2024-03-30T12:57:55.898 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-30T12:57:55.898 DEBUG:teuthology.run:Teuthology command: teuthology --name mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi --verbose --owner scheduled_mchangir@teuthology --archive /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/uninlining} -- /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154/orig.config.yaml 2024-03-30T12:57:55.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T12:57:56.052 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154 branch: wip-mchangir-testing1-main-20240328-072412 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/uninlining} email: mchangir@redhat.com first_in_suite: false job_id: '7629154' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing1-main-20240328-072412 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing1-main-20240328-072412 sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 owner: scheduled_mchangir@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 364 sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-mchangir-testing1-main-20240328-072412 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHTcTYBQ2jxpk8rcJzsWSoaYXcH6H35u4YT/BbNU//5s5R094eBAT2CKdDIquvZQ/lcFnPnLjS2wUYN56GCIixg= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9UJ+Hq2NYgak2LvH0ObOKoIyQPk5Hw1kpe6/jE2GSyXUIunDKTKky+sQlaAgoiVYmgmrk/e7vohRdkcZ9+gqY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_uninlining teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-29_13:38:54 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-30T12:57:56.052 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa; will attempt to use it 2024-03-30T12:57:56.053 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks 2024-03-30T12:57:56.053 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-30T12:57:56.055 INFO:teuthology.task.internal:Checking packages... 2024-03-30T12:57:56.079 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7' 2024-03-30T12:57:56.079 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-30T12:57:56.079 INFO:teuthology.packaging:ref: None 2024-03-30T12:57:56.079 INFO:teuthology.packaging:tag: None 2024-03-30T12:57:56.079 INFO:teuthology.packaging:branch: wip-mchangir-testing1-main-20240328-072412 2024-03-30T12:57:56.079 INFO:teuthology.packaging:sha1: ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T12:57:56.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing1-main-20240328-072412 2024-03-30T12:57:56.225 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2519.gac171039 2024-03-30T12:57:56.227 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-30T12:57:56.233 INFO:teuthology.task.internal:no buildpackages task found 2024-03-30T12:57:56.233 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-30T12:57:56.348 INFO:teuthology.task.internal:Saving configuration 2024-03-30T12:57:56.367 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-30T12:57:56.397 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T12:57:56.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 12:52:53.676762', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHTcTYBQ2jxpk8rcJzsWSoaYXcH6H35u4YT/BbNU//5s5R094eBAT2CKdDIquvZQ/lcFnPnLjS2wUYN56GCIixg='} 2024-03-30T12:57:56.441 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 12:52:53.678725', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9UJ+Hq2NYgak2LvH0ObOKoIyQPk5Hw1kpe6/jE2GSyXUIunDKTKky+sQlaAgoiVYmgmrk/e7vohRdkcZ9+gqY='} 2024-03-30T12:57:56.441 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-30T12:57:56.447 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-30T12:57:56.447 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-30T12:57:56.447 INFO:teuthology.run_tasks:Running task console_log... 2024-03-30T12:57:56.579 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4aa2d46f70>, signals=[15]) 2024-03-30T12:57:56.579 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-30T12:57:56.585 INFO:teuthology.task.internal:Opening connections... 2024-03-30T12:57:56.585 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T12:57:56.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:57:56.696 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T12:57:56.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T12:57:56.784 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-30T12:57:56.791 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-03-30T12:57:56.808 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-03-30T12:57:56.808 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-03-30T12:57:56.865 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-03-30T12:57:56.865 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-03-30T12:57:56.865 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-03-30T12:57:56.865 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-03-30T12:57:56.865 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-03-30T12:57:56.865 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-03-30T12:57:56.866 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T12:57:56.866 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-03-30T12:57:56.866 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-03-30T12:57:56.866 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T12:57:56.866 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-03-30T12:57:56.866 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T12:57:56.866 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T12:57:56.866 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T12:57:56.867 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-03-30T12:57:56.896 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-03-30T12:57:56.914 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-03-30T12:57:56.914 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-03-30T12:57:56.971 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2024-03-30T12:57:56.971 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2024-03-30T12:57:56.971 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2024-03-30T12:57:56.972 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2024-03-30T12:57:56.972 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2024-03-30T12:57:56.972 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2024-03-30T12:57:56.972 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-30T12:57:56.972 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2024-03-30T12:57:56.972 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2024-03-30T12:57:56.972 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-30T12:57:56.972 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2024-03-30T12:57:56.972 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-30T12:57:56.972 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-30T12:57:56.972 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-30T12:57:56.972 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-03-30T12:57:56.996 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-30T12:57:57.005 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-30T12:57:57.045 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-30T12:57:57.046 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-03-30T12:57:57.048 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-03-30T12:57:57.064 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-30T12:57:57.081 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-30T12:57:57.082 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-03-30T12:57:57.106 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-03-30T12:57:57.138 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-30T12:57:57.194 INFO:teuthology.run_tasks:Running task kernel... 2024-03-30T12:57:57.211 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-30T12:57:57.211 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-03-30T12:57:57.211 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-03-30T12:57:57.212 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T12:57:57.213 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-30T12:57:57.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:57:57.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T12:57:57.231 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-30T12:57:57.233 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-30T12:57:57.432 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T12:57:57.432 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-30T12:57:57.433 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-03-30T12:57:57.450 DEBUG:teuthology.task.kernel:sha1 for client.1 is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T12:57:57.451 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-30T12:57:57.451 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-03-30T12:57:57.452 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-361.el9.x86_64 2024-03-30T12:57:57.452 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T12:57:57.452 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-30T12:57:57.453 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum upgrade -y linux-firmware 2024-03-30T12:57:57.470 INFO:teuthology.orchestra.run.smithi151.stdout:5.14.0-361.el9.x86_64 2024-03-30T12:57:57.470 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T12:57:57.470 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-30T12:57:57.471 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum upgrade -y linux-firmware 2024-03-30T12:57:59.669 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-30T12:57:59.793 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-30T12:58:01.111 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-03-30T12:58:01.183 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.0 MB 00:00 2024-03-30T12:58:01.886 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-03-30T12:58:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-03-30T12:58:07.929 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.1 MB 00:00 2024-03-30T12:58:09.338 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 16 kB 00:00 2024-03-30T12:58:10.198 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 28 MB/s | 21 MB 00:00 2024-03-30T12:58:10.672 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 888 kB/s | 8.0 MB 00:09 2024-03-30T12:58:12.423 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-03-30T12:58:15.407 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-03-30T12:58:16.899 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 6.0 MB/s | 6.1 MB 00:01 2024-03-30T12:58:17.804 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-30T12:58:17.812 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-30T12:58:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-03-30T12:58:17.812 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-30T12:58:17.812 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-03-30T12:58:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-30T12:58:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T12:58:17.812 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-30T12:58:17.812 INFO:teuthology.orchestra.run.smithi044.stdout:================================================================================ 2024-03-30T12:58:17.812 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 1 Package 2024-03-30T12:58:17.812 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T12:58:17.812 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 375 M 2024-03-30T12:58:17.813 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-30T12:58:18.391 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 16 kB 00:00 2024-03-30T12:58:19.468 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-03-30T12:58:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 7.5 kB/s | 1.7 kB 00:00 2024-03-30T12:58:24.974 INFO:teuthology.orchestra.run.smithi044.stdout:linux-firmware-20240219-143.el9.noarch.rpm 52 MB/s | 375 MB 00:07 2024-03-30T12:58:24.975 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-30T12:58:24.976 INFO:teuthology.orchestra.run.smithi044.stdout:Total 52 MB/s | 375 MB 00:07 2024-03-30T12:58:24.976 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-30T12:58:25.064 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-30T12:58:25.064 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-30T12:58:27.030 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-03-30T12:58:27.038 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-03-30T12:58:27.038 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-03-30T12:58:27.038 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-03-30T12:58:27.038 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2024-03-30T12:58:27.038 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-30T12:58:27.038 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T12:58:27.039 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-03-30T12:58:27.039 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2024-03-30T12:58:27.039 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 1 Package 2024-03-30T12:58:27.039 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T12:58:27.039 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 375 M 2024-03-30T12:58:27.039 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-03-30T12:58:27.565 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-30T12:58:27.566 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-30T12:58:34.284 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-30T12:58:34.521 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-30T12:58:34.626 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T12:58:34.752 INFO:teuthology.orchestra.run.smithi151.stdout:linux-firmware-20240219-143.el9.noarch.rpm 49 MB/s | 375 MB 00:07 2024-03-30T12:58:34.753 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-03-30T12:58:34.753 INFO:teuthology.orchestra.run.smithi151.stdout:Total 49 MB/s | 375 MB 00:07 2024-03-30T12:58:34.753 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-03-30T12:58:34.857 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-03-30T12:58:34.857 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-03-30T12:58:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T12:58:35.949 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-30T12:58:36.376 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T12:58:36.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T12:58:36.377 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-03-30T12:58:36.377 INFO:teuthology.orchestra.run.smithi044.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-30T12:58:36.377 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T12:58:36.377 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-30T12:58:36.678 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-30T12:58:36.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T12:58:36.905 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-30T12:58:36.905 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-30T12:58:36.907 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi044.front.sepia.ceph.com to complete... 2024-03-30T12:58:37.349 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-03-30T12:58:37.349 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-03-30T12:58:43.803 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-03-30T12:58:44.012 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-30T12:58:44.093 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T12:58:45.523 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T12:58:45.523 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-30T12:58:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-30T12:58:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T12:58:45.931 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2024-03-30T12:58:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-30T12:58:45.931 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T12:58:45.932 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-03-30T12:58:46.224 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.1... 2024-03-30T12:58:46.225 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-30T12:58:46.375 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-30T12:58:46.375 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-30T12:58:46.378 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi151.front.sepia.ceph.com to complete... 2024-03-30T12:58:50.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30 12:58:50 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-30T12:58:50.147 INFO:teuthology.orchestra.run.smithi044.stderr:FINISHED --2024-03-30 12:58:50-- 2024-03-30T12:58:50.147 INFO:teuthology.orchestra.run.smithi044.stderr:Total wall clock time: 13s 2024-03-30T12:58:50.147 INFO:teuthology.orchestra.run.smithi044.stderr:Downloaded: 1 files, 321M in 13s (25.0 MB/s) 2024-03-30T12:58:50.150 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-30T12:58:50.150 DEBUG:teuthology.orchestra.run.smithi044:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-30T12:58:52.185 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying... ######################################## 2024-03-30T12:58:52.240 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing... ######################################## 2024-03-30T12:58:52.324 INFO:teuthology.orchestra.run.smithi044.stdout:Updating / installing... 2024-03-30T12:59:00.136 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-30T12:59:16.268 INFO:teuthology.orchestra.run.smithi044.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-30T12:59:16.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30 12:59:16 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-30T12:59:16.941 INFO:teuthology.orchestra.run.smithi151.stderr:FINISHED --2024-03-30 12:59:16-- 2024-03-30T12:59:16.942 INFO:teuthology.orchestra.run.smithi151.stderr:Total wall clock time: 31s 2024-03-30T12:59:16.942 INFO:teuthology.orchestra.run.smithi151.stderr:Downloaded: 1 files, 321M in 30s (10.7 MB/s) 2024-03-30T12:59:16.945 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.1... 2024-03-30T12:59:16.945 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-30T12:59:18.890 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying... ######################################## 2024-03-30T12:59:19.036 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing... ######################################## 2024-03-30T12:59:19.116 INFO:teuthology.orchestra.run.smithi151.stdout:Updating / installing... 2024-03-30T12:59:26.680 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-30T12:59:39.515 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi044.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-30T12:59:39.515 DEBUG:teuthology.orchestra.run.smithi044:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-30T12:59:39.594 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-30T12:59:39.594 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-30T12:59:39.594 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-30T12:59:39.594 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-30T12:59:39.594 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-30T12:59:39.594 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-30T12:59:39.595 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-30T12:59:39.596 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-30T12:59:39.597 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-30T12:59:39.598 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-30T12:59:39.599 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-30T12:59:39.600 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-30T12:59:39.601 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-30T12:59:39.602 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-30T12:59:39.603 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-30T12:59:39.604 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-30T12:59:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-30T12:59:39.606 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-30T12:59:39.607 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-30T12:59:39.608 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-30T12:59:39.609 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-30T12:59:39.610 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-30T12:59:39.611 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-30T12:59:39.612 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-30T12:59:39.613 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-30T12:59:39.614 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-30T12:59:39.615 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-30T12:59:39.616 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-30T12:59:39.617 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-30T12:59:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-30T12:59:39.619 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-30T12:59:39.620 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-30T12:59:39.621 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-30T12:59:39.622 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-30T12:59:39.623 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-30T12:59:39.624 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-30T12:59:39.625 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-30T12:59:39.626 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-30T12:59:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-30T12:59:39.628 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-30T12:59:39.629 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-30T12:59:39.630 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-30T12:59:39.631 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-30T12:59:39.632 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-30T12:59:39.633 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-30T12:59:39.634 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-30T12:59:39.635 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-30T12:59:39.636 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-30T12:59:39.637 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-30T12:59:39.638 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-30T12:59:39.639 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-30T12:59:39.640 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-30T12:59:39.641 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-30T12:59:39.642 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-30T12:59:39.643 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-30T12:59:39.644 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-30T12:59:39.645 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-30T12:59:39.646 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-30T12:59:39.647 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-30T12:59:39.648 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-30T12:59:39.649 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-30T12:59:39.650 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-30T12:59:39.651 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-30T12:59:39.652 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-30T12:59:39.653 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-30T12:59:39.654 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-30T12:59:39.655 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-30T12:59:39.656 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-30T12:59:39.657 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-30T12:59:39.658 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-30T12:59:39.659 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-30T12:59:39.660 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-30T12:59:39.661 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-30T12:59:39.662 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-30T12:59:39.663 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-30T12:59:39.664 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-30T12:59:39.665 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-30T12:59:39.666 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-30T12:59:39.667 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-30T12:59:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-30T12:59:39.669 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-30T12:59:39.670 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-30T12:59:39.671 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-30T12:59:39.672 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-30T12:59:39.673 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-30T12:59:39.674 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-30T12:59:39.675 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-30T12:59:39.676 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-30T12:59:39.677 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-30T12:59:39.678 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-30T12:59:39.679 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-30T12:59:39.680 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-30T12:59:39.681 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-30T12:59:39.682 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-30T12:59:39.683 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-30T12:59:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-30T12:59:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-30T12:59:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-30T12:59:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-30T12:59:39.688 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-30T12:59:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-30T12:59:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-30T12:59:39.691 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-30T12:59:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-30T12:59:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-30T12:59:39.694 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-30T12:59:39.695 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-30T12:59:39.696 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-30T12:59:39.697 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-30T12:59:39.698 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-30T12:59:39.699 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-30T12:59:39.700 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-30T12:59:39.701 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-30T12:59:39.702 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-30T12:59:39.703 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-30T12:59:39.704 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-30T12:59:39.705 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-30T12:59:39.706 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-30T12:59:39.707 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-30T12:59:39.708 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-30T12:59:39.709 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-30T12:59:39.710 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-30T12:59:39.711 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-30T12:59:39.712 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-30T12:59:39.713 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-30T12:59:39.713 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-30T12:59:39.713 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-30T12:59:39.713 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-30T12:59:39.713 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-30T12:59:39.713 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-30T12:59:39.714 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-30T12:59:39.715 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-30T12:59:39.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-30T12:59:39.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-30T12:59:39.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-30T12:59:39.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-30T12:59:39.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-30T12:59:39.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-30T12:59:39.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-30T12:59:39.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-30T12:59:39.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-30T12:59:39.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-30T12:59:39.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-30T12:59:39.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-30T12:59:39.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-30T12:59:39.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-30T12:59:39.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-30T12:59:39.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-30T12:59:39.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-30T12:59:39.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-30T12:59:39.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-30T12:59:39.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-30T12:59:39.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-30T12:59:39.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-30T12:59:39.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-30T12:59:39.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-30T12:59:39.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-30T12:59:39.734 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-30T12:59:39.734 DEBUG:teuthology.orchestra.run.smithi044:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-30T12:59:39.757 INFO:teuthology.orchestra.run.smithi044.stdout:postinstall scriptlet (using /bin/sh): 2024-03-30T12:59:39.757 INFO:teuthology.orchestra.run.smithi044.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-30T12:59:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-30T12:59:39.757 INFO:teuthology.orchestra.run.smithi044.stdout:fi 2024-03-30T12:59:39.757 INFO:teuthology.orchestra.run.smithi044.stdout:for file in vmlinuz System.map config; do 2024-03-30T12:59:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-30T12:59:39.757 INFO:teuthology.orchestra.run.smithi044.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-30T12:59:39.758 INFO:teuthology.orchestra.run.smithi044.stdout: fi 2024-03-30T12:59:39.758 INFO:teuthology.orchestra.run.smithi044.stdout:done 2024-03-30T12:59:39.758 INFO:teuthology.orchestra.run.smithi044.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-30T12:59:39.758 INFO:teuthology.orchestra.run.smithi044.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-30T12:59:39.758 INFO:teuthology.orchestra.run.smithi044.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-30T12:59:39.758 INFO:teuthology.orchestra.run.smithi044.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-30T12:59:39.758 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-30T12:59:39.758 INFO:teuthology.orchestra.run.smithi044.stdout:fi 2024-03-30T12:59:39.758 INFO:teuthology.orchestra.run.smithi044.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-30T12:59:39.759 INFO:teuthology.orchestra.run.smithi044.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-30T12:59:39.759 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-30T12:59:39.759 INFO:teuthology.orchestra.run.smithi044.stdout:fi 2024-03-30T12:59:39.760 DEBUG:teuthology.orchestra.run.smithi044:> sudo rpm -qi grub2-tools 2024-03-30T12:59:39.839 INFO:teuthology.orchestra.run.smithi044.stdout:Name : grub2-tools 2024-03-30T12:59:39.839 INFO:teuthology.orchestra.run.smithi044.stdout:Epoch : 1 2024-03-30T12:59:39.839 INFO:teuthology.orchestra.run.smithi044.stdout:Version : 2.06 2024-03-30T12:59:39.839 INFO:teuthology.orchestra.run.smithi044.stdout:Release : 68.el9 2024-03-30T12:59:39.839 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: x86_64 2024-03-30T12:59:39.839 INFO:teuthology.orchestra.run.smithi044.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-30T12:59:39.839 INFO:teuthology.orchestra.run.smithi044.stdout:Group : Unspecified 2024-03-30T12:59:39.839 INFO:teuthology.orchestra.run.smithi044.stdout:Size : 8264254 2024-03-30T12:59:39.839 INFO:teuthology.orchestra.run.smithi044.stdout:License : GPLv3+ 2024-03-30T12:59:39.839 INFO:teuthology.orchestra.run.smithi044.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-30T12:59:39.839 INFO:teuthology.orchestra.run.smithi044.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout:Packager : builder@centos.org 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout:Vendor : CentOS 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout:Summary : Support tools for GRUB. 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout:Description : 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout:hardware devices. 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T12:59:39.840 INFO:teuthology.orchestra.run.smithi044.stdout:This subpackage provides tools for support of all platforms. 2024-03-30T12:59:39.841 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-30T12:59:39.841 INFO:teuthology.task.kernel:Updating grub on smithi044 to boot 6.8.0-g1df0c7e8a235 2024-03-30T12:59:39.841 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-30T12:59:40.476 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-03-30T12:59:41.426 INFO:teuthology.orchestra.run.smithi151.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-30T12:59:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-30T12:59:41.903 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-03-30T12:59:41.905 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-03-30T12:59:41.920 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.TwjbGbVsZM 2024-03-30T12:59:41.920 DEBUG:teuthology.orchestra.run.smithi044:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TwjbGbVsZM 2024-03-30T12:59:41.992 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.TwjbGbVsZM 2024-03-30T12:59:42.139 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.TwjbGbVsZM is 6KB 2024-03-30T12:59:42.190 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.TwjbGbVsZM 2024-03-30T12:59:42.204 DEBUG:teuthology.orchestra.run.smithi044:> sudo /bin/ls /boot/loader/entries || true 2024-03-30T12:59:42.273 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-30T12:59:42.273 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-30T12:59:42.273 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-30T12:59:42.273 INFO:teuthology.orchestra.run.smithi044.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-30T12:59:42.274 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-30T12:59:42.443 DEBUG:teuthology.orchestra.run.smithi044:> sudo shutdown -r now 2024-03-30T13:00:03.808 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-30T13:00:03.809 DEBUG:teuthology.orchestra.run.smithi151:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-30T13:00:03.881 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-30T13:00:03.881 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-30T13:00:03.881 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-30T13:00:03.881 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-30T13:00:03.881 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-30T13:00:03.881 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-30T13:00:03.881 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-30T13:00:03.881 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-30T13:00:03.881 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-30T13:00:03.882 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-30T13:00:03.883 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-30T13:00:03.884 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-30T13:00:03.884 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-30T13:00:03.884 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-30T13:00:03.884 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-30T13:00:03.884 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-30T13:00:03.884 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-30T13:00:03.884 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-30T13:00:03.884 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-30T13:00:03.884 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-30T13:00:03.884 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-30T13:00:03.885 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-30T13:00:03.885 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-30T13:00:03.885 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-30T13:00:03.885 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-30T13:00:03.885 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-30T13:00:03.885 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-30T13:00:03.885 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-30T13:00:03.885 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-30T13:00:03.886 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-30T13:00:03.886 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-30T13:00:03.886 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-30T13:00:03.886 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-30T13:00:03.886 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-30T13:00:03.886 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-30T13:00:03.886 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-30T13:00:03.886 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-30T13:00:03.887 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-30T13:00:03.888 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-30T13:00:03.889 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-30T13:00:03.890 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-30T13:00:03.891 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-30T13:00:03.892 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-30T13:00:03.893 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-30T13:00:03.894 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-30T13:00:03.895 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-30T13:00:03.895 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-30T13:00:03.895 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-30T13:00:03.895 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-30T13:00:03.895 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-30T13:00:03.895 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-30T13:00:03.895 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-30T13:00:03.895 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-30T13:00:03.895 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-30T13:00:03.895 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-30T13:00:03.896 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-30T13:00:03.897 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-30T13:00:03.898 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-30T13:00:03.899 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-30T13:00:03.899 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-30T13:00:03.899 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-30T13:00:03.899 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-30T13:00:03.899 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-30T13:00:03.899 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-30T13:00:03.899 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-30T13:00:03.899 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-30T13:00:03.899 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-30T13:00:03.899 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-30T13:00:03.899 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-30T13:00:03.900 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-30T13:00:03.901 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-30T13:00:03.902 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-30T13:00:03.903 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-30T13:00:03.904 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-30T13:00:03.905 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-30T13:00:03.905 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-30T13:00:03.905 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-30T13:00:03.905 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-30T13:00:03.905 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-30T13:00:03.905 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-30T13:00:03.905 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-30T13:00:03.905 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-30T13:00:03.905 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-30T13:00:03.905 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-30T13:00:03.906 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-30T13:00:03.907 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-30T13:00:03.908 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-30T13:00:03.909 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-30T13:00:03.910 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-30T13:00:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-30T13:00:03.912 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-30T13:00:03.912 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-30T13:00:03.912 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-30T13:00:03.912 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-30T13:00:03.912 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-30T13:00:03.912 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-30T13:00:03.912 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-30T13:00:03.912 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-30T13:00:03.912 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-30T13:00:03.913 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-30T13:00:03.914 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-30T13:00:03.915 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-30T13:00:03.916 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-30T13:00:03.916 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-30T13:00:03.916 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-30T13:00:03.916 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-30T13:00:03.916 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-30T13:00:03.916 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-30T13:00:03.916 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-30T13:00:03.916 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-30T13:00:03.916 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-30T13:00:03.916 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-30T13:00:03.916 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-30T13:00:03.917 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-30T13:00:03.918 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-30T13:00:03.919 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-30T13:00:03.920 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-30T13:00:03.920 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-30T13:00:03.920 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-30T13:00:03.920 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-30T13:00:03.920 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-30T13:00:03.920 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-30T13:00:03.920 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-30T13:00:03.920 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-30T13:00:03.920 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-30T13:00:03.920 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-30T13:00:03.921 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-30T13:00:03.922 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-30T13:00:03.923 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-30T13:00:03.924 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-30T13:00:03.925 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-30T13:00:03.926 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-30T13:00:03.926 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-30T13:00:03.926 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-30T13:00:03.926 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-30T13:00:03.926 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-30T13:00:03.926 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-30T13:00:03.926 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-30T13:00:03.926 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-30T13:00:03.926 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-30T13:00:03.926 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-30T13:00:03.927 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-30T13:00:03.928 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-30T13:00:03.929 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-30T13:00:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-30T13:00:03.931 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-30T13:00:03.932 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-30T13:00:03.933 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-30T13:00:03.934 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-30T13:00:03.935 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-30T13:00:03.936 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-30T13:00:03.936 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-30T13:00:03.936 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-30T13:00:03.936 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-30T13:00:03.936 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-30T13:00:03.936 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-30T13:00:03.936 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-30T13:00:03.936 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-30T13:00:03.936 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-30T13:00:03.937 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-30T13:00:03.938 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-30T13:00:03.939 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-30T13:00:03.940 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-30T13:00:03.941 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-30T13:00:03.942 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-30T13:00:03.943 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-30T13:00:03.944 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-30T13:00:03.945 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-30T13:00:03.946 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-30T13:00:03.947 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-30T13:00:03.947 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-30T13:00:03.947 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-30T13:00:03.947 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-30T13:00:03.947 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-30T13:00:03.947 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-30T13:00:03.947 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-30T13:00:03.947 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-30T13:00:03.947 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-30T13:00:03.947 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-30T13:00:03.948 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-30T13:00:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-30T13:00:03.950 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-30T13:00:03.951 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-30T13:00:03.952 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-30T13:00:03.953 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-30T13:00:03.954 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-30T13:00:03.955 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-30T13:00:03.956 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-30T13:00:03.957 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-30T13:00:03.958 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-30T13:00:03.959 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-30T13:00:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-30T13:00:03.961 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-30T13:00:03.962 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-30T13:00:03.963 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-30T13:00:03.964 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-30T13:00:03.965 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-30T13:00:03.966 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-30T13:00:03.967 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-30T13:00:03.968 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-30T13:00:03.969 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-30T13:00:03.970 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-30T13:00:03.971 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-30T13:00:03.972 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-30T13:00:03.973 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-30T13:00:03.974 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-30T13:00:03.975 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-30T13:00:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-30T13:00:03.977 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-30T13:00:03.978 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-30T13:00:03.978 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-30T13:00:03.978 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-30T13:00:03.978 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-30T13:00:03.978 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-30T13:00:03.978 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-30T13:00:03.978 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-30T13:00:03.978 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-30T13:00:03.978 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-30T13:00:03.978 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-30T13:00:03.979 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-30T13:00:03.980 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-30T13:00:03.981 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-30T13:00:03.982 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-30T13:00:03.983 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-30T13:00:03.984 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-30T13:00:03.985 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-30T13:00:03.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-30T13:00:03.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-30T13:00:03.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-30T13:00:03.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-30T13:00:03.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-30T13:00:03.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-30T13:00:03.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-30T13:00:03.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-30T13:00:03.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-30T13:00:03.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-30T13:00:03.986 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-30T13:00:03.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-30T13:00:03.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-30T13:00:03.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-30T13:00:03.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-30T13:00:03.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-30T13:00:03.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-30T13:00:03.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-30T13:00:03.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-30T13:00:03.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-30T13:00:03.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-30T13:00:03.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-30T13:00:03.987 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-30T13:00:03.988 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-30T13:00:03.989 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-30T13:00:03.990 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-30T13:00:03.991 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-30T13:00:03.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-30T13:00:03.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-30T13:00:03.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-30T13:00:03.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-30T13:00:03.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-30T13:00:03.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-30T13:00:03.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-30T13:00:03.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-30T13:00:03.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-30T13:00:03.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-30T13:00:03.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-30T13:00:03.992 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-30T13:00:03.993 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-30T13:00:03.994 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-30T13:00:03.995 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-30T13:00:03.996 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-30T13:00:03.997 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-30T13:00:03.998 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-30T13:00:03.999 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-30T13:00:04.000 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-30T13:00:04.001 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-30T13:00:04.002 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-30T13:00:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-30T13:00:04.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-30T13:00:04.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-30T13:00:04.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-30T13:00:04.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-30T13:00:04.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-30T13:00:04.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-30T13:00:04.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-30T13:00:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-30T13:00:04.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-30T13:00:04.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-30T13:00:04.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-30T13:00:04.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-30T13:00:04.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-30T13:00:04.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-30T13:00:04.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-30T13:00:04.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-30T13:00:04.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-30T13:00:04.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-30T13:00:04.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-30T13:00:04.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-30T13:00:04.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-30T13:00:04.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-30T13:00:04.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-30T13:00:04.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-30T13:00:04.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-30T13:00:04.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-30T13:00:04.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-30T13:00:04.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-30T13:00:04.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-30T13:00:04.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-30T13:00:04.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-30T13:00:04.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-30T13:00:04.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-30T13:00:04.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-30T13:00:04.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-30T13:00:04.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-30T13:00:04.026 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-30T13:00:04.027 DEBUG:teuthology.orchestra.run.smithi151:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-30T13:00:04.048 INFO:teuthology.orchestra.run.smithi151.stdout:postinstall scriptlet (using /bin/sh): 2024-03-30T13:00:04.048 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-30T13:00:04.048 INFO:teuthology.orchestra.run.smithi151.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-30T13:00:04.048 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout:for file in vmlinuz System.map config; do 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout: fi 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout:done 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-30T13:00:04.049 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-30T13:00:04.050 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2024-03-30T13:00:04.050 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -qi grub2-tools 2024-03-30T13:00:04.124 INFO:teuthology.orchestra.run.smithi151.stdout:Name : grub2-tools 2024-03-30T13:00:04.125 INFO:teuthology.orchestra.run.smithi151.stdout:Epoch : 1 2024-03-30T13:00:04.125 INFO:teuthology.orchestra.run.smithi151.stdout:Version : 2.06 2024-03-30T13:00:04.125 INFO:teuthology.orchestra.run.smithi151.stdout:Release : 68.el9 2024-03-30T13:00:04.125 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: x86_64 2024-03-30T13:00:04.125 INFO:teuthology.orchestra.run.smithi151.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-30T13:00:04.125 INFO:teuthology.orchestra.run.smithi151.stdout:Group : Unspecified 2024-03-30T13:00:04.125 INFO:teuthology.orchestra.run.smithi151.stdout:Size : 8264254 2024-03-30T13:00:04.125 INFO:teuthology.orchestra.run.smithi151.stdout:License : GPLv3+ 2024-03-30T13:00:04.125 INFO:teuthology.orchestra.run.smithi151.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-30T13:00:04.125 INFO:teuthology.orchestra.run.smithi151.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-30T13:00:04.125 INFO:teuthology.orchestra.run.smithi151.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-30T13:00:04.125 INFO:teuthology.orchestra.run.smithi151.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-30T13:00:04.126 INFO:teuthology.orchestra.run.smithi151.stdout:Packager : builder@centos.org 2024-03-30T13:00:04.126 INFO:teuthology.orchestra.run.smithi151.stdout:Vendor : CentOS 2024-03-30T13:00:04.126 INFO:teuthology.orchestra.run.smithi151.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-30T13:00:04.126 INFO:teuthology.orchestra.run.smithi151.stdout:Summary : Support tools for GRUB. 2024-03-30T13:00:04.126 INFO:teuthology.orchestra.run.smithi151.stdout:Description : 2024-03-30T13:00:04.126 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:00:04.126 INFO:teuthology.orchestra.run.smithi151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-30T13:00:04.126 INFO:teuthology.orchestra.run.smithi151.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-30T13:00:04.126 INFO:teuthology.orchestra.run.smithi151.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-30T13:00:04.126 INFO:teuthology.orchestra.run.smithi151.stdout:hardware devices. 2024-03-30T13:00:04.126 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:00:04.126 INFO:teuthology.orchestra.run.smithi151.stdout:This subpackage provides tools for support of all platforms. 2024-03-30T13:00:04.127 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-30T13:00:04.127 INFO:teuthology.task.kernel:Updating grub on smithi151 to boot 6.8.0-g1df0c7e8a235 2024-03-30T13:00:04.127 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-30T13:00:04.601 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2024-03-30T13:00:06.021 INFO:teuthology.orchestra.run.smithi151.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-30T13:00:06.069 INFO:teuthology.orchestra.run.smithi151.stderr:done 2024-03-30T13:00:06.080 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-03-30T13:00:06.095 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.QscgdmR0LN 2024-03-30T13:00:06.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QscgdmR0LN 2024-03-30T13:00:06.166 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.QscgdmR0LN 2024-03-30T13:00:06.318 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.QscgdmR0LN is 6KB 2024-03-30T13:00:06.366 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.QscgdmR0LN 2024-03-30T13:00:06.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo /bin/ls /boot/loader/entries || true 2024-03-30T13:00:06.450 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-30T13:00:06.450 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-30T13:00:06.450 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-30T13:00:06.450 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-30T13:00:06.451 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-30T13:00:06.607 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2024-03-30T13:00:12.450 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-30T13:00:12.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-30T13:00:12.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:00:30.879 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-03-30T13:00:36.614 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-30T13:00:36.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-30T13:00:36.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:00:39.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-30T13:00:39.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:00:54.942 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-30T13:01:03.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-30T13:01:03.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:01:07.010 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-30T13:01:19.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-30T13:01:19.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:01:37.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-30T13:01:39.886 DEBUG:teuthology.orchestra.remote:timed out 2024-03-30T13:01:51.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-30T13:01:51.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:01:52.330 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-03-30T13:01:52.439 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-30T13:01:52.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:01:52.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-30T13:01:52.987 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-g1df0c7e8a235"... 2024-03-30T13:01:52.987 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-03-30T13:01:53.039 INFO:teuthology.orchestra.run.smithi044.stdout:6.8.0-g1df0c7e8a235 2024-03-30T13:01:53.040 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-30T13:01:53.040 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T13:01:53.040 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-30T13:01:54.041 DEBUG:teuthology.parallel:result is None 2024-03-30T13:01:54.350 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-03-30T13:01:54.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-30T13:01:54.917 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.8.0-g1df0c7e8a235"... 2024-03-30T13:01:54.917 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-03-30T13:01:54.955 INFO:teuthology.orchestra.run.smithi151.stdout:6.8.0-g1df0c7e8a235 2024-03-30T13:01:54.955 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-30T13:01:54.955 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-30T13:01:54.955 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-30T13:01:55.956 DEBUG:teuthology.parallel:result is None 2024-03-30T13:01:55.957 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-30T13:01:55.967 INFO:teuthology.task.internal:Creating test directory... 2024-03-30T13:01:55.967 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T13:01:55.974 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-30T13:01:56.028 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-30T13:01:56.034 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-30T13:01:56.057 INFO:teuthology.task.internal:Creating archive directory... 2024-03-30T13:01:56.057 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T13:01:56.064 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-30T13:01:56.133 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-30T13:01:56.140 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-30T13:01:56.140 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T13:01:56.145 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-30T13:01:56.266 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T13:01:56.268 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T13:01:56.331 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T13:01:56.353 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-30T13:01:56.357 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-30T13:01:56.366 INFO:teuthology.task.internal:Configuring sudo... 2024-03-30T13:01:56.366 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T13:01:56.373 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-30T13:01:56.468 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-30T13:01:56.477 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-30T13:01:56.477 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T13:01:56.484 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-30T13:01:56.533 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T13:01:56.615 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T13:01:56.726 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T13:01:56.815 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T13:01:56.918 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:01:56.918 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T13:01:57.018 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T13:01:57.100 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-30T13:01:57.183 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T13:01:57.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-30T13:01:57.340 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:01:57.340 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-30T13:01:57.422 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-03-30T13:01:57.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-03-30T13:01:57.524 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T13:01:57.550 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T13:01:57.880 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-30T13:01:57.888 INFO:teuthology.task.internal:Starting timer... 2024-03-30T13:01:57.888 INFO:teuthology.run_tasks:Running task pcp... 2024-03-30T13:01:57.940 INFO:teuthology.run_tasks:Running task selinux... 2024-03-30T13:01:57.970 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-30T13:01:57.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2024-03-30T13:01:58.098 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2024-03-30T13:01:58.103 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2024-03-30T13:01:58.230 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2024-03-30T13:01:58.234 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-30T13:01:58.234 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2024-03-30T13:01:58.298 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2024-03-30T13:01:58.299 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2024-03-30T13:01:58.349 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2024-03-30T13:01:58.349 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2024-03-30T13:01:58.350 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-30T13:01:58.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:01:58.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-30T13:01:58.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:01:58.507 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-30T13:01:58.507 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2024-03-30T13:01:58.612 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2024-03-30T13:01:58.702 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-30T13:01:58.715 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-30T13:01:58.721 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-30T13:01:58.847 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-30T13:01:58.864 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-30T13:01:58.865 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-30T13:08:18.544 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-03-30T13:08:18.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-30T13:08:18.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:08:18.698 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-03-30T13:08:18.864 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-30T13:08:18.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-30T13:08:18.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-30T13:08:19.007 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-03-30T13:08:19.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-30T13:08:19.163 INFO:teuthology.run_tasks:Running task clock... 2024-03-30T13:08:19.174 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-30T13:08:19.175 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T13:08:19.175 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:08:19.183 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-30T13:08:19.183 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:08:19.282 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-30T13:08:19.283 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-30T13:08:19.334 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-30T13:08:19.336 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-30T13:08:19.426 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2024-03-30T13:08:19.434 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2024-03-30T13:08:19.467 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2024-03-30T13:08:19.482 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2024-03-30T13:08:19.517 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-30T13:08:19.536 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-30T13:08:19.567 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-30T13:08:19.592 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-30T13:08:19.691 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-03-30T13:08:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T13:08:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-03-30T13:08:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:08:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:08:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:08:19.700 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:08:19.731 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-03-30T13:08:19.740 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T13:08:19.740 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-03-30T13:08:19.740 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:08:19.740 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:08:19.740 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:08:19.740 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:08:19.741 INFO:teuthology.run_tasks:Running task install... 2024-03-30T13:08:19.750 DEBUG:teuthology.task.install:project ceph 2024-03-30T13:08:19.750 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}} 2024-03-30T13:08:19.750 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'} 2024-03-30T13:08:19.750 INFO:teuthology.task.install:Using flavor: default 2024-03-30T13:08:19.756 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-30T13:08:19.756 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-30T13:08:19.756 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'tag': None, 'wait_for_package': False} 2024-03-30T13:08:19.757 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T13:08:19.759 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'tag': None, 'wait_for_package': False} 2024-03-30T13:08:19.759 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T13:08:20.034 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/ 2024-03-30T13:08:20.034 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2519.gac171039 2024-03-30T13:08:20.039 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/ 2024-03-30T13:08:20.039 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2519.gac171039 2024-03-30T13:08:20.148 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-30T13:08:20.149 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:08:20.149 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-30T13:08:20.211 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-30T13:08:20.212 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:08:20.212 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-30T13:08:20.255 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-30T13:08:20.255 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-30T13:08:20.314 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-30T13:08:20.315 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ac1710396f9f7c389fa4b407711bc5157a8c0bf7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-30T13:08:20.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-30T13:08:20.453 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-30T13:08:20.544 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-30T13:08:20.582 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-30T13:08:20.642 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2024-03-30T13:08:20.647 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2024-03-30T13:08:20.664 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2024-03-30T13:08:20.668 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2024-03-30T13:08:21.016 INFO:teuthology.orchestra.run.smithi044.stdout:74 files removed 2024-03-30T13:08:21.023 INFO:teuthology.orchestra.run.smithi151.stdout:74 files removed 2024-03-30T13:08:21.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-30T13:08:21.061 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-30T13:08:21.978 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 203 kB/s | 83 kB 00:00 2024-03-30T13:08:22.049 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 177 kB/s | 83 kB 00:00 2024-03-30T13:08:22.479 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-03-30T13:08:22.624 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 24 kB/s | 12 kB 00:00 2024-03-30T13:08:22.988 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-03-30T13:08:23.125 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-03-30T13:08:23.624 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-30T13:08:23.846 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - AppStream 10 MB/s | 6.7 MB 00:00 2024-03-30T13:08:25.292 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.0 MB 00:00 2024-03-30T13:08:25.663 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2024-03-30T13:08:27.675 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.0 MB 00:01 2024-03-30T13:08:30.249 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-03-30T13:08:34.937 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 888 kB/s | 8.0 MB 00:09 2024-03-30T13:08:35.885 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.1 MB 00:01 2024-03-30T13:08:37.912 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-03-30T13:08:38.966 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 6.8 MB/s | 19 MB 00:02 2024-03-30T13:08:39.486 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-03-30T13:08:43.990 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 6.1 MB 00:01 2024-03-30T13:08:45.522 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-30T13:08:45.997 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 16 kB 00:00 2024-03-30T13:08:47.791 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-03-30T13:08:48.439 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T13:08:48.441 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T13:08:48.465 INFO:teuthology.orchestra.run.smithi044.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-30T13:08:48.466 INFO:teuthology.orchestra.run.smithi044.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-30T13:08:48.468 INFO:teuthology.orchestra.run.smithi044.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-30T13:08:48.469 INFO:teuthology.orchestra.run.smithi044.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-30T13:08:48.472 INFO:teuthology.orchestra.run.smithi044.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-30T13:08:48.476 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-30T13:08:48.477 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-30T13:08:48.572 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-03-30T13:08:48.595 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================================ 2024-03-30T13:08:48.595 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-03-30T13:08:48.595 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================================ 2024-03-30T13:08:48.595 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-03-30T13:08:48.596 INFO:teuthology.orchestra.run.smithi044.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-30T13:08:48.596 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:19.0.0-2519.gac171039.el9 ceph 6.6 k 2024-03-30T13:08:48.596 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:19.0.0-2519.gac171039.el9 ceph 5.4 M 2024-03-30T13:08:48.596 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:19.0.0-2519.gac171039.el9 ceph 891 k 2024-03-30T13:08:48.596 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2519.gac171039.el9 ceph 145 k 2024-03-30T13:08:48.596 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:19.0.0-2519.gac171039.el9 ceph 1.5 M 2024-03-30T13:08:48.596 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 141 k 2024-03-30T13:08:48.596 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 3.5 M 2024-03-30T13:08:48.596 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 7.4 M 2024-03-30T13:08:48.596 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 49 k 2024-03-30T13:08:48.596 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:19.0.0-2519.gac171039.el9 ceph 9.8 M 2024-03-30T13:08:48.596 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:19.0.0-2519.gac171039.el9 ceph 48 M 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 264 k 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 762 k 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror x86_64 2:19.0.0-2519.gac171039.el9 ceph 221 k 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell x86_64 2:19.0.0-2519.gac171039.el9 ceph 27 k 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 18 k 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:19.0.0-2519.gac171039.el9 ceph 32 k 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:19.0.0-2519.gac171039.el9 ceph 746 k 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:19.0.0-2519.gac171039.el9 ceph 127 k 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-30T13:08:48.597 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-30T13:08:48.598 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-30T13:08:48.598 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-30T13:08:48.598 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-30T13:08:48.598 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-30T13:08:48.598 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:19.0.0-2519.gac171039.el9 ceph 162 k 2024-03-30T13:08:48.598 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:19.0.0-2519.gac171039.el9 ceph 321 k 2024-03-30T13:08:48.598 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:19.0.0-2519.gac171039.el9 ceph 298 k 2024-03-30T13:08:48.598 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:19.0.0-2519.gac171039.el9 ceph 99 k 2024-03-30T13:08:48.598 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:19.0.0-2519.gac171039.el9 ceph 85 k 2024-03-30T13:08:48.598 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:19.0.0-2519.gac171039.el9 ceph 3.1 M 2024-03-30T13:08:48.598 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:19.0.0-2519.gac171039.el9 ceph 170 k 2024-03-30T13:08:48.598 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-30T13:08:48.599 INFO:teuthology.orchestra.run.smithi044.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-30T13:08:48.600 INFO:teuthology.orchestra.run.smithi044.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-30T13:08:48.600 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:19.0.0-2519.gac171039.el9 ceph 3.4 M 2024-03-30T13:08:48.600 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:19.0.0-2519.gac171039.el9 ceph 3.1 M 2024-03-30T13:08:48.600 INFO:teuthology.orchestra.run.smithi044.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-30T13:08:48.600 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-30T13:08:48.600 INFO:teuthology.orchestra.run.smithi044.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-30T13:08:48.600 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-30T13:08:48.600 INFO:teuthology.orchestra.run.smithi044.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-30T13:08:48.600 INFO:teuthology.orchestra.run.smithi044.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-30T13:08:48.600 INFO:teuthology.orchestra.run.smithi044.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-30T13:08:48.600 INFO:teuthology.orchestra.run.smithi044.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-30T13:08:48.600 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:19.0.0-2519.gac171039.el9 ceph 21 M 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 34 k 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:19.0.0-2519.gac171039.el9 ceph 2.4 M 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 249 k 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:19.0.0-2519.gac171039.el9 ceph 4.7 M 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:19.0.0-2519.gac171039.el9 ceph 17 M 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 16 k 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:19.0.0-2519.gac171039.el9 ceph 25 k 2024-03-30T13:08:48.601 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-30T13:08:48.602 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-30T13:08:48.602 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-30T13:08:48.602 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-30T13:08:48.602 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-30T13:08:48.602 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-30T13:08:48.602 INFO:teuthology.orchestra.run.smithi044.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-30T13:08:48.602 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-30T13:08:48.602 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-30T13:08:48.602 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:19.0.0-2519.gac171039.el9 ceph 164 k 2024-03-30T13:08:48.602 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-30T13:08:48.603 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-30T13:08:48.603 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-30T13:08:48.603 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-30T13:08:48.603 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-30T13:08:48.603 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:19.0.0-2519.gac171039.el9 ceph 500 k 2024-03-30T13:08:48.603 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-30T13:08:48.603 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:19.0.0-2519.gac171039.el9 ceph 5.1 M 2024-03-30T13:08:48.603 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-30T13:08:48.603 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-30T13:08:48.603 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-30T13:08:48.603 INFO:teuthology.orchestra.run.smithi044.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-30T13:08:48.603 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-30T13:08:48.604 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:19.0.0-2519.gac171039.el9 ceph 45 k 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:19.0.0-2519.gac171039.el9 ceph 134 k 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-30T13:08:48.605 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-30T13:08:48.606 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-30T13:08:48.607 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-30T13:08:48.608 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-03-30T13:08:48.609 INFO:teuthology.orchestra.run.smithi044.stdout:============================================================================================ 2024-03-30T13:08:48.610 INFO:teuthology.orchestra.run.smithi044.stdout:Install 150 Packages 2024-03-30T13:08:48.610 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 24 Packages 2024-03-30T13:08:48.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:08:48.610 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 226 M 2024-03-30T13:08:48.611 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-03-30T13:08:49.406 INFO:teuthology.orchestra.run.smithi044.stdout:(1/174): ceph-19.0.0-2519.gac171039.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-03-30T13:08:49.623 INFO:teuthology.orchestra.run.smithi044.stdout:(2/174): ceph-fuse-19.0.0-2519.gac171039.el9.x8 4.0 MB/s | 891 kB 00:00 2024-03-30T13:08:49.682 INFO:teuthology.orchestra.run.smithi044.stdout:(3/174): ceph-immutable-object-cache-19.0.0-251 2.5 MB/s | 145 kB 00:00 2024-03-30T13:08:49.990 INFO:teuthology.orchestra.run.smithi044.stdout:(4/174): ceph-mds-19.0.0-2519.gac171039.el9.x86 7.7 MB/s | 2.4 MB 00:00 2024-03-30T13:08:50.241 INFO:teuthology.orchestra.run.smithi044.stdout:(5/174): ceph-mgr-19.0.0-2519.gac171039.el9.x86 6.0 MB/s | 1.5 MB 00:00 2024-03-30T13:08:50.416 INFO:teuthology.orchestra.run.smithi044.stdout:(6/174): ceph-base-19.0.0-2519.gac171039.el9.x8 4.2 MB/s | 5.4 MB 00:01 2024-03-30T13:08:50.900 INFO:teuthology.orchestra.run.smithi044.stdout:(7/174): ceph-mon-19.0.0-2519.gac171039.el9.x86 7.1 MB/s | 4.7 MB 00:00 2024-03-30T13:08:51.200 INFO:teuthology.orchestra.run.smithi044.stdout:(8/174): ceph-common-19.0.0-2519.gac171039.el9. 10 MB/s | 21 MB 00:02 2024-03-30T13:08:51.275 INFO:teuthology.orchestra.run.smithi044.stdout:(9/174): ceph-selinux-19.0.0-2519.gac171039.el9 340 kB/s | 25 kB 00:00 2024-03-30T13:08:52.084 INFO:teuthology.orchestra.run.smithi044.stdout:(10/174): ceph-radosgw-19.0.0-2519.gac171039.el 8.3 MB/s | 9.8 MB 00:01 2024-03-30T13:08:52.151 INFO:teuthology.orchestra.run.smithi044.stdout:(11/174): cephfs-mirror-19.0.0-2519.gac171039.e 3.3 MB/s | 221 kB 00:00 2024-03-30T13:08:52.218 INFO:teuthology.orchestra.run.smithi044.stdout:(12/174): cephfs-shell-19.0.0-2519.gac171039.el 412 kB/s | 27 kB 00:00 2024-03-30T13:08:52.301 INFO:teuthology.orchestra.run.smithi044.stdout:(13/174): libcephfs-devel-19.0.0-2519.gac171039 383 kB/s | 32 kB 00:00 2024-03-30T13:08:52.452 INFO:teuthology.orchestra.run.smithi044.stdout:(14/174): libcephfs2-19.0.0-2519.gac171039.el9. 4.9 MB/s | 746 kB 00:00 2024-03-30T13:08:52.535 INFO:teuthology.orchestra.run.smithi044.stdout:(15/174): libcephsqlite-19.0.0-2519.gac171039.e 1.9 MB/s | 164 kB 00:00 2024-03-30T13:08:52.786 INFO:teuthology.orchestra.run.smithi044.stdout:(16/174): ceph-osd-19.0.0-2519.gac171039.el9.x8 7.1 MB/s | 17 MB 00:02 2024-03-30T13:08:52.819 INFO:teuthology.orchestra.run.smithi044.stdout:(17/174): librados-devel-19.0.0-2519.gac171039. 448 kB/s | 127 kB 00:00 2024-03-30T13:08:52.911 INFO:teuthology.orchestra.run.smithi044.stdout:(18/174): libradosstriper1-19.0.0-2519.gac17103 3.9 MB/s | 500 kB 00:00 2024-03-30T13:08:53.003 INFO:teuthology.orchestra.run.smithi044.stdout:(19/174): python3-ceph-argparse-19.0.0-2519.gac 497 kB/s | 45 kB 00:00 2024-03-30T13:08:53.103 INFO:teuthology.orchestra.run.smithi044.stdout:(20/174): python3-ceph-common-19.0.0-2519.gac17 1.3 MB/s | 134 kB 00:00 2024-03-30T13:08:53.203 INFO:teuthology.orchestra.run.smithi044.stdout:(21/174): python3-cephfs-19.0.0-2519.gac171039. 1.6 MB/s | 162 kB 00:00 2024-03-30T13:08:53.312 INFO:teuthology.orchestra.run.smithi044.stdout:(22/174): python3-rados-19.0.0-2519.gac171039.e 2.9 MB/s | 321 kB 00:00 2024-03-30T13:08:53.471 INFO:teuthology.orchestra.run.smithi044.stdout:(23/174): librgw2-19.0.0-2519.gac171039.el9.x86 7.9 MB/s | 5.1 MB 00:00 2024-03-30T13:08:53.504 INFO:teuthology.orchestra.run.smithi044.stdout:(24/174): python3-rbd-19.0.0-2519.gac171039.el9 1.5 MB/s | 298 kB 00:00 2024-03-30T13:08:53.538 INFO:teuthology.orchestra.run.smithi044.stdout:(25/174): python3-rgw-19.0.0-2519.gac171039.el9 1.5 MB/s | 99 kB 00:00 2024-03-30T13:08:53.572 INFO:teuthology.orchestra.run.smithi044.stdout:(26/174): rbd-fuse-19.0.0-2519.gac171039.el9.x8 1.3 MB/s | 85 kB 00:00 2024-03-30T13:08:53.582 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-03-30T13:08:53.655 INFO:teuthology.orchestra.run.smithi044.stdout:(27/174): rbd-nbd-19.0.0-2519.gac171039.el9.x86 2.0 MB/s | 170 kB 00:00 2024-03-30T13:08:53.747 INFO:teuthology.orchestra.run.smithi044.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2519.g 373 kB/s | 34 kB 00:00 2024-03-30T13:08:53.889 INFO:teuthology.orchestra.run.smithi044.stdout:(29/174): rbd-mirror-19.0.0-2519.gac171039.el9. 8.8 MB/s | 3.1 MB 00:00 2024-03-30T13:08:53.923 INFO:teuthology.orchestra.run.smithi044.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2519.gac17103 812 kB/s | 141 kB 00:00 2024-03-30T13:08:54.582 INFO:teuthology.orchestra.run.smithi044.stdout:(31/174): ceph-test-19.0.0-2519.gac171039.el9.x 14 MB/s | 48 MB 00:03 2024-03-30T13:08:54.640 INFO:teuthology.orchestra.run.smithi044.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2519.gac 4.3 MB/s | 249 kB 00:00 2024-03-30T13:08:54.740 INFO:teuthology.orchestra.run.smithi044.stdout:(33/174): ceph-mgr-dashboard-19.0.0-2519.gac171 4.2 MB/s | 3.5 MB 00:00 2024-03-30T13:08:54.766 INFO:teuthology.orchestra.run.smithi044.stdout:(34/174): ceph-mgr-rook-19.0.0-2519.gac171039.e 397 kB/s | 49 kB 00:00 2024-03-30T13:08:54.791 INFO:teuthology.orchestra.run.smithi044.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2519.ga 331 kB/s | 16 kB 00:00 2024-03-30T13:08:54.824 INFO:teuthology.orchestra.run.smithi044.stdout:(36/174): ceph-volume-19.0.0-2519.gac171039.el9 4.5 MB/s | 264 kB 00:00 2024-03-30T13:08:54.875 INFO:teuthology.orchestra.run.smithi044.stdout:(37/174): cephfs-top-19.0.0-2519.gac171039.el9. 369 kB/s | 18 kB 00:00 2024-03-30T13:08:54.983 INFO:teuthology.orchestra.run.smithi044.stdout:(38/174): cephadm-19.0.0-2519.gac171039.el9.noa 3.9 MB/s | 762 kB 00:00 2024-03-30T13:08:55.134 INFO:teuthology.orchestra.run.smithi044.stdout:(39/174): ceph-mgr-diskprediction-local-19.0.0- 6.1 MB/s | 7.4 MB 00:01 2024-03-30T13:08:55.217 INFO:teuthology.orchestra.run.smithi044.stdout:(40/174): automake-1.16.2-8.el9.noarch.rpm 1.9 MB/s | 662 kB 00:00 2024-03-30T13:08:55.426 INFO:teuthology.orchestra.run.smithi044.stdout:(41/174): bison-3.7.4-5.el9.x86_64.rpm 2.0 MB/s | 920 kB 00:00 2024-03-30T13:08:55.452 INFO:teuthology.orchestra.run.smithi044.stdout:(42/174): boost-program-options-1.75.0-8.el9.x8 338 kB/s | 106 kB 00:00 2024-03-30T13:08:55.485 INFO:teuthology.orchestra.run.smithi044.stdout:(43/174): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 307 kB 00:00 2024-03-30T13:08:55.527 INFO:teuthology.orchestra.run.smithi044.stdout:(44/174): flexiblas-3.0.4-8.el9.x86_64.rpm 444 kB/s | 32 kB 00:00 2024-03-30T13:08:55.627 INFO:teuthology.orchestra.run.smithi044.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-03-30T13:08:55.652 INFO:teuthology.orchestra.run.smithi044.stdout:(46/174): flexiblas-openblas-openmp-3.0.4-8.el9 111 kB/s | 17 kB 00:00 2024-03-30T13:08:55.677 INFO:teuthology.orchestra.run.smithi044.stdout:(47/174): libaio-devel-0.3.111-13.el9.x86_64.rp 71 kB/s | 10 kB 00:00 2024-03-30T13:08:55.720 INFO:teuthology.orchestra.run.smithi044.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.9 MB/s | 159 kB 00:00 2024-03-30T13:08:55.753 INFO:teuthology.orchestra.run.smithi044.stdout:(49/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 44 kB 00:00 2024-03-30T13:08:55.787 INFO:teuthology.orchestra.run.smithi044.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 661 kB 00:00 2024-03-30T13:08:55.854 INFO:teuthology.orchestra.run.smithi044.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 4.4 MB/s | 578 kB 00:00 2024-03-30T13:08:55.879 INFO:teuthology.orchestra.run.smithi044.stdout:(52/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 540 kB/s | 46 kB 00:00 2024-03-30T13:08:55.904 INFO:teuthology.orchestra.run.smithi044.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 282 kB 00:00 2024-03-30T13:08:55.938 INFO:teuthology.orchestra.run.smithi044.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.3 MB/s | 187 kB 00:00 2024-03-30T13:08:55.963 INFO:teuthology.orchestra.run.smithi044.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 613 kB/s | 34 kB 00:00 2024-03-30T13:08:56.005 INFO:teuthology.orchestra.run.smithi044.stdout:(56/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.2 MB/s | 217 kB 00:00 2024-03-30T13:08:56.197 INFO:teuthology.orchestra.run.smithi044.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2024-03-30T13:08:56.297 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T13:08:56.299 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-30T13:08:56.319 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-30T13:08:56.320 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-30T13:08:56.321 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-30T13:08:56.323 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-30T13:08:56.325 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-30T13:08:56.329 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-30T13:08:56.330 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-30T13:08:56.392 INFO:teuthology.orchestra.run.smithi044.stdout:(58/174): postgresql-13.14-1.el9.x86_64.rpm 3.7 MB/s | 1.5 MB 00:00 2024-03-30T13:08:56.417 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-03-30T13:08:56.448 INFO:teuthology.orchestra.run.smithi044.stdout:(59/174): postgresql-contrib-13.14-1.el9.x86_64 1.9 MB/s | 817 kB 00:00 2024-03-30T13:08:56.464 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================ 2024-03-30T13:08:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-03-30T13:08:56.464 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================ 2024-03-30T13:08:56.464 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-03-30T13:08:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-30T13:08:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:19.0.0-2519.gac171039.el9 ceph 6.6 k 2024-03-30T13:08:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:19.0.0-2519.gac171039.el9 ceph 5.4 M 2024-03-30T13:08:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:19.0.0-2519.gac171039.el9 ceph 891 k 2024-03-30T13:08:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2519.gac171039.el9 ceph 145 k 2024-03-30T13:08:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:19.0.0-2519.gac171039.el9 ceph 1.5 M 2024-03-30T13:08:56.464 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 141 k 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 3.5 M 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 7.4 M 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 49 k 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:19.0.0-2519.gac171039.el9 ceph 9.8 M 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:19.0.0-2519.gac171039.el9 ceph 48 M 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 264 k 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 762 k 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:19.0.0-2519.gac171039.el9 ceph 221 k 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell x86_64 2:19.0.0-2519.gac171039.el9 ceph 27 k 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 18 k 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-30T13:08:56.465 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:19.0.0-2519.gac171039.el9 ceph 32 k 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:19.0.0-2519.gac171039.el9 ceph 746 k 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:19.0.0-2519.gac171039.el9 ceph 127 k 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:19.0.0-2519.gac171039.el9 ceph 162 k 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:19.0.0-2519.gac171039.el9 ceph 321 k 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:19.0.0-2519.gac171039.el9 ceph 298 k 2024-03-30T13:08:56.466 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:19.0.0-2519.gac171039.el9 ceph 99 k 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:19.0.0-2519.gac171039.el9 ceph 85 k 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:19.0.0-2519.gac171039.el9 ceph 3.1 M 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:19.0.0-2519.gac171039.el9 ceph 170 k 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-30T13:08:56.467 INFO:teuthology.orchestra.run.smithi151.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:19.0.0-2519.gac171039.el9 ceph 3.4 M 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:19.0.0-2519.gac171039.el9 ceph 3.1 M 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-30T13:08:56.468 INFO:teuthology.orchestra.run.smithi151.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:19.0.0-2519.gac171039.el9 ceph 21 M 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 34 k 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:19.0.0-2519.gac171039.el9 ceph 2.4 M 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 249 k 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:19.0.0-2519.gac171039.el9 ceph 4.7 M 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:19.0.0-2519.gac171039.el9 ceph 17 M 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2519.gac171039.el9 ceph-noarch 16 k 2024-03-30T13:08:56.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:19.0.0-2519.gac171039.el9 ceph 25 k 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:19.0.0-2519.gac171039.el9 ceph 164 k 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-30T13:08:56.470 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:19.0.0-2519.gac171039.el9 ceph 500 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:19.0.0-2519.gac171039.el9 ceph 5.1 M 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-30T13:08:56.471 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:19.0.0-2519.gac171039.el9 ceph 45 k 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:19.0.0-2519.gac171039.el9 ceph 134 k 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-30T13:08:56.472 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-30T13:08:56.473 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-30T13:08:56.474 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-30T13:08:56.475 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-30T13:08:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================ 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout:Install 150 Packages 2024-03-30T13:08:56.477 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 24 Packages 2024-03-30T13:08:56.478 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:08:56.478 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 226 M 2024-03-30T13:08:56.478 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-03-30T13:08:56.515 INFO:teuthology.orchestra.run.smithi044.stdout:(60/174): postgresql-private-libs-13.14-1.el9.x 444 kB/s | 132 kB 00:00 2024-03-30T13:08:56.598 INFO:teuthology.orchestra.run.smithi044.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-03-30T13:08:56.757 INFO:teuthology.orchestra.run.smithi044.stdout:(62/174): postgresql-server-13.14-1.el9.x86_64. 19 MB/s | 5.7 MB 00:00 2024-03-30T13:08:56.782 INFO:teuthology.orchestra.run.smithi044.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 292 kB/s | 78 kB 00:00 2024-03-30T13:08:56.924 INFO:teuthology.orchestra.run.smithi044.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2024-03-30T13:08:56.949 INFO:teuthology.orchestra.run.smithi044.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 119 kB/s | 18 kB 00:00 2024-03-30T13:08:56.974 INFO:teuthology.orchestra.run.smithi044.stdout:(66/174): python3-jsonpatch-1.21-16.el9.noarch. 138 kB/s | 24 kB 00:00 2024-03-30T13:08:57.000 INFO:teuthology.orchestra.run.smithi044.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 649 kB/s | 32 kB 00:00 2024-03-30T13:08:57.033 INFO:teuthology.orchestra.run.smithi044.stdout:(68/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 144 kB 00:00 2024-03-30T13:08:57.167 INFO:teuthology.orchestra.run.smithi044.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 4.8 MB 00:00 2024-03-30T13:08:57.192 INFO:teuthology.orchestra.run.smithi044.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-03-30T13:08:57.192 INFO:teuthology.orchestra.run.smithi151.stdout:(1/174): ceph-19.0.0-2519.gac171039.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-03-30T13:08:57.208 INFO:teuthology.orchestra.run.smithi044.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2024-03-30T13:08:57.242 INFO:teuthology.orchestra.run.smithi044.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 2.1 MB/s | 69 kB 00:00 2024-03-30T13:08:57.276 INFO:teuthology.orchestra.run.smithi044.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 626 kB/s | 41 kB 00:00 2024-03-30T13:08:57.301 INFO:teuthology.orchestra.run.smithi044.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 238 kB 00:00 2024-03-30T13:08:57.327 INFO:teuthology.orchestra.run.smithi044.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2024-03-30T13:08:57.360 INFO:teuthology.orchestra.run.smithi044.stdout:(76/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 211 kB 00:00 2024-03-30T13:08:57.385 INFO:teuthology.orchestra.run.smithi044.stdout:(77/174): python3-pytz-2021.1-5.el9.noarch.rpm 583 kB/s | 47 kB 00:00 2024-03-30T13:08:57.411 INFO:teuthology.orchestra.run.smithi044.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 528 kB/s | 43 kB 00:00 2024-03-30T13:08:57.436 INFO:teuthology.orchestra.run.smithi044.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 796 kB/s | 39 kB 00:00 2024-03-30T13:08:57.509 INFO:teuthology.orchestra.run.smithi151.stdout:(2/174): ceph-fuse-19.0.0-2519.gac171039.el9.x8 2.8 MB/s | 891 kB 00:00 2024-03-30T13:08:57.570 INFO:teuthology.orchestra.run.smithi044.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 260 kB/s | 41 kB 00:00 2024-03-30T13:08:57.593 INFO:teuthology.orchestra.run.smithi151.stdout:(3/174): ceph-immutable-object-cache-19.0.0-251 1.7 MB/s | 145 kB 00:00 2024-03-30T13:08:57.795 INFO:teuthology.orchestra.run.smithi044.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-03-30T13:08:57.820 INFO:teuthology.orchestra.run.smithi044.stdout:(82/174): qatlib-24.02.0-1.el9.x86_64.rpm 597 kB/s | 220 kB 00:00 2024-03-30T13:08:57.845 INFO:teuthology.orchestra.run.smithi044.stdout:(83/174): qatlib-service-24.02.0-1.el9.x86_64.r 130 kB/s | 35 kB 00:00 2024-03-30T13:08:57.870 INFO:teuthology.orchestra.run.smithi044.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 953 kB/s | 46 kB 00:00 2024-03-30T13:08:57.896 INFO:teuthology.orchestra.run.smithi044.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 4.0 MB/s | 300 kB 00:00 2024-03-30T13:08:57.921 INFO:teuthology.orchestra.run.smithi044.stdout:(86/174): uuid-1.6.2-55.el9.x86_64.rpm 788 kB/s | 56 kB 00:00 2024-03-30T13:08:57.946 INFO:teuthology.orchestra.run.smithi044.stdout:(87/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2024-03-30T13:08:57.971 INFO:teuthology.orchestra.run.smithi044.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 600 kB/s | 44 kB 00:00 2024-03-30T13:08:57.997 INFO:teuthology.orchestra.run.smithi044.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-30T13:08:58.034 INFO:teuthology.orchestra.run.smithi151.stdout:(4/174): ceph-mds-19.0.0-2519.gac171039.el9.x86 5.4 MB/s | 2.4 MB 00:00 2024-03-30T13:08:58.039 INFO:teuthology.orchestra.run.smithi044.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2024-03-30T13:08:58.080 INFO:teuthology.orchestra.run.smithi044.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-03-30T13:08:58.105 INFO:teuthology.orchestra.run.smithi044.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 953 kB/s | 103 kB 00:00 2024-03-30T13:08:58.135 INFO:teuthology.orchestra.run.smithi151.stdout:(5/174): ceph-base-19.0.0-2519.gac171039.el9.x8 4.4 MB/s | 5.4 MB 00:01 2024-03-30T13:08:58.148 INFO:teuthology.orchestra.run.smithi044.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 124 kB 00:00 2024-03-30T13:08:58.173 INFO:teuthology.orchestra.run.smithi044.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 187 kB 00:00 2024-03-30T13:08:58.282 INFO:teuthology.orchestra.run.smithi044.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-03-30T13:08:58.310 INFO:teuthology.orchestra.run.smithi151.stdout:(6/174): ceph-mgr-19.0.0-2519.gac171039.el9.x86 5.4 MB/s | 1.5 MB 00:00 2024-03-30T13:08:58.315 INFO:teuthology.orchestra.run.smithi044.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-03-30T13:08:58.340 INFO:teuthology.orchestra.run.smithi044.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-03-30T13:08:58.382 INFO:teuthology.orchestra.run.smithi044.stdout:(98/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.8 MB/s | 803 kB 00:00 2024-03-30T13:08:58.474 INFO:teuthology.orchestra.run.smithi044.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 191 kB/s | 25 kB 00:00 2024-03-30T13:08:58.491 INFO:teuthology.orchestra.run.smithi044.stdout:(100/174): elfutils-libelf-devel-0.190-2.el9.x8 123 kB/s | 21 kB 00:00 2024-03-30T13:08:58.650 INFO:teuthology.orchestra.run.smithi044.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 1.5 MB/s | 248 kB 00:00 2024-03-30T13:08:58.675 INFO:teuthology.orchestra.run.smithi044.stdout:(102/174): python3-devel-3.9.17-2.el9.x86_64.rp 1.2 MB/s | 245 kB 00:00 2024-03-30T13:08:58.717 INFO:teuthology.orchestra.run.smithi044.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-03-30T13:08:58.785 INFO:teuthology.orchestra.run.smithi151.stdout:(7/174): ceph-common-19.0.0-2519.gac171039.el9. 11 MB/s | 21 MB 00:01 2024-03-30T13:08:58.936 INFO:teuthology.orchestra.run.smithi151.stdout:(8/174): ceph-mon-19.0.0-2519.gac171039.el9.x86 5.9 MB/s | 4.7 MB 00:00 2024-03-30T13:08:58.951 INFO:teuthology.orchestra.run.smithi044.stdout:(104/174): openssl-devel-3.0.7-27.el9.x86_64.rp 7.3 MB/s | 4.1 MB 00:00 2024-03-30T13:08:58.976 INFO:teuthology.orchestra.run.smithi044.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-03-30T13:08:59.019 INFO:teuthology.orchestra.run.smithi151.stdout:(9/174): ceph-selinux-19.0.0-2519.gac171039.el9 305 kB/s | 25 kB 00:00 2024-03-30T13:08:59.218 INFO:teuthology.orchestra.run.smithi044.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-03-30T13:08:59.268 INFO:teuthology.orchestra.run.smithi044.stdout:(107/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.7 MB/s | 548 kB 00:00 2024-03-30T13:08:59.294 INFO:teuthology.orchestra.run.smithi044.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 263 kB/s | 19 kB 00:00 2024-03-30T13:08:59.352 INFO:teuthology.orchestra.run.smithi044.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 450 kB/s | 26 kB 00:00 2024-03-30T13:08:59.420 INFO:teuthology.orchestra.run.smithi044.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 735 kB/s | 49 kB 00:00 2024-03-30T13:08:59.495 INFO:teuthology.orchestra.run.smithi044.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 921 kB/s | 67 kB 00:00 2024-03-30T13:08:59.595 INFO:teuthology.orchestra.run.smithi044.stdout:(112/174): libarrow-9.0.0-10.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-03-30T13:08:59.629 INFO:teuthology.orchestra.run.smithi044.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-03-30T13:08:59.679 INFO:teuthology.orchestra.run.smithi044.stdout:(114/174): protobuf-compiler-3.14.0-13.el9.x86_ 898 kB/s | 863 kB 00:00 2024-03-30T13:08:59.750 INFO:teuthology.orchestra.run.smithi044.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.3 MB/s | 838 kB 00:00 2024-03-30T13:08:59.787 INFO:teuthology.orchestra.run.smithi151.stdout:(10/174): ceph-radosgw-19.0.0-2519.gac171039.el 9.8 MB/s | 9.8 MB 00:00 2024-03-30T13:08:59.787 INFO:teuthology.orchestra.run.smithi044.stdout:(116/174): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-03-30T13:08:59.830 INFO:teuthology.orchestra.run.smithi044.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 413 kB/s | 32 kB 00:00 2024-03-30T13:08:59.853 INFO:teuthology.orchestra.run.smithi151.stdout:(11/174): cephfs-mirror-19.0.0-2519.gac171039.e 3.3 MB/s | 221 kB 00:00 2024-03-30T13:08:59.855 INFO:teuthology.orchestra.run.smithi044.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 227 kB/s | 15 kB 00:00 2024-03-30T13:08:59.880 INFO:teuthology.orchestra.run.smithi044.stdout:(119/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 217 kB/s | 43 kB 00:00 2024-03-30T13:08:59.895 INFO:teuthology.orchestra.run.smithi151.stdout:(12/174): cephfs-shell-19.0.0-2519.gac171039.el 665 kB/s | 27 kB 00:00 2024-03-30T13:08:59.914 INFO:teuthology.orchestra.run.smithi044.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-03-30T13:08:59.947 INFO:teuthology.orchestra.run.smithi044.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-03-30T13:08:59.973 INFO:teuthology.orchestra.run.smithi044.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 612 kB/s | 35 kB 00:00 2024-03-30T13:09:00.006 INFO:teuthology.orchestra.run.smithi044.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 3.4 MB/s | 203 kB 00:00 2024-03-30T13:09:00.040 INFO:teuthology.orchestra.run.smithi044.stdout:(124/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.9 MB/s | 303 kB 00:00 2024-03-30T13:09:00.074 INFO:teuthology.orchestra.run.smithi044.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-03-30T13:09:00.090 INFO:teuthology.orchestra.run.smithi044.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 216 kB/s | 11 kB 00:00 2024-03-30T13:09:00.124 INFO:teuthology.orchestra.run.smithi044.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 357 kB/s | 18 kB 00:00 2024-03-30T13:09:00.141 INFO:teuthology.orchestra.run.smithi044.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 466 kB/s | 23 kB 00:00 2024-03-30T13:09:00.162 INFO:teuthology.orchestra.run.smithi151.stdout:(13/174): ceph-osd-19.0.0-2519.gac171039.el9.x8 9.1 MB/s | 17 MB 00:01 2024-03-30T13:09:00.187 INFO:teuthology.orchestra.run.smithi151.stdout:(14/174): libcephfs-devel-19.0.0-2519.gac171039 109 kB/s | 32 kB 00:00 2024-03-30T13:09:00.208 INFO:teuthology.orchestra.run.smithi044.stdout:(129/174): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-03-30T13:09:00.233 INFO:teuthology.orchestra.run.smithi044.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 180 kB/s | 19 kB 00:00 2024-03-30T13:09:00.254 INFO:teuthology.orchestra.run.smithi151.stdout:(15/174): libcephsqlite-19.0.0-2519.gac171039.e 2.4 MB/s | 164 kB 00:00 2024-03-30T13:09:00.258 INFO:teuthology.orchestra.run.smithi044.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 169 kB/s | 20 kB 00:00 2024-03-30T13:09:00.296 INFO:teuthology.orchestra.run.smithi151.stdout:(16/174): libcephfs2-19.0.0-2519.gac171039.el9. 5.5 MB/s | 746 kB 00:00 2024-03-30T13:09:00.317 INFO:teuthology.orchestra.run.smithi044.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 9.5 MB/s | 1.0 MB 00:00 2024-03-30T13:09:00.329 INFO:teuthology.orchestra.run.smithi151.stdout:(17/174): librados-devel-19.0.0-2519.gac171039. 1.7 MB/s | 127 kB 00:00 2024-03-30T13:09:00.342 INFO:teuthology.orchestra.run.smithi044.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 561 kB/s | 46 kB 00:00 2024-03-30T13:09:00.388 INFO:teuthology.orchestra.run.smithi151.stdout:(18/174): libradosstriper1-19.0.0-2519.gac17103 5.4 MB/s | 500 kB 00:00 2024-03-30T13:09:00.401 INFO:teuthology.orchestra.run.smithi044.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 558 kB/s | 79 kB 00:00 2024-03-30T13:09:00.426 INFO:teuthology.orchestra.run.smithi044.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 530 kB/s | 58 kB 00:00 2024-03-30T13:09:00.460 INFO:teuthology.orchestra.run.smithi044.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-03-30T13:09:00.472 INFO:teuthology.orchestra.run.smithi151.stdout:(19/174): python3-ceph-argparse-19.0.0-2519.gac 547 kB/s | 45 kB 00:00 2024-03-30T13:09:00.485 INFO:teuthology.orchestra.run.smithi044.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 198 kB/s | 16 kB 00:00 2024-03-30T13:09:00.511 INFO:teuthology.orchestra.run.smithi044.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-03-30T13:09:00.536 INFO:teuthology.orchestra.run.smithi044.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 377 kB/s | 28 kB 00:00 2024-03-30T13:09:00.555 INFO:teuthology.orchestra.run.smithi151.stdout:(20/174): python3-ceph-common-19.0.0-2519.gac17 1.6 MB/s | 134 kB 00:00 2024-03-30T13:09:00.561 INFO:teuthology.orchestra.run.smithi044.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 411 kB/s | 31 kB 00:00 2024-03-30T13:09:00.595 INFO:teuthology.orchestra.run.smithi044.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-03-30T13:09:00.620 INFO:teuthology.orchestra.run.smithi044.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 617 kB/s | 36 kB 00:00 2024-03-30T13:09:00.645 INFO:teuthology.orchestra.run.smithi044.stdout:(143/174): python3-rsa-4.9-2.el9.noarch.rpm 545 kB/s | 59 kB 00:00 2024-03-30T13:09:00.647 INFO:teuthology.orchestra.run.smithi151.stdout:(21/174): python3-cephfs-19.0.0-2519.gac171039. 1.7 MB/s | 162 kB 00:00 2024-03-30T13:09:00.671 INFO:teuthology.orchestra.run.smithi044.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 682 kB/s | 51 kB 00:00 2024-03-30T13:09:00.704 INFO:teuthology.orchestra.run.smithi044.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-03-30T13:09:00.730 INFO:teuthology.orchestra.run.smithi044.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-03-30T13:09:00.763 INFO:teuthology.orchestra.run.smithi044.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-03-30T13:09:00.772 INFO:teuthology.orchestra.run.smithi151.stdout:(22/174): librgw2-19.0.0-2519.gac171039.el9.x86 12 MB/s | 5.1 MB 00:00 2024-03-30T13:09:00.796 INFO:teuthology.orchestra.run.smithi044.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-03-30T13:09:00.814 INFO:teuthology.orchestra.run.smithi151.stdout:(23/174): python3-rados-19.0.0-2519.gac171039.e 1.9 MB/s | 321 kB 00:00 2024-03-30T13:09:00.830 INFO:teuthology.orchestra.run.smithi044.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-03-30T13:09:00.848 INFO:teuthology.orchestra.run.smithi151.stdout:(24/174): python3-rbd-19.0.0-2519.gac171039.el9 3.9 MB/s | 298 kB 00:00 2024-03-30T13:09:00.890 INFO:teuthology.orchestra.run.smithi151.stdout:(25/174): python3-rgw-19.0.0-2519.gac171039.el9 1.3 MB/s | 99 kB 00:00 2024-03-30T13:09:00.915 INFO:teuthology.orchestra.run.smithi151.stdout:(26/174): rbd-fuse-19.0.0-2519.gac171039.el9.x8 1.3 MB/s | 85 kB 00:00 2024-03-30T13:09:00.982 INFO:teuthology.orchestra.run.smithi151.stdout:(27/174): rbd-nbd-19.0.0-2519.gac171039.el9.x86 2.5 MB/s | 170 kB 00:00 2024-03-30T13:09:01.005 INFO:teuthology.orchestra.run.smithi044.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 6.6 MB/s | 1.6 MB 00:00 2024-03-30T13:09:01.074 INFO:teuthology.orchestra.run.smithi151.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2519.g 374 kB/s | 34 kB 00:00 2024-03-30T13:09:01.183 INFO:teuthology.orchestra.run.smithi151.stdout:(29/174): rbd-mirror-19.0.0-2519.gac171039.el9. 11 MB/s | 3.1 MB 00:00 2024-03-30T13:09:01.208 INFO:teuthology.orchestra.run.smithi151.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2519.gac17103 1.0 MB/s | 141 kB 00:00 2024-03-30T13:09:01.231 INFO:teuthology.orchestra.run.smithi044.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 10 MB/s | 2.3 MB 00:00 2024-03-30T13:09:01.315 INFO:teuthology.orchestra.run.smithi044.stdout:(152/174): NetworkManager-libnm-1.47.2-1.el9.x8 22 MB/s | 1.8 MB 00:00 2024-03-30T13:09:01.348 INFO:teuthology.orchestra.run.smithi044.stdout:(153/174): NetworkManager-team-1.47.2-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-03-30T13:09:01.491 INFO:teuthology.orchestra.run.smithi044.stdout:(154/174): NetworkManager-tui-1.47.2-1.el9.x86_ 1.7 MB/s | 247 kB 00:00 2024-03-30T13:09:01.551 INFO:teuthology.orchestra.run.smithi044.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2024-03-30T13:09:01.592 INFO:teuthology.orchestra.run.smithi151.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2519.gac171 8.7 MB/s | 3.5 MB 00:00 2024-03-30T13:09:01.626 INFO:teuthology.orchestra.run.smithi044.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 958 kB/s | 71 kB 00:00 2024-03-30T13:09:01.660 INFO:teuthology.orchestra.run.smithi044.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 1.1 MB/s | 36 kB 00:00 2024-03-30T13:09:01.692 INFO:teuthology.orchestra.run.smithi151.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2519.gac 2.5 MB/s | 249 kB 00:00 2024-03-30T13:09:01.744 INFO:teuthology.orchestra.run.smithi044.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2024-03-30T13:09:01.776 INFO:teuthology.orchestra.run.smithi151.stdout:(33/174): ceph-mgr-rook-19.0.0-2519.gac171039.e 601 kB/s | 49 kB 00:00 2024-03-30T13:09:01.794 INFO:teuthology.orchestra.run.smithi044.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 5.1 MB/s | 256 kB 00:00 2024-03-30T13:09:01.836 INFO:teuthology.orchestra.run.smithi044.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 563 kB/s | 23 kB 00:00 2024-03-30T13:09:01.878 INFO:teuthology.orchestra.run.smithi044.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 108 kB 00:00 2024-03-30T13:09:01.928 INFO:teuthology.orchestra.run.smithi044.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.1 MB/s | 155 kB 00:00 2024-03-30T13:09:01.935 INFO:teuthology.orchestra.run.smithi151.stdout:(34/174): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-03-30T13:09:01.970 INFO:teuthology.orchestra.run.smithi044.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 3.2 MB/s | 136 kB 00:00 2024-03-30T13:09:01.985 INFO:teuthology.orchestra.run.smithi151.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2519.ga 79 kB/s | 16 kB 00:00 2024-03-30T13:09:02.012 INFO:teuthology.orchestra.run.smithi044.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-03-30T13:09:02.018 INFO:teuthology.orchestra.run.smithi151.stdout:(36/174): ceph-volume-19.0.0-2519.gac171039.el9 3.1 MB/s | 264 kB 00:00 2024-03-30T13:09:02.055 INFO:teuthology.orchestra.run.smithi044.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 700 kB/s | 29 kB 00:00 2024-03-30T13:09:02.069 INFO:teuthology.orchestra.run.smithi151.stdout:(37/174): cephfs-top-19.0.0-2519.gac171039.el9. 370 kB/s | 18 kB 00:00 2024-03-30T13:09:02.102 INFO:teuthology.orchestra.run.smithi151.stdout:(38/174): cephadm-19.0.0-2519.gac171039.el9.noa 6.4 MB/s | 762 kB 00:00 2024-03-30T13:09:02.146 INFO:teuthology.orchestra.run.smithi044.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2024-03-30T13:09:02.247 INFO:teuthology.orchestra.run.smithi044.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 22 MB/s | 2.2 MB 00:00 2024-03-30T13:09:02.311 INFO:teuthology.orchestra.run.smithi151.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 662 kB 00:00 2024-03-30T13:09:02.361 INFO:teuthology.orchestra.run.smithi151.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 920 kB 00:00 2024-03-30T13:09:02.387 INFO:teuthology.orchestra.run.smithi151.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 106 kB 00:00 2024-03-30T13:09:02.389 INFO:teuthology.orchestra.run.smithi044.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 16 MB/s | 2.3 MB 00:00 2024-03-30T13:09:02.445 INFO:teuthology.orchestra.run.smithi151.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 307 kB 00:00 2024-03-30T13:09:02.447 INFO:teuthology.orchestra.run.smithi044.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 7.9 MB/s | 465 kB 00:00 2024-03-30T13:09:02.471 INFO:teuthology.orchestra.run.smithi151.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 394 kB/s | 32 kB 00:00 2024-03-30T13:09:02.489 INFO:teuthology.orchestra.run.smithi044.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 764 kB/s | 31 kB 00:00 2024-03-30T13:09:02.571 INFO:teuthology.orchestra.run.smithi151.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-03-30T13:09:02.573 INFO:teuthology.orchestra.run.smithi044.stdout:(171/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-03-30T13:09:02.587 INFO:teuthology.orchestra.run.smithi151.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 171 kB/s | 17 kB 00:00 2024-03-30T13:09:02.621 INFO:teuthology.orchestra.run.smithi151.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 313 kB/s | 10 kB 00:00 2024-03-30T13:09:02.646 INFO:teuthology.orchestra.run.smithi151.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-30T13:09:02.663 INFO:teuthology.orchestra.run.smithi151.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2024-03-30T13:09:02.705 INFO:teuthology.orchestra.run.smithi151.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-30T13:09:02.748 INFO:teuthology.orchestra.run.smithi044.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 427 kB/s | 74 kB 00:00 2024-03-30T13:09:02.755 INFO:teuthology.orchestra.run.smithi151.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 6.6 MB/s | 578 kB 00:00 2024-03-30T13:09:02.773 INFO:teuthology.orchestra.run.smithi151.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 756 kB/s | 46 kB 00:00 2024-03-30T13:09:02.806 INFO:teuthology.orchestra.run.smithi151.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 282 kB 00:00 2024-03-30T13:09:02.840 INFO:teuthology.orchestra.run.smithi151.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-03-30T13:09:02.898 INFO:teuthology.orchestra.run.smithi151.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.4 MB/s | 217 kB 00:00 2024-03-30T13:09:02.915 INFO:teuthology.orchestra.run.smithi151.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 471 kB/s | 34 kB 00:00 2024-03-30T13:09:03.057 INFO:teuthology.orchestra.run.smithi151.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-03-30T13:09:03.116 INFO:teuthology.orchestra.run.smithi151.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 8.3 MB/s | 1.5 MB 00:00 2024-03-30T13:09:03.158 INFO:teuthology.orchestra.run.smithi151.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 8.3 MB/s | 817 kB 00:00 2024-03-30T13:09:03.174 INFO:teuthology.orchestra.run.smithi151.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.5 MB/s | 132 kB 00:00 2024-03-30T13:09:03.350 INFO:teuthology.orchestra.run.smithi151.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 30 MB/s | 5.7 MB 00:00 2024-03-30T13:09:03.400 INFO:teuthology.orchestra.run.smithi151.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-03-30T13:09:03.423 INFO:teuthology.orchestra.run.smithi044.stdout:(173/174): librados2-19.0.0-2519.gac171039.el9. 1.3 MB/s | 3.4 MB 00:02 2024-03-30T13:09:03.425 INFO:teuthology.orchestra.run.smithi151.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 78 kB 00:00 2024-03-30T13:09:03.576 INFO:teuthology.orchestra.run.smithi151.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 5.8 MB 00:00 2024-03-30T13:09:03.601 INFO:teuthology.orchestra.run.smithi151.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 153 kB/s | 24 kB 00:00 2024-03-30T13:09:03.635 INFO:teuthology.orchestra.run.smithi151.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 564 kB/s | 18 kB 00:00 2024-03-30T13:09:03.660 INFO:teuthology.orchestra.run.smithi151.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2024-03-30T13:09:03.685 INFO:teuthology.orchestra.run.smithi151.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 657 kB/s | 32 kB 00:00 2024-03-30T13:09:03.844 INFO:teuthology.orchestra.run.smithi151.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2024-03-30T13:09:03.869 INFO:teuthology.orchestra.run.smithi151.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 217 kB 00:00 2024-03-30T13:09:03.911 INFO:teuthology.orchestra.run.smithi151.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2024-03-30T13:09:03.915 INFO:teuthology.orchestra.run.smithi044.stdout:(174/174): librbd1-19.0.0-2519.gac171039.el9.x8 1.0 MB/s | 3.1 MB 00:03 2024-03-30T13:09:03.924 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-03-30T13:09:03.924 INFO:teuthology.orchestra.run.smithi044.stdout:Total 15 MB/s | 226 MB 00:15 2024-03-30T13:09:03.936 INFO:teuthology.orchestra.run.smithi151.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-03-30T13:09:03.978 INFO:teuthology.orchestra.run.smithi151.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-03-30T13:09:04.003 INFO:teuthology.orchestra.run.smithi151.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 3.6 MB/s | 238 kB 00:00 2024-03-30T13:09:04.045 INFO:teuthology.orchestra.run.smithi151.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2024-03-30T13:09:04.070 INFO:teuthology.orchestra.run.smithi151.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-03-30T13:09:04.112 INFO:teuthology.orchestra.run.smithi151.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-30T13:09:04.137 INFO:teuthology.orchestra.run.smithi151.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 654 kB/s | 43 kB 00:00 2024-03-30T13:09:04.212 INFO:teuthology.orchestra.run.smithi151.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 525 kB/s | 39 kB 00:00 2024-03-30T13:09:04.496 INFO:teuthology.orchestra.run.smithi151.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-03-30T13:09:04.521 INFO:teuthology.orchestra.run.smithi151.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 139 kB/s | 41 kB 00:00 2024-03-30T13:09:04.555 INFO:teuthology.orchestra.run.smithi151.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 3.8 MB/s | 220 kB 00:00 2024-03-30T13:09:04.580 INFO:teuthology.orchestra.run.smithi151.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 623 kB/s | 35 kB 00:00 2024-03-30T13:09:04.605 INFO:teuthology.orchestra.run.smithi151.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 950 kB/s | 46 kB 00:00 2024-03-30T13:09:04.639 INFO:teuthology.orchestra.run.smithi151.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 300 kB 00:00 2024-03-30T13:09:04.664 INFO:teuthology.orchestra.run.smithi151.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-03-30T13:09:04.716 INFO:teuthology.orchestra.run.smithi151.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 833 kB/s | 63 kB 00:00 2024-03-30T13:09:04.750 INFO:teuthology.orchestra.run.smithi151.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 536 kB/s | 44 kB 00:00 2024-03-30T13:09:04.773 INFO:teuthology.orchestra.run.smithi151.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.4 MB/s | 79 kB 00:00 2024-03-30T13:09:04.808 INFO:teuthology.orchestra.run.smithi151.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-03-30T13:09:04.866 INFO:teuthology.orchestra.run.smithi151.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2024-03-30T13:09:04.882 INFO:teuthology.orchestra.run.smithi151.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2024-03-30T13:09:04.900 INFO:teuthology.orchestra.run.smithi151.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 3.8 MB/s | 124 kB 00:00 2024-03-30T13:09:04.934 INFO:teuthology.orchestra.run.smithi151.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.8 MB/s | 187 kB 00:00 2024-03-30T13:09:05.099 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-03-30T13:09:05.117 INFO:teuthology.orchestra.run.smithi151.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 872 kB/s | 187 kB 00:00 2024-03-30T13:09:05.201 INFO:teuthology.orchestra.run.smithi151.stdout:(95/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-03-30T13:09:05.251 INFO:teuthology.orchestra.run.smithi151.stdout:(96/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-03-30T13:09:05.285 INFO:teuthology.orchestra.run.smithi151.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-03-30T13:09:05.343 INFO:teuthology.orchestra.run.smithi151.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 236 kB/s | 21 kB 00:00 2024-03-30T13:09:05.368 INFO:teuthology.orchestra.run.smithi151.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 308 kB/s | 25 kB 00:00 2024-03-30T13:09:05.455 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-03-30T13:09:05.455 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-03-30T13:09:05.477 INFO:teuthology.orchestra.run.smithi151.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 2.2 MB/s | 245 kB 00:00 2024-03-30T13:09:05.577 INFO:teuthology.orchestra.run.smithi151.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 2.4 MB/s | 248 kB 00:00 2024-03-30T13:09:05.745 INFO:teuthology.orchestra.run.smithi151.stdout:(102/174): openssl-devel-3.0.7-27.el9.x86_64.rp 10 MB/s | 4.1 MB 00:00 2024-03-30T13:09:05.769 INFO:teuthology.orchestra.run.smithi151.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 491 kB/s | 94 kB 00:00 2024-03-30T13:09:06.312 INFO:teuthology.orchestra.run.smithi151.stdout:(104/174): ceph-test-19.0.0-2519.gac171039.el9. 6.5 MB/s | 48 MB 00:07 2024-03-30T13:09:06.354 INFO:teuthology.orchestra.run.smithi151.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 37 kB/s | 22 kB 00:00 2024-03-30T13:09:06.495 INFO:teuthology.orchestra.run.smithi151.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.2 MB/s | 863 kB 00:00 2024-03-30T13:09:06.737 INFO:teuthology.orchestra.run.smithi151.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 81 kB/s | 19 kB 00:00 2024-03-30T13:09:06.838 INFO:teuthology.orchestra.run.smithi151.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 640 kB/s | 309 kB 00:00 2024-03-30T13:09:06.888 INFO:teuthology.orchestra.run.smithi151.stdout:(109/174): abseil-cpp-20211102.0-3.el9.x86_64.r 953 kB/s | 548 kB 00:00 2024-03-30T13:09:06.930 INFO:teuthology.orchestra.run.smithi151.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 285 kB/s | 26 kB 00:00 2024-03-30T13:09:06.989 INFO:teuthology.orchestra.run.smithi151.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 488 kB/s | 49 kB 00:00 2024-03-30T13:09:07.022 INFO:teuthology.orchestra.run.smithi151.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 738 kB/s | 67 kB 00:00 2024-03-30T13:09:07.106 INFO:teuthology.orchestra.run.smithi151.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-03-30T13:09:07.231 INFO:teuthology.orchestra.run.smithi151.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2024-03-30T13:09:07.281 INFO:teuthology.orchestra.run.smithi151.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 3.1 MB/s | 548 kB 00:00 2024-03-30T13:09:07.331 INFO:teuthology.orchestra.run.smithi151.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 439 kB/s | 43 kB 00:00 2024-03-30T13:09:07.448 INFO:teuthology.orchestra.run.smithi151.stdout:(117/174): libarrow-9.0.0-10.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2024-03-30T13:09:07.473 INFO:teuthology.orchestra.run.smithi151.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 106 kB/s | 15 kB 00:00 2024-03-30T13:09:07.499 INFO:teuthology.orchestra.run.smithi151.stdout:(119/174): python3-cachetools-4.2.4-1.el9.noarc 148 kB/s | 32 kB 00:00 2024-03-30T13:09:07.557 INFO:teuthology.orchestra.run.smithi151.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2024-03-30T13:09:07.592 INFO:teuthology.orchestra.run.smithi151.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-03-30T13:09:07.624 INFO:teuthology.orchestra.run.smithi151.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-03-30T13:09:07.667 INFO:teuthology.orchestra.run.smithi151.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 326 kB/s | 35 kB 00:00 2024-03-30T13:09:07.692 INFO:teuthology.orchestra.run.smithi151.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-03-30T13:09:07.767 INFO:teuthology.orchestra.run.smithi151.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-03-30T13:09:07.792 INFO:teuthology.orchestra.run.smithi151.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 108 kB/s | 11 kB 00:00 2024-03-30T13:09:07.875 INFO:teuthology.orchestra.run.smithi151.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 8.2 MB/s | 2.0 MB 00:00 2024-03-30T13:09:07.900 INFO:teuthology.orchestra.run.smithi151.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 134 kB/s | 18 kB 00:00 2024-03-30T13:09:07.917 INFO:teuthology.orchestra.run.smithi151.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 186 kB/s | 23 kB 00:00 2024-03-30T13:09:07.948 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-03-30T13:09:07.948 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-03-30T13:09:07.976 INFO:teuthology.orchestra.run.smithi151.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 195 kB/s | 19 kB 00:00 2024-03-30T13:09:08.026 INFO:teuthology.orchestra.run.smithi151.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2024-03-30T13:09:08.077 INFO:teuthology.orchestra.run.smithi151.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 6.5 MB/s | 1.0 MB 00:00 2024-03-30T13:09:08.094 INFO:teuthology.orchestra.run.smithi151.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 396 kB/s | 46 kB 00:00 2024-03-30T13:09:08.119 INFO:teuthology.orchestra.run.smithi151.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 862 kB/s | 79 kB 00:00 2024-03-30T13:09:08.169 INFO:teuthology.orchestra.run.smithi151.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 631 kB/s | 58 kB 00:00 2024-03-30T13:09:08.203 INFO:teuthology.orchestra.run.smithi151.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-03-30T13:09:08.220 INFO:teuthology.orchestra.run.smithi151.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-03-30T13:09:08.270 INFO:teuthology.orchestra.run.smithi151.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 899 kB/s | 90 kB 00:00 2024-03-30T13:09:08.295 INFO:teuthology.orchestra.run.smithi151.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 308 kB/s | 28 kB 00:00 2024-03-30T13:09:08.320 INFO:teuthology.orchestra.run.smithi151.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 308 kB/s | 31 kB 00:00 2024-03-30T13:09:08.379 INFO:teuthology.orchestra.run.smithi151.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-03-30T13:09:08.396 INFO:teuthology.orchestra.run.smithi151.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 592 kB/s | 59 kB 00:00 2024-03-30T13:09:08.413 INFO:teuthology.orchestra.run.smithi151.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 390 kB/s | 36 kB 00:00 2024-03-30T13:09:08.488 INFO:teuthology.orchestra.run.smithi151.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 472 kB/s | 51 kB 00:00 2024-03-30T13:09:08.514 INFO:teuthology.orchestra.run.smithi151.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 900 kB/s | 90 kB 00:00 2024-03-30T13:09:08.547 INFO:teuthology.orchestra.run.smithi151.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-03-30T13:09:08.606 INFO:teuthology.orchestra.run.smithi151.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-03-30T13:09:08.631 INFO:teuthology.orchestra.run.smithi151.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2024-03-30T13:09:08.665 INFO:teuthology.orchestra.run.smithi151.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-03-30T13:09:09.148 INFO:teuthology.orchestra.run.smithi151.stdout:(150/174): librados2-19.0.0-2519.gac171039.el9. 6.6 MB/s | 3.4 MB 00:00 2024-03-30T13:09:09.207 INFO:teuthology.orchestra.run.smithi151.stdout:(151/174): thrift-0.15.0-2.el9.x86_64.rpm 2.6 MB/s | 1.6 MB 00:00 2024-03-30T13:09:09.299 INFO:teuthology.orchestra.run.smithi151.stdout:(152/174): NetworkManager-1.47.2-1.el9.x86_64.r 15 MB/s | 2.3 MB 00:00 2024-03-30T13:09:09.387 INFO:teuthology.orchestra.run.smithi151.stdout:(153/174): NetworkManager-libnm-1.47.2-1.el9.x8 11 MB/s | 1.8 MB 00:00 2024-03-30T13:09:09.416 INFO:teuthology.orchestra.run.smithi151.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 396 kB/s | 41 kB 00:00 2024-03-30T13:09:09.450 INFO:teuthology.orchestra.run.smithi151.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 4.0 MB/s | 247 kB 00:00 2024-03-30T13:09:09.484 INFO:teuthology.orchestra.run.smithi151.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.9 MB/s | 321 kB 00:00 2024-03-30T13:09:09.575 INFO:teuthology.orchestra.run.smithi151.stdout:(157/174): librbd1-19.0.0-2519.gac171039.el9.x8 3.5 MB/s | 3.1 MB 00:00 2024-03-30T13:09:09.592 INFO:teuthology.orchestra.run.smithi151.stdout:(158/174): acl-2.3.1-4.el9.x86_64.rpm 515 kB/s | 71 kB 00:00 2024-03-30T13:09:09.617 INFO:teuthology.orchestra.run.smithi151.stdout:(159/174): elfutils-debuginfod-client-0.190-2.e 274 kB/s | 36 kB 00:00 2024-03-30T13:09:09.659 INFO:teuthology.orchestra.run.smithi151.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2024-03-30T13:09:09.684 INFO:teuthology.orchestra.run.smithi151.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 351 kB/s | 23 kB 00:00 2024-03-30T13:09:09.718 INFO:teuthology.orchestra.run.smithi151.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 108 kB 00:00 2024-03-30T13:09:09.768 INFO:teuthology.orchestra.run.smithi151.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 155 kB 00:00 2024-03-30T13:09:09.793 INFO:teuthology.orchestra.run.smithi151.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 136 kB 00:00 2024-03-30T13:09:09.848 INFO:teuthology.orchestra.run.smithi151.stdout:(165/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.0 MB/s | 256 kB 00:00 2024-03-30T13:09:09.877 INFO:teuthology.orchestra.run.smithi151.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 346 kB/s | 29 kB 00:00 2024-03-30T13:09:09.903 INFO:teuthology.orchestra.run.smithi151.stdout:(167/174): libsmartcols-2.37.4-18.el9.x86_64.rp 478 kB/s | 64 kB 00:00 2024-03-30T13:09:10.070 INFO:teuthology.orchestra.run.smithi151.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 5.5 MB/s | 1.2 MB 00:00 2024-03-30T13:09:10.197 INFO:teuthology.orchestra.run.smithi151.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 3.6 MB/s | 465 kB 00:00 2024-03-30T13:09:10.264 INFO:teuthology.orchestra.run.smithi151.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 5.6 MB/s | 2.2 MB 00:00 2024-03-30T13:09:10.308 INFO:teuthology.orchestra.run.smithi151.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 282 kB/s | 31 kB 00:00 2024-03-30T13:09:10.415 INFO:teuthology.orchestra.run.smithi151.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 4.5 MB/s | 2.3 MB 00:00 2024-03-30T13:09:10.465 INFO:teuthology.orchestra.run.smithi151.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 5.4 MB/s | 1.1 MB 00:00 2024-03-30T13:09:10.498 INFO:teuthology.orchestra.run.smithi151.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 393 kB/s | 74 kB 00:00 2024-03-30T13:09:10.507 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-03-30T13:09:10.508 INFO:teuthology.orchestra.run.smithi151.stdout:Total 16 MB/s | 226 MB 00:14 2024-03-30T13:09:11.670 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-03-30T13:09:12.053 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-03-30T13:09:12.053 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-03-30T13:09:14.483 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-03-30T13:09:14.484 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-03-30T13:09:15.287 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-03-30T13:09:15.372 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-30T13:09:15.501 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-30T13:09:15.726 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-30T13:09:15.772 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-30T13:09:15.876 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-30T13:09:15.987 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-30T13:09:16.053 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-30T13:09:16.100 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-30T13:09:16.203 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-30T13:09:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-30T13:09:16.673 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:19.0.0-2519.gac171039.el9.x86_64 10/198 2024-03-30T13:09:16.828 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:19.0.0-2519.gac171039.el9.x86_64 10/198 2024-03-30T13:09:16.860 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 11/198 2024-03-30T13:09:16.977 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 11/198 2024-03-30T13:09:17.009 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:19.0.0-2519.gac171039.el9.x86_64 12/198 2024-03-30T13:09:17.074 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-30T13:09:17.401 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-30T13:09:17.458 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-30T13:09:17.483 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 16/198 2024-03-30T13:09:17.642 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 16/198 2024-03-30T13:09:17.667 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:19.0.0-2519.gac171039.el9.x86 17/198 2024-03-30T13:09:17.783 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2519.gac171039.el9.x86 17/198 2024-03-30T13:09:17.828 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-30T13:09:17.852 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-30T13:09:17.926 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-30T13:09:18.231 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-30T13:09:18.278 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-30T13:09:18.330 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-30T13:09:18.718 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-30T13:09:18.828 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-30T13:09:18.901 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-30T13:09:19.110 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-30T13:09:19.156 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-30T13:09:19.484 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-30T13:09:19.677 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-30T13:09:19.799 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-30T13:09:19.846 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-30T13:09:19.882 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-30T13:09:19.943 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-30T13:09:20.054 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-30T13:09:20.124 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-30T13:09:20.181 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-30T13:09:20.288 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-30T13:09:20.344 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-30T13:09:20.405 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-30T13:09:20.448 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-30T13:09:20.479 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-30T13:09:20.596 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-30T13:09:20.635 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:19.0.0-2519.gac171039.el9. 39/198 2024-03-30T13:09:20.688 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:19.0.0-2519.gac171039.el 40/198 2024-03-30T13:09:20.723 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:19.0.0-2519.gac171039.el9.x86_6 41/198 2024-03-30T13:09:20.844 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-30T13:09:20.905 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-30T13:09:21.037 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-30T13:09:21.222 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-30T13:09:21.288 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-30T13:09:22.001 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-30T13:09:22.106 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-30T13:09:22.128 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-03-30T13:09:22.219 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-30T13:09:22.237 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-30T13:09:22.285 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-30T13:09:22.310 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-30T13:09:22.339 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-30T13:09:22.352 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-30T13:09:22.393 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-30T13:09:22.396 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-30T13:09:22.474 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-30T13:09:22.497 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-30T13:09:22.534 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:19.0.0-2519.gac171039.el9.x86_6 53/198 2024-03-30T13:09:22.577 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-30T13:09:22.595 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-30T13:09:22.649 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-30T13:09:22.682 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-30T13:09:22.776 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-30T13:09:22.994 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-30T13:09:23.207 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-30T13:09:23.229 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-30T13:09:23.301 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:19.0.0-2519.gac171039.el9.x86_64 10/198 2024-03-30T13:09:23.325 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-30T13:09:23.384 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-30T13:09:23.468 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:19.0.0-2519.gac171039.el9.x86_64 10/198 2024-03-30T13:09:23.507 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 11/198 2024-03-30T13:09:23.610 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-30T13:09:23.631 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 11/198 2024-03-30T13:09:23.661 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-30T13:09:23.667 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:19.0.0-2519.gac171039.el9.x86_64 12/198 2024-03-30T13:09:23.741 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-30T13:09:23.743 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-30T13:09:23.836 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-30T13:09:23.877 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-30T13:09:23.917 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-30T13:09:23.988 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-30T13:09:24.034 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-30T13:09:24.083 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-30T13:09:24.098 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-30T13:09:24.138 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-30T13:09:24.163 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 16/198 2024-03-30T13:09:24.182 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-30T13:09:24.348 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 16/198 2024-03-30T13:09:24.373 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:19.0.0-2519.gac171039.el9.x86 17/198 2024-03-30T13:09:24.391 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-30T13:09:24.448 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-30T13:09:24.464 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2519.gac171039.el9.x86 17/198 2024-03-30T13:09:24.487 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-30T13:09:24.509 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-30T13:09:24.534 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-30T13:09:24.537 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-30T13:09:24.596 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-30T13:09:24.681 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-30T13:09:24.725 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-30T13:09:24.789 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-30T13:09:24.825 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-30T13:09:24.858 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-30T13:09:24.887 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-30T13:09:24.926 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-30T13:09:24.968 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-30T13:09:24.978 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-30T13:09:25.144 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-30T13:09:25.285 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-30T13:09:25.298 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-30T13:09:25.343 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-30T13:09:25.406 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-30T13:09:25.482 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-30T13:09:25.493 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-30T13:09:25.607 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-30T13:09:25.730 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-30T13:09:25.798 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-30T13:09:25.805 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-30T13:09:25.855 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-30T13:09:25.982 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-30T13:09:26.028 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-30T13:09:26.076 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-30T13:09:26.116 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-30T13:09:26.157 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-30T13:09:26.195 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-30T13:09:26.261 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-30T13:09:26.263 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-30T13:09:26.320 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-30T13:09:26.370 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-30T13:09:26.503 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-30T13:09:26.556 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-30T13:09:26.591 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-30T13:09:26.655 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-30T13:09:26.719 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-30T13:09:26.809 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-30T13:09:26.873 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-30T13:09:26.939 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-30T13:09:26.987 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-30T13:09:26.993 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-30T13:09:27.041 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-30T13:09:27.049 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-30T13:09:27.085 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-30T13:09:27.117 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-30T13:09:27.143 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-30T13:09:27.245 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-30T13:09:27.287 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-30T13:09:27.316 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-30T13:09:27.367 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-30T13:09:27.373 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-30T13:09:27.475 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-30T13:09:27.548 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-30T13:09:27.639 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-30T13:09:27.687 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-30T13:09:27.724 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-30T13:09:27.846 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-30T13:09:28.051 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:19.0.0-2519.gac171039.el9. 39/198 2024-03-30T13:09:28.114 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:19.0.0-2519.gac171039.el 40/198 2024-03-30T13:09:28.152 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:19.0.0-2519.gac171039.el9.x86_6 41/198 2024-03-30T13:09:28.277 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-30T13:09:28.339 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-30T13:09:28.375 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-30T13:09:28.441 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-30T13:09:28.451 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-30T13:09:28.475 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-30T13:09:28.538 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-30T13:09:28.652 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-30T13:09:28.662 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-30T13:09:28.701 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-30T13:09:28.717 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-30T13:09:28.948 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-30T13:09:28.980 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-30T13:09:29.082 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-30T13:09:29.429 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-30T13:09:29.522 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-30T13:09:29.639 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-30T13:09:29.708 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-30T13:09:29.736 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-30T13:09:29.789 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-30T13:09:29.867 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-30T13:09:29.928 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:19.0.0-2519.gac171039.el9.x86_6 53/198 2024-03-30T13:09:29.938 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-30T13:09:29.978 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-30T13:09:30.079 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-30T13:09:30.393 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-30T13:09:30.654 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-30T13:09:30.741 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-30T13:09:30.787 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-30T13:09:30.995 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-30T13:09:31.046 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-30T13:09:31.122 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-30T13:09:31.217 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-30T13:09:31.281 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-30T13:09:31.320 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-30T13:09:31.390 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-30T13:09:31.429 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-30T13:09:31.492 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-30T13:09:31.550 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-30T13:09:31.689 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-30T13:09:31.741 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-30T13:09:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-30T13:09:31.803 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-30T13:09:31.839 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-30T13:09:31.839 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-30T13:09:31.869 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-30T13:09:31.902 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-30T13:09:31.904 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-30T13:09:32.038 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-30T13:09:32.081 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-30T13:09:32.127 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-30T13:09:32.189 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-30T13:09:32.223 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-30T13:09:32.306 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-30T13:09:32.341 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:19.0.0-2519.gac171039.el9.x86_64 124/198 2024-03-30T13:09:32.411 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-30T13:09:32.496 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:19.0.0-2519.gac171039.el9.x86_64 124/198 2024-03-30T13:09:32.531 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:19.0.0-2519.gac171039.el9.x86_64 125/198 2024-03-30T13:09:32.582 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-30T13:09:32.600 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-30T13:09:32.741 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-30T13:09:32.794 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-30T13:09:32.856 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-30T13:09:32.944 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-30T13:09:33.151 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-30T13:09:33.186 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:19.0.0-2519.gac171039.el9.x86_64 128/198 2024-03-30T13:09:33.200 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-30T13:09:33.259 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-30T13:09:33.277 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:19.0.0-2519.gac171039.el9.x86_64 128/198 2024-03-30T13:09:33.305 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:19.0.0-2519.gac171039.el9.x86_64 129/198 2024-03-30T13:09:33.436 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-30T13:09:33.490 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-30T13:09:33.568 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-30T13:09:33.604 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-30T13:09:33.647 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-30T13:09:33.693 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-30T13:09:33.761 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-30T13:09:33.819 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-30T13:09:33.867 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-30T13:09:33.993 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-30T13:09:34.045 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-30T13:09:34.080 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-30T13:09:34.145 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-30T13:09:34.184 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-30T13:09:34.328 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-30T13:09:34.454 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-30T13:09:34.514 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-30T13:09:34.550 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-30T13:09:34.607 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-30T13:09:34.746 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-30T13:09:34.808 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-30T13:09:35.779 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-30T13:09:35.857 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-30T13:09:35.911 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-30T13:09:35.974 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-30T13:09:35.975 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 130/198 2024-03-30T13:09:36.009 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 130/198 2024-03-30T13:09:36.095 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-30T13:09:36.136 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-30T13:09:36.367 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-30T13:09:36.408 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-30T13:09:36.521 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-30T13:09:36.665 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 130/198 2024-03-30T13:09:36.705 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 131/198 2024-03-30T13:09:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 131/198 2024-03-30T13:09:36.848 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-30T13:09:36.848 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-30T13:09:36.848 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:09:36.889 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 132/198 2024-03-30T13:09:37.340 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-30T13:09:37.490 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-30T13:09:39.026 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-30T13:09:39.117 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-30T13:09:39.155 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-30T13:09:39.186 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-30T13:09:39.226 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-30T13:09:39.611 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-30T13:09:39.651 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:19.0.0-2519.gac171039.el9.x86_64 124/198 2024-03-30T13:09:39.772 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:19.0.0-2519.gac171039.el9.x86_64 124/198 2024-03-30T13:09:39.801 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:19.0.0-2519.gac171039.el9.x86_64 125/198 2024-03-30T13:09:39.855 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-30T13:09:40.362 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-30T13:09:40.417 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:19.0.0-2519.gac171039.el9.x86_64 128/198 2024-03-30T13:09:40.515 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:19.0.0-2519.gac171039.el9.x86_64 128/198 2024-03-30T13:09:40.542 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:19.0.0-2519.gac171039.el9.x86_64 129/198 2024-03-30T13:09:43.204 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 130/198 2024-03-30T13:09:43.240 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 130/198 2024-03-30T13:09:43.870 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 130/198 2024-03-30T13:09:43.919 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 131/198 2024-03-30T13:09:44.100 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 131/198 2024-03-30T13:09:44.101 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-30T13:09:44.101 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-30T13:09:44.101 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:09:44.171 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 132/198 2024-03-30T13:09:50.435 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 132/198 2024-03-30T13:09:50.435 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2024-03-30T13:09:50.435 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2024-03-30T13:09:50.435 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2024-03-30T13:09:50.435 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2024-03-30T13:09:50.435 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2024-03-30T13:09:50.436 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2024-03-30T13:09:50.436 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2024-03-30T13:09:50.436 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:09:50.668 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 133/198 2024-03-30T13:09:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 133/198 2024-03-30T13:09:50.721 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:50.721 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-30T13:09:50.721 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:09:52.405 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 134/198 2024-03-30T13:09:52.491 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 134/198 2024-03-30T13:09:52.491 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:52.491 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-30T13:09:52.491 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T13:09:52.491 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T13:09:52.491 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:09:52.747 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 135/198 2024-03-30T13:09:52.818 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 135/198 2024-03-30T13:09:52.818 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:52.818 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-30T13:09:52.818 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T13:09:52.818 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T13:09:52.819 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:09:53.331 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 136/198 2024-03-30T13:09:53.408 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 136/198 2024-03-30T13:09:53.408 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:53.409 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-30T13:09:53.409 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T13:09:53.409 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T13:09:53.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:09:53.525 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-30T13:09:54.484 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.0.0-2519.gac171039.el9.noarch 138/198 2024-03-30T13:09:54.526 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:19.0.0-2519.gac171039.el9.noarch 138/198 2024-03-30T13:09:54.578 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2519.gac171039.e 139/198 2024-03-30T13:09:54.682 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2519.gac171039. 140/198 2024-03-30T13:09:54.713 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noa 141/198 2024-03-30T13:09:56.023 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noa 141/198 2024-03-30T13:09:56.065 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.n 142/198 2024-03-30T13:09:57.188 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 132/198 2024-03-30T13:09:57.188 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2024-03-30T13:09:57.188 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2024-03-30T13:09:57.188 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2024-03-30T13:09:57.188 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2024-03-30T13:09:57.188 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2024-03-30T13:09:57.188 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2024-03-30T13:09:57.188 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2024-03-30T13:09:57.188 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:09:57.212 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.n 142/198 2024-03-30T13:09:57.248 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2519.gac1 143/198 2024-03-30T13:09:57.396 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2519.gac1 143/198 2024-03-30T13:09:57.424 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 133/198 2024-03-30T13:09:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 133/198 2024-03-30T13:09:57.466 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:57.466 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-30T13:09:57.466 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:09:57.570 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2519.gac171039.el 144/198 2024-03-30T13:09:57.600 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 145/198 2024-03-30T13:09:57.674 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 145/198 2024-03-30T13:09:57.674 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:57.674 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-30T13:09:57.674 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T13:09:57.674 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T13:09:57.674 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:09:57.735 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 146/198 2024-03-30T13:09:57.774 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 146/198 2024-03-30T13:09:57.832 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:19.0.0-2519.gac171039.el9.x86_64 147/198 2024-03-30T13:09:58.832 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-30T13:09:58.870 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 149/198 2024-03-30T13:09:58.945 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 149/198 2024-03-30T13:09:58.945 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:58.945 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-30T13:09:58.945 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T13:09:58.946 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T13:09:58.946 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:09:58.996 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2519.gac171 150/198 2024-03-30T13:09:59.050 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 134/198 2024-03-30T13:09:59.065 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2519.gac171 150/198 2024-03-30T13:09:59.066 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:59.066 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-30T13:09:59.066 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:09:59.147 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 151/198 2024-03-30T13:09:59.151 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 134/198 2024-03-30T13:09:59.152 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:59.152 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-30T13:09:59.152 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T13:09:59.152 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-30T13:09:59.152 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:09:59.252 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 151/198 2024-03-30T13:09:59.252 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:59.252 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-30T13:09:59.252 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-30T13:09:59.252 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-30T13:09:59.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:09:59.401 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 135/198 2024-03-30T13:09:59.492 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 135/198 2024-03-30T13:09:59.492 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:59.492 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-30T13:09:59.492 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T13:09:59.492 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-30T13:09:59.492 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:09:59.647 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 152/198 2024-03-30T13:09:59.734 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 152/198 2024-03-30T13:09:59.734 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:09:59.734 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-30T13:09:59.734 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T13:09:59.735 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T13:09:59.735 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:09:59.968 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 136/198 2024-03-30T13:10:00.060 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 136/198 2024-03-30T13:10:00.060 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:10:00.060 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-30T13:10:00.061 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T13:10:00.061 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-30T13:10:00.061 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:00.171 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-30T13:10:00.816 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:19.0.0-2519.gac171039.el9.noarch 138/198 2024-03-30T13:10:00.848 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:19.0.0-2519.gac171039.el9.noarch 138/198 2024-03-30T13:10:00.898 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2519.gac171039.e 139/198 2024-03-30T13:10:01.001 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2519.gac171039. 140/198 2024-03-30T13:10:01.036 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noa 141/198 2024-03-30T13:10:02.330 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noa 141/198 2024-03-30T13:10:02.405 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.n 142/198 2024-03-30T13:10:03.495 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.n 142/198 2024-03-30T13:10:03.530 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2519.gac1 143/198 2024-03-30T13:10:03.676 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2519.gac1 143/198 2024-03-30T13:10:03.852 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2519.gac171039.el 144/198 2024-03-30T13:10:03.891 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 145/198 2024-03-30T13:10:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 145/198 2024-03-30T13:10:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:10:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-30T13:10:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T13:10:03.960 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-30T13:10:03.960 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:04.026 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 146/198 2024-03-30T13:10:04.064 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 146/198 2024-03-30T13:10:04.147 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:19.0.0-2519.gac171039.el9.x86_64 147/198 2024-03-30T13:10:04.837 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:19.0.0-2519.gac171039.el9.x86_64 153/198 2024-03-30T13:10:04.881 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:19.0.0-2519.gac171039.el9.x86_64 154/198 2024-03-30T13:10:04.918 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:19.0.0-2519.gac171039.el9.x86_64 155/198 2024-03-30T13:10:04.957 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-30T13:10:05.143 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-30T13:10:05.178 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 149/198 2024-03-30T13:10:05.248 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-shell-2:19.0.0-2519.gac171039.el9.x86_64 157/198 2024-03-30T13:10:05.276 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 149/198 2024-03-30T13:10:05.276 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:10:05.277 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-30T13:10:05.277 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T13:10:05.277 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-30T13:10:05.277 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:05.321 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2519.gac171 150/198 2024-03-30T13:10:05.385 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-30T13:10:05.415 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2519.gac171 150/198 2024-03-30T13:10:05.415 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:10:05.415 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-30T13:10:05.415 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:05.437 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:19.0.0-2519.gac171039.el9.x86_64 159/198 2024-03-30T13:10:05.492 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-30T13:10:05.505 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 151/198 2024-03-30T13:10:05.578 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-30T13:10:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 151/198 2024-03-30T13:10:05.610 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:10:05.610 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-30T13:10:05.610 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-30T13:10:05.610 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-30T13:10:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:05.650 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-30T13:10:05.694 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:19.0.0-2519.gac171039.el9.x86_ 163/198 2024-03-30T13:10:05.753 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-30T13:10:05.805 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-30T13:10:05.915 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-30T13:10:06.006 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 152/198 2024-03-30T13:10:06.076 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-30T13:10:06.093 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 152/198 2024-03-30T13:10:06.093 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-30T13:10:06.093 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-30T13:10:06.093 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T13:10:06.093 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-30T13:10:06.093 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:06.113 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-30T13:10:06.938 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-30T13:10:06.986 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-30T13:10:07.049 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-30T13:10:08.490 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-top-2:19.0.0-2519.gac171039.el9.noarch 170/198 2024-03-30T13:10:08.616 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-30T13:10:08.681 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-30T13:10:08.834 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-30T13:10:08.877 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-30T13:10:08.910 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-30T13:10:08.944 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-30T13:10:08.987 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-30T13:10:08.987 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-30T13:10:09.140 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-30T13:10:09.207 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-30T13:10:09.207 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-30T13:10:09.361 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-30T13:10:09.406 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-30T13:10:09.452 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-30T13:10:09.485 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-30T13:10:09.525 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-30T13:10:09.605 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-30T13:10:09.683 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-30T13:10:09.739 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-30T13:10:09.772 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-30T13:10:09.830 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-30T13:10:09.864 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-30T13:10:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-30T13:10:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-30T13:10:09.936 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-30T13:10:10.281 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-30T13:10:10.282 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-30T13:10:10.420 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-30T13:10:10.476 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-30T13:10:10.530 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-30T13:10:10.570 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-30T13:10:10.610 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-30T13:10:10.735 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-30T13:10:10.930 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:19.0.0-2519.gac171039.el9.x86_64 153/198 2024-03-30T13:10:10.977 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:19.0.0-2519.gac171039.el9.x86_64 154/198 2024-03-30T13:10:11.010 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-30T13:10:11.010 INFO:teuthology.orchestra.run.smithi044.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-30T13:10:11.010 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:11.012 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:19.0.0-2519.gac171039.el9.x86_64 155/198 2024-03-30T13:10:11.083 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-30T13:10:11.393 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-shell-2:19.0.0-2519.gac171039.el9.x86_64 157/198 2024-03-30T13:10:11.517 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-30T13:10:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:19.0.0-2519.gac171039.el9.x86_64 159/198 2024-03-30T13:10:11.640 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-30T13:10:11.708 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-30T13:10:11.762 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-30T13:10:11.796 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:19.0.0-2519.gac171039.el9.x86_ 163/198 2024-03-30T13:10:11.833 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-30T13:10:11.885 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-30T13:10:11.978 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-30T13:10:12.106 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-30T13:10:12.142 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-30T13:10:13.065 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-30T13:10:13.117 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-30T13:10:13.172 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-30T13:10:14.513 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:19.0.0-2519.gac171039.el9.noarch 170/198 2024-03-30T13:10:14.609 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-30T13:10:14.656 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-30T13:10:14.791 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-30T13:10:14.829 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-30T13:10:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-30T13:10:14.897 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-30T13:10:14.939 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-30T13:10:14.939 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-30T13:10:15.084 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-30T13:10:15.127 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-30T13:10:15.127 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-30T13:10:15.281 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-30T13:10:15.334 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-30T13:10:15.381 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-30T13:10:15.414 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-30T13:10:15.446 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-30T13:10:15.516 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-30T13:10:15.595 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-30T13:10:15.669 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-30T13:10:15.703 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-30T13:10:15.736 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-30T13:10:15.770 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-30T13:10:15.803 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-30T13:10:15.841 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-30T13:10:15.841 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-30T13:10:16.153 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-30T13:10:16.154 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-30T13:10:16.302 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-30T13:10:16.332 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-30T13:10:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-30T13:10:16.427 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-30T13:10:16.467 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-30T13:10:16.586 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-30T13:10:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:19.0.0-2519.gac171039.el9.x86_64 1/198 2024-03-30T13:10:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 2/198 2024-03-30T13:10:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 3/198 2024-03-30T13:10:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:19.0.0-2519.gac171039.el9.x86_64 4/198 2024-03-30T13:10:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2519.gac171 5/198 2024-03-30T13:10:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 6/198 2024-03-30T13:10:16.733 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 7/198 2024-03-30T13:10:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 8/198 2024-03-30T13:10:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 9/198 2024-03-30T13:10:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 10/198 2024-03-30T13:10:16.734 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 11/198 2024-03-30T13:10:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:19.0.0-2519.gac171039.el9.x86_64 12/198 2024-03-30T13:10:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 13/198 2024-03-30T13:10:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-shell-2:19.0.0-2519.gac171039.el9.x86_64 14/198 2024-03-30T13:10:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:19.0.0-2519.gac171039.el9.x86_ 15/198 2024-03-30T13:10:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 16/198 2024-03-30T13:10:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 17/198 2024-03-30T13:10:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:19.0.0-2519.gac171039.el9.x86_6 18/198 2024-03-30T13:10:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:19.0.0-2519.gac171039.el9.x86 19/198 2024-03-30T13:10:16.752 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:19.0.0-2519.gac171039.el9.x86_64 20/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2519.gac171039.el 21/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:19.0.0-2519.gac171039.el9. 22/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:19.0.0-2519.gac171039.el9.x86_6 23/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:19.0.0-2519.gac171039.el9.x86_64 24/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:19.0.0-2519.gac171039.el9.x86_64 25/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:19.0.0-2519.gac171039.el9.x86_64 26/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:19.0.0-2519.gac171039.el9.x86_64 27/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 28/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:19.0.0-2519.gac171039.el9.x86_64 29/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2519.gac171039. 30/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noa 31/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.n 32/198 2024-03-30T13:10:16.753 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2519.gac1 33/198 2024-03-30T13:10:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2519.gac171039.el 34/198 2024-03-30T13:10:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 35/198 2024-03-30T13:10:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2519.gac171039.e 36/198 2024-03-30T13:10:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 37/198 2024-03-30T13:10:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:19.0.0-2519.gac171039.el9.noarch 38/198 2024-03-30T13:10:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-top-2:19.0.0-2519.gac171039.el9.noarch 39/198 2024-03-30T13:10:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-30T13:10:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-30T13:10:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-30T13:10:16.754 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-30T13:10:16.755 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-30T13:10:16.756 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-30T13:10:16.757 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-30T13:10:16.758 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-30T13:10:16.759 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-30T13:10:16.760 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-30T13:10:16.761 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-30T13:10:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-30T13:10:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-30T13:10:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-30T13:10:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-30T13:10:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-30T13:10:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-30T13:10:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-30T13:10:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-30T13:10:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-30T13:10:16.762 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:19.0.0-2519.gac171039.el9.x86_64 151/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:19.0.0-2519.gac171039.el9.x86_64 153/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-30T13:10:16.763 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-30T13:10:16.764 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-30T13:10:16.765 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-30T13:10:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-30T13:10:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-30T13:10:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-30T13:10:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-30T13:10:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-30T13:10:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-30T13:10:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-30T13:10:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-30T13:10:16.766 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-30T13:10:16.848 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-30T13:10:16.848 INFO:teuthology.orchestra.run.smithi151.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-30T13:10:16.849 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:19.370 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-30T13:10:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:19.371 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-03-30T13:10:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-30T13:10:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-30T13:10:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-30T13:10:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-30T13:10:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: acl-2.3.1-4.el9.x86_64 2024-03-30T13:10:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-30T13:10:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-30T13:10:19.371 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-30T13:10:19.372 INFO:teuthology.orchestra.run.smithi044.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: automake-1.16.2-8.el9.noarch 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: bison-3.7.4-5.el9.x86_64 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.373 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.374 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-30T13:10:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: flex-2.6.4-9.el9.x86_64 2024-03-30T13:10:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-30T13:10:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-30T13:10:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-30T13:10:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-30T13:10:19.375 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-30T13:10:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-30T13:10:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: jq-1.6-16.el9.x86_64 2024-03-30T13:10:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-30T13:10:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-30T13:10:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-30T13:10:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-30T13:10:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-30T13:10:19.376 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-30T13:10:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-30T13:10:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-30T13:10:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-30T13:10:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-30T13:10:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-30T13:10:19.377 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-30T13:10:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-30T13:10:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-30T13:10:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: lua-5.4.4-4.el9.x86_64 2024-03-30T13:10:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-30T13:10:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-30T13:10:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-30T13:10:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-30T13:10:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-30T13:10:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-30T13:10:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-30T13:10:19.378 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-13.14-1.el9.x86_64 2024-03-30T13:10:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-30T13:10:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-30T13:10:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-30T13:10:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-30T13:10:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-30T13:10:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-30T13:10:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-30T13:10:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-30T13:10:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-30T13:10:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-30T13:10:19.379 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-30T13:10:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-30T13:10:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-30T13:10:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-30T13:10:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-30T13:10:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-30T13:10:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-30T13:10:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-30T13:10:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-30T13:10:19.380 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-30T13:10:19.381 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-30T13:10:19.382 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-30T13:10:19.383 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:19.384 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-3.el9.x86_64 2024-03-30T13:10:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-30T13:10:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-30T13:10:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-30T13:10:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-30T13:10:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-30T13:10:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-30T13:10:19.385 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:19.385 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-03-30T13:10:20.029 DEBUG:teuthology.parallel:result is None 2024-03-30T13:10:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:19.0.0-2519.gac171039.el9.x86_64 1/198 2024-03-30T13:10:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 2/198 2024-03-30T13:10:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 3/198 2024-03-30T13:10:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:19.0.0-2519.gac171039.el9.x86_64 4/198 2024-03-30T13:10:22.698 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2519.gac171 5/198 2024-03-30T13:10:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 6/198 2024-03-30T13:10:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 7/198 2024-03-30T13:10:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 8/198 2024-03-30T13:10:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 9/198 2024-03-30T13:10:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 10/198 2024-03-30T13:10:22.699 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 11/198 2024-03-30T13:10:22.717 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:19.0.0-2519.gac171039.el9.x86_64 12/198 2024-03-30T13:10:22.717 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 13/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-shell-2:19.0.0-2519.gac171039.el9.x86_64 14/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:19.0.0-2519.gac171039.el9.x86_ 15/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 16/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 17/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:19.0.0-2519.gac171039.el9.x86_6 18/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:19.0.0-2519.gac171039.el9.x86 19/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:19.0.0-2519.gac171039.el9.x86_64 20/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2519.gac171039.el 21/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:19.0.0-2519.gac171039.el9. 22/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:19.0.0-2519.gac171039.el9.x86_6 23/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:19.0.0-2519.gac171039.el9.x86_64 24/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:19.0.0-2519.gac171039.el9.x86_64 25/198 2024-03-30T13:10:22.718 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:19.0.0-2519.gac171039.el9.x86_64 26/198 2024-03-30T13:10:22.719 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:19.0.0-2519.gac171039.el9.x86_64 27/198 2024-03-30T13:10:22.719 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 28/198 2024-03-30T13:10:22.719 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:19.0.0-2519.gac171039.el9.x86_64 29/198 2024-03-30T13:10:22.719 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2519.gac171039. 30/198 2024-03-30T13:10:22.719 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noa 31/198 2024-03-30T13:10:22.719 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.n 32/198 2024-03-30T13:10:22.719 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2519.gac1 33/198 2024-03-30T13:10:22.719 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2519.gac171039.el 34/198 2024-03-30T13:10:22.719 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 35/198 2024-03-30T13:10:22.719 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2519.gac171039.e 36/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 37/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:19.0.0-2519.gac171039.el9.noarch 38/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:19.0.0-2519.gac171039.el9.noarch 39/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-30T13:10:22.720 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-30T13:10:22.721 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-30T13:10:22.721 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-30T13:10:22.721 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-30T13:10:22.721 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-30T13:10:22.721 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-30T13:10:22.721 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-30T13:10:22.721 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-30T13:10:22.721 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-30T13:10:22.721 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-30T13:10:22.721 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-30T13:10:22.722 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-30T13:10:22.723 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-30T13:10:22.723 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-30T13:10:22.723 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-30T13:10:22.723 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-30T13:10:22.723 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-30T13:10:22.723 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-30T13:10:22.723 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-30T13:10:22.724 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-30T13:10:22.724 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-30T13:10:22.724 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-30T13:10:22.724 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-30T13:10:22.724 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-30T13:10:22.724 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-30T13:10:22.725 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-30T13:10:22.725 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-30T13:10:22.725 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-30T13:10:22.725 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-30T13:10:22.725 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-30T13:10:22.725 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-30T13:10:22.725 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-30T13:10:22.725 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-30T13:10:22.725 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-30T13:10:22.725 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-30T13:10:22.725 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-30T13:10:22.725 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-30T13:10:22.726 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-30T13:10:22.727 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-30T13:10:22.728 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-30T13:10:22.728 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-30T13:10:22.728 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-30T13:10:22.728 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-30T13:10:22.728 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-30T13:10:22.728 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-30T13:10:22.728 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-30T13:10:22.728 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-30T13:10:22.728 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-30T13:10:22.729 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-30T13:10:22.730 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:19.0.0-2519.gac171039.el9.x86_64 151/198 2024-03-30T13:10:22.731 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-30T13:10:22.731 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:19.0.0-2519.gac171039.el9.x86_64 153/198 2024-03-30T13:10:22.731 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-30T13:10:22.731 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-30T13:10:22.731 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-30T13:10:22.731 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-30T13:10:22.731 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-30T13:10:22.731 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-30T13:10:22.731 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-30T13:10:22.731 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-30T13:10:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-30T13:10:22.733 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-30T13:10:22.733 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-30T13:10:22.733 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-30T13:10:22.733 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-30T13:10:22.733 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-30T13:10:22.733 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-30T13:10:22.734 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-30T13:10:22.734 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-30T13:10:22.734 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-30T13:10:22.734 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-30T13:10:22.734 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-30T13:10:22.734 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-30T13:10:22.734 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-30T13:10:22.735 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-30T13:10:22.735 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-30T13:10:22.735 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-30T13:10:22.735 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-30T13:10:22.735 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-30T13:10:22.735 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-30T13:10:22.735 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-30T13:10:22.735 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-30T13:10:22.735 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-30T13:10:22.735 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-30T13:10:25.361 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-30T13:10:25.362 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:25.362 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2024-03-30T13:10:25.362 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-30T13:10:25.362 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-30T13:10:25.362 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-30T13:10:25.362 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-30T13:10:25.362 INFO:teuthology.orchestra.run.smithi151.stdout: acl-2.3.1-4.el9.x86_64 2024-03-30T13:10:25.362 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-30T13:10:25.362 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-30T13:10:25.362 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-30T13:10:25.363 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-30T13:10:25.363 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-30T13:10:25.363 INFO:teuthology.orchestra.run.smithi151.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-30T13:10:25.363 INFO:teuthology.orchestra.run.smithi151.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-30T13:10:25.363 INFO:teuthology.orchestra.run.smithi151.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-30T13:10:25.363 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.363 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.363 INFO:teuthology.orchestra.run.smithi151.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-30T13:10:25.363 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-30T13:10:25.363 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.2-8.el9.noarch 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.7.4-5.el9.x86_64 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.364 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.365 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.366 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:25.366 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.366 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.366 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.366 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:25.366 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:25.366 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.366 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.366 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:19.0.0-2519.gac171039.el9.noarch 2024-03-30T13:10:25.366 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-30T13:10:25.366 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.4-9.el9.x86_64 2024-03-30T13:10:25.366 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.6-16.el9.x86_64 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.367 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-30T13:10:25.368 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: lua-5.4.4-4.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-13.14-1.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-30T13:10:25.369 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-30T13:10:25.370 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-30T13:10:25.370 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-30T13:10:25.370 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-30T13:10:25.370 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-30T13:10:25.370 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.370 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.370 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.370 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-30T13:10:25.370 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-30T13:10:25.370 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-30T13:10:25.370 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-30T13:10:25.370 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-30T13:10:25.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2024-03-30T13:10:25.372 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.373 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-30T13:10:25.374 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-30T13:10:25.374 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-30T13:10:25.374 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-30T13:10:25.374 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-30T13:10:25.374 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-30T13:10:25.374 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-30T13:10:25.374 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-30T13:10:25.374 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-30T13:10:25.374 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:19.0.0-2519.gac171039.el9.x86_64 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-3.el9.x86_64 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-30T13:10:25.375 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-30T13:10:25.376 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-30T13:10:25.376 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-30T13:10:25.376 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:25.376 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-03-30T13:10:26.091 DEBUG:teuthology.parallel:result is None 2024-03-30T13:10:26.092 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T13:10:26.312 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-30T13:10:26.390 INFO:teuthology.orchestra.run.smithi044.stdout:19.0.0-2519.gac171039.el9 2024-03-30T13:10:26.391 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2519.gac171039.el9 2024-03-30T13:10:26.391 INFO:teuthology.task.install:The correct ceph version 19.0.0-2519.gac171039 is installed. 2024-03-30T13:10:26.393 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ac1710396f9f7c389fa4b407711bc5157a8c0bf7 2024-03-30T13:10:26.535 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-30T13:10:26.588 INFO:teuthology.orchestra.run.smithi151.stdout:19.0.0-2519.gac171039.el9 2024-03-30T13:10:26.588 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2519.gac171039.el9 2024-03-30T13:10:26.588 INFO:teuthology.task.install:The correct ceph version 19.0.0-2519.gac171039 is installed. 2024-03-30T13:10:26.590 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-30T13:10:26.591 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:10:26.591 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-30T13:10:26.703 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:10:26.704 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-30T13:10:26.779 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-30T13:10:26.780 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:10:26.780 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-03-30T13:10:26.888 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-30T13:10:27.028 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:10:27.028 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-03-30T13:10:27.101 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-30T13:10:27.214 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-30T13:10:27.214 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:10:27.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-30T13:10:27.319 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-30T13:10:27.463 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:10:27.463 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-30T13:10:27.532 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-30T13:10:27.641 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-30T13:10:27.642 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:10:27.642 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-03-30T13:10:27.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-30T13:10:27.848 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:10:27.849 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-03-30T13:10:27.923 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-30T13:10:28.034 INFO:teuthology.run_tasks:Running task ceph... 2024-03-30T13:10:28.130 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-30T13:10:28.130 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /var/log/ceph 2024-03-30T13:10:28.138 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2024-03-30T13:10:28.236 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-30T13:10:28.236 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-30T13:10:28.242 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-30T13:10:28.335 INFO:tasks.ceph:Creating extra log directories... 2024-03-30T13:10:28.335 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-30T13:10:28.341 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-30T13:10:28.445 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-30T13:10:28.445 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-30T13:10:28.445 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-30T13:10:28.445 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:10:28.445 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-30T13:10:28.502 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:28.786 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:28.889 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:10:28.890 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-30T13:10:28.932 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:29.162 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:29.263 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-30T13:10:29.263 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-30T13:10:29.263 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154', 'branch': 'wip-mchangir-testing1-main-20240328-072412', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/uninlining}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7629154', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-testing1-main-20240328-072412'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-testing1-main-20240328-072412', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 364, 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-mchangir-testing1-main-20240328-072412', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi044.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHTcTYBQ2jxpk8rcJzsWSoaYXcH6H35u4YT/BbNU//5s5R094eBAT2CKdDIquvZQ/lcFnPnLjS2wUYN56GCIixg=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9UJ+Hq2NYgak2LvH0ObOKoIyQPk5Hw1kpe6/jE2GSyXUIunDKTKky+sQlaAgoiVYmgmrk/e7vohRdkcZ9+gqY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'ac1710396f9f7c389fa4b407711bc5157a8c0bf7', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_uninlining']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-29_13:38:54', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-30T13:10:29.264 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-30T13:10:29.273 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-30T13:10:29.329 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m0777 -- /var/run/ceph 2024-03-30T13:10:29.334 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2024-03-30T13:10:29.437 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:10:29.437 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T13:10:29.495 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T13:10:29.495 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-03-30 13:10:11.447901265 +0000 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-03-30 13:07:46.443767672 +0000 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-03-30 13:07:46.443767672 +0000 2024-03-30T13:10:29.551 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-03-30 13:07:46.443767672 +0000 2024-03-30T13:10:29.552 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T13:10:29.650 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-03-30T13:10:29.651 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-03-30T13:10:29.651 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.00034721 s, 1.5 MB/s 2024-03-30T13:10:29.655 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T13:10:29.713 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-03-30T13:10:29.762 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T13:10:29.762 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:10:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-03-30T13:10:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:10:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:10:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-03-30 13:10:11.448901250 +0000 2024-03-30T13:10:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-03-30 13:07:47.038758389 +0000 2024-03-30T13:10:29.763 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-03-30 13:07:47.038758389 +0000 2024-03-30T13:10:29.763 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-03-30 13:07:47.038758389 +0000 2024-03-30T13:10:29.763 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T13:10:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-03-30T13:10:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-03-30T13:10:29.858 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000391022 s, 1.3 MB/s 2024-03-30T13:10:29.862 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T13:10:29.923 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-03-30T13:10:29.979 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T13:10:29.979 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:10:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-03-30T13:10:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:10:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:10:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-03-30 13:10:11.449901234 +0000 2024-03-30T13:10:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-03-30 13:07:47.654748776 +0000 2024-03-30T13:10:29.980 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-03-30 13:07:47.654748776 +0000 2024-03-30T13:10:29.980 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-03-30 13:07:47.654748776 +0000 2024-03-30T13:10:29.980 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T13:10:30.078 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-03-30T13:10:30.078 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-03-30T13:10:30.078 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000355906 s, 1.4 MB/s 2024-03-30T13:10:30.083 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T13:10:30.145 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-03-30 13:10:11.449901234 +0000 2024-03-30T13:10:30.199 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-03-30 13:07:48.273739115 +0000 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-03-30 13:07:48.273739115 +0000 2024-03-30T13:10:30.200 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-03-30 13:07:48.273739115 +0000 2024-03-30T13:10:30.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T13:10:30.295 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-03-30T13:10:30.295 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-03-30T13:10:30.295 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000331326 s, 1.5 MB/s 2024-03-30T13:10:30.300 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T13:10:30.360 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:10:30.361 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:10:30.361 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-03-30T13:10:30.417 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-30T13:10:30.417 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-03-30T13:10:30.469 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-30T13:10:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:10:30.470 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 632 Links: 1 2024-03-30T13:10:30.470 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:10:30.470 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:10:30.470 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-03-30 13:10:17.280552517 +0000 2024-03-30T13:10:30.470 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-03-30 13:07:28.002239915 +0000 2024-03-30T13:10:30.470 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-03-30 13:07:28.002239915 +0000 2024-03-30T13:10:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-03-30 13:07:28.002239915 +0000 2024-03-30T13:10:30.470 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-30T13:10:30.559 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-03-30T13:10:30.560 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-03-30T13:10:30.560 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000345863 s, 1.5 MB/s 2024-03-30T13:10:30.564 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-30T13:10:30.618 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-03-30T13:10:30.667 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-30T13:10:30.667 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:10:30.667 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-03-30T13:10:30.667 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:10:30.668 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:10:30.668 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-03-30 13:10:17.281552503 +0000 2024-03-30T13:10:30.668 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-03-30 13:07:28.600231608 +0000 2024-03-30T13:10:30.668 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-03-30 13:07:28.600231608 +0000 2024-03-30T13:10:30.668 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-03-30 13:07:28.600231608 +0000 2024-03-30T13:10:30.668 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-03-30T13:10:30.757 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000317744 s, 1.6 MB/s 2024-03-30T13:10:30.761 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-30T13:10:30.818 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-03-30T13:10:30.871 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-30T13:10:30.871 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:10:30.871 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-30T13:10:30.871 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:10:30.871 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:10:30.872 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-03-30 13:10:17.282552489 +0000 2024-03-30T13:10:30.872 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-03-30 13:07:29.177223592 +0000 2024-03-30T13:10:30.872 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-03-30 13:07:29.177223592 +0000 2024-03-30T13:10:30.872 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-03-30 13:07:29.177223592 +0000 2024-03-30T13:10:30.872 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-03-30T13:10:30.957 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000319205 s, 1.6 MB/s 2024-03-30T13:10:30.961 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-30T13:10:31.016 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-03-30T13:10:31.065 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-30T13:10:31.066 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-30T13:10:31.066 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-03-30T13:10:31.066 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-30T13:10:31.066 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-03-30T13:10:31.066 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-03-30 13:10:17.283552476 +0000 2024-03-30T13:10:31.066 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-03-30 13:07:29.751215619 +0000 2024-03-30T13:10:31.066 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-03-30 13:07:29.751215619 +0000 2024-03-30T13:10:31.066 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-03-30 13:07:29.751215619 +0000 2024-03-30T13:10:31.066 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-30T13:10:31.153 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-03-30T13:10:31.154 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-03-30T13:10:31.154 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000352203 s, 1.5 MB/s 2024-03-30T13:10:31.158 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-30T13:10:31.213 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:10:31.213 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-30T13:10:31.214 INFO:tasks.ceph:Generating config... 2024-03-30T13:10:31.215 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-30T13:10:31.215 INFO:tasks.ceph:[client] debug client = 20 2024-03-30T13:10:31.215 INFO:tasks.ceph:[client] debug ms = 1 2024-03-30T13:10:31.215 INFO:tasks.ceph:[client] pid file = 2024-03-30T13:10:31.215 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-30T13:10:31.215 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-30T13:10:31.215 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mds] mds_bal_replicate_threshold = 1 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mgr] debug client = 20 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-30T13:10:31.216 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-30T13:10:31.217 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-30T13:10:31.217 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-30T13:10:31.217 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-30T13:10:31.217 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-03-30T13:10:31.217 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-30T13:10:31.217 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-30T13:10:31.217 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-30T13:10:31.217 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-03-30T13:10:31.217 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-03-30T13:10:31.217 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-30T13:10:31.217 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-30T13:10:31.217 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-03-30T13:10:31.217 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-30T13:10:31.217 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-30T13:10:31.217 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-30T13:10:31.218 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-30T13:10:31.218 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-30T13:10:31.218 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-30T13:10:31.218 INFO:tasks.ceph:Setting up mon.a... 2024-03-30T13:10:31.219 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-30T13:10:31.362 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.keyring 2024-03-30T13:10:31.373 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-30T13:10:31.511 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-30T13:10:31.612 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.44'), ('mon.b', '172.21.15.151'), ('mon.c', '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]')] 2024-03-30T13:10:31.612 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.44,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-30T13:10:31.613 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:10:31.613 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-30T13:10:31.670 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.44 --add b 172.21.15.151 --addv c '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: generated fsid cf82a1f9-ad5a-4657-adf6-b77304ed0e9d 2024-03-30T13:10:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = quincy 2024-03-30T13:10:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 0 2024-03-30T13:10:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:fsid cf82a1f9-ad5a-4657-adf6-b77304ed0e9d 2024-03-30T13:10:31.830 INFO:teuthology.orchestra.run.smithi044.stdout:last_changed 2024-03-30T13:10:31.827499+0000 2024-03-30T13:10:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-03-30T13:10:31.827499+0000 2024-03-30T13:10:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:min_mon_release 17 (quincy) 2024-03-30T13:10:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:election_strategy: 1 2024-03-30T13:10:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-03-30T13:10:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2024-03-30T13:10:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:2: [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] mon.c 2024-03-30T13:10:31.831 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-30T13:10:31.834 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-30T13:10:31.888 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cf82a1f9-ad5a-4657-adf6-b77304ed0e9d... 2024-03-30T13:10:31.889 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-30T13:10:31.896 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-30T13:10:32.066 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2024-03-30T13:10:32.066 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2024-03-30T13:10:32.066 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-30T13:10:32.067 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2024-03-30T13:10:32.067 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.067 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2024-03-30T13:10:32.067 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.067 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2024-03-30T13:10:32.067 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.067 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2024-03-30T13:10:32.067 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2024-03-30T13:10:32.067 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.067 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2024-03-30T13:10:32.068 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2024-03-30T13:10:32.069 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.070 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2024-03-30T13:10:32.070 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2024-03-30T13:10:32.070 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2024-03-30T13:10:32.070 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.44,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2024-03-30T13:10:32.070 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on skipped message = False 2024-03-30T13:10:32.070 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = cf82a1f9-ad5a-4657-adf6-b77304ed0e9d 2024-03-30T13:10:32.070 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.070 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2024-03-30T13:10:32.070 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2024-03-30T13:10:32.070 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.070 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2024-03-30T13:10:32.070 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2024-03-30T13:10:32.071 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2024-03-30T13:10:32.071 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.071 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2024-03-30T13:10:32.071 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2024-03-30T13:10:32.071 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.071 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2024-03-30T13:10:32.071 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2024-03-30T13:10:32.071 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug trim objects = true 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2024-03-30T13:10:32.072 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 20 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 20 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 10 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2024-03-30T13:10:32.073 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: debug finisher = 20 2024-03-30T13:10:32.074 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-30T13:10:32.075 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: mon down mkfs grace = 300 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-03-30T13:10:32.076 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = "" 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2024-03-30T13:10:32.077 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds balancer = 20 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = True 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout: mds_bal_replicate_threshold = 1 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2024-03-30T13:10:32.078 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2024-03-30T13:10:32.079 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2024-03-30T13:10:32.079 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-03-30T13:10:32.079 INFO:teuthology.orchestra.run.smithi044.stdout: chdir = "" 2024-03-30T13:10:32.079 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-30T13:10:32.079 INFO:teuthology.orchestra.run.smithi044.stdout: auth supported = cephx 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: filestore xattr use omap = true 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: mon clock drift allowed = 1.000 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: osd crush chooseleaf type = 0 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: auth debug = true 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on old message = true 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on bug = true 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: mon pg warn max object skew = 0 2024-03-30T13:10:32.080 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: # disable pg_autoscaler by default for new pools 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default size = 2 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow primary affinity = true 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd allow pg remap = true 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on legacy crush tunables = false 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on crush straw calc version zero = false 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on no sortbitwise = false 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on osd down out interval zero = false 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: mon warn on too few osds = false 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-30T13:10:32.081 INFO:teuthology.orchestra.run.smithi044.stdout: mon_allow_pool_size_one = true 2024-03-30T13:10:32.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.082 INFO:teuthology.orchestra.run.smithi044.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-30T13:10:32.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.082 INFO:teuthology.orchestra.run.smithi044.stdout: osd default data pool replay window = 5 2024-03-30T13:10:32.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.082 INFO:teuthology.orchestra.run.smithi044.stdout: mon allow pool delete = true 2024-03-30T13:10:32.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.082 INFO:teuthology.orchestra.run.smithi044.stdout: mon cluster log file level = debug 2024-03-30T13:10:32.082 INFO:teuthology.orchestra.run.smithi044.stdout: debug asserts on shutdown = true 2024-03-30T13:10:32.082 INFO:teuthology.orchestra.run.smithi044.stdout: mon health detail to clog = false 2024-03-30T13:10:32.082 INFO:teuthology.orchestra.run.smithi044.stdout: mon host = "172.21.15.44,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: ms die on skipped message = False 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = cf82a1f9-ad5a-4657-adf6-b77304ed0e9d 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout:[osd] 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: osd journal size = 100 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub load threshold = 5.0 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: osd scrub max interval = 600 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: osd mclock profile = high_recovery_ops 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: osd recover clone overlap = true 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: osd recovery max chunk = 1048576 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug shutdown = true 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug op order = true 2024-03-30T13:10:32.083 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug verify stray on activate = true 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug trim objects = true 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: osd open classes on start = true 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug pg log writeout = true 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: osd deep scrub update digest min age = 30 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: osd map max advance = 10 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: journal zero on create = true 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: filestore ondisk finisher threads = 3 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: filestore apply finisher threads = 3 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.084 INFO:teuthology.orchestra.run.smithi044.stdout: bdev debug aio = true 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: osd debug misdirected ops = true 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore block size = 96636764160 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: bluestore fsck on mount = True 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluefs = 20 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: debug bluestore = 20 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: debug osd = 20 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: debug rocksdb = 10 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd backfillfull_ratio = 0.85 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd full ratio = 0.9 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd nearfull ratio = 0.8 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: osd failsafe full ratio = 0.95 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: osd objectstore = bluestore 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2024-03-30T13:10:32.085 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr] 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: debug mgr = 20 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: mgr/telemetry/nag = false 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: debug client = 20 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: debug finisher = 20 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout:[mon] 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: debug mon = 20 2024-03-30T13:10:32.086 INFO:teuthology.orchestra.run.smithi044.stdout: debug paxos = 20 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: debug auth = 20 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: mon data avail warn = 5 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: mon mgr mkfs grace = 240 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min pgs per osd = 4 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd reporter subtree level = osd 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: mon osd prime pg temp = true 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: mon reweight min bytes per osd = 10 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: auth mon ticket ttl = 660 # 11m 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: auth service ticket ttl = 240 # 4m 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: # don't complain about insecure global_id in the test suite 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-30T13:10:32.087 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: # 1m isn't quite enough 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: mon_down_mkfs_grace = 2m 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: mon_warn_on_filestore_osds = false 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: mon down mkfs grace = 300 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: mon op complaint time = 120 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout:[client] 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: rgw cache enabled = true 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable ops log = true 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: rgw enable usage log = true 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-30T13:10:32.088 INFO:teuthology.orchestra.run.smithi044.stdout: client mount timeout = 600 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout: debug client = 20 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout: pid file = "" 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.a] 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.b] 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout:[mon.c] 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout:[mds] 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds = 20 2024-03-30T13:10:32.089 INFO:teuthology.orchestra.run.smithi044.stdout: debug mds balancer = 20 2024-03-30T13:10:32.090 INFO:teuthology.orchestra.run.smithi044.stdout: debug ms = 1 2024-03-30T13:10:32.090 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug frag = True 2024-03-30T13:10:32.090 INFO:teuthology.orchestra.run.smithi044.stdout: mds debug scatterstat = True 2024-03-30T13:10:32.090 INFO:teuthology.orchestra.run.smithi044.stdout: mds op complaint time = 180 2024-03-30T13:10:32.090 INFO:teuthology.orchestra.run.smithi044.stdout: mds verify scatter = True 2024-03-30T13:10:32.090 INFO:teuthology.orchestra.run.smithi044.stdout: mds_bal_replicate_threshold = 1 2024-03-30T13:10:32.090 INFO:teuthology.orchestra.run.smithi044.stdout: osd op complaint time = 180 2024-03-30T13:10:32.090 INFO:teuthology.orchestra.run.smithi044.stdout: rados mon op timeout = 900 2024-03-30T13:10:32.090 INFO:teuthology.orchestra.run.smithi044.stdout: rados osd op timeout = 900 2024-03-30T13:10:32.122 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-30T13:10:32.122 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-30T13:10:32.276 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-30T13:10:32.276 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:10:32.276 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-30T13:10:32.332 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:10:32.332 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-30T13:10:32.385 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:10:32.385 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:10:32.385 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-30T13:10:32.385 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-30T13:10:32.546 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:10:32.546 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:32.646 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:10:32.646 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:10:32.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-30T13:10:32.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-30T13:10:32.801 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:10:32.801 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:32.896 INFO:tasks.ceph:Setting up mon nodes... 2024-03-30T13:10:32.896 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-30T13:10:32.896 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-30T13:10:33.092 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-30T13:10:33.103 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-30T13:10:33.292 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-30T13:10:33.303 INFO:tasks.ceph:Setting up mds nodes... 2024-03-30T13:10:33.303 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-30T13:10:33.502 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-30T13:10:33.512 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-30T13:10:33.608 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-30T13:10:33.800 INFO:teuthology.orchestra.run.smithi044.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-30T13:10:33.810 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-30T13:10:33.911 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-30T13:10:34.096 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-30T13:10:34.105 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-30T13:10:34.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-30T13:10:34.374 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-30T13:10:34.383 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-30T13:10:34.474 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-30T13:10:34.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-30T13:10:34.613 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-30T13:10:34.674 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-30T13:10:34.808 INFO:teuthology.orchestra.run.smithi044.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-30T13:10:34.862 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-30T13:10:34.989 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-30T13:10:35.045 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-30T13:10:35.165 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-30T13:10:35.220 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-30T13:10:35.220 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi044.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-30T13:10:35.220 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-30T13:10:35.322 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:10:35.323 INFO:tasks.ceph:role: osd.0 2024-03-30T13:10:35.323 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:10:35.323 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-30T13:10:35.427 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:10:35.427 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:10:35.428 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:10:35.428 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:10:35.428 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:10:35.428 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:10:35.428 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:10:35.428 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:10:35.428 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:10:35.428 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:10:35.940 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-03-30T13:10:35.947 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-03-30T13:10:35.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-30T13:10:36.143 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-30T13:10:36.256 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-30T13:10:36.357 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:10:36.357 INFO:tasks.ceph:role: osd.1 2024-03-30T13:10:36.357 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:10:36.358 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-30T13:10:36.465 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:10:36.465 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:10:36.465 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:10:36.465 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:10:36.465 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:10:36.465 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:10:36.466 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:10:36.466 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:10:36.466 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:10:36.466 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:10:36.954 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-03-30T13:10:36.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-03-30T13:10:36.961 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-30T13:10:37.110 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-30T13:10:37.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-30T13:10:37.278 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:10:37.278 INFO:tasks.ceph:role: osd.2 2024-03-30T13:10:37.278 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:10:37.278 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-30T13:10:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:10:37.377 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:10:37.377 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:10:37.377 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:10:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:10:37.377 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:10:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:10:37.377 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:10:37.378 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:10:37.378 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:10:37.895 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-03-30T13:10:37.902 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-03-30T13:10:37.903 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-30T13:10:38.095 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-30T13:10:38.207 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-30T13:10:38.315 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-30T13:10:38.315 INFO:tasks.ceph:role: osd.3 2024-03-30T13:10:38.315 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:10:38.315 DEBUG:teuthology.orchestra.run.smithi044:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-30T13:10:38.422 INFO:teuthology.orchestra.run.smithi044.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:10:38.422 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:10:38.422 INFO:teuthology.orchestra.run.smithi044.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:10:38.422 INFO:teuthology.orchestra.run.smithi044.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:10:38.422 INFO:teuthology.orchestra.run.smithi044.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:10:38.422 INFO:teuthology.orchestra.run.smithi044.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:10:38.422 INFO:teuthology.orchestra.run.smithi044.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:10:38.422 INFO:teuthology.orchestra.run.smithi044.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:10:38.422 INFO:teuthology.orchestra.run.smithi044.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:10:38.423 INFO:teuthology.orchestra.run.smithi044.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:10:38.886 INFO:teuthology.orchestra.run.smithi044.stdout:Discarding blocks...Done. 2024-03-30T13:10:38.893 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi044.front.sepia.ceph.com -o noatime 2024-03-30T13:10:38.893 DEBUG:teuthology.orchestra.run.smithi044:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-30T13:10:39.047 DEBUG:teuthology.orchestra.run.smithi044:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-30T13:10:39.151 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:39.314+0000 7fe7fe0ae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-30T13:10:39.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:39.319+0000 7fe7fe0ae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-30T13:10:39.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:39.319+0000 7fe7fe0ae640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-30T13:10:39.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:39.319+0000 7fe7fe0ae640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-30T13:10:39.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:39.319+0000 7fe7fe0ae640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-30T13:10:39.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:39.331+0000 7fe7fe0ae640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-30T13:10:42.523 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-30T13:10:42.633 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:42.780+0000 7f3fc9c0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-30T13:10:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:42.781+0000 7f3fc9c0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-30T13:10:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:42.781+0000 7f3fc9c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-30T13:10:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:42.781+0000 7f3fc9c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-30T13:10:42.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:42.781+0000 7f3fc9c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-30T13:10:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:42.783+0000 7f3fc9c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-30T13:10:45.961 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-30T13:10:46.062 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:46.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:46.208+0000 7fd6148bf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-30T13:10:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:46.209+0000 7fd6148bf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-30T13:10:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:46.209+0000 7fd6148bf640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-30T13:10:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:46.209+0000 7fd6148bf640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-30T13:10:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:46.209+0000 7fd6148bf640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-30T13:10:46.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:46.211+0000 7fd6148bf640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-30T13:10:49.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-30T13:10:49.501 DEBUG:teuthology.orchestra.run.smithi044:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:49.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:49.646+0000 7fd6cb822640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-30T13:10:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:49.646+0000 7fd6cb822640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-30T13:10:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:49.647+0000 7fd6cb822640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-30T13:10:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:49.647+0000 7fd6cb822640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-30T13:10:49.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:49.647+0000 7fd6cb822640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-30T13:10:49.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:10:49.649+0000 7fd6cb822640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-30T13:10:52.588 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-30T13:10:52.698 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-30T13:10:52.794 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:10:52.794 INFO:tasks.ceph:role: osd.4 2024-03-30T13:10:52.794 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:10:52.794 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-30T13:10:52.891 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:10:52.891 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:10:52.891 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:10:52.891 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:10:52.891 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:10:52.891 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:10:52.891 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:10:52.891 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:10:52.891 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:10:52.891 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:10:53.400 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-03-30T13:10:53.406 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-03-30T13:10:53.407 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-30T13:10:53.593 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-30T13:10:53.700 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-30T13:10:53.791 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:10:53.792 INFO:tasks.ceph:role: osd.5 2024-03-30T13:10:53.792 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:10:53.792 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-30T13:10:53.886 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:10:53.886 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:10:53.886 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:10:53.886 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:10:53.886 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:10:53.886 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:10:53.886 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:10:53.887 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:10:53.887 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:10:53.887 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:10:54.374 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-03-30T13:10:54.381 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-03-30T13:10:54.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-30T13:10:54.534 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-30T13:10:54.629 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-30T13:10:54.718 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:10:54.718 INFO:tasks.ceph:role: osd.6 2024-03-30T13:10:54.718 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:10:54.718 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-30T13:10:54.816 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:10:54.817 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:10:54.817 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:10:54.817 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:10:54.817 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:10:54.817 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:10:54.817 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:10:54.817 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:10:54.817 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:10:54.817 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:10:55.339 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-03-30T13:10:55.345 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-03-30T13:10:55.346 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-30T13:10:55.543 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-30T13:10:55.647 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-30T13:10:55.739 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-30T13:10:55.739 INFO:tasks.ceph:role: osd.7 2024-03-30T13:10:55.739 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:10:55.740 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-30T13:10:55.840 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-30T13:10:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-30T13:10:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-30T13:10:55.840 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-30T13:10:55.841 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-30T13:10:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-03-30T13:10:55.841 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-30T13:10:55.841 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-30T13:10:55.841 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-30T13:10:55.841 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-30T13:10:56.313 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-03-30T13:10:56.319 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-03-30T13:10:56.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-30T13:10:56.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-30T13:10:56.545 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:10:56.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:10:56.698+0000 7fde9db81640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-30T13:10:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:10:56.698+0000 7fde9db81640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-30T13:10:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:10:56.698+0000 7fde9db81640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-30T13:10:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:10:56.698+0000 7fde9db81640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-30T13:10:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:10:56.698+0000 7fde9db81640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-30T13:10:56.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:10:56.708+0000 7fde9db81640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-30T13:10:59.265 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:59.273 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:10:59.889 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-30T13:10:59.987 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:11:00.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:00.120+0000 7f923ba12640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-30T13:11:00.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:00.121+0000 7f923ba12640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-30T13:11:00.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:00.121+0000 7f923ba12640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-30T13:11:00.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:00.121+0000 7f923ba12640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-30T13:11:00.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:00.121+0000 7f923ba12640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-30T13:11:00.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:00.123+0000 7f923ba12640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-30T13:11:03.306 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-30T13:11:03.402 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:11:03.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:03.539+0000 7f52248f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-30T13:11:03.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:03.540+0000 7f52248f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-30T13:11:03.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:03.540+0000 7f52248f9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-30T13:11:03.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:03.540+0000 7f52248f9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-30T13:11:03.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:03.540+0000 7f52248f9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-30T13:11:03.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:03.542+0000 7f52248f9640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-30T13:11:06.493 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-30T13:11:06.588 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:11:06.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:06.719+0000 7fa76dea8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-30T13:11:06.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:06.719+0000 7fa76dea8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-30T13:11:06.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:06.719+0000 7fa76dea8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-30T13:11:06.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:06.719+0000 7fa76dea8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-30T13:11:06.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:06.720+0000 7fa76dea8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-30T13:11:06.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:06.721+0000 7fa76dea8640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-30T13:11:09.660 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-30T13:11:09.754 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-30T13:11:09.754 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:09.755 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-30T13:11:09.865 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:09.865 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-30T13:11:09.967 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:09.968 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-30T13:11:10.066 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:10.066 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-30T13:11:10.166 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:10.167 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-30T13:11:10.267 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:10.267 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-30T13:11:10.366 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:10.366 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-30T13:11:10.461 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:10.462 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-30T13:11:10.553 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:10.553 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-30T13:11:10.648 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:10.648 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-30T13:11:10.739 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:10.740 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-30T13:11:10.877 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:10.877 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-30T13:11:10.971 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:10.972 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-30T13:11:11.062 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:11.063 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-30T13:11:11.195 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:11.195 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-30T13:11:11.256 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:11.256 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-30T13:11:11.313 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:11.313 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-30T13:11:11.371 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:11.371 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-30T13:11:11.423 INFO:tasks.ceph:Adding keys to all mons... 2024-03-30T13:11:11.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-30T13:11:11.431 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-30T13:11:11.518 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.y] 2024-03-30T13:11:11.518 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBJDwhmjyVdBRAAGrsoIJmc1xKgpPh234615w== 2024-03-30T13:11:11.518 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2024-03-30T13:11:11.518 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBJDwhmsO/RHRAA4BKmSytiyQ/wu5TjZH+g9Q== 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBJDwhmYCuVLxAAsEk/EJeDxb9jQUzQUkZj7Q== 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBPDwhmEKvHEhAAdueNOQAKRcQYDEPD+l8igA== 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBSDwhmYwKPLhAAhdKfz1MusyAbTC4/njth0w== 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBWDwhmrI5xDBAAQK4JjvNpLRAs3FZAOKajWQ== 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBZDwhmAbCSJhAAaIfF/vKvPpZhUQidEbnESQ== 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBJDwhmigdHERAAzZDywQSje3Jpak4h9qiEdA== 2024-03-30T13:11:11.519 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBKDwhmlMyVBRAAnsiOGIMLKztsB6GsCUOD8g== 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBKDwhmkdwsFhAAu5gTZsaCCfXk9I+TJkw2yA== 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.4] 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBgDwhmZzmmKRAAnSeWY9Hrlp/Jkn01wNBOYw== 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.5] 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBkDwhmVV9JBxAA6L8zG27q3ECaddq0284Wzg== 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.6] 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBnDwhm/NhEIBAARHcV2Jg/q9SmvDVc8u+bdQ== 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.7] 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBqDwhm3p71KhAAXlXxNPOIHgVtZJAUgWKO2A== 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBKDwhmQIprJBAAmTYCUPcFur+aT859aD7+jQ== 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout:[client.2] 2024-03-30T13:11:11.520 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBKDwhmwj8GMBAAxmghTPYKPD+59J1RMq9MvA== 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi151.stdout:[client.1] 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBKDwhmKpPWOhAAkHjzBEZJrsB6qa6LThgMJw== 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi151.stdout:[client.3] 2024-03-30T13:11:11.521 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQBLDwhmA2WzCRAAX5J+afnSm4E2XjI256PLBA== 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.y] 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBJDwhmjyVdBRAAGrsoIJmc1xKgpPh234615w== 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a] 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBJDwhmsO/RHRAA4BKmSytiyQ/wu5TjZH+g9Q== 2024-03-30T13:11:11.523 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c] 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBJDwhmYCuVLxAAsEk/EJeDxb9jQUzQUkZj7Q== 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.0] 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBPDwhmEKvHEhAAdueNOQAKRcQYDEPD+l8igA== 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.1] 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBSDwhmYwKPLhAAhdKfz1MusyAbTC4/njth0w== 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.2] 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBWDwhmrI5xDBAAQK4JjvNpLRAs3FZAOKajWQ== 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.3] 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBZDwhmAbCSJhAAaIfF/vKvPpZhUQidEbnESQ== 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout:[mgr.x] 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBJDwhmigdHERAAzZDywQSje3Jpak4h9qiEdA== 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b] 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBKDwhmlMyVBRAAnsiOGIMLKztsB6GsCUOD8g== 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d] 2024-03-30T13:11:11.524 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBKDwhmkdwsFhAAu5gTZsaCCfXk9I+TJkw2yA== 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.4] 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBgDwhmZzmmKRAAnSeWY9Hrlp/Jkn01wNBOYw== 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.5] 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBkDwhmVV9JBxAA6L8zG27q3ECaddq0284Wzg== 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.6] 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBnDwhm/NhEIBAARHcV2Jg/q9SmvDVc8u+bdQ== 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout:[osd.7] 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBqDwhm3p71KhAAXlXxNPOIHgVtZJAUgWKO2A== 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBKDwhmQIprJBAAmTYCUPcFur+aT859aD7+jQ== 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout:[client.2] 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBKDwhmwj8GMBAAxmghTPYKPD+59J1RMq9MvA== 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout:[client.1] 2024-03-30T13:11:11.525 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBKDwhmKpPWOhAAkHjzBEZJrsB6qa6LThgMJw== 2024-03-30T13:11:11.526 INFO:teuthology.orchestra.run.smithi044.stdout:[client.3] 2024-03-30T13:11:11.526 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBLDwhmA2WzCRAAX5J+afnSm4E2XjI256PLBA== 2024-03-30T13:11:11.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T13:11:11.538 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T13:11:11.707 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:11:11.715 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:11:11.865 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:11:11.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:11:12.014 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:12.021 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:12.161 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:12.166 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:12.314 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:12.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:12.464 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:12.471 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:12.616 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T13:11:12.622 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-30T13:11:12.769 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:11:12.776 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:11:12.928 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:11:12.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-30T13:11:13.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:13.086 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:13.223 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:13.230 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:13.376 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:13.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:13.528 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:13.540 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-30T13:11:13.691 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:11:13.700 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:11:13.851 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:11:13.857 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:11:14.007 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:11:14.014 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:11:14.157 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:11:14.165 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-30T13:11:14.311 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-30T13:11:14.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-30T13:11:14.415 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-30T13:11:14.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-30T13:11:14.681 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-30T13:11:14.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-30T13:11:14.936 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-30T13:11:15.007 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-30T13:11:15.100 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-30T13:11:15.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-30T13:11:15.337 DEBUG:teuthology.orchestra.run.smithi044:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:11:15.344 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-30T13:11:15.399 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-30T13:11:15.399 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-30T13:11:15.399 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-30T13:11:15.404 INFO:tasks.ceph.mon.a:Started 2024-03-30T13:11:15.405 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-30T13:11:15.405 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-30T13:11:15.410 INFO:tasks.ceph.mon.b:Started 2024-03-30T13:11:15.411 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-30T13:11:15.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-30T13:11:15.416 INFO:tasks.ceph.mon.c:Started 2024-03-30T13:11:15.417 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-30T13:11:15.417 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-30T13:11:15.417 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-30T13:11:15.422 INFO:tasks.ceph.mgr.y:Started 2024-03-30T13:11:15.422 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-30T13:11:15.422 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-30T13:11:15.427 INFO:tasks.ceph.mgr.x:Started 2024-03-30T13:11:15.427 INFO:tasks.ceph:Setting crush tunables to default 2024-03-30T13:11:15.427 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph osd crush tunables default 2024-03-30T13:11:15.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.608+0000 7f43e9a00640 1 Processor -- start 2024-03-30T13:11:15.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.608+0000 7f43e9a00640 1 -- start start 2024-03-30T13:11:15.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43e9a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:15.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43e9a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:15.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43e9a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e40cf860 con 0x7f43e40d13d0 2024-03-30T13:11:15.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43e9a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f43e40cfb40 con 0x7f43e40b3760 2024-03-30T13:11:15.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43e9a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f43e40d33a0 con 0x7f43e40d3ba0 2024-03-30T13:11:15.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43e3400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:15.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43e2a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f43e40d13d0 0x7f43e40d17b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46474/0 (socket says 172.21.15.44:46474) 2024-03-30T13:11:15.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43da000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:15.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43e2a00640 1 -- 172.21.15.44:0/526062529 learned_addr learned my addr 172.21.15.44:0/526062529 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:15.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43e3400640 1 -- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 msgr2=0x7f43e40b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-30T13:11:15.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43e3400640 1 -- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 msgr2=0x7f43e40b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:11:15.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:11:15.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 msgr2=0x7f43e40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:11:15.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 msgr2=0x7f43e40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:11:15.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:11:15.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T13:11:15.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.610+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T13:11:15.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.811+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:15.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.811+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:15.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.812+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 msgr2=0x7f43e40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-30T13:11:15.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.812+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 msgr2=0x7f43e40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:11:15.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.812+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:11:15.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.812+0000 7f43e3400640 1 -- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 msgr2=0x7f43e40b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:11:15.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.812+0000 7f43e3400640 1 -- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 msgr2=0x7f43e40b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:11:15.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.812+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:11:15.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.812+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T13:11:15.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:15.812+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T13:11:16.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:16.213+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:16.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:16.213+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:16.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:16.214+0000 7f43e3400640 1 -- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 msgr2=0x7f43e40b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-30T13:11:16.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:16.214+0000 7f43e3400640 1 -- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 msgr2=0x7f43e40b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:11:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:16.214+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:11:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:16.214+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 msgr2=0x7f43e40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:11:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:16.214+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 msgr2=0x7f43e40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:11:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:16.214+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:11:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:16.214+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-30T13:11:16.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:16.214+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-30T13:11:17.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:17.015+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:17.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:17.015+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:17.016+0000 7f43e3400640 1 -- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 msgr2=0x7f43e40b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:11:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:17.016+0000 7f43e3400640 1 -- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 msgr2=0x7f43e40b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:11:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:17.016+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:11:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:17.016+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 msgr2=0x7f43e40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-30T13:11:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:17.016+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 msgr2=0x7f43e40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:11:17.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:17.016+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:11:17.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:17.016+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-30T13:11:17.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:17.016+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-30T13:11:18.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.610+0000 7f43e0c00640 1 -- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 msgr2=0x7f43e40b7740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:11:18.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.610+0000 7f43e0c00640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43e40d3ba0 0x7f43e40b7740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:18.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.610+0000 7f43e0c00640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 msgr2=0x7f43e40cecc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:11:18.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.610+0000 7f43e0c00640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.44:3300/0 conn(0x7f43e40b3760 0x7f43e40cecc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:18.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.610+0000 7f43e0c00640 1 -- 172.21.15.44:0/526062529 >> v1:172.21.15.44:6789/0 conn(0x7f43e40d13d0 legacy=0x7f43e40d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:18.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.610+0000 7f43e0c00640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:18.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.610+0000 7f43e0c00640 1 -- 172.21.15.44:0/526062529 --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e40d3680 con 0x7f43c00036a0 2024-03-30T13:11:18.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.610+0000 7f43e0c00640 1 -- 172.21.15.44:0/526062529 --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f43e40cfb40 con 0x7f43c0007350 2024-03-30T13:11:18.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.611+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:18.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.611+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 msgr2=0x7f43c0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:11:18.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.611+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 msgr2=0x7f43c0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:11:18.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.611+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:11:18.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.611+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-30T13:11:18.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.813+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:18.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.813+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 msgr2=0x7f43c0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:11:18.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.813+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 msgr2=0x7f43c0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:11:18.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.813+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:11:18.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:18.813+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-30T13:11:19.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:19.215+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:19.215+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 msgr2=0x7f43c0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:11:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:19.215+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 msgr2=0x7f43c0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:11:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:19.215+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:11:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:19.215+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-30T13:11:20.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.017+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.017+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 msgr2=0x7f43c0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-30T13:11:20.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.017+0000 7f43da000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 msgr2=0x7f43c0009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-30T13:11:20.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.017+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-30T13:11:20.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.017+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.661+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1598180872 0 0) 0x7f43e40d3680 con 0x7f43c00036a0 2024-03-30T13:11:20.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.661+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43c8003520 con 0x7f43c00036a0 2024-03-30T13:11:20.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.666+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 661943829 0 0) 0x7f43c8003520 con 0x7f43c00036a0 2024-03-30T13:11:20.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.666+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 msgr2=0x7f43c0009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:11:20.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.667+0000 7f43e2000640 1 --2- 172.21.15.44:0/526062529 >> v2:172.21.15.151:3300/0 conn(0x7f43c0007350 0x7f43c0009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.667+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c000afb0 con 0x7f43c00036a0 2024-03-30T13:11:20.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.667+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f43d4001a70 con 0x7f43c00036a0 2024-03-30T13:11:20.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.667+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 >> v1:172.21.15.151:6789/0 conn(0x7f43c00036a0 legacy=0x7f43c0005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:20.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.667+0000 7f43e3400640 1 -- 172.21.15.44:0/526062529 reap_dead start 2024-03-30T13:11:20.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.667+0000 7f43e2000640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c8003a00 0x7f43c8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.667+0000 7f43e2000640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c8004800 0x7f43c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.667+0000 7f43e2000640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c80053c0 0x7f43c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.667+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f43e40cfb40 con 0x7f43c80053c0 2024-03-30T13:11:20.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.667+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f43c800c280 con 0x7f43c8003a00 2024-03-30T13:11:20.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.667+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f43c800c480 con 0x7f43c8004800 2024-03-30T13:11:20.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.668+0000 7f43e2a00640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c8003a00 0x7f43c8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.668+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c80053c0 0x7f43c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.668+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c8004800 0x7f43c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.669+0000 7f43e3400640 1 -- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c8004800 msgr2=0x7f43c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:20.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.669+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c8004800 0x7f43c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.669+0000 7f43e3400640 1 -- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c8003a00 msgr2=0x7f43c8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:20.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.669+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c8003a00 0x7f43c8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.670+0000 7f43e3400640 1 -- 172.21.15.44:0/526062529 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c8003520 con 0x7f43c80053c0 2024-03-30T13:11:20.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.670+0000 7f43e2a00640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c8003a00 0x7f43c8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:20.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.670+0000 7f43da000640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c8004800 0x7f43c8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:20.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.672+0000 7f43e3400640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c80053c0 0x7f43c800b9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f43e40b6fb0 tx=0x7f43c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ba8ebd7efe9a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:20.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.674+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc032070 con 0x7f43c80053c0 2024-03-30T13:11:20.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.674+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43dc02cc30 con 0x7f43c80053c0 2024-03-30T13:11:20.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.674+0000 7f43e2000640 1 -- 172.21.15.44:0/526062529 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc0115f0 con 0x7f43c80053c0 2024-03-30T13:11:20.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.675+0000 7f43e9a00640 1 -- 172.21.15.44:0/526062529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c80053c0 msgr2=0x7f43c800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:20.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.675+0000 7f43e9a00640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c80053c0 0x7f43c800b9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f43e40b6fb0 tx=0x7f43c8005830 comp rx=0 tx=0).stop 2024-03-30T13:11:20.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.676+0000 7f43e9a00640 1 -- 172.21.15.44:0/526062529 shutdown_connections 2024-03-30T13:11:20.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.676+0000 7f43e9a00640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c80053c0 0x7f43c800b9c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.676+0000 7f43e9a00640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c8004800 0x7f43c8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.676+0000 7f43e9a00640 1 --2- 172.21.15.44:0/526062529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c8003a00 0x7f43c8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.676+0000 7f43e9a00640 1 -- 172.21.15.44:0/526062529 >> 172.21.15.44:0/526062529 conn(0x7f43e4067710 msgr2=0x7f43e4067b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:20.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.676+0000 7f43e9a00640 1 -- 172.21.15.44:0/526062529 shutdown_connections 2024-03-30T13:11:20.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.676+0000 7f43e9a00640 1 -- 172.21.15.44:0/526062529 wait complete. 2024-03-30T13:11:20.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.681+0000 7f43e9a00640 1 Processor -- start 2024-03-30T13:11:20.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.681+0000 7f43e9a00640 1 -- start start 2024-03-30T13:11:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.683+0000 7f43e9a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c8003a00 0x7f43e41554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.683+0000 7f43e9a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c8004800 0x7f43e4159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e9a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c80053c0 0x7f43e415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e9a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f43e415eab0 con 0x7f43c8003a00 2024-03-30T13:11:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e9a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f43e415e930 con 0x7f43c80053c0 2024-03-30T13:11:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e9a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f43e40cf4c0 con 0x7f43c8004800 2024-03-30T13:11:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c8003a00 0x7f43e41554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c8003a00 0x7f43e41554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33426/0 (socket says 172.21.15.44:33426) 2024-03-30T13:11:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e2a00640 1 -- 172.21.15.44:0/1607653336 learned_addr learned my addr 172.21.15.44:0/1607653336 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43da000640 1 --2- 172.21.15.44:0/1607653336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c8004800 0x7f43e4159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e3400640 1 --2- 172.21.15.44:0/1607653336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c80053c0 0x7f43e415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:20.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e2a00640 1 -- 172.21.15.44:0/1607653336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c8004800 msgr2=0x7f43e4159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:20.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e2a00640 1 --2- 172.21.15.44:0/1607653336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c8004800 0x7f43e4159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e2a00640 1 -- 172.21.15.44:0/1607653336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c80053c0 msgr2=0x7f43e415aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:20.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e2a00640 1 --2- 172.21.15.44:0/1607653336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c80053c0 0x7f43e415aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.684+0000 7f43e2a00640 1 -- 172.21.15.44:0/1607653336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e415a730 con 0x7f43c8003a00 2024-03-30T13:11:20.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.685+0000 7f43da000640 1 --2- 172.21.15.44:0/1607653336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c8004800 0x7f43e4159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:20.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.685+0000 7f43e2a00640 1 --2- 172.21.15.44:0/1607653336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c8003a00 0x7f43e41554c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f43d400ac80 tx=0x7f43d4007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:20.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.685+0000 7f43db400640 1 -- 172.21.15.44:0/1607653336 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d4017020 con 0x7f43c8003a00 2024-03-30T13:11:20.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.685+0000 7f43db400640 1 -- 172.21.15.44:0/1607653336 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43d40133f0 con 0x7f43c8003a00 2024-03-30T13:11:20.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.685+0000 7f43e9a00640 1 -- 172.21.15.44:0/1607653336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43e41f4ec0 con 0x7f43c8003a00 2024-03-30T13:11:20.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.685+0000 7f43db400640 1 -- 172.21.15.44:0/1607653336 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43d40137a0 con 0x7f43c8003a00 2024-03-30T13:11:20.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.686+0000 7f43db400640 1 -- 172.21.15.44:0/1607653336 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f43d401a020 con 0x7f43c8003a00 2024-03-30T13:11:20.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.686+0000 7f43e9a00640 1 -- 172.21.15.44:0/1607653336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43e41593e0 con 0x7f43c8003a00 2024-03-30T13:11:20.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.686+0000 7f43db400640 1 -- 172.21.15.44:0/1607653336 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f43d401c400 con 0x7f43c8003a00 2024-03-30T13:11:20.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.688+0000 7f43e9a00640 1 -- 172.21.15.44:0/1607653336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43e4075890 con 0x7f43c8003a00 2024-03-30T13:11:20.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.691+0000 7f43db400640 1 -- 172.21.15.44:0/1607653336 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f43d4021020 con 0x7f43c8003a00 2024-03-30T13:11:20.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.766+0000 7f43e9a00640 1 -- 172.21.15.44:0/1607653336 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f43e4161f20 con 0x7f43c8003a00 2024-03-30T13:11:20.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.771+0000 7f43db400640 1 -- 172.21.15.44:0/1607653336 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f43d401c600 con 0x7f43c8003a00 2024-03-30T13:11:20.775 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-03-30T13:11:20.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.772+0000 7f43e9a00640 1 -- 172.21.15.44:0/1607653336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c8003a00 msgr2=0x7f43e41554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:20.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.772+0000 7f43e9a00640 1 --2- 172.21.15.44:0/1607653336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c8003a00 0x7f43e41554c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f43d400ac80 tx=0x7f43d4007430 comp rx=0 tx=0).stop 2024-03-30T13:11:20.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.772+0000 7f43e9a00640 1 -- 172.21.15.44:0/1607653336 shutdown_connections 2024-03-30T13:11:20.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.772+0000 7f43e9a00640 1 --2- 172.21.15.44:0/1607653336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c80053c0 0x7f43e415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.772+0000 7f43e9a00640 1 --2- 172.21.15.44:0/1607653336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c8004800 0x7f43e4159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.772+0000 7f43e9a00640 1 --2- 172.21.15.44:0/1607653336 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f43c8003a00 0x7f43e41554c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:20.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.772+0000 7f43e9a00640 1 -- 172.21.15.44:0/1607653336 >> 172.21.15.44:0/1607653336 conn(0x7f43e4067710 msgr2=0x7f43e4067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:20.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.772+0000 7f43e9a00640 1 -- 172.21.15.44:0/1607653336 shutdown_connections 2024-03-30T13:11:20.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:20.772+0000 7f43e9a00640 1 -- 172.21.15.44:0/1607653336 wait complete. 2024-03-30T13:11:20.795 INFO:tasks.ceph:check_enable_crimson: False 2024-03-30T13:11:20.795 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-30T13:11:20.795 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:20.795 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-30T13:11:20.892 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:20.892 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-30T13:11:21.027 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:21.028 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-30T13:11:21.129 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:21.129 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-30T13:11:21.230 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:21.230 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-30T13:11:21.311 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:21.306+0000 7fc558039040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:11:21.320 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:21.320 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-30T13:11:21.380 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:21.376+0000 7fc558039040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:11:21.446 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:21.447 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-30T13:11:21.567 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:11:21.568 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-30T13:11:21.696 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new e9f254c5-2916-435c-a929-73eb57610678 0 2024-03-30T13:11:21.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.927+0000 7fafbce00640 1 Processor -- start 2024-03-30T13:11:21.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.927+0000 7fafbce00640 1 -- start start 2024-03-30T13:11:21.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafbce00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fafb8159f90 0x7fafb80ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafbce00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fafb815ffe0 0x7fafb815d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafbce00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb815c9f0 con 0x7fafb815d6d0 2024-03-30T13:11:21.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafbce00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fafb815cd00 con 0x7fafb8159f90 2024-03-30T13:11:21.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafbce00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fafb8160750 con 0x7fafb815ffe0 2024-03-30T13:11:21.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafb5400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fafb815ffe0 0x7fafb815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafb5400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fafb815ffe0 0x7fafb815d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49362/0 (socket says 172.21.15.151:49362) 2024-03-30T13:11:21.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafb5400640 1 -- 172.21.15.151:0/366015880 learned_addr learned my addr 172.21.15.151:0/366015880 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:21.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafb5e00640 1 --2- 172.21.15.151:0/366015880 >> v2:172.21.15.44:3300/0 conn(0x7fafb8159f90 0x7fafb80ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafb5400640 1 -- 172.21.15.151:0/366015880 >> v2:172.21.15.44:3300/0 conn(0x7fafb8159f90 msgr2=0x7fafb80ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:21.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafb5400640 1 --2- 172.21.15.151:0/366015880 >> v2:172.21.15.44:3300/0 conn(0x7fafb8159f90 0x7fafb80ce310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafb5400640 1 -- 172.21.15.151:0/366015880 >> v1:172.21.15.44:6789/0 conn(0x7fafb815d6d0 legacy=0x7fafb806b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:21.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafb5400640 1 -- 172.21.15.151:0/366015880 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb8160a30 con 0x7fafb815ffe0 2024-03-30T13:11:21.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.929+0000 7fafb5e00640 1 --2- 172.21.15.151:0/366015880 >> v2:172.21.15.44:3300/0 conn(0x7fafb8159f90 0x7fafb80ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:21.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.931+0000 7fafb5400640 1 --2- 172.21.15.151:0/366015880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb815ffe0 0x7fafb815d190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fafb8074450 tx=0x7fafa402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89783a69c2a7378c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:21.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.931+0000 7fafb4a00640 1 -- 172.21.15.151:0/366015880 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4035020 con 0x7fafb815ffe0 2024-03-30T13:11:21.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.931+0000 7fafb4a00640 1 -- 172.21.15.151:0/366015880 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa4031870 con 0x7fafb815ffe0 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.931+0000 7fafb4a00640 1 -- 172.21.15.151:0/366015880 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4031c40 con 0x7fafb815ffe0 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.932+0000 7fafbce00640 1 -- 172.21.15.151:0/366015880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb815ffe0 msgr2=0x7fafb815d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.932+0000 7fafbce00640 1 --2- 172.21.15.151:0/366015880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb815ffe0 0x7fafb815d190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fafb8074450 tx=0x7fafa402b910 comp rx=0 tx=0).stop 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.932+0000 7fafbce00640 1 -- 172.21.15.151:0/366015880 shutdown_connections 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.932+0000 7fafbce00640 1 --2- 172.21.15.151:0/366015880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb815ffe0 0x7fafb815d190 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.932+0000 7fafbce00640 1 --2- 172.21.15.151:0/366015880 >> v2:172.21.15.44:3300/0 conn(0x7fafb8159f90 0x7fafb80ce310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.932+0000 7fafbce00640 1 -- 172.21.15.151:0/366015880 >> 172.21.15.151:0/366015880 conn(0x7fafb80d1160 msgr2=0x7fafb80d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.932+0000 7fafbce00640 1 -- 172.21.15.151:0/366015880 shutdown_connections 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.932+0000 7fafbce00640 1 -- 172.21.15.151:0/366015880 wait complete. 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.934+0000 7fafbce00640 1 Processor -- start 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.934+0000 7fafbce00640 1 -- start start 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.935+0000 7fafbce00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb8159f90 0x7fafb80cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.935+0000 7fafbce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafb815d6d0 0x7fafb80b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.935+0000 7fafbce00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb815ffe0 0x7fafb80cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.935+0000 7fafbce00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fafb815a370 con 0x7fafb815d6d0 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.935+0000 7fafbce00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fafb8160440 con 0x7fafb815ffe0 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.935+0000 7fafbce00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fafb806bc90 con 0x7fafb8159f90 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.935+0000 7fafb5e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb8159f90 0x7fafb80cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.935+0000 7fafb6800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb815ffe0 0x7fafb80cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.935+0000 7fafb6800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb815ffe0 0x7fafb80cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49368/0 (socket says 172.21.15.151:49368) 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.935+0000 7fafb5e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb8159f90 0x7fafb80cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:46196/0 (socket says 172.21.15.151:46196) 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.935+0000 7fafb6800640 1 -- 172.21.15.151:0/912010480 learned_addr learned my addr 172.21.15.151:0/912010480 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.935+0000 7fafb5400640 1 --2- 172.21.15.151:0/912010480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafb815d6d0 0x7fafb80b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.936+0000 7fafb6800640 1 -- 172.21.15.151:0/912010480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb8159f90 msgr2=0x7fafb80cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.936+0000 7fafb6800640 1 --2- 172.21.15.151:0/912010480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb8159f90 0x7fafb80cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.936+0000 7fafb6800640 1 -- 172.21.15.151:0/912010480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafb815d6d0 msgr2=0x7fafb80b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.936+0000 7fafb6800640 1 --2- 172.21.15.151:0/912010480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafb815d6d0 0x7fafb80b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:21.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.936+0000 7fafb6800640 1 -- 172.21.15.151:0/912010480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb80cb9a0 con 0x7fafb815ffe0 2024-03-30T13:11:21.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.936+0000 7fafb6800640 1 --2- 172.21.15.151:0/912010480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb815ffe0 0x7fafb80cbc30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fafb000c780 tx=0x7fafb000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:21.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.936+0000 7fafae000640 1 -- 172.21.15.151:0/912010480 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0017070 con 0x7fafb815ffe0 2024-03-30T13:11:21.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.936+0000 7fafae000640 1 -- 172.21.15.151:0/912010480 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0003da0 con 0x7fafb815ffe0 2024-03-30T13:11:21.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.936+0000 7fafae000640 1 -- 172.21.15.151:0/912010480 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb00052b0 con 0x7fafb815ffe0 2024-03-30T13:11:21.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.936+0000 7fafbce00640 1 -- 172.21.15.151:0/912010480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb80ca6a0 con 0x7fafb815ffe0 2024-03-30T13:11:21.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.936+0000 7fafbce00640 1 -- 172.21.15.151:0/912010480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb80cac60 con 0x7fafb815ffe0 2024-03-30T13:11:21.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.936+0000 7fafae000640 1 -- 172.21.15.151:0/912010480 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fafb001a070 con 0x7fafb815ffe0 2024-03-30T13:11:21.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.937+0000 7fafae000640 1 -- 172.21.15.151:0/912010480 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fafb001c780 con 0x7fafb815ffe0 2024-03-30T13:11:21.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.938+0000 7fafbce00640 1 -- 172.21.15.151:0/912010480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb8075890 con 0x7fafb815ffe0 2024-03-30T13:11:21.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:21.941+0000 7fafae000640 1 -- 172.21.15.151:0/912010480 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fafb0021020 con 0x7fafb815ffe0 2024-03-30T13:11:22.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.020+0000 7fafbce00640 1 -- 172.21.15.151:0/912010480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e9f254c5-2916-435c-a929-73eb57610678", "id": 0} v 0) -- 0x7fafb80cf8b0 con 0x7fafb815ffe0 2024-03-30T13:11:22.025 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:22.021+0000 7fc558039040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:11:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.028+0000 7fafae000640 1 -- 172.21.15.151:0/912010480 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e9f254c5-2916-435c-a929-73eb57610678", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fafb000ae10 con 0x7fafb815ffe0 2024-03-30T13:11:22.032 INFO:teuthology.orchestra.run.smithi151.stdout:0 2024-03-30T13:11:22.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.030+0000 7fafbce00640 1 -- 172.21.15.151:0/912010480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb815ffe0 msgr2=0x7fafb80cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.030+0000 7fafbce00640 1 --2- 172.21.15.151:0/912010480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb815ffe0 0x7fafb80cbc30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fafb000c780 tx=0x7fafb000cc40 comp rx=0 tx=0).stop 2024-03-30T13:11:22.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.030+0000 7fafbce00640 1 -- 172.21.15.151:0/912010480 shutdown_connections 2024-03-30T13:11:22.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.030+0000 7fafbce00640 1 --2- 172.21.15.151:0/912010480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafb815ffe0 0x7fafb80cbc30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.030+0000 7fafbce00640 1 --2- 172.21.15.151:0/912010480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafb815d6d0 0x7fafb80b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.030+0000 7fafbce00640 1 --2- 172.21.15.151:0/912010480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafb8159f90 0x7fafb80cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.030+0000 7fafbce00640 1 -- 172.21.15.151:0/912010480 >> 172.21.15.151:0/912010480 conn(0x7fafb80d1160 msgr2=0x7fafb80cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.030+0000 7fafbce00640 1 -- 172.21.15.151:0/912010480 shutdown_connections 2024-03-30T13:11:22.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.031+0000 7fafbce00640 1 -- 172.21.15.151:0/912010480 wait complete. 2024-03-30T13:11:22.057 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new a7ff4d09-d3c6-40ac-ad39-7ea908769472 1 2024-03-30T13:11:22.103 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:22.100+0000 7fc558039040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:11:22.159 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:22.155+0000 7fc558039040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:11:22.228 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:22.225+0000 7fc558039040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:11:22.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.229+0000 7f5bb4e00640 1 Processor -- start 2024-03-30T13:11:22.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.230+0000 7f5bb4e00640 1 -- start start 2024-03-30T13:11:22.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.231+0000 7f5bb4e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5bb00ba090 0x7f5bb00d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.231+0000 7f5bb4e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5bb00b73d0 0x7f5bb00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.231+0000 7f5bb4e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bb00d2ff0 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.231+0000 7f5bb4e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb00d32d0 con 0x7f5bb00b73d0 2024-03-30T13:11:22.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.231+0000 7f5bb4e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb00d35b0 con 0x7f5bb00ba090 2024-03-30T13:11:22.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.231+0000 7f5ba5400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5bb00ba090 0x7f5bb00d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.231+0000 7f5ba5400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5bb00ba090 0x7f5bb00d2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49376/0 (socket says 172.21.15.151:49376) 2024-03-30T13:11:22.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.231+0000 7f5ba5400640 1 -- 172.21.15.151:0/1193982309 learned_addr learned my addr 172.21.15.151:0/1193982309 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:22.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.232+0000 7f5bae800640 1 --2- 172.21.15.151:0/1193982309 >> v2:172.21.15.44:3300/0 conn(0x7f5bb00b73d0 0x7f5bb00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.232+0000 7f5ba5400640 1 -- 172.21.15.151:0/1193982309 >> v2:172.21.15.44:3300/0 conn(0x7f5bb00b73d0 msgr2=0x7f5bb00b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.232+0000 7f5ba5400640 1 --2- 172.21.15.151:0/1193982309 >> v2:172.21.15.44:3300/0 conn(0x7f5bb00b73d0 0x7f5bb00b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.232+0000 7f5ba5400640 1 -- 172.21.15.151:0/1193982309 >> v1:172.21.15.44:6789/0 conn(0x7f5bb00b5dc0 legacy=0x7f5bb00b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.232+0000 7f5ba5400640 1 -- 172.21.15.151:0/1193982309 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb00d3890 con 0x7f5bb00ba090 2024-03-30T13:11:22.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.233+0000 7f5ba5400640 1 --2- 172.21.15.151:0/1193982309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bb00ba090 0x7f5bb00d2680 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5b98009870 tx=0x7f5b9802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d995dd9e95d0536 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.233+0000 7f5bad400640 1 -- 172.21.15.151:0/1193982309 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b98035020 con 0x7f5bb00ba090 2024-03-30T13:11:22.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.233+0000 7f5bad400640 1 -- 172.21.15.151:0/1193982309 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b98031870 con 0x7f5bb00ba090 2024-03-30T13:11:22.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.233+0000 7f5bad400640 1 -- 172.21.15.151:0/1193982309 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b98031c40 con 0x7f5bb00ba090 2024-03-30T13:11:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.234+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1193982309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bb00ba090 msgr2=0x7f5bb00d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.234+0000 7f5bb4e00640 1 --2- 172.21.15.151:0/1193982309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bb00ba090 0x7f5bb00d2680 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5b98009870 tx=0x7f5b9802b910 comp rx=0 tx=0).stop 2024-03-30T13:11:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.234+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1193982309 shutdown_connections 2024-03-30T13:11:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.234+0000 7f5bb4e00640 1 --2- 172.21.15.151:0/1193982309 >> v2:172.21.15.44:3300/0 conn(0x7f5bb00b73d0 0x7f5bb00b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.234+0000 7f5bb4e00640 1 --2- 172.21.15.151:0/1193982309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bb00ba090 0x7f5bb00d2680 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.234+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1193982309 >> 172.21.15.151:0/1193982309 conn(0x7f5bb00678f0 msgr2=0x7f5bb00d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.234+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1193982309 shutdown_connections 2024-03-30T13:11:22.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.234+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1193982309 wait complete. 2024-03-30T13:11:22.239 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:22.234+0000 7fa0c3032040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-30T13:11:22.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.236+0000 7f5bb4e00640 1 Processor -- start 2024-03-30T13:11:22.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.236+0000 7f5bb4e00640 1 -- start start 2024-03-30T13:11:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.237+0000 7f5bb4e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bb00b5dc0 0x7f5bb01e7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.237+0000 7f5bb4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bb00b73d0 0x7f5bb00ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.237+0000 7f5bb4e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bb00ba090 0x7f5bb00cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.237+0000 7f5bb4e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb015e880 con 0x7f5bb00b73d0 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.237+0000 7f5bb4e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb00d4090 con 0x7f5bb00ba090 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.237+0000 7f5bb4e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb015ea00 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.237+0000 7f5bade00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bb00b5dc0 0x7f5bb01e7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.237+0000 7f5bade00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bb00b5dc0 0x7f5bb01e7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:46206/0 (socket says 172.21.15.151:46206) 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.237+0000 7f5bade00640 1 -- 172.21.15.151:0/1521793273 learned_addr learned my addr 172.21.15.151:0/1521793273 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.238+0000 7f5ba5400640 1 --2- 172.21.15.151:0/1521793273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bb00b73d0 0x7f5bb00ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.238+0000 7f5bade00640 1 -- 172.21.15.151:0/1521793273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bb00ba090 msgr2=0x7f5bb00cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.238+0000 7f5bade00640 1 --2- 172.21.15.151:0/1521793273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bb00ba090 0x7f5bb00cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.238+0000 7f5bade00640 1 -- 172.21.15.151:0/1521793273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bb00b73d0 msgr2=0x7f5bb00ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.238+0000 7f5bade00640 1 --2- 172.21.15.151:0/1521793273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bb00b73d0 0x7f5bb00ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.238+0000 7f5bade00640 1 -- 172.21.15.151:0/1521793273 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb01f7bb0 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.238+0000 7f5bade00640 1 --2- 172.21.15.151:0/1521793273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bb00b5dc0 0x7f5bb01e7ca0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c410 tx=0x7f5ba000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.238+0000 7f5ba6a00640 1 -- 172.21.15.151:0/1521793273 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0017070 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.238+0000 7f5ba6a00640 1 -- 172.21.15.151:0/1521793273 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba00035f0 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.238+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1521793273 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb01f7e50 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.238+0000 7f5ba6a00640 1 -- 172.21.15.151:0/1521793273 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0003a20 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.239+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1521793273 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb01f8410 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.239+0000 7f5ba6a00640 1 -- 172.21.15.151:0/1521793273 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ba001a070 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.239+0000 7f5ba6a00640 1 -- 172.21.15.151:0/1521793273 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f5ba00127b0 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.240+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1521793273 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb01f89f0 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.243+0000 7f5ba6a00640 1 -- 172.21.15.151:0/1521793273 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5bb01f89f0 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.286 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:22.282+0000 7fc558039040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:11:22.309 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:22.304+0000 7fa0c3032040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-30T13:11:22.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.319+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1521793273 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a7ff4d09-d3c6-40ac-ad39-7ea908769472", "id": 1} v 0) -- 0x7f5bb0075890 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.327+0000 7f5ba6a00640 1 -- 172.21.15.151:0/1521793273 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7ff4d09-d3c6-40ac-ad39-7ea908769472", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f5ba0021070 con 0x7f5bb00b5dc0 2024-03-30T13:11:22.331 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-03-30T13:11:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.329+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1521793273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bb00b5dc0 msgr2=0x7f5bb01e7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.329+0000 7f5bb4e00640 1 --2- 172.21.15.151:0/1521793273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bb00b5dc0 0x7f5bb01e7ca0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c410 tx=0x7f5ba000c8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.329+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1521793273 shutdown_connections 2024-03-30T13:11:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.329+0000 7f5bb4e00640 1 --2- 172.21.15.151:0/1521793273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bb00ba090 0x7f5bb00cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.329+0000 7f5bb4e00640 1 --2- 172.21.15.151:0/1521793273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bb00b73d0 0x7f5bb00ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.329+0000 7f5bb4e00640 1 --2- 172.21.15.151:0/1521793273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bb00b5dc0 0x7f5bb01e7ca0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.329+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1521793273 >> 172.21.15.151:0/1521793273 conn(0x7f5bb00678f0 msgr2=0x7f5bb00b83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.329+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1521793273 shutdown_connections 2024-03-30T13:11:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.329+0000 7f5bb4e00640 1 -- 172.21.15.151:0/1521793273 wait complete. 2024-03-30T13:11:22.348 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 43dcea44-7a40-413e-a4c1-c868380d33db 2 2024-03-30T13:11:22.430 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:22.427+0000 7fc558039040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T13:11:22.517 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:22.513+0000 7fc558039040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:11:22.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.515+0000 7f3ab6e00640 1 Processor -- start 2024-03-30T13:11:22.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.515+0000 7f3ab6e00640 1 -- start start 2024-03-30T13:11:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.516+0000 7f3ab6e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3ab015e4b0 0x7f3ab00cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.516+0000 7f3ab6e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3ab00cfd90 0x7f3ab00d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.517+0000 7f3ab6e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ab00b7200 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.517+0000 7f3ab6e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3ab00d3130 con 0x7f3ab015e4b0 2024-03-30T13:11:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.517+0000 7f3ab6e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f3ab00b74e0 con 0x7f3ab00cfd90 2024-03-30T13:11:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.517+0000 7f3ab5000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3ab00cfd90 0x7f3ab00d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.517+0000 7f3ab5000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3ab00cfd90 0x7f3ab00d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49384/0 (socket says 172.21.15.151:49384) 2024-03-30T13:11:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.517+0000 7f3ab5000640 1 -- 172.21.15.151:0/3402357046 learned_addr learned my addr 172.21.15.151:0/3402357046 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.517+0000 7f3ab6400640 1 --1- 172.21.15.151:0/3402357046 >> v1:172.21.15.151:6789/0 conn(0x7f3ab00d2cc0 0x7f3ab00b4e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:60222/0 (socket says 172.21.15.151:60222) 2024-03-30T13:11:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.517+0000 7f3ab5000640 1 -- 172.21.15.151:0/3402357046 >> v2:172.21.15.44:3300/0 conn(0x7f3ab015e4b0 msgr2=0x7f3ab00cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.517+0000 7f3ab5000640 1 --2- 172.21.15.151:0/3402357046 >> v2:172.21.15.44:3300/0 conn(0x7f3ab015e4b0 0x7f3ab00cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.517+0000 7f3ab5000640 1 -- 172.21.15.151:0/3402357046 >> v1:172.21.15.151:6789/0 conn(0x7f3ab00d2cc0 legacy=0x7f3ab00b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.517+0000 7f3ab5000640 1 -- 172.21.15.151:0/3402357046 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab00b77c0 con 0x7f3ab00cfd90 2024-03-30T13:11:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.518+0000 7f3ab5000640 1 --2- 172.21.15.151:0/3402357046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ab00cfd90 0x7f3ab00d2780 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00ba1d0 tx=0x7f3a9c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb2f1f135889570b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.518+0000 7f3aafe00640 1 -- 172.21.15.151:0/3402357046 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c035020 con 0x7f3ab00cfd90 2024-03-30T13:11:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.518+0000 7f3aafe00640 1 -- 172.21.15.151:0/3402357046 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a9c031870 con 0x7f3ab00cfd90 2024-03-30T13:11:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.518+0000 7f3aafe00640 1 -- 172.21.15.151:0/3402357046 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c031c40 con 0x7f3ab00cfd90 2024-03-30T13:11:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.519+0000 7f3ab6e00640 1 -- 172.21.15.151:0/3402357046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ab00cfd90 msgr2=0x7f3ab00d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.519+0000 7f3ab6e00640 1 --2- 172.21.15.151:0/3402357046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ab00cfd90 0x7f3ab00d2780 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00ba1d0 tx=0x7f3a9c02b910 comp rx=0 tx=0).stop 2024-03-30T13:11:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.519+0000 7f3ab6e00640 1 -- 172.21.15.151:0/3402357046 shutdown_connections 2024-03-30T13:11:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.519+0000 7f3ab6e00640 1 --2- 172.21.15.151:0/3402357046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ab00cfd90 0x7f3ab00d2780 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.519+0000 7f3ab6e00640 1 --2- 172.21.15.151:0/3402357046 >> v2:172.21.15.44:3300/0 conn(0x7f3ab015e4b0 0x7f3ab00cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.519+0000 7f3ab6e00640 1 -- 172.21.15.151:0/3402357046 >> 172.21.15.151:0/3402357046 conn(0x7f3ab009d4e0 msgr2=0x7f3ab00d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.519+0000 7f3ab6e00640 1 -- 172.21.15.151:0/3402357046 shutdown_connections 2024-03-30T13:11:22.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.519+0000 7f3ab6e00640 1 -- 172.21.15.151:0/3402357046 wait complete. 2024-03-30T13:11:22.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.521+0000 7f3ab6e00640 1 Processor -- start 2024-03-30T13:11:22.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.521+0000 7f3ab6e00640 1 -- start start 2024-03-30T13:11:22.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.522+0000 7f3ab6e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ab00cfd90 0x7f3ab0160d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.522+0000 7f3ab6e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ab00d2cc0 0x7f3ab0158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.522+0000 7f3ab6e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ab015e4b0 0x7f3ab015ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.522+0000 7f3ab6e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab015ea10 con 0x7f3ab00cfd90 2024-03-30T13:11:22.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.522+0000 7f3ab6e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab015e890 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.522+0000 7f3ab6e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab00b5520 con 0x7f3ab015e4b0 2024-03-30T13:11:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.522+0000 7f3ab5000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ab00d2cc0 0x7f3ab0158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.522+0000 7f3ab5000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ab00d2cc0 0x7f3ab0158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49400/0 (socket says 172.21.15.151:49400) 2024-03-30T13:11:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.522+0000 7f3ab5000640 1 -- 172.21.15.151:0/2978338587 learned_addr learned my addr 172.21.15.151:0/2978338587 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.522+0000 7f3ab6400640 1 --2- 172.21.15.151:0/2978338587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ab015e4b0 0x7f3ab015ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.522+0000 7f3ab5a00640 1 --2- 172.21.15.151:0/2978338587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ab00cfd90 0x7f3ab0160d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.522+0000 7f3ab5000640 1 -- 172.21.15.151:0/2978338587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ab015e4b0 msgr2=0x7f3ab015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.523+0000 7f3ab5000640 1 --2- 172.21.15.151:0/2978338587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ab015e4b0 0x7f3ab015ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.523+0000 7f3ab5000640 1 -- 172.21.15.151:0/2978338587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ab00cfd90 msgr2=0x7f3ab0160d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.523+0000 7f3ab5000640 1 --2- 172.21.15.151:0/2978338587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ab00cfd90 0x7f3ab0160d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.523+0000 7f3ab5000640 1 -- 172.21.15.151:0/2978338587 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab015a070 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.523+0000 7f3ab5000640 1 --2- 172.21.15.151:0/2978338587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ab00d2cc0 0x7f3ab0158810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c02b950 tx=0x7f3a9c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.523+0000 7f3aad600640 1 -- 172.21.15.151:0/2978338587 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c040070 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.523+0000 7f3aad600640 1 -- 172.21.15.151:0/2978338587 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a9c03a420 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.523+0000 7f3ab6e00640 1 -- 172.21.15.151:0/2978338587 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab0161430 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.523+0000 7f3aad600640 1 -- 172.21.15.151:0/2978338587 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c035040 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.523+0000 7f3ab6e00640 1 -- 172.21.15.151:0/2978338587 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab01619f0 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.524+0000 7f3aad600640 1 -- 172.21.15.151:0/2978338587 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3a9c038020 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.524+0000 7f3aad600640 1 -- 172.21.15.151:0/2978338587 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f3a9c031730 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.524+0000 7f3ab6e00640 1 -- 172.21.15.151:0/2978338587 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab00b5340 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.527+0000 7f3aad600640 1 -- 172.21.15.151:0/2978338587 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3ab00b5340 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.574 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:22.571+0000 7fc558039040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:11:22.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.603+0000 7f3ab6e00640 1 -- 172.21.15.151:0/2978338587 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "43dcea44-7a40-413e-a4c1-c868380d33db", "id": 2} v 0) -- 0x7f3ab0075890 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.612+0000 7f3aad600640 1 -- 172.21.15.151:0/2978338587 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43dcea44-7a40-413e-a4c1-c868380d33db", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f3ab015a070 con 0x7f3ab00d2cc0 2024-03-30T13:11:22.615 INFO:teuthology.orchestra.run.smithi151.stdout:2 2024-03-30T13:11:22.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.613+0000 7f3ab6e00640 1 -- 172.21.15.151:0/2978338587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ab00d2cc0 msgr2=0x7f3ab0158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.613+0000 7f3ab6e00640 1 --2- 172.21.15.151:0/2978338587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ab00d2cc0 0x7f3ab0158810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c02b950 tx=0x7f3a9c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.613+0000 7f3ab6e00640 1 -- 172.21.15.151:0/2978338587 shutdown_connections 2024-03-30T13:11:22.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.613+0000 7f3ab6e00640 1 --2- 172.21.15.151:0/2978338587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ab015e4b0 0x7f3ab015ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.613+0000 7f3ab6e00640 1 --2- 172.21.15.151:0/2978338587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ab00d2cc0 0x7f3ab0158810 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.613+0000 7f3ab6e00640 1 --2- 172.21.15.151:0/2978338587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3ab00cfd90 0x7f3ab0160d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.613+0000 7f3ab6e00640 1 -- 172.21.15.151:0/2978338587 >> 172.21.15.151:0/2978338587 conn(0x7f3ab009d4e0 msgr2=0x7f3ab00b9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.613+0000 7f3ab6e00640 1 -- 172.21.15.151:0/2978338587 shutdown_connections 2024-03-30T13:11:22.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.613+0000 7f3ab6e00640 1 -- 172.21.15.151:0/2978338587 wait complete. 2024-03-30T13:11:22.632 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf 3 2024-03-30T13:11:22.639 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:22.636+0000 7fc558039040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:11:22.698 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:22.695+0000 7fc558039040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:11:22.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.815+0000 7f1ca7800640 1 Processor -- start 2024-03-30T13:11:22.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.815+0000 7f1ca7800640 1 -- start start 2024-03-30T13:11:22.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.817+0000 7f1ca7800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1ca00b4c90 0x7f1ca015fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.817+0000 7f1ca7800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ca00d03c0 0x7f1ca00d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.817+0000 7f1ca7800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca00b5ff0 con 0x7f1ca0155b10 2024-03-30T13:11:22.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.817+0000 7f1ca7800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1ca0155ef0 con 0x7f1ca00d03c0 2024-03-30T13:11:22.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.817+0000 7f1ca7800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f1ca00b41b0 con 0x7f1ca00b4c90 2024-03-30T13:11:22.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.817+0000 7f1ca4e00640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f1ca0155b10 0x7f1ca00b57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:60230/0 (socket says 172.21.15.151:60230) 2024-03-30T13:11:22.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.817+0000 7f1ca4e00640 1 -- 172.21.15.151:0/3114153692 learned_addr learned my addr 172.21.15.151:0/3114153692 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-03-30T13:11:22.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.817+0000 7f1c9fe00640 1 --2- 172.21.15.151:0/3114153692 >> v2:172.21.15.151:3300/0 conn(0x7f1ca00b4c90 0x7f1ca015fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.818+0000 7f1ca5800640 1 --2- 172.21.15.151:0/3114153692 >> v2:172.21.15.44:3300/0 conn(0x7f1ca00d03c0 0x7f1ca00d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.818+0000 7f1c9fe00640 1 -- 172.21.15.151:0/3114153692 >> v2:172.21.15.44:3300/0 conn(0x7f1ca00d03c0 msgr2=0x7f1ca00d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:22.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.818+0000 7f1c9fe00640 1 --2- 172.21.15.151:0/3114153692 >> v2:172.21.15.44:3300/0 conn(0x7f1ca00d03c0 0x7f1ca00d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.818+0000 7f1c9fe00640 1 -- 172.21.15.151:0/3114153692 >> v1:172.21.15.151:6789/0 conn(0x7f1ca0155b10 legacy=0x7f1ca00b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.818+0000 7f1c9fe00640 1 -- 172.21.15.151:0/3114153692 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca00b4490 con 0x7f1ca00b4c90 2024-03-30T13:11:22.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.818+0000 7f1c9f400640 1 -- 172.21.15.151:0/3114153692 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153257909 0 0) 0x7f1ca00b5ff0 con 0x7f1ca0155b10 2024-03-30T13:11:22.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.820+0000 7f1c9fe00640 1 --2- 172.21.15.151:0/3114153692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca00b4c90 0x7f1ca015fae0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1ca006d650 tx=0x7f1c8c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee739210112a2f5a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.820+0000 7f1c9f400640 1 -- 172.21.15.151:0/3114153692 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c035020 con 0x7f1ca00b4c90 2024-03-30T13:11:22.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.820+0000 7f1c9f400640 1 -- 172.21.15.151:0/3114153692 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8c031830 con 0x7f1ca00b4c90 2024-03-30T13:11:22.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.820+0000 7f1c9f400640 1 -- 172.21.15.151:0/3114153692 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c031c00 con 0x7f1ca00b4c90 2024-03-30T13:11:22.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.820+0000 7f1ca7800640 1 -- 172.21.15.151:0/3114153692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca00b4c90 msgr2=0x7f1ca015fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.820+0000 7f1ca7800640 1 --2- 172.21.15.151:0/3114153692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca00b4c90 0x7f1ca015fae0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1ca006d650 tx=0x7f1c8c02b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.821+0000 7f1ca7800640 1 -- 172.21.15.151:0/3114153692 shutdown_connections 2024-03-30T13:11:22.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.821+0000 7f1ca7800640 1 --2- 172.21.15.151:0/3114153692 >> v2:172.21.15.44:3300/0 conn(0x7f1ca00d03c0 0x7f1ca00d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.821+0000 7f1ca7800640 1 --2- 172.21.15.151:0/3114153692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca00b4c90 0x7f1ca015fae0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.821+0000 7f1ca7800640 1 -- 172.21.15.151:0/3114153692 >> 172.21.15.151:0/3114153692 conn(0x7f1ca00d1160 msgr2=0x7f1ca00d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.821+0000 7f1ca7800640 1 -- 172.21.15.151:0/3114153692 shutdown_connections 2024-03-30T13:11:22.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.821+0000 7f1ca7800640 1 -- 172.21.15.151:0/3114153692 wait complete. 2024-03-30T13:11:22.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.822+0000 7f1ca7800640 1 Processor -- start 2024-03-30T13:11:22.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.823+0000 7f1ca7800640 1 -- start start 2024-03-30T13:11:22.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.823+0000 7f1ca7800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca00b4c90 0x7f1ca014b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1ca7800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca00d03c0 0x7f1ca015a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1ca7800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca0155b10 0x7f1ca015a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:22.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1ca7800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca015b9d0 con 0x7f1ca0155b10 2024-03-30T13:11:22.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1ca7800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca00b62d0 con 0x7f1ca00d03c0 2024-03-30T13:11:22.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1ca7800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca015bb50 con 0x7f1ca00b4c90 2024-03-30T13:11:22.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1c9fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca00d03c0 0x7f1ca015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1ca4e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca00b4c90 0x7f1ca014b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1c9fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca00d03c0 0x7f1ca015a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49426/0 (socket says 172.21.15.151:49426) 2024-03-30T13:11:22.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1c9fe00640 1 -- 172.21.15.151:0/3691153129 learned_addr learned my addr 172.21.15.151:0/3691153129 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:22.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1ca4e00640 1 --2- 172.21.15.151:0/3691153129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca00b4c90 0x7f1ca014b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:46234/0 (socket says 172.21.15.151:46234) 2024-03-30T13:11:22.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1ca5800640 1 --2- 172.21.15.151:0/3691153129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca0155b10 0x7f1ca015a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:22.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1c9fe00640 1 -- 172.21.15.151:0/3691153129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca00b4c90 msgr2=0x7f1ca014b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1c9fe00640 1 --2- 172.21.15.151:0/3691153129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca00b4c90 0x7f1ca014b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1c9fe00640 1 -- 172.21.15.151:0/3691153129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca0155b10 msgr2=0x7f1ca015a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1c9fe00640 1 --2- 172.21.15.151:0/3691153129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca0155b10 0x7f1ca015a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1c9fe00640 1 -- 172.21.15.151:0/3691153129 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca01f42d0 con 0x7f1ca00d03c0 2024-03-30T13:11:22.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.824+0000 7f1ca4e00640 1 --2- 172.21.15.151:0/3691153129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca00b4c90 0x7f1ca014b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:22.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.825+0000 7f1c9fe00640 1 --2- 172.21.15.151:0/3691153129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca00d03c0 0x7f1ca015a490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009890 tx=0x7f1c8c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:22.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.825+0000 7f1c9cc00640 1 -- 172.21.15.151:0/3691153129 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c041070 con 0x7f1ca00d03c0 2024-03-30T13:11:22.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.825+0000 7f1c9cc00640 1 -- 172.21.15.151:0/3691153129 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8c03aa30 con 0x7f1ca00d03c0 2024-03-30T13:11:22.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.825+0000 7f1ca7800640 1 -- 172.21.15.151:0/3691153129 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca01f45b0 con 0x7f1ca00d03c0 2024-03-30T13:11:22.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.825+0000 7f1c9cc00640 1 -- 172.21.15.151:0/3691153129 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c035040 con 0x7f1ca00d03c0 2024-03-30T13:11:22.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.825+0000 7f1ca7800640 1 -- 172.21.15.151:0/3691153129 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca01f4b70 con 0x7f1ca00d03c0 2024-03-30T13:11:22.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.826+0000 7f1c9cc00640 1 -- 172.21.15.151:0/3691153129 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1c8c038020 con 0x7f1ca00d03c0 2024-03-30T13:11:22.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.826+0000 7f1c9cc00640 1 -- 172.21.15.151:0/3691153129 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1c8c04ec60 con 0x7f1ca00d03c0 2024-03-30T13:11:22.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.826+0000 7f1ca7800640 1 -- 172.21.15.151:0/3691153129 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca0075890 con 0x7f1ca00d03c0 2024-03-30T13:11:22.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.829+0000 7f1c9cc00640 1 -- 172.21.15.151:0/3691153129 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1c8c054080 con 0x7f1ca00d03c0 2024-03-30T13:11:22.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.907+0000 7f1ca7800640 1 -- 172.21.15.151:0/3691153129 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf", "id": 3} v 0) -- 0x7f1ca00d1ee0 con 0x7f1ca00d03c0 2024-03-30T13:11:22.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.917+0000 7f1c9cc00640 1 -- 172.21.15.151:0/3691153129 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1c8c04e7d0 con 0x7f1ca00d03c0 2024-03-30T13:11:22.921 INFO:teuthology.orchestra.run.smithi151.stdout:3 2024-03-30T13:11:22.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.918+0000 7f1ca7800640 1 -- 172.21.15.151:0/3691153129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca00d03c0 msgr2=0x7f1ca015a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:22.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.918+0000 7f1ca7800640 1 --2- 172.21.15.151:0/3691153129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca00d03c0 0x7f1ca015a490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009890 tx=0x7f1c8c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.918+0000 7f1ca7800640 1 -- 172.21.15.151:0/3691153129 shutdown_connections 2024-03-30T13:11:22.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.918+0000 7f1ca7800640 1 --2- 172.21.15.151:0/3691153129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ca0155b10 0x7f1ca015a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.918+0000 7f1ca7800640 1 --2- 172.21.15.151:0/3691153129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ca00d03c0 0x7f1ca015a490 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.918+0000 7f1ca7800640 1 --2- 172.21.15.151:0/3691153129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ca00b4c90 0x7f1ca014b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:22.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.918+0000 7f1ca7800640 1 -- 172.21.15.151:0/3691153129 >> 172.21.15.151:0/3691153129 conn(0x7f1ca00d1160 msgr2=0x7f1ca015bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:22.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.919+0000 7f1ca7800640 1 -- 172.21.15.151:0/3691153129 shutdown_connections 2024-03-30T13:11:22.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:22.919+0000 7f1ca7800640 1 -- 172.21.15.151:0/3691153129 wait complete. 2024-03-30T13:11:22.939 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 2fc37687-1849-4792-91b2-c58ea87d3506 4 2024-03-30T13:11:22.972 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:22.967+0000 7fa0c3032040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-30T13:11:23.039 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:23.034+0000 7fa0c3032040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-30T13:11:23.092 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:23.087+0000 7fa0c3032040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-30T13:11:23.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.131+0000 7f4dc3600640 1 Processor -- start 2024-03-30T13:11:23.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.131+0000 7f4dc3600640 1 -- start start 2024-03-30T13:11:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.133+0000 7f4dc3600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dbc0b3f20 0x7f4dbc15d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.133+0000 7f4dc3600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dbc0cc8e0 con 0x7f4dbc0b4300 2024-03-30T13:11:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.133+0000 7f4dc3600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dbc0ccbc0 con 0x7f4dbc0d1ca0 2024-03-30T13:11:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.133+0000 7f4dc3600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4dbc15cac0 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.133+0000 7f4dc0c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dbc0b3f20 0x7f4dbc15d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.133+0000 7f4dc1600640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f4dbc0d1ca0 0x7f4dbc0d2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:60240/0 (socket says 172.21.15.151:60240) 2024-03-30T13:11:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.133+0000 7f4dc1600640 1 -- 172.21.15.151:0/4145584651 learned_addr learned my addr 172.21.15.151:0/4145584651 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-03-30T13:11:23.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.133+0000 7f4dc0c00640 1 -- 172.21.15.151:0/4145584651 >> v1:172.21.15.151:6789/0 conn(0x7f4dbc0d1ca0 legacy=0x7f4dbc0d2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.134+0000 7f4dc0c00640 1 -- 172.21.15.151:0/4145584651 >> v1:172.21.15.44:6789/0 conn(0x7f4dbc0b4300 legacy=0x7f4dbc0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.134+0000 7f4dbb400640 1 -- 172.21.15.151:0/4145584651 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827953750 0 0) 0x7f4dbc0ccbc0 con 0x7f4dbc0d1ca0 2024-03-30T13:11:23.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.134+0000 7f4dc0c00640 1 -- 172.21.15.151:0/4145584651 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dbc0ceba0 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.135+0000 7f4dc0c00640 1 --2- 172.21.15.151:0/4145584651 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dbc0b3f20 0x7f4dbc15d2c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4db00097d0 tx=0x7f4db002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9fc7ef097f522b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.135+0000 7f4dbb400640 1 -- 172.21.15.151:0/4145584651 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0031770 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.135+0000 7f4dbb400640 1 -- 172.21.15.151:0/4145584651 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db0037070 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.135+0000 7f4dbb400640 1 -- 172.21.15.151:0/4145584651 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0031b30 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.136+0000 7f4dc3600640 1 -- 172.21.15.151:0/4145584651 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dbc0b3f20 msgr2=0x7f4dbc15d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.136+0000 7f4dc3600640 1 --2- 172.21.15.151:0/4145584651 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dbc0b3f20 0x7f4dbc15d2c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4db00097d0 tx=0x7f4db002b810 comp rx=0 tx=0).stop 2024-03-30T13:11:23.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.136+0000 7f4dc3600640 1 -- 172.21.15.151:0/4145584651 shutdown_connections 2024-03-30T13:11:23.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.136+0000 7f4dc3600640 1 --2- 172.21.15.151:0/4145584651 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dbc0b3f20 0x7f4dbc15d2c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.136+0000 7f4dc3600640 1 -- 172.21.15.151:0/4145584651 >> 172.21.15.151:0/4145584651 conn(0x7f4dbc0672c0 msgr2=0x7f4dbc0676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:23.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.136+0000 7f4dc3600640 1 -- 172.21.15.151:0/4145584651 shutdown_connections 2024-03-30T13:11:23.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.136+0000 7f4dc3600640 1 -- 172.21.15.151:0/4145584651 wait complete. 2024-03-30T13:11:23.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.137+0000 7f4dc3600640 1 Processor -- start 2024-03-30T13:11:23.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.138+0000 7f4dc3600640 1 -- start start 2024-03-30T13:11:23.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.138+0000 7f4dc3600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dbc0b3f20 0x7f4dbc1f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.138+0000 7f4dc3600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dbc0b4300 0x7f4dbc15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc3600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0d1ca0 0x7f4dbc0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc3600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc15d980 con 0x7f4dbc0d1ca0 2024-03-30T13:11:23.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc3600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4dbc15d800 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc3600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4dbc152db0 con 0x7f4dbc0b4300 2024-03-30T13:11:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc0c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dbc0b3f20 0x7f4dbc1f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc0c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dbc0b3f20 0x7f4dbc1f4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49432/0 (socket says 172.21.15.151:49432) 2024-03-30T13:11:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc0c00640 1 -- 172.21.15.151:0/4044180059 learned_addr learned my addr 172.21.15.151:0/4044180059 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dbbe00640 1 --2- 172.21.15.151:0/4044180059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dbc0b4300 0x7f4dbc15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc1600640 1 --2- 172.21.15.151:0/4044180059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0d1ca0 0x7f4dbc0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc0c00640 1 -- 172.21.15.151:0/4044180059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dbc0b4300 msgr2=0x7f4dbc15b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc0c00640 1 --2- 172.21.15.151:0/4044180059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dbc0b4300 0x7f4dbc15b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc0c00640 1 -- 172.21.15.151:0/4044180059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0d1ca0 msgr2=0x7f4dbc0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc0c00640 1 --2- 172.21.15.151:0/4044180059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0d1ca0 0x7f4dbc0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.139+0000 7f4dc0c00640 1 -- 172.21.15.151:0/4044180059 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dbc1f5300 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.140+0000 7f4dc0c00640 1 --2- 172.21.15.151:0/4044180059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dbc0b3f20 0x7f4dbc1f4dc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4db0034040 tx=0x7f4db00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.140+0000 7f4db8c00640 1 -- 172.21.15.151:0/4044180059 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0032810 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.140+0000 7f4db8c00640 1 -- 172.21.15.151:0/4044180059 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db00329b0 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.140+0000 7f4db8c00640 1 -- 172.21.15.151:0/4044180059 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0032da0 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.140+0000 7f4dc3600640 1 -- 172.21.15.151:0/4044180059 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dbc06e530 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.140+0000 7f4dc3600640 1 -- 172.21.15.151:0/4044180059 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dbc154e80 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.140+0000 7f4db8c00640 1 -- 172.21.15.151:0/4044180059 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4db004c060 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.140+0000 7f4db8c00640 1 -- 172.21.15.151:0/4044180059 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f4db0006340 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.141+0000 7f4dc3600640 1 -- 172.21.15.151:0/4044180059 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dbc075890 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.143+0000 7f4db8c00640 1 -- 172.21.15.151:0/4044180059 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4dbc1f5300 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.157 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:23.153+0000 7fa0c3032040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-30T13:11:23.170 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:23.166+0000 7fc558039040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:11:23.210 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:23.205+0000 7fa0c3032040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-30T13:11:23.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.223+0000 7f4dc3600640 1 -- 172.21.15.151:0/4044180059 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2fc37687-1849-4792-91b2-c58ea87d3506", "id": 4} v 0) -- 0x7f4dbc0d1a80 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.229+0000 7f4db8c00640 1 -- 172.21.15.151:0/4044180059 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2fc37687-1849-4792-91b2-c58ea87d3506", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f4db0052020 con 0x7f4dbc0b3f20 2024-03-30T13:11:23.233 INFO:teuthology.orchestra.run.smithi151.stdout:4 2024-03-30T13:11:23.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.231+0000 7f4dc3600640 1 -- 172.21.15.151:0/4044180059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dbc0b3f20 msgr2=0x7f4dbc1f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.231+0000 7f4dc3600640 1 --2- 172.21.15.151:0/4044180059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dbc0b3f20 0x7f4dbc1f4dc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4db0034040 tx=0x7f4db00046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.231+0000 7f4dc3600640 1 -- 172.21.15.151:0/4044180059 shutdown_connections 2024-03-30T13:11:23.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.231+0000 7f4dc3600640 1 --2- 172.21.15.151:0/4044180059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4dbc0d1ca0 0x7f4dbc0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.231+0000 7f4dc3600640 1 --2- 172.21.15.151:0/4044180059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dbc0b4300 0x7f4dbc15b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.231+0000 7f4dc3600640 1 --2- 172.21.15.151:0/4044180059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dbc0b3f20 0x7f4dbc1f4dc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.231+0000 7f4dc3600640 1 -- 172.21.15.151:0/4044180059 >> 172.21.15.151:0/4044180059 conn(0x7f4dbc0672c0 msgr2=0x7f4dbc0b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:23.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.231+0000 7f4dc3600640 1 -- 172.21.15.151:0/4044180059 shutdown_connections 2024-03-30T13:11:23.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.231+0000 7f4dc3600640 1 -- 172.21.15.151:0/4044180059 wait complete. 2024-03-30T13:11:23.250 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new ee034798-2fd8-4dbc-a713-55f1a16bb98e 5 2024-03-30T13:11:23.339 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:23.335+0000 7fc558039040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:11:23.347 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:23.343+0000 7fa0c3032040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-30T13:11:23.431 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:23.427+0000 7fa0c3032040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-30T13:11:23.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.434+0000 7f806cc00640 1 Processor -- start 2024-03-30T13:11:23.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.434+0000 7f806cc00640 1 -- start start 2024-03-30T13:11:23.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.435+0000 7f806cc00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f806815e4b0 0x7f80680cf850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.435+0000 7f806cc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80680d2e90 0x7f80680b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.435+0000 7f806cc00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80680b7200 con 0x7f80680cfd90 2024-03-30T13:11:23.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.435+0000 7f806cc00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f80680b74e0 con 0x7f806815e4b0 2024-03-30T13:11:23.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.435+0000 7f806cc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f80680b77c0 con 0x7f80680d2e90 2024-03-30T13:11:23.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.436+0000 7f8067e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80680d2e90 0x7f80680b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.436+0000 7f8067e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80680d2e90 0x7f80680b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:46276/0 (socket says 172.21.15.151:46276) 2024-03-30T13:11:23.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.436+0000 7f8067e00640 1 -- 172.21.15.151:0/2511943198 learned_addr learned my addr 172.21.15.151:0/2511943198 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:23.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.436+0000 7f8067400640 1 --2- 172.21.15.151:0/2511943198 >> v2:172.21.15.151:3300/0 conn(0x7f806815e4b0 0x7f80680cf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.436+0000 7f8067e00640 1 -- 172.21.15.151:0/2511943198 >> v2:172.21.15.151:3300/0 conn(0x7f806815e4b0 msgr2=0x7f80680cf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:23.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.436+0000 7f8067e00640 1 --2- 172.21.15.151:0/2511943198 >> v2:172.21.15.151:3300/0 conn(0x7f806815e4b0 0x7f80680cf850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.436+0000 7f8067e00640 1 -- 172.21.15.151:0/2511943198 >> v1:172.21.15.44:6789/0 conn(0x7f80680cfd90 legacy=0x7f80680d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.436+0000 7f8067e00640 1 -- 172.21.15.151:0/2511943198 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80680b7aa0 con 0x7f80680d2e90 2024-03-30T13:11:23.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.437+0000 7f8067e00640 1 --2- 172.21.15.151:0/2511943198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80680d2e90 0x7f80680b4e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8060009e50 tx=0x7f806002bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9f4766fd94b6c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.438+0000 7f8066a00640 1 -- 172.21.15.151:0/2511943198 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806002ca80 con 0x7f80680d2e90 2024-03-30T13:11:23.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.438+0000 7f8066a00640 1 -- 172.21.15.151:0/2511943198 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f806002cc20 con 0x7f80680d2e90 2024-03-30T13:11:23.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.438+0000 7f8066a00640 1 -- 172.21.15.151:0/2511943198 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80600343f0 con 0x7f80680d2e90 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.438+0000 7f806cc00640 1 -- 172.21.15.151:0/2511943198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80680d2e90 msgr2=0x7f80680b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.438+0000 7f806cc00640 1 --2- 172.21.15.151:0/2511943198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80680d2e90 0x7f80680b4e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8060009e50 tx=0x7f806002bee0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.438+0000 7f806cc00640 1 -- 172.21.15.151:0/2511943198 shutdown_connections 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.438+0000 7f806cc00640 1 --2- 172.21.15.151:0/2511943198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80680d2e90 0x7f80680b4e10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.438+0000 7f806cc00640 1 --2- 172.21.15.151:0/2511943198 >> v2:172.21.15.151:3300/0 conn(0x7f806815e4b0 0x7f80680cf850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.438+0000 7f806cc00640 1 -- 172.21.15.151:0/2511943198 >> 172.21.15.151:0/2511943198 conn(0x7f806809d4e0 msgr2=0x7f80680d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:23.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.438+0000 7f806cc00640 1 -- 172.21.15.151:0/2511943198 shutdown_connections 2024-03-30T13:11:23.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.439+0000 7f806cc00640 1 -- 172.21.15.151:0/2511943198 wait complete. 2024-03-30T13:11:23.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.440+0000 7f806cc00640 1 Processor -- start 2024-03-30T13:11:23.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.440+0000 7f806cc00640 1 -- start start 2024-03-30T13:11:23.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.441+0000 7f806cc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80680cfd90 0x7f80681e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.441+0000 7f806cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80680d2e90 0x7f80680c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.441+0000 7f806cc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f806815e4b0 0x7f80680ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.441+0000 7f806cc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f80680b54d0 con 0x7f80680d2e90 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.441+0000 7f806cc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f80680b5350 con 0x7f80680cfd90 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.441+0000 7f806cc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f80680b5650 con 0x7f806815e4b0 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.441+0000 7f8067400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80680cfd90 0x7f80681e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.441+0000 7f8067400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80680cfd90 0x7f80681e6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49438/0 (socket says 172.21.15.151:49438) 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.441+0000 7f8067400640 1 -- 172.21.15.151:0/2563228284 learned_addr learned my addr 172.21.15.151:0/2563228284 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.442+0000 7f8067e00640 1 --2- 172.21.15.151:0/2563228284 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f806815e4b0 0x7f80680ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.442+0000 7f805fe00640 1 --2- 172.21.15.151:0/2563228284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80680d2e90 0x7f80680c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.442+0000 7f8067400640 1 -- 172.21.15.151:0/2563228284 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f806815e4b0 msgr2=0x7f80680ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.442+0000 7f8067400640 1 --2- 172.21.15.151:0/2563228284 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f806815e4b0 0x7f80680ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.442+0000 7f8067400640 1 -- 172.21.15.151:0/2563228284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80680d2e90 msgr2=0x7f80680c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.442+0000 7f8067400640 1 --2- 172.21.15.151:0/2563228284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80680d2e90 0x7f80680c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.442+0000 7f8067400640 1 -- 172.21.15.151:0/2563228284 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80680c8a50 con 0x7f80680cfd90 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.442+0000 7f8067400640 1 --2- 172.21.15.151:0/2563228284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80680cfd90 0x7f80681e6f00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f805800e870 tx=0x7f805800ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.442+0000 7f805f400640 1 -- 172.21.15.151:0/2563228284 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8058017070 con 0x7f80680cfd90 2024-03-30T13:11:23.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.442+0000 7f805f400640 1 -- 172.21.15.151:0/2563228284 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f805800c940 con 0x7f80680cfd90 2024-03-30T13:11:23.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.443+0000 7f806cc00640 1 -- 172.21.15.151:0/2563228284 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80680c8d30 con 0x7f80680cfd90 2024-03-30T13:11:23.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.443+0000 7f805f400640 1 -- 172.21.15.151:0/2563228284 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805800cd30 con 0x7f80680cfd90 2024-03-30T13:11:23.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.443+0000 7f806cc00640 1 -- 172.21.15.151:0/2563228284 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80680c92f0 con 0x7f80680cfd90 2024-03-30T13:11:23.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.443+0000 7f805f400640 1 -- 172.21.15.151:0/2563228284 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f805801a070 con 0x7f80680cfd90 2024-03-30T13:11:23.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.443+0000 7f805f400640 1 -- 172.21.15.151:0/2563228284 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f80580139f0 con 0x7f80680cfd90 2024-03-30T13:11:23.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.444+0000 7f806cc00640 1 -- 172.21.15.151:0/2563228284 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80680d0310 con 0x7f80680cfd90 2024-03-30T13:11:23.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.446+0000 7f805f400640 1 -- 172.21.15.151:0/2563228284 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f80680d0310 con 0x7f80680cfd90 2024-03-30T13:11:23.488 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:23.483+0000 7fa0c3032040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-30T13:11:23.491 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:23.488+0000 7fc558039040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:11:23.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.524+0000 7f806cc00640 1 -- 172.21.15.151:0/2563228284 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ee034798-2fd8-4dbc-a713-55f1a16bb98e", "id": 5} v 0) -- 0x7f80680c94f0 con 0x7f80680cfd90 2024-03-30T13:11:23.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.534+0000 7f805f400640 1 -- 172.21.15.151:0/2563228284 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee034798-2fd8-4dbc-a713-55f1a16bb98e", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f80680c94f0 con 0x7f80680cfd90 2024-03-30T13:11:23.538 INFO:teuthology.orchestra.run.smithi151.stdout:5 2024-03-30T13:11:23.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.536+0000 7f806cc00640 1 -- 172.21.15.151:0/2563228284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80680cfd90 msgr2=0x7f80681e6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.536+0000 7f806cc00640 1 --2- 172.21.15.151:0/2563228284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80680cfd90 0x7f80681e6f00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f805800e870 tx=0x7f805800ec70 comp rx=0 tx=0).stop 2024-03-30T13:11:23.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.536+0000 7f806cc00640 1 -- 172.21.15.151:0/2563228284 shutdown_connections 2024-03-30T13:11:23.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.536+0000 7f806cc00640 1 --2- 172.21.15.151:0/2563228284 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f806815e4b0 0x7f80680ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.536+0000 7f806cc00640 1 --2- 172.21.15.151:0/2563228284 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80680d2e90 0x7f80680c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.536+0000 7f806cc00640 1 --2- 172.21.15.151:0/2563228284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80680cfd90 0x7f80681e6f00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.536+0000 7f806cc00640 1 -- 172.21.15.151:0/2563228284 >> 172.21.15.151:0/2563228284 conn(0x7f806809d4e0 msgr2=0x7f8068160ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:23.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.536+0000 7f806cc00640 1 -- 172.21.15.151:0/2563228284 shutdown_connections 2024-03-30T13:11:23.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.536+0000 7f806cc00640 1 -- 172.21.15.151:0/2563228284 wait complete. 2024-03-30T13:11:23.548 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:23.545+0000 7fc558039040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:11:23.551 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:23.547+0000 7fa0c3032040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-30T13:11:23.556 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 22a50a18-c452-4c7e-95ad-431ec30864f4 6 2024-03-30T13:11:23.609 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:23.604+0000 7fa0c3032040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-30T13:11:23.684 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:23.680+0000 7fc558039040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:11:23.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.730+0000 7f4811a00640 1 Processor -- start 2024-03-30T13:11:23.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.730+0000 7f4811a00640 1 -- start start 2024-03-30T13:11:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.732+0000 7f4811a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f480c15e950 0x7f480c0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.732+0000 7f4811a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f480c0ce650 con 0x7f480c15e570 2024-03-30T13:11:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.732+0000 7f4811a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f480c0cfb60 con 0x7f480c0d12f0 2024-03-30T13:11:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.732+0000 7f4811a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f480c0cfe40 con 0x7f480c15e950 2024-03-30T13:11:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.732+0000 7f4811000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f480c15e950 0x7f480c0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.732+0000 7f4811000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f480c15e950 0x7f480c0cc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49452/0 (socket says 172.21.15.151:49452) 2024-03-30T13:11:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.732+0000 7f4811000640 1 -- 172.21.15.151:0/3325008452 learned_addr learned my addr 172.21.15.151:0/3325008452 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.732+0000 7f4811000640 1 -- 172.21.15.151:0/3325008452 >> v1:172.21.15.151:6789/0 conn(0x7f480c0d12f0 legacy=0x7f480c0cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.732+0000 7f4811000640 1 -- 172.21.15.151:0/3325008452 >> v1:172.21.15.44:6789/0 conn(0x7f480c15e570 legacy=0x7f480c0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.732+0000 7f4811000640 1 -- 172.21.15.151:0/3325008452 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480c0d0120 con 0x7f480c15e950 2024-03-30T13:11:23.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.733+0000 7f4811000640 1 --2- 172.21.15.151:0/3325008452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f480c15e950 0x7f480c0cc0d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4804009e50 tx=0x7f480402bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67e06f6c5fe62c03 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.734+0000 7f480b400640 1 -- 172.21.15.151:0/3325008452 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480402cb10 con 0x7f480c15e950 2024-03-30T13:11:23.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.734+0000 7f480b400640 1 -- 172.21.15.151:0/3325008452 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480402ccb0 con 0x7f480c15e950 2024-03-30T13:11:23.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.734+0000 7f480b400640 1 -- 172.21.15.151:0/3325008452 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480402ce60 con 0x7f480c15e950 2024-03-30T13:11:23.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.734+0000 7f4811a00640 1 -- 172.21.15.151:0/3325008452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f480c15e950 msgr2=0x7f480c0cc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.734+0000 7f4811a00640 1 --2- 172.21.15.151:0/3325008452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f480c15e950 0x7f480c0cc0d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4804009e50 tx=0x7f480402bf70 comp rx=0 tx=0).stop 2024-03-30T13:11:23.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.734+0000 7f4811a00640 1 -- 172.21.15.151:0/3325008452 shutdown_connections 2024-03-30T13:11:23.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.734+0000 7f4811a00640 1 --2- 172.21.15.151:0/3325008452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f480c15e950 0x7f480c0cc0d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.734+0000 7f4811a00640 1 -- 172.21.15.151:0/3325008452 >> 172.21.15.151:0/3325008452 conn(0x7f480c0d41f0 msgr2=0x7f480c0d4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.735+0000 7f4811a00640 1 -- 172.21.15.151:0/3325008452 shutdown_connections 2024-03-30T13:11:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.735+0000 7f4811a00640 1 -- 172.21.15.151:0/3325008452 wait complete. 2024-03-30T13:11:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.736+0000 7f4811a00640 1 Processor -- start 2024-03-30T13:11:23.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.736+0000 7f4811a00640 1 -- start start 2024-03-30T13:11:23.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.737+0000 7f4811a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f480c0d12f0 0x7f480c1f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.737+0000 7f4811a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f480c15e570 0x7f480c160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.737+0000 7f4811a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480c15e950 0x7f480c146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.737+0000 7f4811a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f480c068130 con 0x7f480c0d12f0 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.737+0000 7f4811a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f480c067fb0 con 0x7f480c15e570 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.737+0000 7f4811a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f480c0d4d10 con 0x7f480c15e950 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.737+0000 7f4811000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480c15e950 0x7f480c146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.737+0000 7f4803e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f480c15e570 0x7f480c160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.737+0000 7f4811000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480c15e950 0x7f480c146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:46292/0 (socket says 172.21.15.151:46292) 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.737+0000 7f4811000640 1 -- 172.21.15.151:0/2498507100 learned_addr learned my addr 172.21.15.151:0/2498507100 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.738+0000 7f480be00640 1 --2- 172.21.15.151:0/2498507100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f480c0d12f0 0x7f480c1f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.738+0000 7f4803e00640 1 -- 172.21.15.151:0/2498507100 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480c15e950 msgr2=0x7f480c146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.738+0000 7f4803e00640 1 --2- 172.21.15.151:0/2498507100 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480c15e950 0x7f480c146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.738+0000 7f4803e00640 1 -- 172.21.15.151:0/2498507100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f480c0d12f0 msgr2=0x7f480c1f72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.738+0000 7f4803e00640 1 --2- 172.21.15.151:0/2498507100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f480c0d12f0 0x7f480c1f72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.738+0000 7f4803e00640 1 -- 172.21.15.151:0/2498507100 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480c15ff30 con 0x7f480c15e570 2024-03-30T13:11:23.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.738+0000 7f4811000640 1 --2- 172.21.15.151:0/2498507100 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480c15e950 0x7f480c146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:23.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.738+0000 7f4803e00640 1 --2- 172.21.15.151:0/2498507100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f480c15e570 0x7f480c160fd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f47f400c3c0 tx=0x7f47f400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:23.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.739+0000 7f4808c00640 1 -- 172.21.15.151:0/2498507100 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f4017070 con 0x7f480c15e570 2024-03-30T13:11:23.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.739+0000 7f4808c00640 1 -- 172.21.15.151:0/2498507100 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f40052d0 con 0x7f480c15e570 2024-03-30T13:11:23.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.739+0000 7f4811a00640 1 -- 172.21.15.151:0/2498507100 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f480c160210 con 0x7f480c15e570 2024-03-30T13:11:23.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.739+0000 7f4808c00640 1 -- 172.21.15.151:0/2498507100 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f4003830 con 0x7f480c15e570 2024-03-30T13:11:23.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.739+0000 7f4811a00640 1 -- 172.21.15.151:0/2498507100 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f480c1607d0 con 0x7f480c15e570 2024-03-30T13:11:23.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.739+0000 7f4808c00640 1 -- 172.21.15.151:0/2498507100 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f47f401a070 con 0x7f480c15e570 2024-03-30T13:11:23.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.739+0000 7f4808c00640 1 -- 172.21.15.151:0/2498507100 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f47f4011590 con 0x7f480c15e570 2024-03-30T13:11:23.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.740+0000 7f4811a00640 1 -- 172.21.15.151:0/2498507100 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f480c075890 con 0x7f480c15e570 2024-03-30T13:11:23.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.742+0000 7f4808c00640 1 -- 172.21.15.151:0/2498507100 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f47f4021020 con 0x7f480c15e570 2024-03-30T13:11:23.802 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:23.798+0000 7fc558039040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:11:23.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.821+0000 7f4811a00640 1 -- 172.21.15.151:0/2498507100 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "22a50a18-c452-4c7e-95ad-431ec30864f4", "id": 6} v 0) -- 0x7f480c0cdca0 con 0x7f480c15e570 2024-03-30T13:11:23.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.830+0000 7f4808c00640 1 -- 172.21.15.151:0/2498507100 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22a50a18-c452-4c7e-95ad-431ec30864f4", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f47f4011bd0 con 0x7f480c15e570 2024-03-30T13:11:23.833 INFO:teuthology.orchestra.run.smithi151.stdout:6 2024-03-30T13:11:23.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.831+0000 7f4811a00640 1 -- 172.21.15.151:0/2498507100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f480c15e570 msgr2=0x7f480c160fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:23.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.831+0000 7f4811a00640 1 --2- 172.21.15.151:0/2498507100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f480c15e570 0x7f480c160fd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f47f400c3c0 tx=0x7f47f400c880 comp rx=0 tx=0).stop 2024-03-30T13:11:23.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.831+0000 7f4811a00640 1 -- 172.21.15.151:0/2498507100 shutdown_connections 2024-03-30T13:11:23.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.831+0000 7f4811a00640 1 --2- 172.21.15.151:0/2498507100 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f480c15e950 0x7f480c146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.831+0000 7f4811a00640 1 --2- 172.21.15.151:0/2498507100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f480c15e570 0x7f480c160fd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.831+0000 7f4811a00640 1 --2- 172.21.15.151:0/2498507100 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f480c0d12f0 0x7f480c1f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:23.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.831+0000 7f4811a00640 1 -- 172.21.15.151:0/2498507100 >> 172.21.15.151:0/2498507100 conn(0x7f480c0d41f0 msgr2=0x7f480c0d1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:23.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.832+0000 7f4811a00640 1 -- 172.21.15.151:0/2498507100 shutdown_connections 2024-03-30T13:11:23.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:23.832+0000 7f4811a00640 1 -- 172.21.15.151:0/2498507100 wait complete. 2024-03-30T13:11:23.852 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 1b3f2117-76b0-4720-ad67-b765e5e10603 7 2024-03-30T13:11:23.992 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:23.988+0000 7fc558039040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:11:24.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.031+0000 7f979fc00640 1 Processor -- start 2024-03-30T13:11:24.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.032+0000 7f979fc00640 1 -- start start 2024-03-30T13:11:24.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.033+0000 7f979fc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f979815ec60 0x7f97980d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.033+0000 7f979fc00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f97980cf890 0x7f97980b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.033+0000 7f979fc00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97980b49f0 con 0x7f9798154fb0 2024-03-30T13:11:24.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.033+0000 7f979fc00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f97980b47c0 con 0x7f979815ec60 2024-03-30T13:11:24.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.033+0000 7f979fc00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f9798070720 con 0x7f97980cf890 2024-03-30T13:11:24.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.033+0000 7f979d200640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f9798154fb0 0x7f979815e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:60260/0 (socket says 172.21.15.151:60260) 2024-03-30T13:11:24.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.033+0000 7f979d200640 1 -- 172.21.15.151:0/2424798320 learned_addr learned my addr 172.21.15.151:0/2424798320 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-03-30T13:11:24.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.033+0000 7f979dc00640 1 --2- 172.21.15.151:0/2424798320 >> v2:172.21.15.151:3300/0 conn(0x7f97980cf890 0x7f97980b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.034+0000 7f9797e00640 1 --2- 172.21.15.151:0/2424798320 >> v2:172.21.15.44:3300/0 conn(0x7f979815ec60 0x7f97980d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.034+0000 7f9797400640 1 -- 172.21.15.151:0/2424798320 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1292113799 0 0) 0x7f97980b49f0 con 0x7f9798154fb0 2024-03-30T13:11:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.034+0000 7f9797400640 1 -- 172.21.15.151:0/2424798320 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9780003520 con 0x7f9798154fb0 2024-03-30T13:11:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.034+0000 7f979dc00640 1 -- 172.21.15.151:0/2424798320 >> v2:172.21.15.44:3300/0 conn(0x7f979815ec60 msgr2=0x7f97980d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.034+0000 7f979dc00640 1 --2- 172.21.15.151:0/2424798320 >> v2:172.21.15.44:3300/0 conn(0x7f979815ec60 0x7f97980d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.034+0000 7f979dc00640 1 -- 172.21.15.151:0/2424798320 >> v1:172.21.15.151:6789/0 conn(0x7f9798154fb0 legacy=0x7f979815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.034+0000 7f979dc00640 1 -- 172.21.15.151:0/2424798320 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97980cead0 con 0x7f97980cf890 2024-03-30T13:11:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.035+0000 7f979dc00640 1 --2- 172.21.15.151:0/2424798320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97980cf890 0x7f97980b4280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f97980ce5d0 tx=0x7f979002bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38b1b3d6d265be9a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.035+0000 7f9797400640 1 -- 172.21.15.151:0/2424798320 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790039070 con 0x7f97980cf890 2024-03-30T13:11:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.035+0000 7f9797400640 1 -- 172.21.15.151:0/2424798320 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979002cc80 con 0x7f97980cf890 2024-03-30T13:11:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.035+0000 7f9797400640 1 -- 172.21.15.151:0/2424798320 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790034660 con 0x7f97980cf890 2024-03-30T13:11:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.036+0000 7f979fc00640 1 -- 172.21.15.151:0/2424798320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97980cf890 msgr2=0x7f97980b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.036+0000 7f979fc00640 1 --2- 172.21.15.151:0/2424798320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97980cf890 0x7f97980b4280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f97980ce5d0 tx=0x7f979002bed0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.036+0000 7f979fc00640 1 -- 172.21.15.151:0/2424798320 shutdown_connections 2024-03-30T13:11:24.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.036+0000 7f979fc00640 1 --2- 172.21.15.151:0/2424798320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97980cf890 0x7f97980b4280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.036+0000 7f979fc00640 1 --2- 172.21.15.151:0/2424798320 >> v2:172.21.15.44:3300/0 conn(0x7f979815ec60 0x7f97980d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.036+0000 7f979fc00640 1 -- 172.21.15.151:0/2424798320 >> 172.21.15.151:0/2424798320 conn(0x7f97980cd310 msgr2=0x7f97980cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:24.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.036+0000 7f979fc00640 1 -- 172.21.15.151:0/2424798320 shutdown_connections 2024-03-30T13:11:24.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.036+0000 7f979fc00640 1 -- 172.21.15.151:0/2424798320 wait complete. 2024-03-30T13:11:24.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.038+0000 7f979fc00640 1 Processor -- start 2024-03-30T13:11:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.038+0000 7f979fc00640 1 -- start start 2024-03-30T13:11:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.039+0000 7f979fc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97980cf890 0x7f97980b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.039+0000 7f979fc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9798154fb0 0x7f97981544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.039+0000 7f979fc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f979815ec60 0x7f97980caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.039+0000 7f979fc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f97980cf370 con 0x7f979815ec60 2024-03-30T13:11:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.039+0000 7f979fc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97980cf090 con 0x7f9798154fb0 2024-03-30T13:11:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.039+0000 7f979fc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f9798155390 con 0x7f97980cf890 2024-03-30T13:11:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.039+0000 7f979d200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97980cf890 0x7f97980b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.039+0000 7f9797e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9798154fb0 0x7f97981544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.039+0000 7f979d200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97980cf890 0x7f97980b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:46294/0 (socket says 172.21.15.151:46294) 2024-03-30T13:11:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.039+0000 7f979d200640 1 -- 172.21.15.151:0/613153969 learned_addr learned my addr 172.21.15.151:0/613153969 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-03-30T13:11:24.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f979dc00640 1 --2- 172.21.15.151:0/613153969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f979815ec60 0x7f97980caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f979d200640 1 -- 172.21.15.151:0/613153969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9798154fb0 msgr2=0x7f97981544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f979d200640 1 --2- 172.21.15.151:0/613153969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9798154fb0 0x7f97981544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f979d200640 1 -- 172.21.15.151:0/613153969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f979815ec60 msgr2=0x7f97980caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f979d200640 1 --2- 172.21.15.151:0/613153969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f979815ec60 0x7f97980caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f979d200640 1 -- 172.21.15.151:0/613153969 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97980c9c90 con 0x7f97980cf890 2024-03-30T13:11:24.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f9797e00640 1 --2- 172.21.15.151:0/613153969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9798154fb0 0x7f97981544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f979d200640 1 --2- 172.21.15.151:0/613153969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97980cf890 0x7f97980b1f90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f978c00c430 tx=0x7f978c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f9794c00640 1 -- 172.21.15.151:0/613153969 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c017070 con 0x7f97980cf890 2024-03-30T13:11:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f9794c00640 1 -- 172.21.15.151:0/613153969 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c005ce0 con 0x7f97980cf890 2024-03-30T13:11:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f979fc00640 1 -- 172.21.15.151:0/613153969 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97980c9f70 con 0x7f97980cf890 2024-03-30T13:11:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f9794c00640 1 -- 172.21.15.151:0/613153969 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c0072f0 con 0x7f97980cf890 2024-03-30T13:11:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f979fc00640 1 -- 172.21.15.151:0/613153969 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97980ca530 con 0x7f97980cf890 2024-03-30T13:11:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.040+0000 7f9794c00640 1 -- 172.21.15.151:0/613153969 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f978c01a070 con 0x7f97980cf890 2024-03-30T13:11:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.041+0000 7f9794c00640 1 -- 172.21.15.151:0/613153969 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f978c007490 con 0x7f97980cf890 2024-03-30T13:11:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.042+0000 7f979fc00640 1 -- 172.21.15.151:0/613153969 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97980ca730 con 0x7f97980cf890 2024-03-30T13:11:24.052 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:24.042+0000 7fc558039040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:11:24.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.044+0000 7f9794c00640 1 -- 172.21.15.151:0/613153969 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f97980ca730 con 0x7f97980cf890 2024-03-30T13:11:24.081 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:24.077+0000 7fa0c3032040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-30T13:11:24.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.140+0000 7f979fc00640 1 -- 172.21.15.151:0/613153969 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1b3f2117-76b0-4720-ad67-b765e5e10603", "id": 7} v 0) -- 0x7f9798150280 con 0x7f97980cf890 2024-03-30T13:11:24.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.149+0000 7f9794c00640 1 -- 172.21.15.151:0/613153969 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b3f2117-76b0-4720-ad67-b765e5e10603", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f9798150280 con 0x7f97980cf890 2024-03-30T13:11:24.155 INFO:teuthology.orchestra.run.smithi151.stdout:7 2024-03-30T13:11:24.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.151+0000 7f979fc00640 1 -- 172.21.15.151:0/613153969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97980cf890 msgr2=0x7f97980b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.151+0000 7f979fc00640 1 --2- 172.21.15.151:0/613153969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97980cf890 0x7f97980b1f90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f978c00c430 tx=0x7f978c00c8f0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.151+0000 7f979fc00640 1 -- 172.21.15.151:0/613153969 shutdown_connections 2024-03-30T13:11:24.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.151+0000 7f979fc00640 1 --2- 172.21.15.151:0/613153969 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f979815ec60 0x7f97980caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.151+0000 7f979fc00640 1 --2- 172.21.15.151:0/613153969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9798154fb0 0x7f97981544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.151+0000 7f979fc00640 1 --2- 172.21.15.151:0/613153969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97980cf890 0x7f97980b1f90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.151+0000 7f979fc00640 1 -- 172.21.15.151:0/613153969 >> 172.21.15.151:0/613153969 conn(0x7f97980cd310 msgr2=0x7f9798071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:24.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.151+0000 7f979fc00640 1 -- 172.21.15.151:0/613153969 shutdown_connections 2024-03-30T13:11:24.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:11:24.151+0000 7f979fc00640 1 -- 172.21.15.151:0/613153969 wait complete. 2024-03-30T13:11:24.171 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-30T13:11:24.171 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-30T13:11:24.180 INFO:tasks.ceph.osd.0:Started 2024-03-30T13:11:24.180 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-30T13:11:24.180 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-30T13:11:24.189 INFO:tasks.ceph.osd.1:Started 2024-03-30T13:11:24.190 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-30T13:11:24.190 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-30T13:11:24.201 INFO:tasks.ceph.osd.2:Started 2024-03-30T13:11:24.202 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-30T13:11:24.202 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-30T13:11:24.210 INFO:tasks.ceph.osd.3:Started 2024-03-30T13:11:24.210 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-30T13:11:24.210 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-30T13:11:24.219 INFO:tasks.ceph.osd.4:Started 2024-03-30T13:11:24.220 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-30T13:11:24.220 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-30T13:11:24.227 INFO:tasks.ceph.osd.5:Started 2024-03-30T13:11:24.227 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-30T13:11:24.227 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-30T13:11:24.232 INFO:tasks.ceph.osd.6:Started 2024-03-30T13:11:24.232 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-30T13:11:24.232 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-30T13:11:24.242 INFO:tasks.ceph.osd.7:Started 2024-03-30T13:11:24.243 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:24.259 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:24.255+0000 7fc558039040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:11:24.266 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:24.260+0000 7fa0c3032040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-30T13:11:24.439 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:24.435+0000 7fa0c3032040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-30T13:11:24.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.483+0000 7fc545c00640 1 Processor -- start 2024-03-30T13:11:24.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.483+0000 7fc545c00640 1 -- start start 2024-03-30T13:11:24.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.484+0000 7fc545c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc540145090 0x7fc5400b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.484+0000 7fc545c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc540160540 0x7fc5400d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.484+0000 7fc545c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5400b5f80 con 0x7fc5400b5aa0 2024-03-30T13:11:24.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.484+0000 7fc545c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc5400b6260 con 0x7fc540145090 2024-03-30T13:11:24.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.484+0000 7fc545c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fc5400b6540 con 0x7fc540160540 2024-03-30T13:11:24.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.484+0000 7fc53ea00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc540145090 0x7fc5400b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.484+0000 7fc53ea00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc540145090 0x7fc5400b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33474/0 (socket says 172.21.15.44:33474) 2024-03-30T13:11:24.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.484+0000 7fc53ea00640 1 -- 172.21.15.44:0/4145387394 learned_addr learned my addr 172.21.15.44:0/4145387394 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:24.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.485+0000 7fc53f400640 1 --2- 172.21.15.44:0/4145387394 >> v2:172.21.15.151:3300/0 conn(0x7fc540160540 0x7fc5400d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.485+0000 7fc53ea00640 1 -- 172.21.15.44:0/4145387394 >> v2:172.21.15.151:3300/0 conn(0x7fc540160540 msgr2=0x7fc5400d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:24.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.485+0000 7fc53ea00640 1 --2- 172.21.15.44:0/4145387394 >> v2:172.21.15.151:3300/0 conn(0x7fc540160540 0x7fc5400d11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.485+0000 7fc53ea00640 1 -- 172.21.15.44:0/4145387394 >> v1:172.21.15.151:6789/0 conn(0x7fc5400b5aa0 legacy=0x7fc54015fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:24.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.485+0000 7fc53ea00640 1 -- 172.21.15.44:0/4145387394 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5400b6820 con 0x7fc540145090 2024-03-30T13:11:24.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.486+0000 7fc53ea00640 1 --2- 172.21.15.44:0/4145387394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc540145090 0x7fc5400b1720 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc5400d01e0 tx=0x7fc53002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e8eb7f45d8128c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:24.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.486+0000 7fc53e000640 1 -- 172.21.15.44:0/4145387394 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530035020 con 0x7fc540145090 2024-03-30T13:11:24.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.486+0000 7fc53e000640 1 -- 172.21.15.44:0/4145387394 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc530031870 con 0x7fc540145090 2024-03-30T13:11:24.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.486+0000 7fc53e000640 1 -- 172.21.15.44:0/4145387394 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc530031c40 con 0x7fc540145090 2024-03-30T13:11:24.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.487+0000 7fc545c00640 1 -- 172.21.15.44:0/4145387394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc540145090 msgr2=0x7fc5400b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.487+0000 7fc545c00640 1 --2- 172.21.15.44:0/4145387394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc540145090 0x7fc5400b1720 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc5400d01e0 tx=0x7fc53002b910 comp rx=0 tx=0).stop 2024-03-30T13:11:24.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.487+0000 7fc545c00640 1 -- 172.21.15.44:0/4145387394 shutdown_connections 2024-03-30T13:11:24.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.487+0000 7fc545c00640 1 --2- 172.21.15.44:0/4145387394 >> v2:172.21.15.151:3300/0 conn(0x7fc540160540 0x7fc5400d11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.487+0000 7fc545c00640 1 --2- 172.21.15.44:0/4145387394 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc540145090 0x7fc5400b1720 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.487+0000 7fc545c00640 1 -- 172.21.15.44:0/4145387394 >> 172.21.15.44:0/4145387394 conn(0x7fc54006f8b0 msgr2=0x7fc54006fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:24.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.487+0000 7fc545c00640 1 -- 172.21.15.44:0/4145387394 shutdown_connections 2024-03-30T13:11:24.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.487+0000 7fc545c00640 1 -- 172.21.15.44:0/4145387394 wait complete. 2024-03-30T13:11:24.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.489+0000 7fc545c00640 1 Processor -- start 2024-03-30T13:11:24.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.489+0000 7fc545c00640 1 -- start start 2024-03-30T13:11:24.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.490+0000 7fc545c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5400b5aa0 0x7fc54015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.490+0000 7fc545c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc540145090 0x7fc540153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.490+0000 7fc545c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc540160540 0x7fc5400afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:24.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.490+0000 7fc545c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc540145470 con 0x7fc540145090 2024-03-30T13:11:24.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.490+0000 7fc545c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc540146000 con 0x7fc5400b5aa0 2024-03-30T13:11:24.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.490+0000 7fc545c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc5401455f0 con 0x7fc540160540 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.490+0000 7fc537e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc540145090 0x7fc540153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.490+0000 7fc537e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc540145090 0x7fc540153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33486/0 (socket says 172.21.15.44:33486) 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.490+0000 7fc537e00640 1 -- 172.21.15.44:0/1661169918 learned_addr learned my addr 172.21.15.44:0/1661169918 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.490+0000 7fc53ea00640 1 --2- 172.21.15.44:0/1661169918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5400b5aa0 0x7fc54015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.490+0000 7fc53f400640 1 --2- 172.21.15.44:0/1661169918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc540160540 0x7fc5400afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.491+0000 7fc537e00640 1 -- 172.21.15.44:0/1661169918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc540160540 msgr2=0x7fc5400afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.491+0000 7fc537e00640 1 --2- 172.21.15.44:0/1661169918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc540160540 0x7fc5400afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.491+0000 7fc537e00640 1 -- 172.21.15.44:0/1661169918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5400b5aa0 msgr2=0x7fc54015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.491+0000 7fc537e00640 1 --2- 172.21.15.44:0/1661169918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5400b5aa0 0x7fc54015dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.491+0000 7fc537e00640 1 -- 172.21.15.44:0/1661169918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc540141850 con 0x7fc540145090 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.491+0000 7fc537e00640 1 --2- 172.21.15.44:0/1661169918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc540145090 0x7fc540153910 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc52800c440 tx=0x7fc52800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.491+0000 7fc536a00640 1 -- 172.21.15.44:0/1661169918 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5280052d0 con 0x7fc540145090 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.491+0000 7fc536a00640 1 -- 172.21.15.44:0/1661169918 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc528005470 con 0x7fc540145090 2024-03-30T13:11:24.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.491+0000 7fc545c00640 1 -- 172.21.15.44:0/1661169918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc540141b30 con 0x7fc540145090 2024-03-30T13:11:24.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.491+0000 7fc536a00640 1 -- 172.21.15.44:0/1661169918 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc528007260 con 0x7fc540145090 2024-03-30T13:11:24.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.491+0000 7fc545c00640 1 -- 172.21.15.44:0/1661169918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5401420f0 con 0x7fc540145090 2024-03-30T13:11:24.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.491+0000 7fc536a00640 1 -- 172.21.15.44:0/1661169918 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc528007400 con 0x7fc540145090 2024-03-30T13:11:24.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.492+0000 7fc536a00640 1 -- 172.21.15.44:0/1661169918 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc528003a00 con 0x7fc540145090 2024-03-30T13:11:24.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.492+0000 7fc545c00640 1 -- 172.21.15.44:0/1661169918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc540075a10 con 0x7fc540145090 2024-03-30T13:11:24.503 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:24.493+0000 7fa0c3032040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-30T13:11:24.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.495+0000 7fc536a00640 1 -- 172.21.15.44:0/1661169918 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc5280035f0 con 0x7fc540145090 2024-03-30T13:11:24.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.561+0000 7fc545c00640 1 -- 172.21.15.44:0/1661169918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5400d1ee0 con 0x7fc540145090 2024-03-30T13:11:24.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.562+0000 7fc536a00640 1 -- 172.21.15.44:0/1661169918 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc528003cd0 con 0x7fc540145090 2024-03-30T13:11:24.566 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:24.566 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":10,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:24.142223+0000","last_up_change":"0.000000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:24.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.563+0000 7fc545c00640 1 -- 172.21.15.44:0/1661169918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc540145090 msgr2=0x7fc540153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:24.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.563+0000 7fc545c00640 1 --2- 172.21.15.44:0/1661169918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc540145090 0x7fc540153910 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc52800c440 tx=0x7fc52800c900 comp rx=0 tx=0).stop 2024-03-30T13:11:24.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.563+0000 7fc545c00640 1 -- 172.21.15.44:0/1661169918 shutdown_connections 2024-03-30T13:11:24.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.563+0000 7fc545c00640 1 --2- 172.21.15.44:0/1661169918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc540160540 0x7fc5400afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.563+0000 7fc545c00640 1 --2- 172.21.15.44:0/1661169918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc540145090 0x7fc540153910 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.563+0000 7fc545c00640 1 --2- 172.21.15.44:0/1661169918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5400b5aa0 0x7fc54015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:24.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.563+0000 7fc545c00640 1 -- 172.21.15.44:0/1661169918 >> 172.21.15.44:0/1661169918 conn(0x7fc54006f8b0 msgr2=0x7fc5400d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:24.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.563+0000 7fc545c00640 1 -- 172.21.15.44:0/1661169918 shutdown_connections 2024-03-30T13:11:24.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:24.563+0000 7fc545c00640 1 -- 172.21.15.44:0/1661169918 wait complete. 2024-03-30T13:11:24.584 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-30T13:11:24.584 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-30T13:11:24.635 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:24.631+0000 7fa0c3032040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:11:24.753 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:24.748+0000 7fa0c3032040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-30T13:11:24.872 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-03-30T13:11:24.867+0000 7f777b60f640 -1 Falling back to public interface 2024-03-30T13:11:24.888 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-03-30T13:11:24.883+0000 7f3cf112a640 -1 Falling back to public interface 2024-03-30T13:11:24.901 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-03-30T13:11:24.897+0000 7f8e5daf5640 -1 Falling back to public interface 2024-03-30T13:11:24.913 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-03-30T13:11:24.910+0000 7f8e8e716640 -1 Falling back to public interface 2024-03-30T13:11:24.920 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-03-30T13:11:24.915+0000 7f50fcd6b640 -1 Falling back to public interface 2024-03-30T13:11:24.939 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:24.935+0000 7fa0c3032040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-30T13:11:24.940 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-03-30T13:11:24.937+0000 7f7b4d32a640 -1 Falling back to public interface 2024-03-30T13:11:24.945 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-03-30T13:11:24.941+0000 7f1fe8613640 -1 Falling back to public interface 2024-03-30T13:11:24.958 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-03-30T13:11:24.955+0000 7f214f547640 -1 Falling back to public interface 2024-03-30T13:11:24.993 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:24.988+0000 7fa0c3032040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-30T13:11:25.177 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:25.172+0000 7fa0c3032040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-30T13:11:25.376 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:25.373+0000 7fc558039040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:11:25.391 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:25.552 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.547+0000 7f714b600640 1 Processor -- start 2024-03-30T13:11:25.552 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.547+0000 7f714b600640 1 -- start start 2024-03-30T13:11:25.553 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.548+0000 7f714b600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f71440ae070 0x7f71440ae500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.553 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.548+0000 7f714b600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71440aea40 con 0x7f714415c6f0 2024-03-30T13:11:25.553 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.548+0000 7f714b600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71440b1360 con 0x7f714406b4c0 2024-03-30T13:11:25.553 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.549+0000 7f714b600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f71440b1f70 con 0x7f71440ae070 2024-03-30T13:11:25.553 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.549+0000 7f7148c00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f714415c6f0 0x7f71440b0b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59970/0 (socket says 172.21.15.44:59970) 2024-03-30T13:11:25.553 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.549+0000 7f7148c00640 1 -- 172.21.15.44:0/1253772515 learned_addr learned my addr 172.21.15.44:0/1253772515 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:25.554 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.549+0000 7f7149600640 1 --2- 172.21.15.44:0/1253772515 >> v2:172.21.15.151:3300/0 conn(0x7f71440ae070 0x7f71440ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.554 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.549+0000 7f7143400640 1 -- 172.21.15.44:0/1253772515 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 556065997 0 0) 0x7f71440aea40 con 0x7f714415c6f0 2024-03-30T13:11:25.554 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.549+0000 7f7143400640 1 -- 172.21.15.44:0/1253772515 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f712c003520 con 0x7f714415c6f0 2024-03-30T13:11:25.554 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.550+0000 7f7149600640 1 -- 172.21.15.44:0/1253772515 >> v1:172.21.15.151:6789/0 conn(0x7f714406b4c0 legacy=0x7f71440b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.554 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.550+0000 7f7149600640 1 -- 172.21.15.44:0/1253772515 >> v1:172.21.15.44:6789/0 conn(0x7f714415c6f0 legacy=0x7f71440b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.554 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.550+0000 7f7149600640 1 -- 172.21.15.44:0/1253772515 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71440b1640 con 0x7f71440ae070 2024-03-30T13:11:25.555 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.551+0000 7f7149600640 1 --2- 172.21.15.44:0/1253772515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71440ae070 0x7f71440ae500 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f713c009d90 tx=0x7f713c02bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9387ec54b33c3272 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.556 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.551+0000 7f7143400640 1 -- 172.21.15.44:0/1253772515 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c039070 con 0x7f71440ae070 2024-03-30T13:11:25.556 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.551+0000 7f7143400640 1 -- 172.21.15.44:0/1253772515 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713c02ccf0 con 0x7f71440ae070 2024-03-30T13:11:25.556 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.551+0000 7f7143400640 1 -- 172.21.15.44:0/1253772515 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c034640 con 0x7f71440ae070 2024-03-30T13:11:25.557 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.552+0000 7f714b600640 1 -- 172.21.15.44:0/1253772515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71440ae070 msgr2=0x7f71440ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.557 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.552+0000 7f714b600640 1 --2- 172.21.15.44:0/1253772515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71440ae070 0x7f71440ae500 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f713c009d90 tx=0x7f713c02bf40 comp rx=0 tx=0).stop 2024-03-30T13:11:25.557 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.552+0000 7f714b600640 1 -- 172.21.15.44:0/1253772515 shutdown_connections 2024-03-30T13:11:25.557 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.552+0000 7f714b600640 1 --2- 172.21.15.44:0/1253772515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71440ae070 0x7f71440ae500 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.557 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.552+0000 7f714b600640 1 -- 172.21.15.44:0/1253772515 >> 172.21.15.44:0/1253772515 conn(0x7f714409aa00 msgr2=0x7f71440b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:25.557 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.552+0000 7f714b600640 1 -- 172.21.15.44:0/1253772515 shutdown_connections 2024-03-30T13:11:25.557 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.552+0000 7f714b600640 1 -- 172.21.15.44:0/1253772515 wait complete. 2024-03-30T13:11:25.558 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.554+0000 7f714b600640 1 Processor -- start 2024-03-30T13:11:25.558 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.554+0000 7f714b600640 1 -- start start 2024-03-30T13:11:25.561 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f714b600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f714406b4c0 0x7f71441f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.561 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f714b600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71440ae070 0x7f714409ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.561 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f714b600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714415c6f0 0x7f71441f15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:25.561 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f714b600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f714415cad0 con 0x7f714415c6f0 2024-03-30T13:11:25.561 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f714b600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f71440b1c00 con 0x7f71440ae070 2024-03-30T13:11:25.561 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f714b600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f71440b2b10 con 0x7f714406b4c0 2024-03-30T13:11:25.561 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f7149600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714415c6f0 0x7f71441f15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.562 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f7149600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714415c6f0 0x7f71441f15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33496/0 (socket says 172.21.15.44:33496) 2024-03-30T13:11:25.562 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f7149600640 1 -- 172.21.15.44:0/3483691360 learned_addr learned my addr 172.21.15.44:0/3483691360 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:25.562 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f7148c00640 1 --2- 172.21.15.44:0/3483691360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f714406b4c0 0x7f71441f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.562 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f7143e00640 1 --2- 172.21.15.44:0/3483691360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71440ae070 0x7f714409ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:25.562 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f7149600640 1 -- 172.21.15.44:0/3483691360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f714406b4c0 msgr2=0x7f71441f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.562 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f7149600640 1 --2- 172.21.15.44:0/3483691360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f714406b4c0 0x7f71441f2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.562 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f7149600640 1 -- 172.21.15.44:0/3483691360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71440ae070 msgr2=0x7f714409ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.562 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f7149600640 1 --2- 172.21.15.44:0/3483691360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71440ae070 0x7f714409ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.563 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f7149600640 1 -- 172.21.15.44:0/3483691360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71441e1c40 con 0x7f714415c6f0 2024-03-30T13:11:25.563 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.555+0000 7f7148c00640 1 --2- 172.21.15.44:0/3483691360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f714406b4c0 0x7f71441f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:25.563 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.556+0000 7f7149600640 1 --2- 172.21.15.44:0/3483691360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714415c6f0 0x7f71441f15a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f713c037040 tx=0x7f713c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:25.563 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.556+0000 7f7140c00640 1 -- 172.21.15.44:0/3483691360 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c044020 con 0x7f714415c6f0 2024-03-30T13:11:25.563 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.556+0000 7f7140c00640 1 -- 172.21.15.44:0/3483691360 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f713c03a040 con 0x7f714415c6f0 2024-03-30T13:11:25.563 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.556+0000 7f714b600640 1 -- 172.21.15.44:0/3483691360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71440c6ca0 con 0x7f714415c6f0 2024-03-30T13:11:25.563 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.556+0000 7f7140c00640 1 -- 172.21.15.44:0/3483691360 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c039050 con 0x7f714415c6f0 2024-03-30T13:11:25.563 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.556+0000 7f714b600640 1 -- 172.21.15.44:0/3483691360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71440c7260 con 0x7f714415c6f0 2024-03-30T13:11:25.563 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.556+0000 7f7140c00640 1 -- 172.21.15.44:0/3483691360 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f713c003bd0 con 0x7f714415c6f0 2024-03-30T13:11:25.564 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.557+0000 7f7140c00640 1 -- 172.21.15.44:0/3483691360 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f713c03ece0 con 0x7f714415c6f0 2024-03-30T13:11:25.564 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.557+0000 7f714b600640 1 -- 172.21.15.44:0/3483691360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71440758d0 con 0x7f714415c6f0 2024-03-30T13:11:25.564 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.560+0000 7f7140c00640 1 -- 172.21.15.44:0/3483691360 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f713c04e060 con 0x7f714415c6f0 2024-03-30T13:11:25.635 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.627+0000 7f714b600640 1 -- 172.21.15.44:0/3483691360 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f714406f640 con 0x7f714415c6f0 2024-03-30T13:11:25.636 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.628+0000 7f7140c00640 1 -- 172.21.15.44:0/3483691360 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f713c004030 con 0x7f714415c6f0 2024-03-30T13:11:25.636 INFO:teuthology.misc.health.smithi044.stdout: 2024-03-30T13:11:25.636 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":10,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:24.142223+0000","last_up_change":"0.000000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:25.637 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.629+0000 7f714b600640 1 -- 172.21.15.44:0/3483691360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714415c6f0 msgr2=0x7f71441f15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:25.637 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.629+0000 7f714b600640 1 --2- 172.21.15.44:0/3483691360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714415c6f0 0x7f71441f15a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f713c037040 tx=0x7f713c004a40 comp rx=0 tx=0).stop 2024-03-30T13:11:25.637 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.629+0000 7f714b600640 1 -- 172.21.15.44:0/3483691360 shutdown_connections 2024-03-30T13:11:25.638 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.629+0000 7f714b600640 1 --2- 172.21.15.44:0/3483691360 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f714415c6f0 0x7f71441f15a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.638 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.629+0000 7f714b600640 1 --2- 172.21.15.44:0/3483691360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71440ae070 0x7f714409ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.638 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.629+0000 7f714b600640 1 --2- 172.21.15.44:0/3483691360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f714406b4c0 0x7f71441f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:25.638 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.629+0000 7f714b600640 1 -- 172.21.15.44:0/3483691360 >> 172.21.15.44:0/3483691360 conn(0x7f714409aa00 msgr2=0x7f714406fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:25.638 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.629+0000 7f714b600640 1 -- 172.21.15.44:0/3483691360 shutdown_connections 2024-03-30T13:11:25.638 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:25.629+0000 7f714b600640 1 -- 172.21.15.44:0/3483691360 wait complete. 2024-03-30T13:11:25.647 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-30T13:11:25.721 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:25.717+0000 7fc558039040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:11:25.785 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:25.781+0000 7fc558039040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:11:25.916 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:25.912+0000 7fc558039040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:11:26.306 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:26.301+0000 7fa0c3032040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-30T13:11:26.633 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:26.628+0000 7fa0c3032040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-30T13:11:26.697 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:26.692+0000 7fa0c3032040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-30T13:11:26.833 INFO:tasks.ceph.mgr.y.smithi044.stderr:2024-03-30T13:11:26.829+0000 7fa0c3032040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-30T13:11:26.967 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:26.963+0000 7fc4f8800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-30T13:11:26.967 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-03-30T13:11:26.964+0000 7fc4f8800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-30T13:11:28.419 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-03-30T13:11:28.415+0000 7f8e5daf5640 -1 osd.5 0 log_to_monitors true 2024-03-30T13:11:28.467 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-03-30T13:11:28.463+0000 7f8e8e716640 -1 osd.7 0 log_to_monitors true 2024-03-30T13:11:28.487 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-03-30T13:11:28.483+0000 7f214f547640 -1 osd.6 0 log_to_monitors true 2024-03-30T13:11:28.497 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-03-30T13:11:28.493+0000 7f50fcd6b640 -1 osd.2 0 log_to_monitors true 2024-03-30T13:11:28.702 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-03-30T13:11:28.697+0000 7f777b60f640 -1 osd.1 0 log_to_monitors true 2024-03-30T13:11:28.720 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-03-30T13:11:28.715+0000 7f3cf112a640 -1 osd.0 0 log_to_monitors true 2024-03-30T13:11:28.728 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-03-30T13:11:28.725+0000 7f7b4d32a640 -1 osd.4 0 log_to_monitors true 2024-03-30T13:11:28.780 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-03-30T13:11:28.776+0000 7f1fe8613640 -1 osd.3 0 log_to_monitors true 2024-03-30T13:11:29.453 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:11:29.460 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:11:30.775 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-03-30T13:11:30.771+0000 7f50f8600640 -1 osd.2 0 waiting for initial osdmap 2024-03-30T13:11:30.782 INFO:tasks.ceph.osd.2.smithi044.stderr:2024-03-30T13:11:30.777+0000 7f50edc00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:11:31.786 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-03-30T13:11:31.781+0000 7f214a400640 -1 osd.6 0 waiting for initial osdmap 2024-03-30T13:11:31.796 INFO:tasks.ceph.osd.6.smithi151.stderr:2024-03-30T13:11:31.793+0000 7f2140400640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:11:31.859 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-03-30T13:11:31.856+0000 7f8e89600640 -1 osd.7 0 waiting for initial osdmap 2024-03-30T13:11:31.868 INFO:tasks.ceph.osd.7.smithi151.stderr:2024-03-30T13:11:31.864+0000 7f8e7f600640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:11:31.903 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-03-30T13:11:31.900+0000 7f8e58a00640 -1 osd.5 0 waiting for initial osdmap 2024-03-30T13:11:31.910 INFO:tasks.ceph.osd.5.smithi151.stderr:2024-03-30T13:11:31.907+0000 7f8e4ea00640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:11:32.238 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-03-30T13:11:32.235+0000 7f7b48200640 -1 osd.4 0 waiting for initial osdmap 2024-03-30T13:11:32.250 INFO:tasks.ceph.osd.4.smithi151.stderr:2024-03-30T13:11:32.247+0000 7f7b3e200640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:11:32.453 DEBUG:teuthology.orchestra.run.smithi044:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:32.671 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-03-30T13:11:32.665+0000 7f7775e00640 -1 osd.1 0 waiting for initial osdmap 2024-03-30T13:11:32.675 INFO:tasks.ceph.osd.1.smithi044.stderr:2024-03-30T13:11:32.671+0000 7f776be00640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:11:32.681 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.677+0000 7f7210800640 1 Processor -- start 2024-03-30T13:11:32.682 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.677+0000 7f7210800640 1 -- start start 2024-03-30T13:11:32.684 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.678+0000 7f7210800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72080b3870 0x7f72080d3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.684 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.678+0000 7f7210800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f72080b5f90 0x7f72080b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.684 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.678+0000 7f7210800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f720815ec90 con 0x7f720815e8b0 2024-03-30T13:11:32.684 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.678+0000 7f7210800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f72080d3690 con 0x7f72080b5f90 2024-03-30T13:11:32.684 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.678+0000 7f7210800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f72080ced00 con 0x7f72080b3870 2024-03-30T13:11:32.684 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.679+0000 7f720e800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f72080b5f90 0x7f72080b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.684 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.679+0000 7f720e800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f72080b5f90 0x7f72080b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40400/0 (socket says 172.21.15.44:40400) 2024-03-30T13:11:32.684 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.679+0000 7f720e800640 1 -- 172.21.15.44:0/3215594016 learned_addr learned my addr 172.21.15.44:0/3215594016 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:32.684 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.679+0000 7f720d400640 1 --2- 172.21.15.44:0/3215594016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72080b3870 0x7f72080d3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.684 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.679+0000 7f720e800640 1 -- 172.21.15.44:0/3215594016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72080b3870 msgr2=0x7f72080d3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:32.684 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.679+0000 7f720e800640 1 --2- 172.21.15.44:0/3215594016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72080b3870 0x7f72080d3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.685 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.679+0000 7f720e800640 1 -- 172.21.15.44:0/3215594016 >> v1:172.21.15.151:6789/0 conn(0x7f720815e8b0 legacy=0x7f72080cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.685 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.679+0000 7f720e800640 1 -- 172.21.15.44:0/3215594016 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72080cefe0 con 0x7f72080b5f90 2024-03-30T13:11:32.685 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.680+0000 7f720e800640 1 --2- 172.21.15.44:0/3215594016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72080b5f90 0x7f72080b6420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7204009e80 tx=0x7f720402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6822c508e4e242aa server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:32.685 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.681+0000 7f720ca00640 1 -- 172.21.15.44:0/3215594016 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f720402ca50 con 0x7f72080b5f90 2024-03-30T13:11:32.686 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.681+0000 7f720ca00640 1 -- 172.21.15.44:0/3215594016 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f720402cbf0 con 0x7f72080b5f90 2024-03-30T13:11:32.686 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.681+0000 7f720ca00640 1 -- 172.21.15.44:0/3215594016 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72040343f0 con 0x7f72080b5f90 2024-03-30T13:11:32.686 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.681+0000 7f7210800640 1 -- 172.21.15.44:0/3215594016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72080b5f90 msgr2=0x7f72080b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.686 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.681+0000 7f7210800640 1 --2- 172.21.15.44:0/3215594016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72080b5f90 0x7f72080b6420 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7204009e80 tx=0x7f720402beb0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.687 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.682+0000 7f7210800640 1 -- 172.21.15.44:0/3215594016 shutdown_connections 2024-03-30T13:11:32.687 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.682+0000 7f7210800640 1 --2- 172.21.15.44:0/3215594016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72080b5f90 0x7f72080b6420 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.687 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.682+0000 7f7210800640 1 --2- 172.21.15.44:0/3215594016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72080b3870 0x7f72080d3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.687 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.682+0000 7f7210800640 1 -- 172.21.15.44:0/3215594016 >> 172.21.15.44:0/3215594016 conn(0x7f720808bf90 msgr2=0x7f72080d4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:32.687 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.682+0000 7f7210800640 1 -- 172.21.15.44:0/3215594016 shutdown_connections 2024-03-30T13:11:32.687 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.682+0000 7f7210800640 1 -- 172.21.15.44:0/3215594016 wait complete. 2024-03-30T13:11:32.688 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.683+0000 7f7210800640 1 Processor -- start 2024-03-30T13:11:32.688 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.684+0000 7f7210800640 1 -- start start 2024-03-30T13:11:32.688 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.684+0000 7f7210800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72080b3870 0x7f72080cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.689 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.684+0000 7f7210800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72080b5f90 0x7f7208147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.690 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.684+0000 7f7210800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f720815e8b0 0x7f7208147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.690 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.684+0000 7f7210800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f72080d4e50 con 0x7f72080b5f90 2024-03-30T13:11:32.690 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.684+0000 7f7210800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f72080cfef0 con 0x7f72080b3870 2024-03-30T13:11:32.690 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.684+0000 7f7210800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f720806c300 con 0x7f720815e8b0 2024-03-30T13:11:32.690 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.685+0000 7f720d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72080b5f90 0x7f7208147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.690 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.685+0000 7f720d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72080b5f90 0x7f7208147890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40412/0 (socket says 172.21.15.44:40412) 2024-03-30T13:11:32.690 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.685+0000 7f720d400640 1 -- 172.21.15.44:0/3046024478 learned_addr learned my addr 172.21.15.44:0/3046024478 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:32.690 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.685+0000 7f720de00640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72080b3870 0x7f72080cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.691 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.685+0000 7f720e800640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f720815e8b0 0x7f7208147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.691 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.685+0000 7f720d400640 1 -- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f720815e8b0 msgr2=0x7f7208147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.691 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.685+0000 7f720d400640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f720815e8b0 0x7f7208147dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.691 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.685+0000 7f720d400640 1 -- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72080b3870 msgr2=0x7f72080cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.691 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.685+0000 7f720d400640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72080b3870 0x7f72080cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.691 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.685+0000 7f720d400640 1 -- 172.21.15.44:0/3046024478 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72080cc630 con 0x7f72080b5f90 2024-03-30T13:11:32.691 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.685+0000 7f720de00640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72080b3870 0x7f72080cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:32.691 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.685+0000 7f720e800640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f720815e8b0 0x7f7208147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:32.691 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.686+0000 7f720d400640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72080b5f90 0x7f7208147890 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f71f800d800 tx=0x7f71f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:32.692 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.686+0000 7f7202000640 1 -- 172.21.15.44:0/3046024478 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f800b660 con 0x7f72080b5f90 2024-03-30T13:11:32.692 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.686+0000 7f7202000640 1 -- 172.21.15.44:0/3046024478 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71f8019070 con 0x7f72080b5f90 2024-03-30T13:11:32.692 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.686+0000 7f7210800640 1 -- 172.21.15.44:0/3046024478 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72080cc910 con 0x7f72080b5f90 2024-03-30T13:11:32.692 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.686+0000 7f7202000640 1 -- 172.21.15.44:0/3046024478 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f800ba20 con 0x7f72080b5f90 2024-03-30T13:11:32.692 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.687+0000 7f7210800640 1 -- 172.21.15.44:0/3046024478 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72080cced0 con 0x7f72080b5f90 2024-03-30T13:11:32.692 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.688+0000 7f7210800640 1 -- 172.21.15.44:0/3046024478 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72080758d0 con 0x7f72080b5f90 2024-03-30T13:11:32.694 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.689+0000 7f7202000640 1 -- 172.21.15.44:0/3046024478 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 90800+0+0 (secure 0 0 0) 0x7f71f800bbc0 con 0x7f72080b5f90 2024-03-30T13:11:32.695 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.691+0000 7f7202000640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f71ec06c4f0 0x7f71ec06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:32.696 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.691+0000 7f7202000640 1 -- 172.21.15.44:0/3046024478 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f71f808b840 con 0x7f72080b5f90 2024-03-30T13:11:32.696 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.691+0000 7f720de00640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f71ec06c4f0 0x7f71ec06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:32.697 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.692+0000 7f720de00640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f71ec06c4f0 0x7f71ec06e9b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f71fc001660 tx=0x7f71fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:32.701 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.696+0000 7f7202000640 1 -- 172.21.15.44:0/3046024478 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f71f805ac30 con 0x7f72080b5f90 2024-03-30T13:11:32.710 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-03-30T13:11:32.706+0000 7f3cec000640 -1 osd.0 0 waiting for initial osdmap 2024-03-30T13:11:32.718 INFO:tasks.ceph.osd.0.smithi044.stderr:2024-03-30T13:11:32.712+0000 7f3ce2000640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:11:32.724 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-03-30T13:11:32.720+0000 7f1fe2e00640 -1 osd.3 0 waiting for initial osdmap 2024-03-30T13:11:32.739 INFO:tasks.ceph.osd.3.smithi044.stderr:2024-03-30T13:11:32.734+0000 7f1fd8e00640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-30T13:11:32.923 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.918+0000 7f7210800640 1 -- 172.21.15.44:0/3046024478 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72080b6510 con 0x7f72080b5f90 2024-03-30T13:11:32.924 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.920+0000 7f7202000640 1 -- 172.21.15.44:0/3046024478 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10908 (secure 0 0 0) 0x7f71f805a530 con 0x7f72080b5f90 2024-03-30T13:11:32.924 INFO:teuthology.misc.health.smithi044.stdout: 2024-03-30T13:11:32.924 INFO:teuthology.misc.health.smithi044.stdout:{"epoch":15,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:32.802509+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:32.927 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.922+0000 7f7210800640 1 -- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f71ec06c4f0 msgr2=0x7f71ec06e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.927 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.922+0000 7f7210800640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f71ec06c4f0 0x7f71ec06e9b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f71fc001660 tx=0x7f71fc009040 comp rx=0 tx=0).stop 2024-03-30T13:11:32.927 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.922+0000 7f7210800640 1 -- 172.21.15.44:0/3046024478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72080b5f90 msgr2=0x7f7208147890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:32.927 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.922+0000 7f7210800640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72080b5f90 0x7f7208147890 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f71f800d800 tx=0x7f71f800dcc0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.927 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.922+0000 7f7210800640 1 -- 172.21.15.44:0/3046024478 shutdown_connections 2024-03-30T13:11:32.927 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.922+0000 7f7210800640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f720815e8b0 0x7f7208147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.927 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.922+0000 7f7210800640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f72080b5f90 0x7f7208147890 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.927 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.922+0000 7f7210800640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f71ec06c4f0 0x7f71ec06e9b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.927 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.922+0000 7f7210800640 1 --2- 172.21.15.44:0/3046024478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72080b3870 0x7f72080cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:32.928 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.922+0000 7f7210800640 1 -- 172.21.15.44:0/3046024478 >> 172.21.15.44:0/3046024478 conn(0x7f720808bf90 msgr2=0x7f72080b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:32.928 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.922+0000 7f7210800640 1 -- 172.21.15.44:0/3046024478 shutdown_connections 2024-03-30T13:11:32.928 INFO:teuthology.misc.health.smithi044.stderr:2024-03-30T13:11:32.922+0000 7f7210800640 1 -- 172.21.15.44:0/3046024478 wait complete. 2024-03-30T13:11:32.940 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-30T13:11:32.940 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-30T13:11:32.940 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-30T13:11:32.940 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-30T13:11:32.946 INFO:tasks.ceph.mds.a:Started 2024-03-30T13:11:32.946 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-30T13:11:32.946 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-30T13:11:32.952 INFO:tasks.ceph.mds.c:Started 2024-03-30T13:11:32.952 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-30T13:11:32.952 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-30T13:11:32.960 INFO:tasks.ceph.mds.b:Started 2024-03-30T13:11:32.960 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-30T13:11:32.960 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-30T13:11:32.967 INFO:tasks.ceph.mds.d:Started 2024-03-30T13:11:32.967 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-30T13:11:32.967 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:33.093 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-03-30T13:11:33.097 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-03-30T13:11:33.116 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2024-03-30T13:11:33.122 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2024-03-30T13:11:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.148+0000 7f3a2b200640 1 Processor -- start 2024-03-30T13:11:33.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.148+0000 7f3a2b200640 1 -- start start 2024-03-30T13:11:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.149+0000 7f3a2b200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3a2415e4f0 0x7f3a240cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.149+0000 7f3a2b200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a240b9d20 con 0x7f3a240b79c0 2024-03-30T13:11:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.149+0000 7f3a2b200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a240ba000 con 0x7f3a240b7530 2024-03-30T13:11:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.149+0000 7f3a2b200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f3a240ba2e0 con 0x7f3a2415e4f0 2024-03-30T13:11:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a29200640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3a240b79c0 0x7f3a240d3d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59288/0 (socket says 172.21.15.44:59288) 2024-03-30T13:11:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a29200640 1 -- 172.21.15.44:0/1687363349 learned_addr learned my addr 172.21.15.44:0/1687363349 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a23e00640 1 --2- 172.21.15.44:0/1687363349 >> v2:172.21.15.151:3300/0 conn(0x7f3a2415e4f0 0x7f3a240cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3206282800 0 0) 0x7f3a240b9d20 con 0x7f3a240b79c0 2024-03-30T13:11:33.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a08003520 con 0x7f3a240b79c0 2024-03-30T13:11:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 974802508 0 0) 0x7f3a240ba000 con 0x7f3a240b7530 2024-03-30T13:11:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a240b9d20 con 0x7f3a240b7530 2024-03-30T13:11:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 109963561 0 0) 0x7f3a08003520 con 0x7f3a240b79c0 2024-03-30T13:11:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 >> v2:172.21.15.151:3300/0 conn(0x7f3a2415e4f0 msgr2=0x7f3a240cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a23400640 1 --2- 172.21.15.44:0/1687363349 >> v2:172.21.15.151:3300/0 conn(0x7f3a2415e4f0 0x7f3a240cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 >> v1:172.21.15.151:6789/0 conn(0x7f3a240b7530 legacy=0x7f3a240d29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a240ceaf0 con 0x7f3a240b79c0 2024-03-30T13:11:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f3a1c001670 con 0x7f3a240b79c0 2024-03-30T13:11:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.150+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 >> v1:172.21.15.44:6789/0 conn(0x7f3a240b79c0 legacy=0x7f3a240d3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a23400640 1 --2- 172.21.15.44:0/1687363349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a08003b40 0x7f3a08003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a23400640 1 --2- 172.21.15.44:0/1687363349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a08004800 0x7f3a08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a23400640 1 --2- 172.21.15.44:0/1687363349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a080051c0 0x7f3a0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3a240ba2e0 con 0x7f3a08004800 2024-03-30T13:11:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0800c0f0 con 0x7f3a080051c0 2024-03-30T13:11:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3a0800c2f0 con 0x7f3a08003b40 2024-03-30T13:11:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a23e00640 1 --2- 172.21.15.44:0/1687363349 >> v2:172.21.15.151:3300/0 conn(0x7f3a2415e4f0 0x7f3a240cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:11:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a1b400640 1 --2- 172.21.15.44:0/1687363349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a08004800 0x7f3a08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a29200640 1 --2- 172.21.15.44:0/1687363349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a080051c0 0x7f3a0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a23e00640 1 --2- 172.21.15.44:0/1687363349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a08003b40 0x7f3a08003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a1b400640 1 -- 172.21.15.44:0/1687363349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a08003b40 msgr2=0x7f3a08003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a1b400640 1 --2- 172.21.15.44:0/1687363349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a08003b40 0x7f3a08003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a1b400640 1 -- 172.21.15.44:0/1687363349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a080051c0 msgr2=0x7f3a0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a1b400640 1 --2- 172.21.15.44:0/1687363349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a080051c0 0x7f3a0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a1b400640 1 -- 172.21.15.44:0/1687363349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a08003520 con 0x7f3a08004800 2024-03-30T13:11:33.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.151+0000 7f3a29200640 1 -- 172.21.15.44:0/1687363349 reap_dead start 2024-03-30T13:11:33.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.152+0000 7f3a1b400640 1 --2- 172.21.15.44:0/1687363349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a08004800 0x7f3a08004c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0018d0 tx=0x7f3a08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534ab3e0cda57e13 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.152+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c037070 con 0x7f3a08004800 2024-03-30T13:11:33.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.152+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a0c0052d0 con 0x7f3a08004800 2024-03-30T13:11:33.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.152+0000 7f3a23400640 1 -- 172.21.15.44:0/1687363349 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c0014f0 con 0x7f3a08004800 2024-03-30T13:11:33.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.153+0000 7f3a2b200640 1 -- 172.21.15.44:0/1687363349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a08004800 msgr2=0x7f3a08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.153+0000 7f3a2b200640 1 --2- 172.21.15.44:0/1687363349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a08004800 0x7f3a08004c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0018d0 tx=0x7f3a08005830 comp rx=0 tx=0).stop 2024-03-30T13:11:33.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.153+0000 7f3a2b200640 1 -- 172.21.15.44:0/1687363349 shutdown_connections 2024-03-30T13:11:33.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.153+0000 7f3a2b200640 1 --2- 172.21.15.44:0/1687363349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a08004800 0x7f3a08004c80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.153+0000 7f3a2b200640 1 -- 172.21.15.44:0/1687363349 >> 172.21.15.44:0/1687363349 conn(0x7f3a240676e0 msgr2=0x7f3a24067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:33.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.153+0000 7f3a2b200640 1 -- 172.21.15.44:0/1687363349 shutdown_connections 2024-03-30T13:11:33.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.153+0000 7f3a2b200640 1 -- 172.21.15.44:0/1687363349 wait complete. 2024-03-30T13:11:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.155+0000 7f3a2b200640 1 Processor -- start 2024-03-30T13:11:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.155+0000 7f3a2b200640 1 -- start start 2024-03-30T13:11:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a2b200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a08004800 0x7f3a2414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a2b200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a240d3ca0 0x7f3a240d4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a2b200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a2414d3c0 0x7f3a2414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a2b200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3a240cf5e0 con 0x7f3a240d3ca0 2024-03-30T13:11:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a2b200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3a240cf460 con 0x7f3a2414d3c0 2024-03-30T13:11:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a2b200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3a240cf760 con 0x7f3a08004800 2024-03-30T13:11:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a1b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a240d3ca0 0x7f3a240d4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a1b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a240d3ca0 0x7f3a240d4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40460/0 (socket says 172.21.15.44:40460) 2024-03-30T13:11:33.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a1b400640 1 -- 172.21.15.44:0/3633538138 learned_addr learned my addr 172.21.15.44:0/3633538138 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a23e00640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a08004800 0x7f3a2414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a29200640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a2414d3c0 0x7f3a2414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a1b400640 1 -- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a08004800 msgr2=0x7f3a2414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a1b400640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a08004800 0x7f3a2414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a1b400640 1 -- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a2414d3c0 msgr2=0x7f3a2414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a1b400640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a2414d3c0 0x7f3a2414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a1b400640 1 -- 172.21.15.44:0/3633538138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a241f7a70 con 0x7f3a240d3ca0 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.156+0000 7f3a29200640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a2414d3c0 0x7f3a2414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.157+0000 7f3a1b400640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a240d3ca0 0x7f3a240d4100 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c035040 tx=0x7f3a0c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.157+0000 7f3a20c00640 1 -- 172.21.15.44:0/3633538138 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c042020 con 0x7f3a240d3ca0 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.157+0000 7f3a20c00640 1 -- 172.21.15.44:0/3633538138 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a0c038040 con 0x7f3a240d3ca0 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.157+0000 7f3a20c00640 1 -- 172.21.15.44:0/3633538138 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c037070 con 0x7f3a240d3ca0 2024-03-30T13:11:33.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.157+0000 7f3a2b200640 1 -- 172.21.15.44:0/3633538138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a241f7d50 con 0x7f3a240d3ca0 2024-03-30T13:11:33.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.157+0000 7f3a2b200640 1 -- 172.21.15.44:0/3633538138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a241f8310 con 0x7f3a240d3ca0 2024-03-30T13:11:33.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.158+0000 7f3a2b200640 1 -- 172.21.15.44:0/3633538138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a240d4640 con 0x7f3a240d3ca0 2024-03-30T13:11:33.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.159+0000 7f3a20c00640 1 -- 172.21.15.44:0/3633538138 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 90800+0+0 (secure 0 0 0) 0x7f3a0c045020 con 0x7f3a240d3ca0 2024-03-30T13:11:33.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.160+0000 7f3a20c00640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a0006c4a0 0x7f3a0006e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.160+0000 7f3a20c00640 1 -- 172.21.15.44:0/3633538138 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4471+0+0 (secure 0 0 0) 0x7f3a0c0ac7c0 con 0x7f3a240d3ca0 2024-03-30T13:11:33.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.160+0000 7f3a23e00640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a0006c4a0 0x7f3a0006e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.161+0000 7f3a23e00640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a0006c4a0 0x7f3a0006e960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3a240511f0 tx=0x7f3a1400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.165+0000 7f3a20c00640 1 -- 172.21.15.44:0/3633538138 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3a0c04c030 con 0x7f3a240d3ca0 2024-03-30T13:11:33.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.361+0000 7f3a2b200640 1 -- 172.21.15.44:0/3633538138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a24075a10 con 0x7f3a240d3ca0 2024-03-30T13:11:33.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.362+0000 7f3a20c00640 1 -- 172.21.15.44:0/3633538138 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10908 (secure 0 0 0) 0x7f3a0c07b2f0 con 0x7f3a240d3ca0 2024-03-30T13:11:33.366 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:33.367 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":15,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:32.802509+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:33.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.365+0000 7f3a2b200640 1 -- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a0006c4a0 msgr2=0x7f3a0006e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.365+0000 7f3a2b200640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a0006c4a0 0x7f3a0006e960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3a240511f0 tx=0x7f3a1400b040 comp rx=0 tx=0).stop 2024-03-30T13:11:33.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.365+0000 7f3a2b200640 1 -- 172.21.15.44:0/3633538138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a240d3ca0 msgr2=0x7f3a240d4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.365+0000 7f3a2b200640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a240d3ca0 0x7f3a240d4100 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c035040 tx=0x7f3a0c0012d0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.365+0000 7f3a2b200640 1 -- 172.21.15.44:0/3633538138 shutdown_connections 2024-03-30T13:11:33.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.365+0000 7f3a2b200640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a0006c4a0 0x7f3a0006e960 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.365+0000 7f3a2b200640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a2414d3c0 0x7f3a2414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.365+0000 7f3a2b200640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a240d3ca0 0x7f3a240d4100 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.365+0000 7f3a2b200640 1 --2- 172.21.15.44:0/3633538138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a08004800 0x7f3a2414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.365+0000 7f3a2b200640 1 -- 172.21.15.44:0/3633538138 >> 172.21.15.44:0/3633538138 conn(0x7f3a240676e0 msgr2=0x7f3a240cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:33.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.365+0000 7f3a2b200640 1 -- 172.21.15.44:0/3633538138 shutdown_connections 2024-03-30T13:11:33.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.365+0000 7f3a2b200640 1 -- 172.21.15.44:0/3633538138 wait complete. 2024-03-30T13:11:33.388 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-03-30T13:11:33.389 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:33.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.587+0000 7fe433200640 1 Processor -- start 2024-03-30T13:11:33.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.587+0000 7fe433200640 1 -- start start 2024-03-30T13:11:33.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.589+0000 7fe433200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe434144970 0x7fe4340b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.589+0000 7fe433200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe4340d0360 0x7fe4340d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.589+0000 7fe433200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4340716a0 con 0x7fe4340b3d50 2024-03-30T13:11:33.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.589+0000 7fe433200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fe4340d0d10 con 0x7fe4340d0360 2024-03-30T13:11:33.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.589+0000 7fe433200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe434071980 con 0x7fe434144970 2024-03-30T13:11:33.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.589+0000 7fe431e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe434144970 0x7fe4340b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.590+0000 7fe431e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe434144970 0x7fe4340b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:43096/0 (socket says 172.21.15.44:43096) 2024-03-30T13:11:33.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.590+0000 7fe431e00640 1 -- 172.21.15.44:0/211765558 learned_addr learned my addr 172.21.15.44:0/211765558 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:33.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.590+0000 7fe432800640 1 --2- 172.21.15.44:0/211765558 >> v2:172.21.15.151:3300/0 conn(0x7fe4340d0360 0x7fe4340d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.590+0000 7fe431e00640 1 -- 172.21.15.44:0/211765558 >> v2:172.21.15.151:3300/0 conn(0x7fe4340d0360 msgr2=0x7fe4340d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:33.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.590+0000 7fe431e00640 1 --2- 172.21.15.44:0/211765558 >> v2:172.21.15.151:3300/0 conn(0x7fe4340d0360 0x7fe4340d07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.590+0000 7fe431e00640 1 -- 172.21.15.44:0/211765558 >> v1:172.21.15.151:6789/0 conn(0x7fe4340b3d50 legacy=0x7fe4340cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.590+0000 7fe431e00640 1 -- 172.21.15.44:0/211765558 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe434071c60 con 0x7fe434144970 2024-03-30T13:11:33.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.590+0000 7fe430a00640 1 -- 172.21.15.44:0/211765558 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697686725 0 0) 0x7fe4340716a0 con 0x7fe4340b3d50 2024-03-30T13:11:33.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.592+0000 7fe431e00640 1 --2- 172.21.15.44:0/211765558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe434144970 0x7fe4340b3810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe424009870 tx=0x7fe42402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec93ccdc04c2080 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.592+0000 7fe430a00640 1 -- 172.21.15.44:0/211765558 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424035020 con 0x7fe434144970 2024-03-30T13:11:33.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.592+0000 7fe430a00640 1 -- 172.21.15.44:0/211765558 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe424031640 con 0x7fe434144970 2024-03-30T13:11:33.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.592+0000 7fe430a00640 1 -- 172.21.15.44:0/211765558 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42402d040 con 0x7fe434144970 2024-03-30T13:11:33.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.593+0000 7fe433200640 1 -- 172.21.15.44:0/211765558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe434144970 msgr2=0x7fe4340b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.593+0000 7fe433200640 1 --2- 172.21.15.44:0/211765558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe434144970 0x7fe4340b3810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe424009870 tx=0x7fe42402b8f0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.593+0000 7fe433200640 1 -- 172.21.15.44:0/211765558 shutdown_connections 2024-03-30T13:11:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.593+0000 7fe433200640 1 --2- 172.21.15.44:0/211765558 >> v2:172.21.15.151:3300/0 conn(0x7fe4340d0360 0x7fe4340d07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.593+0000 7fe433200640 1 --2- 172.21.15.44:0/211765558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe434144970 0x7fe4340b3810 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.593+0000 7fe433200640 1 -- 172.21.15.44:0/211765558 >> 172.21.15.44:0/211765558 conn(0x7fe43406b9a0 msgr2=0x7fe43406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.593+0000 7fe433200640 1 -- 172.21.15.44:0/211765558 shutdown_connections 2024-03-30T13:11:33.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.593+0000 7fe433200640 1 -- 172.21.15.44:0/211765558 wait complete. 2024-03-30T13:11:33.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.595+0000 7fe433200640 1 Processor -- start 2024-03-30T13:11:33.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.595+0000 7fe433200640 1 -- start start 2024-03-30T13:11:33.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.596+0000 7fe433200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4340b3d50 0x7fe4340c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.596+0000 7fe433200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4340d0360 0x7fe43415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.596+0000 7fe433200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe434144970 0x7fe43415dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe433200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe434144d50 con 0x7fe4340d0360 2024-03-30T13:11:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe433200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe434072220 con 0x7fe4340b3d50 2024-03-30T13:11:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe433200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe4340cde10 con 0x7fe434144970 2024-03-30T13:11:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe431400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4340d0360 0x7fe43415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe431400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4340d0360 0x7fe43415d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40476/0 (socket says 172.21.15.44:40476) 2024-03-30T13:11:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe431400640 1 -- 172.21.15.44:0/2401108066 learned_addr learned my addr 172.21.15.44:0/2401108066 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe431e00640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4340b3d50 0x7fe4340c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe432800640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe434144970 0x7fe43415dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe431400640 1 -- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe434144970 msgr2=0x7fe43415dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe431400640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe434144970 0x7fe43415dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe431400640 1 -- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4340b3d50 msgr2=0x7fe4340c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe431400640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4340b3d50 0x7fe4340c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.597+0000 7fe431400640 1 -- 172.21.15.44:0/2401108066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe434136520 con 0x7fe4340d0360 2024-03-30T13:11:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.598+0000 7fe431400640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4340d0360 0x7fe43415d6b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe42000c3c0 tx=0x7fe42000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.598+0000 7fe42a000640 1 -- 172.21.15.44:0/2401108066 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420017070 con 0x7fe4340d0360 2024-03-30T13:11:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.598+0000 7fe42a000640 1 -- 172.21.15.44:0/2401108066 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4200035f0 con 0x7fe4340d0360 2024-03-30T13:11:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.598+0000 7fe433200640 1 -- 172.21.15.44:0/2401108066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe434136800 con 0x7fe4340d0360 2024-03-30T13:11:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.598+0000 7fe42a000640 1 -- 172.21.15.44:0/2401108066 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4200039e0 con 0x7fe4340d0360 2024-03-30T13:11:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.598+0000 7fe433200640 1 -- 172.21.15.44:0/2401108066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe434136dc0 con 0x7fe4340d0360 2024-03-30T13:11:33.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.599+0000 7fe433200640 1 -- 172.21.15.44:0/2401108066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4340ccd20 con 0x7fe4340d0360 2024-03-30T13:11:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.600+0000 7fe42a000640 1 -- 172.21.15.44:0/2401108066 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 90800+0+0 (secure 0 0 0) 0x7fe42001a070 con 0x7fe4340d0360 2024-03-30T13:11:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.601+0000 7fe42a000640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe41406c4a0 0x7fe41406e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:33.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.601+0000 7fe42a000640 1 -- 172.21.15.44:0/2401108066 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4471+0+0 (secure 0 0 0) 0x7fe42008a470 con 0x7fe4340d0360 2024-03-30T13:11:33.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.602+0000 7fe431e00640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe41406c4a0 0x7fe41406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:33.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.603+0000 7fe431e00640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe41406c4a0 0x7fe41406e960 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe424036000 tx=0x7fe42403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:33.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.606+0000 7fe42a000640 1 -- 172.21.15.44:0/2401108066 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe4340ccd20 con 0x7fe4340d0360 2024-03-30T13:11:33.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.843+0000 7fe433200640 1 -- 172.21.15.44:0/2401108066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe434075890 con 0x7fe4340d0360 2024-03-30T13:11:33.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.844+0000 7fe42a000640 1 -- 172.21.15.44:0/2401108066 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fe4200588d0 con 0x7fe4340d0360 2024-03-30T13:11:33.849 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:33.849 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1458748329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1458748329},{"type":"v1","addr":"172.21.15.44:6834","nonce":1458748329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-30T13:11:33.849 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 2 2024-03-30T13:11:33.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.847+0000 7fe433200640 1 -- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe41406c4a0 msgr2=0x7fe41406e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.847+0000 7fe433200640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe41406c4a0 0x7fe41406e960 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe424036000 tx=0x7fe42403c040 comp rx=0 tx=0).stop 2024-03-30T13:11:33.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.847+0000 7fe433200640 1 -- 172.21.15.44:0/2401108066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4340d0360 msgr2=0x7fe43415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:33.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.847+0000 7fe433200640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4340d0360 0x7fe43415d6b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe42000c3c0 tx=0x7fe42000c880 comp rx=0 tx=0).stop 2024-03-30T13:11:33.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.847+0000 7fe433200640 1 -- 172.21.15.44:0/2401108066 shutdown_connections 2024-03-30T13:11:33.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.847+0000 7fe433200640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe434144970 0x7fe43415dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.847+0000 7fe433200640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe4340d0360 0x7fe43415d6b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.847+0000 7fe433200640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe41406c4a0 0x7fe41406e960 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.847+0000 7fe433200640 1 --2- 172.21.15.44:0/2401108066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4340b3d50 0x7fe4340c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:33.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.847+0000 7fe433200640 1 -- 172.21.15.44:0/2401108066 >> 172.21.15.44:0/2401108066 conn(0x7fe43406b9a0 msgr2=0x7fe4340b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:33.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.847+0000 7fe433200640 1 -- 172.21.15.44:0/2401108066 shutdown_connections 2024-03-30T13:11:33.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:33.847+0000 7fe433200640 1 -- 172.21.15.44:0/2401108066 wait complete. 2024-03-30T13:11:35.869 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:36.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.094+0000 7f0183400640 1 Processor -- start 2024-03-30T13:11:36.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.094+0000 7f0183400640 1 -- start start 2024-03-30T13:11:36.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.095+0000 7f0183400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f017c0d4a90 0x7f017c0d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.096+0000 7f0183400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017c0d36f0 con 0x7f017c15e950 2024-03-30T13:11:36.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.096+0000 7f0183400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017c0d39d0 con 0x7f017c0d2f00 2024-03-30T13:11:36.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.096+0000 7f0183400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f017c0d3cb0 con 0x7f017c0d4a90 2024-03-30T13:11:36.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.096+0000 7f0180a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f017c15e950 0x7f017c0d4380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59304/0 (socket says 172.21.15.44:59304) 2024-03-30T13:11:36.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.096+0000 7f0180a00640 1 -- 172.21.15.44:0/3507398810 learned_addr learned my addr 172.21.15.44:0/3507398810 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:36.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.096+0000 7f017be00640 1 --2- 172.21.15.44:0/3507398810 >> v2:172.21.15.44:3300/0 conn(0x7f017c0d4a90 0x7f017c0d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.096+0000 7f017be00640 1 -- 172.21.15.44:0/3507398810 >> v1:172.21.15.151:6789/0 conn(0x7f017c0d2f00 legacy=0x7f017c0b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.096+0000 7f017be00640 1 -- 172.21.15.44:0/3507398810 >> v1:172.21.15.44:6789/0 conn(0x7f017c15e950 legacy=0x7f017c0d4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.096+0000 7f017be00640 1 -- 172.21.15.44:0/3507398810 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c0b7ac0 con 0x7f017c0d4a90 2024-03-30T13:11:36.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.097+0000 7f017be00640 1 --2- 172.21.15.44:0/3507398810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f017c0d4a90 0x7f017c0d29c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01680097a0 tx=0x7f016802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1656656cac3e7c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.098+0000 7f017b400640 1 -- 172.21.15.44:0/3507398810 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168034070 con 0x7f017c0d4a90 2024-03-30T13:11:36.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.098+0000 7f017b400640 1 -- 172.21.15.44:0/3507398810 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0168030610 con 0x7f017c0d4a90 2024-03-30T13:11:36.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.098+0000 7f017b400640 1 -- 172.21.15.44:0/3507398810 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01680309e0 con 0x7f017c0d4a90 2024-03-30T13:11:36.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.099+0000 7f0183400640 1 -- 172.21.15.44:0/3507398810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f017c0d4a90 msgr2=0x7f017c0d29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.099+0000 7f0183400640 1 --2- 172.21.15.44:0/3507398810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f017c0d4a90 0x7f017c0d29c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01680097a0 tx=0x7f016802b960 comp rx=0 tx=0).stop 2024-03-30T13:11:36.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.099+0000 7f0183400640 1 -- 172.21.15.44:0/3507398810 shutdown_connections 2024-03-30T13:11:36.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.099+0000 7f0183400640 1 --2- 172.21.15.44:0/3507398810 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f017c0d4a90 0x7f017c0d29c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.099+0000 7f0183400640 1 -- 172.21.15.44:0/3507398810 >> 172.21.15.44:0/3507398810 conn(0x7f017c0676e0 msgr2=0x7f017c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.099+0000 7f0183400640 1 -- 172.21.15.44:0/3507398810 shutdown_connections 2024-03-30T13:11:36.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.099+0000 7f0183400640 1 -- 172.21.15.44:0/3507398810 wait complete. 2024-03-30T13:11:36.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.101+0000 7f0183400640 1 Processor -- start 2024-03-30T13:11:36.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.101+0000 7f0183400640 1 -- start start 2024-03-30T13:11:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.102+0000 7f0183400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f017c0d2f00 0x7f017c15af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.102+0000 7f0183400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f017c0d4a90 0x7f017c0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.102+0000 7f0183400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f017c15e950 0x7f017c0b88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.102+0000 7f0183400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f017c15ed30 con 0x7f017c15e950 2024-03-30T13:11:36.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.102+0000 7f0183400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f017c0d33b0 con 0x7f017c0d2f00 2024-03-30T13:11:36.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.102+0000 7f0183400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f017c15eeb0 con 0x7f017c0d4a90 2024-03-30T13:11:36.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.103+0000 7f0181400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f017c15e950 0x7f017c0b88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.103+0000 7f0181400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f017c15e950 0x7f017c0b88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40496/0 (socket says 172.21.15.44:40496) 2024-03-30T13:11:36.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.103+0000 7f0181400640 1 -- 172.21.15.44:0/1732677800 learned_addr learned my addr 172.21.15.44:0/1732677800 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:36.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.103+0000 7f017be00640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f017c0d4a90 0x7f017c0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.103+0000 7f0180a00640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f017c0d2f00 0x7f017c15af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.103+0000 7f0181400640 1 -- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f017c0d4a90 msgr2=0x7f017c0ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.103+0000 7f0181400640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f017c0d4a90 0x7f017c0ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.103+0000 7f0181400640 1 -- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f017c0d2f00 msgr2=0x7f017c15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.103+0000 7f0181400640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f017c0d2f00 0x7f017c15af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.103+0000 7f0181400640 1 -- 172.21.15.44:0/1732677800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c1f8570 con 0x7f017c15e950 2024-03-30T13:11:36.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.103+0000 7f0181400640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f017c15e950 0x7f017c0b88a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f017400c7b0 tx=0x7f017400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.104+0000 7f0178c00640 1 -- 172.21.15.44:0/1732677800 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0174004b60 con 0x7f017c15e950 2024-03-30T13:11:36.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.104+0000 7f0178c00640 1 -- 172.21.15.44:0/1732677800 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0174004d00 con 0x7f017c15e950 2024-03-30T13:11:36.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.104+0000 7f0183400640 1 -- 172.21.15.44:0/1732677800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017c1f8850 con 0x7f017c15e950 2024-03-30T13:11:36.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.104+0000 7f0178c00640 1 -- 172.21.15.44:0/1732677800 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017400aa90 con 0x7f017c15e950 2024-03-30T13:11:36.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.104+0000 7f0183400640 1 -- 172.21.15.44:0/1732677800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f017c1f8e10 con 0x7f017c15e950 2024-03-30T13:11:36.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.105+0000 7f0183400640 1 -- 172.21.15.44:0/1732677800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f017c075a10 con 0x7f017c15e950 2024-03-30T13:11:36.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.106+0000 7f0178c00640 1 -- 172.21.15.44:0/1732677800 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 90800+0+0 (secure 0 0 0) 0x7f017400ac30 con 0x7f017c15e950 2024-03-30T13:11:36.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.107+0000 7f0178c00640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f015c06c4a0 0x7f015c06e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.107+0000 7f0178c00640 1 -- 172.21.15.44:0/1732677800 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f017408b560 con 0x7f017c15e950 2024-03-30T13:11:36.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.108+0000 7f0180a00640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f015c06c4a0 0x7f015c06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.109+0000 7f0180a00640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f015c06c4a0 0x7f015c06e960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0170000f60 tx=0x7f0170009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.113+0000 7f0178c00640 1 -- 172.21.15.44:0/1732677800 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0174020070 con 0x7f017c15e950 2024-03-30T13:11:36.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.361+0000 7f0183400640 1 -- 172.21.15.44:0/1732677800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f017c15deb0 con 0x7f017c15e950 2024-03-30T13:11:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.362+0000 7f0178c00640 1 -- 172.21.15.44:0/1732677800 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3867 (secure 0 0 0) 0x7f0174059fa0 con 0x7f017c15e950 2024-03-30T13:11:36.367 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:36.367 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1458748329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1458748329},{"type":"v1","addr":"172.21.15.44:6834","nonce":1458748329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3921281718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3921281718},{"type":"v1","addr":"172.21.15.151:6837","nonce":3921281718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2065829800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2065829800},{"type":"v1","addr":"172.21.15.44:6835","nonce":2065829800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/456394190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":456394190},{"type":"v1","addr":"172.21.15.151:6835","nonce":456394190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-30T13:11:36.367 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 3 2024-03-30T13:11:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.364+0000 7f0183400640 1 -- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f015c06c4a0 msgr2=0x7f015c06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.364+0000 7f0183400640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f015c06c4a0 0x7f015c06e960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0170000f60 tx=0x7f0170009040 comp rx=0 tx=0).stop 2024-03-30T13:11:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.364+0000 7f0183400640 1 -- 172.21.15.44:0/1732677800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f017c15e950 msgr2=0x7f017c0b88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.364+0000 7f0183400640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f017c15e950 0x7f017c0b88a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f017400c7b0 tx=0x7f017400cc70 comp rx=0 tx=0).stop 2024-03-30T13:11:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.365+0000 7f0183400640 1 -- 172.21.15.44:0/1732677800 shutdown_connections 2024-03-30T13:11:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.365+0000 7f0183400640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f017c15e950 0x7f017c0b88a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.365+0000 7f0183400640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f017c0d4a90 0x7f017c0ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.365+0000 7f0183400640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f015c06c4a0 0x7f015c06e960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.365+0000 7f0183400640 1 --2- 172.21.15.44:0/1732677800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f017c0d2f00 0x7f017c15af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.365+0000 7f0183400640 1 -- 172.21.15.44:0/1732677800 >> 172.21.15.44:0/1732677800 conn(0x7f017c0676e0 msgr2=0x7f017c0cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.365+0000 7f0183400640 1 -- 172.21.15.44:0/1732677800 shutdown_connections 2024-03-30T13:11:36.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.365+0000 7f0183400640 1 -- 172.21.15.44:0/1732677800 wait complete. 2024-03-30T13:11:36.391 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:36.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.591+0000 7faed7c00640 1 Processor -- start 2024-03-30T13:11:36.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.591+0000 7faed7c00640 1 -- start start 2024-03-30T13:11:36.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.592+0000 7faed7c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faed015c2a0 0x7faed006b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.592+0000 7faed7c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faed006f130 0x7faed00b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.592+0000 7faed7c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faed015c680 con 0x7faed015ed30 2024-03-30T13:11:36.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.592+0000 7faed7c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7faed006bef0 con 0x7faed006f130 2024-03-30T13:11:36.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.592+0000 7faed7c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7faed006c1d0 con 0x7faed015c2a0 2024-03-30T13:11:36.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.593+0000 7faecfe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7faed015ed30 0x7faed006ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:59316/0 (socket says 172.21.15.44:59316) 2024-03-30T13:11:36.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.593+0000 7faecfe00640 1 -- 172.21.15.44:0/3385359837 learned_addr learned my addr 172.21.15.44:0/3385359837 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:36.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.593+0000 7faed5200640 1 --2- 172.21.15.44:0/3385359837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faed015c2a0 0x7faed006b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.593+0000 7faed5c00640 1 --2- 172.21.15.44:0/3385359837 >> v2:172.21.15.151:3300/0 conn(0x7faed006f130 0x7faed00b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.593+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4167806013 0 0) 0x7faed015c680 con 0x7faed015ed30 2024-03-30T13:11:36.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.593+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeb8003520 con 0x7faed015ed30 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1472329784 0 0) 0x7faeb8003520 con 0x7faed015ed30 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faed015c2a0 msgr2=0x7faed006b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 --2- 172.21.15.44:0/3385359837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faed015c2a0 0x7faed006b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 >> v2:172.21.15.151:3300/0 conn(0x7faed006f130 msgr2=0x7faed00b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 --2- 172.21.15.44:0/3385359837 >> v2:172.21.15.151:3300/0 conn(0x7faed006f130 0x7faed00b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed006c4b0 con 0x7faed015ed30 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7faebc001670 con 0x7faed015ed30 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 >> v1:172.21.15.44:6789/0 conn(0x7faed015ed30 legacy=0x7faed006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 --2- 172.21.15.44:0/3385359837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faed015c2a0 0x7faeb80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 --2- 172.21.15.44:0/3385359837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faeb8003f30 0x7faeb8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 --2- 172.21.15.44:0/3385359837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb8004d40 0x7faeb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faed006bef0 con 0x7faeb8004d40 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faed006c1d0 con 0x7faeb8003f30 2024-03-30T13:11:36.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7faeb800bb50 con 0x7faed015c2a0 2024-03-30T13:11:36.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faed5c00640 1 --2- 172.21.15.44:0/3385359837 >> v2:172.21.15.151:3300/0 conn(0x7faed006f130 0x7faed00b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:36.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.594+0000 7faed5c00640 1 --2- 172.21.15.44:0/3385359837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb8004d40 0x7faeb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.595+0000 7faed5200640 1 --2- 172.21.15.44:0/3385359837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faed015c2a0 0x7faeb80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.595+0000 7faecfe00640 1 --2- 172.21.15.44:0/3385359837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faeb8003f30 0x7faeb8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.595+0000 7faed5c00640 1 -- 172.21.15.44:0/3385359837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faed015c2a0 msgr2=0x7faeb80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.595+0000 7faed5c00640 1 --2- 172.21.15.44:0/3385359837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faed015c2a0 0x7faeb80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.595+0000 7faed5c00640 1 -- 172.21.15.44:0/3385359837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faeb8003f30 msgr2=0x7faeb8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:36.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.595+0000 7faed5c00640 1 --2- 172.21.15.44:0/3385359837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faeb8003f30 0x7faeb8004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.595+0000 7faed5c00640 1 -- 172.21.15.44:0/3385359837 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb8003520 con 0x7faeb8004d40 2024-03-30T13:11:36.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.596+0000 7faed5c00640 1 --2- 172.21.15.44:0/3385359837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb8004d40 0x7faeb80051c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faed00b2630 tx=0x7faeb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41e86ef8fe24544 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.596+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8039070 con 0x7faeb8004d40 2024-03-30T13:11:36.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.596+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec802cd60 con 0x7faeb8004d40 2024-03-30T13:11:36.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.596+0000 7faecf400640 1 -- 172.21.15.44:0/3385359837 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8009c70 con 0x7faeb8004d40 2024-03-30T13:11:36.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.597+0000 7faed7c00640 1 -- 172.21.15.44:0/3385359837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb8004d40 msgr2=0x7faeb80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.597+0000 7faed7c00640 1 --2- 172.21.15.44:0/3385359837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faeb8004d40 0x7faeb80051c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faed00b2630 tx=0x7faeb8005830 comp rx=0 tx=0).stop 2024-03-30T13:11:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.597+0000 7faed5c00640 1 -- 172.21.15.44:0/3385359837 reap_dead start 2024-03-30T13:11:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.597+0000 7faed7c00640 1 -- 172.21.15.44:0/3385359837 shutdown_connections 2024-03-30T13:11:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.597+0000 7faed7c00640 1 -- 172.21.15.44:0/3385359837 >> 172.21.15.44:0/3385359837 conn(0x7faed00d0af0 msgr2=0x7faed00d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.597+0000 7faed7c00640 1 -- 172.21.15.44:0/3385359837 shutdown_connections 2024-03-30T13:11:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.597+0000 7faed7c00640 1 -- 172.21.15.44:0/3385359837 wait complete. 2024-03-30T13:11:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.599+0000 7faed7c00640 1 Processor -- start 2024-03-30T13:11:36.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.599+0000 7faed7c00640 1 -- start start 2024-03-30T13:11:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.600+0000 7faed7c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faeb8004d40 0x7faed0149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.600+0000 7faed7c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faed01f4690 0x7faed00cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.600+0000 7faed7c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faed01591d0 0x7faed0159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.600+0000 7faed7c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faed006b700 con 0x7faed01f4690 2024-03-30T13:11:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.600+0000 7faed7c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faed006b580 con 0x7faed01591d0 2024-03-30T13:11:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.600+0000 7faed7c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7faed006b880 con 0x7faeb8004d40 2024-03-30T13:11:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faecfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faed01f4690 0x7faed00cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faecfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faed01f4690 0x7faed00cd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40528/0 (socket says 172.21.15.44:40528) 2024-03-30T13:11:36.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faecfe00640 1 -- 172.21.15.44:0/3970435778 learned_addr learned my addr 172.21.15.44:0/3970435778 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:36.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faed5200640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faeb8004d40 0x7faed0149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faecfe00640 1 -- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faeb8004d40 msgr2=0x7faed0149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faecfe00640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faeb8004d40 0x7faed0149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faecfe00640 1 -- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faed01591d0 msgr2=0x7faed0159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faecfe00640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faed01591d0 0x7faed0159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faecfe00640 1 -- 172.21.15.44:0/3970435778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed01f4c40 con 0x7faed01f4690 2024-03-30T13:11:36.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faecfe00640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faed01f4690 0x7faed00cd480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faebc00d840 tx=0x7faebc00dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faeccc00640 1 -- 172.21.15.44:0/3970435778 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc019070 con 0x7faed01f4690 2024-03-30T13:11:36.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faeccc00640 1 -- 172.21.15.44:0/3970435778 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faebc0074e0 con 0x7faed01f4690 2024-03-30T13:11:36.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.601+0000 7faed7c00640 1 -- 172.21.15.44:0/3970435778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed01f4f20 con 0x7faed01f4690 2024-03-30T13:11:36.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.602+0000 7faeccc00640 1 -- 172.21.15.44:0/3970435778 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc004a20 con 0x7faed01f4690 2024-03-30T13:11:36.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.602+0000 7faed7c00640 1 -- 172.21.15.44:0/3970435778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed01f54e0 con 0x7faed01f4690 2024-03-30T13:11:36.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.603+0000 7faed7c00640 1 -- 172.21.15.44:0/3970435778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed0075a10 con 0x7faed01f4690 2024-03-30T13:11:36.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.604+0000 7faeccc00640 1 -- 172.21.15.44:0/3970435778 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 90800+0+0 (secure 0 0 0) 0x7faebc01c070 con 0x7faed01f4690 2024-03-30T13:11:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.604+0000 7faeccc00640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faeb006c4d0 0x7faeb006e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:36.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.605+0000 7faeccc00640 1 -- 172.21.15.44:0/3970435778 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7faebc08ac90 con 0x7faed01f4690 2024-03-30T13:11:36.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.609+0000 7faeccc00640 1 -- 172.21.15.44:0/3970435778 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7faebc0596d0 con 0x7faed01f4690 2024-03-30T13:11:36.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.611+0000 7faed5200640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faeb006c4d0 0x7faeb006e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:36.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.612+0000 7faed5200640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faeb006c4d0 0x7faeb006e990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faec4009a10 tx=0x7faec4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:36.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.824+0000 7faed7c00640 1 -- 172.21.15.44:0/3970435778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faed00b51a0 con 0x7faed01f4690 2024-03-30T13:11:36.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.826+0000 7faeccc00640 1 -- 172.21.15.44:0/3970435778 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12873 (secure 0 0 0) 0x7faebc058fd0 con 0x7faed01f4690 2024-03-30T13:11:36.830 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:36.830 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":18,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:35.894928+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.828+0000 7faed7c00640 1 -- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faeb006c4d0 msgr2=0x7faeb006e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.828+0000 7faed7c00640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faeb006c4d0 0x7faeb006e990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faec4009a10 tx=0x7faec4008040 comp rx=0 tx=0).stop 2024-03-30T13:11:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.828+0000 7faed7c00640 1 -- 172.21.15.44:0/3970435778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faed01f4690 msgr2=0x7faed00cd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.828+0000 7faed7c00640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faed01f4690 0x7faed00cd480 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faebc00d840 tx=0x7faebc00dd00 comp rx=0 tx=0).stop 2024-03-30T13:11:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.828+0000 7faed7c00640 1 -- 172.21.15.44:0/3970435778 shutdown_connections 2024-03-30T13:11:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.828+0000 7faed7c00640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faeb006c4d0 0x7faeb006e990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.828+0000 7faed7c00640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faed01591d0 0x7faed0159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.828+0000 7faed7c00640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faed01f4690 0x7faed00cd480 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.828+0000 7faed7c00640 1 --2- 172.21.15.44:0/3970435778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faeb8004d40 0x7faed0149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:36.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.829+0000 7faed7c00640 1 -- 172.21.15.44:0/3970435778 >> 172.21.15.44:0/3970435778 conn(0x7faed00d0af0 msgr2=0x7faed00b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:36.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.829+0000 7faed7c00640 1 -- 172.21.15.44:0/3970435778 shutdown_connections 2024-03-30T13:11:36.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:36.829+0000 7faed7c00640 1 -- 172.21.15.44:0/3970435778 wait complete. 2024-03-30T13:11:36.849 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:11:36.850 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:37.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.047+0000 7fbbd4a00640 1 Processor -- start 2024-03-30T13:11:37.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.048+0000 7fbbd4a00640 1 -- start start 2024-03-30T13:11:37.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.049+0000 7fbbd4a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd00acd60 0x7fbbd0072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.049+0000 7fbbd4a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd00ad2e0 con 0x7fbbd006e980 2024-03-30T13:11:37.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.049+0000 7fbbd4a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd00716a0 con 0x7fbbd00ae9d0 2024-03-30T13:11:37.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.049+0000 7fbbd4a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd00ad5c0 con 0x7fbbd00acd60 2024-03-30T13:11:37.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.049+0000 7fbbce800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbbd006e980 0x7fbbd015d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49946/0 (socket says 172.21.15.44:49946) 2024-03-30T13:11:37.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.049+0000 7fbbce800640 1 -- 172.21.15.44:0/840344269 learned_addr learned my addr 172.21.15.44:0/840344269 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbc7e00640 1 --2- 172.21.15.44:0/840344269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd00acd60 0x7fbbd0072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1685576852 0 0) 0x7fbbd00ad2e0 con 0x7fbbd006e980 2024-03-30T13:11:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbb4003520 con 0x7fbbd006e980 2024-03-30T13:11:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1102596348 0 0) 0x7fbbb4003520 con 0x7fbbd006e980 2024-03-30T13:11:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd00acd60 msgr2=0x7fbbd0072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 --2- 172.21.15.44:0/840344269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd00acd60 0x7fbbd0072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 >> v1:172.21.15.151:6789/0 conn(0x7fbbd00ae9d0 legacy=0x7fbbd00aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd0071980 con 0x7fbbd006e980 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fbbc0001670 con 0x7fbbd006e980 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 >> v1:172.21.15.44:6789/0 conn(0x7fbbd006e980 legacy=0x7fbbd015d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 --2- 172.21.15.44:0/840344269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbb40039e0 0x7fbbb4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 --2- 172.21.15.44:0/840344269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbb4004390 0x7fbbb4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 --2- 172.21.15.44:0/840344269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd00acd60 0x7fbbb4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb400ba70 con 0x7fbbb40039e0 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.050+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbbb400bbf0 con 0x7fbbb4004390 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.051+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fbbb400bdf0 con 0x7fbbd00acd60 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.051+0000 7fbbce800640 1 --2- 172.21.15.44:0/840344269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbb40039e0 0x7fbbb4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.051+0000 7fbbc7e00640 1 --2- 172.21.15.44:0/840344269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbb4004390 0x7fbbb4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.051+0000 7fbbcf200640 1 --2- 172.21.15.44:0/840344269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd00acd60 0x7fbbb4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.051+0000 7fbbce800640 1 -- 172.21.15.44:0/840344269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd00acd60 msgr2=0x7fbbb4005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.051+0000 7fbbce800640 1 --2- 172.21.15.44:0/840344269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd00acd60 0x7fbbb4005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.051+0000 7fbbce800640 1 -- 172.21.15.44:0/840344269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbb4004390 msgr2=0x7fbbb4004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:37.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.051+0000 7fbbce800640 1 --2- 172.21.15.44:0/840344269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbb4004390 0x7fbbb4004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.051+0000 7fbbce800640 1 -- 172.21.15.44:0/840344269 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbb4003520 con 0x7fbbb40039e0 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.052+0000 7fbbce800640 1 --2- 172.21.15.44:0/840344269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbb40039e0 0x7fbbb4003dc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c240 tx=0x7fbbb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2829338031440f7e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.052+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0007d30 con 0x7fbbb40039e0 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.053+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc0030070 con 0x7fbbb40039e0 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.053+0000 7fbbcde00640 1 -- 172.21.15.44:0/840344269 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc002cd60 con 0x7fbbb40039e0 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.053+0000 7fbbd4a00640 1 -- 172.21.15.44:0/840344269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbb40039e0 msgr2=0x7fbbb4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.053+0000 7fbbd4a00640 1 --2- 172.21.15.44:0/840344269 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbb40039e0 0x7fbbb4003dc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c240 tx=0x7fbbb4005830 comp rx=0 tx=0).stop 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.053+0000 7fbbcf200640 1 -- 172.21.15.44:0/840344269 reap_dead start 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.053+0000 7fbbd4a00640 1 -- 172.21.15.44:0/840344269 shutdown_connections 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.053+0000 7fbbd4a00640 1 -- 172.21.15.44:0/840344269 >> 172.21.15.44:0/840344269 conn(0x7fbbd00cfd90 msgr2=0x7fbbd00d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.053+0000 7fbbd4a00640 1 -- 172.21.15.44:0/840344269 shutdown_connections 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.054+0000 7fbbd4a00640 1 -- 172.21.15.44:0/840344269 wait complete. 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.055+0000 7fbbd4a00640 1 Processor -- start 2024-03-30T13:11:37.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.055+0000 7fbbd4a00640 1 -- start start 2024-03-30T13:11:37.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.056+0000 7fbbd4a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb40039e0 0x7fbbd014d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.056+0000 7fbbd4a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0159420 0x7fbbd00c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.056+0000 7fbbd4a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbd014e2d0 0x7fbbd015a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.056+0000 7fbbd4a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd0072180 con 0x7fbbd014e2d0 2024-03-30T13:11:37.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.056+0000 7fbbd4a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd0071450 con 0x7fbbd0159420 2024-03-30T13:11:37.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.056+0000 7fbbd4a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd0072300 con 0x7fbbb40039e0 2024-03-30T13:11:37.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbcf200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbd014e2d0 0x7fbbd015a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbcf200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbd014e2d0 0x7fbbd015a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49438/0 (socket says 172.21.15.44:49438) 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbcf200640 1 -- 172.21.15.44:0/3481680945 learned_addr learned my addr 172.21.15.44:0/3481680945 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbce800640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb40039e0 0x7fbbd014d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbc7e00640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0159420 0x7fbbd00c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbcf200640 1 -- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb40039e0 msgr2=0x7fbbd014d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbcf200640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb40039e0 0x7fbbd014d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbcf200640 1 -- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0159420 msgr2=0x7fbbd00c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbcf200640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0159420 0x7fbbd00c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbcf200640 1 -- 172.21.15.44:0/3481680945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd00b3160 con 0x7fbbd014e2d0 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbc7e00640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0159420 0x7fbbd00c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbce800640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb40039e0 0x7fbbd014d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.057+0000 7fbbcf200640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbd014e2d0 0x7fbbd015a9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00aedb0 tx=0x7fbbc800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.058+0000 7fbbc6a00640 1 -- 172.21.15.44:0/3481680945 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8003970 con 0x7fbbd014e2d0 2024-03-30T13:11:37.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.058+0000 7fbbc6a00640 1 -- 172.21.15.44:0/3481680945 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc8018070 con 0x7fbbd014e2d0 2024-03-30T13:11:37.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.058+0000 7fbbc6a00640 1 -- 172.21.15.44:0/3481680945 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8003d50 con 0x7fbbd014e2d0 2024-03-30T13:11:37.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.058+0000 7fbbd4a00640 1 -- 172.21.15.44:0/3481680945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd00b3440 con 0x7fbbd014e2d0 2024-03-30T13:11:37.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.058+0000 7fbbd4a00640 1 -- 172.21.15.44:0/3481680945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbd00b3a00 con 0x7fbbd014e2d0 2024-03-30T13:11:37.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.059+0000 7fbbd4a00640 1 -- 172.21.15.44:0/3481680945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbd0075890 con 0x7fbbd014e2d0 2024-03-30T13:11:37.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.060+0000 7fbbc6a00640 1 -- 172.21.15.44:0/3481680945 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 90800+0+0 (secure 0 0 0) 0x7fbbc80050d0 con 0x7fbbd014e2d0 2024-03-30T13:11:37.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.062+0000 7fbbc6a00640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbbac06c4f0 0x7fbbac06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.062+0000 7fbbc6a00640 1 -- 172.21.15.44:0/3481680945 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fbbc808afe0 con 0x7fbbd014e2d0 2024-03-30T13:11:37.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.062+0000 7fbbce800640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbbac06c4f0 0x7fbbac06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.063+0000 7fbbce800640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbbac06c4f0 0x7fbbac06e9b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0034000 tx=0x7fbbc0009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.067+0000 7fbbc6a00640 1 -- 172.21.15.44:0/3481680945 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fbbc8059aa0 con 0x7fbbd014e2d0 2024-03-30T13:11:37.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.285+0000 7fbbd4a00640 1 -- 172.21.15.44:0/3481680945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbbd00cd700 con 0x7fbbd014e2d0 2024-03-30T13:11:37.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.285+0000 7fbbc6a00640 1 -- 172.21.15.44:0/3481680945 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7fbbc80593a0 con 0x7fbbd014e2d0 2024-03-30T13:11:37.290 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:11:37.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.288+0000 7fbbd4a00640 1 -- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbbac06c4f0 msgr2=0x7fbbac06e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.288+0000 7fbbd4a00640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbbac06c4f0 0x7fbbac06e9b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0034000 tx=0x7fbbc0009030 comp rx=0 tx=0).stop 2024-03-30T13:11:37.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.288+0000 7fbbd4a00640 1 -- 172.21.15.44:0/3481680945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbd014e2d0 msgr2=0x7fbbd015a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.288+0000 7fbbd4a00640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbd014e2d0 0x7fbbd015a9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00aedb0 tx=0x7fbbc800eb90 comp rx=0 tx=0).stop 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.288+0000 7fbbd4a00640 1 -- 172.21.15.44:0/3481680945 shutdown_connections 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.288+0000 7fbbd4a00640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbbd014e2d0 0x7fbbd015a9d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.288+0000 7fbbd4a00640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbbac06c4f0 0x7fbbac06e9b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.288+0000 7fbbd4a00640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0159420 0x7fbbd00c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.288+0000 7fbbd4a00640 1 --2- 172.21.15.44:0/3481680945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb40039e0 0x7fbbd014d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.288+0000 7fbbd4a00640 1 -- 172.21.15.44:0/3481680945 >> 172.21.15.44:0/3481680945 conn(0x7fbbd00cfd90 msgr2=0x7fbbd00b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.289+0000 7fbbd4a00640 1 -- 172.21.15.44:0/3481680945 shutdown_connections 2024-03-30T13:11:37.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.289+0000 7fbbd4a00640 1 -- 172.21.15.44:0/3481680945 wait complete. 2024-03-30T13:11:37.310 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-30T13:11:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.521+0000 7f158dc00640 1 Processor -- start 2024-03-30T13:11:37.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.522+0000 7f158dc00640 1 -- start start 2024-03-30T13:11:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.523+0000 7f158dc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f15880b2e40 0x7f1588162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.523+0000 7f158dc00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158815ef20 con 0x7f15880d09a0 2024-03-30T13:11:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.524+0000 7f158dc00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f158815f200 con 0x7f1588155370 2024-03-30T13:11:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.524+0000 7f158dc00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1588073060 con 0x7f15880b2e40 2024-03-30T13:11:37.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.524+0000 7f157fe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f15880d09a0 0x7f1588071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49956/0 (socket says 172.21.15.44:49956) 2024-03-30T13:11:37.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.524+0000 7f157fe00640 1 -- 172.21.15.44:0/8122453 learned_addr learned my addr 172.21.15.44:0/8122453 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:37.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.524+0000 7f158d200640 1 --2- 172.21.15.44:0/8122453 >> v2:172.21.15.44:3300/0 conn(0x7f15880b2e40 0x7f1588162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.524+0000 7f1587400640 1 -- 172.21.15.44:0/8122453 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063739863 0 0) 0x7f158815ef20 con 0x7f15880d09a0 2024-03-30T13:11:37.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.524+0000 7f1587400640 1 -- 172.21.15.44:0/8122453 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f156c003520 con 0x7f15880d09a0 2024-03-30T13:11:37.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.525+0000 7f158d200640 1 -- 172.21.15.44:0/8122453 >> v1:172.21.15.151:6789/0 conn(0x7f1588155370 legacy=0x7f15880d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.525+0000 7f158d200640 1 -- 172.21.15.44:0/8122453 >> v1:172.21.15.44:6789/0 conn(0x7f15880d09a0 legacy=0x7f1588071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.525+0000 7f158d200640 1 -- 172.21.15.44:0/8122453 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158815f4e0 con 0x7f15880b2e40 2024-03-30T13:11:37.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.526+0000 7f158d200640 1 --2- 172.21.15.44:0/8122453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15880b2e40 0x7f1588162980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1580009d90 tx=0x7f158002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfca943cba6d349e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.526+0000 7f1587400640 1 -- 172.21.15.44:0/8122453 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580039070 con 0x7f15880b2e40 2024-03-30T13:11:37.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.526+0000 7f1587400640 1 -- 172.21.15.44:0/8122453 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158002ccf0 con 0x7f15880b2e40 2024-03-30T13:11:37.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.526+0000 7f1587400640 1 -- 172.21.15.44:0/8122453 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580034660 con 0x7f15880b2e40 2024-03-30T13:11:37.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.527+0000 7f158dc00640 1 -- 172.21.15.44:0/8122453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15880b2e40 msgr2=0x7f1588162980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.527+0000 7f158dc00640 1 --2- 172.21.15.44:0/8122453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15880b2e40 0x7f1588162980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1580009d90 tx=0x7f158002bf40 comp rx=0 tx=0).stop 2024-03-30T13:11:37.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.527+0000 7f158dc00640 1 -- 172.21.15.44:0/8122453 shutdown_connections 2024-03-30T13:11:37.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.527+0000 7f158dc00640 1 --2- 172.21.15.44:0/8122453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15880b2e40 0x7f1588162980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.527+0000 7f158dc00640 1 -- 172.21.15.44:0/8122453 >> 172.21.15.44:0/8122453 conn(0x7f158806b9a0 msgr2=0x7f158806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.527+0000 7f158dc00640 1 -- 172.21.15.44:0/8122453 shutdown_connections 2024-03-30T13:11:37.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.527+0000 7f158dc00640 1 -- 172.21.15.44:0/8122453 wait complete. 2024-03-30T13:11:37.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.529+0000 7f158dc00640 1 Processor -- start 2024-03-30T13:11:37.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.529+0000 7f158dc00640 1 -- start start 2024-03-30T13:11:37.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f158dc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15880b2e40 0x7f158814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f158dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15880d09a0 0x7f1588157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f158dc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1588155370 0x7f15881f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f158dc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1588071530 con 0x7f15880d09a0 2024-03-30T13:11:37.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f158dc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f15880af910 con 0x7f1588155370 2024-03-30T13:11:37.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f158dc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1588155750 con 0x7f15880b2e40 2024-03-30T13:11:37.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f157fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15880d09a0 0x7f1588157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f157fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15880d09a0 0x7f1588157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49466/0 (socket says 172.21.15.44:49466) 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f157fe00640 1 -- 172.21.15.44:0/2062601550 learned_addr learned my addr 172.21.15.44:0/2062601550 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f1587e00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15880b2e40 0x7f158814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f158d200640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1588155370 0x7f15881f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f157fe00640 1 -- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15880b2e40 msgr2=0x7f158814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f157fe00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15880b2e40 0x7f158814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f157fe00640 1 -- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1588155370 msgr2=0x7f15881f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f157fe00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1588155370 0x7f15881f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.530+0000 7f157fe00640 1 -- 172.21.15.44:0/2062601550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15881583e0 con 0x7f15880d09a0 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.531+0000 7f157fe00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15880d09a0 0x7f1588157b40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f157000c500 tx=0x7f157000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.531+0000 7f1584c00640 1 -- 172.21.15.44:0/2062601550 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570017070 con 0x7f15880d09a0 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.531+0000 7f1584c00640 1 -- 172.21.15.44:0/2062601550 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1570005ce0 con 0x7f15880d09a0 2024-03-30T13:11:37.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.531+0000 7f1584c00640 1 -- 172.21.15.44:0/2062601550 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570007330 con 0x7f15880d09a0 2024-03-30T13:11:37.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.531+0000 7f158dc00640 1 -- 172.21.15.44:0/2062601550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15881586c0 con 0x7f15880d09a0 2024-03-30T13:11:37.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.531+0000 7f158dc00640 1 -- 172.21.15.44:0/2062601550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15880b0dc0 con 0x7f15880d09a0 2024-03-30T13:11:37.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.532+0000 7f158dc00640 1 -- 172.21.15.44:0/2062601550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1588075890 con 0x7f15880d09a0 2024-03-30T13:11:37.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.533+0000 7f1584c00640 1 -- 172.21.15.44:0/2062601550 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 90800+0+0 (secure 0 0 0) 0x7f157001a070 con 0x7f15880d09a0 2024-03-30T13:11:37.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.534+0000 7f1584c00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f156406c4a0 0x7f156406e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.534+0000 7f1584c00640 1 -- 172.21.15.44:0/2062601550 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f157008a6a0 con 0x7f15880d09a0 2024-03-30T13:11:37.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.535+0000 7f1587e00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f156406c4a0 0x7f156406e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.536+0000 7f1587e00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f156406c4a0 0x7f156406e960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1578007fd0 tx=0x7f1578009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.539+0000 7f1584c00640 1 -- 172.21.15.44:0/2062601550 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f15700591a0 con 0x7f15880d09a0 2024-03-30T13:11:37.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.747+0000 7f158dc00640 1 -- 172.21.15.44:0/2062601550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1588154960 con 0x7f15880d09a0 2024-03-30T13:11:37.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.747+0000 7f1584c00640 1 -- 172.21.15.44:0/2062601550 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f1570058aa0 con 0x7f15880d09a0 2024-03-30T13:11:37.752 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:37.752 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-03-30T13:11:37.752 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:11:37.752 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-03-30T13:11:37.752 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-03-30T13:11:37.753 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:11:37.753 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-03-30T13:11:37.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.750+0000 7f158dc00640 1 -- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f156406c4a0 msgr2=0x7f156406e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.750+0000 7f158dc00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f156406c4a0 0x7f156406e960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1578007fd0 tx=0x7f1578009040 comp rx=0 tx=0).stop 2024-03-30T13:11:37.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.750+0000 7f158dc00640 1 -- 172.21.15.44:0/2062601550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15880d09a0 msgr2=0x7f1588157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.750+0000 7f158dc00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15880d09a0 0x7f1588157b40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f157000c500 tx=0x7f157000c9c0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.750+0000 7f158dc00640 1 -- 172.21.15.44:0/2062601550 shutdown_connections 2024-03-30T13:11:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.750+0000 7f158dc00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f156406c4a0 0x7f156406e960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.750+0000 7f158dc00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1588155370 0x7f15881f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.750+0000 7f158dc00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15880d09a0 0x7f1588157b40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.750+0000 7f158dc00640 1 --2- 172.21.15.44:0/2062601550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15880b2e40 0x7f158814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.750+0000 7f158dc00640 1 -- 172.21.15.44:0/2062601550 >> 172.21.15.44:0/2062601550 conn(0x7f158806b9a0 msgr2=0x7f1588153cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.750+0000 7f158dc00640 1 -- 172.21.15.44:0/2062601550 shutdown_connections 2024-03-30T13:11:37.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.750+0000 7f158dc00640 1 -- 172.21.15.44:0/2062601550 wait complete. 2024-03-30T13:11:37.773 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-30T13:11:37.773 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-30T13:11:37.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.980+0000 7f0d02800640 1 Processor -- start 2024-03-30T13:11:37.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.980+0000 7f0d02800640 1 -- start start 2024-03-30T13:11:37.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.981+0000 7f0d02800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cfc145a30 0x7f0cfc1609c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.981+0000 7f0d02800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cfc15d3e0 con 0x7f0cfc15c8f0 2024-03-30T13:11:37.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.981+0000 7f0d02800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cfc15d6c0 con 0x7f0cfc06bc90 2024-03-30T13:11:37.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.981+0000 7f0d02800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0cfc160530 con 0x7f0cfc145a30 2024-03-30T13:11:37.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.982+0000 7f0d00a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0cfc15c8f0 0x7f0cfc06b580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49958/0 (socket says 172.21.15.44:49958) 2024-03-30T13:11:37.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.982+0000 7f0d00a00640 1 -- 172.21.15.44:0/1746935143 learned_addr learned my addr 172.21.15.44:0/1746935143 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:37.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.982+0000 7f0d01400640 1 --2- 172.21.15.44:0/1746935143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cfc145a30 0x7f0cfc1609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.983+0000 7f0d01400640 1 -- 172.21.15.44:0/1746935143 >> v1:172.21.15.151:6789/0 conn(0x7f0cfc06bc90 legacy=0x7f0cfc06fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.983+0000 7f0d01400640 1 -- 172.21.15.44:0/1746935143 >> v1:172.21.15.44:6789/0 conn(0x7f0cfc15c8f0 legacy=0x7f0cfc06b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.983+0000 7f0d01400640 1 -- 172.21.15.44:0/1746935143 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cfc15fee0 con 0x7f0cfc145a30 2024-03-30T13:11:37.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.984+0000 7f0d01400640 1 --2- 172.21.15.44:0/1746935143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cfc145a30 0x7f0cfc1609c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc1606b0 tx=0x7f0cf002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef021d462b9b0f88 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.985+0000 7f0cfbe00640 1 -- 172.21.15.44:0/1746935143 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0035020 con 0x7f0cfc145a30 2024-03-30T13:11:37.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.986+0000 7f0cfbe00640 1 -- 172.21.15.44:0/1746935143 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf0031890 con 0x7f0cfc145a30 2024-03-30T13:11:37.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.986+0000 7f0cfbe00640 1 -- 172.21.15.44:0/1746935143 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0031c60 con 0x7f0cfc145a30 2024-03-30T13:11:37.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.986+0000 7f0d02800640 1 -- 172.21.15.44:0/1746935143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cfc145a30 msgr2=0x7f0cfc1609c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.986+0000 7f0d02800640 1 --2- 172.21.15.44:0/1746935143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cfc145a30 0x7f0cfc1609c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc1606b0 tx=0x7f0cf002b930 comp rx=0 tx=0).stop 2024-03-30T13:11:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.987+0000 7f0d02800640 1 -- 172.21.15.44:0/1746935143 shutdown_connections 2024-03-30T13:11:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.987+0000 7f0d02800640 1 --2- 172.21.15.44:0/1746935143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cfc145a30 0x7f0cfc1609c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.987+0000 7f0d02800640 1 -- 172.21.15.44:0/1746935143 >> 172.21.15.44:0/1746935143 conn(0x7f0cfc06d1f0 msgr2=0x7f0cfc0b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.987+0000 7f0d02800640 1 -- 172.21.15.44:0/1746935143 shutdown_connections 2024-03-30T13:11:37.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.987+0000 7f0d02800640 1 -- 172.21.15.44:0/1746935143 wait complete. 2024-03-30T13:11:37.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.988+0000 7f0d02800640 1 Processor -- start 2024-03-30T13:11:37.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.989+0000 7f0d02800640 1 -- start start 2024-03-30T13:11:37.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d02800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cfc06bc90 0x7f0cfc1f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d02800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cfc145a30 0x7f0cfc1e6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d02800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cfc15c8f0 0x7f0cfc13fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d02800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc145e10 con 0x7f0cfc06bc90 2024-03-30T13:11:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d02800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0cfc072ea0 con 0x7f0cfc145a30 2024-03-30T13:11:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d02800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0cfc145f90 con 0x7f0cfc15c8f0 2024-03-30T13:11:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d01400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cfc06bc90 0x7f0cfc1f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d01400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cfc06bc90 0x7f0cfc1f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49480/0 (socket says 172.21.15.44:49480) 2024-03-30T13:11:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d01400640 1 -- 172.21.15.44:0/2295940917 learned_addr learned my addr 172.21.15.44:0/2295940917 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d00a00640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cfc145a30 0x7f0cfc1e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d01e00640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cfc15c8f0 0x7f0cfc13fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d01400640 1 -- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cfc15c8f0 msgr2=0x7f0cfc13fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d01400640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cfc15c8f0 0x7f0cfc13fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d01400640 1 -- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cfc145a30 msgr2=0x7f0cfc1e6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:37.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d01400640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cfc145a30 0x7f0cfc1e6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.990+0000 7f0d01400640 1 -- 172.21.15.44:0/2295940917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cfc1e76a0 con 0x7f0cfc06bc90 2024-03-30T13:11:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.991+0000 7f0d01400640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cfc06bc90 0x7f0cfc1f1810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00098c0 tx=0x7f0cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.991+0000 7f0cf9600640 1 -- 172.21.15.44:0/2295940917 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0035040 con 0x7f0cfc06bc90 2024-03-30T13:11:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.991+0000 7f0cf9600640 1 -- 172.21.15.44:0/2295940917 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf0046480 con 0x7f0cfc06bc90 2024-03-30T13:11:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.991+0000 7f0cf9600640 1 -- 172.21.15.44:0/2295940917 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0046870 con 0x7f0cfc06bc90 2024-03-30T13:11:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.991+0000 7f0d02800640 1 -- 172.21.15.44:0/2295940917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cfc1e70e0 con 0x7f0cfc06bc90 2024-03-30T13:11:37.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.991+0000 7f0d02800640 1 -- 172.21.15.44:0/2295940917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cfc1f2170 con 0x7f0cfc06bc90 2024-03-30T13:11:37.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.993+0000 7f0d02800640 1 -- 172.21.15.44:0/2295940917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cfc0723d0 con 0x7f0cfc06bc90 2024-03-30T13:11:37.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.993+0000 7f0cf9600640 1 -- 172.21.15.44:0/2295940917 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 90800+0+0 (secure 0 0 0) 0x7f0cf0038020 con 0x7f0cfc06bc90 2024-03-30T13:11:37.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.994+0000 7f0cf9600640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0cdc06c4a0 0x7f0cdc06e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:37.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.994+0000 7f0cf9600640 1 -- 172.21.15.44:0/2295940917 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f0cf00adbc0 con 0x7f0cfc06bc90 2024-03-30T13:11:37.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.995+0000 7f0d00a00640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0cdc06c4a0 0x7f0cdc06e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:37.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:37.996+0000 7f0d00a00640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0cdc06c4a0 0x7f0cdc06e960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc13f390 tx=0x7f0ce8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:38.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:38.000+0000 7f0cf9600640 1 -- 172.21.15.44:0/2295940917 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0cfc0723d0 con 0x7f0cfc06bc90 2024-03-30T13:11:38.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:38.205+0000 7f0d02800640 1 -- 172.21.15.44:0/2295940917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0cfc072670 con 0x7f0cfc06bc90 2024-03-30T13:11:38.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:38.372+0000 7f0cf9600640 1 -- 172.21.15.44:0/2295940917 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0cf002f050 con 0x7f0cfc06bc90 2024-03-30T13:11:39.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.000+0000 7f0cf9600640 1 -- 172.21.15.44:0/2295940917 <== mon.0 v2:172.21.15.44:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f0cf002d040 con 0x7f0cfc06bc90 2024-03-30T13:11:39.004 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-03-30T13:11:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.003+0000 7f0d02800640 1 -- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0cdc06c4a0 msgr2=0x7f0cdc06e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.003+0000 7f0d02800640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0cdc06c4a0 0x7f0cdc06e960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc13f390 tx=0x7f0ce8009040 comp rx=0 tx=0).stop 2024-03-30T13:11:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.003+0000 7f0d02800640 1 -- 172.21.15.44:0/2295940917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cfc06bc90 msgr2=0x7f0cfc1f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.003+0000 7f0d02800640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cfc06bc90 0x7f0cfc1f1810 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00098c0 tx=0x7f0cf00046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.004+0000 7f0d02800640 1 -- 172.21.15.44:0/2295940917 shutdown_connections 2024-03-30T13:11:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.004+0000 7f0d02800640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cfc15c8f0 0x7f0cfc13fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.004+0000 7f0d02800640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0cdc06c4a0 0x7f0cdc06e960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.004+0000 7f0d02800640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cfc145a30 0x7f0cfc1e6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.004+0000 7f0d02800640 1 --2- 172.21.15.44:0/2295940917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cfc06bc90 0x7f0cfc1f1810 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.004+0000 7f0d02800640 1 -- 172.21.15.44:0/2295940917 >> 172.21.15.44:0/2295940917 conn(0x7f0cfc06d1f0 msgr2=0x7f0cfc15f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:39.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.004+0000 7f0d02800640 1 -- 172.21.15.44:0/2295940917 shutdown_connections 2024-03-30T13:11:39.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.004+0000 7f0d02800640 1 -- 172.21.15.44:0/2295940917 wait complete. 2024-03-30T13:11:39.037 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-03-30T13:11:39.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.245+0000 7f430d600640 1 Processor -- start 2024-03-30T13:11:39.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.245+0000 7f430d600640 1 -- start start 2024-03-30T13:11:39.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.247+0000 7f430d600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4308145820 0x7f43080cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.247+0000 7f430d600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43080cd320 con 0x7f43080ccec0 2024-03-30T13:11:39.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.247+0000 7f430d600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f430815cb30 con 0x7f4308160840 2024-03-30T13:11:39.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.247+0000 7f430d600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f430815d460 con 0x7f4308145820 2024-03-30T13:11:39.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.248+0000 7f4306000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f43080ccec0 0x7f4308160130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49968/0 (socket says 172.21.15.44:49968) 2024-03-30T13:11:39.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.248+0000 7f4306000640 1 -- 172.21.15.44:0/153058864 learned_addr learned my addr 172.21.15.44:0/153058864 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:39.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.248+0000 7f4306a00640 1 --2- 172.21.15.44:0/153058864 >> v2:172.21.15.151:3300/0 conn(0x7f4308145820 0x7f43080cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.248+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965604442 0 0) 0x7f43080cd320 con 0x7f43080ccec0 2024-03-30T13:11:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.248+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42ec003520 con 0x7f43080ccec0 2024-03-30T13:11:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2322333820 0 0) 0x7f42ec003520 con 0x7f43080ccec0 2024-03-30T13:11:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 >> v2:172.21.15.151:3300/0 conn(0x7f4308145820 msgr2=0x7f43080cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 --2- 172.21.15.44:0/153058864 >> v2:172.21.15.151:3300/0 conn(0x7f4308145820 0x7f43080cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 >> v1:172.21.15.151:6789/0 conn(0x7f4308160840 legacy=0x7f43080c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430815ce10 con 0x7f43080ccec0 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f42f4001670 con 0x7f43080ccec0 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 >> v1:172.21.15.44:6789/0 conn(0x7f43080ccec0 legacy=0x7f4308160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 --2- 172.21.15.44:0/153058864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42ec003a00 0x7f42ec003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 --2- 172.21.15.44:0/153058864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42ec004800 0x7f42ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 --2- 172.21.15.44:0/153058864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 0x7f42ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f430815d460 con 0x7f42ec0052c0 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec00c200 con 0x7f42ec004800 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f42ec00c400 con 0x7f42ec003a00 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4307400640 1 --2- 172.21.15.44:0/153058864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 0x7f42ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4306000640 1 --2- 172.21.15.44:0/153058864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42ec004800 0x7f42ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.249+0000 7f4306a00640 1 --2- 172.21.15.44:0/153058864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42ec003a00 0x7f42ec003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.250+0000 7f4307400640 1 -- 172.21.15.44:0/153058864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42ec003a00 msgr2=0x7f42ec003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.250+0000 7f4307400640 1 --2- 172.21.15.44:0/153058864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42ec003a00 0x7f42ec003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.250+0000 7f4307400640 1 -- 172.21.15.44:0/153058864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42ec004800 msgr2=0x7f42ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.250+0000 7f4307400640 1 --2- 172.21.15.44:0/153058864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42ec004800 0x7f42ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.250+0000 7f4307400640 1 -- 172.21.15.44:0/153058864 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec003520 con 0x7f42ec0052c0 2024-03-30T13:11:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.251+0000 7f4307400640 1 -- 172.21.15.44:0/153058864 reap_dead start 2024-03-30T13:11:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.251+0000 7f4307400640 1 --2- 172.21.15.44:0/153058864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 0x7f42ec00b9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4300001e50 tx=0x7f42ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53556d64cdadaa46 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.251+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300001a70 con 0x7f42ec0052c0 2024-03-30T13:11:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.251+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4300003b90 con 0x7f42ec0052c0 2024-03-30T13:11:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.251+0000 7f4305600640 1 -- 172.21.15.44:0/153058864 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43000050d0 con 0x7f42ec0052c0 2024-03-30T13:11:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.252+0000 7f430d600640 1 -- 172.21.15.44:0/153058864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 msgr2=0x7f42ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.252+0000 7f430d600640 1 --2- 172.21.15.44:0/153058864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 0x7f42ec00b9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4300001e50 tx=0x7f42ec005830 comp rx=0 tx=0).stop 2024-03-30T13:11:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.252+0000 7f430d600640 1 -- 172.21.15.44:0/153058864 shutdown_connections 2024-03-30T13:11:39.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.252+0000 7f430d600640 1 --2- 172.21.15.44:0/153058864 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 0x7f42ec00b9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.252+0000 7f430d600640 1 -- 172.21.15.44:0/153058864 >> 172.21.15.44:0/153058864 conn(0x7f43080b1c90 msgr2=0x7f43080b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:39.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.252+0000 7f430d600640 1 -- 172.21.15.44:0/153058864 shutdown_connections 2024-03-30T13:11:39.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.252+0000 7f430d600640 1 -- 172.21.15.44:0/153058864 wait complete. 2024-03-30T13:11:39.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.254+0000 7f430d600640 1 Processor -- start 2024-03-30T13:11:39.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.254+0000 7f430d600640 1 -- start start 2024-03-30T13:11:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.255+0000 7f430d600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 0x7f43080b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.255+0000 7f430d600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43080add70 0x7f43080af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.255+0000 7f430d600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43080cedb0 0x7f430813a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.255+0000 7f430d600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f430815d8f0 con 0x7f42ec0052c0 2024-03-30T13:11:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.255+0000 7f430d600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4308160e90 con 0x7f43080add70 2024-03-30T13:11:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.255+0000 7f430d600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f43080cc980 con 0x7f43080cedb0 2024-03-30T13:11:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.255+0000 7f4306a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 0x7f43080b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.255+0000 7f4306a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 0x7f43080b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49496/0 (socket says 172.21.15.44:49496) 2024-03-30T13:11:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.255+0000 7f4306a00640 1 -- 172.21.15.44:0/911943079 learned_addr learned my addr 172.21.15.44:0/911943079 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.256+0000 7f4307400640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43080cedb0 0x7f430813a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.256+0000 7f4306a00640 1 -- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43080cedb0 msgr2=0x7f430813a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.256+0000 7f4306000640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43080add70 0x7f43080af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.256+0000 7f4306a00640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43080cedb0 0x7f430813a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.256+0000 7f4306a00640 1 -- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43080add70 msgr2=0x7f43080af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.256+0000 7f4306a00640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43080add70 0x7f43080af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.256+0000 7f4306a00640 1 -- 172.21.15.44:0/911943079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43080ae1f0 con 0x7f42ec0052c0 2024-03-30T13:11:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.256+0000 7f4306a00640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 0x7f43080b58d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f42f8011540 tx=0x7f42f8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.256+0000 7f42fea00640 1 -- 172.21.15.44:0/911943079 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8015930 con 0x7f42ec0052c0 2024-03-30T13:11:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.256+0000 7f42fea00640 1 -- 172.21.15.44:0/911943079 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f8015ad0 con 0x7f42ec0052c0 2024-03-30T13:11:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.256+0000 7f42fea00640 1 -- 172.21.15.44:0/911943079 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f800f460 con 0x7f42ec0052c0 2024-03-30T13:11:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.256+0000 7f430d600640 1 -- 172.21.15.44:0/911943079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43080ae470 con 0x7f42ec0052c0 2024-03-30T13:11:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.257+0000 7f430d600640 1 -- 172.21.15.44:0/911943079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43080aea30 con 0x7f42ec0052c0 2024-03-30T13:11:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.258+0000 7f430d600640 1 -- 172.21.15.44:0/911943079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4308075890 con 0x7f42ec0052c0 2024-03-30T13:11:39.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.259+0000 7f42fea00640 1 -- 172.21.15.44:0/911943079 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f42f800f600 con 0x7f42ec0052c0 2024-03-30T13:11:39.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.260+0000 7f42fea00640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f42e806c5b0 0x7f42e806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:39.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.260+0000 7f42fea00640 1 -- 172.21.15.44:0/911943079 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f42f808bcc0 con 0x7f42ec0052c0 2024-03-30T13:11:39.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.260+0000 7f4306000640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f42e806c5b0 0x7f42e806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:39.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.261+0000 7f4306000640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f42e806c5b0 0x7f42e806ea70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42f40010e0 tx=0x7f42f4000f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:39.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.265+0000 7f42fea00640 1 -- 172.21.15.44:0/911943079 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f43080ae1f0 con 0x7f42ec0052c0 2024-03-30T13:11:39.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:39.471+0000 7f430d600640 1 -- 172.21.15.44:0/911943079 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f43080b29c0 con 0x7f42ec0052c0 2024-03-30T13:11:40.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.017+0000 7f42fea00640 1 -- 172.21.15.44:0/911943079 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7f42f8019030 con 0x7f42ec0052c0 2024-03-30T13:11:40.021 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-03-30T13:11:40.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.020+0000 7f430d600640 1 -- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f42e806c5b0 msgr2=0x7f42e806ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.020+0000 7f430d600640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f42e806c5b0 0x7f42e806ea70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f42f40010e0 tx=0x7f42f4000f50 comp rx=0 tx=0).stop 2024-03-30T13:11:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.021+0000 7f430d600640 1 -- 172.21.15.44:0/911943079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 msgr2=0x7f43080b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.021+0000 7f430d600640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 0x7f43080b58d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f42f8011540 tx=0x7f42f8011a00 comp rx=0 tx=0).stop 2024-03-30T13:11:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.021+0000 7f430d600640 1 -- 172.21.15.44:0/911943079 shutdown_connections 2024-03-30T13:11:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.021+0000 7f430d600640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43080cedb0 0x7f430813a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.021+0000 7f430d600640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f42e806c5b0 0x7f42e806ea70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.021+0000 7f430d600640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43080add70 0x7f43080af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.021+0000 7f430d600640 1 --2- 172.21.15.44:0/911943079 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42ec0052c0 0x7f43080b58d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.021+0000 7f430d600640 1 -- 172.21.15.44:0/911943079 >> 172.21.15.44:0/911943079 conn(0x7f43080b1c90 msgr2=0x7f43080cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.021+0000 7f430d600640 1 -- 172.21.15.44:0/911943079 shutdown_connections 2024-03-30T13:11:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.021+0000 7f430d600640 1 -- 172.21.15.44:0/911943079 wait complete. 2024-03-30T13:11:40.060 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-30T13:11:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.250+0000 7f0eafc00640 1 Processor -- start 2024-03-30T13:11:40.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.251+0000 7f0eafc00640 1 -- start start 2024-03-30T13:11:40.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.252+0000 7f0eafc00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ea80b5dc0 0x7f0ea80b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.252+0000 7f0eafc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0ea80ba090 0x7f0ea80d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.252+0000 7f0eafc00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea80b66e0 con 0x7f0ea806c620 2024-03-30T13:11:40.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.252+0000 7f0eafc00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea80d2ff0 con 0x7f0ea80ba090 2024-03-30T13:11:40.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.252+0000 7f0eafc00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea80d32d0 con 0x7f0ea80b5dc0 2024-03-30T13:11:40.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.253+0000 7f0ea7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0ea80ba090 0x7f0ea80d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.253+0000 7f0ea7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0ea80ba090 0x7f0ea80d2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49502/0 (socket says 172.21.15.44:49502) 2024-03-30T13:11:40.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.253+0000 7f0ea7e00640 1 -- 172.21.15.44:0/644082028 learned_addr learned my addr 172.21.15.44:0/644082028 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:40.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.253+0000 7f0ead200640 1 --2- 172.21.15.44:0/644082028 >> v2:172.21.15.151:3300/0 conn(0x7f0ea80b5dc0 0x7f0ea80b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.253+0000 7f0ea7e00640 1 -- 172.21.15.44:0/644082028 >> v2:172.21.15.151:3300/0 conn(0x7f0ea80b5dc0 msgr2=0x7f0ea80b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:40.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.253+0000 7f0ea7e00640 1 --2- 172.21.15.44:0/644082028 >> v2:172.21.15.151:3300/0 conn(0x7f0ea80b5dc0 0x7f0ea80b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.253+0000 7f0ea7e00640 1 -- 172.21.15.44:0/644082028 >> v1:172.21.15.151:6789/0 conn(0x7f0ea806c620 legacy=0x7f0ea806ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:40.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.253+0000 7f0ea7e00640 1 -- 172.21.15.44:0/644082028 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea80d35b0 con 0x7f0ea80ba090 2024-03-30T13:11:40.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.254+0000 7f0ea7e00640 1 --2- 172.21.15.44:0/644082028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea80ba090 0x7f0ea80d2680 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ea806d770 tx=0x7f0e9402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977608442e5bd835 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:40.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.254+0000 7f0ea7400640 1 -- 172.21.15.44:0/644082028 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94035020 con 0x7f0ea80ba090 2024-03-30T13:11:40.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.255+0000 7f0ea7400640 1 -- 172.21.15.44:0/644082028 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e94031870 con 0x7f0ea80ba090 2024-03-30T13:11:40.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.255+0000 7f0ea7400640 1 -- 172.21.15.44:0/644082028 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94031c40 con 0x7f0ea80ba090 2024-03-30T13:11:40.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.255+0000 7f0eafc00640 1 -- 172.21.15.44:0/644082028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea80ba090 msgr2=0x7f0ea80d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.255+0000 7f0eafc00640 1 --2- 172.21.15.44:0/644082028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea80ba090 0x7f0ea80d2680 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ea806d770 tx=0x7f0e9402b910 comp rx=0 tx=0).stop 2024-03-30T13:11:40.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.255+0000 7f0eafc00640 1 -- 172.21.15.44:0/644082028 shutdown_connections 2024-03-30T13:11:40.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.255+0000 7f0eafc00640 1 --2- 172.21.15.44:0/644082028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea80ba090 0x7f0ea80d2680 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.255+0000 7f0eafc00640 1 --2- 172.21.15.44:0/644082028 >> v2:172.21.15.151:3300/0 conn(0x7f0ea80b5dc0 0x7f0ea80b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.255+0000 7f0eafc00640 1 -- 172.21.15.44:0/644082028 >> 172.21.15.44:0/644082028 conn(0x7f0ea80678f0 msgr2=0x7f0ea80d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:40.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.255+0000 7f0eafc00640 1 -- 172.21.15.44:0/644082028 shutdown_connections 2024-03-30T13:11:40.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.255+0000 7f0eafc00640 1 -- 172.21.15.44:0/644082028 wait complete. 2024-03-30T13:11:40.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.257+0000 7f0eafc00640 1 Processor -- start 2024-03-30T13:11:40.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.257+0000 7f0eafc00640 1 -- start start 2024-03-30T13:11:40.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.258+0000 7f0eafc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea806c620 0x7f0ea8158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.258+0000 7f0eafc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea80b5dc0 0x7f0ea80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.258+0000 7f0eafc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea80ba090 0x7f0ea81553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.258+0000 7f0eafc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea80d4090 con 0x7f0ea806c620 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.258+0000 7f0eafc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea80d3b70 con 0x7f0ea80b5dc0 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.258+0000 7f0eafc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea80b83e0 con 0x7f0ea80ba090 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.258+0000 7f0ead200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea806c620 0x7f0ea8158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.258+0000 7f0ead200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea806c620 0x7f0ea8158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49512/0 (socket says 172.21.15.44:49512) 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.258+0000 7f0ead200640 1 -- 172.21.15.44:0/3280891165 learned_addr learned my addr 172.21.15.44:0/3280891165 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.259+0000 7f0ead200640 1 -- 172.21.15.44:0/3280891165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea80ba090 msgr2=0x7f0ea81553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.259+0000 7f0ead200640 1 --2- 172.21.15.44:0/3280891165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea80ba090 0x7f0ea81553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.259+0000 7f0ead200640 1 -- 172.21.15.44:0/3280891165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea80b5dc0 msgr2=0x7f0ea80cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.259+0000 7f0ead200640 1 --2- 172.21.15.44:0/3280891165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea80b5dc0 0x7f0ea80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.259+0000 7f0ead200640 1 -- 172.21.15.44:0/3280891165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea8159560 con 0x7f0ea806c620 2024-03-30T13:11:40.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.259+0000 7f0ead200640 1 --2- 172.21.15.44:0/3280891165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea806c620 0x7f0ea8158f10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800d800 tx=0x7f0e9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:40.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.259+0000 7f0ea4c00640 1 -- 172.21.15.44:0/3280891165 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800b6c0 con 0x7f0ea806c620 2024-03-30T13:11:40.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.259+0000 7f0ea4c00640 1 -- 172.21.15.44:0/3280891165 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e98019070 con 0x7f0ea806c620 2024-03-30T13:11:40.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.259+0000 7f0ea4c00640 1 -- 172.21.15.44:0/3280891165 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800ba80 con 0x7f0ea806c620 2024-03-30T13:11:40.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.259+0000 7f0eafc00640 1 -- 172.21.15.44:0/3280891165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea80cc500 con 0x7f0ea806c620 2024-03-30T13:11:40.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.260+0000 7f0eafc00640 1 -- 172.21.15.44:0/3280891165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea80ccac0 con 0x7f0ea806c620 2024-03-30T13:11:40.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.261+0000 7f0eafc00640 1 -- 172.21.15.44:0/3280891165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea8075890 con 0x7f0ea806c620 2024-03-30T13:11:40.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.262+0000 7f0ea4c00640 1 -- 172.21.15.44:0/3280891165 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0e9800bc20 con 0x7f0ea806c620 2024-03-30T13:11:40.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.263+0000 7f0ea4c00640 1 --2- 172.21.15.44:0/3280891165 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0e8806c530 0x7f0e8806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:40.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.263+0000 7f0ea4c00640 1 -- 172.21.15.44:0/3280891165 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f0e9808bbd0 con 0x7f0ea806c620 2024-03-30T13:11:40.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.264+0000 7f0ea7e00640 1 --2- 172.21.15.44:0/3280891165 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0e8806c530 0x7f0e8806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:40.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.265+0000 7f0ea7e00640 1 --2- 172.21.15.44:0/3280891165 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0e8806c530 0x7f0e8806e9f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e94036000 tx=0x7f0e94030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:40.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.269+0000 7f0ea4c00640 1 -- 172.21.15.44:0/3280891165 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0e9805a1c0 con 0x7f0ea806c620 2024-03-30T13:11:40.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:40.529+0000 7f0eafc00640 1 -- 172.21.15.44:0/3280891165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0ea80b3820 con 0x7f0ea806c620 2024-03-30T13:11:41.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.037+0000 7f0ea4c00640 1 -- 172.21.15.44:0/3280891165 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f0e98059ac0 con 0x7f0ea806c620 2024-03-30T13:11:41.044 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 2 and data pool 3 2024-03-30T13:11:41.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.045+0000 7f0eafc00640 1 -- 172.21.15.44:0/3280891165 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0e8806c530 msgr2=0x7f0e8806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.045+0000 7f0eafc00640 1 --2- 172.21.15.44:0/3280891165 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0e8806c530 0x7f0e8806e9f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e94036000 tx=0x7f0e94030000 comp rx=0 tx=0).stop 2024-03-30T13:11:41.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.045+0000 7f0eafc00640 1 -- 172.21.15.44:0/3280891165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea806c620 msgr2=0x7f0ea8158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.045+0000 7f0eafc00640 1 --2- 172.21.15.44:0/3280891165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea806c620 0x7f0ea8158f10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800d800 tx=0x7f0e9800dcc0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.045+0000 7f0eafc00640 1 -- 172.21.15.44:0/3280891165 shutdown_connections 2024-03-30T13:11:41.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.045+0000 7f0eafc00640 1 --2- 172.21.15.44:0/3280891165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ea80ba090 0x7f0ea81553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.045+0000 7f0eafc00640 1 --2- 172.21.15.44:0/3280891165 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0e8806c530 0x7f0e8806e9f0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0e94036000 tx=0x7f0e94030000 comp rx=0 tx=0).stop 2024-03-30T13:11:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.045+0000 7f0eafc00640 1 --2- 172.21.15.44:0/3280891165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea80b5dc0 0x7f0ea80cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.045+0000 7f0eafc00640 1 --2- 172.21.15.44:0/3280891165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0ea806c620 0x7f0ea8158f10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.045+0000 7f0eafc00640 1 -- 172.21.15.44:0/3280891165 >> 172.21.15.44:0/3280891165 conn(0x7f0ea80678f0 msgr2=0x7f0ea80b9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.046+0000 7f0eafc00640 1 -- 172.21.15.44:0/3280891165 shutdown_connections 2024-03-30T13:11:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.046+0000 7f0eafc00640 1 -- 172.21.15.44:0/3280891165 wait complete. 2024-03-30T13:11:41.082 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-03-30T13:11:41.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-03-30T13:11:41.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.266+0000 7faf39400640 1 Processor -- start 2024-03-30T13:11:41.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.266+0000 7faf39400640 1 -- start start 2024-03-30T13:11:41.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.268+0000 7faf39400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faf340cf800 0x7faf340cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.268+0000 7faf39400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf340d2120 con 0x7faf340d3e20 2024-03-30T13:11:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.268+0000 7faf39400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf340d2400 con 0x7faf3415e060 2024-03-30T13:11:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.268+0000 7faf39400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7faf340d26e0 con 0x7faf340cf800 2024-03-30T13:11:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.268+0000 7faf33400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faf340cf800 0x7faf340cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.268+0000 7faf33400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faf340cf800 0x7faf340cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49520/0 (socket says 172.21.15.44:49520) 2024-03-30T13:11:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.268+0000 7faf33400640 1 -- 172.21.15.44:0/3577143335 learned_addr learned my addr 172.21.15.44:0/3577143335 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.269+0000 7faf33400640 1 -- 172.21.15.44:0/3577143335 >> v1:172.21.15.151:6789/0 conn(0x7faf3415e060 legacy=0x7faf3415e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:41.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.269+0000 7faf33400640 1 -- 172.21.15.44:0/3577143335 >> v1:172.21.15.44:6789/0 conn(0x7faf340d3e20 legacy=0x7faf340d42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.269+0000 7faf33400640 1 -- 172.21.15.44:0/3577143335 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf340d29c0 con 0x7faf340cf800 2024-03-30T13:11:41.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.270+0000 7faf33400640 1 --2- 172.21.15.44:0/3577143335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf340cf800 0x7faf340cfc90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009870 tx=0x7faf1c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ceca299b39d96e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:41.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.270+0000 7faf32a00640 1 -- 172.21.15.44:0/3577143335 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c035020 con 0x7faf340cf800 2024-03-30T13:11:41.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.270+0000 7faf32a00640 1 -- 172.21.15.44:0/3577143335 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1c031870 con 0x7faf340cf800 2024-03-30T13:11:41.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.270+0000 7faf32a00640 1 -- 172.21.15.44:0/3577143335 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c031c40 con 0x7faf340cf800 2024-03-30T13:11:41.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.270+0000 7faf39400640 1 -- 172.21.15.44:0/3577143335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf340cf800 msgr2=0x7faf340cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.270+0000 7faf39400640 1 --2- 172.21.15.44:0/3577143335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf340cf800 0x7faf340cfc90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009870 tx=0x7faf1c02b910 comp rx=0 tx=0).stop 2024-03-30T13:11:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.271+0000 7faf39400640 1 -- 172.21.15.44:0/3577143335 shutdown_connections 2024-03-30T13:11:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.271+0000 7faf39400640 1 --2- 172.21.15.44:0/3577143335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf340cf800 0x7faf340cfc90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.271+0000 7faf39400640 1 -- 172.21.15.44:0/3577143335 >> 172.21.15.44:0/3577143335 conn(0x7faf3408dc00 msgr2=0x7faf3409d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.271+0000 7faf39400640 1 -- 172.21.15.44:0/3577143335 shutdown_connections 2024-03-30T13:11:41.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.271+0000 7faf39400640 1 -- 172.21.15.44:0/3577143335 wait complete. 2024-03-30T13:11:41.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.272+0000 7faf39400640 1 Processor -- start 2024-03-30T13:11:41.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.272+0000 7faf39400640 1 -- start start 2024-03-30T13:11:41.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.273+0000 7faf39400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf340cf800 0x7faf34158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:41.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.273+0000 7faf39400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf340d3e20 0x7faf340b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:41.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.273+0000 7faf39400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf3415e060 0x7faf340b9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:41.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.273+0000 7faf39400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faf340b4a90 con 0x7faf340cf800 2024-03-30T13:11:41.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.273+0000 7faf39400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faf340d1db0 con 0x7faf3415e060 2024-03-30T13:11:41.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.273+0000 7faf39400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7faf340b4c10 con 0x7faf340d3e20 2024-03-30T13:11:41.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.274+0000 7faf33e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf340cf800 0x7faf34158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:41.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.274+0000 7faf33e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf340cf800 0x7faf34158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49534/0 (socket says 172.21.15.44:49534) 2024-03-30T13:11:41.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.274+0000 7faf33e00640 1 -- 172.21.15.44:0/4061435815 learned_addr learned my addr 172.21.15.44:0/4061435815 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:41.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.274+0000 7faf33e00640 1 -- 172.21.15.44:0/4061435815 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf340d3e20 msgr2=0x7faf340b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.274+0000 7faf33e00640 1 --2- 172.21.15.44:0/4061435815 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf340d3e20 0x7faf340b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.274+0000 7faf33e00640 1 -- 172.21.15.44:0/4061435815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf3415e060 msgr2=0x7faf340b9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:41.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.274+0000 7faf33e00640 1 --2- 172.21.15.44:0/4061435815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf3415e060 0x7faf340b9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:41.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.274+0000 7faf33e00640 1 -- 172.21.15.44:0/4061435815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3415c300 con 0x7faf340cf800 2024-03-30T13:11:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.274+0000 7faf33e00640 1 --2- 172.21.15.44:0/4061435815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf340cf800 0x7faf34158270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf2400c430 tx=0x7faf2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.274+0000 7faf2be00640 1 -- 172.21.15.44:0/4061435815 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf24011790 con 0x7faf340cf800 2024-03-30T13:11:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.275+0000 7faf2be00640 1 -- 172.21.15.44:0/4061435815 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf24017070 con 0x7faf340cf800 2024-03-30T13:11:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.275+0000 7faf2be00640 1 -- 172.21.15.44:0/4061435815 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf24011bb0 con 0x7faf340cf800 2024-03-30T13:11:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.275+0000 7faf39400640 1 -- 172.21.15.44:0/4061435815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf340ca2f0 con 0x7faf340cf800 2024-03-30T13:11:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.275+0000 7faf39400640 1 -- 172.21.15.44:0/4061435815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf340ca8b0 con 0x7faf340cf800 2024-03-30T13:11:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.276+0000 7faf39400640 1 -- 172.21.15.44:0/4061435815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf3415c4d0 con 0x7faf340cf800 2024-03-30T13:11:41.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.277+0000 7faf2be00640 1 -- 172.21.15.44:0/4061435815 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7faf2401c460 con 0x7faf340cf800 2024-03-30T13:11:41.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.277+0000 7faf2be00640 1 --2- 172.21.15.44:0/4061435815 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faf1006c560 0x7faf1006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:41.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.278+0000 7faf2be00640 1 -- 172.21.15.44:0/4061435815 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7faf2408b620 con 0x7faf340cf800 2024-03-30T13:11:41.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.278+0000 7faf33400640 1 --2- 172.21.15.44:0/4061435815 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faf1006c560 0x7faf1006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:41.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.279+0000 7faf33400640 1 --2- 172.21.15.44:0/4061435815 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faf1006c560 0x7faf1006ea20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf1c036000 tx=0x7faf1c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:41.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.282+0000 7faf2be00640 1 -- 172.21.15.44:0/4061435815 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7faf24059ba0 con 0x7faf340cf800 2024-03-30T13:11:41.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:41.493+0000 7faf39400640 1 -- 172.21.15.44:0/4061435815 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7faf3409d730 con 0x7faf340cf800 2024-03-30T13:11:42.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.048+0000 7faf2be00640 1 -- 172.21.15.44:0/4061435815 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7faf240594a0 con 0x7faf340cf800 2024-03-30T13:11:42.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.052+0000 7faf39400640 1 -- 172.21.15.44:0/4061435815 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faf1006c560 msgr2=0x7faf1006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.052+0000 7faf39400640 1 --2- 172.21.15.44:0/4061435815 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faf1006c560 0x7faf1006ea20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf1c036000 tx=0x7faf1c030000 comp rx=0 tx=0).stop 2024-03-30T13:11:42.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.053+0000 7faf39400640 1 -- 172.21.15.44:0/4061435815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf340cf800 msgr2=0x7faf34158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.053+0000 7faf39400640 1 --2- 172.21.15.44:0/4061435815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf340cf800 0x7faf34158270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf2400c430 tx=0x7faf2400c8f0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.054+0000 7faf39400640 1 -- 172.21.15.44:0/4061435815 shutdown_connections 2024-03-30T13:11:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.054+0000 7faf39400640 1 --2- 172.21.15.44:0/4061435815 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faf1006c560 0x7faf1006ea20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.054+0000 7faf39400640 1 --2- 172.21.15.44:0/4061435815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf3415e060 0x7faf340b9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.054+0000 7faf39400640 1 --2- 172.21.15.44:0/4061435815 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf340d3e20 0x7faf340b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.054+0000 7faf39400640 1 --2- 172.21.15.44:0/4061435815 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf340cf800 0x7faf34158270 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.054+0000 7faf39400640 1 -- 172.21.15.44:0/4061435815 >> 172.21.15.44:0/4061435815 conn(0x7faf3408dc00 msgr2=0x7faf3406d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:42.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.054+0000 7faf39400640 1 -- 172.21.15.44:0/4061435815 shutdown_connections 2024-03-30T13:11:42.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.054+0000 7faf39400640 1 -- 172.21.15.44:0/4061435815 wait complete. 2024-03-30T13:11:42.081 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-03-30T13:11:42.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.309+0000 7faf53200640 1 Processor -- start 2024-03-30T13:11:42.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.309+0000 7faf53200640 1 -- start start 2024-03-30T13:11:42.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.311+0000 7faf53200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faf540d4af0 0x7faf540d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.311+0000 7faf53200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf540b0e60 con 0x7faf540d2cf0 2024-03-30T13:11:42.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.311+0000 7faf53200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf540d1b50 con 0x7faf54161b60 2024-03-30T13:11:42.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.311+0000 7faf53200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7faf540d3160 con 0x7faf540d4af0 2024-03-30T13:11:42.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.311+0000 7faf4be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7faf540d4af0 0x7faf540d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.311+0000 7faf52800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7faf540d2cf0 0x7faf540cf1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49998/0 (socket says 172.21.15.44:49998) 2024-03-30T13:11:42.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.311+0000 7faf52800640 1 -- 172.21.15.44:0/1898841505 learned_addr learned my addr 172.21.15.44:0/1898841505 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:42.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.312+0000 7faf4be00640 1 -- 172.21.15.44:0/1898841505 >> v1:172.21.15.151:6789/0 conn(0x7faf54161b60 legacy=0x7faf540d1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.312+0000 7faf4be00640 1 -- 172.21.15.44:0/1898841505 >> v1:172.21.15.44:6789/0 conn(0x7faf540d2cf0 legacy=0x7faf540cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.312+0000 7faf51400640 1 -- 172.21.15.44:0/1898841505 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461400721 0 0) 0x7faf540b0e60 con 0x7faf540d2cf0 2024-03-30T13:11:42.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.312+0000 7faf4be00640 1 -- 172.21.15.44:0/1898841505 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf540d12b0 con 0x7faf540d4af0 2024-03-30T13:11:42.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.313+0000 7faf4be00640 1 --2- 172.21.15.44:0/1898841505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf540d4af0 0x7faf540d27b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0097a0 tx=0x7faf3c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3e97de45d12fae server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:42.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.313+0000 7faf51400640 1 -- 172.21.15.44:0/1898841505 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c034070 con 0x7faf540d4af0 2024-03-30T13:11:42.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.313+0000 7faf51400640 1 -- 172.21.15.44:0/1898841505 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c030610 con 0x7faf540d4af0 2024-03-30T13:11:42.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.313+0000 7faf51400640 1 -- 172.21.15.44:0/1898841505 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0309e0 con 0x7faf540d4af0 2024-03-30T13:11:42.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.314+0000 7faf53200640 1 -- 172.21.15.44:0/1898841505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf540d4af0 msgr2=0x7faf540d27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.314+0000 7faf53200640 1 --2- 172.21.15.44:0/1898841505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf540d4af0 0x7faf540d27b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0097a0 tx=0x7faf3c02b960 comp rx=0 tx=0).stop 2024-03-30T13:11:42.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.314+0000 7faf53200640 1 -- 172.21.15.44:0/1898841505 shutdown_connections 2024-03-30T13:11:42.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.314+0000 7faf53200640 1 --2- 172.21.15.44:0/1898841505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf540d4af0 0x7faf540d27b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.314+0000 7faf53200640 1 -- 172.21.15.44:0/1898841505 >> 172.21.15.44:0/1898841505 conn(0x7faf5409d500 msgr2=0x7faf540d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:42.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.314+0000 7faf53200640 1 -- 172.21.15.44:0/1898841505 shutdown_connections 2024-03-30T13:11:42.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.314+0000 7faf53200640 1 -- 172.21.15.44:0/1898841505 wait complete. 2024-03-30T13:11:42.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.316+0000 7faf53200640 1 Processor -- start 2024-03-30T13:11:42.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.316+0000 7faf53200640 1 -- start start 2024-03-30T13:11:42.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf53200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf540d2cf0 0x7faf540cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf53200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf540d4af0 0x7faf541f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf53200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf54161b60 0x7faf54156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf53200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7faf540d5060 con 0x7faf540d4af0 2024-03-30T13:11:42.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf53200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faf540d1870 con 0x7faf54161b60 2024-03-30T13:11:42.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf53200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7faf54161f40 con 0x7faf540d2cf0 2024-03-30T13:11:42.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf4be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf540d4af0 0x7faf541f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf4be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf540d4af0 0x7faf541f4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49552/0 (socket says 172.21.15.44:49552) 2024-03-30T13:11:42.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf4be00640 1 -- 172.21.15.44:0/3493469655 learned_addr learned my addr 172.21.15.44:0/3493469655 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:42.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf51e00640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf540d2cf0 0x7faf540cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf52800640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf54161b60 0x7faf54156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf4be00640 1 -- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf540d2cf0 msgr2=0x7faf540cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.317+0000 7faf4be00640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf540d2cf0 0x7faf540cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.318+0000 7faf4be00640 1 -- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf54161b60 msgr2=0x7faf54156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:42.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.318+0000 7faf4be00640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf54161b60 0x7faf54156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:42.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.318+0000 7faf4be00640 1 -- 172.21.15.44:0/3493469655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf540c9980 con 0x7faf540d4af0 2024-03-30T13:11:42.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.318+0000 7faf52800640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf54161b60 0x7faf54156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:42.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.318+0000 7faf4be00640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf540d4af0 0x7faf541f4b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0098c0 tx=0x7faf3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:42.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.318+0000 7faf4a000640 1 -- 172.21.15.44:0/3493469655 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c034040 con 0x7faf540d4af0 2024-03-30T13:11:42.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.318+0000 7faf4a000640 1 -- 172.21.15.44:0/3493469655 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c039a10 con 0x7faf540d4af0 2024-03-30T13:11:42.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.318+0000 7faf4a000640 1 -- 172.21.15.44:0/3493469655 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c039de0 con 0x7faf540d4af0 2024-03-30T13:11:42.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.318+0000 7faf53200640 1 -- 172.21.15.44:0/3493469655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf540c9bf0 con 0x7faf540d4af0 2024-03-30T13:11:42.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.318+0000 7faf53200640 1 -- 172.21.15.44:0/3493469655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf540ca1b0 con 0x7faf540d4af0 2024-03-30T13:11:42.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.319+0000 7faf53200640 1 -- 172.21.15.44:0/3493469655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf540d2b10 con 0x7faf540d4af0 2024-03-30T13:11:42.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.320+0000 7faf4a000640 1 -- 172.21.15.44:0/3493469655 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7faf3c037070 con 0x7faf540d4af0 2024-03-30T13:11:42.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.322+0000 7faf4a000640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faf3006c530 0x7faf3006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:42.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.322+0000 7faf4a000640 1 -- 172.21.15.44:0/3493469655 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7faf3c0ad990 con 0x7faf540d4af0 2024-03-30T13:11:42.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.322+0000 7faf51e00640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faf3006c530 0x7faf3006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:42.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.323+0000 7faf51e00640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faf3006c530 0x7faf3006e9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf540ce8b0 tx=0x7faf44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:42.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.327+0000 7faf4a000640 1 -- 172.21.15.44:0/3493469655 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7faf540d2b10 con 0x7faf540d4af0 2024-03-30T13:11:42.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:42.531+0000 7faf53200640 1 -- 172.21.15.44:0/3493469655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7faf54075890 con 0x7faf540d4af0 2024-03-30T13:11:44.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.066+0000 7faf4a000640 1 -- 172.21.15.44:0/3493469655 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7faf3c07bf00 con 0x7faf540d4af0 2024-03-30T13:11:44.070 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data_ec' created 2024-03-30T13:11:44.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.069+0000 7faf53200640 1 -- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faf3006c530 msgr2=0x7faf3006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.069+0000 7faf53200640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faf3006c530 0x7faf3006e9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faf540ce8b0 tx=0x7faf44009040 comp rx=0 tx=0).stop 2024-03-30T13:11:44.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.069+0000 7faf53200640 1 -- 172.21.15.44:0/3493469655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf540d4af0 msgr2=0x7faf541f4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.069+0000 7faf53200640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf540d4af0 0x7faf541f4b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0098c0 tx=0x7faf3c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.070+0000 7faf53200640 1 -- 172.21.15.44:0/3493469655 shutdown_connections 2024-03-30T13:11:44.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.070+0000 7faf53200640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faf3006c530 0x7faf3006e9f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.070+0000 7faf53200640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf54161b60 0x7faf54156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.070+0000 7faf53200640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7faf540d4af0 0x7faf541f4b80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.070+0000 7faf53200640 1 --2- 172.21.15.44:0/3493469655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf540d2cf0 0x7faf540cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.070+0000 7faf53200640 1 -- 172.21.15.44:0/3493469655 >> 172.21.15.44:0/3493469655 conn(0x7faf5409d500 msgr2=0x7faf540b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:44.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.070+0000 7faf53200640 1 -- 172.21.15.44:0/3493469655 shutdown_connections 2024-03-30T13:11:44.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.070+0000 7faf53200640 1 -- 172.21.15.44:0/3493469655 wait complete. 2024-03-30T13:11:44.104 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-03-30T13:11:44.123 INFO:tasks.ceph.mds.b.smithi151.stderr:2024-03-30T13:11:44.120+0000 7fd048c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T13:11:44.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.295+0000 7f6030a00640 1 Processor -- start 2024-03-30T13:11:44.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.295+0000 7f6030a00640 1 -- start start 2024-03-30T13:11:44.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.297+0000 7f6030a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f602c0d01c0 0x7f602c0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:44.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.297+0000 7f6030a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f602c0ce690 0x7f602c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:44.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.297+0000 7f6030a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f602c15c780 con 0x7f602c13f000 2024-03-30T13:11:44.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.297+0000 7f6030a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f602c0d0b70 con 0x7f602c0d01c0 2024-03-30T13:11:44.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.297+0000 7f6030a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f602c15ca60 con 0x7f602c0ce690 2024-03-30T13:11:44.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.297+0000 7f602b200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f602c0ce690 0x7f602c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:44.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.297+0000 7f6029e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f602c0d01c0 0x7f602c0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.297+0000 7f602b200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f602c0ce690 0x7f602c0cea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:46912/0 (socket says 172.21.15.44:46912) 2024-03-30T13:11:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.297+0000 7f602b200640 1 -- 172.21.15.44:0/3463930946 learned_addr learned my addr 172.21.15.44:0/3463930946 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.297+0000 7f6029e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f602c0d01c0 0x7f602c0d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:42366/0 (socket says 172.21.15.44:42366) 2024-03-30T13:11:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.298+0000 7f6029e00640 1 -- 172.21.15.44:0/3463930946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f602c0ce690 msgr2=0x7f602c0cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.298+0000 7f6029e00640 1 --2- 172.21.15.44:0/3463930946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f602c0ce690 0x7f602c0cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.298+0000 7f6029e00640 1 -- 172.21.15.44:0/3463930946 >> v1:172.21.15.151:6789/0 conn(0x7f602c13f000 legacy=0x7f602c141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.298+0000 7f6029e00640 1 -- 172.21.15.44:0/3463930946 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602c15cd40 con 0x7f602c0d01c0 2024-03-30T13:11:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.299+0000 7f6029e00640 1 --2- 172.21.15.44:0/3463930946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f602c0d01c0 0x7f602c0d0630 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f60180097a0 tx=0x7f601802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89ae3ec0767cfdea server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.300+0000 7f6029400640 1 -- 172.21.15.44:0/3463930946 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018035020 con 0x7f602c0d01c0 2024-03-30T13:11:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.300+0000 7f6029400640 1 -- 172.21.15.44:0/3463930946 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6018031830 con 0x7f602c0d01c0 2024-03-30T13:11:44.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.300+0000 7f6029400640 1 -- 172.21.15.44:0/3463930946 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018031c00 con 0x7f602c0d01c0 2024-03-30T13:11:44.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.300+0000 7f6030a00640 1 -- 172.21.15.44:0/3463930946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f602c0d01c0 msgr2=0x7f602c0d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.300+0000 7f6030a00640 1 --2- 172.21.15.44:0/3463930946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f602c0d01c0 0x7f602c0d0630 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f60180097a0 tx=0x7f601802b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.301+0000 7f6030a00640 1 -- 172.21.15.44:0/3463930946 shutdown_connections 2024-03-30T13:11:44.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.301+0000 7f6030a00640 1 --2- 172.21.15.44:0/3463930946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f602c0ce690 0x7f602c0cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.301+0000 7f6030a00640 1 --2- 172.21.15.44:0/3463930946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f602c0d01c0 0x7f602c0d0630 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.301+0000 7f6030a00640 1 -- 172.21.15.44:0/3463930946 >> 172.21.15.44:0/3463930946 conn(0x7f602c06b9a0 msgr2=0x7f602c06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:44.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.301+0000 7f6030a00640 1 -- 172.21.15.44:0/3463930946 shutdown_connections 2024-03-30T13:11:44.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.301+0000 7f6030a00640 1 -- 172.21.15.44:0/3463930946 wait complete. 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.303+0000 7f6030a00640 1 Processor -- start 2024-03-30T13:11:44.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.303+0000 7f6030a00640 1 -- start start 2024-03-30T13:11:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.304+0000 7f6030a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f602c0ce690 0x7f602c072b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.304+0000 7f6030a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f602c0d01c0 0x7f602c0b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.304+0000 7f6030a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f602c13f000 0x7f602c1428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.304+0000 7f6030a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f602c13f3e0 con 0x7f602c0d01c0 2024-03-30T13:11:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.304+0000 7f6030a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f602c1426d0 con 0x7f602c13f000 2024-03-30T13:11:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.304+0000 7f6030a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f602c13f560 con 0x7f602c0ce690 2024-03-30T13:11:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.305+0000 7f6029e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f602c0d01c0 0x7f602c0b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.305+0000 7f6029e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f602c0d01c0 0x7f602c0b0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49554/0 (socket says 172.21.15.44:49554) 2024-03-30T13:11:44.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.305+0000 7f6029e00640 1 -- 172.21.15.44:0/3202445639 learned_addr learned my addr 172.21.15.44:0/3202445639 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.305+0000 7f602b200640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f602c13f000 0x7f602c1428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.305+0000 7f602a800640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f602c0ce690 0x7f602c072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.305+0000 7f6029e00640 1 -- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f602c0ce690 msgr2=0x7f602c072b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.305+0000 7f6029e00640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f602c0ce690 0x7f602c072b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.305+0000 7f6029e00640 1 -- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f602c13f000 msgr2=0x7f602c1428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.305+0000 7f6029e00640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f602c13f000 0x7f602c1428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.305+0000 7f6029e00640 1 -- 172.21.15.44:0/3202445639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602c0b4820 con 0x7f602c0d01c0 2024-03-30T13:11:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.305+0000 7f602a800640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f602c0ce690 0x7f602c072b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.306+0000 7f6029e00640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f602c0d01c0 0x7f602c0b0230 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f601802bee0 tx=0x7f60180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.306+0000 7f6022a00640 1 -- 172.21.15.44:0/3202445639 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018041070 con 0x7f602c0d01c0 2024-03-30T13:11:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.306+0000 7f6022a00640 1 -- 172.21.15.44:0/3202445639 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601803b920 con 0x7f602c0d01c0 2024-03-30T13:11:44.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.306+0000 7f6022a00640 1 -- 172.21.15.44:0/3202445639 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6018035040 con 0x7f602c0d01c0 2024-03-30T13:11:44.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.306+0000 7f6030a00640 1 -- 172.21.15.44:0/3202445639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602c0b4b00 con 0x7f602c0d01c0 2024-03-30T13:11:44.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.306+0000 7f6030a00640 1 -- 172.21.15.44:0/3202445639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602c0730d0 con 0x7f602c0d01c0 2024-03-30T13:11:44.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.307+0000 7f6030a00640 1 -- 172.21.15.44:0/3202445639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602c075890 con 0x7f602c0d01c0 2024-03-30T13:11:44.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.308+0000 7f6022a00640 1 -- 172.21.15.44:0/3202445639 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f601804c060 con 0x7f602c0d01c0 2024-03-30T13:11:44.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.310+0000 7f6022a00640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f600c06c530 0x7f600c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:44.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.310+0000 7f6022a00640 1 -- 172.21.15.44:0/3202445639 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f60180ad320 con 0x7f602c0d01c0 2024-03-30T13:11:44.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.311+0000 7f602a800640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f600c06c530 0x7f600c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:44.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.312+0000 7f602a800640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f600c06c530 0x7f600c06e9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f601c000f60 tx=0x7f601c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:44.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.317+0000 7f6022a00640 1 -- 172.21.15.44:0/3202445639 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f601807b580 con 0x7f602c0d01c0 2024-03-30T13:11:44.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:44.519+0000 7f6030a00640 1 -- 172.21.15.44:0/3202445639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f602c0736c0 con 0x7f602c0d01c0 2024-03-30T13:11:45.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.070+0000 7f6022a00640 1 -- 172.21.15.44:0/3202445639 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7f601807ae80 con 0x7f602c0d01c0 2024-03-30T13:11:45.076 INFO:teuthology.orchestra.run.smithi044.stderr:set pool 4 allow_ec_overwrites to true 2024-03-30T13:11:45.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.074+0000 7f6030a00640 1 -- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f600c06c530 msgr2=0x7f600c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.074+0000 7f6030a00640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f600c06c530 0x7f600c06e9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f601c000f60 tx=0x7f601c009040 comp rx=0 tx=0).stop 2024-03-30T13:11:45.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.074+0000 7f6030a00640 1 -- 172.21.15.44:0/3202445639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f602c0d01c0 msgr2=0x7f602c0b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.074+0000 7f6030a00640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f602c0d01c0 0x7f602c0b0230 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f601802bee0 tx=0x7f60180046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.075+0000 7f6030a00640 1 -- 172.21.15.44:0/3202445639 shutdown_connections 2024-03-30T13:11:45.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.075+0000 7f6030a00640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f600c06c530 0x7f600c06e9f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.075+0000 7f6030a00640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f602c13f000 0x7f602c1428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.075+0000 7f6030a00640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f602c0d01c0 0x7f602c0b0230 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.075+0000 7f6030a00640 1 --2- 172.21.15.44:0/3202445639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f602c0ce690 0x7f602c072b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.075+0000 7f6030a00640 1 -- 172.21.15.44:0/3202445639 >> 172.21.15.44:0/3202445639 conn(0x7f602c06b9a0 msgr2=0x7f602c0b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:45.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.075+0000 7f6030a00640 1 -- 172.21.15.44:0/3202445639 shutdown_connections 2024-03-30T13:11:45.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.075+0000 7f6030a00640 1 -- 172.21.15.44:0/3202445639 wait complete. 2024-03-30T13:11:45.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-03-30T13:11:45.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.299+0000 7efcd0c00640 1 Processor -- start 2024-03-30T13:11:45.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.300+0000 7efcd0c00640 1 -- start start 2024-03-30T13:11:45.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.301+0000 7efcd0c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efccc0d0700 0x7efccc0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.301+0000 7efcd0c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efccc0b39b0 0x7efccc071630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.301+0000 7efcd0c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efccc071b70 0x7efccc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.301+0000 7efcd0c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7efccc164010 con 0x7efccc071b70 2024-03-30T13:11:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.301+0000 7efcd0c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7efccc0b3ec0 con 0x7efccc0d0700 2024-03-30T13:11:45.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.301+0000 7efcd0c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7efccc0b41a0 con 0x7efccc0b39b0 2024-03-30T13:11:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.301+0000 7efcca800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efccc071b70 0x7efccc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.301+0000 7efcca800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efccc071b70 0x7efccc06d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49558/0 (socket says 172.21.15.44:49558) 2024-03-30T13:11:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.301+0000 7efcca800640 1 -- 172.21.15.44:0/1424472960 learned_addr learned my addr 172.21.15.44:0/1424472960 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.302+0000 7efcc1400640 1 --2- 172.21.15.44:0/1424472960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efccc0b39b0 0x7efccc071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.302+0000 7efcc9e00640 1 --2- 172.21.15.44:0/1424472960 >> v2:172.21.15.151:3300/0 conn(0x7efccc0d0700 0x7efccc0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.302+0000 7efcca800640 1 -- 172.21.15.44:0/1424472960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efccc0b39b0 msgr2=0x7efccc071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.302+0000 7efcca800640 1 --2- 172.21.15.44:0/1424472960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efccc0b39b0 0x7efccc071630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.302+0000 7efcca800640 1 -- 172.21.15.44:0/1424472960 >> v2:172.21.15.151:3300/0 conn(0x7efccc0d0700 msgr2=0x7efccc0b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.302+0000 7efcca800640 1 --2- 172.21.15.44:0/1424472960 >> v2:172.21.15.151:3300/0 conn(0x7efccc0d0700 0x7efccc0b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.302+0000 7efcca800640 1 -- 172.21.15.44:0/1424472960 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc0b4480 con 0x7efccc071b70 2024-03-30T13:11:45.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.302+0000 7efcc1400640 1 --2- 172.21.15.44:0/1424472960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efccc0b39b0 0x7efccc071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.303+0000 7efcca800640 1 --2- 172.21.15.44:0/1424472960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efccc071b70 0x7efccc06d1e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efccc06f7a0 tx=0x7efcc402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=523420b0efcd6115 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.303+0000 7efcc9400640 1 -- 172.21.15.44:0/1424472960 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc402c9e0 con 0x7efccc071b70 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.303+0000 7efcc9400640 1 -- 172.21.15.44:0/1424472960 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc402cb80 con 0x7efccc071b70 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.303+0000 7efcc9400640 1 -- 172.21.15.44:0/1424472960 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc40343f0 con 0x7efccc071b70 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.304+0000 7efcd0c00640 1 -- 172.21.15.44:0/1424472960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efccc071b70 msgr2=0x7efccc06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.304+0000 7efcd0c00640 1 --2- 172.21.15.44:0/1424472960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efccc071b70 0x7efccc06d1e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efccc06f7a0 tx=0x7efcc402be40 comp rx=0 tx=0).stop 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.304+0000 7efcd0c00640 1 -- 172.21.15.44:0/1424472960 shutdown_connections 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.304+0000 7efcd0c00640 1 --2- 172.21.15.44:0/1424472960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efccc071b70 0x7efccc06d1e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.304+0000 7efcd0c00640 1 --2- 172.21.15.44:0/1424472960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efccc0b39b0 0x7efccc071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.304+0000 7efcd0c00640 1 --2- 172.21.15.44:0/1424472960 >> v2:172.21.15.151:3300/0 conn(0x7efccc0d0700 0x7efccc0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.304+0000 7efcd0c00640 1 -- 172.21.15.44:0/1424472960 >> 172.21.15.44:0/1424472960 conn(0x7efccc0b5b00 msgr2=0x7efccc06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.304+0000 7efcd0c00640 1 -- 172.21.15.44:0/1424472960 shutdown_connections 2024-03-30T13:11:45.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.304+0000 7efcd0c00640 1 -- 172.21.15.44:0/1424472960 wait complete. 2024-03-30T13:11:45.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.306+0000 7efcd0c00640 1 Processor -- start 2024-03-30T13:11:45.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.306+0000 7efcd0c00640 1 -- start start 2024-03-30T13:11:45.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.307+0000 7efcd0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efccc071b70 0x7efccc153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.307+0000 7efcd0c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efccc0b39b0 0x7efccc13e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.307+0000 7efcd0c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efccc0d0700 0x7efccc14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.307+0000 7efcd0c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efccc163200 con 0x7efccc071b70 2024-03-30T13:11:45.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.307+0000 7efcd0c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efccc163080 con 0x7efccc0b39b0 2024-03-30T13:11:45.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.307+0000 7efcd0c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7efccc06d720 con 0x7efccc0d0700 2024-03-30T13:11:45.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.307+0000 7efcc9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efccc071b70 0x7efccc153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.307+0000 7efcc9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efccc071b70 0x7efccc153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49562/0 (socket says 172.21.15.44:49562) 2024-03-30T13:11:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.307+0000 7efcc9e00640 1 -- 172.21.15.44:0/3456751659 learned_addr learned my addr 172.21.15.44:0/3456751659 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.307+0000 7efcc1400640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efccc0b39b0 0x7efccc13e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcca800640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efccc0d0700 0x7efccc14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcc9e00640 1 -- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efccc0d0700 msgr2=0x7efccc14f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcc9e00640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efccc0d0700 0x7efccc14f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcc9e00640 1 -- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efccc0b39b0 msgr2=0x7efccc13e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcc9e00640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efccc0b39b0 0x7efccc13e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:45.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcc9e00640 1 -- 172.21.15.44:0/3456751659 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc153790 con 0x7efccc071b70 2024-03-30T13:11:45.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcc1400640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efccc0b39b0 0x7efccc13e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:45.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcc9e00640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efccc071b70 0x7efccc153250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00c7f0 tx=0x7efcbc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:45.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcc2a00640 1 -- 172.21.15.44:0/3456751659 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc015070 con 0x7efccc071b70 2024-03-30T13:11:45.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcc2a00640 1 -- 172.21.15.44:0/3456751659 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcbc004220 con 0x7efccc071b70 2024-03-30T13:11:45.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcd0c00640 1 -- 172.21.15.44:0/3456751659 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efccc1f8db0 con 0x7efccc071b70 2024-03-30T13:11:45.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcc2a00640 1 -- 172.21.15.44:0/3456751659 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcbc007620 con 0x7efccc071b70 2024-03-30T13:11:45.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.308+0000 7efcd0c00640 1 -- 172.21.15.44:0/3456751659 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efccc1f9370 con 0x7efccc071b70 2024-03-30T13:11:45.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.309+0000 7efcd0c00640 1 -- 172.21.15.44:0/3456751659 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efccc075890 con 0x7efccc071b70 2024-03-30T13:11:45.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.310+0000 7efcc2a00640 1 -- 172.21.15.44:0/3456751659 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7efcbc0079d0 con 0x7efccc071b70 2024-03-30T13:11:45.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.311+0000 7efcc2a00640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efca806c530 0x7efca806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:45.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.311+0000 7efcc2a00640 1 -- 172.21.15.44:0/3456751659 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7efcbc08bd80 con 0x7efccc071b70 2024-03-30T13:11:45.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.312+0000 7efcc1400640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efca806c530 0x7efca806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:45.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.313+0000 7efcc1400640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efca806c530 0x7efca806e9f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efccc1fbf40 tx=0x7efcb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:45.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.316+0000 7efcc2a00640 1 -- 172.21.15.44:0/3456751659 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7efcbc059fe0 con 0x7efccc071b70 2024-03-30T13:11:45.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:45.563+0000 7efcd0c00640 1 -- 172.21.15.44:0/3456751659 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7efccc0b2eb0 con 0x7efccc071b70 2024-03-30T13:11:46.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.108+0000 7efcc2a00640 1 -- 172.21.15.44:0/3456751659 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7efcbc05ee20 con 0x7efccc071b70 2024-03-30T13:11:46.112 INFO:teuthology.orchestra.run.smithi044.stderr:added data pool 4 to fsmap 2024-03-30T13:11:46.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.112+0000 7efcd0c00640 1 -- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efca806c530 msgr2=0x7efca806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.112+0000 7efcd0c00640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efca806c530 0x7efca806e9f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efccc1fbf40 tx=0x7efcb4008040 comp rx=0 tx=0).stop 2024-03-30T13:11:46.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.112+0000 7efcd0c00640 1 -- 172.21.15.44:0/3456751659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efccc071b70 msgr2=0x7efccc153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.112+0000 7efcd0c00640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efccc071b70 0x7efccc153250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efcbc00c7f0 tx=0x7efcbc00ccb0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.112+0000 7efcd0c00640 1 -- 172.21.15.44:0/3456751659 shutdown_connections 2024-03-30T13:11:46.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.112+0000 7efcd0c00640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efccc0d0700 0x7efccc14f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.112+0000 7efcd0c00640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efca806c530 0x7efca806e9f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.112+0000 7efcd0c00640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efccc0b39b0 0x7efccc13e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.112+0000 7efcd0c00640 1 --2- 172.21.15.44:0/3456751659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efccc071b70 0x7efccc153250 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.112+0000 7efcd0c00640 1 -- 172.21.15.44:0/3456751659 >> 172.21.15.44:0/3456751659 conn(0x7efccc0b5b00 msgr2=0x7efccc06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:46.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.112+0000 7efcd0c00640 1 -- 172.21.15.44:0/3456751659 shutdown_connections 2024-03-30T13:11:46.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.112+0000 7efcd0c00640 1 -- 172.21.15.44:0/3456751659 wait complete. 2024-03-30T13:11:46.142 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:46.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.364+0000 7f6257200640 1 Processor -- start 2024-03-30T13:11:46.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.365+0000 7f6257200640 1 -- start start 2024-03-30T13:11:46.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.366+0000 7f6257200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f62580d4950 0x7f6258161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.366+0000 7f6257200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f62580d1110 0x7f6258161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.366+0000 7f6257200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62580b5b60 con 0x7f62580d0d30 2024-03-30T13:11:46.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.366+0000 7f6257200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f62580c7b90 con 0x7f62580d1110 2024-03-30T13:11:46.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.366+0000 7f6257200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f62580d4fc0 con 0x7f62580d4950 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.367+0000 7f6256800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f62580d1110 0x7f6258161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.367+0000 7f6255e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f62580d0d30 0x7f62580cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:50000/0 (socket says 172.21.15.44:50000) 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.367+0000 7f6255e00640 1 -- 172.21.15.44:0/2677867675 learned_addr learned my addr 172.21.15.44:0/2677867675 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.367+0000 7f6255400640 1 --2- 172.21.15.44:0/2677867675 >> v2:172.21.15.151:3300/0 conn(0x7f62580d4950 0x7f6258161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.367+0000 7f6256800640 1 -- 172.21.15.44:0/2677867675 >> v2:172.21.15.151:3300/0 conn(0x7f62580d4950 msgr2=0x7f6258161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.367+0000 7f6256800640 1 --2- 172.21.15.44:0/2677867675 >> v2:172.21.15.151:3300/0 conn(0x7f62580d4950 0x7f6258161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.367+0000 7f6256800640 1 -- 172.21.15.44:0/2677867675 >> v1:172.21.15.44:6789/0 conn(0x7f62580d0d30 legacy=0x7f62580cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.367+0000 7f6256800640 1 -- 172.21.15.44:0/2677867675 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62580b57f0 con 0x7f62580d1110 2024-03-30T13:11:46.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.367+0000 7f6254a00640 1 -- 172.21.15.44:0/2677867675 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3271646958 0 0) 0x7f62580b5b60 con 0x7f62580d0d30 2024-03-30T13:11:46.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.368+0000 7f6256800640 1 --2- 172.21.15.44:0/2677867675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62580d1110 0x7f6258161ca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6258068f70 tx=0x7f625002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e625a7a7ceffaf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:46.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.369+0000 7f6254a00640 1 -- 172.21.15.44:0/2677867675 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500315a0 con 0x7f62580d1110 2024-03-30T13:11:46.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.369+0000 7f6254a00640 1 -- 172.21.15.44:0/2677867675 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6250037070 con 0x7f62580d1110 2024-03-30T13:11:46.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.369+0000 7f6254a00640 1 -- 172.21.15.44:0/2677867675 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250031960 con 0x7f62580d1110 2024-03-30T13:11:46.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.369+0000 7f6257200640 1 -- 172.21.15.44:0/2677867675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62580d1110 msgr2=0x7f6258161ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.369+0000 7f6257200640 1 --2- 172.21.15.44:0/2677867675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62580d1110 0x7f6258161ca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6258068f70 tx=0x7f625002b840 comp rx=0 tx=0).stop 2024-03-30T13:11:46.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.369+0000 7f6257200640 1 -- 172.21.15.44:0/2677867675 shutdown_connections 2024-03-30T13:11:46.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.369+0000 7f6257200640 1 --2- 172.21.15.44:0/2677867675 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62580d1110 0x7f6258161ca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.369+0000 7f6257200640 1 --2- 172.21.15.44:0/2677867675 >> v2:172.21.15.151:3300/0 conn(0x7f62580d4950 0x7f6258161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.369+0000 7f6257200640 1 -- 172.21.15.44:0/2677867675 >> 172.21.15.44:0/2677867675 conn(0x7f625809d570 msgr2=0x7f62580d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:46.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.369+0000 7f6257200640 1 -- 172.21.15.44:0/2677867675 shutdown_connections 2024-03-30T13:11:46.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.369+0000 7f6257200640 1 -- 172.21.15.44:0/2677867675 wait complete. 2024-03-30T13:11:46.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.371+0000 7f6257200640 1 Processor -- start 2024-03-30T13:11:46.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.371+0000 7f6257200640 1 -- start start 2024-03-30T13:11:46.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.372+0000 7f6257200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62580d0d30 0x7f625814f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.372+0000 7f6257200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62580d1110 0x7f625814f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.372+0000 7f6257200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62580d4950 0x7f625814fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.372+0000 7f6257200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f62580d32d0 con 0x7f62580d0d30 2024-03-30T13:11:46.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.372+0000 7f6257200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f62580d3150 con 0x7f62580d1110 2024-03-30T13:11:46.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.372+0000 7f6257200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f62580d3450 con 0x7f62580d4950 2024-03-30T13:11:46.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.372+0000 7f6255e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62580d0d30 0x7f625814f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.372+0000 7f6255e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62580d0d30 0x7f625814f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49574/0 (socket says 172.21.15.44:49574) 2024-03-30T13:11:46.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.372+0000 7f6255e00640 1 -- 172.21.15.44:0/2356269662 learned_addr learned my addr 172.21.15.44:0/2356269662 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:46.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.373+0000 7f6255e00640 1 -- 172.21.15.44:0/2356269662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62580d4950 msgr2=0x7f625814fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.373+0000 7f6255e00640 1 --2- 172.21.15.44:0/2356269662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62580d4950 0x7f625814fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.373+0000 7f6255e00640 1 -- 172.21.15.44:0/2356269662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62580d1110 msgr2=0x7f625814f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.373+0000 7f6255e00640 1 --2- 172.21.15.44:0/2356269662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62580d1110 0x7f625814f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.373+0000 7f6255e00640 1 -- 172.21.15.44:0/2356269662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625814e0c0 con 0x7f62580d0d30 2024-03-30T13:11:46.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.373+0000 7f6255e00640 1 --2- 172.21.15.44:0/2356269662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62580d0d30 0x7f625814f140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f624800c7c0 tx=0x7f624800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:46.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.373+0000 7f624e000640 1 -- 172.21.15.44:0/2356269662 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6248018070 con 0x7f62580d0d30 2024-03-30T13:11:46.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.373+0000 7f624e000640 1 -- 172.21.15.44:0/2356269662 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624800a640 con 0x7f62580d0d30 2024-03-30T13:11:46.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.373+0000 7f624e000640 1 -- 172.21.15.44:0/2356269662 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624800aa30 con 0x7f62580d0d30 2024-03-30T13:11:46.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.373+0000 7f6257200640 1 -- 172.21.15.44:0/2356269662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625814e380 con 0x7f62580d0d30 2024-03-30T13:11:46.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.373+0000 7f6257200640 1 -- 172.21.15.44:0/2356269662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625814e940 con 0x7f62580d0d30 2024-03-30T13:11:46.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.374+0000 7f6257200640 1 -- 172.21.15.44:0/2356269662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6258075890 con 0x7f62580d0d30 2024-03-30T13:11:46.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.375+0000 7f624e000640 1 -- 172.21.15.44:0/2356269662 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f624800abd0 con 0x7f62580d0d30 2024-03-30T13:11:46.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.376+0000 7f624e000640 1 --2- 172.21.15.44:0/2356269662 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f623406c530 0x7f623406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.376+0000 7f624e000640 1 -- 172.21.15.44:0/2356269662 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f624808b1f0 con 0x7f62580d0d30 2024-03-30T13:11:46.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.377+0000 7f6255400640 1 --2- 172.21.15.44:0/2356269662 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f623406c530 0x7f623406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.378+0000 7f6255400640 1 --2- 172.21.15.44:0/2356269662 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f623406c530 0x7f623406e9f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f62580cd020 tx=0x7f6240008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:46.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.383+0000 7f624e000640 1 -- 172.21.15.44:0/2356269662 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f62480593a0 con 0x7f62580d0d30 2024-03-30T13:11:46.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.619+0000 7f6257200640 1 -- 172.21.15.44:0/2356269662 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62580b4450 con 0x7f62580d0d30 2024-03-30T13:11:46.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.621+0000 7f624e000640 1 -- 172.21.15.44:0/2356269662 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5180 (secure 0 0 0) 0x7f6248058ca0 con 0x7f62580d0d30 2024-03-30T13:11:46.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:46.624 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1458748329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1458748329},{"type":"v1","addr":"172.21.15.44:6834","nonce":1458748329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3921281718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3921281718},{"type":"v1","addr":"172.21.15.151:6837","nonce":3921281718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2065829800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2065829800},{"type":"v1","addr":"172.21.15.44:6835","nonce":2065829800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:11:40.531273+0000","modified":"2024-03-30T13:11:45.565178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/456394190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":456394190},{"type":"v1","addr":"172.21.15.151:6835","nonce":456394190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4276,"qdb_cluster":[4276]},"id":1}]} 2024-03-30T13:11:46.625 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-03-30T13:11:46.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.623+0000 7f6257200640 1 -- 172.21.15.44:0/2356269662 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f623406c530 msgr2=0x7f623406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.623+0000 7f6257200640 1 --2- 172.21.15.44:0/2356269662 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f623406c530 0x7f623406e9f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f62580cd020 tx=0x7f6240008040 comp rx=0 tx=0).stop 2024-03-30T13:11:46.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.623+0000 7f6257200640 1 -- 172.21.15.44:0/2356269662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62580d0d30 msgr2=0x7f625814f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.623+0000 7f6257200640 1 --2- 172.21.15.44:0/2356269662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62580d0d30 0x7f625814f140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f624800c7c0 tx=0x7f624800cc80 comp rx=0 tx=0).stop 2024-03-30T13:11:46.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.623+0000 7f6257200640 1 -- 172.21.15.44:0/2356269662 shutdown_connections 2024-03-30T13:11:46.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.623+0000 7f6257200640 1 --2- 172.21.15.44:0/2356269662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62580d4950 0x7f625814fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.623+0000 7f6257200640 1 --2- 172.21.15.44:0/2356269662 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f623406c530 0x7f623406e9f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.623+0000 7f6257200640 1 --2- 172.21.15.44:0/2356269662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62580d1110 0x7f625814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.623+0000 7f6257200640 1 --2- 172.21.15.44:0/2356269662 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62580d0d30 0x7f625814f140 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.623+0000 7f6257200640 1 -- 172.21.15.44:0/2356269662 >> 172.21.15.44:0/2356269662 conn(0x7f625809d570 msgr2=0x7f62580b5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.623+0000 7f6257200640 1 -- 172.21.15.44:0/2356269662 shutdown_connections 2024-03-30T13:11:46.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.623+0000 7f6257200640 1 -- 172.21.15.44:0/2356269662 wait complete. 2024-03-30T13:11:46.644 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:46.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.856+0000 7f81a1a00640 1 Processor -- start 2024-03-30T13:11:46.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.856+0000 7f81a1a00640 1 -- start start 2024-03-30T13:11:46.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.858+0000 7f81a1a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f819c145c60 0x7f819c071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.858+0000 7f81a1a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f819c160830 0x7f819c0ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.858+0000 7f81a1a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f819c146040 con 0x7f819c071a60 2024-03-30T13:11:46.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.858+0000 7f81a1a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f819c071ed0 con 0x7f819c160830 2024-03-30T13:11:46.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.858+0000 7f81a1a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f819c160e50 con 0x7f819c145c60 2024-03-30T13:11:46.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.858+0000 7f819b400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f819c160830 0x7f819c0ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.858+0000 7f819b400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f819c160830 0x7f819c0ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49590/0 (socket says 172.21.15.44:49590) 2024-03-30T13:11:46.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.858+0000 7f819b400640 1 -- 172.21.15.44:0/745729763 learned_addr learned my addr 172.21.15.44:0/745729763 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:46.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.858+0000 7f819aa00640 1 --2- 172.21.15.44:0/745729763 >> v2:172.21.15.151:3300/0 conn(0x7f819c145c60 0x7f819c071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.859+0000 7f819b400640 1 -- 172.21.15.44:0/745729763 >> v2:172.21.15.151:3300/0 conn(0x7f819c145c60 msgr2=0x7f819c071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:46.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.859+0000 7f819b400640 1 --2- 172.21.15.44:0/745729763 >> v2:172.21.15.151:3300/0 conn(0x7f819c145c60 0x7f819c071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.859+0000 7f819b400640 1 -- 172.21.15.44:0/745729763 >> v1:172.21.15.151:6789/0 conn(0x7f819c071a60 legacy=0x7f819c160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.859+0000 7f819b400640 1 -- 172.21.15.44:0/745729763 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819c15d8b0 con 0x7f819c160830 2024-03-30T13:11:46.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.860+0000 7f819b400640 1 --2- 172.21.15.44:0/745729763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c160830 0x7f819c0ca830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f819c06e580 tx=0x7f819402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ec3db60fe1b590 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:46.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.861+0000 7f8199600640 1 -- 172.21.15.44:0/745729763 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819402ca80 con 0x7f819c160830 2024-03-30T13:11:46.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.861+0000 7f8199600640 1 -- 172.21.15.44:0/745729763 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f819402cc20 con 0x7f819c160830 2024-03-30T13:11:46.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.861+0000 7f8199600640 1 -- 172.21.15.44:0/745729763 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81940343f0 con 0x7f819c160830 2024-03-30T13:11:46.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.862+0000 7f81a1a00640 1 -- 172.21.15.44:0/745729763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c160830 msgr2=0x7f819c0ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.862+0000 7f81a1a00640 1 --2- 172.21.15.44:0/745729763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c160830 0x7f819c0ca830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f819c06e580 tx=0x7f819402bee0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.862+0000 7f81a1a00640 1 -- 172.21.15.44:0/745729763 shutdown_connections 2024-03-30T13:11:46.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.862+0000 7f81a1a00640 1 --2- 172.21.15.44:0/745729763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c160830 0x7f819c0ca830 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.862+0000 7f81a1a00640 1 --2- 172.21.15.44:0/745729763 >> v2:172.21.15.151:3300/0 conn(0x7f819c145c60 0x7f819c071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.862+0000 7f81a1a00640 1 -- 172.21.15.44:0/745729763 >> 172.21.15.44:0/745729763 conn(0x7f819c0b1c90 msgr2=0x7f819c0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:46.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.862+0000 7f81a1a00640 1 -- 172.21.15.44:0/745729763 shutdown_connections 2024-03-30T13:11:46.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.862+0000 7f81a1a00640 1 -- 172.21.15.44:0/745729763 wait complete. 2024-03-30T13:11:46.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.864+0000 7f81a1a00640 1 Processor -- start 2024-03-30T13:11:46.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.864+0000 7f81a1a00640 1 -- start start 2024-03-30T13:11:46.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f81a1a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f819c071a60 0x7f819c144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f81a1a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c145c60 0x7f819c1f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f81a1a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c160830 0x7f819c140020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f81a1a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f819c15d0b0 con 0x7f819c145c60 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f81a1a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f819c15cdd0 con 0x7f819c160830 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f81a1a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f819c0cad70 con 0x7f819c071a60 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f819a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c145c60 0x7f819c1f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f819a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c145c60 0x7f819c1f5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49596/0 (socket says 172.21.15.44:49596) 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f819a000640 1 -- 172.21.15.44:0/2284953010 learned_addr learned my addr 172.21.15.44:0/2284953010 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f819aa00640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f819c071a60 0x7f819c144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f819b400640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c160830 0x7f819c140020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f819a000640 1 -- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f819c071a60 msgr2=0x7f819c144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f819a000640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f819c071a60 0x7f819c144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f819a000640 1 -- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c160830 msgr2=0x7f819c140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:46.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f819a000640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c160830 0x7f819c140020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:46.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f819a000640 1 -- 172.21.15.44:0/2284953010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f819c0b4c70 con 0x7f819c145c60 2024-03-30T13:11:46.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f819aa00640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f819c071a60 0x7f819c144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:46.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.865+0000 7f819b400640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c160830 0x7f819c140020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:46.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.866+0000 7f819a000640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c145c60 0x7f819c1f5930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f818800c400 tx=0x7f818800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:46.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.866+0000 7f8192a00640 1 -- 172.21.15.44:0/2284953010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81880052d0 con 0x7f819c145c60 2024-03-30T13:11:46.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.866+0000 7f8192a00640 1 -- 172.21.15.44:0/2284953010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8188005490 con 0x7f819c145c60 2024-03-30T13:11:46.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.866+0000 7f8192a00640 1 -- 172.21.15.44:0/2284953010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8188007260 con 0x7f819c145c60 2024-03-30T13:11:46.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.866+0000 7f81a1a00640 1 -- 172.21.15.44:0/2284953010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f819c0b4f50 con 0x7f819c145c60 2024-03-30T13:11:46.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.866+0000 7f81a1a00640 1 -- 172.21.15.44:0/2284953010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f819c0b57f0 con 0x7f819c145c60 2024-03-30T13:11:46.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.867+0000 7f81a1a00640 1 -- 172.21.15.44:0/2284953010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f819c075a10 con 0x7f819c145c60 2024-03-30T13:11:46.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.868+0000 7f8192a00640 1 -- 172.21.15.44:0/2284953010 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8188007400 con 0x7f819c145c60 2024-03-30T13:11:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.870+0000 7f8192a00640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f817c06c530 0x7f817c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.870+0000 7f8192a00640 1 -- 172.21.15.44:0/2284953010 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f818808af90 con 0x7f819c145c60 2024-03-30T13:11:46.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.870+0000 7f819aa00640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f817c06c530 0x7f817c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:46.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.872+0000 7f819aa00640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f817c06c530 0x7f817c06e9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f818c006fd0 tx=0x7f818c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:46.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:46.876+0000 7f8192a00640 1 -- 172.21.15.44:0/2284953010 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8188059270 con 0x7f819c145c60 2024-03-30T13:11:47.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.078+0000 7f81a1a00640 1 -- 172.21.15.44:0/2284953010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f819c0ca610 con 0x7f819c145c60 2024-03-30T13:11:47.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.080+0000 7f8192a00640 1 -- 172.21.15.44:0/2284953010 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7f8188058b70 con 0x7f819c145c60 2024-03-30T13:11:47.085 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:47.085 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:47.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.082+0000 7f81a1a00640 1 -- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f817c06c530 msgr2=0x7f817c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.082+0000 7f81a1a00640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f817c06c530 0x7f817c06e9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f818c006fd0 tx=0x7f818c008040 comp rx=0 tx=0).stop 2024-03-30T13:11:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.082+0000 7f81a1a00640 1 -- 172.21.15.44:0/2284953010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c145c60 msgr2=0x7f819c1f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.083+0000 7f81a1a00640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c145c60 0x7f819c1f5930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f818800c400 tx=0x7f818800c8c0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.083+0000 7f81a1a00640 1 -- 172.21.15.44:0/2284953010 shutdown_connections 2024-03-30T13:11:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.083+0000 7f81a1a00640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f817c06c530 0x7f817c06e9f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.083+0000 7f81a1a00640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c160830 0x7f819c140020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.083+0000 7f81a1a00640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f819c145c60 0x7f819c1f5930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.083+0000 7f81a1a00640 1 --2- 172.21.15.44:0/2284953010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f819c071a60 0x7f819c144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.083+0000 7f81a1a00640 1 -- 172.21.15.44:0/2284953010 >> 172.21.15.44:0/2284953010 conn(0x7f819c0b1c90 msgr2=0x7f819c141420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.083+0000 7f81a1a00640 1 -- 172.21.15.44:0/2284953010 shutdown_connections 2024-03-30T13:11:47.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.083+0000 7f81a1a00640 1 -- 172.21.15.44:0/2284953010 wait complete. 2024-03-30T13:11:47.105 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:47.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.304+0000 7f0c23000640 1 Processor -- start 2024-03-30T13:11:47.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.304+0000 7f0c23000640 1 -- start start 2024-03-30T13:11:47.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.305+0000 7f0c23000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c1c145c60 0x7f0c1c071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.306+0000 7f0c23000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c1c146040 con 0x7f0c1c160830 2024-03-30T13:11:47.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.306+0000 7f0c23000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c1c160e50 con 0x7f0c1c071a60 2024-03-30T13:11:47.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.306+0000 7f0c23000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0c1c071ea0 con 0x7f0c1c145c60 2024-03-30T13:11:47.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.306+0000 7f0c21000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0c1c160830 0x7f0c1c0ca830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60970/0 (socket says 172.21.15.44:60970) 2024-03-30T13:11:47.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.306+0000 7f0c21000640 1 -- 172.21.15.44:0/1379831136 learned_addr learned my addr 172.21.15.44:0/1379831136 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:47.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.306+0000 7f0c1be00640 1 --2- 172.21.15.44:0/1379831136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c1c145c60 0x7f0c1c071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.306+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21552131 0 0) 0x7f0c1c146040 con 0x7f0c1c160830 2024-03-30T13:11:47.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.306+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c00003520 con 0x7f0c1c160830 2024-03-30T13:11:47.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 656929104 0 0) 0x7f0c00003520 con 0x7f0c1c160830 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c1c145c60 msgr2=0x7f0c1c071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 --2- 172.21.15.44:0/1379831136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c1c145c60 0x7f0c1c071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 >> v1:172.21.15.151:6789/0 conn(0x7f0c1c071a60 legacy=0x7f0c1c160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1c15d8b0 con 0x7f0c1c160830 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f0c14001670 con 0x7f0c1c160830 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 >> v1:172.21.15.44:6789/0 conn(0x7f0c1c160830 legacy=0x7f0c1c0ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 --2- 172.21.15.44:0/1379831136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c1c145c60 0x7f0c000039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 --2- 172.21.15.44:0/1379831136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c00003fb0 0x7f0c00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 --2- 172.21.15.44:0/1379831136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c00004d40 0x7f0c000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1c071ea0 con 0x7f0c00003fb0 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0000bbb0 con 0x7f0c00004d40 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0c0000bdb0 con 0x7f0c1c145c60 2024-03-30T13:11:47.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c13400640 1 --2- 172.21.15.44:0/1379831136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c00003fb0 0x7f0c00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.307+0000 7f0c21000640 1 --2- 172.21.15.44:0/1379831136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c00004d40 0x7f0c000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.308+0000 7f0c13400640 1 -- 172.21.15.44:0/1379831136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c1c145c60 msgr2=0x7f0c000039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.308+0000 7f0c13400640 1 --2- 172.21.15.44:0/1379831136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c1c145c60 0x7f0c000039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.308+0000 7f0c13400640 1 -- 172.21.15.44:0/1379831136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c00004d40 msgr2=0x7f0c000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.308+0000 7f0c13400640 1 --2- 172.21.15.44:0/1379831136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c00004d40 0x7f0c000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.308+0000 7f0c13400640 1 -- 172.21.15.44:0/1379831136 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c00003520 con 0x7f0c00003fb0 2024-03-30T13:11:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.309+0000 7f0c13400640 1 --2- 172.21.15.44:0/1379831136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c00003fb0 0x7f0c00004800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c04001750 tx=0x7f0c00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139911357e0dafb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.309+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04001370 con 0x7f0c00003fb0 2024-03-30T13:11:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.309+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c040052d0 con 0x7f0c00003fb0 2024-03-30T13:11:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.309+0000 7f0c1b400640 1 -- 172.21.15.44:0/1379831136 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c04003830 con 0x7f0c00003fb0 2024-03-30T13:11:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.309+0000 7f0c23000640 1 -- 172.21.15.44:0/1379831136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c00003fb0 msgr2=0x7f0c00004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.309+0000 7f0c23000640 1 --2- 172.21.15.44:0/1379831136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c00003fb0 0x7f0c00004800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c04001750 tx=0x7f0c00005830 comp rx=0 tx=0).stop 2024-03-30T13:11:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.309+0000 7f0c21000640 1 -- 172.21.15.44:0/1379831136 reap_dead start 2024-03-30T13:11:47.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.309+0000 7f0c23000640 1 -- 172.21.15.44:0/1379831136 shutdown_connections 2024-03-30T13:11:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.309+0000 7f0c23000640 1 -- 172.21.15.44:0/1379831136 >> 172.21.15.44:0/1379831136 conn(0x7f0c1c0b1c90 msgr2=0x7f0c1c0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.310+0000 7f0c23000640 1 -- 172.21.15.44:0/1379831136 shutdown_connections 2024-03-30T13:11:47.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.310+0000 7f0c23000640 1 -- 172.21.15.44:0/1379831136 wait complete. 2024-03-30T13:11:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.311+0000 7f0c23000640 1 Processor -- start 2024-03-30T13:11:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.311+0000 7f0c23000640 1 -- start start 2024-03-30T13:11:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.312+0000 7f0c23000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c00003fb0 0x7f0c1c15bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.312+0000 7f0c23000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c1c142210 0x7f0c1c0a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.312+0000 7f0c23000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1c0a99d0 0x7f0c1c0aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.312+0000 7f0c23000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1c15d0b0 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.312+0000 7f0c23000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1c15cdd0 con 0x7f0c1c142210 2024-03-30T13:11:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.312+0000 7f0c23000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0c1c071520 con 0x7f0c00003fb0 2024-03-30T13:11:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c21000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1c0a99d0 0x7f0c1c0aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c21000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1c0a99d0 0x7f0c1c0aba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39734/0 (socket says 172.21.15.44:39734) 2024-03-30T13:11:47.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c21000640 1 -- 172.21.15.44:0/3394759489 learned_addr learned my addr 172.21.15.44:0/3394759489 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c1be00640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c00003fb0 0x7f0c1c15bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c13400640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c1c142210 0x7f0c1c0a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c21000640 1 -- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c00003fb0 msgr2=0x7f0c1c15bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c21000640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c00003fb0 0x7f0c1c15bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c21000640 1 -- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c1c142210 msgr2=0x7f0c1c0a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c21000640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c1c142210 0x7f0c1c0a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c21000640 1 -- 172.21.15.44:0/3394759489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1c1426a0 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c13400640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c1c142210 0x7f0c1c0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c1be00640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c00003fb0 0x7f0c1c15bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:47.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.313+0000 7f0c21000640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1c0a99d0 0x7f0c1c0aba80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c073b90 tx=0x7f0c1400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.314+0000 7f0c18c00640 1 -- 172.21.15.44:0/3394759489 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c14012590 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.314+0000 7f0c18c00640 1 -- 172.21.15.44:0/3394759489 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c14018070 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.314+0000 7f0c18c00640 1 -- 172.21.15.44:0/3394759489 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c14012990 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.314+0000 7f0c23000640 1 -- 172.21.15.44:0/3394759489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c1c142980 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.314+0000 7f0c23000640 1 -- 172.21.15.44:0/3394759489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c1c142f40 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.315+0000 7f0c23000640 1 -- 172.21.15.44:0/3394759489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c1c0ab770 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.316+0000 7f0c18c00640 1 -- 172.21.15.44:0/3394759489 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0c14012b30 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.317+0000 7f0c18c00640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0bf806c530 0x7f0bf806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.317+0000 7f0c18c00640 1 -- 172.21.15.44:0/3394759489 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0c1408b5e0 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.318+0000 7f0c1be00640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0bf806c530 0x7f0bf806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.319+0000 7f0c1be00640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0bf806c530 0x7f0bf806e9f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c004b30 tx=0x7f0c0c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:47.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.322+0000 7f0c18c00640 1 -- 172.21.15.44:0/3394759489 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0c140591d0 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.523+0000 7f0c23000640 1 -- 172.21.15.44:0/3394759489 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c1c075a10 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.526+0000 7f0c18c00640 1 -- 172.21.15.44:0/3394759489 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7f0c1405d4d0 con 0x7f0c1c0a99d0 2024-03-30T13:11:47.530 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:47.530 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.529+0000 7f0c23000640 1 -- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0bf806c530 msgr2=0x7f0bf806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.529+0000 7f0c23000640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0bf806c530 0x7f0bf806e9f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c004b30 tx=0x7f0c0c00b040 comp rx=0 tx=0).stop 2024-03-30T13:11:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.529+0000 7f0c23000640 1 -- 172.21.15.44:0/3394759489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1c0a99d0 msgr2=0x7f0c1c0aba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.529+0000 7f0c23000640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1c0a99d0 0x7f0c1c0aba80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c073b90 tx=0x7f0c1400e960 comp rx=0 tx=0).stop 2024-03-30T13:11:47.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.529+0000 7f0c23000640 1 -- 172.21.15.44:0/3394759489 shutdown_connections 2024-03-30T13:11:47.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.529+0000 7f0c23000640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c1c0a99d0 0x7f0c1c0aba80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.529+0000 7f0c23000640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0bf806c530 0x7f0bf806e9f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.529+0000 7f0c23000640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c1c142210 0x7f0c1c0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.529+0000 7f0c23000640 1 --2- 172.21.15.44:0/3394759489 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c00003fb0 0x7f0c1c15bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.529+0000 7f0c23000640 1 -- 172.21.15.44:0/3394759489 >> 172.21.15.44:0/3394759489 conn(0x7f0c1c0b1c90 msgr2=0x7f0c1c15e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:47.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.529+0000 7f0c23000640 1 -- 172.21.15.44:0/3394759489 shutdown_connections 2024-03-30T13:11:47.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.529+0000 7f0c23000640 1 -- 172.21.15.44:0/3394759489 wait complete. 2024-03-30T13:11:47.567 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:11:47.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.790+0000 7efd54e00640 1 Processor -- start 2024-03-30T13:11:47.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.791+0000 7efd54e00640 1 -- start start 2024-03-30T13:11:47.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.792+0000 7efd54e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efd5015b390 0x7efd500d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.792+0000 7efd54e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500b5be0 0x7efd500cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.792+0000 7efd54e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd500b41b0 con 0x7efd500d0940 2024-03-30T13:11:47.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.792+0000 7efd54e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7efd5015b770 con 0x7efd5015b390 2024-03-30T13:11:47.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.793+0000 7efd54e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7efd500d1d20 con 0x7efd500b5be0 2024-03-30T13:11:47.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.793+0000 7efd4de00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efd5015b390 0x7efd500d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.793+0000 7efd4d400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efd500d0940 0x7efd500b54d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60982/0 (socket says 172.21.15.44:60982) 2024-03-30T13:11:47.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.793+0000 7efd4de00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efd5015b390 0x7efd500d17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39748/0 (socket says 172.21.15.44:39748) 2024-03-30T13:11:47.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.793+0000 7efd4d400640 1 -- 172.21.15.44:0/1158964392 learned_addr learned my addr 172.21.15.44:0/1158964392 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:47.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.793+0000 7efd4e800640 1 --2- 172.21.15.44:0/1158964392 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500b5be0 0x7efd500cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.793+0000 7efd4de00640 1 -- 172.21.15.44:0/1158964392 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500b5be0 msgr2=0x7efd500cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:47.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.793+0000 7efd4de00640 1 --2- 172.21.15.44:0/1158964392 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500b5be0 0x7efd500cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.793+0000 7efd4de00640 1 -- 172.21.15.44:0/1158964392 >> v1:172.21.15.44:6789/0 conn(0x7efd500d0940 legacy=0x7efd500b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.793+0000 7efd4de00640 1 -- 172.21.15.44:0/1158964392 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd500b4450 con 0x7efd5015b390 2024-03-30T13:11:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.793+0000 7efd4ca00640 1 -- 172.21.15.44:0/1158964392 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002760972 0 0) 0x7efd500b41b0 con 0x7efd500d0940 2024-03-30T13:11:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.794+0000 7efd4de00640 1 --2- 172.21.15.44:0/1158964392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd5015b390 0x7efd500d17e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efd400097a0 tx=0x7efd4002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf30e21ac7d7fe1c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.795+0000 7efd4ca00640 1 -- 172.21.15.44:0/1158964392 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd400315a0 con 0x7efd5015b390 2024-03-30T13:11:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.795+0000 7efd4ca00640 1 -- 172.21.15.44:0/1158964392 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd40037070 con 0x7efd5015b390 2024-03-30T13:11:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.795+0000 7efd4ca00640 1 -- 172.21.15.44:0/1158964392 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40031960 con 0x7efd5015b390 2024-03-30T13:11:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.795+0000 7efd54e00640 1 -- 172.21.15.44:0/1158964392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd5015b390 msgr2=0x7efd500d17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.795+0000 7efd54e00640 1 --2- 172.21.15.44:0/1158964392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd5015b390 0x7efd500d17e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efd400097a0 tx=0x7efd4002b840 comp rx=0 tx=0).stop 2024-03-30T13:11:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.795+0000 7efd54e00640 1 -- 172.21.15.44:0/1158964392 shutdown_connections 2024-03-30T13:11:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.795+0000 7efd54e00640 1 --2- 172.21.15.44:0/1158964392 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500b5be0 0x7efd500cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.795+0000 7efd54e00640 1 --2- 172.21.15.44:0/1158964392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd5015b390 0x7efd500d17e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.795+0000 7efd54e00640 1 -- 172.21.15.44:0/1158964392 >> 172.21.15.44:0/1158964392 conn(0x7efd5006c690 msgr2=0x7efd5006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.796+0000 7efd54e00640 1 -- 172.21.15.44:0/1158964392 shutdown_connections 2024-03-30T13:11:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.796+0000 7efd54e00640 1 -- 172.21.15.44:0/1158964392 wait complete. 2024-03-30T13:11:47.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.797+0000 7efd54e00640 1 Processor -- start 2024-03-30T13:11:47.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.797+0000 7efd54e00640 1 -- start start 2024-03-30T13:11:47.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.798+0000 7efd54e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd500b5be0 0x7efd501467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.798+0000 7efd54e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500d0940 0x7efd500b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.798+0000 7efd54e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5015b390 0x7efd500b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.798+0000 7efd54e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd500b4cf0 con 0x7efd500b5be0 2024-03-30T13:11:47.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.798+0000 7efd54e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efd500b4a10 con 0x7efd5015b390 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.798+0000 7efd54e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7efd500b4fd0 con 0x7efd500d0940 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.799+0000 7efd4de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd500b5be0 0x7efd501467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.799+0000 7efd4de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd500b5be0 0x7efd501467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39760/0 (socket says 172.21.15.44:39760) 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.799+0000 7efd4de00640 1 -- 172.21.15.44:0/635867458 learned_addr learned my addr 172.21.15.44:0/635867458 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.799+0000 7efd4d400640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500d0940 0x7efd500b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.799+0000 7efd4de00640 1 -- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500d0940 msgr2=0x7efd500b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.799+0000 7efd4e800640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5015b390 0x7efd500b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.799+0000 7efd4de00640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500d0940 0x7efd500b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.799+0000 7efd4de00640 1 -- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5015b390 msgr2=0x7efd500b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.799+0000 7efd4de00640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5015b390 0x7efd500b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.799+0000 7efd4de00640 1 -- 172.21.15.44:0/635867458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd50146cf0 con 0x7efd500b5be0 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.799+0000 7efd4d400640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500d0940 0x7efd500b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.799+0000 7efd4de00640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd500b5be0 0x7efd501467b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd40000c00 tx=0x7efd400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.800+0000 7efd46000640 1 -- 172.21.15.44:0/635867458 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40032840 con 0x7efd500b5be0 2024-03-30T13:11:47.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.800+0000 7efd46000640 1 -- 172.21.15.44:0/635867458 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd400329e0 con 0x7efd500b5be0 2024-03-30T13:11:47.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.800+0000 7efd46000640 1 -- 172.21.15.44:0/635867458 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40032dd0 con 0x7efd500b5be0 2024-03-30T13:11:47.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.800+0000 7efd54e00640 1 -- 172.21.15.44:0/635867458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5014e1d0 con 0x7efd500b5be0 2024-03-30T13:11:47.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.800+0000 7efd54e00640 1 -- 172.21.15.44:0/635867458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5014b500 con 0x7efd500b5be0 2024-03-30T13:11:47.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.801+0000 7efd54e00640 1 -- 172.21.15.44:0/635867458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd50075a10 con 0x7efd500b5be0 2024-03-30T13:11:47.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.802+0000 7efd46000640 1 -- 172.21.15.44:0/635867458 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7efd4004d3f0 con 0x7efd500b5be0 2024-03-30T13:11:47.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.803+0000 7efd46000640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efd3006c530 0x7efd3006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:47.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.803+0000 7efd46000640 1 -- 172.21.15.44:0/635867458 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7efd4002f030 con 0x7efd500b5be0 2024-03-30T13:11:47.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.803+0000 7efd4d400640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efd3006c530 0x7efd3006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:47.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.804+0000 7efd4d400640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efd3006c530 0x7efd3006e9f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efd3c007fd0 tx=0x7efd3c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:47.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:47.807+0000 7efd46000640 1 -- 172.21.15.44:0/635867458 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7efd40040070 con 0x7efd500b5be0 2024-03-30T13:11:48.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.056+0000 7efd54e00640 1 -- 172.21.15.44:0/635867458 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd500cfa00 con 0x7efd500b5be0 2024-03-30T13:11:48.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.057+0000 7efd46000640 1 -- 172.21.15.44:0/635867458 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5180 (secure 0 0 0) 0x7efd4007b810 con 0x7efd500b5be0 2024-03-30T13:11:48.061 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:48.062 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1458748329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1458748329},{"type":"v1","addr":"172.21.15.44:6834","nonce":1458748329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3921281718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3921281718},{"type":"v1","addr":"172.21.15.151:6837","nonce":3921281718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2065829800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2065829800},{"type":"v1","addr":"172.21.15.44:6835","nonce":2065829800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:11:40.531273+0000","modified":"2024-03-30T13:11:45.565178+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/456394190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":456394190},{"type":"v1","addr":"172.21.15.151:6835","nonce":456394190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4276,"qdb_cluster":[4276]},"id":1}]} 2024-03-30T13:11:48.062 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-03-30T13:11:48.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.061+0000 7efd54e00640 1 -- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efd3006c530 msgr2=0x7efd3006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.061+0000 7efd54e00640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efd3006c530 0x7efd3006e9f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efd3c007fd0 tx=0x7efd3c009040 comp rx=0 tx=0).stop 2024-03-30T13:11:48.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.061+0000 7efd54e00640 1 -- 172.21.15.44:0/635867458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd500b5be0 msgr2=0x7efd501467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.061+0000 7efd54e00640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd500b5be0 0x7efd501467b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd40000c00 tx=0x7efd400046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.061+0000 7efd54e00640 1 -- 172.21.15.44:0/635867458 shutdown_connections 2024-03-30T13:11:48.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.061+0000 7efd54e00640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efd3006c530 0x7efd3006e9f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.061+0000 7efd54e00640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5015b390 0x7efd500b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.061+0000 7efd54e00640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd500d0940 0x7efd500b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.061+0000 7efd54e00640 1 --2- 172.21.15.44:0/635867458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd500b5be0 0x7efd501467b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.061+0000 7efd54e00640 1 -- 172.21.15.44:0/635867458 >> 172.21.15.44:0/635867458 conn(0x7efd5006c690 msgr2=0x7efd500d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:48.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.061+0000 7efd54e00640 1 -- 172.21.15.44:0/635867458 shutdown_connections 2024-03-30T13:11:48.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.062+0000 7efd54e00640 1 -- 172.21.15.44:0/635867458 wait complete. 2024-03-30T13:11:48.083 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:48.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.301+0000 7f13d8000640 1 Processor -- start 2024-03-30T13:11:48.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.301+0000 7f13d8000640 1 -- start start 2024-03-30T13:11:48.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.303+0000 7f13d8000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f13d0071c30 0x7f13d0160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.303+0000 7f13d8000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f13d0160660 0x7f13d00ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.303+0000 7f13d8000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d0146040 con 0x7f13d0145c60 2024-03-30T13:11:48.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.303+0000 7f13d8000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f13d0160e50 con 0x7f13d0071c30 2024-03-30T13:11:48.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.303+0000 7f13d8000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f13d015d8b0 con 0x7f13d0160660 2024-03-30T13:11:48.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.303+0000 7f13d4c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f13d0071c30 0x7f13d0160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.303+0000 7f13d4c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f13d0071c30 0x7f13d0160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39776/0 (socket says 172.21.15.44:39776) 2024-03-30T13:11:48.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.303+0000 7f13d4c00640 1 -- 172.21.15.44:0/3397696001 learned_addr learned my addr 172.21.15.44:0/3397696001 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:48.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.304+0000 7f13d6000640 1 --2- 172.21.15.44:0/3397696001 >> v2:172.21.15.151:3300/0 conn(0x7f13d0160660 0x7f13d00ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.304+0000 7f13d4c00640 1 -- 172.21.15.44:0/3397696001 >> v2:172.21.15.151:3300/0 conn(0x7f13d0160660 msgr2=0x7f13d00ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:48.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.304+0000 7f13d4c00640 1 --2- 172.21.15.44:0/3397696001 >> v2:172.21.15.151:3300/0 conn(0x7f13d0160660 0x7f13d00ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.304+0000 7f13d4c00640 1 -- 172.21.15.44:0/3397696001 >> v1:172.21.15.151:6789/0 conn(0x7f13d0145c60 legacy=0x7f13d0071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:48.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.304+0000 7f13d4c00640 1 -- 172.21.15.44:0/3397696001 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d015caf0 con 0x7f13d0071c30 2024-03-30T13:11:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.305+0000 7f13d4c00640 1 --2- 172.21.15.44:0/3397696001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13d0071c30 0x7f13d0160120 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f13d00cc4d0 tx=0x7f13bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8931e5c031294b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.305+0000 7f13cfe00640 1 -- 172.21.15.44:0/3397696001 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc02e070 con 0x7f13d0071c30 2024-03-30T13:11:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.305+0000 7f13cfe00640 1 -- 172.21.15.44:0/3397696001 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13bc037070 con 0x7f13d0071c30 2024-03-30T13:11:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.305+0000 7f13cfe00640 1 -- 172.21.15.44:0/3397696001 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc031a00 con 0x7f13d0071c30 2024-03-30T13:11:48.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.306+0000 7f13d8000640 1 -- 172.21.15.44:0/3397696001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13d0071c30 msgr2=0x7f13d0160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.306+0000 7f13d8000640 1 --2- 172.21.15.44:0/3397696001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13d0071c30 0x7f13d0160120 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f13d00cc4d0 tx=0x7f13bc02b880 comp rx=0 tx=0).stop 2024-03-30T13:11:48.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.306+0000 7f13d8000640 1 -- 172.21.15.44:0/3397696001 shutdown_connections 2024-03-30T13:11:48.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.306+0000 7f13d8000640 1 --2- 172.21.15.44:0/3397696001 >> v2:172.21.15.151:3300/0 conn(0x7f13d0160660 0x7f13d00ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.306+0000 7f13d8000640 1 --2- 172.21.15.44:0/3397696001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13d0071c30 0x7f13d0160120 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.306+0000 7f13d8000640 1 -- 172.21.15.44:0/3397696001 >> 172.21.15.44:0/3397696001 conn(0x7f13d00b1c90 msgr2=0x7f13d00b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:48.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.306+0000 7f13d8000640 1 -- 172.21.15.44:0/3397696001 shutdown_connections 2024-03-30T13:11:48.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.306+0000 7f13d8000640 1 -- 172.21.15.44:0/3397696001 wait complete. 2024-03-30T13:11:48.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.308+0000 7f13d8000640 1 Processor -- start 2024-03-30T13:11:48.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.308+0000 7f13d8000640 1 -- start start 2024-03-30T13:11:48.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.309+0000 7f13d8000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13d0071c30 0x7f13d0134af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.309+0000 7f13d8000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13d0145c60 0x7f13d00cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.309+0000 7f13d8000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13d0160660 0x7f13d00cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.309+0000 7f13d8000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f13d0160a90 con 0x7f13d0145c60 2024-03-30T13:11:48.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.309+0000 7f13d8000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f13d015d0b0 con 0x7f13d0160660 2024-03-30T13:11:48.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.309+0000 7f13d8000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f13d0160c10 con 0x7f13d0071c30 2024-03-30T13:11:48.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.310+0000 7f13d4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13d0145c60 0x7f13d00cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.310+0000 7f13d4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13d0145c60 0x7f13d00cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39778/0 (socket says 172.21.15.44:39778) 2024-03-30T13:11:48.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.310+0000 7f13d4c00640 1 -- 172.21.15.44:0/48853117 learned_addr learned my addr 172.21.15.44:0/48853117 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.310+0000 7f13d5600640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13d0071c30 0x7f13d0134af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.310+0000 7f13d6000640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13d0160660 0x7f13d00cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.310+0000 7f13d4c00640 1 -- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13d0071c30 msgr2=0x7f13d0134af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.310+0000 7f13d4c00640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13d0071c30 0x7f13d0134af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.310+0000 7f13d4c00640 1 -- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13d0160660 msgr2=0x7f13d00cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.310+0000 7f13d4c00640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13d0160660 0x7f13d00cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.310+0000 7f13d4c00640 1 -- 172.21.15.44:0/48853117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d00b4800 con 0x7f13d0145c60 2024-03-30T13:11:48.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.310+0000 7f13d4c00640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13d0145c60 0x7f13d00cebe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f13bc000c00 tx=0x7f13bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:48.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.311+0000 7f13cd600640 1 -- 172.21.15.44:0/48853117 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc032880 con 0x7f13d0145c60 2024-03-30T13:11:48.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.311+0000 7f13cd600640 1 -- 172.21.15.44:0/48853117 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13bc032a20 con 0x7f13d0145c60 2024-03-30T13:11:48.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.311+0000 7f13cd600640 1 -- 172.21.15.44:0/48853117 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc032e10 con 0x7f13d0145c60 2024-03-30T13:11:48.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.311+0000 7f13d8000640 1 -- 172.21.15.44:0/48853117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d00b4ae0 con 0x7f13d0145c60 2024-03-30T13:11:48.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.311+0000 7f13d8000640 1 -- 172.21.15.44:0/48853117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d00b50a0 con 0x7f13d0145c60 2024-03-30T13:11:48.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.312+0000 7f13d8000640 1 -- 172.21.15.44:0/48853117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d0075a10 con 0x7f13d0145c60 2024-03-30T13:11:48.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.313+0000 7f13cd600640 1 -- 172.21.15.44:0/48853117 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f13bc04c060 con 0x7f13d0145c60 2024-03-30T13:11:48.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.315+0000 7f13cd600640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f13b006c560 0x7f13b006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:48.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.315+0000 7f13cd600640 1 -- 172.21.15.44:0/48853117 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f13bc0ad780 con 0x7f13d0145c60 2024-03-30T13:11:48.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.315+0000 7f13d5600640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f13b006c560 0x7f13b006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:48.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.316+0000 7f13d5600640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f13b006c560 0x7f13b006ea20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f13c4007fd0 tx=0x7f13c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:48.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.319+0000 7f13cd600640 1 -- 172.21.15.44:0/48853117 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f13bc040070 con 0x7f13d0145c60 2024-03-30T13:11:48.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.527+0000 7f13d8000640 1 -- 172.21.15.44:0/48853117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13d00ca610 con 0x7f13d0145c60 2024-03-30T13:11:48.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.529+0000 7f13cd600640 1 -- 172.21.15.44:0/48853117 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7f13bc07b9c0 con 0x7f13d0145c60 2024-03-30T13:11:48.533 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:48.533 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:48.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.532+0000 7f13d8000640 1 -- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f13b006c560 msgr2=0x7f13b006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.532+0000 7f13d8000640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f13b006c560 0x7f13b006ea20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f13c4007fd0 tx=0x7f13c4009040 comp rx=0 tx=0).stop 2024-03-30T13:11:48.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.532+0000 7f13d8000640 1 -- 172.21.15.44:0/48853117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13d0145c60 msgr2=0x7f13d00cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:48.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.532+0000 7f13d8000640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13d0145c60 0x7f13d00cebe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f13bc000c00 tx=0x7f13bc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.532+0000 7f13d8000640 1 -- 172.21.15.44:0/48853117 shutdown_connections 2024-03-30T13:11:48.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.532+0000 7f13d8000640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f13b006c560 0x7f13b006ea20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.532+0000 7f13d8000640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13d0160660 0x7f13d00cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.532+0000 7f13d8000640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f13d0145c60 0x7f13d00cebe0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.532+0000 7f13d8000640 1 --2- 172.21.15.44:0/48853117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13d0071c30 0x7f13d0134af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:48.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.532+0000 7f13d8000640 1 -- 172.21.15.44:0/48853117 >> 172.21.15.44:0/48853117 conn(0x7f13d00b1c90 msgr2=0x7f13d00cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:48.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.532+0000 7f13d8000640 1 -- 172.21.15.44:0/48853117 shutdown_connections 2024-03-30T13:11:48.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:48.532+0000 7f13d8000640 1 -- 172.21.15.44:0/48853117 wait complete. 2024-03-30T13:11:48.959 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T13:11:40.531273+0000', 'modified': '2024-03-30T13:11:45.565178+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6835/456394190', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 456394190}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 456394190}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4276, 'qdb_cluster': [4276]} 2024-03-30T13:11:48.959 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-30T13:11:48.959 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-30T13:11:49.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.185+0000 7f97aec00640 1 Processor -- start 2024-03-30T13:11:49.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.186+0000 7f97aec00640 1 -- start start 2024-03-30T13:11:49.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.187+0000 7f97aec00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a8145c60 0x7f97a8071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.187+0000 7f97aec00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97a8146040 con 0x7f97a8160830 2024-03-30T13:11:49.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.187+0000 7f97aec00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97a8160e50 con 0x7f97a8071a60 2024-03-30T13:11:49.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.187+0000 7f97aec00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f97a8071ea0 con 0x7f97a8145c60 2024-03-30T13:11:49.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.187+0000 7f97acc00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f97a8160830 0x7f97a80ca830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:60990/0 (socket says 172.21.15.44:60990) 2024-03-30T13:11:49.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.187+0000 7f97acc00640 1 -- 172.21.15.44:0/3853452301 learned_addr learned my addr 172.21.15.44:0/3853452301 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:49.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.187+0000 7f97a7e00640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a8145c60 0x7f97a8071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786061023 0 0) 0x7f97a8146040 con 0x7f97a8160830 2024-03-30T13:11:49.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9788003520 con 0x7f97a8160830 2024-03-30T13:11:49.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 68441448 0 0) 0x7f9788003520 con 0x7f97a8160830 2024-03-30T13:11:49.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a8145c60 msgr2=0x7f97a8071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a8145c60 0x7f97a8071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 >> v1:172.21.15.151:6789/0 conn(0x7f97a8071a60 legacy=0x7f97a8160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a815d8b0 con 0x7f97a8160830 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f97a0001670 con 0x7f97a8160830 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 >> v1:172.21.15.44:6789/0 conn(0x7f97a8160830 legacy=0x7f97a80ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97880039e0 0x7f9788003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a8145c60 0x7f9788004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9788004d40 0x7f97880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f97a8071ea0 con 0x7f9788004d40 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f978800bb50 con 0x7f97880039e0 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.188+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f978800bd50 con 0x7f97a8145c60 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.189+0000 7f97acc00640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9788004d40 0x7f97880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.189+0000 7f97a7e00640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97880039e0 0x7f9788003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.189+0000 7f97a7400640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a8145c60 0x7f9788004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.189+0000 7f97acc00640 1 -- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a8145c60 msgr2=0x7f9788004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.189+0000 7f97acc00640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a8145c60 0x7f9788004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.189+0000 7f97acc00640 1 -- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97880039e0 msgr2=0x7f9788003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.189+0000 7f97acc00640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97880039e0 0x7f9788003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.189+0000 7f97acc00640 1 -- 172.21.15.44:0/3853452301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9788003520 con 0x7f9788004d40 2024-03-30T13:11:49.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.189+0000 7f97a7e00640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97880039e0 0x7f9788003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:49.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.189+0000 7f97a7400640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a8145c60 0x7f9788004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.190+0000 7f97acc00640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9788004d40 0x7f97880051c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f97a000c190 tx=0x7f9788005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824501da77e7a9d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.190+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a0007c60 con 0x7f9788004d40 2024-03-30T13:11:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.191+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a0030070 con 0x7f9788004d40 2024-03-30T13:11:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.191+0000 7f97a6a00640 1 -- 172.21.15.44:0/3853452301 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a0005d70 con 0x7f9788004d40 2024-03-30T13:11:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.191+0000 7f97aec00640 1 -- 172.21.15.44:0/3853452301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9788004d40 msgr2=0x7f97880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.191+0000 7f97aec00640 1 --2- 172.21.15.44:0/3853452301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9788004d40 0x7f97880051c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f97a000c190 tx=0x7f9788005830 comp rx=0 tx=0).stop 2024-03-30T13:11:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.191+0000 7f97acc00640 1 -- 172.21.15.44:0/3853452301 reap_dead start 2024-03-30T13:11:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.191+0000 7f97aec00640 1 -- 172.21.15.44:0/3853452301 shutdown_connections 2024-03-30T13:11:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.191+0000 7f97aec00640 1 -- 172.21.15.44:0/3853452301 >> 172.21.15.44:0/3853452301 conn(0x7f97a80b1c90 msgr2=0x7f97a80b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.191+0000 7f97aec00640 1 -- 172.21.15.44:0/3853452301 shutdown_connections 2024-03-30T13:11:49.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.191+0000 7f97aec00640 1 -- 172.21.15.44:0/3853452301 wait complete. 2024-03-30T13:11:49.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.193+0000 7f97aec00640 1 Processor -- start 2024-03-30T13:11:49.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.193+0000 7f97aec00640 1 -- start start 2024-03-30T13:11:49.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.194+0000 7f97aec00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a8143d20 0x7f97a81e6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.194+0000 7f97aec00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a8144100 0x7f97a80a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.194+0000 7f97aec00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a80a99d0 0x7f97a80b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.194+0000 7f97aec00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f97a815d0b0 con 0x7f97a8144100 2024-03-30T13:11:49.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.194+0000 7f97aec00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97a815cdd0 con 0x7f97a8143d20 2024-03-30T13:11:49.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.194+0000 7f97aec00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f97a8071520 con 0x7f97a80a99d0 2024-03-30T13:11:49.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.194+0000 7f97a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a8144100 0x7f97a80a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.194+0000 7f97a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a8144100 0x7f97a80a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39796/0 (socket says 172.21.15.44:39796) 2024-03-30T13:11:49.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.194+0000 7f97a7400640 1 -- 172.21.15.44:0/271049655 learned_addr learned my addr 172.21.15.44:0/271049655 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:49.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.195+0000 7f97a7e00640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a8143d20 0x7f97a81e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.195+0000 7f97a7400640 1 -- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a80a99d0 msgr2=0x7f97a80b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.195+0000 7f97a7400640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a80a99d0 0x7f97a80b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.195+0000 7f97a7400640 1 -- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a8143d20 msgr2=0x7f97a81e6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.195+0000 7f97a7400640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a8143d20 0x7f97a81e6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.195+0000 7f97a7400640 1 -- 172.21.15.44:0/271049655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a80b2fa0 con 0x7f97a8144100 2024-03-30T13:11:49.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.195+0000 7f97a7e00640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a8143d20 0x7f97a81e6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:49.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.195+0000 7f97a7400640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a8144100 0x7f97a80a9490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f979000db10 tx=0x7f97900020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.195+0000 7f979fe00640 1 -- 172.21.15.44:0/271049655 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790018070 con 0x7f97a8144100 2024-03-30T13:11:49.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.195+0000 7f979fe00640 1 -- 172.21.15.44:0/271049655 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9790003da0 con 0x7f97a8144100 2024-03-30T13:11:49.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.195+0000 7f979fe00640 1 -- 172.21.15.44:0/271049655 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790006d70 con 0x7f97a8144100 2024-03-30T13:11:49.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.196+0000 7f97aec00640 1 -- 172.21.15.44:0/271049655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a80b3280 con 0x7f97a8144100 2024-03-30T13:11:49.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.196+0000 7f97aec00640 1 -- 172.21.15.44:0/271049655 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a80b3840 con 0x7f97a8144100 2024-03-30T13:11:49.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.198+0000 7f979fe00640 1 -- 172.21.15.44:0/271049655 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f979000b6c0 con 0x7f97a8144100 2024-03-30T13:11:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.199+0000 7f979fe00640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f978406c530 0x7f978406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.199+0000 7f979fe00640 1 -- 172.21.15.44:0/271049655 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f979008aff0 con 0x7f97a8144100 2024-03-30T13:11:49.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.199+0000 7f97a7e00640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f978406c530 0x7f978406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.200+0000 7f97b19a1740 1 Processor -- start 2024-03-30T13:11:49.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.200+0000 7f97b19a1740 1 -- start start 2024-03-30T13:11:49.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.200+0000 7f97a7e00640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f978406c530 0x7f978406e9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9798009a00 tx=0x7f9798008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.201+0000 7f97b19a1740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c300 0x55b50faef2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.201+0000 7f97b19a1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c6e0 0x55b50fb1f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.201+0000 7f97b19a1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50faef7e0 0x55b50fb1f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.201+0000 7f97b19a1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b50fab6c80 con 0x55b50fb1c6e0 2024-03-30T13:11:49.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.201+0000 7f97b19a1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b50fa58fa0 con 0x55b50faef7e0 2024-03-30T13:11:49.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.201+0000 7f97b19a1740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55b50fa01560 con 0x55b50fb1c300 2024-03-30T13:11:49.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.201+0000 7f97a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c6e0 0x55b50fb1f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.201+0000 7f97a7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c6e0 0x55b50fb1f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39802/0 (socket says 172.21.15.44:39802) 2024-03-30T13:11:49.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.201+0000 7f97a7400640 1 -- 172.21.15.44:0/2680599334 learned_addr learned my addr 172.21.15.44:0/2680599334 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:49.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.201+0000 7f97a7e00640 1 --2- 172.21.15.44:0/2680599334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c300 0x55b50faef2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.201+0000 7f97a7400640 1 -- 172.21.15.44:0/2680599334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c300 msgr2=0x55b50faef2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.202+0000 7f97a7400640 1 --2- 172.21.15.44:0/2680599334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c300 0x55b50faef2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.202+0000 7f97a7400640 1 -- 172.21.15.44:0/2680599334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50faef7e0 msgr2=0x55b50fb1f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.202+0000 7f97a7400640 1 --2- 172.21.15.44:0/2680599334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50faef7e0 0x55b50fb1f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.202+0000 7f97a7400640 1 -- 172.21.15.44:0/2680599334 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50f76d2d0 con 0x55b50fb1c6e0 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.202+0000 7f97a7400640 1 --2- 172.21.15.44:0/2680599334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c6e0 0x55b50fb1f090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9790089170 tx=0x7f979005cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34697a8e2034d01b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.202+0000 7f9797e00640 1 -- 172.21.15.44:0/2680599334 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790056fd0 con 0x55b50fb1c6e0 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.202+0000 7f9797e00640 1 -- 172.21.15.44:0/2680599334 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9790055340 con 0x55b50fb1c6e0 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.202+0000 7f9797e00640 1 -- 172.21.15.44:0/2680599334 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790082d90 con 0x55b50fb1c6e0 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.203+0000 7f97b19a1740 1 -- 172.21.15.44:0/2680599334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c6e0 msgr2=0x55b50fb1f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.203+0000 7f97b19a1740 1 --2- 172.21.15.44:0/2680599334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c6e0 0x55b50fb1f090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9790089170 tx=0x7f979005cfd0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.203+0000 7f97b19a1740 1 -- 172.21.15.44:0/2680599334 shutdown_connections 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.203+0000 7f97b19a1740 1 --2- 172.21.15.44:0/2680599334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50faef7e0 0x55b50fb1f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.203+0000 7f97b19a1740 1 --2- 172.21.15.44:0/2680599334 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c6e0 0x55b50fb1f090 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.203+0000 7f97b19a1740 1 --2- 172.21.15.44:0/2680599334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c300 0x55b50faef2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.203+0000 7f97b19a1740 1 -- 172.21.15.44:0/2680599334 >> 172.21.15.44:0/2680599334 conn(0x55b50faf1510 msgr2=0x55b50fb3a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.203+0000 7f97b19a1740 1 -- 172.21.15.44:0/2680599334 shutdown_connections 2024-03-30T13:11:49.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.203+0000 7f97b19a1740 1 -- 172.21.15.44:0/2680599334 wait complete. 2024-03-30T13:11:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.204+0000 7f97b19a1740 1 -- start start 2024-03-30T13:11:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.204+0000 7f97b19a1740 1 Processor -- start 2024-03-30T13:11:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.205+0000 7f97b19a1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c300 0x55b50fb4d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.205+0000 7f97b19a1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c6e0 0x55b50fb1d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.205+0000 7f97b19a1740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb31730 0x55b50fb0c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.205+0000 7f97b19a1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b50fa14920 con 0x55b50fb1c300 2024-03-30T13:11:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.205+0000 7f97b19a1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b50fa54f50 con 0x55b50fb1c6e0 2024-03-30T13:11:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.205+0000 7f97b19a1740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55b50faf3ab0 con 0x55b50fb31730 2024-03-30T13:11:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.205+0000 7f97b19a1740 10 client.0 _ll_register_callbacks cb 0x55b50fa14310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.205+0000 7f97a7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c300 0x55b50fb4d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.205+0000 7f97a7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c300 0x55b50fb4d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39810/0 (socket says 172.21.15.44:39810) 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.205+0000 7f97a7e00640 1 -- 172.21.15.44:0/806589754 learned_addr learned my addr 172.21.15.44:0/806589754 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f97a7400640 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c6e0 0x55b50fb1d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f97a7e00640 1 -- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb31730 msgr2=0x55b50fb0c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f97acc00640 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb31730 0x55b50fb0c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f97a7e00640 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb31730 0x55b50fb0c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f97a7e00640 1 -- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c6e0 msgr2=0x55b50fb1d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f97a7e00640 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c6e0 0x55b50fb1d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f97a7e00640 1 -- 172.21.15.44:0/806589754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b50f8376b0 con 0x55b50fb1c300 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f97a7400640 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c6e0 0x55b50fb1d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f97a7e00640 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c300 0x55b50fb4d2c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f97980157d0 tx=0x7f9798004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b1647f19b45c7c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f9794c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f9794c00640 1 -- 172.21.15.44:0/806589754 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798026070 con 0x55b50fb1c300 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f9794c00640 1 -- 172.21.15.44:0/806589754 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9798014b30 con 0x55b50fb1c300 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.206+0000 7f97b19a1740 1 -- 172.21.15.44:0/806589754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9790055340 con 0x55b50fb1c300 2024-03-30T13:11:49.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.207+0000 7f9794c00640 1 -- 172.21.15.44:0/806589754 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f9798031050 con 0x55b50fb1c300 2024-03-30T13:11:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.207+0000 7f97b19a1740 10 client.4380 fetch_fsmap learned FSMap version 7 2024-03-30T13:11:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.207+0000 7f97b19a1740 1 -- 172.21.15.44:0/806589754 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55b50fb0a710 con 0x55b50fb1c300 2024-03-30T13:11:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.207+0000 7f9794c00640 1 -- 172.21.15.44:0/806589754 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9790055340 con 0x55b50fb1c300 2024-03-30T13:11:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.207+0000 7f9794c00640 1 -- 172.21.15.44:0/806589754 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f9798034020 con 0x55b50fb1c300 2024-03-30T13:11:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.207+0000 7f97b19a1740 10 client.4380 fetch_fsmap finished waiting for FSMap version 7 2024-03-30T13:11:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.207+0000 7f97b19a1740 10 client.4380 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-30T13:11:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.207+0000 7f97b19a1740 20 client.4380 populate_metadata read hostname 'smithi044' 2024-03-30T13:11:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.207+0000 7f97b19a1740 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55b50fb4dc60 0x55b50fb0b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.207+0000 7f97b19a1740 4 client.4380 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:11:49.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.207+0000 7f97b19a1740 1 -- 172.21.15.44:0/806589754 --> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b50fa664e0 con 0x55b50fb4dc60 2024-03-30T13:11:49.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.208+0000 7f97a7400640 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55b50fb4dc60 0x55b50fb0b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.209+0000 7f97a7400640 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55b50fb4dc60 0x55b50fb0b290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef9448af22125778 server_cookie=2a37d678c6e456ef in_seq=0 out_seq=0 2024-03-30T13:11:49.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.209+0000 7f9794c00640 10 client.4380 ms_handle_connect on v2:172.21.15.151:6834/456394190 2024-03-30T13:11:49.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.211+0000 7f9794c00640 1 -- 172.21.15.44:0/806589754 <== mds.0 v2:172.21.15.151:6834/456394190 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b50fa664e0 con 0x55b50fb4dc60 2024-03-30T13:11:49.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.211+0000 7f9794c00640 10 client.4380 handle_command_reply: tid=0 2024-03-30T13:11:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.211+0000 7f97b19a1740 1 client.4380 shutdown 2024-03-30T13:11:49.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.212+0000 7f97b19a1740 1 -- 172.21.15.44:0/806589754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c300 msgr2=0x55b50fb4d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.212+0000 7f97b19a1740 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c300 0x55b50fb4d2c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f97980157d0 tx=0x7f9798004730 comp rx=0 tx=0).stop 2024-03-30T13:11:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.212+0000 7f97b19a1740 1 -- 172.21.15.44:0/806589754 shutdown_connections 2024-03-30T13:11:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.212+0000 7f97b19a1740 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55b50fb4dc60 0x55b50fb0b290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.212+0000 7f97b19a1740 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb31730 0x55b50fb0c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.212+0000 7f97b19a1740 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c6e0 0x55b50fb1d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.212+0000 7f97b19a1740 1 --2- 172.21.15.44:0/806589754 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb1c300 0x55b50fb4d2c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.212+0000 7f9794c00640 0 client.4380 ms_handle_reset on v2:172.21.15.151:6834/456394190 2024-03-30T13:11:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.212+0000 7f97b19a1740 1 -- 172.21.15.44:0/806589754 >> 172.21.15.44:0/806589754 conn(0x55b50faef7e0 msgr2=0x55b50faee070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.212+0000 7f97b19a1740 1 -- 172.21.15.44:0/806589754 shutdown_connections 2024-03-30T13:11:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.212+0000 7f97b19a1740 1 -- 172.21.15.44:0/806589754 wait complete. 2024-03-30T13:11:49.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.212+0000 7f97b19a1740 20 client.4380 trim_cache size 0 max 16384 2024-03-30T13:11:49.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.233+0000 7f97b19a1740 1 Processor -- start 2024-03-30T13:11:49.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.233+0000 7f97b19a1740 1 -- start start 2024-03-30T13:11:49.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.233+0000 7f97b19a1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c300 0x55b50fb17520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.233+0000 7f97b19a1740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c6e0 0x55b50fb17a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97b19a1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 0x55b50fb2fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97b19a1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f97a8201e00 con 0x55b50fb31730 2024-03-30T13:11:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97b19a1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97a81f8bf0 con 0x55b50fb1c300 2024-03-30T13:11:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97b19a1740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f97a82017b0 con 0x55b50fb1c6e0 2024-03-30T13:11:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97acc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 0x55b50fb2fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97acc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 0x55b50fb2fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39818/0 (socket says 172.21.15.44:39818) 2024-03-30T13:11:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97acc00640 1 -- 172.21.15.44:0/3042448872 learned_addr learned my addr 172.21.15.44:0/3042448872 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97a7e00640 1 --2- 172.21.15.44:0/3042448872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c300 0x55b50fb17520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97acc00640 1 -- 172.21.15.44:0/3042448872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c6e0 msgr2=0x55b50fb17a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97a7400640 1 --2- 172.21.15.44:0/3042448872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c6e0 0x55b50fb17a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97acc00640 1 --2- 172.21.15.44:0/3042448872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c6e0 0x55b50fb17a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97acc00640 1 -- 172.21.15.44:0/3042448872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c300 msgr2=0x55b50fb17520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97acc00640 1 --2- 172.21.15.44:0/3042448872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c300 0x55b50fb17520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97acc00640 1 -- 172.21.15.44:0/3042448872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b50fb0c7b0 con 0x55b50fb31730 2024-03-30T13:11:49.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.234+0000 7f97a7e00640 1 --2- 172.21.15.44:0/3042448872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c300 0x55b50fb17520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:49.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.235+0000 7f97acc00640 1 --2- 172.21.15.44:0/3042448872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 0x55b50fb2fa20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f97a000c190 tx=0x7f97a002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793a93ba8488e801 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.235+0000 7f9797400640 1 -- 172.21.15.44:0/3042448872 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a0007c60 con 0x55b50fb31730 2024-03-30T13:11:49.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.235+0000 7f9797400640 1 -- 172.21.15.44:0/3042448872 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a0030040 con 0x55b50fb31730 2024-03-30T13:11:49.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.235+0000 7f9797400640 1 -- 172.21.15.44:0/3042448872 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a00015b0 con 0x55b50fb31730 2024-03-30T13:11:49.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.235+0000 7f97b19a1740 1 -- 172.21.15.44:0/3042448872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 msgr2=0x55b50fb2fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.235+0000 7f97b19a1740 1 --2- 172.21.15.44:0/3042448872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 0x55b50fb2fa20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f97a000c190 tx=0x7f97a002e070 comp rx=0 tx=0).stop 2024-03-30T13:11:49.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.236+0000 7f97b19a1740 1 -- 172.21.15.44:0/3042448872 shutdown_connections 2024-03-30T13:11:49.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.236+0000 7f97b19a1740 1 --2- 172.21.15.44:0/3042448872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 0x55b50fb2fa20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.236+0000 7f97b19a1740 1 --2- 172.21.15.44:0/3042448872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c6e0 0x55b50fb17a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.236+0000 7f97b19a1740 1 --2- 172.21.15.44:0/3042448872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c300 0x55b50fb17520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.236+0000 7f97b19a1740 1 -- 172.21.15.44:0/3042448872 >> 172.21.15.44:0/3042448872 conn(0x55b50faef7e0 msgr2=0x55b50fb32220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:49.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.236+0000 7f97b19a1740 1 -- 172.21.15.44:0/3042448872 shutdown_connections 2024-03-30T13:11:49.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.236+0000 7f97b19a1740 1 -- 172.21.15.44:0/3042448872 wait complete. 2024-03-30T13:11:49.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.236+0000 7f97b19a1740 1 -- start start 2024-03-30T13:11:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.236+0000 7f97b19a1740 1 Processor -- start 2024-03-30T13:11:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.237+0000 7f97b19a1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c300 0x55b50fb1d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.237+0000 7f97b19a1740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c6e0 0x55b50fbbe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.237+0000 7f97b19a1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 0x55b50fb3c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.237+0000 7f97b19a1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b50fb4dae0 con 0x55b50fb31730 2024-03-30T13:11:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.237+0000 7f97b19a1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b50fb0bd10 con 0x55b50fb1c300 2024-03-30T13:11:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.237+0000 7f97b19a1740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55b50fb4e100 con 0x55b50fb1c6e0 2024-03-30T13:11:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.237+0000 7f97b19a1740 10 client.0 _ll_register_callbacks cb 0x7f9798015450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:11:49.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.238+0000 7f97acc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 0x55b50fb3c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.238+0000 7f97acc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 0x55b50fb3c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39830/0 (socket says 172.21.15.44:39830) 2024-03-30T13:11:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.238+0000 7f97acc00640 1 -- 172.21.15.44:0/1981396061 learned_addr learned my addr 172.21.15.44:0/1981396061 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.238+0000 7f97a7e00640 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c300 0x55b50fb1d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.238+0000 7f97a7400640 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c6e0 0x55b50fbbe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.238+0000 7f97acc00640 1 -- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c6e0 msgr2=0x55b50fbbe910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.238+0000 7f97acc00640 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c6e0 0x55b50fbbe910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.238+0000 7f97acc00640 1 -- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c300 msgr2=0x55b50fb1d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.238+0000 7f97acc00640 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c300 0x55b50fb1d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.238+0000 7f97acc00640 1 -- 172.21.15.44:0/1981396061 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b50fb1d9a0 con 0x55b50fb31730 2024-03-30T13:11:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.238+0000 7f97a7e00640 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c300 0x55b50fb1d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.239+0000 7f97acc00640 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 0x55b50fb3c4a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f97a0037040 tx=0x7f97a0007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48babe6e95a5048 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.239+0000 7f9794c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:11:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.239+0000 7f9794c00640 1 -- 172.21.15.44:0/1981396061 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97a0004ab0 con 0x55b50fb31730 2024-03-30T13:11:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.239+0000 7f9794c00640 1 -- 172.21.15.44:0/1981396061 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f97a0046070 con 0x55b50fb31730 2024-03-30T13:11:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.239+0000 7f97b19a1740 1 -- 172.21.15.44:0/1981396061 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97a0030040 con 0x55b50fb31730 2024-03-30T13:11:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.239+0000 7f9794c00640 1 -- 172.21.15.44:0/1981396061 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f97a0004c50 con 0x55b50fb31730 2024-03-30T13:11:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.239+0000 7f97b19a1740 10 client.4386 fetch_fsmap learned FSMap version 7 2024-03-30T13:11:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.239+0000 7f97b19a1740 1 -- 172.21.15.44:0/1981396061 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55b50fb1cfa0 con 0x55b50fb31730 2024-03-30T13:11:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.240+0000 7f9794c00640 1 -- 172.21.15.44:0/1981396061 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97a0030040 con 0x55b50fb31730 2024-03-30T13:11:49.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.240+0000 7f9794c00640 1 -- 172.21.15.44:0/1981396061 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f97a002c850 con 0x55b50fb31730 2024-03-30T13:11:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.240+0000 7f97b19a1740 10 client.4386 fetch_fsmap finished waiting for FSMap version 7 2024-03-30T13:11:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.240+0000 7f97b19a1740 10 client.4386 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-30T13:11:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.240+0000 7f97b19a1740 20 client.4386 populate_metadata read hostname 'smithi044' 2024-03-30T13:11:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.240+0000 7f97b19a1740 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55b50fb3caa0 0x55b50fb2fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.240+0000 7f97b19a1740 4 client.4386 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-30T13:11:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.240+0000 7f97b19a1740 1 -- 172.21.15.44:0/1981396061 --> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] -- command(tid 0: {"prefix": "status"}) -- 0x55b50fa60830 con 0x55b50fb3caa0 2024-03-30T13:11:49.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.240+0000 7f97a7e00640 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55b50fb3caa0 0x55b50fb2fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.241+0000 7f97a7e00640 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55b50fb3caa0 0x55b50fb2fa20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89a55996e6a68362 server_cookie=e2f64af5a39396f in_seq=0 out_seq=0 2024-03-30T13:11:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.242+0000 7f9794c00640 10 client.4386 ms_handle_connect on v2:172.21.15.151:6834/456394190 2024-03-30T13:11:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.242+0000 7f9794c00640 1 -- 172.21.15.44:0/1981396061 <== mds.0 v2:172.21.15.151:6834/456394190 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55b50fa60830 con 0x55b50fb3caa0 2024-03-30T13:11:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.242+0000 7f9794c00640 10 client.4386 handle_command_reply: tid=0 2024-03-30T13:11:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.242+0000 7f97b19a1740 1 client.4386 shutdown 2024-03-30T13:11:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.242+0000 7f97b19a1740 1 -- 172.21.15.44:0/1981396061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 msgr2=0x55b50fb3c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.242+0000 7f97b19a1740 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 0x55b50fb3c4a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f97a0037040 tx=0x7f97a0007000 comp rx=0 tx=0).stop 2024-03-30T13:11:49.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.242+0000 7f97b19a1740 1 -- 172.21.15.44:0/1981396061 shutdown_connections 2024-03-30T13:11:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.242+0000 7f97b19a1740 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55b50fb3caa0 0x55b50fb2fa20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.242+0000 7f97b19a1740 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b50fb31730 0x55b50fb3c4a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.243+0000 7f97b19a1740 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b50fb1c6e0 0x55b50fbbe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.243+0000 7f97b19a1740 1 --2- 172.21.15.44:0/1981396061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b50fb1c300 0x55b50fb1d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.243+0000 7f9794c00640 0 client.4386 ms_handle_reset on v2:172.21.15.151:6834/456394190 2024-03-30T13:11:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.243+0000 7f97b19a1740 1 -- 172.21.15.44:0/1981396061 >> 172.21.15.44:0/1981396061 conn(0x55b50faef7e0 msgr2=0x55b50faf3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.243+0000 7f97b19a1740 1 -- 172.21.15.44:0/1981396061 shutdown_connections 2024-03-30T13:11:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.243+0000 7f97b19a1740 1 -- 172.21.15.44:0/1981396061 wait complete. 2024-03-30T13:11:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.243+0000 7f97b19a1740 20 client.4386 trim_cache size 0 max 16384 2024-03-30T13:11:49.251 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:11:49.252 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "cf82a1f9-ad5a-4657-adf6-b77304ed0e9d", 2024-03-30T13:11:49.252 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-03-30T13:11:49.252 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4276, 2024-03-30T13:11:49.252 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-03-30T13:11:49.252 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-03-30T13:11:49.252 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-03-30T13:11:49.252 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 8.2019609409999994, 2024-03-30T13:11:49.252 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 7, 2024-03-30T13:11:49.252 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 27, 2024-03-30T13:11:49.252 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 27, 2024-03-30T13:11:49.252 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 16.125917517000001 2024-03-30T13:11:49.253 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:11:49.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.243+0000 7f97aec00640 1 -- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f978406c530 msgr2=0x7f978406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.243+0000 7f97aec00640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f978406c530 0x7f978406e9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9798009a00 tx=0x7f9798008040 comp rx=0 tx=0).stop 2024-03-30T13:11:49.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.243+0000 7f97aec00640 1 -- 172.21.15.44:0/271049655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a8144100 msgr2=0x7f97a80a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.243+0000 7f97aec00640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a8144100 0x7f97a80a9490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f979000db10 tx=0x7f97900020c0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.244+0000 7f97aec00640 1 -- 172.21.15.44:0/271049655 shutdown_connections 2024-03-30T13:11:49.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.244+0000 7f97aec00640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a80a99d0 0x7f97a80b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.244+0000 7f97aec00640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a8144100 0x7f97a80a9490 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.244+0000 7f97aec00640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f978406c530 0x7f978406e9f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.244+0000 7f97aec00640 1 --2- 172.21.15.44:0/271049655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a8143d20 0x7f97a81e6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.244+0000 7f97aec00640 1 -- 172.21.15.44:0/271049655 >> 172.21.15.44:0/271049655 conn(0x7f97a80b1c90 msgr2=0x7f97a80cb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:49.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.244+0000 7f97aec00640 1 -- 172.21.15.44:0/271049655 shutdown_connections 2024-03-30T13:11:49.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.244+0000 7f97aec00640 1 -- 172.21.15.44:0/271049655 wait complete. 2024-03-30T13:11:49.265 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:11:49.265 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-30T13:11:49.265 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:11:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.476+0000 7fe6c1200640 1 Processor -- start 2024-03-30T13:11:49.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.476+0000 7fe6c1200640 1 -- start start 2024-03-30T13:11:49.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.478+0000 7fe6c1200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe6bc0cdc00 0x7fe6bc166d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.478+0000 7fe6c1200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6bc0737d0 con 0x7fe6bc145820 2024-03-30T13:11:49.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.478+0000 7fe6c1200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6bc072280 con 0x7fe6bc071de0 2024-03-30T13:11:49.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.478+0000 7fe6c1200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fe6bc072560 con 0x7fe6bc0cdc00 2024-03-30T13:11:49.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.478+0000 7fe6bb400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe6bc145820 0x7fe6bc15d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32774/0 (socket says 172.21.15.44:32774) 2024-03-30T13:11:49.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.478+0000 7fe6bb400640 1 -- 172.21.15.44:0/2245570119 learned_addr learned my addr 172.21.15.44:0/2245570119 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6bbe00640 1 --2- 172.21.15.44:0/2245570119 >> v2:172.21.15.151:3300/0 conn(0x7fe6bc0cdc00 0x7fe6bc166d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2119853266 0 0) 0x7fe6bc0737d0 con 0x7fe6bc145820 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6a0003520 con 0x7fe6bc145820 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 619339190 0 0) 0x7fe6a0003520 con 0x7fe6bc145820 2024-03-30T13:11:49.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 >> v2:172.21.15.151:3300/0 conn(0x7fe6bc0cdc00 msgr2=0x7fe6bc166d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 --2- 172.21.15.44:0/2245570119 >> v2:172.21.15.151:3300/0 conn(0x7fe6bc0cdc00 0x7fe6bc166d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 >> v1:172.21.15.151:6789/0 conn(0x7fe6bc071de0 legacy=0x7fe6bc0cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc072840 con 0x7fe6bc145820 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fe6ac001670 con 0x7fe6bc145820 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 >> v1:172.21.15.44:6789/0 conn(0x7fe6bc145820 legacy=0x7fe6bc15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 --2- 172.21.15.44:0/2245570119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a0003a00 0x7fe6a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 --2- 172.21.15.44:0/2245570119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 0x7fe6a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 --2- 172.21.15.44:0/2245570119 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00051c0 0x7fe6a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc072560 con 0x7fe6a0004800 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a000c0c0 con 0x7fe6a0003a00 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.479+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a000c2c0 con 0x7fe6a00051c0 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.480+0000 7fe6b3e00640 1 --2- 172.21.15.44:0/2245570119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 0x7fe6a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.480+0000 7fe6bb400640 1 --2- 172.21.15.44:0/2245570119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a0003a00 0x7fe6a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.480+0000 7fe6b3e00640 1 -- 172.21.15.44:0/2245570119 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00051c0 msgr2=0x7fe6a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.480+0000 7fe6b3e00640 1 --2- 172.21.15.44:0/2245570119 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a00051c0 0x7fe6a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.480+0000 7fe6b3e00640 1 -- 172.21.15.44:0/2245570119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a0003a00 msgr2=0x7fe6a0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.480+0000 7fe6b3e00640 1 --2- 172.21.15.44:0/2245570119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a0003a00 0x7fe6a0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.480+0000 7fe6bbe00640 1 -- 172.21.15.44:0/2245570119 reap_dead start 2024-03-30T13:11:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.480+0000 7fe6b3e00640 1 -- 172.21.15.44:0/2245570119 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a0003520 con 0x7fe6a0004800 2024-03-30T13:11:49.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.480+0000 7fe6bb400640 1 --2- 172.21.15.44:0/2245570119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a0003a00 0x7fe6a0003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.481+0000 7fe6b3e00640 1 --2- 172.21.15.44:0/2245570119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 0x7fe6a0004c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4001750 tx=0x7fe6a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd67d29180cc9bb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.481+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4001370 con 0x7fe6a0004800 2024-03-30T13:11:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.481+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a40052d0 con 0x7fe6a0004800 2024-03-30T13:11:49.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.481+0000 7fe6baa00640 1 -- 172.21.15.44:0/2245570119 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4003830 con 0x7fe6a0004800 2024-03-30T13:11:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.482+0000 7fe6c1200640 1 -- 172.21.15.44:0/2245570119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 msgr2=0x7fe6a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.482+0000 7fe6c1200640 1 --2- 172.21.15.44:0/2245570119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 0x7fe6a0004c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4001750 tx=0x7fe6a0005830 comp rx=0 tx=0).stop 2024-03-30T13:11:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.482+0000 7fe6c1200640 1 -- 172.21.15.44:0/2245570119 shutdown_connections 2024-03-30T13:11:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.482+0000 7fe6c1200640 1 --2- 172.21.15.44:0/2245570119 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 0x7fe6a0004c80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.482+0000 7fe6c1200640 1 -- 172.21.15.44:0/2245570119 >> 172.21.15.44:0/2245570119 conn(0x7fe6bc06b970 msgr2=0x7fe6bc06bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.482+0000 7fe6c1200640 1 -- 172.21.15.44:0/2245570119 shutdown_connections 2024-03-30T13:11:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.482+0000 7fe6c1200640 1 -- 172.21.15.44:0/2245570119 wait complete. 2024-03-30T13:11:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.484+0000 7fe6c1200640 1 Processor -- start 2024-03-30T13:11:49.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.484+0000 7fe6c1200640 1 -- start start 2024-03-30T13:11:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.485+0000 7fe6c1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 0x7fe6bc15da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.485+0000 7fe6c1200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6bc0b45d0 0x7fe6bc13b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.485+0000 7fe6c1200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6bc140720 0x7fe6bc140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.485+0000 7fe6c1200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc145c00 con 0x7fe6a0004800 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.485+0000 7fe6c1200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc072e00 con 0x7fe6bc140720 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.485+0000 7fe6c1200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe6bc0cd4f0 con 0x7fe6bc0b45d0 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.485+0000 7fe6bb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 0x7fe6bc15da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.485+0000 7fe6bb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 0x7fe6bc15da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39850/0 (socket says 172.21.15.44:39850) 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.485+0000 7fe6bb400640 1 -- 172.21.15.44:0/25164517 learned_addr learned my addr 172.21.15.44:0/25164517 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.486+0000 7fe6bbe00640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6bc140720 0x7fe6bc140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.486+0000 7fe6bb400640 1 -- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6bc0b45d0 msgr2=0x7fe6bc13b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.486+0000 7fe6b3e00640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6bc0b45d0 0x7fe6bc13b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.486+0000 7fe6bb400640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6bc0b45d0 0x7fe6bc13b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.486+0000 7fe6bb400640 1 -- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6bc140720 msgr2=0x7fe6bc140ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.486+0000 7fe6bb400640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6bc140720 0x7fe6bc140ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.486+0000 7fe6bb400640 1 -- 172.21.15.44:0/25164517 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc0b4a50 con 0x7fe6a0004800 2024-03-30T13:11:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.486+0000 7fe6bbe00640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6bc140720 0x7fe6bc140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.486+0000 7fe6b3e00640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6bc0b45d0 0x7fe6bc13b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.486+0000 7fe6bb400640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 0x7fe6bc15da20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac000ff0 tx=0x7fe6ac00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.487+0000 7fe6b3400640 1 -- 172.21.15.44:0/25164517 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac019070 con 0x7fe6a0004800 2024-03-30T13:11:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.487+0000 7fe6b3400640 1 -- 172.21.15.44:0/25164517 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ac0072d0 con 0x7fe6a0004800 2024-03-30T13:11:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.487+0000 7fe6b3400640 1 -- 172.21.15.44:0/25164517 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0047e0 con 0x7fe6a0004800 2024-03-30T13:11:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.487+0000 7fe6c1200640 1 -- 172.21.15.44:0/25164517 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6bc0b3150 con 0x7fe6a0004800 2024-03-30T13:11:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.487+0000 7fe6c1200640 1 -- 172.21.15.44:0/25164517 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6bc0b3710 con 0x7fe6a0004800 2024-03-30T13:11:49.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.488+0000 7fe6c1200640 1 -- 172.21.15.44:0/25164517 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6bc1410e0 con 0x7fe6a0004800 2024-03-30T13:11:49.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.489+0000 7fe6b3400640 1 -- 172.21.15.44:0/25164517 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe6ac01c070 con 0x7fe6a0004800 2024-03-30T13:11:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.490+0000 7fe6b3400640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe69806c530 0x7fe69806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.490+0000 7fe6b3400640 1 -- 172.21.15.44:0/25164517 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe6ac08b3e0 con 0x7fe6a0004800 2024-03-30T13:11:49.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.491+0000 7fe6b3e00640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe69806c530 0x7fe69806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:49.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.492+0000 7fe6b3e00640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe69806c530 0x7fe69806e9f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4033000 tx=0x7fe6a4009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:49.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.495+0000 7fe6b3400640 1 -- 172.21.15.44:0/25164517 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe6ac059620 con 0x7fe6a0004800 2024-03-30T13:11:49.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.739+0000 7fe6c1200640 1 -- 172.21.15.44:0/25164517 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe6bc075890 con 0x7fe6a0004800 2024-03-30T13:11:49.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.739+0000 7fe6b3400640 1 -- 172.21.15.44:0/25164517 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7fe6ac058f20 con 0x7fe6a0004800 2024-03-30T13:11:49.743 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-30T13:11:49.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.741+0000 7fe6c1200640 1 -- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe69806c530 msgr2=0x7fe69806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.741+0000 7fe6c1200640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe69806c530 0x7fe69806e9f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4033000 tx=0x7fe6a4009030 comp rx=0 tx=0).stop 2024-03-30T13:11:49.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.741+0000 7fe6c1200640 1 -- 172.21.15.44:0/25164517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 msgr2=0x7fe6bc15da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:49.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.741+0000 7fe6c1200640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 0x7fe6bc15da20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac000ff0 tx=0x7fe6ac00dc00 comp rx=0 tx=0).stop 2024-03-30T13:11:49.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.742+0000 7fe6c1200640 1 -- 172.21.15.44:0/25164517 shutdown_connections 2024-03-30T13:11:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.742+0000 7fe6c1200640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe69806c530 0x7fe69806e9f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.742+0000 7fe6c1200640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6bc140720 0x7fe6bc140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.742+0000 7fe6c1200640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6bc0b45d0 0x7fe6bc13b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.742+0000 7fe6c1200640 1 --2- 172.21.15.44:0/25164517 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6a0004800 0x7fe6bc15da20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.742+0000 7fe6c1200640 1 -- 172.21.15.44:0/25164517 >> 172.21.15.44:0/25164517 conn(0x7fe6bc06b970 msgr2=0x7fe6bc0b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.742+0000 7fe6c1200640 1 -- 172.21.15.44:0/25164517 shutdown_connections 2024-03-30T13:11:49.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49.742+0000 7fe6c1200640 1 -- 172.21.15.44:0/25164517 wait complete. 2024-03-30T13:11:49.764 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-30T13:11:49.764 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:11:49.764 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-03-30T13:11:49.764 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-03-30T13:11:49.764 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-30T13:11:49.765 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-30T13:11:49.765 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:11:49.765 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:11:49.765 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-03-30T13:11:49.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:49.765 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-03-30T13:11:49.813 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:11:49.814 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:49.815 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-03-30T13:11:49.815 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-30T13:11:49.815 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42577sec preferred_lft 42577sec 2024-03-30T13:11:49.815 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2024-03-30T13:11:49.815 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:11:49.815 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:11:49.815 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:11:49.815 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-03-30T13:11:49.816 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-30T13:11:49.816 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:49.816 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:11:49.816 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2024-03-30T13:11:49.817 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2024-03-30T13:11:49.817 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2024-03-30T13:11:49.817 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-30T13:11:49.817 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:11:49.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:50.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:50.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:50.342 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:11:50.426 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-03-30T13:11:50.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:50.430 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-03-30T13:11:50.488 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-03-30T13:11:50.489 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:11:50.489 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-30T13:11:50.489 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-30T13:11:50.489 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:11:50.489 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:50.489 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:11:50.489 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-30T13:11:50.490 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-30T13:11:50.490 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-30T13:11:50.490 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:11:50.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:51.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:51.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:51.298 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-03-30T13:11:51.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:51.353 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-03-30T13:11:51.406 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:51.406 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:11:51.406 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-30T13:11:51.406 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-03-30T13:11:51.406 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:11:51.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:51.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:51.623 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-03-30T13:11:51.623 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:51.623 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:11:51.623 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-03-30T13:11:51.623 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-30T13:11:51.623 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-03-30T13:11:51.624 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-03-30T13:11:51.624 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-03-30T13:11:51.624 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:11:51.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:51.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:51.983 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:11:51.983 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:11:51.983 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-03-30T13:11:51.984 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2024-03-30T13:11:51.984 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:11:52.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:11:52.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:52.217 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-03-30T13:11:52.217 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:11:52.217 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-03-30T13:11:52.264 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-03-30T13:11:52.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:11:52.264 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-03-30T13:11:52.357 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-03-30T13:11:52.451 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:11:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-03-30T13:11:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-03-30T13:11:52.508 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-03-30T13:11:52.509 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-03-30T13:11:52.510 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-30T13:11:52.511 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-30T13:11:52.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:52.512 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-03-30T13:11:52.564 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-30T13:11:52.564 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-03-30T13:11:52.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-03-30T13:11:52.649 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-03-30T13:11:52.693 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-03-30T13:11:52.693 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-03-30T13:11:52.693 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-03-30T13:11:52.694 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-0 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-1 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-2 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph/osd/ceph-3 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-03-30T13:11:52.695 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-30T13:11:52.696 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-30T13:11:52.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:52.697 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-03-30T13:11:52.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:2024-03-30T13:11:52.758+0000 7ff871073480 -1 init, newargv = 0x563e8912d4f0 newargc=15 2024-03-30T13:11:52.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[43389]: starting ceph client 2024-03-30T13:11:52.776 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[43389]: starting fuse 2024-03-30T13:11:52.785 INFO:teuthology.orchestra.run.smithi044.stdout:42 2024-03-30T13:11:52.785 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-30T13:11:52.785 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2024-03-30T13:11:52.785 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-03-30T13:11:52.785 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-03-30T13:11:52.785 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-03-30T13:11:52.785 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-30T13:11:52.786 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-30T13:11:52.787 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-03-30T13:11:52.787 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-03-30T13:11:52.787 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-03-30T13:11:52.787 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-30T13:11:52.787 DEBUG:teuthology.orchestra.run.smithi044:> 2024-03-30T13:11:52.787 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.admin")) 2024-03-30T13:11:52.787 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-03-30T13:11:52.994 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.admin.43389.asok 2024-03-30T13:11:52.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:53.012 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43389.asok 2024-03-30T13:11:53.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:53.012 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43389.asok status 2024-03-30T13:11:53.261 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:11:53.261 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-03-30T13:11:53.261 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "ac1710396f9f7c389fa4b407711bc5157a8c0bf7", 2024-03-30T13:11:53.261 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.0.0-2519-gac171039 (ac1710396f9f7c389fa4b407711bc5157a8c0bf7) squid (dev)", 2024-03-30T13:11:53.261 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "admin", 2024-03-30T13:11:53.261 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-03-30T13:11:53.261 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-03-30T13:11:53.261 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "43389", 2024-03-30T13:11:53.261 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-03-30T13:11:53.261 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:11:53.261 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4398, 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 4398 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 946908488 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:11:53.262 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 946908488 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.4398 192.168.0.1:0/946908488", 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/946908488", 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 7, 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 27, 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-03-30T13:11:53.263 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:11:53.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:53.276 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-03-30T13:11:53.276 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-03-30T13:11:53.331 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-03-30T13:11:53.331 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-03-30T13:11:53.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:53.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-03-30T13:11:53.431 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-03-30T13:11:53.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:11:53.596 INFO:teuthology.orchestra.run.smithi044.stdout:# file: . 2024-03-30T13:11:53.596 INFO:teuthology.orchestra.run.smithi044.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-03-30T13:11:53.596 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:53.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:11:53.607 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:53.607 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:53.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:53.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.885+0000 7f0f54200640 1 Processor -- start 2024-03-30T13:11:53.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.885+0000 7f0f54200640 1 -- start start 2024-03-30T13:11:53.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.887+0000 7f0f54200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4c071c30 0x7f0f4c160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.887+0000 7f0f54200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4c146040 con 0x7f0f4c145c60 2024-03-30T13:11:53.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.887+0000 7f0f54200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4c160e50 con 0x7f0f4c160660 2024-03-30T13:11:53.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.887+0000 7f0f54200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c15d8b0 con 0x7f0f4c071c30 2024-03-30T13:11:53.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.887+0000 7f0f51800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0f4c145c60 0x7f0f4c071520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32776/0 (socket says 172.21.15.44:32776) 2024-03-30T13:11:53.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.887+0000 7f0f51800640 1 -- 172.21.15.44:0/100235838 learned_addr learned my addr 172.21.15.44:0/100235838 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:53.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.887+0000 7f0f50e00640 1 --2- 172.21.15.44:0/100235838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4c071c30 0x7f0f4c160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 63072699 0 0) 0x7f0f4c146040 con 0x7f0f4c145c60 2024-03-30T13:11:53.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f34003520 con 0x7f0f4c145c60 2024-03-30T13:11:53.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1492196770 0 0) 0x7f0f34003520 con 0x7f0f4c145c60 2024-03-30T13:11:53.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4c071c30 msgr2=0x7f0f4c160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:53.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 --2- 172.21.15.44:0/100235838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4c071c30 0x7f0f4c160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 >> v1:172.21.15.151:6789/0 conn(0x7f0f4c160660 legacy=0x7f0f4c0ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c15caf0 con 0x7f0f4c145c60 2024-03-30T13:11:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f0f40001670 con 0x7f0f4c145c60 2024-03-30T13:11:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 >> v1:172.21.15.44:6789/0 conn(0x7f0f4c145c60 legacy=0x7f0f4c071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 --2- 172.21.15.44:0/100235838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4c071c30 0x7f0f340039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 --2- 172.21.15.44:0/100235838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f34003f60 0x7f0f34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 --2- 172.21.15.44:0/100235838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f34004d40 0x7f0f340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c15d8b0 con 0x7f0f34004d40 2024-03-30T13:11:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3400bb50 con 0x7f0f34003f60 2024-03-30T13:11:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.888+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3400bd50 con 0x7f0f4c071c30 2024-03-30T13:11:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.889+0000 7f0f52200640 1 --2- 172.21.15.44:0/100235838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f34004d40 0x7f0f340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.889+0000 7f0f50e00640 1 --2- 172.21.15.44:0/100235838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f34003f60 0x7f0f34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.889+0000 7f0f51800640 1 --2- 172.21.15.44:0/100235838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4c071c30 0x7f0f340039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.889+0000 7f0f52200640 1 -- 172.21.15.44:0/100235838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4c071c30 msgr2=0x7f0f340039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.889+0000 7f0f52200640 1 --2- 172.21.15.44:0/100235838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4c071c30 0x7f0f340039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.889+0000 7f0f52200640 1 -- 172.21.15.44:0/100235838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f34003f60 msgr2=0x7f0f34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.889+0000 7f0f52200640 1 --2- 172.21.15.44:0/100235838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f34003f60 0x7f0f34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.889+0000 7f0f52200640 1 -- 172.21.15.44:0/100235838 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f34003520 con 0x7f0f34004d40 2024-03-30T13:11:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.890+0000 7f0f52200640 1 --2- 172.21.15.44:0/100235838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f34004d40 0x7f0f340051c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0f44001e50 tx=0x7f0f34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01b9e44c9fc74e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:53.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.890+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44001a70 con 0x7f0f34004d40 2024-03-30T13:11:53.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.890+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f44003b70 con 0x7f0f34004d40 2024-03-30T13:11:53.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.890+0000 7f0f4be00640 1 -- 172.21.15.44:0/100235838 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f440050d0 con 0x7f0f34004d40 2024-03-30T13:11:53.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.891+0000 7f0f54200640 1 -- 172.21.15.44:0/100235838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f34004d40 msgr2=0x7f0f340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:53.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.891+0000 7f0f54200640 1 --2- 172.21.15.44:0/100235838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f34004d40 0x7f0f340051c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0f44001e50 tx=0x7f0f34005830 comp rx=0 tx=0).stop 2024-03-30T13:11:53.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.891+0000 7f0f52200640 1 -- 172.21.15.44:0/100235838 reap_dead start 2024-03-30T13:11:53.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.891+0000 7f0f54200640 1 -- 172.21.15.44:0/100235838 shutdown_connections 2024-03-30T13:11:53.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.891+0000 7f0f54200640 1 -- 172.21.15.44:0/100235838 >> 172.21.15.44:0/100235838 conn(0x7f0f4c0b1c90 msgr2=0x7f0f4c0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:53.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.891+0000 7f0f54200640 1 -- 172.21.15.44:0/100235838 shutdown_connections 2024-03-30T13:11:53.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.891+0000 7f0f54200640 1 -- 172.21.15.44:0/100235838 wait complete. 2024-03-30T13:11:53.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.893+0000 7f0f54200640 1 Processor -- start 2024-03-30T13:11:53.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.893+0000 7f0f54200640 1 -- start start 2024-03-30T13:11:53.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.894+0000 7f0f54200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f34004d40 0x7f0f4c15b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.894+0000 7f0f54200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f4c1f4330 0x7f0f4c0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.894+0000 7f0f54200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4c0b5940 0x7f0f4c0c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.894+0000 7f0f54200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c160b10 con 0x7f0f34004d40 2024-03-30T13:11:53.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.894+0000 7f0f54200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c15d0b0 con 0x7f0f4c1f4330 2024-03-30T13:11:53.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.894+0000 7f0f54200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c160120 con 0x7f0f4c0b5940 2024-03-30T13:11:53.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.894+0000 7f0f51800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f34004d40 0x7f0f4c15b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.894+0000 7f0f51800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f34004d40 0x7f0f4c15b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39862/0 (socket says 172.21.15.44:39862) 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.894+0000 7f0f51800640 1 -- 172.21.15.44:0/3961269750 learned_addr learned my addr 172.21.15.44:0/3961269750 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.895+0000 7f0f50e00640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f4c1f4330 0x7f0f4c0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.895+0000 7f0f51800640 1 -- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4c0b5940 msgr2=0x7f0f4c0c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.895+0000 7f0f51800640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4c0b5940 0x7f0f4c0c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.895+0000 7f0f51800640 1 -- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f4c1f4330 msgr2=0x7f0f4c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.895+0000 7f0f51800640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f4c1f4330 0x7f0f4c0b5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.895+0000 7f0f51800640 1 -- 172.21.15.44:0/3961269750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c0b3b90 con 0x7f0f34004d40 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.895+0000 7f0f51800640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f34004d40 0x7f0f4c15b2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000e840 tx=0x7f0f4000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.895+0000 7f0f49600640 1 -- 172.21.15.44:0/3961269750 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4000c850 con 0x7f0f34004d40 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.895+0000 7f0f49600640 1 -- 172.21.15.44:0/3961269750 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f40018070 con 0x7f0f34004d40 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.895+0000 7f0f49600640 1 -- 172.21.15.44:0/3961269750 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4000cc30 con 0x7f0f34004d40 2024-03-30T13:11:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.895+0000 7f0f54200640 1 -- 172.21.15.44:0/3961269750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4c0b3e70 con 0x7f0f34004d40 2024-03-30T13:11:53.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.896+0000 7f0f54200640 1 -- 172.21.15.44:0/3961269750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4c0ce920 con 0x7f0f34004d40 2024-03-30T13:11:53.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.897+0000 7f0f54200640 1 -- 172.21.15.44:0/3961269750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f4c075a10 con 0x7f0f34004d40 2024-03-30T13:11:53.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.898+0000 7f0f49600640 1 -- 172.21.15.44:0/3961269750 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0f4001d460 con 0x7f0f34004d40 2024-03-30T13:11:53.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.898+0000 7f0f49600640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2c06c560 0x7f0f2c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:53.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.899+0000 7f0f49600640 1 -- 172.21.15.44:0/3961269750 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0f4008b990 con 0x7f0f34004d40 2024-03-30T13:11:53.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.899+0000 7f0f50e00640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2c06c560 0x7f0f2c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:53.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.900+0000 7f0f50e00640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2c06c560 0x7f0f2c06ea20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c073ab0 tx=0x7f0f38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:53.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:53.903+0000 7f0f49600640 1 -- 172.21.15.44:0/3961269750 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0f40059bd0 con 0x7f0f34004d40 2024-03-30T13:11:54.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.108+0000 7f0f54200640 1 -- 172.21.15.44:0/3961269750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f4c15b800 con 0x7f0f34004d40 2024-03-30T13:11:54.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.110+0000 7f0f49600640 1 -- 172.21.15.44:0/3961269750 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7f0f400594d0 con 0x7f0f34004d40 2024-03-30T13:11:54.114 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:54.114 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:54.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.113+0000 7f0f54200640 1 -- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2c06c560 msgr2=0x7f0f2c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.113+0000 7f0f54200640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2c06c560 0x7f0f2c06ea20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c073ab0 tx=0x7f0f38008040 comp rx=0 tx=0).stop 2024-03-30T13:11:54.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.113+0000 7f0f54200640 1 -- 172.21.15.44:0/3961269750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f34004d40 msgr2=0x7f0f4c15b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.113+0000 7f0f54200640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f34004d40 0x7f0f4c15b2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000e840 tx=0x7f0f4000ed00 comp rx=0 tx=0).stop 2024-03-30T13:11:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.113+0000 7f0f54200640 1 -- 172.21.15.44:0/3961269750 shutdown_connections 2024-03-30T13:11:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.113+0000 7f0f54200640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4c0b5940 0x7f0f4c0c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.113+0000 7f0f54200640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2c06c560 0x7f0f2c06ea20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.113+0000 7f0f54200640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f4c1f4330 0x7f0f4c0b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.113+0000 7f0f54200640 1 --2- 172.21.15.44:0/3961269750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f34004d40 0x7f0f4c15b2c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.113+0000 7f0f54200640 1 -- 172.21.15.44:0/3961269750 >> 172.21.15.44:0/3961269750 conn(0x7f0f4c0b1c90 msgr2=0x7f0f4c0cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.113+0000 7f0f54200640 1 -- 172.21.15.44:0/3961269750 shutdown_connections 2024-03-30T13:11:54.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.113+0000 7f0f54200640 1 -- 172.21.15.44:0/3961269750 wait complete. 2024-03-30T13:11:54.135 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:11:54.136 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:54.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.344+0000 7fa4c2c00640 1 Processor -- start 2024-03-30T13:11:54.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.344+0000 7fa4c2c00640 1 -- start start 2024-03-30T13:11:54.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.346+0000 7fa4c2c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4bc144cb0 0x7fa4bc0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.346+0000 7fa4c2c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4bc0b35e0 con 0x7fa4bc15f800 2024-03-30T13:11:54.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.346+0000 7fa4c2c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4bc0b38c0 con 0x7fa4bc072d50 2024-03-30T13:11:54.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.346+0000 7fa4c2c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa4bc0b3e80 con 0x7fa4bc144cb0 2024-03-30T13:11:54.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.347+0000 7fa4b3e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa4bc15f800 0x7fa4bc072640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32790/0 (socket says 172.21.15.44:32790) 2024-03-30T13:11:54.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.347+0000 7fa4b3e00640 1 -- 172.21.15.44:0/1021682719 learned_addr learned my addr 172.21.15.44:0/1021682719 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:54.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.347+0000 7fa4bbe00640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4bc144cb0 0x7fa4bc0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.347+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2152851992 0 0) 0x7fa4bc0b35e0 con 0x7fa4bc15f800 2024-03-30T13:11:54.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.347+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4a0003520 con 0x7fa4bc15f800 2024-03-30T13:11:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.347+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1974785801 0 0) 0x7fa4a0003520 con 0x7fa4bc15f800 2024-03-30T13:11:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4bc144cb0 msgr2=0x7fa4bc0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bb400640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4bc144cb0 0x7fa4bc0b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 >> v1:172.21.15.151:6789/0 conn(0x7fa4bc072d50 legacy=0x7fa4bc0ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4bc0b3ba0 con 0x7fa4bc15f800 2024-03-30T13:11:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fa4a4001670 con 0x7fa4bc15f800 2024-03-30T13:11:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 >> v1:172.21.15.44:6789/0 conn(0x7fa4bc15f800 legacy=0x7fa4bc072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bb400640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4a00039e0 0x7fa4a0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bb400640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4bc144cb0 0x7fa4a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bb400640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4a0004d40 0x7fa4a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc0b3e80 con 0x7fa4a0004d40 2024-03-30T13:11:54.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a000ba70 con 0x7fa4a00039e0 2024-03-30T13:11:54.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa4a000de80 con 0x7fa4bc144cb0 2024-03-30T13:11:54.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4c0c00640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4a0004d40 0x7fa4a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4bbe00640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4a00039e0 0x7fa4a0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.348+0000 7fa4b3e00640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4bc144cb0 0x7fa4a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.349+0000 7fa4c0c00640 1 -- 172.21.15.44:0/1021682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4bc144cb0 msgr2=0x7fa4a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:54.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.349+0000 7fa4c0c00640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4bc144cb0 0x7fa4a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.349+0000 7fa4c0c00640 1 -- 172.21.15.44:0/1021682719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4a00039e0 msgr2=0x7fa4a0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:54.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.349+0000 7fa4c0c00640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4a00039e0 0x7fa4a0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.349+0000 7fa4c0c00640 1 -- 172.21.15.44:0/1021682719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a0003520 con 0x7fa4a0004d40 2024-03-30T13:11:54.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.349+0000 7fa4b3e00640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4bc144cb0 0x7fa4a0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:54.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.350+0000 7fa4c0c00640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4a0004d40 0x7fa4a00051c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc071200 tx=0x7fa4a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0971e99605a2733 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:54.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.350+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4001a70 con 0x7fa4a0004d40 2024-03-30T13:11:54.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.350+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b4003b70 con 0x7fa4a0004d40 2024-03-30T13:11:54.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.350+0000 7fa4bb400640 1 -- 172.21.15.44:0/1021682719 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40050d0 con 0x7fa4a0004d40 2024-03-30T13:11:54.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.351+0000 7fa4c2c00640 1 -- 172.21.15.44:0/1021682719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4a0004d40 msgr2=0x7fa4a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.351+0000 7fa4c2c00640 1 --2- 172.21.15.44:0/1021682719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4a0004d40 0x7fa4a00051c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc071200 tx=0x7fa4a0005830 comp rx=0 tx=0).stop 2024-03-30T13:11:54.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.351+0000 7fa4c0c00640 1 -- 172.21.15.44:0/1021682719 reap_dead start 2024-03-30T13:11:54.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.351+0000 7fa4c2c00640 1 -- 172.21.15.44:0/1021682719 shutdown_connections 2024-03-30T13:11:54.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.351+0000 7fa4c2c00640 1 -- 172.21.15.44:0/1021682719 >> 172.21.15.44:0/1021682719 conn(0x7fa4bc0b5b00 msgr2=0x7fa4bc06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:54.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.351+0000 7fa4c2c00640 1 -- 172.21.15.44:0/1021682719 shutdown_connections 2024-03-30T13:11:54.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.351+0000 7fa4c2c00640 1 -- 172.21.15.44:0/1021682719 wait complete. 2024-03-30T13:11:54.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.353+0000 7fa4c2c00640 1 Processor -- start 2024-03-30T13:11:54.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.353+0000 7fa4c2c00640 1 -- start start 2024-03-30T13:11:54.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.354+0000 7fa4c2c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4a0004d40 0x7fa4bc0c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.354+0000 7fa4c2c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4bc143650 0x7fa4bc143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.354+0000 7fa4c2c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4bc0c5820 0x7fa4bc0c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.354+0000 7fa4c2c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc0b2f20 con 0x7fa4bc0c5820 2024-03-30T13:11:54.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.354+0000 7fa4c2c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc15fc40 con 0x7fa4bc143650 2024-03-30T13:11:54.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.354+0000 7fa4c2c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa4bc0b30a0 con 0x7fa4a0004d40 2024-03-30T13:11:54.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.354+0000 7fa4c0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4bc0c5820 0x7fa4bc0c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.354+0000 7fa4c0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4bc0c5820 0x7fa4bc0c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39868/0 (socket says 172.21.15.44:39868) 2024-03-30T13:11:54.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.354+0000 7fa4c0c00640 1 -- 172.21.15.44:0/2824987412 learned_addr learned my addr 172.21.15.44:0/2824987412 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:54.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.355+0000 7fa4b3e00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4bc143650 0x7fa4bc143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.355+0000 7fa4bbe00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4a0004d40 0x7fa4bc0c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.355+0000 7fa4c0c00640 1 -- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4a0004d40 msgr2=0x7fa4bc0c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.355+0000 7fa4c0c00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4a0004d40 0x7fa4bc0c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.355+0000 7fa4c0c00640 1 -- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4bc143650 msgr2=0x7fa4bc143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.355+0000 7fa4c0c00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4bc143650 0x7fa4bc143ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.355+0000 7fa4c0c00640 1 -- 172.21.15.44:0/2824987412 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4bc0c83e0 con 0x7fa4bc0c5820 2024-03-30T13:11:54.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.355+0000 7fa4c0c00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4bc0c5820 0x7fa4bc0c5c90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4001f10 tx=0x7fa4b40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:54.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.355+0000 7fa4b8c00640 1 -- 172.21.15.44:0/2824987412 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4007db0 con 0x7fa4bc0c5820 2024-03-30T13:11:54.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.356+0000 7fa4b8c00640 1 -- 172.21.15.44:0/2824987412 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b4003970 con 0x7fa4bc0c5820 2024-03-30T13:11:54.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.356+0000 7fa4b8c00640 1 -- 172.21.15.44:0/2824987412 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4006d70 con 0x7fa4bc0c5820 2024-03-30T13:11:54.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.356+0000 7fa4c2c00640 1 -- 172.21.15.44:0/2824987412 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4bc0c86c0 con 0x7fa4bc0c5820 2024-03-30T13:11:54.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.356+0000 7fa4c2c00640 1 -- 172.21.15.44:0/2824987412 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4bc0c8c80 con 0x7fa4bc0c5820 2024-03-30T13:11:54.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.357+0000 7fa4c2c00640 1 -- 172.21.15.44:0/2824987412 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4bc075890 con 0x7fa4bc0c5820 2024-03-30T13:11:54.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.358+0000 7fa4b8c00640 1 -- 172.21.15.44:0/2824987412 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa4b4041030 con 0x7fa4bc0c5820 2024-03-30T13:11:54.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.359+0000 7fa4b8c00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa49806c560 0x7fa49806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.359+0000 7fa4b8c00640 1 -- 172.21.15.44:0/2824987412 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa4b40accf0 con 0x7fa4bc0c5820 2024-03-30T13:11:54.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.359+0000 7fa4bbe00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa49806c560 0x7fa49806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.360+0000 7fa4bbe00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa49806c560 0x7fa49806ea20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc1e7e30 tx=0x7fa4ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:54.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.363+0000 7fa4b8c00640 1 -- 172.21.15.44:0/2824987412 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa4b4033020 con 0x7fa4bc0c5820 2024-03-30T13:11:54.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.569+0000 7fa4c2c00640 1 -- 172.21.15.44:0/2824987412 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa4bc0b4030 con 0x7fa4bc0c5820 2024-03-30T13:11:54.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.569+0000 7fa4b8c00640 1 -- 172.21.15.44:0/2824987412 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fa4b407afc0 con 0x7fa4bc0c5820 2024-03-30T13:11:54.573 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:11:54.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.573+0000 7fa4c2c00640 1 -- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa49806c560 msgr2=0x7fa49806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.573+0000 7fa4c2c00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa49806c560 0x7fa49806ea20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc1e7e30 tx=0x7fa4ac008040 comp rx=0 tx=0).stop 2024-03-30T13:11:54.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.573+0000 7fa4c2c00640 1 -- 172.21.15.44:0/2824987412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4bc0c5820 msgr2=0x7fa4bc0c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.573+0000 7fa4c2c00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4bc0c5820 0x7fa4bc0c5c90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4001f10 tx=0x7fa4b40014a0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.573+0000 7fa4c2c00640 1 -- 172.21.15.44:0/2824987412 shutdown_connections 2024-03-30T13:11:54.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.573+0000 7fa4c2c00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa4bc0c5820 0x7fa4bc0c5c90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.573+0000 7fa4c2c00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa49806c560 0x7fa49806ea20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.573+0000 7fa4c2c00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4bc143650 0x7fa4bc143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.573+0000 7fa4c2c00640 1 --2- 172.21.15.44:0/2824987412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4a0004d40 0x7fa4bc0c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.573+0000 7fa4c2c00640 1 -- 172.21.15.44:0/2824987412 >> 172.21.15.44:0/2824987412 conn(0x7fa4bc0b5b00 msgr2=0x7fa4bc0cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:54.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.573+0000 7fa4c2c00640 1 -- 172.21.15.44:0/2824987412 shutdown_connections 2024-03-30T13:11:54.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.573+0000 7fa4c2c00640 1 -- 172.21.15.44:0/2824987412 wait complete. 2024-03-30T13:11:54.597 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:54.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.796+0000 7fae96200640 1 Processor -- start 2024-03-30T13:11:54.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.796+0000 7fae96200640 1 -- start start 2024-03-30T13:11:54.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.797+0000 7fae96200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fae90158a20 0x7fae9006b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.797+0000 7fae96200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fae900b0740 0x7fae9006bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.797+0000 7fae96200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae90072570 con 0x7fae90158e00 2024-03-30T13:11:54.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.797+0000 7fae96200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fae90072850 con 0x7fae90158a20 2024-03-30T13:11:54.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.797+0000 7fae96200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fae90072b30 con 0x7fae900b0740 2024-03-30T13:11:54.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.798+0000 7fae8f400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fae90158a20 0x7fae9006b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.798+0000 7fae8ea00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fae90158e00 0x7fae900b0030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32800/0 (socket says 172.21.15.44:32800) 2024-03-30T13:11:54.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.798+0000 7fae8ea00640 1 -- 172.21.15.44:0/2780902704 learned_addr learned my addr 172.21.15.44:0/2780902704 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:54.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.798+0000 7fae8fe00640 1 --2- 172.21.15.44:0/2780902704 >> v2:172.21.15.151:3300/0 conn(0x7fae900b0740 0x7fae9006bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.798+0000 7fae8f400640 1 -- 172.21.15.44:0/2780902704 >> v2:172.21.15.151:3300/0 conn(0x7fae900b0740 msgr2=0x7fae9006bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:54.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.798+0000 7fae8f400640 1 --2- 172.21.15.44:0/2780902704 >> v2:172.21.15.151:3300/0 conn(0x7fae900b0740 0x7fae9006bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.798+0000 7fae8f400640 1 -- 172.21.15.44:0/2780902704 >> v1:172.21.15.44:6789/0 conn(0x7fae90158e00 legacy=0x7fae900b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.798+0000 7fae8e000640 1 -- 172.21.15.44:0/2780902704 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2462420764 0 0) 0x7fae90072570 con 0x7fae90158e00 2024-03-30T13:11:54.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.799+0000 7fae8f400640 1 -- 172.21.15.44:0/2780902704 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae90072e10 con 0x7fae90158a20 2024-03-30T13:11:54.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.800+0000 7fae8f400640 1 --2- 172.21.15.44:0/2780902704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae90158a20 0x7fae9006b580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae900afd10 tx=0x7fae8002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798d2b67e00688fd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:54.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.800+0000 7fae8e000640 1 -- 172.21.15.44:0/2780902704 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae80035020 con 0x7fae90158a20 2024-03-30T13:11:54.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.800+0000 7fae8e000640 1 -- 172.21.15.44:0/2780902704 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae80031830 con 0x7fae90158a20 2024-03-30T13:11:54.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.800+0000 7fae8e000640 1 -- 172.21.15.44:0/2780902704 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae80031c00 con 0x7fae90158a20 2024-03-30T13:11:54.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.801+0000 7fae96200640 1 -- 172.21.15.44:0/2780902704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae90158a20 msgr2=0x7fae9006b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.801+0000 7fae96200640 1 --2- 172.21.15.44:0/2780902704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae90158a20 0x7fae9006b580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae900afd10 tx=0x7fae8002b8d0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.801+0000 7fae96200640 1 -- 172.21.15.44:0/2780902704 shutdown_connections 2024-03-30T13:11:54.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.801+0000 7fae96200640 1 --2- 172.21.15.44:0/2780902704 >> v2:172.21.15.151:3300/0 conn(0x7fae900b0740 0x7fae9006bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.801+0000 7fae96200640 1 --2- 172.21.15.44:0/2780902704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae90158a20 0x7fae9006b580 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.801+0000 7fae96200640 1 -- 172.21.15.44:0/2780902704 >> 172.21.15.44:0/2780902704 conn(0x7fae900d1160 msgr2=0x7fae900d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:54.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.801+0000 7fae96200640 1 -- 172.21.15.44:0/2780902704 shutdown_connections 2024-03-30T13:11:54.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.801+0000 7fae96200640 1 -- 172.21.15.44:0/2780902704 wait complete. 2024-03-30T13:11:54.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.802+0000 7fae96200640 1 Processor -- start 2024-03-30T13:11:54.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.803+0000 7fae96200640 1 -- start start 2024-03-30T13:11:54.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae96200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae900b0740 0x7fae900cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae96200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae90158a20 0x7fae9015df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae96200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae90158e00 0x7fae9015b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae96200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fae900b4290 con 0x7fae900b0740 2024-03-30T13:11:54.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae96200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fae900b4110 con 0x7fae90158e00 2024-03-30T13:11:54.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae96200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fae900b4410 con 0x7fae90158a20 2024-03-30T13:11:54.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae8f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae900b0740 0x7fae900cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae8f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae900b0740 0x7fae900cda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39884/0 (socket says 172.21.15.44:39884) 2024-03-30T13:11:54.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae8f400640 1 -- 172.21.15.44:0/295812594 learned_addr learned my addr 172.21.15.44:0/295812594 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:54.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae8ea00640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae90158a20 0x7fae9015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae8fe00640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae90158e00 0x7fae9015b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae8f400640 1 -- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae90158a20 msgr2=0x7fae9015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae8f400640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae90158a20 0x7fae9015df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae8f400640 1 -- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae90158e00 msgr2=0x7fae9015b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae8f400640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae90158e00 0x7fae9015b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.804+0000 7fae8f400640 1 -- 172.21.15.44:0/295812594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae9015c750 con 0x7fae900b0740 2024-03-30T13:11:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.805+0000 7fae8f400640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae900b0740 0x7fae900cda90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae80009890 tx=0x7fae800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.805+0000 7fae87400640 1 -- 172.21.15.44:0/295812594 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae80041070 con 0x7fae900b0740 2024-03-30T13:11:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.805+0000 7fae87400640 1 -- 172.21.15.44:0/295812594 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae8003b920 con 0x7fae900b0740 2024-03-30T13:11:54.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.805+0000 7fae96200640 1 -- 172.21.15.44:0/295812594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae9015c470 con 0x7fae900b0740 2024-03-30T13:11:54.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.805+0000 7fae87400640 1 -- 172.21.15.44:0/295812594 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae80035040 con 0x7fae900b0740 2024-03-30T13:11:54.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.805+0000 7fae96200640 1 -- 172.21.15.44:0/295812594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae901596c0 con 0x7fae900b0740 2024-03-30T13:11:54.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.806+0000 7fae96200640 1 -- 172.21.15.44:0/295812594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae90075890 con 0x7fae900b0740 2024-03-30T13:11:54.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.808+0000 7fae87400640 1 -- 172.21.15.44:0/295812594 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fae80038020 con 0x7fae900b0740 2024-03-30T13:11:54.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.808+0000 7fae87400640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fae7006c530 0x7fae7006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:54.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.809+0000 7fae87400640 1 -- 172.21.15.44:0/295812594 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fae800ad3c0 con 0x7fae900b0740 2024-03-30T13:11:54.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.809+0000 7fae8ea00640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fae7006c530 0x7fae7006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:54.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.810+0000 7fae8ea00640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fae7006c530 0x7fae7006e9f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fae901f4dd0 tx=0x7fae7c007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:54.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:54.817+0000 7fae87400640 1 -- 172.21.15.44:0/295812594 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fae8002f2e0 con 0x7fae900b0740 2024-03-30T13:11:55.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.024+0000 7fae96200640 1 -- 172.21.15.44:0/295812594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fae901619e0 con 0x7fae900b0740 2024-03-30T13:11:55.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.025+0000 7fae87400640 1 -- 172.21.15.44:0/295812594 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fae80031800 con 0x7fae900b0740 2024-03-30T13:11:55.028 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:11:55.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.027+0000 7fae96200640 1 -- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fae7006c530 msgr2=0x7fae7006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.027+0000 7fae96200640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fae7006c530 0x7fae7006e9f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fae901f4dd0 tx=0x7fae7c007c00 comp rx=0 tx=0).stop 2024-03-30T13:11:55.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.027+0000 7fae96200640 1 -- 172.21.15.44:0/295812594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae900b0740 msgr2=0x7fae900cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.027+0000 7fae96200640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae900b0740 0x7fae900cda90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae80009890 tx=0x7fae800046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.027+0000 7fae96200640 1 -- 172.21.15.44:0/295812594 shutdown_connections 2024-03-30T13:11:55.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.027+0000 7fae96200640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fae7006c530 0x7fae7006e9f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.027+0000 7fae96200640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae90158e00 0x7fae9015b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.027+0000 7fae96200640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae90158a20 0x7fae9015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.027+0000 7fae96200640 1 --2- 172.21.15.44:0/295812594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fae900b0740 0x7fae900cda90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.028+0000 7fae96200640 1 -- 172.21.15.44:0/295812594 >> 172.21.15.44:0/295812594 conn(0x7fae900d1160 msgr2=0x7fae9015ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:55.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.028+0000 7fae96200640 1 -- 172.21.15.44:0/295812594 shutdown_connections 2024-03-30T13:11:55.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.028+0000 7fae96200640 1 -- 172.21.15.44:0/295812594 wait complete. 2024-03-30T13:11:55.051 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:55.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.262+0000 7f4eaac00640 1 Processor -- start 2024-03-30T13:11:55.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.262+0000 7f4eaac00640 1 -- start start 2024-03-30T13:11:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.263+0000 7f4eaac00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4ea415e6c0 0x7f4ea40cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.263+0000 7f4eaac00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4ea40d12c0 0x7f4ea40d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.263+0000 7f4eaac00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ea4068070 con 0x7f4ea406ce70 2024-03-30T13:11:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.264+0000 7f4eaac00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea415eaa0 con 0x7f4ea415e6c0 2024-03-30T13:11:55.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.264+0000 7f4eaac00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f4ea406c9c0 con 0x7f4ea40d12c0 2024-03-30T13:11:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.264+0000 7f4ea9800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4ea415e6c0 0x7f4ea40cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.264+0000 7f4ea9800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4ea415e6c0 0x7f4ea40cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39890/0 (socket says 172.21.15.44:39890) 2024-03-30T13:11:55.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.264+0000 7f4ea9800640 1 -- 172.21.15.44:0/3784426801 learned_addr learned my addr 172.21.15.44:0/3784426801 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:55.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.264+0000 7f4ea9800640 1 -- 172.21.15.44:0/3784426801 >> v2:172.21.15.151:3300/0 conn(0x7f4ea40d12c0 msgr2=0x7f4ea40d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:55.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.264+0000 7f4ea8e00640 1 --2- 172.21.15.44:0/3784426801 >> v2:172.21.15.151:3300/0 conn(0x7f4ea40d12c0 0x7f4ea40d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.264+0000 7f4ea9800640 1 --2- 172.21.15.44:0/3784426801 >> v2:172.21.15.151:3300/0 conn(0x7f4ea40d12c0 0x7f4ea40d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.264+0000 7f4ea9800640 1 -- 172.21.15.44:0/3784426801 >> v1:172.21.15.151:6789/0 conn(0x7f4ea406ce70 legacy=0x7f4ea406d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.264+0000 7f4ea9800640 1 -- 172.21.15.44:0/3784426801 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea40cf710 con 0x7f4ea415e6c0 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.264+0000 7f4ea8e00640 1 --2- 172.21.15.44:0/3784426801 >> v2:172.21.15.151:3300/0 conn(0x7f4ea40d12c0 0x7f4ea40d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.265+0000 7f4ea9800640 1 --2- 172.21.15.44:0/3784426801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ea415e6c0 0x7f4ea40cc620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4072000 tx=0x7f4e9402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6187809c882eaee server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.266+0000 7f4ea3e00640 1 -- 172.21.15.44:0/3784426801 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94034070 con 0x7f4ea415e6c0 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.266+0000 7f4ea3e00640 1 -- 172.21.15.44:0/3784426801 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e94030860 con 0x7f4ea415e6c0 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.266+0000 7f4ea3e00640 1 -- 172.21.15.44:0/3784426801 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94030c30 con 0x7f4ea415e6c0 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.266+0000 7f4eaac00640 1 -- 172.21.15.44:0/3784426801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ea415e6c0 msgr2=0x7f4ea40cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.266+0000 7f4eaac00640 1 --2- 172.21.15.44:0/3784426801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ea415e6c0 0x7f4ea40cc620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4072000 tx=0x7f4e9402b9a0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.267+0000 7f4eaac00640 1 -- 172.21.15.44:0/3784426801 shutdown_connections 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.267+0000 7f4eaac00640 1 --2- 172.21.15.44:0/3784426801 >> v2:172.21.15.151:3300/0 conn(0x7f4ea40d12c0 0x7f4ea40d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.267+0000 7f4eaac00640 1 --2- 172.21.15.44:0/3784426801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ea415e6c0 0x7f4ea40cc620 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.267+0000 7f4eaac00640 1 -- 172.21.15.44:0/3784426801 >> 172.21.15.44:0/3784426801 conn(0x7f4ea40cea50 msgr2=0x7f4ea40cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.267+0000 7f4eaac00640 1 -- 172.21.15.44:0/3784426801 shutdown_connections 2024-03-30T13:11:55.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.267+0000 7f4eaac00640 1 -- 172.21.15.44:0/3784426801 wait complete. 2024-03-30T13:11:55.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.269+0000 7f4eaac00640 1 Processor -- start 2024-03-30T13:11:55.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.269+0000 7f4eaac00640 1 -- start start 2024-03-30T13:11:55.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.270+0000 7f4eaac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ea406ce70 0x7f4ea40c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.270+0000 7f4eaac00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ea40d12c0 0x7f4ea415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.270+0000 7f4eaac00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ea415e6c0 0x7f4ea409d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.270+0000 7f4eaac00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea406dbf0 con 0x7f4ea406ce70 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.270+0000 7f4eaac00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea40d2d40 con 0x7f4ea40d12c0 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.270+0000 7f4eaac00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea40b3780 con 0x7f4ea415e6c0 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.270+0000 7f4ea9800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ea406ce70 0x7f4ea40c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.270+0000 7f4ea9800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ea406ce70 0x7f4ea40c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39892/0 (socket says 172.21.15.44:39892) 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.270+0000 7f4ea9800640 1 -- 172.21.15.44:0/2155830142 learned_addr learned my addr 172.21.15.44:0/2155830142 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.270+0000 7f4ea8e00640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ea40d12c0 0x7f4ea415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.270+0000 7f4eaa200640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ea415e6c0 0x7f4ea409d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4ea9800640 1 -- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ea415e6c0 msgr2=0x7f4ea409d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4ea9800640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ea415e6c0 0x7f4ea409d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4ea9800640 1 -- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ea40d12c0 msgr2=0x7f4ea415d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4ea9800640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ea40d12c0 0x7f4ea415d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4ea9800640 1 -- 172.21.15.44:0/2155830142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ea409c3f0 con 0x7f4ea406ce70 2024-03-30T13:11:55.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4ea8e00640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ea40d12c0 0x7f4ea415d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:55.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4eaa200640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ea415e6c0 0x7f4ea409d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:55.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4ea9800640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ea406ce70 0x7f4ea40c7a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e9402b9e0 tx=0x7f4e940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:55.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4ea1600640 1 -- 172.21.15.44:0/2155830142 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e94034040 con 0x7f4ea406ce70 2024-03-30T13:11:55.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4ea1600640 1 -- 172.21.15.44:0/2155830142 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e940433f0 con 0x7f4ea406ce70 2024-03-30T13:11:55.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4ea1600640 1 -- 172.21.15.44:0/2155830142 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e940437e0 con 0x7f4ea406ce70 2024-03-30T13:11:55.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4eaac00640 1 -- 172.21.15.44:0/2155830142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea409c980 con 0x7f4ea406ce70 2024-03-30T13:11:55.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.271+0000 7f4eaac00640 1 -- 172.21.15.44:0/2155830142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea409cf40 con 0x7f4ea406ce70 2024-03-30T13:11:55.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.273+0000 7f4eaac00640 1 -- 172.21.15.44:0/2155830142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea4075890 con 0x7f4ea406ce70 2024-03-30T13:11:55.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.274+0000 7f4ea1600640 1 -- 172.21.15.44:0/2155830142 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4e9404a060 con 0x7f4ea406ce70 2024-03-30T13:11:55.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.275+0000 7f4ea1600640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4e8806c530 0x7f4e8806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.275+0000 7f4ea1600640 1 -- 172.21.15.44:0/2155830142 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4e940adcf0 con 0x7f4ea406ce70 2024-03-30T13:11:55.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.276+0000 7f4ea8e00640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4e8806c530 0x7f4e8806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.277+0000 7f4ea8e00640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4e8806c530 0x7f4e8806e9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40cc6a0 tx=0x7f4e98007490 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:55.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.279+0000 7f4ea1600640 1 -- 172.21.15.44:0/2155830142 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4e940b2070 con 0x7f4ea406ce70 2024-03-30T13:11:55.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.480+0000 7f4eaac00640 1 -- 172.21.15.44:0/2155830142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4ea40c8e10 con 0x7f4ea406ce70 2024-03-30T13:11:55.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.480+0000 7f4ea1600640 1 -- 172.21.15.44:0/2155830142 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f4e9403e070 con 0x7f4ea406ce70 2024-03-30T13:11:55.484 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:11:55.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.483+0000 7f4eaac00640 1 -- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4e8806c530 msgr2=0x7f4e8806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.483+0000 7f4eaac00640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4e8806c530 0x7f4e8806e9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40cc6a0 tx=0x7f4e98007490 comp rx=0 tx=0).stop 2024-03-30T13:11:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.483+0000 7f4eaac00640 1 -- 172.21.15.44:0/2155830142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ea406ce70 msgr2=0x7f4ea40c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.483+0000 7f4eaac00640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ea406ce70 0x7f4ea40c7a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e9402b9e0 tx=0x7f4e940046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.483+0000 7f4eaac00640 1 -- 172.21.15.44:0/2155830142 shutdown_connections 2024-03-30T13:11:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.483+0000 7f4eaac00640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ea415e6c0 0x7f4ea409d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.483+0000 7f4eaac00640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4e8806c530 0x7f4e8806e9f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.483+0000 7f4eaac00640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ea40d12c0 0x7f4ea415d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.483+0000 7f4eaac00640 1 --2- 172.21.15.44:0/2155830142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ea406ce70 0x7f4ea40c7a10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.483+0000 7f4eaac00640 1 -- 172.21.15.44:0/2155830142 >> 172.21.15.44:0/2155830142 conn(0x7f4ea40cea50 msgr2=0x7f4ea406f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.483+0000 7f4eaac00640 1 -- 172.21.15.44:0/2155830142 shutdown_connections 2024-03-30T13:11:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.483+0000 7f4eaac00640 1 -- 172.21.15.44:0/2155830142 wait complete. 2024-03-30T13:11:55.503 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:11:55.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.708+0000 7f22e1200640 1 Processor -- start 2024-03-30T13:11:55.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.708+0000 7f22e1200640 1 -- start start 2024-03-30T13:11:55.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.709+0000 7f22e1200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22dc0b4920 0x7f22dc0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.709+0000 7f22e1200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f22dc0b4d00 0x7f22dc0d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.709+0000 7f22e1200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22dc0b54b0 con 0x7f22dc0d0b90 2024-03-30T13:11:55.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.709+0000 7f22e1200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f22dc0d0260 con 0x7f22dc0b4d00 2024-03-30T13:11:55.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.709+0000 7f22e1200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f22dc0cfca0 con 0x7f22dc0b4920 2024-03-30T13:11:55.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.710+0000 7f22dbe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f22dc0d0b90 0x7f22dc0d26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32806/0 (socket says 172.21.15.44:32806) 2024-03-30T13:11:55.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.710+0000 7f22dbe00640 1 -- 172.21.15.44:0/3824394988 learned_addr learned my addr 172.21.15.44:0/3824394988 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:55.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.710+0000 7f22d2a00640 1 --2- 172.21.15.44:0/3824394988 >> v2:172.21.15.44:3300/0 conn(0x7f22dc0b4d00 0x7f22dc0d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.710+0000 7f22db400640 1 --2- 172.21.15.44:0/3824394988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22dc0b4920 0x7f22dc0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.710+0000 7f22daa00640 1 -- 172.21.15.44:0/3824394988 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1688930428 0 0) 0x7f22d4001490 con 0x7f22dc0d0b90 2024-03-30T13:11:55.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.710+0000 7f22d2a00640 1 -- 172.21.15.44:0/3824394988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22dc0b4920 msgr2=0x7f22dc0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:55.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.710+0000 7f22d2a00640 1 --2- 172.21.15.44:0/3824394988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22dc0b4920 0x7f22dc0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.710+0000 7f22d2a00640 1 -- 172.21.15.44:0/3824394988 >> v1:172.21.15.44:6789/0 conn(0x7f22dc0d0b90 legacy=0x7f22dc0d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.710+0000 7f22d2a00640 1 -- 172.21.15.44:0/3824394988 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc0cff80 con 0x7f22dc0b4d00 2024-03-30T13:11:55.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.711+0000 7f22d2a00640 1 --2- 172.21.15.44:0/3824394988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22dc0b4d00 0x7f22dc0d4ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f22c40097a0 tx=0x7f22c402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c29ec375835cd1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:55.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.712+0000 7f22daa00640 1 -- 172.21.15.44:0/3824394988 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c40315a0 con 0x7f22dc0b4d00 2024-03-30T13:11:55.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.712+0000 7f22daa00640 1 -- 172.21.15.44:0/3824394988 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c4037070 con 0x7f22dc0b4d00 2024-03-30T13:11:55.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.712+0000 7f22daa00640 1 -- 172.21.15.44:0/3824394988 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4031960 con 0x7f22dc0b4d00 2024-03-30T13:11:55.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.712+0000 7f22e1200640 1 -- 172.21.15.44:0/3824394988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22dc0b4d00 msgr2=0x7f22dc0d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.712+0000 7f22e1200640 1 --2- 172.21.15.44:0/3824394988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22dc0b4d00 0x7f22dc0d4ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f22c40097a0 tx=0x7f22c402b840 comp rx=0 tx=0).stop 2024-03-30T13:11:55.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.712+0000 7f22e1200640 1 -- 172.21.15.44:0/3824394988 shutdown_connections 2024-03-30T13:11:55.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.712+0000 7f22e1200640 1 --2- 172.21.15.44:0/3824394988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22dc0b4d00 0x7f22dc0d4ac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.712+0000 7f22e1200640 1 --2- 172.21.15.44:0/3824394988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22dc0b4920 0x7f22dc0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.712+0000 7f22e1200640 1 -- 172.21.15.44:0/3824394988 >> 172.21.15.44:0/3824394988 conn(0x7f22dc09d4e0 msgr2=0x7f22dc0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:55.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.713+0000 7f22e1200640 1 -- 172.21.15.44:0/3824394988 shutdown_connections 2024-03-30T13:11:55.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.713+0000 7f22e1200640 1 -- 172.21.15.44:0/3824394988 wait complete. 2024-03-30T13:11:55.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.714+0000 7f22e1200640 1 Processor -- start 2024-03-30T13:11:55.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.715+0000 7f22e1200640 1 -- start start 2024-03-30T13:11:55.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.715+0000 7f22e1200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22dc0b4920 0x7f22dc1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.715+0000 7f22e1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22dc0b4d00 0x7f22dc0b9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22e1200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22dc0d0b90 0x7f22dc0b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22e1200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc0b3ff0 con 0x7f22dc0b4d00 2024-03-30T13:11:55.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22e1200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc0d2180 con 0x7f22dc0b4920 2024-03-30T13:11:55.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22e1200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f22dc0d5000 con 0x7f22dc0d0b90 2024-03-30T13:11:55.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22d2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22dc0b4d00 0x7f22dc0b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22d2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22dc0b4d00 0x7f22dc0b9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39908/0 (socket says 172.21.15.44:39908) 2024-03-30T13:11:55.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22d2a00640 1 -- 172.21.15.44:0/3584722402 learned_addr learned my addr 172.21.15.44:0/3584722402 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:55.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22db400640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22dc0b4920 0x7f22dc1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22dbe00640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22dc0d0b90 0x7f22dc0b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22d2a00640 1 -- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22dc0d0b90 msgr2=0x7f22dc0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22d2a00640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22dc0d0b90 0x7f22dc0b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22d2a00640 1 -- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22dc0b4920 msgr2=0x7f22dc1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22d2a00640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22dc0b4920 0x7f22dc1592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.716+0000 7f22d2a00640 1 -- 172.21.15.44:0/3584722402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc1e92f0 con 0x7f22dc0b4d00 2024-03-30T13:11:55.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.717+0000 7f22d2a00640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22dc0b4d00 0x7f22dc0b9710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f22c40098c0 tx=0x7f22c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:55.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.717+0000 7f22d3e00640 1 -- 172.21.15.44:0/3584722402 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4032840 con 0x7f22dc0b4d00 2024-03-30T13:11:55.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.717+0000 7f22d3e00640 1 -- 172.21.15.44:0/3584722402 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c4032a00 con 0x7f22dc0b4d00 2024-03-30T13:11:55.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.717+0000 7f22d3e00640 1 -- 172.21.15.44:0/3584722402 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4032df0 con 0x7f22dc0b4d00 2024-03-30T13:11:55.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.717+0000 7f22e1200640 1 -- 172.21.15.44:0/3584722402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22dc1e95d0 con 0x7f22dc0b4d00 2024-03-30T13:11:55.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.717+0000 7f22e1200640 1 -- 172.21.15.44:0/3584722402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22dc0b9c50 con 0x7f22dc0b4d00 2024-03-30T13:11:55.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.719+0000 7f22e1200640 1 -- 172.21.15.44:0/3584722402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22dc075890 con 0x7f22dc0b4d00 2024-03-30T13:11:55.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.721+0000 7f22d3e00640 1 -- 172.21.15.44:0/3584722402 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f22c403b3f0 con 0x7f22dc0b4d00 2024-03-30T13:11:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.721+0000 7f22d3e00640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f22b806c530 0x7f22b806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.722+0000 7f22d3e00640 1 -- 172.21.15.44:0/3584722402 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f22c402f030 con 0x7f22dc0b4d00 2024-03-30T13:11:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.722+0000 7f22db400640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f22b806c530 0x7f22b806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:55.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.723+0000 7f22db400640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f22b806c530 0x7f22b806e9f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f22cc006fd0 tx=0x7f22cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:55.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.726+0000 7f22d3e00640 1 -- 172.21.15.44:0/3584722402 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f22c4040070 con 0x7f22dc0b4d00 2024-03-30T13:11:55.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.930+0000 7f22e1200640 1 -- 172.21.15.44:0/3584722402 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f22dc15fd80 con 0x7f22dc0b4d00 2024-03-30T13:11:55.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.932+0000 7f22d3e00640 1 -- 172.21.15.44:0/3584722402 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f22c407be60 con 0x7f22dc0b4d00 2024-03-30T13:11:55.935 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:11:55.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.934+0000 7f22e1200640 1 -- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f22b806c530 msgr2=0x7f22b806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.934+0000 7f22e1200640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f22b806c530 0x7f22b806e9f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f22cc006fd0 tx=0x7f22cc008040 comp rx=0 tx=0).stop 2024-03-30T13:11:55.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.934+0000 7f22e1200640 1 -- 172.21.15.44:0/3584722402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22dc0b4d00 msgr2=0x7f22dc0b9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:55.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.934+0000 7f22e1200640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22dc0b4d00 0x7f22dc0b9710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f22c40098c0 tx=0x7f22c40046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.934+0000 7f22e1200640 1 -- 172.21.15.44:0/3584722402 shutdown_connections 2024-03-30T13:11:55.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.934+0000 7f22e1200640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22dc0d0b90 0x7f22dc0b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.934+0000 7f22e1200640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22dc0b4d00 0x7f22dc0b9710 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.934+0000 7f22e1200640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f22b806c530 0x7f22b806e9f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.934+0000 7f22e1200640 1 --2- 172.21.15.44:0/3584722402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22dc0b4920 0x7f22dc1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:55.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.934+0000 7f22e1200640 1 -- 172.21.15.44:0/3584722402 >> 172.21.15.44:0/3584722402 conn(0x7f22dc09d4e0 msgr2=0x7f22dc074ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:55.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.934+0000 7f22e1200640 1 -- 172.21.15.44:0/3584722402 shutdown_connections 2024-03-30T13:11:55.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:55.935+0000 7f22e1200640 1 -- 172.21.15.44:0/3584722402 wait complete. 2024-03-30T13:11:55.956 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:11:56.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.176+0000 7f9514e00640 1 Processor -- start 2024-03-30T13:11:56.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.176+0000 7f9514e00640 1 -- start start 2024-03-30T13:11:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.177+0000 7f9514e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f951015e950 0x7f95100d4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.177+0000 7f9514e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95100d36f0 con 0x7f95100d30d0 2024-03-30T13:11:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.177+0000 7f9514e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95100d39d0 con 0x7f95100d48c0 2024-03-30T13:11:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.177+0000 7f9514e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f95100d3cb0 con 0x7f951015e950 2024-03-30T13:11:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.178+0000 7f950e800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f95100d30d0 0x7f95100b82c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32820/0 (socket says 172.21.15.44:32820) 2024-03-30T13:11:56.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.178+0000 7f950e800640 1 -- 172.21.15.44:0/2085594720 learned_addr learned my addr 172.21.15.44:0/2085594720 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:56.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.178+0000 7f950de00640 1 --2- 172.21.15.44:0/2085594720 >> v2:172.21.15.151:3300/0 conn(0x7f951015e950 0x7f95100d4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.178+0000 7f950ca00640 1 -- 172.21.15.44:0/2085594720 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264511906 0 0) 0x7f95100d36f0 con 0x7f95100d30d0 2024-03-30T13:11:56.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.178+0000 7f950ca00640 1 -- 172.21.15.44:0/2085594720 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94f4003520 con 0x7f95100d30d0 2024-03-30T13:11:56.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.179+0000 7f950ca00640 1 -- 172.21.15.44:0/2085594720 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 558698789 0 0) 0x7f94f4003520 con 0x7f95100d30d0 2024-03-30T13:11:56.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.179+0000 7f950de00640 1 -- 172.21.15.44:0/2085594720 >> v1:172.21.15.151:6789/0 conn(0x7f95100d48c0 legacy=0x7f95100d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.179+0000 7f950de00640 1 -- 172.21.15.44:0/2085594720 >> v1:172.21.15.44:6789/0 conn(0x7f95100d30d0 legacy=0x7f95100b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.179+0000 7f950de00640 1 -- 172.21.15.44:0/2085594720 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95100b7ac0 con 0x7f951015e950 2024-03-30T13:11:56.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.180+0000 7f950de00640 1 --2- 172.21.15.44:0/2085594720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f951015e950 0x7f95100d4380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f95000097a0 tx=0x7f950002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adc465793ab4ff68 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:56.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.180+0000 7f950ca00640 1 -- 172.21.15.44:0/2085594720 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95080019f0 con 0x7f951015e950 2024-03-30T13:11:56.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.181+0000 7f950ca00640 1 -- 172.21.15.44:0/2085594720 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9500037070 con 0x7f951015e950 2024-03-30T13:11:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.181+0000 7f950ca00640 1 -- 172.21.15.44:0/2085594720 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9500031790 con 0x7f951015e950 2024-03-30T13:11:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.181+0000 7f9514e00640 1 -- 172.21.15.44:0/2085594720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f951015e950 msgr2=0x7f95100d4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.181+0000 7f9514e00640 1 --2- 172.21.15.44:0/2085594720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f951015e950 0x7f95100d4380 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f95000097a0 tx=0x7f950002b8b0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.181+0000 7f9514e00640 1 -- 172.21.15.44:0/2085594720 shutdown_connections 2024-03-30T13:11:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.181+0000 7f9514e00640 1 --2- 172.21.15.44:0/2085594720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f951015e950 0x7f95100d4380 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.181+0000 7f9514e00640 1 -- 172.21.15.44:0/2085594720 >> 172.21.15.44:0/2085594720 conn(0x7f95100676e0 msgr2=0x7f9510067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.181+0000 7f9514e00640 1 -- 172.21.15.44:0/2085594720 shutdown_connections 2024-03-30T13:11:56.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.181+0000 7f9514e00640 1 -- 172.21.15.44:0/2085594720 wait complete. 2024-03-30T13:11:56.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.183+0000 7f9514e00640 1 Processor -- start 2024-03-30T13:11:56.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.183+0000 7f9514e00640 1 -- start start 2024-03-30T13:11:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.184+0000 7f9514e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100d30d0 0x7f95101f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.184+0000 7f9514e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95100d48c0 0x7f95101f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.184+0000 7f9514e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f951015e950 0x7f95100cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.184+0000 7f9514e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f951015ed30 con 0x7f95100d48c0 2024-03-30T13:11:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.184+0000 7f9514e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f95100d4d00 con 0x7f951015e950 2024-03-30T13:11:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.184+0000 7f9514e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f951015eeb0 con 0x7f95100d30d0 2024-03-30T13:11:56.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.184+0000 7f950d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95100d48c0 0x7f95101f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.185+0000 7f950d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95100d48c0 0x7f95101f4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39910/0 (socket says 172.21.15.44:39910) 2024-03-30T13:11:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.185+0000 7f950d400640 1 -- 172.21.15.44:0/2232911142 learned_addr learned my addr 172.21.15.44:0/2232911142 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.185+0000 7f950de00640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100d30d0 0x7f95101f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.185+0000 7f950e800640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f951015e950 0x7f95100cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.185+0000 7f950d400640 1 -- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100d30d0 msgr2=0x7f95101f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.185+0000 7f950d400640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100d30d0 0x7f95101f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.185+0000 7f950d400640 1 -- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f951015e950 msgr2=0x7f95100cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.185+0000 7f950d400640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f951015e950 0x7f95100cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.185+0000 7f950d400640 1 -- 172.21.15.44:0/2232911142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95101f8510 con 0x7f95100d48c0 2024-03-30T13:11:56.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.186+0000 7f950d400640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95100d48c0 0x7f95101f4fe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94f800c450 tx=0x7f94f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:56.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.186+0000 7f9506000640 1 -- 172.21.15.44:0/2232911142 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f80052d0 con 0x7f95100d48c0 2024-03-30T13:11:56.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.186+0000 7f9506000640 1 -- 172.21.15.44:0/2232911142 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f8005470 con 0x7f95100d48c0 2024-03-30T13:11:56.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.186+0000 7f9514e00640 1 -- 172.21.15.44:0/2232911142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95101f87f0 con 0x7f95100d48c0 2024-03-30T13:11:56.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.186+0000 7f9506000640 1 -- 172.21.15.44:0/2232911142 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8012870 con 0x7f95100d48c0 2024-03-30T13:11:56.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.186+0000 7f9514e00640 1 -- 172.21.15.44:0/2232911142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95101f4ac0 con 0x7f95100d48c0 2024-03-30T13:11:56.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.187+0000 7f9514e00640 1 -- 172.21.15.44:0/2232911142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95101f89c0 con 0x7f95100d48c0 2024-03-30T13:11:56.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.189+0000 7f9506000640 1 -- 172.21.15.44:0/2232911142 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f94f8012a10 con 0x7f95100d48c0 2024-03-30T13:11:56.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.190+0000 7f9506000640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f94ec06c530 0x7f94ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.190+0000 7f9506000640 1 -- 172.21.15.44:0/2232911142 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f94f808b770 con 0x7f95100d48c0 2024-03-30T13:11:56.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.191+0000 7f950de00640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f94ec06c530 0x7f94ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.192+0000 7f950de00640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f94ec06c530 0x7f94ec06e9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9500036000 tx=0x7f9500008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:56.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.195+0000 7f9506000640 1 -- 172.21.15.44:0/2232911142 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f94f8059930 con 0x7f95100d48c0 2024-03-30T13:11:56.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.412+0000 7f9514e00640 1 -- 172.21.15.44:0/2232911142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9510075a10 con 0x7f95100d48c0 2024-03-30T13:11:56.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.413+0000 7f9506000640 1 -- 172.21.15.44:0/2232911142 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f94f8059230 con 0x7f95100d48c0 2024-03-30T13:11:56.417 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-03-30T13:11:56.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.416+0000 7f9514e00640 1 -- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f94ec06c530 msgr2=0x7f94ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.416+0000 7f9514e00640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f94ec06c530 0x7f94ec06e9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9500036000 tx=0x7f9500008030 comp rx=0 tx=0).stop 2024-03-30T13:11:56.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.416+0000 7f9514e00640 1 -- 172.21.15.44:0/2232911142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95100d48c0 msgr2=0x7f95101f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.416+0000 7f9514e00640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95100d48c0 0x7f95101f4fe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94f800c450 tx=0x7f94f800c910 comp rx=0 tx=0).stop 2024-03-30T13:11:56.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.416+0000 7f9514e00640 1 -- 172.21.15.44:0/2232911142 shutdown_connections 2024-03-30T13:11:56.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.416+0000 7f9514e00640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f94ec06c530 0x7f94ec06e9f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.416+0000 7f9514e00640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f951015e950 0x7f95100cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.416+0000 7f9514e00640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f95100d48c0 0x7f95101f4fe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.416+0000 7f9514e00640 1 --2- 172.21.15.44:0/2232911142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100d30d0 0x7f95101f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.416+0000 7f9514e00640 1 -- 172.21.15.44:0/2232911142 >> 172.21.15.44:0/2232911142 conn(0x7f95100676e0 msgr2=0x7f95100b82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:56.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.416+0000 7f9514e00640 1 -- 172.21.15.44:0/2232911142 shutdown_connections 2024-03-30T13:11:56.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.416+0000 7f9514e00640 1 -- 172.21.15.44:0/2232911142 wait complete. 2024-03-30T13:11:56.442 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:11:56.442 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:11:56.495 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:11:56.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.714+0000 7f76fb400640 1 Processor -- start 2024-03-30T13:11:56.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.714+0000 7f76fb400640 1 -- start start 2024-03-30T13:11:56.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.716+0000 7f76fb400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f4071c30 0x7f76f4160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.716+0000 7f76fb400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f4146040 con 0x7f76f4160660 2024-03-30T13:11:56.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.716+0000 7f76fb400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f4160e50 con 0x7f76f4145c60 2024-03-30T13:11:56.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.716+0000 7f76fb400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f76f415d8b0 con 0x7f76f4071c30 2024-03-30T13:11:56.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.716+0000 7f76f9400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f76f4160660 0x7f76f40ca830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:32822/0 (socket says 172.21.15.44:32822) 2024-03-30T13:11:56.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.716+0000 7f76f9400640 1 -- 172.21.15.44:0/219083671 learned_addr learned my addr 172.21.15.44:0/219083671 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:56.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3e00640 1 --2- 172.21.15.44:0/219083671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f4071c30 0x7f76f4160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 358925112 0 0) 0x7f76f4146040 con 0x7f76f4160660 2024-03-30T13:11:56.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76dc003520 con 0x7f76f4160660 2024-03-30T13:11:56.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058256883 0 0) 0x7f76f4160e50 con 0x7f76f4145c60 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76f4146040 con 0x7f76f4145c60 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 707545031 0 0) 0x7f76dc003520 con 0x7f76f4160660 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f4071c30 msgr2=0x7f76f4160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3400640 1 --2- 172.21.15.44:0/219083671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f4071c30 0x7f76f4160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 >> v1:172.21.15.151:6789/0 conn(0x7f76f4145c60 legacy=0x7f76f4071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f415caf0 con 0x7f76f4160660 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f76ec0019f0 con 0x7f76f4160660 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 >> v1:172.21.15.44:6789/0 conn(0x7f76f4160660 legacy=0x7f76f40ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.717+0000 7f76f3400640 1 --2- 172.21.15.44:0/219083671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76dc003b70 0x7f76dc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f3400640 1 --2- 172.21.15.44:0/219083671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76dc004800 0x7f76dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f3400640 1 --2- 172.21.15.44:0/219083671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f4071c30 0x7f76dc0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76f415d8b0 con 0x7f76dc003b70 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc00bb00 con 0x7f76dc004800 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f76dc00bd00 con 0x7f76f4071c30 2024-03-30T13:11:56.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f8a00640 1 --2- 172.21.15.44:0/219083671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76dc003b70 0x7f76dc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f3e00640 1 --2- 172.21.15.44:0/219083671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76dc004800 0x7f76dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f9400640 1 --2- 172.21.15.44:0/219083671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f4071c30 0x7f76dc0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f8a00640 1 -- 172.21.15.44:0/219083671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f4071c30 msgr2=0x7f76dc0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:56.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f8a00640 1 --2- 172.21.15.44:0/219083671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f4071c30 0x7f76dc0051e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f8a00640 1 -- 172.21.15.44:0/219083671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76dc004800 msgr2=0x7f76dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:56.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f8a00640 1 --2- 172.21.15.44:0/219083671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76dc004800 0x7f76dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.718+0000 7f76f8a00640 1 -- 172.21.15.44:0/219083671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc003520 con 0x7f76dc003b70 2024-03-30T13:11:56.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.720+0000 7f76f8a00640 1 --2- 172.21.15.44:0/219083671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76dc003b70 0x7f76dc003f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76e80018d0 tx=0x7f76dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33af876f430bed0c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:56.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.720+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8037070 con 0x7f76dc003b70 2024-03-30T13:11:56.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.720+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e80052d0 con 0x7f76dc003b70 2024-03-30T13:11:56.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.720+0000 7f76f3400640 1 -- 172.21.15.44:0/219083671 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e80014f0 con 0x7f76dc003b70 2024-03-30T13:11:56.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.720+0000 7f76fb400640 1 -- 172.21.15.44:0/219083671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76dc003b70 msgr2=0x7f76dc003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.720+0000 7f76fb400640 1 --2- 172.21.15.44:0/219083671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76dc003b70 0x7f76dc003f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76e80018d0 tx=0x7f76dc005830 comp rx=0 tx=0).stop 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.720+0000 7f76f9400640 1 -- 172.21.15.44:0/219083671 reap_dead start 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.721+0000 7f76fb400640 1 -- 172.21.15.44:0/219083671 shutdown_connections 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.721+0000 7f76fb400640 1 -- 172.21.15.44:0/219083671 >> 172.21.15.44:0/219083671 conn(0x7f76f40b1c90 msgr2=0x7f76f40b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.721+0000 7f76fb400640 1 -- 172.21.15.44:0/219083671 shutdown_connections 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.721+0000 7f76fb400640 1 -- 172.21.15.44:0/219083671 wait complete. 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.722+0000 7f76fb400640 1 Processor -- start 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.723+0000 7f76fb400640 1 -- start start 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76fb400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76dc003b70 0x7f76f40c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76fb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76f40c6920 0x7f76f4138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76fb400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f40b4d60 0x7f76f40b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76fb400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4160b10 con 0x7f76f40c6920 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76fb400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f76f415d0b0 con 0x7f76dc003b70 2024-03-30T13:11:56.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76fb400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f76f4160120 con 0x7f76f40b4d60 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76f3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76f40c6920 0x7f76f4138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76f3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76f40c6920 0x7f76f4138bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39930/0 (socket says 172.21.15.44:39930) 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76f3e00640 1 -- 172.21.15.44:0/3225449829 learned_addr learned my addr 172.21.15.44:0/3225449829 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76f8a00640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76dc003b70 0x7f76f40c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76f9400640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f40b4d60 0x7f76f40b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76f3e00640 1 -- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f40b4d60 msgr2=0x7f76f40b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76f3e00640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f40b4d60 0x7f76f40b51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76f3e00640 1 -- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76dc003b70 msgr2=0x7f76f40c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76f3e00640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76dc003b70 0x7f76f40c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.724+0000 7f76f3e00640 1 -- 172.21.15.44:0/3225449829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f40c70c0 con 0x7f76f40c6920 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.725+0000 7f76f3e00640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76f40c6920 0x7f76f4138bc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f76e0011600 tx=0x7f76e0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.725+0000 7f76f0c00640 1 -- 172.21.15.44:0/3225449829 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e000f920 con 0x7f76f40c6920 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.725+0000 7f76f0c00640 1 -- 172.21.15.44:0/3225449829 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76e000fac0 con 0x7f76f40c6920 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.725+0000 7f76f0c00640 1 -- 172.21.15.44:0/3225449829 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e000fe70 con 0x7f76f40c6920 2024-03-30T13:11:56.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.725+0000 7f76fb400640 1 -- 172.21.15.44:0/3225449829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f40c73a0 con 0x7f76f40c6920 2024-03-30T13:11:56.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.725+0000 7f76fb400640 1 -- 172.21.15.44:0/3225449829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f40c7960 con 0x7f76f40c6920 2024-03-30T13:11:56.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.726+0000 7f76fb400640 1 -- 172.21.15.44:0/3225449829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f4075a10 con 0x7f76f40c6920 2024-03-30T13:11:56.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.727+0000 7f76f0c00640 1 -- 172.21.15.44:0/3225449829 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f76e0015460 con 0x7f76f40c6920 2024-03-30T13:11:56.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.728+0000 7f76f0c00640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f76d406c560 0x7f76d406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:56.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.729+0000 7f76f0c00640 1 -- 172.21.15.44:0/3225449829 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f76e008c490 con 0x7f76f40c6920 2024-03-30T13:11:56.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.729+0000 7f76f8a00640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f76d406c560 0x7f76d406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:56.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.730+0000 7f76f8a00640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f76d406c560 0x7f76d406ea20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f76e8034000 tx=0x7f76e8031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:56.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.733+0000 7f76f0c00640 1 -- 172.21.15.44:0/3225449829 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f76e0019030 con 0x7f76f40c6920 2024-03-30T13:11:56.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.945+0000 7f76fb400640 1 -- 172.21.15.44:0/3225449829 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76f4160e50 con 0x7f76f40c6920 2024-03-30T13:11:56.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.948+0000 7f76f0c00640 1 -- 172.21.15.44:0/3225449829 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7f76e005a6d0 con 0x7f76f40c6920 2024-03-30T13:11:56.952 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:11:56.952 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:11:56.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.951+0000 7f76fb400640 1 -- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f76d406c560 msgr2=0x7f76d406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.951+0000 7f76fb400640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f76d406c560 0x7f76d406ea20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f76e8034000 tx=0x7f76e8031000 comp rx=0 tx=0).stop 2024-03-30T13:11:56.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.951+0000 7f76fb400640 1 -- 172.21.15.44:0/3225449829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76f40c6920 msgr2=0x7f76f4138bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:56.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.951+0000 7f76fb400640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76f40c6920 0x7f76f4138bc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f76e0011600 tx=0x7f76e0011ac0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.951+0000 7f76fb400640 1 -- 172.21.15.44:0/3225449829 shutdown_connections 2024-03-30T13:11:56.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.951+0000 7f76fb400640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76f40b4d60 0x7f76f40b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.951+0000 7f76fb400640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76f40c6920 0x7f76f4138bc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.951+0000 7f76fb400640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f76d406c560 0x7f76d406ea20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.951+0000 7f76fb400640 1 --2- 172.21.15.44:0/3225449829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76dc003b70 0x7f76f40c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:56.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.951+0000 7f76fb400640 1 -- 172.21.15.44:0/3225449829 >> 172.21.15.44:0/3225449829 conn(0x7f76f40b1c90 msgr2=0x7f76f40b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:56.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.952+0000 7f76fb400640 1 -- 172.21.15.44:0/3225449829 shutdown_connections 2024-03-30T13:11:56.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:56.952+0000 7f76fb400640 1 -- 172.21.15.44:0/3225449829 wait complete. 2024-03-30T13:11:56.975 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:11:56.976 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:11:57.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.203+0000 7ff26b800640 1 Processor -- start 2024-03-30T13:11:57.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.203+0000 7ff26b800640 1 -- start start 2024-03-30T13:11:57.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.205+0000 7ff26b800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff26406d8f0 0x7ff26415fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.205+0000 7ff26b800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff2641603d0 0x7ff2640cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.205+0000 7ff26b800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2640ce9c0 con 0x7ff26413f0c0 2024-03-30T13:11:57.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.205+0000 7ff26b800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff264160e30 con 0x7ff2641603d0 2024-03-30T13:11:57.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.205+0000 7ff26b800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7ff264160b50 con 0x7ff26406d8f0 2024-03-30T13:11:57.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.206+0000 7ff269800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff2641603d0 0x7ff2640cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.206+0000 7ff269800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff2641603d0 0x7ff2640cfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49998/0 (socket says 172.21.15.44:49998) 2024-03-30T13:11:57.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.206+0000 7ff269800640 1 -- 172.21.15.44:0/2753191280 learned_addr learned my addr 172.21.15.44:0/2753191280 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:57.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.206+0000 7ff263e00640 1 --2- 172.21.15.44:0/2753191280 >> v2:172.21.15.151:3300/0 conn(0x7ff26406d8f0 0x7ff26415fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.206+0000 7ff269800640 1 -- 172.21.15.44:0/2753191280 >> v2:172.21.15.151:3300/0 conn(0x7ff26406d8f0 msgr2=0x7ff26415fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:57.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.206+0000 7ff269800640 1 --2- 172.21.15.44:0/2753191280 >> v2:172.21.15.151:3300/0 conn(0x7ff26406d8f0 0x7ff26415fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.206+0000 7ff269800640 1 -- 172.21.15.44:0/2753191280 >> v1:172.21.15.151:6789/0 conn(0x7ff26413f0c0 legacy=0x7ff26406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.206+0000 7ff269800640 1 -- 172.21.15.44:0/2753191280 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff26413fa40 con 0x7ff2641603d0 2024-03-30T13:11:57.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.207+0000 7ff269800640 1 --2- 172.21.15.44:0/2753191280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2641603d0 0x7ff2640cfbb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff26406e3a0 tx=0x7ff25c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a39aaae7704fb45 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:57.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.208+0000 7ff263400640 1 -- 172.21.15.44:0/2753191280 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c02c9f0 con 0x7ff2641603d0 2024-03-30T13:11:57.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.208+0000 7ff263400640 1 -- 172.21.15.44:0/2753191280 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25c02cb90 con 0x7ff2641603d0 2024-03-30T13:11:57.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.208+0000 7ff263400640 1 -- 172.21.15.44:0/2753191280 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0343f0 con 0x7ff2641603d0 2024-03-30T13:11:57.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.208+0000 7ff26b800640 1 -- 172.21.15.44:0/2753191280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2641603d0 msgr2=0x7ff2640cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.208+0000 7ff26b800640 1 --2- 172.21.15.44:0/2753191280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2641603d0 0x7ff2640cfbb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff26406e3a0 tx=0x7ff25c02be50 comp rx=0 tx=0).stop 2024-03-30T13:11:57.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.209+0000 7ff26b800640 1 -- 172.21.15.44:0/2753191280 shutdown_connections 2024-03-30T13:11:57.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.209+0000 7ff26b800640 1 --2- 172.21.15.44:0/2753191280 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2641603d0 0x7ff2640cfbb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.209+0000 7ff26b800640 1 --2- 172.21.15.44:0/2753191280 >> v2:172.21.15.151:3300/0 conn(0x7ff26406d8f0 0x7ff26415fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.209+0000 7ff26b800640 1 -- 172.21.15.44:0/2753191280 >> 172.21.15.44:0/2753191280 conn(0x7ff2640b5b00 msgr2=0x7ff26406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.209+0000 7ff26b800640 1 -- 172.21.15.44:0/2753191280 shutdown_connections 2024-03-30T13:11:57.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.209+0000 7ff26b800640 1 -- 172.21.15.44:0/2753191280 wait complete. 2024-03-30T13:11:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.211+0000 7ff26b800640 1 Processor -- start 2024-03-30T13:11:57.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.212+0000 7ff26b800640 1 -- start start 2024-03-30T13:11:57.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.213+0000 7ff26b800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26406d8f0 0x7ff264072db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.213+0000 7ff26b800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff26413f0c0 0x7ff2641440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.213+0000 7ff26b800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2641603d0 0x7ff264144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.213+0000 7ff26b800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff264160840 con 0x7ff26406d8f0 2024-03-30T13:11:57.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.213+0000 7ff26b800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff264140000 con 0x7ff26413f0c0 2024-03-30T13:11:57.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.213+0000 7ff26b800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff26413f4a0 con 0x7ff2641603d0 2024-03-30T13:11:57.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.213+0000 7ff268e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26406d8f0 0x7ff264072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.213+0000 7ff268e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26406d8f0 0x7ff264072db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50010/0 (socket says 172.21.15.44:50010) 2024-03-30T13:11:57.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.213+0000 7ff268e00640 1 -- 172.21.15.44:0/3840985540 learned_addr learned my addr 172.21.15.44:0/3840985540 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:57.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.214+0000 7ff263e00640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff26413f0c0 0x7ff2641440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.214+0000 7ff269800640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2641603d0 0x7ff264144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.214+0000 7ff268e00640 1 -- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2641603d0 msgr2=0x7ff264144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.214+0000 7ff268e00640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2641603d0 0x7ff264144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.214+0000 7ff268e00640 1 -- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff26413f0c0 msgr2=0x7ff2641440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.214+0000 7ff268e00640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff26413f0c0 0x7ff2641440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.214+0000 7ff268e00640 1 -- 172.21.15.44:0/3840985540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2641320f0 con 0x7ff26406d8f0 2024-03-30T13:11:57.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.214+0000 7ff268e00640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26406d8f0 0x7ff264072db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c3c0 tx=0x7ff25800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:57.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.214+0000 7ff260c00640 1 -- 172.21.15.44:0/3840985540 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2580052d0 con 0x7ff26406d8f0 2024-03-30T13:11:57.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.215+0000 7ff260c00640 1 -- 172.21.15.44:0/3840985540 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff258005490 con 0x7ff26406d8f0 2024-03-30T13:11:57.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.215+0000 7ff260c00640 1 -- 172.21.15.44:0/3840985540 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258007260 con 0x7ff26406d8f0 2024-03-30T13:11:57.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.215+0000 7ff26b800640 1 -- 172.21.15.44:0/3840985540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff264071670 con 0x7ff26406d8f0 2024-03-30T13:11:57.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.215+0000 7ff26b800640 1 -- 172.21.15.44:0/3840985540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff264071c30 con 0x7ff26406d8f0 2024-03-30T13:11:57.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.216+0000 7ff26b800640 1 -- 172.21.15.44:0/3840985540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff264075890 con 0x7ff26406d8f0 2024-03-30T13:11:57.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.217+0000 7ff260c00640 1 -- 172.21.15.44:0/3840985540 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff258007400 con 0x7ff26406d8f0 2024-03-30T13:11:57.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.218+0000 7ff260c00640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff24406c530 0x7ff24406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.218+0000 7ff260c00640 1 -- 172.21.15.44:0/3840985540 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff25808afc0 con 0x7ff26406d8f0 2024-03-30T13:11:57.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.219+0000 7ff263e00640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff24406c530 0x7ff24406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.220+0000 7ff263e00640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff24406c530 0x7ff24406e9f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff2640cee70 tx=0x7ff250008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:57.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.223+0000 7ff260c00640 1 -- 172.21.15.44:0/3840985540 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff2640ce9c0 con 0x7ff26406d8f0 2024-03-30T13:11:57.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.432+0000 7ff26b800640 1 -- 172.21.15.44:0/3840985540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff26406c2c0 con 0x7ff26406d8f0 2024-03-30T13:11:57.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.433+0000 7ff260c00640 1 -- 172.21.15.44:0/3840985540 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7ff258059200 con 0x7ff26406d8f0 2024-03-30T13:11:57.437 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:11:57.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.435+0000 7ff26b800640 1 -- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff24406c530 msgr2=0x7ff24406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.435+0000 7ff26b800640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff24406c530 0x7ff24406e9f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff2640cee70 tx=0x7ff250008040 comp rx=0 tx=0).stop 2024-03-30T13:11:57.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.435+0000 7ff26b800640 1 -- 172.21.15.44:0/3840985540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26406d8f0 msgr2=0x7ff264072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.435+0000 7ff26b800640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26406d8f0 0x7ff264072db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c3c0 tx=0x7ff25800c880 comp rx=0 tx=0).stop 2024-03-30T13:11:57.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.436+0000 7ff26b800640 1 -- 172.21.15.44:0/3840985540 shutdown_connections 2024-03-30T13:11:57.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.436+0000 7ff26b800640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2641603d0 0x7ff264144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.436+0000 7ff26b800640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff24406c530 0x7ff24406e9f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.436+0000 7ff26b800640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff26413f0c0 0x7ff2641440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.436+0000 7ff26b800640 1 --2- 172.21.15.44:0/3840985540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff26406d8f0 0x7ff264072db0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.436+0000 7ff26b800640 1 -- 172.21.15.44:0/3840985540 >> 172.21.15.44:0/3840985540 conn(0x7ff2640b5b00 msgr2=0x7ff26415e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:57.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.436+0000 7ff26b800640 1 -- 172.21.15.44:0/3840985540 shutdown_connections 2024-03-30T13:11:57.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.436+0000 7ff26b800640 1 -- 172.21.15.44:0/3840985540 wait complete. 2024-03-30T13:11:57.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:11:57.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.679+0000 7fced1200640 1 Processor -- start 2024-03-30T13:11:57.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.679+0000 7fced1200640 1 -- start start 2024-03-30T13:11:57.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.680+0000 7fced1200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcecc0d13d0 0x7fcecc0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.680+0000 7fced1200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcecc0b3760 0x7fcecc0d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.680+0000 7fced1200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcecc0d1cf0 con 0x7fcecc0d3ba0 2024-03-30T13:11:57.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.680+0000 7fced1200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fcecc0cf860 con 0x7fcecc0d13d0 2024-03-30T13:11:57.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.680+0000 7fced1200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcecc0cfb40 con 0x7fcecc0b3760 2024-03-30T13:11:57.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.680+0000 7fceca800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcecc0d3ba0 0x7fcecc0b7740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39444/0 (socket says 172.21.15.44:39444) 2024-03-30T13:11:57.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.680+0000 7fcec9e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcecc0d13d0 0x7fcecc0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.680+0000 7fceca800640 1 -- 172.21.15.44:0/1945759440 learned_addr learned my addr 172.21.15.44:0/1945759440 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.681+0000 7fcec9400640 1 --2- 172.21.15.44:0/1945759440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcecc0b3760 0x7fcecc0d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.681+0000 7fcec8a00640 1 -- 172.21.15.44:0/1945759440 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4172419708 0 0) 0x7fcecc0d1cf0 con 0x7fcecc0d3ba0 2024-03-30T13:11:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.681+0000 7fcec8a00640 1 -- 172.21.15.44:0/1945759440 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceb0003520 con 0x7fcecc0d3ba0 2024-03-30T13:11:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.681+0000 7fcec9e00640 1 -- 172.21.15.44:0/1945759440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcecc0b3760 msgr2=0x7fcecc0d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.681+0000 7fcec9e00640 1 --2- 172.21.15.44:0/1945759440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcecc0b3760 0x7fcecc0d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.681+0000 7fcec9e00640 1 -- 172.21.15.44:0/1945759440 >> v1:172.21.15.44:6789/0 conn(0x7fcecc0d3ba0 legacy=0x7fcecc0b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.681+0000 7fcec9e00640 1 -- 172.21.15.44:0/1945759440 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc0d33a0 con 0x7fcecc0d13d0 2024-03-30T13:11:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.681+0000 7fcec9400640 1 --2- 172.21.15.44:0/1945759440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcecc0b3760 0x7fcecc0d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.682+0000 7fcec9e00640 1 --2- 172.21.15.44:0/1945759440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcecc0d13d0 0x7fcecc0cecc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0097a0 tx=0x7fcebc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfeef55942a28a70 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.682+0000 7fcec8a00640 1 -- 172.21.15.44:0/1945759440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc035020 con 0x7fcecc0d13d0 2024-03-30T13:11:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.682+0000 7fcec8a00640 1 -- 172.21.15.44:0/1945759440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc031810 con 0x7fcecc0d13d0 2024-03-30T13:11:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.682+0000 7fcec8a00640 1 -- 172.21.15.44:0/1945759440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc031bc0 con 0x7fcecc0d13d0 2024-03-30T13:11:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.683+0000 7fced1200640 1 -- 172.21.15.44:0/1945759440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcecc0d13d0 msgr2=0x7fcecc0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.683+0000 7fced1200640 1 --2- 172.21.15.44:0/1945759440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcecc0d13d0 0x7fcecc0cecc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0097a0 tx=0x7fcebc02b8b0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.683+0000 7fced1200640 1 -- 172.21.15.44:0/1945759440 shutdown_connections 2024-03-30T13:11:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.683+0000 7fced1200640 1 --2- 172.21.15.44:0/1945759440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcecc0b3760 0x7fcecc0d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.683+0000 7fced1200640 1 --2- 172.21.15.44:0/1945759440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcecc0d13d0 0x7fcecc0cecc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.683+0000 7fced1200640 1 -- 172.21.15.44:0/1945759440 >> 172.21.15.44:0/1945759440 conn(0x7fcecc067710 msgr2=0x7fcecc067b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.683+0000 7fced1200640 1 -- 172.21.15.44:0/1945759440 shutdown_connections 2024-03-30T13:11:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.683+0000 7fced1200640 1 -- 172.21.15.44:0/1945759440 wait complete. 2024-03-30T13:11:57.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.685+0000 7fced1200640 1 Processor -- start 2024-03-30T13:11:57.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.685+0000 7fced1200640 1 -- start start 2024-03-30T13:11:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.686+0000 7fced1200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcecc0b3760 0x7fcecc1f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.686+0000 7fced1200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcecc0d13d0 0x7fcecc0b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.686+0000 7fced1200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcecc0d3ba0 0x7fcecc0b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.686+0000 7fced1200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc15e930 con 0x7fcecc0b3760 2024-03-30T13:11:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.686+0000 7fced1200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcecc0d3090 con 0x7fcecc0d13d0 2024-03-30T13:11:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.686+0000 7fced1200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcecc15eab0 con 0x7fcecc0d3ba0 2024-03-30T13:11:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.686+0000 7fcec9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcecc0b3760 0x7fcecc1f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.686+0000 7fcec9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcecc0b3760 0x7fcecc1f4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50038/0 (socket says 172.21.15.44:50038) 2024-03-30T13:11:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.686+0000 7fcec9e00640 1 -- 172.21.15.44:0/2140510586 learned_addr learned my addr 172.21.15.44:0/2140510586 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.686+0000 7fcec9400640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcecc0d13d0 0x7fcecc0b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.687+0000 7fceca800640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcecc0d3ba0 0x7fcecc0b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.687+0000 7fcec9e00640 1 -- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcecc0d3ba0 msgr2=0x7fcecc0b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.687+0000 7fcec9e00640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcecc0d3ba0 0x7fcecc0b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.687+0000 7fcec9e00640 1 -- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcecc0d13d0 msgr2=0x7fcecc0b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.687+0000 7fcec9e00640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcecc0d13d0 0x7fcecc0b56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.687+0000 7fcec9e00640 1 -- 172.21.15.44:0/2140510586 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcecc0cc220 con 0x7fcecc0b3760 2024-03-30T13:11:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.687+0000 7fceca800640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcecc0d3ba0 0x7fcecc0b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.687+0000 7fcec9400640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcecc0d13d0 0x7fcecc0b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:11:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.687+0000 7fcec9e00640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcecc0b3760 0x7fcecc1f4130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0098c0 tx=0x7fcebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.688+0000 7fcec2000640 1 -- 172.21.15.44:0/2140510586 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc041070 con 0x7fcecc0b3760 2024-03-30T13:11:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.688+0000 7fcec2000640 1 -- 172.21.15.44:0/2140510586 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc03ad00 con 0x7fcecc0b3760 2024-03-30T13:11:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.688+0000 7fcec2000640 1 -- 172.21.15.44:0/2140510586 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc035040 con 0x7fcecc0b3760 2024-03-30T13:11:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.688+0000 7fced1200640 1 -- 172.21.15.44:0/2140510586 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcecc0cc500 con 0x7fcecc0b3760 2024-03-30T13:11:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.688+0000 7fced1200640 1 -- 172.21.15.44:0/2140510586 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcecc0ccd00 con 0x7fcecc0b3760 2024-03-30T13:11:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.689+0000 7fced1200640 1 -- 172.21.15.44:0/2140510586 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcecc075890 con 0x7fcecc0b3760 2024-03-30T13:11:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.690+0000 7fcec2000640 1 -- 172.21.15.44:0/2140510586 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcebc04c060 con 0x7fcecc0b3760 2024-03-30T13:11:57.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.691+0000 7fcec2000640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fceac06c530 0x7fceac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:57.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.691+0000 7fcec2000640 1 -- 172.21.15.44:0/2140510586 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcebc0ad600 con 0x7fcecc0b3760 2024-03-30T13:11:57.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.691+0000 7fcec9400640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fceac06c530 0x7fceac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:57.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.693+0000 7fcec9400640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fceac06c530 0x7fceac06e9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0c7f20 tx=0x7fceb8003a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:57.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.695+0000 7fcec2000640 1 -- 172.21.15.44:0/2140510586 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fcebc07b840 con 0x7fcecc0b3760 2024-03-30T13:11:57.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.900+0000 7fced1200640 1 -- 172.21.15.44:0/2140510586 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcecc161f20 con 0x7fcecc0b3760 2024-03-30T13:11:57.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.901+0000 7fcec2000640 1 -- 172.21.15.44:0/2140510586 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fcebc07b140 con 0x7fcecc0b3760 2024-03-30T13:11:57.904 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:11:57.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.903+0000 7fced1200640 1 -- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fceac06c530 msgr2=0x7fceac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.903+0000 7fced1200640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fceac06c530 0x7fceac06e9f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0c7f20 tx=0x7fceb8003a30 comp rx=0 tx=0).stop 2024-03-30T13:11:57.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.903+0000 7fced1200640 1 -- 172.21.15.44:0/2140510586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcecc0b3760 msgr2=0x7fcecc1f4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:57.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.903+0000 7fced1200640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcecc0b3760 0x7fcecc1f4130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0098c0 tx=0x7fcebc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.903+0000 7fced1200640 1 -- 172.21.15.44:0/2140510586 shutdown_connections 2024-03-30T13:11:57.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.903+0000 7fced1200640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcecc0d3ba0 0x7fcecc0b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.903+0000 7fced1200640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fceac06c530 0x7fceac06e9f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.903+0000 7fced1200640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcecc0d13d0 0x7fcecc0b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.903+0000 7fced1200640 1 --2- 172.21.15.44:0/2140510586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcecc0b3760 0x7fcecc1f4130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.903+0000 7fced1200640 1 -- 172.21.15.44:0/2140510586 >> 172.21.15.44:0/2140510586 conn(0x7fcecc067710 msgr2=0x7fcecc0ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.904+0000 7fced1200640 1 -- 172.21.15.44:0/2140510586 shutdown_connections 2024-03-30T13:11:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:57.904+0000 7fced1200640 1 -- 172.21.15.44:0/2140510586 wait complete. 2024-03-30T13:11:57.925 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:11:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.149+0000 7fb483e00640 1 Processor -- start 2024-03-30T13:11:58.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.150+0000 7fb483e00640 1 -- start start 2024-03-30T13:11:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.151+0000 7fb483e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb48415e6c0 0x7fb4840cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.151+0000 7fb483e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb4840d12c0 0x7fb4840d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.151+0000 7fb483e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb484068070 con 0x7fb48406ce70 2024-03-30T13:11:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.152+0000 7fb483e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb48415eaa0 con 0x7fb48415e6c0 2024-03-30T13:11:58.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.152+0000 7fb483e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fb48406c9c0 con 0x7fb4840d12c0 2024-03-30T13:11:58.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.152+0000 7fb483400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb48406ce70 0x7fb48406d300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39446/0 (socket says 172.21.15.44:39446) 2024-03-30T13:11:58.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.152+0000 7fb482a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb48415e6c0 0x7fb4840cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.152+0000 7fb483400640 1 -- 172.21.15.44:0/3291448170 learned_addr learned my addr 172.21.15.44:0/3291448170 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:58.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.152+0000 7fb482000640 1 --2- 172.21.15.44:0/3291448170 >> v2:172.21.15.151:3300/0 conn(0x7fb4840d12c0 0x7fb4840d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.152+0000 7fb482a00640 1 -- 172.21.15.44:0/3291448170 >> v2:172.21.15.151:3300/0 conn(0x7fb4840d12c0 msgr2=0x7fb4840d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:58.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.152+0000 7fb482a00640 1 --2- 172.21.15.44:0/3291448170 >> v2:172.21.15.151:3300/0 conn(0x7fb4840d12c0 0x7fb4840d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.152+0000 7fb482a00640 1 -- 172.21.15.44:0/3291448170 >> v1:172.21.15.44:6789/0 conn(0x7fb48406ce70 legacy=0x7fb48406d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.152+0000 7fb482a00640 1 -- 172.21.15.44:0/3291448170 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4840cf710 con 0x7fb48415e6c0 2024-03-30T13:11:58.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.154+0000 7fb482a00640 1 --2- 172.21.15.44:0/3291448170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb48415e6c0 0x7fb4840cc620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb484072000 tx=0x7fb47402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96badb07b01ace78 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:58.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.156+0000 7fb481600640 1 -- 172.21.15.44:0/3291448170 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474034070 con 0x7fb48415e6c0 2024-03-30T13:11:58.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.156+0000 7fb481600640 1 -- 172.21.15.44:0/3291448170 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb474030610 con 0x7fb48415e6c0 2024-03-30T13:11:58.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.156+0000 7fb481600640 1 -- 172.21.15.44:0/3291448170 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4740309e0 con 0x7fb48415e6c0 2024-03-30T13:11:58.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.157+0000 7fb483e00640 1 -- 172.21.15.44:0/3291448170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb48415e6c0 msgr2=0x7fb4840cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.157+0000 7fb483e00640 1 --2- 172.21.15.44:0/3291448170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb48415e6c0 0x7fb4840cc620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb484072000 tx=0x7fb47402b960 comp rx=0 tx=0).stop 2024-03-30T13:11:58.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.157+0000 7fb483e00640 1 -- 172.21.15.44:0/3291448170 shutdown_connections 2024-03-30T13:11:58.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.157+0000 7fb483e00640 1 --2- 172.21.15.44:0/3291448170 >> v2:172.21.15.151:3300/0 conn(0x7fb4840d12c0 0x7fb4840d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.157+0000 7fb483e00640 1 --2- 172.21.15.44:0/3291448170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb48415e6c0 0x7fb4840cc620 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.157+0000 7fb483e00640 1 -- 172.21.15.44:0/3291448170 >> 172.21.15.44:0/3291448170 conn(0x7fb4840cea50 msgr2=0x7fb4840cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:58.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.157+0000 7fb483e00640 1 -- 172.21.15.44:0/3291448170 shutdown_connections 2024-03-30T13:11:58.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.157+0000 7fb483e00640 1 -- 172.21.15.44:0/3291448170 wait complete. 2024-03-30T13:11:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.159+0000 7fb483e00640 1 Processor -- start 2024-03-30T13:11:58.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.159+0000 7fb483e00640 1 -- start start 2024-03-30T13:11:58.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.160+0000 7fb483e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb48406ce70 0x7fb4840c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb483e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4840d12c0 0x7fb48409be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb483e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb48415e6c0 0x7fb48409c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb483e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb48406dbf0 con 0x7fb48406ce70 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb483e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb4840d2d40 con 0x7fb4840d12c0 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb483e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb4840b3780 con 0x7fb48415e6c0 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb482a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb48406ce70 0x7fb4840c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb482a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb48406ce70 0x7fb4840c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50058/0 (socket says 172.21.15.44:50058) 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb482a00640 1 -- 172.21.15.44:0/3633252958 learned_addr learned my addr 172.21.15.44:0/3633252958 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb482000640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4840d12c0 0x7fb48409be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb483400640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb48415e6c0 0x7fb48409c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb482a00640 1 -- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb48415e6c0 msgr2=0x7fb48409c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb482a00640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb48415e6c0 0x7fb48409c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb482a00640 1 -- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4840d12c0 msgr2=0x7fb48409be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb482a00640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4840d12c0 0x7fb48409be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.161+0000 7fb482a00640 1 -- 172.21.15.44:0/3633252958 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48409f250 con 0x7fb48406ce70 2024-03-30T13:11:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.162+0000 7fb482a00640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb48406ce70 0x7fb4840c88f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb47402bf70 tx=0x7fb4740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.162+0000 7fb47aa00640 1 -- 172.21.15.44:0/3633252958 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474034040 con 0x7fb48406ce70 2024-03-30T13:11:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.162+0000 7fb47aa00640 1 -- 172.21.15.44:0/3633252958 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb47403acc0 con 0x7fb48406ce70 2024-03-30T13:11:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.162+0000 7fb47aa00640 1 -- 172.21.15.44:0/3633252958 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474044640 con 0x7fb48406ce70 2024-03-30T13:11:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.162+0000 7fb483e00640 1 -- 172.21.15.44:0/3633252958 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb48409f530 con 0x7fb48406ce70 2024-03-30T13:11:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.162+0000 7fb483e00640 1 -- 172.21.15.44:0/3633252958 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb48409faf0 con 0x7fb48406ce70 2024-03-30T13:11:58.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.163+0000 7fb483e00640 1 -- 172.21.15.44:0/3633252958 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4840b4bf0 con 0x7fb48406ce70 2024-03-30T13:11:58.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.164+0000 7fb47aa00640 1 -- 172.21.15.44:0/3633252958 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb474037070 con 0x7fb48406ce70 2024-03-30T13:11:58.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.166+0000 7fb47aa00640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb46406c560 0x7fb46406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.166+0000 7fb47aa00640 1 -- 172.21.15.44:0/3633252958 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb4740ad840 con 0x7fb48406ce70 2024-03-30T13:11:58.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.167+0000 7fb482000640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb46406c560 0x7fb46406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.168+0000 7fb482000640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb46406c560 0x7fb46406ea20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb470006fd0 tx=0x7fb470008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:58.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.171+0000 7fb47aa00640 1 -- 172.21.15.44:0/3633252958 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb4840b4bf0 con 0x7fb48406ce70 2024-03-30T13:11:58.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.381+0000 7fb483e00640 1 -- 172.21.15.44:0/3633252958 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb4840c6950 con 0x7fb48406ce70 2024-03-30T13:11:58.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.382+0000 7fb47aa00640 1 -- 172.21.15.44:0/3633252958 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fb4840c6950 con 0x7fb48406ce70 2024-03-30T13:11:58.386 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:11:58.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.385+0000 7fb483e00640 1 -- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb46406c560 msgr2=0x7fb46406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.385+0000 7fb483e00640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb46406c560 0x7fb46406ea20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb470006fd0 tx=0x7fb470008040 comp rx=0 tx=0).stop 2024-03-30T13:11:58.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.385+0000 7fb483e00640 1 -- 172.21.15.44:0/3633252958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb48406ce70 msgr2=0x7fb4840c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.385+0000 7fb483e00640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb48406ce70 0x7fb4840c88f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb47402bf70 tx=0x7fb4740046c0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.385+0000 7fb483e00640 1 -- 172.21.15.44:0/3633252958 shutdown_connections 2024-03-30T13:11:58.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.385+0000 7fb483e00640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb48415e6c0 0x7fb48409c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.385+0000 7fb483e00640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb46406c560 0x7fb46406ea20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.385+0000 7fb483e00640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4840d12c0 0x7fb48409be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.385+0000 7fb483e00640 1 --2- 172.21.15.44:0/3633252958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb48406ce70 0x7fb4840c88f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.385+0000 7fb483e00640 1 -- 172.21.15.44:0/3633252958 >> 172.21.15.44:0/3633252958 conn(0x7fb4840cea50 msgr2=0x7fb4840b72c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:58.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.385+0000 7fb483e00640 1 -- 172.21.15.44:0/3633252958 shutdown_connections 2024-03-30T13:11:58.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.385+0000 7fb483e00640 1 -- 172.21.15.44:0/3633252958 wait complete. 2024-03-30T13:11:58.407 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:11:58.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.621+0000 7f7962a00640 1 Processor -- start 2024-03-30T13:11:58.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.622+0000 7f7962a00640 1 -- start start 2024-03-30T13:11:58.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.623+0000 7f7962a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f795c0d0b90 0x7f795c0d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.623+0000 7f7962a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f795c0b54b0 con 0x7f795c0b4920 2024-03-30T13:11:58.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.623+0000 7f7962a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f795c0cfca0 con 0x7f795c0b4d00 2024-03-30T13:11:58.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.623+0000 7f7962a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f795c0d0260 con 0x7f795c0d0b90 2024-03-30T13:11:58.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.624+0000 7f7961600640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f795c0b4920 0x7f795c0b3ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39452/0 (socket says 172.21.15.44:39452) 2024-03-30T13:11:58.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.624+0000 7f7961600640 1 -- 172.21.15.44:0/3810383878 learned_addr learned my addr 172.21.15.44:0/3810383878 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:58.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.624+0000 7f7962000640 1 --2- 172.21.15.44:0/3810383878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f795c0d0b90 0x7f795c0d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.624+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2103936587 0 0) 0x7f7950001110 con 0x7f795c0b4920 2024-03-30T13:11:58.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.624+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7944003520 con 0x7f795c0b4920 2024-03-30T13:11:58.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.624+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1617701780 0 0) 0x7f7944003520 con 0x7f795c0b4920 2024-03-30T13:11:58.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.624+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f795c0d0b90 msgr2=0x7f795c0d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:58.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.624+0000 7f795be00640 1 --2- 172.21.15.44:0/3810383878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f795c0d0b90 0x7f795c0d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.624+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 >> v1:172.21.15.151:6789/0 conn(0x7f795c0b4d00 legacy=0x7f795c0d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.624+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795c0cff80 con 0x7f795c0b4920 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f7950001840 con 0x7f795c0b4920 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 >> v1:172.21.15.44:6789/0 conn(0x7f795c0b4920 legacy=0x7f795c0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f795be00640 1 --2- 172.21.15.44:0/3810383878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79440039e0 0x7f7944003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f795be00640 1 --2- 172.21.15.44:0/3810383878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7944004800 0x7f7944004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f795be00640 1 --2- 172.21.15.44:0/3810383878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f795c0d0b90 0x7f7944005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f795c0d0260 con 0x7f79440039e0 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f794400bbb0 con 0x7f7944004800 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f794400bdb0 con 0x7f795c0d0b90 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f7961600640 1 --2- 172.21.15.44:0/3810383878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79440039e0 0x7f7944003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f7960c00640 1 --2- 172.21.15.44:0/3810383878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7944004800 0x7f7944004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f7961600640 1 -- 172.21.15.44:0/3810383878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f795c0d0b90 msgr2=0x7f7944005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f7961600640 1 --2- 172.21.15.44:0/3810383878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f795c0d0b90 0x7f7944005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f7961600640 1 -- 172.21.15.44:0/3810383878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7944004800 msgr2=0x7f7944004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:58.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f7961600640 1 --2- 172.21.15.44:0/3810383878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7944004800 0x7f7944004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.625+0000 7f7961600640 1 -- 172.21.15.44:0/3810383878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7944003520 con 0x7f79440039e0 2024-03-30T13:11:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.627+0000 7f7961600640 1 --2- 172.21.15.44:0/3810383878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79440039e0 0x7f7944003e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f795000c2f0 tx=0x7f7944005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8ae9356b8024a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.627+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7950007e10 con 0x7f79440039e0 2024-03-30T13:11:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.627+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7950030070 con 0x7f79440039e0 2024-03-30T13:11:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.627+0000 7f795be00640 1 -- 172.21.15.44:0/3810383878 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795002cdf0 con 0x7f79440039e0 2024-03-30T13:11:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.628+0000 7f7962a00640 1 -- 172.21.15.44:0/3810383878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79440039e0 msgr2=0x7f7944003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.628+0000 7f7962a00640 1 --2- 172.21.15.44:0/3810383878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79440039e0 0x7f7944003e20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f795000c2f0 tx=0x7f7944005830 comp rx=0 tx=0).stop 2024-03-30T13:11:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.628+0000 7f7962000640 1 -- 172.21.15.44:0/3810383878 reap_dead start 2024-03-30T13:11:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.628+0000 7f7962a00640 1 -- 172.21.15.44:0/3810383878 shutdown_connections 2024-03-30T13:11:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.628+0000 7f7962a00640 1 -- 172.21.15.44:0/3810383878 >> 172.21.15.44:0/3810383878 conn(0x7f795c09d4e0 msgr2=0x7f795c0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.628+0000 7f7962a00640 1 -- 172.21.15.44:0/3810383878 shutdown_connections 2024-03-30T13:11:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.628+0000 7f7962a00640 1 -- 172.21.15.44:0/3810383878 wait complete. 2024-03-30T13:11:58.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.630+0000 7f7962a00640 1 Processor -- start 2024-03-30T13:11:58.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.630+0000 7f7962a00640 1 -- start start 2024-03-30T13:11:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.631+0000 7f7962a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79440039e0 0x7f795c1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.631+0000 7f7962a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f795c0cdaf0 0x7f795c1f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.631+0000 7f7962a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f795c1f7e70 0x7f795c159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.631+0000 7f7962a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f795c0cf8c0 con 0x7f79440039e0 2024-03-30T13:11:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.631+0000 7f7962a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f795c0d2180 con 0x7f795c1f7e70 2024-03-30T13:11:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.631+0000 7f7962a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f795c0cfa40 con 0x7f795c0cdaf0 2024-03-30T13:11:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.631+0000 7f7961600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79440039e0 0x7f795c1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.631+0000 7f7961600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79440039e0 0x7f795c1561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50070/0 (socket says 172.21.15.44:50070) 2024-03-30T13:11:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.631+0000 7f7961600640 1 -- 172.21.15.44:0/3341772779 learned_addr learned my addr 172.21.15.44:0/3341772779 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.631+0000 7f7960c00640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f795c0cdaf0 0x7f795c1f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.631+0000 7f7962000640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f795c1f7e70 0x7f795c159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.632+0000 7f7961600640 1 -- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f795c0cdaf0 msgr2=0x7f795c1f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.632+0000 7f7961600640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f795c0cdaf0 0x7f795c1f7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.632+0000 7f7961600640 1 -- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f795c1f7e70 msgr2=0x7f795c159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.632+0000 7f7961600640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f795c1f7e70 0x7f795c159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.632+0000 7f7961600640 1 -- 172.21.15.44:0/3341772779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795c15b960 con 0x7f79440039e0 2024-03-30T13:11:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.632+0000 7f7961600640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79440039e0 0x7f795c1561f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f795002c620 tx=0x7f795c0b5a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.632+0000 7f7959600640 1 -- 172.21.15.44:0/3341772779 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7950045070 con 0x7f79440039e0 2024-03-30T13:11:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.632+0000 7f7959600640 1 -- 172.21.15.44:0/3341772779 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7950004a00 con 0x7f79440039e0 2024-03-30T13:11:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.632+0000 7f7959600640 1 -- 172.21.15.44:0/3341772779 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7950007e10 con 0x7f79440039e0 2024-03-30T13:11:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.632+0000 7f7962a00640 1 -- 172.21.15.44:0/3341772779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795c15bc40 con 0x7f79440039e0 2024-03-30T13:11:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.633+0000 7f7962a00640 1 -- 172.21.15.44:0/3341772779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795c15c200 con 0x7f79440039e0 2024-03-30T13:11:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.634+0000 7f7962a00640 1 -- 172.21.15.44:0/3341772779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f795c1f8280 con 0x7f79440039e0 2024-03-30T13:11:58.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.635+0000 7f7959600640 1 -- 172.21.15.44:0/3341772779 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7950007070 con 0x7f79440039e0 2024-03-30T13:11:58.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.637+0000 7f7959600640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f794006c560 0x7f794006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:58.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.637+0000 7f7959600640 1 -- 172.21.15.44:0/3341772779 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f79500ac9c0 con 0x7f79440039e0 2024-03-30T13:11:58.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.637+0000 7f7960c00640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f794006c560 0x7f794006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:58.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.638+0000 7f7960c00640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f794006c560 0x7f794006ea20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f795c161ac0 tx=0x7f794c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:58.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.641+0000 7f7959600640 1 -- 172.21.15.44:0/3341772779 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f795c1f8280 con 0x7f79440039e0 2024-03-30T13:11:58.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.844+0000 7f7962a00640 1 -- 172.21.15.44:0/3341772779 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f795c075890 con 0x7f79440039e0 2024-03-30T13:11:58.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.845+0000 7f7959600640 1 -- 172.21.15.44:0/3341772779 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f795c0b54b0 con 0x7f79440039e0 2024-03-30T13:11:58.849 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:11:58.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.848+0000 7f7962a00640 1 -- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f794006c560 msgr2=0x7f794006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.848+0000 7f7962a00640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f794006c560 0x7f794006ea20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f795c161ac0 tx=0x7f794c009040 comp rx=0 tx=0).stop 2024-03-30T13:11:58.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.848+0000 7f7962a00640 1 -- 172.21.15.44:0/3341772779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79440039e0 msgr2=0x7f795c1561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:58.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.848+0000 7f7962a00640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79440039e0 0x7f795c1561f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f795002c620 tx=0x7f795c0b5a70 comp rx=0 tx=0).stop 2024-03-30T13:11:58.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.848+0000 7f7962a00640 1 -- 172.21.15.44:0/3341772779 shutdown_connections 2024-03-30T13:11:58.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.848+0000 7f7962a00640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f794006c560 0x7f794006ea20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.848+0000 7f7962a00640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f795c1f7e70 0x7f795c159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.849+0000 7f7962a00640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f795c0cdaf0 0x7f795c1f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.849+0000 7f7962a00640 1 --2- 172.21.15.44:0/3341772779 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79440039e0 0x7f795c1561f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:58.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.849+0000 7f7962a00640 1 -- 172.21.15.44:0/3341772779 >> 172.21.15.44:0/3341772779 conn(0x7f795c09d4e0 msgr2=0x7f795c0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:58.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.849+0000 7f7962a00640 1 -- 172.21.15.44:0/3341772779 shutdown_connections 2024-03-30T13:11:58.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:58.849+0000 7f7962a00640 1 -- 172.21.15.44:0/3341772779 wait complete. 2024-03-30T13:11:58.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:11:59.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.091+0000 7f39e2e00640 1 Processor -- start 2024-03-30T13:11:59.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.092+0000 7f39e2e00640 1 -- start start 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.093+0000 7f39e2e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39dc072de0 0x7f39dc073240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.093+0000 7f39e2e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f39dc0ce8e0 0x7f39dc0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.094+0000 7f39e2e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39dc0cde40 con 0x7f39dc15a8e0 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.094+0000 7f39e2e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f39dc073780 con 0x7f39dc0ce8e0 2024-03-30T13:11:59.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.094+0000 7f39e2e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f39dc072a10 con 0x7f39dc072de0 2024-03-30T13:11:59.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.094+0000 7f39e1a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f39dc15a8e0 0x7f39dc0b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39458/0 (socket says 172.21.15.44:39458) 2024-03-30T13:11:59.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.094+0000 7f39e1a00640 1 -- 172.21.15.44:0/3844524190 learned_addr learned my addr 172.21.15.44:0/3844524190 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:11:59.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.094+0000 7f39e1000640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39dc072de0 0x7f39dc073240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.094+0000 7f39e2400640 1 --2- 172.21.15.44:0/3844524190 >> v2:172.21.15.151:3300/0 conn(0x7f39dc0ce8e0 0x7f39dc0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.094+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297606331 0 0) 0x7f39dc0cde40 con 0x7f39dc15a8e0 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39c4003440 con 0x7f39dc15a8e0 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2250264761 0 0) 0x7f39c4003440 con 0x7f39dc15a8e0 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39dc072de0 msgr2=0x7f39dc073240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39dc072de0 0x7f39dc073240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 >> v2:172.21.15.151:3300/0 conn(0x7f39dc0ce8e0 msgr2=0x7f39dc0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 --2- 172.21.15.44:0/3844524190 >> v2:172.21.15.151:3300/0 conn(0x7f39dc0ce8e0 0x7f39dc0ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39dc06e710 con 0x7f39dc15a8e0 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f39d0001670 con 0x7f39dc15a8e0 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 >> v1:172.21.15.44:6789/0 conn(0x7f39dc15a8e0 legacy=0x7f39dc0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39c4003aa0 0x7f39c4003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39dc072de0 0x7f39c400a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39c400ae50 0x7f39c400d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc072a10 con 0x7f39c4003aa0 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f39c400dac0 con 0x7f39c400ae50 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f39c400dcc0 con 0x7f39dc072de0 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.095+0000 7f39e1a00640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39c4003aa0 0x7f39c4003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.096+0000 7f39e1000640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39dc072de0 0x7f39c400a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.096+0000 7f39e2400640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39c400ae50 0x7f39c400d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.096+0000 7f39e1a00640 1 -- 172.21.15.44:0/3844524190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39dc072de0 msgr2=0x7f39c400a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.096+0000 7f39e1a00640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39dc072de0 0x7f39c400a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.096+0000 7f39e1a00640 1 -- 172.21.15.44:0/3844524190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39c400ae50 msgr2=0x7f39c400d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.096+0000 7f39e1a00640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39c400ae50 0x7f39c400d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.096+0000 7f39e1a00640 1 -- 172.21.15.44:0/3844524190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c4003440 con 0x7f39c4003aa0 2024-03-30T13:11:59.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.096+0000 7f39e2400640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39c400ae50 0x7f39c400d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:11:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.097+0000 7f39e1a00640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39c4003aa0 0x7f39c4003ee0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c290 tx=0x7f39c4003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a8ac6dd10037df server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.097+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0007d50 con 0x7f39c4003aa0 2024-03-30T13:11:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.097+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d0030070 con 0x7f39c4003aa0 2024-03-30T13:11:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.097+0000 7f39dbe00640 1 -- 172.21.15.44:0/3844524190 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d002cd80 con 0x7f39c4003aa0 2024-03-30T13:11:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.098+0000 7f39e2e00640 1 -- 172.21.15.44:0/3844524190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39c4003aa0 msgr2=0x7f39c4003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.098+0000 7f39e2e00640 1 --2- 172.21.15.44:0/3844524190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39c4003aa0 0x7f39c4003ee0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c290 tx=0x7f39c4003730 comp rx=0 tx=0).stop 2024-03-30T13:11:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.098+0000 7f39e2400640 1 -- 172.21.15.44:0/3844524190 reap_dead start 2024-03-30T13:11:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.098+0000 7f39e2e00640 1 -- 172.21.15.44:0/3844524190 shutdown_connections 2024-03-30T13:11:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.098+0000 7f39e2e00640 1 -- 172.21.15.44:0/3844524190 >> 172.21.15.44:0/3844524190 conn(0x7f39dc06b970 msgr2=0x7f39dc06bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.098+0000 7f39e2e00640 1 -- 172.21.15.44:0/3844524190 shutdown_connections 2024-03-30T13:11:59.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.098+0000 7f39e2e00640 1 -- 172.21.15.44:0/3844524190 wait complete. 2024-03-30T13:11:59.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.100+0000 7f39e2e00640 1 Processor -- start 2024-03-30T13:11:59.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.100+0000 7f39e2e00640 1 -- start start 2024-03-30T13:11:59.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.101+0000 7f39e2e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39c4003aa0 0x7f39dc1e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.101+0000 7f39e2e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39dc1f3640 0x7f39dc1e2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.101+0000 7f39e2e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39dc1f3ac0 0x7f39dc1e46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.101+0000 7f39e2e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc0ce3c0 con 0x7f39dc1f3640 2024-03-30T13:11:59.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.101+0000 7f39e2e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc0ce0e0 con 0x7f39dc1f3ac0 2024-03-30T13:11:59.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.101+0000 7f39e2e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f39dc06e2a0 con 0x7f39c4003aa0 2024-03-30T13:11:59.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.102+0000 7f39e1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39dc1f3640 0x7f39dc1e2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.102+0000 7f39e1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39dc1f3640 0x7f39dc1e2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50096/0 (socket says 172.21.15.44:50096) 2024-03-30T13:11:59.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.102+0000 7f39e1000640 1 -- 172.21.15.44:0/3780298140 learned_addr learned my addr 172.21.15.44:0/3780298140 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:11:59.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.102+0000 7f39e1a00640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39c4003aa0 0x7f39dc1e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.102+0000 7f39e2400640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39dc1f3ac0 0x7f39dc1e46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.102+0000 7f39e1000640 1 -- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39c4003aa0 msgr2=0x7f39dc1e6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.102+0000 7f39e1000640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39c4003aa0 0x7f39dc1e6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.102+0000 7f39e1000640 1 -- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39dc1f3ac0 msgr2=0x7f39dc1e46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.102+0000 7f39e1000640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39dc1f3ac0 0x7f39dc1e46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.102+0000 7f39e1000640 1 -- 172.21.15.44:0/3780298140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39dc1e3070 con 0x7f39dc1f3640 2024-03-30T13:11:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.103+0000 7f39e1000640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39dc1f3640 0x7f39dc1e2700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f39c8011590 tx=0x7f39c8011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.103+0000 7f39d9600640 1 -- 172.21.15.44:0/3780298140 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8004220 con 0x7f39dc1f3640 2024-03-30T13:11:59.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.103+0000 7f39d9600640 1 -- 172.21.15.44:0/3780298140 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c80043c0 con 0x7f39dc1f3640 2024-03-30T13:11:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.103+0000 7f39e2e00640 1 -- 172.21.15.44:0/3780298140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39dc1dff90 con 0x7f39dc1f3640 2024-03-30T13:11:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.103+0000 7f39d9600640 1 -- 172.21.15.44:0/3780298140 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8015930 con 0x7f39dc1f3640 2024-03-30T13:11:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.103+0000 7f39e2e00640 1 -- 172.21.15.44:0/3780298140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39dc1e0550 con 0x7f39dc1f3640 2024-03-30T13:11:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.104+0000 7f39e2e00640 1 -- 172.21.15.44:0/3780298140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39dc0cd490 con 0x7f39dc1f3640 2024-03-30T13:11:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.105+0000 7f39d9600640 1 -- 172.21.15.44:0/3780298140 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f39c8015ad0 con 0x7f39dc1f3640 2024-03-30T13:11:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.106+0000 7f39d9600640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f39bc06c530 0x7f39bc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:11:59.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.106+0000 7f39d9600640 1 -- 172.21.15.44:0/3780298140 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f39c808c070 con 0x7f39dc1f3640 2024-03-30T13:11:59.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.107+0000 7f39e1a00640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f39bc06c530 0x7f39bc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:11:59.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.108+0000 7f39e1a00640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f39bc06c530 0x7f39bc06e9f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f39d0034000 tx=0x7f39d0007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:11:59.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.110+0000 7f39d9600640 1 -- 172.21.15.44:0/3780298140 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f39dc0cd490 con 0x7f39dc1f3640 2024-03-30T13:11:59.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.325+0000 7f39e2e00640 1 -- 172.21.15.44:0/3780298140 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f39dc075890 con 0x7f39dc1f3640 2024-03-30T13:11:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.326+0000 7f39d9600640 1 -- 172.21.15.44:0/3780298140 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f39c8019030 con 0x7f39dc1f3640 2024-03-30T13:11:59.329 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-03-30T13:11:59.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.328+0000 7f39e2e00640 1 -- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f39bc06c530 msgr2=0x7f39bc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.328+0000 7f39e2e00640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f39bc06c530 0x7f39bc06e9f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f39d0034000 tx=0x7f39d0007000 comp rx=0 tx=0).stop 2024-03-30T13:11:59.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.328+0000 7f39e2e00640 1 -- 172.21.15.44:0/3780298140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39dc1f3640 msgr2=0x7f39dc1e2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:11:59.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.329+0000 7f39e2e00640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39dc1f3640 0x7f39dc1e2700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f39c8011590 tx=0x7f39c8011a50 comp rx=0 tx=0).stop 2024-03-30T13:11:59.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.329+0000 7f39e2e00640 1 -- 172.21.15.44:0/3780298140 shutdown_connections 2024-03-30T13:11:59.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.329+0000 7f39e2e00640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f39bc06c530 0x7f39bc06e9f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.329+0000 7f39e2e00640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39dc1f3ac0 0x7f39dc1e46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.329+0000 7f39e2e00640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39dc1f3640 0x7f39dc1e2700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.329+0000 7f39e2e00640 1 --2- 172.21.15.44:0/3780298140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39c4003aa0 0x7f39dc1e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:11:59.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.329+0000 7f39e2e00640 1 -- 172.21.15.44:0/3780298140 >> 172.21.15.44:0/3780298140 conn(0x7f39dc06b970 msgr2=0x7f39dc14edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:11:59.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.329+0000 7f39e2e00640 1 -- 172.21.15.44:0/3780298140 shutdown_connections 2024-03-30T13:11:59.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:11:59.329+0000 7f39e2e00640 1 -- 172.21.15.44:0/3780298140 wait complete. 2024-03-30T13:11:59.349 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-03-30T13:11:59.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:11:59.350 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-03-30T13:11:59.438 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[43389]: fuse finished with error 0 and tester_r 0 2024-03-30T13:11:59.445 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:11:59.598 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:11:59.605 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:05.547 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:12:05.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:05.547 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-03-30T13:12:05.630 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:05.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.854+0000 7f7c29400640 1 Processor -- start 2024-03-30T13:12:05.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.854+0000 7f7c29400640 1 -- start start 2024-03-30T13:12:05.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.855+0000 7f7c29400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7c240b3250 0x7f7c2406d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.855+0000 7f7c29400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c240d0ed0 con 0x7f7c2415e8d0 2024-03-30T13:12:05.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.855+0000 7f7c29400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c240d11b0 con 0x7f7c2415e4f0 2024-03-30T13:12:05.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.855+0000 7f7c29400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f7c240cc650 con 0x7f7c240b3250 2024-03-30T13:12:05.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.856+0000 7f7c1b400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7c240b3250 0x7f7c2406d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.856+0000 7f7c28a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7c2415e8d0 0x7f7c240ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39474/0 (socket says 172.21.15.44:39474) 2024-03-30T13:12:05.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.856+0000 7f7c28a00640 1 -- 172.21.15.44:0/127824876 learned_addr learned my addr 172.21.15.44:0/127824876 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:05.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.856+0000 7f7c1b400640 1 -- 172.21.15.44:0/127824876 >> v1:172.21.15.151:6789/0 conn(0x7f7c2415e4f0 legacy=0x7f7c2406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.856+0000 7f7c1b400640 1 -- 172.21.15.44:0/127824876 >> v1:172.21.15.44:6789/0 conn(0x7f7c2415e8d0 legacy=0x7f7c240ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.856+0000 7f7c1b400640 1 -- 172.21.15.44:0/127824876 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c240d1490 con 0x7f7c240b3250 2024-03-30T13:12:05.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.856+0000 7f7c23400640 1 -- 172.21.15.44:0/127824876 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 732509505 0 0) 0x7f7c240d0ed0 con 0x7f7c2415e8d0 2024-03-30T13:12:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.857+0000 7f7c1b400640 1 --2- 172.21.15.44:0/127824876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c240b3250 0x7f7c2406d040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0097a0 tx=0x7f7c0c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fec607aefb5e85 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.858+0000 7f7c23400640 1 -- 172.21.15.44:0/127824876 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c034070 con 0x7f7c240b3250 2024-03-30T13:12:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.858+0000 7f7c23400640 1 -- 172.21.15.44:0/127824876 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0c030610 con 0x7f7c240b3250 2024-03-30T13:12:05.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.858+0000 7f7c23400640 1 -- 172.21.15.44:0/127824876 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0309e0 con 0x7f7c240b3250 2024-03-30T13:12:05.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.858+0000 7f7c29400640 1 -- 172.21.15.44:0/127824876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c240b3250 msgr2=0x7f7c2406d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.858+0000 7f7c29400640 1 --2- 172.21.15.44:0/127824876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c240b3250 0x7f7c2406d040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0097a0 tx=0x7f7c0c02b960 comp rx=0 tx=0).stop 2024-03-30T13:12:05.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.858+0000 7f7c29400640 1 -- 172.21.15.44:0/127824876 shutdown_connections 2024-03-30T13:12:05.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.858+0000 7f7c29400640 1 --2- 172.21.15.44:0/127824876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c240b3250 0x7f7c2406d040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.858+0000 7f7c29400640 1 -- 172.21.15.44:0/127824876 >> 172.21.15.44:0/127824876 conn(0x7f7c240b3af0 msgr2=0x7f7c240b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:05.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.859+0000 7f7c29400640 1 -- 172.21.15.44:0/127824876 shutdown_connections 2024-03-30T13:12:05.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.859+0000 7f7c29400640 1 -- 172.21.15.44:0/127824876 wait complete. 2024-03-30T13:12:05.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.860+0000 7f7c29400640 1 Processor -- start 2024-03-30T13:12:05.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.860+0000 7f7c29400640 1 -- start start 2024-03-30T13:12:05.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.861+0000 7f7c29400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c240b3250 0x7f7c240b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.861+0000 7f7c29400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2415e4f0 0x7f7c240b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.861+0000 7f7c29400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2415e8d0 0x7f7c24148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.861+0000 7f7c29400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2406d580 con 0x7f7c2415e4f0 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.861+0000 7f7c29400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2409ba40 con 0x7f7c2415e8d0 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.861+0000 7f7c29400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7c2406d700 con 0x7f7c240b3250 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.862+0000 7f7c1b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2415e4f0 0x7f7c240b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.862+0000 7f7c1b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2415e4f0 0x7f7c240b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50118/0 (socket says 172.21.15.44:50118) 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.862+0000 7f7c1b400640 1 -- 172.21.15.44:0/1844505605 learned_addr learned my addr 172.21.15.44:0/1844505605 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.862+0000 7f7c23e00640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c240b3250 0x7f7c240b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.862+0000 7f7c28a00640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2415e8d0 0x7f7c24148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.862+0000 7f7c1b400640 1 -- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c240b3250 msgr2=0x7f7c240b7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.862+0000 7f7c1b400640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c240b3250 0x7f7c240b7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.862+0000 7f7c1b400640 1 -- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2415e8d0 msgr2=0x7f7c24148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.862+0000 7f7c1b400640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2415e8d0 0x7f7c24148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:05.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.862+0000 7f7c1b400640 1 -- 172.21.15.44:0/1844505605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c240b7db0 con 0x7f7c2415e4f0 2024-03-30T13:12:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.862+0000 7f7c28a00640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2415e8d0 0x7f7c24148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.862+0000 7f7c1b400640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2415e4f0 0x7f7c240b4b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0098c0 tx=0x7f7c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.863+0000 7f7c20c00640 1 -- 172.21.15.44:0/1844505605 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c034040 con 0x7f7c2415e4f0 2024-03-30T13:12:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.863+0000 7f7c20c00640 1 -- 172.21.15.44:0/1844505605 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0c03acc0 con 0x7f7c2415e4f0 2024-03-30T13:12:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.863+0000 7f7c20c00640 1 -- 172.21.15.44:0/1844505605 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c044630 con 0x7f7c2415e4f0 2024-03-30T13:12:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.863+0000 7f7c29400640 1 -- 172.21.15.44:0/1844505605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c240b67d0 con 0x7f7c2415e4f0 2024-03-30T13:12:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.863+0000 7f7c29400640 1 -- 172.21.15.44:0/1844505605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c240b6d90 con 0x7f7c2415e4f0 2024-03-30T13:12:05.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.864+0000 7f7c29400640 1 -- 172.21.15.44:0/1844505605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c24161ff0 con 0x7f7c2415e4f0 2024-03-30T13:12:05.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.865+0000 7f7c20c00640 1 -- 172.21.15.44:0/1844505605 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7c0c04b060 con 0x7f7c2415e4f0 2024-03-30T13:12:05.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.866+0000 7f7c20c00640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7c0006c530 0x7f7c0006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:05.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.867+0000 7f7c20c00640 1 -- 172.21.15.44:0/1844505605 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7c0c0ada60 con 0x7f7c2415e4f0 2024-03-30T13:12:05.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.867+0000 7f7c23e00640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7c0006c530 0x7f7c0006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:05.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.868+0000 7f7c23e00640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7c0006c530 0x7f7c0006e9f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7c14000f60 tx=0x7f7c14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:05.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:05.871+0000 7f7c20c00640 1 -- 172.21.15.44:0/1844505605 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7c24161ff0 con 0x7f7c2415e4f0 2024-03-30T13:12:06.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.076+0000 7f7c29400640 1 -- 172.21.15.44:0/1844505605 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c2406ddb0 con 0x7f7c2415e4f0 2024-03-30T13:12:06.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.080+0000 7f7c20c00640 1 -- 172.21.15.44:0/1844505605 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7f7c0c03f070 con 0x7f7c2415e4f0 2024-03-30T13:12:06.084 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:06.084 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:06.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.082+0000 7f7c29400640 1 -- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7c0006c530 msgr2=0x7f7c0006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.082+0000 7f7c29400640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7c0006c530 0x7f7c0006e9f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7c14000f60 tx=0x7f7c14009040 comp rx=0 tx=0).stop 2024-03-30T13:12:06.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.082+0000 7f7c29400640 1 -- 172.21.15.44:0/1844505605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2415e4f0 msgr2=0x7f7c240b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.082+0000 7f7c29400640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2415e4f0 0x7f7c240b4b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0098c0 tx=0x7f7c0c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.083+0000 7f7c29400640 1 -- 172.21.15.44:0/1844505605 shutdown_connections 2024-03-30T13:12:06.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.083+0000 7f7c29400640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7c0006c530 0x7f7c0006e9f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.083+0000 7f7c29400640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2415e8d0 0x7f7c24148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.083+0000 7f7c29400640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c2415e4f0 0x7f7c240b4b80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.083+0000 7f7c29400640 1 --2- 172.21.15.44:0/1844505605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c240b3250 0x7f7c240b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.083+0000 7f7c29400640 1 -- 172.21.15.44:0/1844505605 >> 172.21.15.44:0/1844505605 conn(0x7f7c240b3af0 msgr2=0x7f7c240cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:06.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.083+0000 7f7c29400640 1 -- 172.21.15.44:0/1844505605 shutdown_connections 2024-03-30T13:12:06.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.083+0000 7f7c29400640 1 -- 172.21.15.44:0/1844505605 wait complete. 2024-03-30T13:12:06.106 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:06.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.307+0000 7f5c0de00640 1 Processor -- start 2024-03-30T13:12:06.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.307+0000 7f5c0de00640 1 -- start start 2024-03-30T13:12:06.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.309+0000 7f5c0de00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c0815f7e0 0x7f5c080cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.309+0000 7f5c0de00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c0815b650 con 0x7f5c080ccf10 2024-03-30T13:12:06.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.309+0000 7f5c0de00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c08072ab0 con 0x7f5c0815b270 2024-03-30T13:12:06.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.309+0000 7f5c0de00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0815fc40 con 0x7f5c0815f7e0 2024-03-30T13:12:06.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.309+0000 7f5c07400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5c080ccf10 0x7f5c080ca9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:39490/0 (socket says 172.21.15.44:39490) 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.309+0000 7f5c07400640 1 -- 172.21.15.44:0/2315968527 learned_addr learned my addr 172.21.15.44:0/2315968527 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.309+0000 7f5c06000640 1 --2- 172.21.15.44:0/2315968527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c0815f7e0 0x7f5c080cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4027407420 0 0) 0x7f5c0815b650 con 0x7f5c080ccf10 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bec003520 con 0x7f5c080ccf10 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1500341051 0 0) 0x7f5bec003520 con 0x7f5c080ccf10 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c0815f7e0 msgr2=0x7f5c080cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 --2- 172.21.15.44:0/2315968527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c0815f7e0 0x7f5c080cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 >> v1:172.21.15.151:6789/0 conn(0x7f5c0815b270 legacy=0x7f5c08072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c08072d90 con 0x7f5c080ccf10 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f5c000019f0 con 0x7f5c080ccf10 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 >> v1:172.21.15.44:6789/0 conn(0x7f5c080ccf10 legacy=0x7f5c080ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 --2- 172.21.15.44:0/2315968527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec0039e0 0x7f5bec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 --2- 172.21.15.44:0/2315968527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c0815f7e0 0x7f5bec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 --2- 172.21.15.44:0/2315968527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec004d40 0x7f5bec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0815fc40 con 0x7f5bec004d40 2024-03-30T13:12:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec00ba70 con 0x7f5bec0039e0 2024-03-30T13:12:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.310+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5bec00bc70 con 0x7f5c0815f7e0 2024-03-30T13:12:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.311+0000 7f5c07400640 1 --2- 172.21.15.44:0/2315968527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec004d40 0x7f5bec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.311+0000 7f5c06a00640 1 --2- 172.21.15.44:0/2315968527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec0039e0 0x7f5bec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.311+0000 7f5c06000640 1 --2- 172.21.15.44:0/2315968527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c0815f7e0 0x7f5bec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.311+0000 7f5c07400640 1 -- 172.21.15.44:0/2315968527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c0815f7e0 msgr2=0x7f5bec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.311+0000 7f5c07400640 1 --2- 172.21.15.44:0/2315968527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c0815f7e0 0x7f5bec004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.311+0000 7f5c07400640 1 -- 172.21.15.44:0/2315968527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec0039e0 msgr2=0x7f5bec003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.311+0000 7f5c07400640 1 --2- 172.21.15.44:0/2315968527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec0039e0 0x7f5bec003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.311+0000 7f5c07400640 1 -- 172.21.15.44:0/2315968527 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bec003520 con 0x7f5bec004d40 2024-03-30T13:12:06.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.312+0000 7f5c07400640 1 --2- 172.21.15.44:0/2315968527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec004d40 0x7f5bec0051c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000a810 tx=0x7f5bec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161e4eeb6725aaea server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:06.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.312+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0000a460 con 0x7f5bec004d40 2024-03-30T13:12:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.312+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c00034650 con 0x7f5bec004d40 2024-03-30T13:12:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.312+0000 7f5c05600640 1 -- 172.21.15.44:0/2315968527 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00034a40 con 0x7f5bec004d40 2024-03-30T13:12:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.313+0000 7f5c0de00640 1 -- 172.21.15.44:0/2315968527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec004d40 msgr2=0x7f5bec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.313+0000 7f5c0de00640 1 --2- 172.21.15.44:0/2315968527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec004d40 0x7f5bec0051c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000a810 tx=0x7f5bec005830 comp rx=0 tx=0).stop 2024-03-30T13:12:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.313+0000 7f5c07400640 1 -- 172.21.15.44:0/2315968527 reap_dead start 2024-03-30T13:12:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.313+0000 7f5c0de00640 1 -- 172.21.15.44:0/2315968527 shutdown_connections 2024-03-30T13:12:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.313+0000 7f5c0de00640 1 -- 172.21.15.44:0/2315968527 >> 172.21.15.44:0/2315968527 conn(0x7f5c080b1c90 msgr2=0x7f5c080b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.313+0000 7f5c0de00640 1 -- 172.21.15.44:0/2315968527 shutdown_connections 2024-03-30T13:12:06.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.313+0000 7f5c0de00640 1 -- 172.21.15.44:0/2315968527 wait complete. 2024-03-30T13:12:06.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.315+0000 7f5c0de00640 1 Processor -- start 2024-03-30T13:12:06.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.315+0000 7f5c0de00640 1 -- start start 2024-03-30T13:12:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.316+0000 7f5c0de00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec004d40 0x7f5c08146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.316+0000 7f5c0de00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c080b57f0 0x7f5c08153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.316+0000 7f5c0de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c08153b60 0x7f5c081581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.316+0000 7f5c0de00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08073630 con 0x7f5c08153b60 2024-03-30T13:12:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.316+0000 7f5c0de00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5c08073350 con 0x7f5c080b57f0 2024-03-30T13:12:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.316+0000 7f5c0de00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5c080cc9d0 con 0x7f5bec004d40 2024-03-30T13:12:06.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.316+0000 7f5c07400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c08153b60 0x7f5c081581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.316+0000 7f5c07400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c08153b60 0x7f5c081581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50146/0 (socket says 172.21.15.44:50146) 2024-03-30T13:12:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.316+0000 7f5c07400640 1 -- 172.21.15.44:0/1510350332 learned_addr learned my addr 172.21.15.44:0/1510350332 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.316+0000 7f5c06000640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c080b57f0 0x7f5c08153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.316+0000 7f5c06a00640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec004d40 0x7f5c08146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.317+0000 7f5c07400640 1 -- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec004d40 msgr2=0x7f5c08146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.317+0000 7f5c07400640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec004d40 0x7f5c08146ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.317+0000 7f5c07400640 1 -- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c080b57f0 msgr2=0x7f5c08153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.317+0000 7f5c07400640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c080b57f0 0x7f5c08153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.317+0000 7f5c07400640 1 -- 172.21.15.44:0/1510350332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c08152e40 con 0x7f5c08153b60 2024-03-30T13:12:06.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.317+0000 7f5c07400640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c08153b60 0x7f5c081581b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c00001cf0 tx=0x7f5c08072f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:06.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.317+0000 7f5bff400640 1 -- 172.21.15.44:0/1510350332 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00034a00 con 0x7f5c08153b60 2024-03-30T13:12:06.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.317+0000 7f5bff400640 1 -- 172.21.15.44:0/1510350332 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c00044070 con 0x7f5c08153b60 2024-03-30T13:12:06.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.317+0000 7f5bff400640 1 -- 172.21.15.44:0/1510350332 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00034da0 con 0x7f5c08153b60 2024-03-30T13:12:06.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.317+0000 7f5c0de00640 1 -- 172.21.15.44:0/1510350332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c080b35e0 con 0x7f5c08153b60 2024-03-30T13:12:06.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.318+0000 7f5c0de00640 1 -- 172.21.15.44:0/1510350332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c080b3ba0 con 0x7f5c08153b60 2024-03-30T13:12:06.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.319+0000 7f5c0de00640 1 -- 172.21.15.44:0/1510350332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c08075a10 con 0x7f5c08153b60 2024-03-30T13:12:06.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.320+0000 7f5bff400640 1 -- 172.21.15.44:0/1510350332 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5c00049460 con 0x7f5c08153b60 2024-03-30T13:12:06.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.320+0000 7f5bff400640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5be406c530 0x7f5be406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.321+0000 7f5bff400640 1 -- 172.21.15.44:0/1510350332 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5c000adff0 con 0x7f5c08153b60 2024-03-30T13:12:06.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.321+0000 7f5c06a00640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5be406c530 0x7f5be406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.322+0000 7f5c06a00640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5be406c530 0x7f5be406e9f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8007fd0 tx=0x7f5bf8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:06.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.325+0000 7f5bff400640 1 -- 172.21.15.44:0/1510350332 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5c00032380 con 0x7f5c08153b60 2024-03-30T13:12:06.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.528+0000 7f5c0de00640 1 -- 172.21.15.44:0/1510350332 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c080cd720 con 0x7f5c08153b60 2024-03-30T13:12:06.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.531+0000 7f5bff400640 1 -- 172.21.15.44:0/1510350332 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7f5c0007c230 con 0x7f5c08153b60 2024-03-30T13:12:06.535 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:06.535 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.533+0000 7f5c0de00640 1 -- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5be406c530 msgr2=0x7f5be406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.533+0000 7f5c0de00640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5be406c530 0x7f5be406e9f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8007fd0 tx=0x7f5bf8009040 comp rx=0 tx=0).stop 2024-03-30T13:12:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.533+0000 7f5c0de00640 1 -- 172.21.15.44:0/1510350332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c08153b60 msgr2=0x7f5c081581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.533+0000 7f5c0de00640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c08153b60 0x7f5c081581b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c00001cf0 tx=0x7f5c08072f60 comp rx=0 tx=0).stop 2024-03-30T13:12:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.533+0000 7f5c0de00640 1 -- 172.21.15.44:0/1510350332 shutdown_connections 2024-03-30T13:12:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.533+0000 7f5c0de00640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c08153b60 0x7f5c081581b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.533+0000 7f5c0de00640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5be406c530 0x7f5be406e9f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.533+0000 7f5c0de00640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c080b57f0 0x7f5c08153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.533+0000 7f5c0de00640 1 --2- 172.21.15.44:0/1510350332 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec004d40 0x7f5c08146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.533+0000 7f5c0de00640 1 -- 172.21.15.44:0/1510350332 >> 172.21.15.44:0/1510350332 conn(0x7f5c080b1c90 msgr2=0x7f5c080c9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.534+0000 7f5c0de00640 1 -- 172.21.15.44:0/1510350332 shutdown_connections 2024-03-30T13:12:06.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.534+0000 7f5c0de00640 1 -- 172.21.15.44:0/1510350332 wait complete. 2024-03-30T13:12:06.557 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-30T13:12:06.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.777+0000 7f4435c00640 1 Processor -- start 2024-03-30T13:12:06.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.777+0000 7f4435c00640 1 -- start start 2024-03-30T13:12:06.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.778+0000 7f4435c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f44300d1920 0x7f44300d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.778+0000 7f4435c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44300cfea0 0x7f44300d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.778+0000 7f4435c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44300d2460 con 0x7f443015e400 2024-03-30T13:12:06.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.778+0000 7f4435c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f443015e7e0 con 0x7f44300d1920 2024-03-30T13:12:06.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.778+0000 7f4435c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f44300cf0e0 con 0x7f44300cfea0 2024-03-30T13:12:06.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.779+0000 7f442f400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f44300d1920 0x7f44300d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.779+0000 7f4435200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44300cfea0 0x7f44300d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.779+0000 7f4435200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44300cfea0 0x7f44300d2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:42074/0 (socket says 172.21.15.44:42074) 2024-03-30T13:12:06.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.779+0000 7f442f400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f44300d1920 0x7f44300d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:52682/0 (socket says 172.21.15.44:52682) 2024-03-30T13:12:06.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.779+0000 7f4435200640 1 -- 172.21.15.44:0/417180251 learned_addr learned my addr 172.21.15.44:0/417180251 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:06.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.780+0000 7f4435200640 1 -- 172.21.15.44:0/417180251 >> v2:172.21.15.151:3300/0 conn(0x7f44300d1920 msgr2=0x7f44300d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:06.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.780+0000 7f4435200640 1 --2- 172.21.15.44:0/417180251 >> v2:172.21.15.151:3300/0 conn(0x7f44300d1920 0x7f44300d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.780+0000 7f4435200640 1 -- 172.21.15.44:0/417180251 >> v1:172.21.15.151:6789/0 conn(0x7f443015e400 legacy=0x7f44300d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.780+0000 7f4435200640 1 -- 172.21.15.44:0/417180251 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44300cf3c0 con 0x7f44300cfea0 2024-03-30T13:12:06.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.781+0000 7f4435200640 1 --2- 172.21.15.44:0/417180251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44300cfea0 0x7f44300d2c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4428009e50 tx=0x7f442802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b82e9b2f16e4b2b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:06.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.781+0000 7f442ea00640 1 -- 172.21.15.44:0/417180251 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442802cb00 con 0x7f44300cfea0 2024-03-30T13:12:06.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.781+0000 7f442ea00640 1 -- 172.21.15.44:0/417180251 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f442802cca0 con 0x7f44300cfea0 2024-03-30T13:12:06.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.782+0000 7f442ea00640 1 -- 172.21.15.44:0/417180251 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428034610 con 0x7f44300cfea0 2024-03-30T13:12:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.782+0000 7f4435c00640 1 -- 172.21.15.44:0/417180251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44300cfea0 msgr2=0x7f44300d2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.782+0000 7f4435c00640 1 --2- 172.21.15.44:0/417180251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44300cfea0 0x7f44300d2c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4428009e50 tx=0x7f442802bf60 comp rx=0 tx=0).stop 2024-03-30T13:12:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.782+0000 7f4435c00640 1 -- 172.21.15.44:0/417180251 shutdown_connections 2024-03-30T13:12:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.782+0000 7f4435c00640 1 --2- 172.21.15.44:0/417180251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44300cfea0 0x7f44300d2c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.782+0000 7f4435c00640 1 --2- 172.21.15.44:0/417180251 >> v2:172.21.15.151:3300/0 conn(0x7f44300d1920 0x7f44300d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.782+0000 7f4435c00640 1 -- 172.21.15.44:0/417180251 >> 172.21.15.44:0/417180251 conn(0x7f443009d4c0 msgr2=0x7f44300d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.782+0000 7f4435c00640 1 -- 172.21.15.44:0/417180251 shutdown_connections 2024-03-30T13:12:06.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.782+0000 7f4435c00640 1 -- 172.21.15.44:0/417180251 wait complete. 2024-03-30T13:12:06.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.784+0000 7f4435c00640 1 Processor -- start 2024-03-30T13:12:06.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.784+0000 7f4435c00640 1 -- start start 2024-03-30T13:12:06.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.785+0000 7f4435c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44300cfea0 0x7f443015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.785+0000 7f4435c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44300d1920 0x7f44300c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.785+0000 7f4435c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f443015e400 0x7f44300b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.785+0000 7f4435c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f44300ced00 con 0x7f443015e400 2024-03-30T13:12:06.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.785+0000 7f4435c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f44300cf980 con 0x7f44300d1920 2024-03-30T13:12:06.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.785+0000 7f4435c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f44300cee80 con 0x7f44300cfea0 2024-03-30T13:12:06.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.785+0000 7f4435200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f443015e400 0x7f44300b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.785+0000 7f4435200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f443015e400 0x7f44300b8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50160/0 (socket says 172.21.15.44:50160) 2024-03-30T13:12:06.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.785+0000 7f4435200640 1 -- 172.21.15.44:0/3085134927 learned_addr learned my addr 172.21.15.44:0/3085134927 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:06.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.786+0000 7f442f400640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44300d1920 0x7f44300c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.786+0000 7f442fe00640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44300cfea0 0x7f443015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.786+0000 7f4435200640 1 -- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44300cfea0 msgr2=0x7f443015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.786+0000 7f4435200640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44300cfea0 0x7f443015c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.786+0000 7f4435200640 1 -- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44300d1920 msgr2=0x7f44300c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:06.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.786+0000 7f4435200640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44300d1920 0x7f44300c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:06.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.786+0000 7f4435200640 1 -- 172.21.15.44:0/3085134927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443015cda0 con 0x7f443015e400 2024-03-30T13:12:06.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.786+0000 7f442f400640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44300d1920 0x7f44300c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:06.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.786+0000 7f4435200640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f443015e400 0x7f44300b8f50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4428009e50 tx=0x7f4428004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:06.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.787+0000 7f4427e00640 1 -- 172.21.15.44:0/3085134927 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428043020 con 0x7f443015e400 2024-03-30T13:12:06.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.787+0000 7f4427e00640 1 -- 172.21.15.44:0/3085134927 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f442802ce50 con 0x7f443015e400 2024-03-30T13:12:06.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.787+0000 7f4427e00640 1 -- 172.21.15.44:0/3085134927 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4428009510 con 0x7f443015e400 2024-03-30T13:12:06.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.787+0000 7f4435c00640 1 -- 172.21.15.44:0/3085134927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44301f44b0 con 0x7f443015e400 2024-03-30T13:12:06.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.787+0000 7f4435c00640 1 -- 172.21.15.44:0/3085134927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44301f4a70 con 0x7f443015e400 2024-03-30T13:12:06.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.788+0000 7f4435c00640 1 -- 172.21.15.44:0/3085134927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4430075890 con 0x7f443015e400 2024-03-30T13:12:06.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.789+0000 7f4427e00640 1 -- 172.21.15.44:0/3085134927 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4428046020 con 0x7f443015e400 2024-03-30T13:12:06.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.790+0000 7f4427e00640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f440c06c530 0x7f440c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:06.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.790+0000 7f4427e00640 1 -- 172.21.15.44:0/3085134927 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f44280adfe0 con 0x7f443015e400 2024-03-30T13:12:06.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.791+0000 7f442fe00640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f440c06c530 0x7f440c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:06.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.792+0000 7f442fe00640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f440c06c530 0x7f440c06e9f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4420007fd0 tx=0x7f4420009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:06.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:06.794+0000 7f4427e00640 1 -- 172.21.15.44:0/3085134927 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f442804d030 con 0x7f443015e400 2024-03-30T13:12:07.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.042+0000 7f4435c00640 1 -- 172.21.15.44:0/3085134927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f44300d4890 con 0x7f443015e400 2024-03-30T13:12:07.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.203+0000 7f4427e00640 1 -- 172.21.15.44:0/3085134927 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f442803c350 con 0x7f443015e400 2024-03-30T13:12:07.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.206+0000 7f4435c00640 1 -- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f440c06c530 msgr2=0x7f440c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:07.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.206+0000 7f4435c00640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f440c06c530 0x7f440c06e9f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4420007fd0 tx=0x7f4420009040 comp rx=0 tx=0).stop 2024-03-30T13:12:07.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.206+0000 7f4435c00640 1 -- 172.21.15.44:0/3085134927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f443015e400 msgr2=0x7f44300b8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:07.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.206+0000 7f4435c00640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f443015e400 0x7f44300b8f50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4428009e50 tx=0x7f4428004a40 comp rx=0 tx=0).stop 2024-03-30T13:12:07.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.206+0000 7f4435c00640 1 -- 172.21.15.44:0/3085134927 shutdown_connections 2024-03-30T13:12:07.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.206+0000 7f4435c00640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f443015e400 0x7f44300b8f50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.206+0000 7f4435c00640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f440c06c530 0x7f440c06e9f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.206+0000 7f4435c00640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44300d1920 0x7f44300c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.206+0000 7f4435c00640 1 --2- 172.21.15.44:0/3085134927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44300cfea0 0x7f443015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.206+0000 7f4435c00640 1 -- 172.21.15.44:0/3085134927 >> 172.21.15.44:0/3085134927 conn(0x7f443009d4c0 msgr2=0x7f443015e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:07.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.207+0000 7f4435c00640 1 -- 172.21.15.44:0/3085134927 shutdown_connections 2024-03-30T13:12:07.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.207+0000 7f4435c00640 1 -- 172.21.15.44:0/3085134927 wait complete. 2024-03-30T13:12:07.233 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-03-30T13:12:07.233 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-30T13:12:07.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.447+0000 7f3a72a00640 1 Processor -- start 2024-03-30T13:12:07.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.448+0000 7f3a72a00640 1 -- start start 2024-03-30T13:12:07.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.449+0000 7f3a72a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c15da00 0x7f3a6c071890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.449+0000 7f3a72a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a6c0ad690 con 0x7f3a6c0729e0 2024-03-30T13:12:07.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.450+0000 7f3a72a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a6c160120 con 0x7f3a6c15fc20 2024-03-30T13:12:07.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.450+0000 7f3a72a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3a6c160400 con 0x7f3a6c15da00 2024-03-30T13:12:07.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.450+0000 7f3a71600640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3a6c0729e0 0x7f3a6c072dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56748/0 (socket says 172.21.15.44:56748) 2024-03-30T13:12:07.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.450+0000 7f3a71600640 1 -- 172.21.15.44:0/4092535615 learned_addr learned my addr 172.21.15.44:0/4092535615 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.450+0000 7f3a72000640 1 --2- 172.21.15.44:0/4092535615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c15da00 0x7f3a6c071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.450+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1789485486 0 0) 0x7f3a6c0ad690 con 0x7f3a6c0729e0 2024-03-30T13:12:07.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.450+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a54003520 con 0x7f3a6c0729e0 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 167174736 0 0) 0x7f3a54003520 con 0x7f3a6c0729e0 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c15da00 msgr2=0x7f3a6c071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 --2- 172.21.15.44:0/4092535615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c15da00 0x7f3a6c071890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 >> v1:172.21.15.151:6789/0 conn(0x7f3a6c15fc20 legacy=0x7f3a6c0acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6c1606e0 con 0x7f3a6c0729e0 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f3a60001670 con 0x7f3a6c0729e0 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 >> v1:172.21.15.44:6789/0 conn(0x7f3a6c0729e0 legacy=0x7f3a6c072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 --2- 172.21.15.44:0/4092535615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a540039e0 0x7f3a54003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 --2- 172.21.15.44:0/4092535615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c15da00 0x7f3a54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 --2- 172.21.15.44:0/4092535615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a54004d40 0x7f3a540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c160400 con 0x7f3a54004d40 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5400ba70 con 0x7f3a540039e0 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5400bc70 con 0x7f3a6c15da00 2024-03-30T13:12:07.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a72000640 1 --2- 172.21.15.44:0/4092535615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a54004d40 0x7f3a540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.451+0000 7f3a71600640 1 --2- 172.21.15.44:0/4092535615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a540039e0 0x7f3a54003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.452+0000 7f3a70c00640 1 --2- 172.21.15.44:0/4092535615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c15da00 0x7f3a54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.452+0000 7f3a72000640 1 -- 172.21.15.44:0/4092535615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c15da00 msgr2=0x7f3a54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:07.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.452+0000 7f3a72000640 1 --2- 172.21.15.44:0/4092535615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a6c15da00 0x7f3a54004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.452+0000 7f3a72000640 1 -- 172.21.15.44:0/4092535615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a540039e0 msgr2=0x7f3a54003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:07.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.452+0000 7f3a72000640 1 --2- 172.21.15.44:0/4092535615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a540039e0 0x7f3a54003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.452+0000 7f3a72000640 1 -- 172.21.15.44:0/4092535615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a54003520 con 0x7f3a54004d40 2024-03-30T13:12:07.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.453+0000 7f3a72000640 1 --2- 172.21.15.44:0/4092535615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a54004d40 0x7f3a540051c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009f90 tx=0x7f3a54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3473a50a56e2cda3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:07.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.453+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64039070 con 0x7f3a54004d40 2024-03-30T13:12:07.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.453+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6402cbd0 con 0x7f3a54004d40 2024-03-30T13:12:07.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.453+0000 7f3a6be00640 1 -- 172.21.15.44:0/4092535615 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64009c10 con 0x7f3a54004d40 2024-03-30T13:12:07.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.454+0000 7f3a72a00640 1 -- 172.21.15.44:0/4092535615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a54004d40 msgr2=0x7f3a540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:07.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.454+0000 7f3a72a00640 1 --2- 172.21.15.44:0/4092535615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a54004d40 0x7f3a540051c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009f90 tx=0x7f3a54005830 comp rx=0 tx=0).stop 2024-03-30T13:12:07.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.454+0000 7f3a72000640 1 -- 172.21.15.44:0/4092535615 reap_dead start 2024-03-30T13:12:07.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.454+0000 7f3a72a00640 1 -- 172.21.15.44:0/4092535615 shutdown_connections 2024-03-30T13:12:07.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.454+0000 7f3a72a00640 1 -- 172.21.15.44:0/4092535615 >> 172.21.15.44:0/4092535615 conn(0x7f3a6c0cfd60 msgr2=0x7f3a6c0d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:07.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.454+0000 7f3a72a00640 1 -- 172.21.15.44:0/4092535615 shutdown_connections 2024-03-30T13:12:07.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.454+0000 7f3a72a00640 1 -- 172.21.15.44:0/4092535615 wait complete. 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.455+0000 7f3a72a00640 1 Processor -- start 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.456+0000 7f3a72a00640 1 -- start start 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a72a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a54004d40 0x7f3a6c0b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a72a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a6c09aa30 0x7f3a6c0ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a72a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6c09cbe0 0x7f3a6c09d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a72a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c15d4f0 con 0x7f3a6c09aa30 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a72a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6c15d370 con 0x7f3a6c09cbe0 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a72a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3a6c071890 con 0x7f3a54004d40 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a70c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a6c09aa30 0x7f3a6c0ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a70c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a6c09aa30 0x7f3a6c0ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39084/0 (socket says 172.21.15.44:39084) 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a70c00640 1 -- 172.21.15.44:0/3506075494 learned_addr learned my addr 172.21.15.44:0/3506075494 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a71600640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a54004d40 0x7f3a6c0b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a72000640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6c09cbe0 0x7f3a6c09d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a70c00640 1 -- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a54004d40 msgr2=0x7f3a6c0b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:07.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a70c00640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a54004d40 0x7f3a6c0b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a70c00640 1 -- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6c09cbe0 msgr2=0x7f3a6c09d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:07.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a70c00640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6c09cbe0 0x7f3a6c09d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:07.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.457+0000 7f3a70c00640 1 -- 172.21.15.44:0/3506075494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6c09afa0 con 0x7f3a6c09aa30 2024-03-30T13:12:07.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.458+0000 7f3a70c00640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a6c09aa30 0x7f3a6c0ce580 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800d570 tx=0x7f3a5800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:07.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.458+0000 7f3a69600640 1 -- 172.21.15.44:0/3506075494 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58005480 con 0x7f3a6c09aa30 2024-03-30T13:12:07.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.458+0000 7f3a69600640 1 -- 172.21.15.44:0/3506075494 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a58017070 con 0x7f3a6c09aa30 2024-03-30T13:12:07.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.458+0000 7f3a72a00640 1 -- 172.21.15.44:0/3506075494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6c09b280 con 0x7f3a6c09aa30 2024-03-30T13:12:07.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.458+0000 7f3a69600640 1 -- 172.21.15.44:0/3506075494 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58003810 con 0x7f3a6c09aa30 2024-03-30T13:12:07.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.458+0000 7f3a72a00640 1 -- 172.21.15.44:0/3506075494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6c0aed90 con 0x7f3a6c09aa30 2024-03-30T13:12:07.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.459+0000 7f3a72a00640 1 -- 172.21.15.44:0/3506075494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a6c075890 con 0x7f3a6c09aa30 2024-03-30T13:12:07.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.460+0000 7f3a69600640 1 -- 172.21.15.44:0/3506075494 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3a580039b0 con 0x7f3a6c09aa30 2024-03-30T13:12:07.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.462+0000 7f3a69600640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a4c06c530 0x7f3a4c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:07.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.462+0000 7f3a69600640 1 -- 172.21.15.44:0/3506075494 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3a5808b960 con 0x7f3a6c09aa30 2024-03-30T13:12:07.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.462+0000 7f3a71600640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a4c06c530 0x7f3a4c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:07.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.463+0000 7f3a71600640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a4c06c530 0x7f3a4c06e9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a60001eb0 tx=0x7f3a60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:07.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.466+0000 7f3a69600640 1 -- 172.21.15.44:0/3506075494 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3a58059ba0 con 0x7f3a6c09aa30 2024-03-30T13:12:07.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:07.710+0000 7f3a72a00640 1 -- 172.21.15.44:0/3506075494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3a6c0adce0 con 0x7f3a6c09aa30 2024-03-30T13:12:08.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.214+0000 7f3a69600640 1 -- 172.21.15.44:0/3506075494 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f3a580594a0 con 0x7f3a6c09aa30 2024-03-30T13:12:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.218+0000 7f3a72a00640 1 -- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a4c06c530 msgr2=0x7f3a4c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.218+0000 7f3a72a00640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a4c06c530 0x7f3a4c06e9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a60001eb0 tx=0x7f3a60009040 comp rx=0 tx=0).stop 2024-03-30T13:12:08.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.218+0000 7f3a72a00640 1 -- 172.21.15.44:0/3506075494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a6c09aa30 msgr2=0x7f3a6c0ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.218+0000 7f3a72a00640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a6c09aa30 0x7f3a6c0ce580 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800d570 tx=0x7f3a5800da30 comp rx=0 tx=0).stop 2024-03-30T13:12:08.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.218+0000 7f3a72a00640 1 -- 172.21.15.44:0/3506075494 shutdown_connections 2024-03-30T13:12:08.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.218+0000 7f3a72a00640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a4c06c530 0x7f3a4c06e9f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.218+0000 7f3a72a00640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a6c09cbe0 0x7f3a6c09d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.218+0000 7f3a72a00640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a6c09aa30 0x7f3a6c0ce580 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.218+0000 7f3a72a00640 1 --2- 172.21.15.44:0/3506075494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a54004d40 0x7f3a6c0b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.218+0000 7f3a72a00640 1 -- 172.21.15.44:0/3506075494 >> 172.21.15.44:0/3506075494 conn(0x7f3a6c0cfd60 msgr2=0x7f3a6c06e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:08.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.218+0000 7f3a72a00640 1 -- 172.21.15.44:0/3506075494 shutdown_connections 2024-03-30T13:12:08.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.218+0000 7f3a72a00640 1 -- 172.21.15.44:0/3506075494 wait complete. 2024-03-30T13:12:08.244 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-30T13:12:08.244 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:12:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.464+0000 7f9800c00640 1 Processor -- start 2024-03-30T13:12:08.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.465+0000 7f9800c00640 1 -- start start 2024-03-30T13:12:08.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.466+0000 7f9800c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d0d30 0x7f97fc0cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.466+0000 7f9800c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f97fc0d4950 0x7f97fc161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.466+0000 7f9800c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97fc0b5b60 con 0x7f97fc0d1110 2024-03-30T13:12:08.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.466+0000 7f9800c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f97fc0c7b90 con 0x7f97fc0d4950 2024-03-30T13:12:08.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.466+0000 7f9800c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc0d4fc0 con 0x7f97fc0d0d30 2024-03-30T13:12:08.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.467+0000 7f97fbe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f97fc0d1110 0x7f97fc0b3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56750/0 (socket says 172.21.15.44:56750) 2024-03-30T13:12:08.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.467+0000 7f97fbe00640 1 -- 172.21.15.44:0/2525202010 learned_addr learned my addr 172.21.15.44:0/2525202010 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:08.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.467+0000 7f97f2a00640 1 --2- 172.21.15.44:0/2525202010 >> v2:172.21.15.151:3300/0 conn(0x7f97fc0d4950 0x7f97fc161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.467+0000 7f97fb400640 1 --2- 172.21.15.44:0/2525202010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d0d30 0x7f97fc0cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.467+0000 7f97faa00640 1 -- 172.21.15.44:0/2525202010 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609528521 0 0) 0x7f97fc0b5b60 con 0x7f97fc0d1110 2024-03-30T13:12:08.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.467+0000 7f97faa00640 1 -- 172.21.15.44:0/2525202010 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97e0003520 con 0x7f97fc0d1110 2024-03-30T13:12:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.468+0000 7f97f2a00640 1 -- 172.21.15.44:0/2525202010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d0d30 msgr2=0x7f97fc0cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.468+0000 7f97f2a00640 1 --2- 172.21.15.44:0/2525202010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d0d30 0x7f97fc0cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.468+0000 7f97f2a00640 1 -- 172.21.15.44:0/2525202010 >> v1:172.21.15.44:6789/0 conn(0x7f97fc0d1110 legacy=0x7f97fc0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.468+0000 7f97f2a00640 1 -- 172.21.15.44:0/2525202010 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc0b57f0 con 0x7f97fc0d4950 2024-03-30T13:12:08.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.469+0000 7f97f2a00640 1 --2- 172.21.15.44:0/2525202010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d4950 0x7f97fc161760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97e40097a0 tx=0x7f97e402b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5933d68a4fc645a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.470+0000 7f97faa00640 1 -- 172.21.15.44:0/2525202010 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4034070 con 0x7f97fc0d4950 2024-03-30T13:12:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.470+0000 7f97faa00640 1 -- 172.21.15.44:0/2525202010 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e4030800 con 0x7f97fc0d4950 2024-03-30T13:12:08.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.470+0000 7f97faa00640 1 -- 172.21.15.44:0/2525202010 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4030bd0 con 0x7f97fc0d4950 2024-03-30T13:12:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.470+0000 7f9800c00640 1 -- 172.21.15.44:0/2525202010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d4950 msgr2=0x7f97fc161760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.470+0000 7f9800c00640 1 --2- 172.21.15.44:0/2525202010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d4950 0x7f97fc161760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97e40097a0 tx=0x7f97e402b940 comp rx=0 tx=0).stop 2024-03-30T13:12:08.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.470+0000 7f9800c00640 1 -- 172.21.15.44:0/2525202010 shutdown_connections 2024-03-30T13:12:08.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.470+0000 7f9800c00640 1 --2- 172.21.15.44:0/2525202010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d4950 0x7f97fc161760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.470+0000 7f9800c00640 1 --2- 172.21.15.44:0/2525202010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d0d30 0x7f97fc0cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.470+0000 7f9800c00640 1 -- 172.21.15.44:0/2525202010 >> 172.21.15.44:0/2525202010 conn(0x7f97fc09d570 msgr2=0x7f97fc0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:08.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.471+0000 7f9800c00640 1 -- 172.21.15.44:0/2525202010 shutdown_connections 2024-03-30T13:12:08.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.471+0000 7f9800c00640 1 -- 172.21.15.44:0/2525202010 wait complete. 2024-03-30T13:12:08.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.472+0000 7f9800c00640 1 Processor -- start 2024-03-30T13:12:08.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.472+0000 7f9800c00640 1 -- start start 2024-03-30T13:12:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.473+0000 7f9800c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97fc0d0d30 0x7f97fc1e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.473+0000 7f9800c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d1110 0x7f97fc0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.473+0000 7f9800c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d4950 0x7f97fc1f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.473+0000 7f9800c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0b3300 con 0x7f97fc0d0d30 2024-03-30T13:12:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.473+0000 7f9800c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0b3180 con 0x7f97fc0d1110 2024-03-30T13:12:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.473+0000 7f9800c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc0d3150 con 0x7f97fc0d4950 2024-03-30T13:12:08.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.474+0000 7f97fb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97fc0d0d30 0x7f97fc1e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.474+0000 7f97fb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97fc0d0d30 0x7f97fc1e73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39090/0 (socket says 172.21.15.44:39090) 2024-03-30T13:12:08.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.474+0000 7f97fb400640 1 -- 172.21.15.44:0/3999441066 learned_addr learned my addr 172.21.15.44:0/3999441066 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:08.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.474+0000 7f97f2a00640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d1110 0x7f97fc0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.474+0000 7f97fb400640 1 -- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d4950 msgr2=0x7f97fc1f34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.474+0000 7f97fb400640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d4950 0x7f97fc1f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.474+0000 7f97fb400640 1 -- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d1110 msgr2=0x7f97fc0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.474+0000 7f97fb400640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d1110 0x7f97fc0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.474+0000 7f97fb400640 1 -- 172.21.15.44:0/3999441066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc1e7cc0 con 0x7f97fc0d0d30 2024-03-30T13:12:08.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.474+0000 7f97fb400640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97fc0d0d30 0x7f97fc1e73c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00e9e0 tx=0x7f97ec00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:08.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.475+0000 7f97f3e00640 1 -- 172.21.15.44:0/3999441066 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec017070 con 0x7f97fc0d0d30 2024-03-30T13:12:08.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.475+0000 7f97f3e00640 1 -- 172.21.15.44:0/3999441066 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97ec00c9d0 con 0x7f97fc0d0d30 2024-03-30T13:12:08.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.475+0000 7f97f3e00640 1 -- 172.21.15.44:0/3999441066 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00cdc0 con 0x7f97fc0d0d30 2024-03-30T13:12:08.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.475+0000 7f9800c00640 1 -- 172.21.15.44:0/3999441066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc1e7fa0 con 0x7f97fc0d0d30 2024-03-30T13:12:08.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.475+0000 7f9800c00640 1 -- 172.21.15.44:0/3999441066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc1e8560 con 0x7f97fc0d0d30 2024-03-30T13:12:08.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.476+0000 7f9800c00640 1 -- 172.21.15.44:0/3999441066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc0cb0e0 con 0x7f97fc0d0d30 2024-03-30T13:12:08.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.477+0000 7f97f3e00640 1 -- 172.21.15.44:0/3999441066 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f97ec01a070 con 0x7f97fc0d0d30 2024-03-30T13:12:08.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.478+0000 7f97f3e00640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f97d806c530 0x7f97d806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.478+0000 7f97f3e00640 1 -- 172.21.15.44:0/3999441066 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f97ec08be90 con 0x7f97fc0d0d30 2024-03-30T13:12:08.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.479+0000 7f97f2a00640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f97d806c530 0x7f97d806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.480+0000 7f97f2a00640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f97d806c530 0x7f97d806e9f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f97e4036000 tx=0x7f97e403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:08.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.482+0000 7f97f3e00640 1 -- 172.21.15.44:0/3999441066 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f97fc0cb0e0 con 0x7f97fc0d0d30 2024-03-30T13:12:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.729+0000 7f9800c00640 1 -- 172.21.15.44:0/3999441066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97fc06dfd0 con 0x7f97fc0d0d30 2024-03-30T13:12:08.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.730+0000 7f97f3e00640 1 -- 172.21.15.44:0/3999441066 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f97ec05a0d0 con 0x7f97fc0d0d30 2024-03-30T13:12:08.734 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:08.734 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1458748329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1458748329},{"type":"v1","addr":"172.21.15.44:6834","nonce":1458748329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3921281718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3921281718},{"type":"v1","addr":"172.21.15.151:6837","nonce":3921281718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2065829800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2065829800},{"type":"v1","addr":"172.21.15.44:6835","nonce":2065829800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:11:40.531273+0000","modified":"2024-03-30T13:12:07.711287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/456394190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":456394190},{"type":"v1","addr":"172.21.15.151:6835","nonce":456394190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276]},"id":1}]} 2024-03-30T13:12:08.734 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-03-30T13:12:08.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.733+0000 7f9800c00640 1 -- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f97d806c530 msgr2=0x7f97d806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.733+0000 7f9800c00640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f97d806c530 0x7f97d806e9f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f97e4036000 tx=0x7f97e403b040 comp rx=0 tx=0).stop 2024-03-30T13:12:08.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.733+0000 7f9800c00640 1 -- 172.21.15.44:0/3999441066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97fc0d0d30 msgr2=0x7f97fc1e73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.733+0000 7f9800c00640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97fc0d0d30 0x7f97fc1e73c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00e9e0 tx=0x7f97ec00eea0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.733+0000 7f9800c00640 1 -- 172.21.15.44:0/3999441066 shutdown_connections 2024-03-30T13:12:08.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.733+0000 7f9800c00640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97fc0d4950 0x7f97fc1f34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.733+0000 7f9800c00640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f97d806c530 0x7f97d806e9f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.733+0000 7f9800c00640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97fc0d1110 0x7f97fc0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.733+0000 7f9800c00640 1 --2- 172.21.15.44:0/3999441066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97fc0d0d30 0x7f97fc1e73c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.733+0000 7f9800c00640 1 -- 172.21.15.44:0/3999441066 >> 172.21.15.44:0/3999441066 conn(0x7f97fc09d570 msgr2=0x7f97fc0b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:08.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.734+0000 7f9800c00640 1 -- 172.21.15.44:0/3999441066 shutdown_connections 2024-03-30T13:12:08.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.734+0000 7f9800c00640 1 -- 172.21.15.44:0/3999441066 wait complete. 2024-03-30T13:12:08.757 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:08.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.969+0000 7f1ba2e00640 1 Processor -- start 2024-03-30T13:12:08.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.970+0000 7f1ba2e00640 1 -- start start 2024-03-30T13:12:08.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.971+0000 7f1ba2e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1b9c155370 0x7f1b9c162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.971+0000 7f1ba2e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b9c0b2e40 0x7f1b9c0d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.971+0000 7f1ba2e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b9c15ef20 con 0x7f1b9c15e9a0 2024-03-30T13:12:08.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.971+0000 7f1ba2e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f1b9c073060 con 0x7f1b9c155370 2024-03-30T13:12:08.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.971+0000 7f1ba2e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1b9c0af910 con 0x7f1b9c0b2e40 2024-03-30T13:12:08.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.972+0000 7f1ba2400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1b9c15e9a0 0x7f1b9c06d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56764/0 (socket says 172.21.15.44:56764) 2024-03-30T13:12:08.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.972+0000 7f1ba2400640 1 -- 172.21.15.44:0/557032010 learned_addr learned my addr 172.21.15.44:0/557032010 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.972+0000 7f1ba1a00640 1 --2- 172.21.15.44:0/557032010 >> v2:172.21.15.151:3300/0 conn(0x7f1b9c155370 0x7f1b9c162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.972+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1538638774 0 0) 0x7f1b9c15ef20 con 0x7f1b9c15e9a0 2024-03-30T13:12:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.972+0000 7f1ba1000640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b9c0b2e40 0x7f1b9c0d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.972+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b84003520 con 0x7f1b9c15e9a0 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1633863966 0 0) 0x7f1b84003520 con 0x7f1b9c15e9a0 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b9c0b2e40 msgr2=0x7f1b9c0d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b9c0b2e40 0x7f1b9c0d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 >> v2:172.21.15.151:3300/0 conn(0x7f1b9c155370 msgr2=0x7f1b9c162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 --2- 172.21.15.44:0/557032010 >> v2:172.21.15.151:3300/0 conn(0x7f1b9c155370 0x7f1b9c162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9c15f200 con 0x7f1b9c15e9a0 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f1b940019f0 con 0x7f1b9c15e9a0 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1ba1000640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b9c0b2e40 0x7f1b9c0d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 >> v1:172.21.15.44:6789/0 conn(0x7f1b9c15e9a0 legacy=0x7f1b9c06d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b9c0b2e40 0x7f1b840039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b84003ef0 0x7f1b84004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b84004d40 0x7f1b840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c0af910 con 0x7f1b84003ef0 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8400b9c0 con 0x7f1b84004d40 2024-03-30T13:12:08.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8400bb70 con 0x7f1b9c0b2e40 2024-03-30T13:12:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1ba1000640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b84003ef0 0x7f1b84004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1ba1a00640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b9c0b2e40 0x7f1b840039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1ba1000640 1 -- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b9c0b2e40 msgr2=0x7f1b840039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.973+0000 7f1ba1000640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b9c0b2e40 0x7f1b840039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.974+0000 7f1ba1000640 1 -- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b84004d40 msgr2=0x7f1b840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.974+0000 7f1ba2400640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b84004d40 0x7f1b840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.974+0000 7f1ba1000640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b84004d40 0x7f1b840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.974+0000 7f1ba1000640 1 -- 172.21.15.44:0/557032010 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b84003520 con 0x7f1b84003ef0 2024-03-30T13:12:08.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.974+0000 7f1ba2400640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b84004d40 0x7f1b840051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:08.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.975+0000 7f1ba1000640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b84003ef0 0x7f1b84004800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0b3260 tx=0x7f1b84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900e261fe19bc48f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:08.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.975+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88034070 con 0x7f1b84003ef0 2024-03-30T13:12:08.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.975+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b88030400 con 0x7f1b84003ef0 2024-03-30T13:12:08.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.975+0000 7f1b9be00640 1 -- 172.21.15.44:0/557032010 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8800f040 con 0x7f1b84003ef0 2024-03-30T13:12:08.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.976+0000 7f1ba2e00640 1 -- 172.21.15.44:0/557032010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b84003ef0 msgr2=0x7f1b84004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.976+0000 7f1ba2e00640 1 --2- 172.21.15.44:0/557032010 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b84003ef0 0x7f1b84004800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0b3260 tx=0x7f1b84005830 comp rx=0 tx=0).stop 2024-03-30T13:12:08.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.976+0000 7f1ba2400640 1 -- 172.21.15.44:0/557032010 reap_dead start 2024-03-30T13:12:08.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.976+0000 7f1ba2e00640 1 -- 172.21.15.44:0/557032010 shutdown_connections 2024-03-30T13:12:08.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.976+0000 7f1ba2e00640 1 -- 172.21.15.44:0/557032010 >> 172.21.15.44:0/557032010 conn(0x7f1b9c06b9a0 msgr2=0x7f1b9c06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:08.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.976+0000 7f1ba2e00640 1 -- 172.21.15.44:0/557032010 shutdown_connections 2024-03-30T13:12:08.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.976+0000 7f1ba2e00640 1 -- 172.21.15.44:0/557032010 wait complete. 2024-03-30T13:12:08.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.978+0000 7f1ba2e00640 1 Processor -- start 2024-03-30T13:12:08.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.978+0000 7f1ba2e00640 1 -- start start 2024-03-30T13:12:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.979+0000 7f1ba2e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b84003ef0 0x7f1b9c15d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.979+0000 7f1ba2e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b9c1f3da0 0x7f1b9c0ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.979+0000 7f1ba2e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b9c1f4220 0x7f1b9c0b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.979+0000 7f1ba2e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c071530 con 0x7f1b9c1f3da0 2024-03-30T13:12:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.979+0000 7f1ba2e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9c15f7c0 con 0x7f1b9c1f4220 2024-03-30T13:12:08.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.979+0000 7f1ba2e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1b9c155750 con 0x7f1b84003ef0 2024-03-30T13:12:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.979+0000 7f1ba1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b9c1f3da0 0x7f1b9c0ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.979+0000 7f1ba1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b9c1f3da0 0x7f1b9c0ae440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39114/0 (socket says 172.21.15.44:39114) 2024-03-30T13:12:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.979+0000 7f1ba1000640 1 -- 172.21.15.44:0/3984366092 learned_addr learned my addr 172.21.15.44:0/3984366092 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.979+0000 7f1ba1a00640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b84003ef0 0x7f1b9c15d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.979+0000 7f1ba2400640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b9c1f4220 0x7f1b9c0b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.980+0000 7f1ba1000640 1 -- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b84003ef0 msgr2=0x7f1b9c15d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.980+0000 7f1ba1000640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b84003ef0 0x7f1b9c15d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.980+0000 7f1ba1000640 1 -- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b9c1f4220 msgr2=0x7f1b9c0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.980+0000 7f1ba1000640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b9c1f4220 0x7f1b9c0b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.980+0000 7f1ba1000640 1 -- 172.21.15.44:0/3984366092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b9c0b0e80 con 0x7f1b9c1f3da0 2024-03-30T13:12:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.980+0000 7f1ba1a00640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b84003ef0 0x7f1b9c15d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:08.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.980+0000 7f1ba2400640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b9c1f4220 0x7f1b9c0b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:08.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.980+0000 7f1ba1000640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b9c1f3da0 0x7f1b9c0ae440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b880099b0 tx=0x7f1b88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:08.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.980+0000 7f1b99600640 1 -- 172.21.15.44:0/3984366092 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88049070 con 0x7f1b9c1f3da0 2024-03-30T13:12:08.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.981+0000 7f1b99600640 1 -- 172.21.15.44:0/3984366092 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b88039450 con 0x7f1b9c1f3da0 2024-03-30T13:12:08.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.981+0000 7f1b99600640 1 -- 172.21.15.44:0/3984366092 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88034040 con 0x7f1b9c1f3da0 2024-03-30T13:12:08.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.981+0000 7f1ba2e00640 1 -- 172.21.15.44:0/3984366092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b9c0b1160 con 0x7f1b9c1f3da0 2024-03-30T13:12:08.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.981+0000 7f1ba2e00640 1 -- 172.21.15.44:0/3984366092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b9c0b1720 con 0x7f1b9c1f3da0 2024-03-30T13:12:08.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.982+0000 7f1ba2e00640 1 -- 172.21.15.44:0/3984366092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b9c075890 con 0x7f1b9c1f3da0 2024-03-30T13:12:08.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.983+0000 7f1b99600640 1 -- 172.21.15.44:0/3984366092 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1b8804c070 con 0x7f1b9c1f3da0 2024-03-30T13:12:08.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.984+0000 7f1b99600640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b7c06c530 0x7f1b7c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:08.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.984+0000 7f1b99600640 1 -- 172.21.15.44:0/3984366092 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1b880ad2e0 con 0x7f1b9c1f3da0 2024-03-30T13:12:08.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.984+0000 7f1ba1a00640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b7c06c530 0x7f1b7c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:08.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.985+0000 7f1ba1a00640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b7c06c530 0x7f1b7c06e9f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009b50 tx=0x7f1b90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:08.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:08.988+0000 7f1b99600640 1 -- 172.21.15.44:0/3984366092 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1b8807aed0 con 0x7f1b9c1f3da0 2024-03-30T13:12:09.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.202+0000 7f1ba2e00640 1 -- 172.21.15.44:0/3984366092 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b9c0ad9f0 con 0x7f1b9c1f3da0 2024-03-30T13:12:09.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.203+0000 7f1b99600640 1 -- 172.21.15.44:0/3984366092 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7f1b8807f1d0 con 0x7f1b9c1f3da0 2024-03-30T13:12:09.207 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:09.208 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:09.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.206+0000 7f1ba2e00640 1 -- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b7c06c530 msgr2=0x7f1b7c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.206+0000 7f1ba2e00640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b7c06c530 0x7f1b7c06e9f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b90009b50 tx=0x7f1b90008040 comp rx=0 tx=0).stop 2024-03-30T13:12:09.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.206+0000 7f1ba2e00640 1 -- 172.21.15.44:0/3984366092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b9c1f3da0 msgr2=0x7f1b9c0ae440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.206+0000 7f1ba2e00640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b9c1f3da0 0x7f1b9c0ae440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b880099b0 tx=0x7f1b88004730 comp rx=0 tx=0).stop 2024-03-30T13:12:09.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.206+0000 7f1ba2e00640 1 -- 172.21.15.44:0/3984366092 shutdown_connections 2024-03-30T13:12:09.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.206+0000 7f1ba2e00640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b7c06c530 0x7f1b7c06e9f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.206+0000 7f1ba2e00640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b9c1f4220 0x7f1b9c0b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.206+0000 7f1ba2e00640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b9c1f3da0 0x7f1b9c0ae440 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.206+0000 7f1ba2e00640 1 --2- 172.21.15.44:0/3984366092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b84003ef0 0x7f1b9c15d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.206+0000 7f1ba2e00640 1 -- 172.21.15.44:0/3984366092 >> 172.21.15.44:0/3984366092 conn(0x7f1b9c06b9a0 msgr2=0x7f1b9c15dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:09.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.206+0000 7f1ba2e00640 1 -- 172.21.15.44:0/3984366092 shutdown_connections 2024-03-30T13:12:09.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.207+0000 7f1ba2e00640 1 -- 172.21.15.44:0/3984366092 wait complete. 2024-03-30T13:12:09.231 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-30T13:12:09.231 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:12:09.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.442+0000 7f7017e00640 1 Processor -- start 2024-03-30T13:12:09.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.442+0000 7f7017e00640 1 -- start start 2024-03-30T13:12:09.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.444+0000 7f7017e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f70180cf810 0x7f70181566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.444+0000 7f7017e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7018160c20 con 0x7f70180d09a0 2024-03-30T13:12:09.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.444+0000 7f7017e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70181600a0 con 0x7f70181562f0 2024-03-30T13:12:09.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.444+0000 7f7017e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f7018156c10 con 0x7f70180cf810 2024-03-30T13:12:09.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.444+0000 7f700e000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f70180d09a0 0x7f701815ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56766/0 (socket says 172.21.15.44:56766) 2024-03-30T13:12:09.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.444+0000 7f700e000640 1 -- 172.21.15.44:0/2528878510 learned_addr learned my addr 172.21.15.44:0/2528878510 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:09.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.444+0000 7f7017400640 1 --2- 172.21.15.44:0/2528878510 >> v2:172.21.15.151:3300/0 conn(0x7f70180cf810 0x7f70181566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.445+0000 7f7016000640 1 -- 172.21.15.44:0/2528878510 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2173194301 0 0) 0x7f7018160c20 con 0x7f70180d09a0 2024-03-30T13:12:09.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.445+0000 7f7016000640 1 -- 172.21.15.44:0/2528878510 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ffc003520 con 0x7f70180d09a0 2024-03-30T13:12:09.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.445+0000 7f7017400640 1 -- 172.21.15.44:0/2528878510 >> v1:172.21.15.151:6789/0 conn(0x7f70181562f0 legacy=0x7f70180d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.445+0000 7f7017400640 1 -- 172.21.15.44:0/2528878510 >> v1:172.21.15.44:6789/0 conn(0x7f70180d09a0 legacy=0x7f701815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.445+0000 7f7017400640 1 -- 172.21.15.44:0/2528878510 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7018160380 con 0x7f70180cf810 2024-03-30T13:12:09.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.446+0000 7f7017400640 1 --2- 172.21.15.44:0/2528878510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70180cf810 0x7f70181566d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70100097a0 tx=0x7f701002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6f1544f7fea6a09 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:09.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.447+0000 7f7016000640 1 -- 172.21.15.44:0/2528878510 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010035020 con 0x7f70180cf810 2024-03-30T13:12:09.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.447+0000 7f7016000640 1 -- 172.21.15.44:0/2528878510 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7010031830 con 0x7f70180cf810 2024-03-30T13:12:09.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.447+0000 7f7016000640 1 -- 172.21.15.44:0/2528878510 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010031c00 con 0x7f70180cf810 2024-03-30T13:12:09.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.447+0000 7f7017e00640 1 -- 172.21.15.44:0/2528878510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70180cf810 msgr2=0x7f70181566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.447+0000 7f7017e00640 1 --2- 172.21.15.44:0/2528878510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70180cf810 0x7f70181566d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70100097a0 tx=0x7f701002b8d0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.448+0000 7f7017e00640 1 -- 172.21.15.44:0/2528878510 shutdown_connections 2024-03-30T13:12:09.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.448+0000 7f7017e00640 1 --2- 172.21.15.44:0/2528878510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70180cf810 0x7f70181566d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.448+0000 7f7017e00640 1 -- 172.21.15.44:0/2528878510 >> 172.21.15.44:0/2528878510 conn(0x7f701806b9a0 msgr2=0x7f701806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:09.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.448+0000 7f7017e00640 1 -- 172.21.15.44:0/2528878510 shutdown_connections 2024-03-30T13:12:09.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.448+0000 7f7017e00640 1 -- 172.21.15.44:0/2528878510 wait complete. 2024-03-30T13:12:09.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.450+0000 7f7017e00640 1 Processor -- start 2024-03-30T13:12:09.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.450+0000 7f7017e00640 1 -- start start 2024-03-30T13:12:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f7017e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70180cf810 0x7f70180b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f7017e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70180d09a0 0x7f701815d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f7017e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70181562f0 0x7f70181557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f7017e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f70180cca20 con 0x7f70180d09a0 2024-03-30T13:12:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f7017e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7018160940 con 0x7f70180cf810 2024-03-30T13:12:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f7017e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f70180ccba0 con 0x7f70181562f0 2024-03-30T13:12:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f700e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70180d09a0 0x7f701815d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f700e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70180d09a0 0x7f701815d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39124/0 (socket says 172.21.15.44:39124) 2024-03-30T13:12:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f700e000640 1 -- 172.21.15.44:0/635232066 learned_addr learned my addr 172.21.15.44:0/635232066 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f7016a00640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70180cf810 0x7f70180b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f7017400640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70181562f0 0x7f70181557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f700e000640 1 -- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70181562f0 msgr2=0x7f70181557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.451+0000 7f700e000640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70181562f0 0x7f70181557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.452+0000 7f700e000640 1 -- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70180cf810 msgr2=0x7f70180b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.452+0000 7f700e000640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70180cf810 0x7f70180b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.452+0000 7f700e000640 1 -- 172.21.15.44:0/635232066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70180b1140 con 0x7f70180d09a0 2024-03-30T13:12:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.452+0000 7f7016a00640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70180cf810 0x7f70180b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.452+0000 7f700e000640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70180d09a0 0x7f701815d360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f700000c430 tx=0x7f700000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.452+0000 7f700f400640 1 -- 172.21.15.44:0/635232066 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7000017070 con 0x7f70180d09a0 2024-03-30T13:12:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.452+0000 7f700f400640 1 -- 172.21.15.44:0/635232066 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7000005ce0 con 0x7f70180d09a0 2024-03-30T13:12:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.452+0000 7f700f400640 1 -- 172.21.15.44:0/635232066 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70000072f0 con 0x7f70180d09a0 2024-03-30T13:12:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.452+0000 7f7017e00640 1 -- 172.21.15.44:0/635232066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70180b1420 con 0x7f70180d09a0 2024-03-30T13:12:09.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.452+0000 7f7017e00640 1 -- 172.21.15.44:0/635232066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70180b19e0 con 0x7f70180d09a0 2024-03-30T13:12:09.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.453+0000 7f7017e00640 1 -- 172.21.15.44:0/635232066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7018075890 con 0x7f70180d09a0 2024-03-30T13:12:09.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.455+0000 7f700f400640 1 -- 172.21.15.44:0/635232066 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f700001a070 con 0x7f70180d09a0 2024-03-30T13:12:09.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.456+0000 7f700f400640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6ff406c560 0x7f6ff406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:09.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.456+0000 7f700f400640 1 -- 172.21.15.44:0/635232066 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f700008aeb0 con 0x7f70180d09a0 2024-03-30T13:12:09.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.456+0000 7f7016a00640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6ff406c560 0x7f6ff406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:09.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.457+0000 7f7016a00640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6ff406c560 0x7f6ff406ea20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7008001e00 tx=0x7f7008009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:09.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.460+0000 7f700f400640 1 -- 172.21.15.44:0/635232066 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7000059180 con 0x7f70180d09a0 2024-03-30T13:12:09.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.660+0000 7f7017e00640 1 -- 172.21.15.44:0/635232066 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70180714c0 con 0x7f6ff406c560 2024-03-30T13:12:09.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.710+0000 7f700f400640 1 -- 172.21.15.44:0/635232066 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332573 (secure 0 0 0) 0x7f70180714c0 con 0x7f6ff406c560 2024-03-30T13:12:09.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:09.720 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:12:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.716+0000 7f7017e00640 1 -- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6ff406c560 msgr2=0x7f6ff406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.716+0000 7f7017e00640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6ff406c560 0x7f6ff406ea20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7008001e00 tx=0x7f7008009040 comp rx=0 tx=0).stop 2024-03-30T13:12:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.716+0000 7f7017e00640 1 -- 172.21.15.44:0/635232066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70180d09a0 msgr2=0x7f701815d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.716+0000 7f7017e00640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70180d09a0 0x7f701815d360 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f700000c430 tx=0x7f700000c8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.716+0000 7f7017e00640 1 -- 172.21.15.44:0/635232066 shutdown_connections 2024-03-30T13:12:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.716+0000 7f7017e00640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70181562f0 0x7f70181557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.716+0000 7f7017e00640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70180d09a0 0x7f701815d360 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.716+0000 7f7017e00640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6ff406c560 0x7f6ff406ea20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.716+0000 7f7017e00640 1 --2- 172.21.15.44:0/635232066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70180cf810 0x7f70180b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:09.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.716+0000 7f7017e00640 1 -- 172.21.15.44:0/635232066 >> 172.21.15.44:0/635232066 conn(0x7f701806b9a0 msgr2=0x7f70180b4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:09.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.716+0000 7f7017e00640 1 -- 172.21.15.44:0/635232066 shutdown_connections 2024-03-30T13:12:09.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:09.716+0000 7f7017e00640 1 -- 172.21.15.44:0/635232066 wait complete. 2024-03-30T13:12:09.740 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-03-30T13:12:07.957715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219592,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755128,"statfs":{"total":773094113280,"available":772869251072,"internally_reserved":0,"allocated":3514368,"data_stored":2075768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004818"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730687+0000","last_change":"2024-03-30T13:11:40.057283+0000","last_active":"2024-03-30T13:11:46.730687+0000","last_peered":"2024-03-30T13:11:46.730687+0000","last_clean":"2024-03-30T13:11:46.730687+0000","last_became_active":"2024-03-30T13:11:40.056762+0000","last_became_peered":"2024-03-30T13:11:40.056762+0000","last_unstale":"2024-03-30T13:11:46.730687+0000","last_undegraded":"2024-03-30T13:11:46.730687+0000","last_fullsized":"2024-03-30T13:11:46.730687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:40:48.482839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101982+0000","last_change":"2024-03-30T13:11:41.053361+0000","last_active":"2024-03-30T13:11:46.101982+0000","last_peered":"2024-03-30T13:11:46.101982+0000","last_clean":"2024-03-30T13:11:46.101982+0000","last_became_active":"2024-03-30T13:11:41.053113+0000","last_became_peered":"2024-03-30T13:11:41.053113+0000","last_unstale":"2024-03-30T13:11:46.101982+0000","last_undegraded":"2024-03-30T13:11:46.101982+0000","last_fullsized":"2024-03-30T13:11:46.101982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:26:18.201405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099642+0000","last_change":"2024-03-30T13:11:45.128908+0000","last_active":"2024-03-30T13:11:46.099642+0000","last_peered":"2024-03-30T13:11:46.099642+0000","last_clean":"2024-03-30T13:11:46.099642+0000","last_became_active":"2024-03-30T13:11:45.125033+0000","last_became_peered":"2024-03-30T13:11:45.125033+0000","last_unstale":"2024-03-30T13:11:46.099642+0000","last_undegraded":"2024-03-30T13:11:46.099642+0000","last_fullsized":"2024-03-30T13:11:46.099642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:47.578255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102346+0000","last_change":"2024-03-30T13:11:40.061864+0000","last_active":"2024-03-30T13:11:46.102346+0000","last_peered":"2024-03-30T13:11:46.102346+0000","last_clean":"2024-03-30T13:11:46.102346+0000","last_became_active":"2024-03-30T13:11:40.061541+0000","last_became_peered":"2024-03-30T13:11:40.061541+0000","last_unstale":"2024-03-30T13:11:46.102346+0000","last_undegraded":"2024-03-30T13:11:46.102346+0000","last_fullsized":"2024-03-30T13:11:46.102346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:00:09.740838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730387+0000","last_change":"2024-03-30T13:11:41.071991+0000","last_active":"2024-03-30T13:11:46.730387+0000","last_peered":"2024-03-30T13:11:46.730387+0000","last_clean":"2024-03-30T13:11:46.730387+0000","last_became_active":"2024-03-30T13:11:41.068214+0000","last_became_peered":"2024-03-30T13:11:41.068214+0000","last_unstale":"2024-03-30T13:11:46.730387+0000","last_undegraded":"2024-03-30T13:11:46.730387+0000","last_fullsized":"2024-03-30T13:11:46.730387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:07.157771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878229+0000","last_change":"2024-03-30T13:11:45.118196+0000","last_active":"2024-03-30T13:11:46.878229+0000","last_peered":"2024-03-30T13:11:46.878229+0000","last_clean":"2024-03-30T13:11:46.878229+0000","last_became_active":"2024-03-30T13:11:45.117348+0000","last_became_peered":"2024-03-30T13:11:45.117348+0000","last_unstale":"2024-03-30T13:11:46.878229+0000","last_undegraded":"2024-03-30T13:11:46.878229+0000","last_fullsized":"2024-03-30T13:11:46.878229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:33.630135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101841+0000","last_change":"2024-03-30T13:11:40.060593+0000","last_active":"2024-03-30T13:11:46.101841+0000","last_peered":"2024-03-30T13:11:46.101841+0000","last_clean":"2024-03-30T13:11:46.101841+0000","last_became_active":"2024-03-30T13:11:40.060297+0000","last_became_peered":"2024-03-30T13:11:40.060297+0000","last_unstale":"2024-03-30T13:11:46.101841+0000","last_undegraded":"2024-03-30T13:11:46.101841+0000","last_fullsized":"2024-03-30T13:11:46.101841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:26:00.941858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880714+0000","last_change":"2024-03-30T13:11:41.059936+0000","last_active":"2024-03-30T13:11:46.880714+0000","last_peered":"2024-03-30T13:11:46.880714+0000","last_clean":"2024-03-30T13:11:46.880714+0000","last_became_active":"2024-03-30T13:11:41.058955+0000","last_became_peered":"2024-03-30T13:11:41.058955+0000","last_unstale":"2024-03-30T13:11:46.880714+0000","last_undegraded":"2024-03-30T13:11:46.880714+0000","last_fullsized":"2024-03-30T13:11:46.880714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:48:13.158195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878602+0000","last_change":"2024-03-30T13:11:45.122549+0000","last_active":"2024-03-30T13:11:46.878602+0000","last_peered":"2024-03-30T13:11:46.878602+0000","last_clean":"2024-03-30T13:11:46.878602+0000","last_became_active":"2024-03-30T13:11:45.121869+0000","last_became_peered":"2024-03-30T13:11:45.121869+0000","last_unstale":"2024-03-30T13:11:46.878602+0000","last_undegraded":"2024-03-30T13:11:46.878602+0000","last_fullsized":"2024-03-30T13:11:46.878602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:08.813927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101843+0000","last_change":"2024-03-30T13:11:40.064355+0000","last_active":"2024-03-30T13:11:46.101843+0000","last_peered":"2024-03-30T13:11:46.101843+0000","last_clean":"2024-03-30T13:11:46.101843+0000","last_became_active":"2024-03-30T13:11:40.063509+0000","last_became_peered":"2024-03-30T13:11:40.063509+0000","last_unstale":"2024-03-30T13:11:46.101843+0000","last_undegraded":"2024-03-30T13:11:46.101843+0000","last_fullsized":"2024-03-30T13:11:46.101843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:08:08.320399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881004+0000","last_change":"2024-03-30T13:11:41.056587+0000","last_active":"2024-03-30T13:11:46.881004+0000","last_peered":"2024-03-30T13:11:46.881004+0000","last_clean":"2024-03-30T13:11:46.881004+0000","last_became_active":"2024-03-30T13:11:41.055308+0000","last_became_peered":"2024-03-30T13:11:41.055308+0000","last_unstale":"2024-03-30T13:11:46.881004+0000","last_undegraded":"2024-03-30T13:11:46.881004+0000","last_fullsized":"2024-03-30T13:11:46.881004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:05:33.323351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878545+0000","last_change":"2024-03-30T13:11:45.110636+0000","last_active":"2024-03-30T13:11:46.878545+0000","last_peered":"2024-03-30T13:11:46.878545+0000","last_clean":"2024-03-30T13:11:46.878545+0000","last_became_active":"2024-03-30T13:11:45.110148+0000","last_became_peered":"2024-03-30T13:11:45.110148+0000","last_unstale":"2024-03-30T13:11:46.878545+0000","last_undegraded":"2024-03-30T13:11:46.878545+0000","last_fullsized":"2024-03-30T13:11:46.878545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:42:11.094376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103982+0000","last_change":"2024-03-30T13:11:41.060135+0000","last_active":"2024-03-30T13:11:46.103982+0000","last_peered":"2024-03-30T13:11:46.103982+0000","last_clean":"2024-03-30T13:11:46.103982+0000","last_became_active":"2024-03-30T13:11:41.059868+0000","last_became_peered":"2024-03-30T13:11:41.059868+0000","last_unstale":"2024-03-30T13:11:46.103982+0000","last_undegraded":"2024-03-30T13:11:46.103982+0000","last_fullsized":"2024-03-30T13:11:46.103982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:01:39.869927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103046+0000","last_change":"2024-03-30T13:11:40.062596+0000","last_active":"2024-03-30T13:11:46.103046+0000","last_peered":"2024-03-30T13:11:46.103046+0000","last_clean":"2024-03-30T13:11:46.103046+0000","last_became_active":"2024-03-30T13:11:40.061171+0000","last_became_peered":"2024-03-30T13:11:40.061171+0000","last_unstale":"2024-03-30T13:11:46.103046+0000","last_undegraded":"2024-03-30T13:11:46.103046+0000","last_fullsized":"2024-03-30T13:11:46.103046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:36:51.946896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879271+0000","last_change":"2024-03-30T13:11:45.114509+0000","last_active":"2024-03-30T13:11:46.879271+0000","last_peered":"2024-03-30T13:11:46.879271+0000","last_clean":"2024-03-30T13:11:46.879271+0000","last_became_active":"2024-03-30T13:11:45.112300+0000","last_became_peered":"2024-03-30T13:11:45.112300+0000","last_unstale":"2024-03-30T13:11:46.879271+0000","last_undegraded":"2024-03-30T13:11:46.879271+0000","last_fullsized":"2024-03-30T13:11:46.879271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:20.547592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100409+0000","last_change":"2024-03-30T13:11:41.055501+0000","last_active":"2024-03-30T13:11:46.100409+0000","last_peered":"2024-03-30T13:11:46.100409+0000","last_clean":"2024-03-30T13:11:46.100409+0000","last_became_active":"2024-03-30T13:11:41.050140+0000","last_became_peered":"2024-03-30T13:11:41.050140+0000","last_unstale":"2024-03-30T13:11:46.100409+0000","last_undegraded":"2024-03-30T13:11:46.100409+0000","last_fullsized":"2024-03-30T13:11:46.100409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:29.578558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876526+0000","last_change":"2024-03-30T13:11:40.052089+0000","last_active":"2024-03-30T13:11:46.876526+0000","last_peered":"2024-03-30T13:11:46.876526+0000","last_clean":"2024-03-30T13:11:46.876526+0000","last_became_active":"2024-03-30T13:11:40.051812+0000","last_became_peered":"2024-03-30T13:11:40.051812+0000","last_unstale":"2024-03-30T13:11:46.876526+0000","last_undegraded":"2024-03-30T13:11:46.876526+0000","last_fullsized":"2024-03-30T13:11:46.876526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:11:46.050978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878901+0000","last_change":"2024-03-30T13:11:45.121795+0000","last_active":"2024-03-30T13:11:46.878901+0000","last_peered":"2024-03-30T13:11:46.878901+0000","last_clean":"2024-03-30T13:11:46.878901+0000","last_became_active":"2024-03-30T13:11:45.121345+0000","last_became_peered":"2024-03-30T13:11:45.121345+0000","last_unstale":"2024-03-30T13:11:46.878901+0000","last_undegraded":"2024-03-30T13:11:46.878901+0000","last_fullsized":"2024-03-30T13:11:46.878901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:26:22.252982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100364+0000","last_change":"2024-03-30T13:11:41.060945+0000","last_active":"2024-03-30T13:11:46.100364+0000","last_peered":"2024-03-30T13:11:46.100364+0000","last_clean":"2024-03-30T13:11:46.100364+0000","last_became_active":"2024-03-30T13:11:41.060615+0000","last_became_peered":"2024-03-30T13:11:41.060615+0000","last_unstale":"2024-03-30T13:11:46.100364+0000","last_undegraded":"2024-03-30T13:11:46.100364+0000","last_fullsized":"2024-03-30T13:11:46.100364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:05:51.376531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875830+0000","last_change":"2024-03-30T13:11:40.060348+0000","last_active":"2024-03-30T13:11:46.875830+0000","last_peered":"2024-03-30T13:11:46.875830+0000","last_clean":"2024-03-30T13:11:46.875830+0000","last_became_active":"2024-03-30T13:11:40.059848+0000","last_became_peered":"2024-03-30T13:11:40.059848+0000","last_unstale":"2024-03-30T13:11:46.875830+0000","last_undegraded":"2024-03-30T13:11:46.875830+0000","last_fullsized":"2024-03-30T13:11:46.875830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:28:08.352146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876924+0000","last_change":"2024-03-30T13:11:45.116711+0000","last_active":"2024-03-30T13:11:46.876924+0000","last_peered":"2024-03-30T13:11:46.876924+0000","last_clean":"2024-03-30T13:11:46.876924+0000","last_became_active":"2024-03-30T13:11:45.114206+0000","last_became_peered":"2024-03-30T13:11:45.114206+0000","last_unstale":"2024-03-30T13:11:46.876924+0000","last_undegraded":"2024-03-30T13:11:46.876924+0000","last_fullsized":"2024-03-30T13:11:46.876924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:32:28.206719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880010+0000","last_change":"2024-03-30T13:11:41.056070+0000","last_active":"2024-03-30T13:11:46.880010+0000","last_peered":"2024-03-30T13:11:46.880010+0000","last_clean":"2024-03-30T13:11:46.880010+0000","last_became_active":"2024-03-30T13:11:41.053456+0000","last_became_peered":"2024-03-30T13:11:41.053456+0000","last_unstale":"2024-03-30T13:11:46.880010+0000","last_undegraded":"2024-03-30T13:11:46.880010+0000","last_fullsized":"2024-03-30T13:11:46.880010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:16:30.169967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100577+0000","last_change":"2024-03-30T13:11:40.064409+0000","last_active":"2024-03-30T13:11:46.100577+0000","last_peered":"2024-03-30T13:11:46.100577+0000","last_clean":"2024-03-30T13:11:46.100577+0000","last_became_active":"2024-03-30T13:11:40.063354+0000","last_became_peered":"2024-03-30T13:11:40.063354+0000","last_unstale":"2024-03-30T13:11:46.100577+0000","last_undegraded":"2024-03-30T13:11:46.100577+0000","last_fullsized":"2024-03-30T13:11:46.100577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:10:46.181474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879273+0000","last_change":"2024-03-30T13:11:45.121709+0000","last_active":"2024-03-30T13:11:46.879273+0000","last_peered":"2024-03-30T13:11:46.879273+0000","last_clean":"2024-03-30T13:11:46.879273+0000","last_became_active":"2024-03-30T13:11:45.121209+0000","last_became_peered":"2024-03-30T13:11:45.121209+0000","last_unstale":"2024-03-30T13:11:46.879273+0000","last_undegraded":"2024-03-30T13:11:46.879273+0000","last_fullsized":"2024-03-30T13:11:46.879273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:22:00.571371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730831+0000","last_change":"2024-03-30T13:11:41.050382+0000","last_active":"2024-03-30T13:11:46.730831+0000","last_peered":"2024-03-30T13:11:46.730831+0000","last_clean":"2024-03-30T13:11:46.730831+0000","last_became_active":"2024-03-30T13:11:41.050104+0000","last_became_peered":"2024-03-30T13:11:41.050104+0000","last_unstale":"2024-03-30T13:11:46.730831+0000","last_undegraded":"2024-03-30T13:11:46.730831+0000","last_fullsized":"2024-03-30T13:11:46.730831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:42.594649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105935+0000","last_change":"2024-03-30T13:11:40.055011+0000","last_active":"2024-03-30T13:11:46.105935+0000","last_peered":"2024-03-30T13:11:46.105935+0000","last_clean":"2024-03-30T13:11:46.105935+0000","last_became_active":"2024-03-30T13:11:40.054495+0000","last_became_peered":"2024-03-30T13:11:40.054495+0000","last_unstale":"2024-03-30T13:11:46.105935+0000","last_undegraded":"2024-03-30T13:11:46.105935+0000","last_fullsized":"2024-03-30T13:11:46.105935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:10:46.181474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879720+0000","last_change":"2024-03-30T13:11:45.102475+0000","last_active":"2024-03-30T13:11:46.879720+0000","last_peered":"2024-03-30T13:11:46.879720+0000","last_clean":"2024-03-30T13:11:46.879720+0000","last_became_active":"2024-03-30T13:11:45.102062+0000","last_became_peered":"2024-03-30T13:11:45.102062+0000","last_unstale":"2024-03-30T13:11:46.879720+0000","last_undegraded":"2024-03-30T13:11:46.879720+0000","last_fullsized":"2024-03-30T13:11:46.879720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:14:57.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101633+0000","last_change":"2024-03-30T13:11:41.060379+0000","last_active":"2024-03-30T13:11:46.101633+0000","last_peered":"2024-03-30T13:11:46.101633+0000","last_clean":"2024-03-30T13:11:46.101633+0000","last_became_active":"2024-03-30T13:11:41.060173+0000","last_became_peered":"2024-03-30T13:11:41.060173+0000","last_unstale":"2024-03-30T13:11:46.101633+0000","last_undegraded":"2024-03-30T13:11:46.101633+0000","last_fullsized":"2024-03-30T13:11:46.101633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:04.762350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876716+0000","last_change":"2024-03-30T13:11:40.055192+0000","last_active":"2024-03-30T13:11:46.876716+0000","last_peered":"2024-03-30T13:11:46.876716+0000","last_clean":"2024-03-30T13:11:46.876716+0000","last_became_active":"2024-03-30T13:11:40.054791+0000","last_became_peered":"2024-03-30T13:11:40.054791+0000","last_unstale":"2024-03-30T13:11:46.876716+0000","last_undegraded":"2024-03-30T13:11:46.876716+0000","last_fullsized":"2024-03-30T13:11:46.876716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:48.164301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099353+0000","last_change":"2024-03-30T13:11:45.126240+0000","last_active":"2024-03-30T13:11:46.099353+0000","last_peered":"2024-03-30T13:11:46.099353+0000","last_clean":"2024-03-30T13:11:46.099353+0000","last_became_active":"2024-03-30T13:11:45.123879+0000","last_became_peered":"2024-03-30T13:11:45.123879+0000","last_unstale":"2024-03-30T13:11:46.099353+0000","last_undegraded":"2024-03-30T13:11:46.099353+0000","last_fullsized":"2024-03-30T13:11:46.099353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:39.782287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876292+0000","last_change":"2024-03-30T13:11:41.034727+0000","last_active":"2024-03-30T13:11:46.876292+0000","last_peered":"2024-03-30T13:11:46.876292+0000","last_clean":"2024-03-30T13:11:46.876292+0000","last_became_active":"2024-03-30T13:11:41.034082+0000","last_became_peered":"2024-03-30T13:11:41.034082+0000","last_unstale":"2024-03-30T13:11:46.876292+0000","last_undegraded":"2024-03-30T13:11:46.876292+0000","last_fullsized":"2024-03-30T13:11:46.876292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:21.432848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102205+0000","last_change":"2024-03-30T13:11:40.062157+0000","last_active":"2024-03-30T13:11:46.102205+0000","last_peered":"2024-03-30T13:11:46.102205+0000","last_clean":"2024-03-30T13:11:46.102205+0000","last_became_active":"2024-03-30T13:11:40.061803+0000","last_became_peered":"2024-03-30T13:11:40.061803+0000","last_unstale":"2024-03-30T13:11:46.102205+0000","last_undegraded":"2024-03-30T13:11:46.102205+0000","last_fullsized":"2024-03-30T13:11:46.102205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:42.868273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729905+0000","last_change":"2024-03-30T13:11:45.123226+0000","last_active":"2024-03-30T13:11:46.729905+0000","last_peered":"2024-03-30T13:11:46.729905+0000","last_clean":"2024-03-30T13:11:46.729905+0000","last_became_active":"2024-03-30T13:11:45.122718+0000","last_became_peered":"2024-03-30T13:11:45.122718+0000","last_unstale":"2024-03-30T13:11:46.729905+0000","last_undegraded":"2024-03-30T13:11:46.729905+0000","last_fullsized":"2024-03-30T13:11:46.729905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:33:31.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881174+0000","last_change":"2024-03-30T13:11:41.052392+0000","last_active":"2024-03-30T13:11:46.881174+0000","last_peered":"2024-03-30T13:11:46.881174+0000","last_clean":"2024-03-30T13:11:46.881174+0000","last_became_active":"2024-03-30T13:11:41.052060+0000","last_became_peered":"2024-03-30T13:11:41.052060+0000","last_unstale":"2024-03-30T13:11:46.881174+0000","last_undegraded":"2024-03-30T13:11:46.881174+0000","last_fullsized":"2024-03-30T13:11:46.881174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:43.692694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876402+0000","last_change":"2024-03-30T13:11:40.048150+0000","last_active":"2024-03-30T13:11:46.876402+0000","last_peered":"2024-03-30T13:11:46.876402+0000","last_clean":"2024-03-30T13:11:46.876402+0000","last_became_active":"2024-03-30T13:11:40.047850+0000","last_became_peered":"2024-03-30T13:11:40.047850+0000","last_unstale":"2024-03-30T13:11:46.876402+0000","last_undegraded":"2024-03-30T13:11:46.876402+0000","last_fullsized":"2024-03-30T13:11:46.876402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:16:29.155616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876047+0000","last_change":"2024-03-30T13:11:45.113367+0000","last_active":"2024-03-30T13:11:46.876047+0000","last_peered":"2024-03-30T13:11:46.876047+0000","last_clean":"2024-03-30T13:11:46.876047+0000","last_became_active":"2024-03-30T13:11:45.111513+0000","last_became_peered":"2024-03-30T13:11:45.111513+0000","last_unstale":"2024-03-30T13:11:46.876047+0000","last_undegraded":"2024-03-30T13:11:46.876047+0000","last_fullsized":"2024-03-30T13:11:46.876047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:14:57.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878997+0000","last_change":"2024-03-30T13:11:41.056650+0000","last_active":"2024-03-30T13:11:46.878997+0000","last_peered":"2024-03-30T13:11:46.878997+0000","last_clean":"2024-03-30T13:11:46.878997+0000","last_became_active":"2024-03-30T13:11:41.056039+0000","last_became_peered":"2024-03-30T13:11:41.056039+0000","last_unstale":"2024-03-30T13:11:46.878997+0000","last_undegraded":"2024-03-30T13:11:46.878997+0000","last_fullsized":"2024-03-30T13:11:46.878997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:17:03.655789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879619+0000","last_change":"2024-03-30T13:11:40.054357+0000","last_active":"2024-03-30T13:11:46.879619+0000","last_peered":"2024-03-30T13:11:46.879619+0000","last_clean":"2024-03-30T13:11:46.879619+0000","last_became_active":"2024-03-30T13:11:40.054059+0000","last_became_peered":"2024-03-30T13:11:40.054059+0000","last_unstale":"2024-03-30T13:11:46.879619+0000","last_undegraded":"2024-03-30T13:11:46.879619+0000","last_fullsized":"2024-03-30T13:11:46.879619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:49:27.793465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876330+0000","last_change":"2024-03-30T13:11:45.118213+0000","last_active":"2024-03-30T13:11:46.876330+0000","last_peered":"2024-03-30T13:11:46.876330+0000","last_clean":"2024-03-30T13:11:46.876330+0000","last_became_active":"2024-03-30T13:11:45.117767+0000","last_became_peered":"2024-03-30T13:11:45.117767+0000","last_unstale":"2024-03-30T13:11:46.876330+0000","last_undegraded":"2024-03-30T13:11:46.876330+0000","last_fullsized":"2024-03-30T13:11:46.876330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:06:10.320614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875760+0000","last_change":"2024-03-30T13:11:41.034348+0000","last_active":"2024-03-30T13:11:46.875760+0000","last_peered":"2024-03-30T13:11:46.875760+0000","last_clean":"2024-03-30T13:11:46.875760+0000","last_became_active":"2024-03-30T13:11:41.033932+0000","last_became_peered":"2024-03-30T13:11:41.033932+0000","last_unstale":"2024-03-30T13:11:46.875760+0000","last_undegraded":"2024-03-30T13:11:46.875760+0000","last_fullsized":"2024-03-30T13:11:46.875760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:42.594649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876009+0000","last_change":"2024-03-30T13:11:40.051550+0000","last_active":"2024-03-30T13:11:46.876009+0000","last_peered":"2024-03-30T13:11:46.876009+0000","last_clean":"2024-03-30T13:11:46.876009+0000","last_became_active":"2024-03-30T13:11:40.051234+0000","last_became_peered":"2024-03-30T13:11:40.051234+0000","last_unstale":"2024-03-30T13:11:46.876009+0000","last_undegraded":"2024-03-30T13:11:46.876009+0000","last_fullsized":"2024-03-30T13:11:46.876009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:27.119414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877003+0000","last_change":"2024-03-30T13:11:45.119951+0000","last_active":"2024-03-30T13:11:46.877003+0000","last_peered":"2024-03-30T13:11:46.877003+0000","last_clean":"2024-03-30T13:11:46.877003+0000","last_became_active":"2024-03-30T13:11:45.111516+0000","last_became_peered":"2024-03-30T13:11:45.111516+0000","last_unstale":"2024-03-30T13:11:46.877003+0000","last_undegraded":"2024-03-30T13:11:46.877003+0000","last_fullsized":"2024-03-30T13:11:46.877003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:02:40.515040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729368+0000","last_change":"2024-03-30T13:11:41.042344+0000","last_active":"2024-03-30T13:11:46.729368+0000","last_peered":"2024-03-30T13:11:46.729368+0000","last_clean":"2024-03-30T13:11:46.729368+0000","last_became_active":"2024-03-30T13:11:41.042069+0000","last_became_peered":"2024-03-30T13:11:41.042069+0000","last_unstale":"2024-03-30T13:11:46.729368+0000","last_undegraded":"2024-03-30T13:11:46.729368+0000","last_fullsized":"2024-03-30T13:11:46.729368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:58:30.289414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100827+0000","last_change":"2024-03-30T13:11:40.058392+0000","last_active":"2024-03-30T13:11:46.100827+0000","last_peered":"2024-03-30T13:11:46.100827+0000","last_clean":"2024-03-30T13:11:46.100827+0000","last_became_active":"2024-03-30T13:11:40.058061+0000","last_became_peered":"2024-03-30T13:11:40.058061+0000","last_unstale":"2024-03-30T13:11:46.100827+0000","last_undegraded":"2024-03-30T13:11:46.100827+0000","last_fullsized":"2024-03-30T13:11:46.100827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:48.743642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730652+0000","last_change":"2024-03-30T13:11:45.116598+0000","last_active":"2024-03-30T13:11:46.730652+0000","last_peered":"2024-03-30T13:11:46.730652+0000","last_clean":"2024-03-30T13:11:46.730652+0000","last_became_active":"2024-03-30T13:11:45.114214+0000","last_became_peered":"2024-03-30T13:11:45.114214+0000","last_unstale":"2024-03-30T13:11:46.730652+0000","last_undegraded":"2024-03-30T13:11:46.730652+0000","last_fullsized":"2024-03-30T13:11:46.730652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:41.073690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101902+0000","last_change":"2024-03-30T13:11:41.053875+0000","last_active":"2024-03-30T13:11:46.101902+0000","last_peered":"2024-03-30T13:11:46.101902+0000","last_clean":"2024-03-30T13:11:46.101902+0000","last_became_active":"2024-03-30T13:11:41.053564+0000","last_became_peered":"2024-03-30T13:11:41.053564+0000","last_unstale":"2024-03-30T13:11:46.101902+0000","last_undegraded":"2024-03-30T13:11:46.101902+0000","last_fullsized":"2024-03-30T13:11:46.101902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:21.432848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880378+0000","last_change":"2024-03-30T13:11:40.052525+0000","last_active":"2024-03-30T13:11:46.880378+0000","last_peered":"2024-03-30T13:11:46.880378+0000","last_clean":"2024-03-30T13:11:46.880378+0000","last_became_active":"2024-03-30T13:11:40.052228+0000","last_became_peered":"2024-03-30T13:11:40.052228+0000","last_unstale":"2024-03-30T13:11:46.880378+0000","last_undegraded":"2024-03-30T13:11:46.880378+0000","last_fullsized":"2024-03-30T13:11:46.880378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:37:31.772967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101036+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:11:46.101036+0000","last_peered":"2024-03-30T13:11:46.101036+0000","last_clean":"2024-03-30T13:11:46.101036+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:11:46.101036+0000","last_undegraded":"2024-03-30T13:11:46.101036+0000","last_fullsized":"2024-03-30T13:11:46.101036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105800+0000","last_change":"2024-03-30T13:11:45.115266+0000","last_active":"2024-03-30T13:11:46.105800+0000","last_peered":"2024-03-30T13:11:46.105800+0000","last_clean":"2024-03-30T13:11:46.105800+0000","last_became_active":"2024-03-30T13:11:45.114824+0000","last_became_peered":"2024-03-30T13:11:45.114824+0000","last_unstale":"2024-03-30T13:11:46.105800+0000","last_undegraded":"2024-03-30T13:11:46.105800+0000","last_fullsized":"2024-03-30T13:11:46.105800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:18:57.086379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101484+0000","last_change":"2024-03-30T13:11:41.064932+0000","last_active":"2024-03-30T13:11:46.101484+0000","last_peered":"2024-03-30T13:11:46.101484+0000","last_clean":"2024-03-30T13:11:46.101484+0000","last_became_active":"2024-03-30T13:11:41.064572+0000","last_became_peered":"2024-03-30T13:11:41.064572+0000","last_unstale":"2024-03-30T13:11:46.101484+0000","last_undegraded":"2024-03-30T13:11:46.101484+0000","last_fullsized":"2024-03-30T13:11:46.101484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:25:57.230503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876099+0000","last_change":"2024-03-30T13:11:40.053963+0000","last_active":"2024-03-30T13:11:46.876099+0000","last_peered":"2024-03-30T13:11:46.876099+0000","last_clean":"2024-03-30T13:11:46.876099+0000","last_became_active":"2024-03-30T13:11:40.053682+0000","last_became_peered":"2024-03-30T13:11:40.053682+0000","last_unstale":"2024-03-30T13:11:46.876099+0000","last_undegraded":"2024-03-30T13:11:46.876099+0000","last_fullsized":"2024-03-30T13:11:46.876099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:37:31.772967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103831+0000","last_change":"2024-03-30T13:11:45.108253+0000","last_active":"2024-03-30T13:11:46.103831+0000","last_peered":"2024-03-30T13:11:46.103831+0000","last_clean":"2024-03-30T13:11:46.103831+0000","last_became_active":"2024-03-30T13:11:45.107313+0000","last_became_peered":"2024-03-30T13:11:45.107313+0000","last_unstale":"2024-03-30T13:11:46.103831+0000","last_undegraded":"2024-03-30T13:11:46.103831+0000","last_fullsized":"2024-03-30T13:11:46.103831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:05:37.374928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880809+0000","last_change":"2024-03-30T13:11:41.043218+0000","last_active":"2024-03-30T13:11:46.880809+0000","last_peered":"2024-03-30T13:11:46.880809+0000","last_clean":"2024-03-30T13:11:46.880809+0000","last_became_active":"2024-03-30T13:11:41.042943+0000","last_became_peered":"2024-03-30T13:11:41.042943+0000","last_unstale":"2024-03-30T13:11:46.880809+0000","last_undegraded":"2024-03-30T13:11:46.880809+0000","last_fullsized":"2024-03-30T13:11:46.880809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:25:57.230503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876549+0000","last_change":"2024-03-30T13:11:40.053353+0000","last_active":"2024-03-30T13:11:46.876549+0000","last_peered":"2024-03-30T13:11:46.876549+0000","last_clean":"2024-03-30T13:11:46.876549+0000","last_became_active":"2024-03-30T13:11:40.052963+0000","last_became_peered":"2024-03-30T13:11:40.052963+0000","last_unstale":"2024-03-30T13:11:46.876549+0000","last_undegraded":"2024-03-30T13:11:46.876549+0000","last_fullsized":"2024-03-30T13:11:46.876549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:17:02.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729934+0000","last_change":"2024-03-30T13:11:45.121685+0000","last_active":"2024-03-30T13:11:46.729934+0000","last_peered":"2024-03-30T13:11:46.729934+0000","last_clean":"2024-03-30T13:11:46.729934+0000","last_became_active":"2024-03-30T13:11:45.121227+0000","last_became_peered":"2024-03-30T13:11:45.121227+0000","last_unstale":"2024-03-30T13:11:46.729934+0000","last_undegraded":"2024-03-30T13:11:46.729934+0000","last_fullsized":"2024-03-30T13:11:46.729934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:06:10.320614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103743+0000","last_change":"2024-03-30T13:11:41.058714+0000","last_active":"2024-03-30T13:11:46.103743+0000","last_peered":"2024-03-30T13:11:46.103743+0000","last_clean":"2024-03-30T13:11:46.103743+0000","last_became_active":"2024-03-30T13:11:41.058349+0000","last_became_peered":"2024-03-30T13:11:41.058349+0000","last_unstale":"2024-03-30T13:11:46.103743+0000","last_undegraded":"2024-03-30T13:11:46.103743+0000","last_fullsized":"2024-03-30T13:11:46.103743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:11:57.137995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875850+0000","last_change":"2024-03-30T13:11:40.062027+0000","last_active":"2024-03-30T13:11:46.875850+0000","last_peered":"2024-03-30T13:11:46.875850+0000","last_clean":"2024-03-30T13:11:46.875850+0000","last_became_active":"2024-03-30T13:11:40.060193+0000","last_became_peered":"2024-03-30T13:11:40.060193+0000","last_unstale":"2024-03-30T13:11:46.875850+0000","last_undegraded":"2024-03-30T13:11:46.875850+0000","last_fullsized":"2024-03-30T13:11:46.875850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:06.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877217+0000","last_change":"2024-03-30T13:11:45.104166+0000","last_active":"2024-03-30T13:11:46.877217+0000","last_peered":"2024-03-30T13:11:46.877217+0000","last_clean":"2024-03-30T13:11:46.877217+0000","last_became_active":"2024-03-30T13:11:45.103571+0000","last_became_peered":"2024-03-30T13:11:45.103571+0000","last_unstale":"2024-03-30T13:11:46.877217+0000","last_undegraded":"2024-03-30T13:11:46.877217+0000","last_fullsized":"2024-03-30T13:11:46.877217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:01:25.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103495+0000","last_change":"2024-03-30T13:11:41.052693+0000","last_active":"2024-03-30T13:11:46.103495+0000","last_peered":"2024-03-30T13:11:46.103495+0000","last_clean":"2024-03-30T13:11:46.103495+0000","last_became_active":"2024-03-30T13:11:41.052258+0000","last_became_peered":"2024-03-30T13:11:41.052258+0000","last_unstale":"2024-03-30T13:11:46.103495+0000","last_undegraded":"2024-03-30T13:11:46.103495+0000","last_fullsized":"2024-03-30T13:11:46.103495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:44:44.472713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879516+0000","last_change":"2024-03-30T13:11:40.046274+0000","last_active":"2024-03-30T13:11:46.879516+0000","last_peered":"2024-03-30T13:11:46.879516+0000","last_clean":"2024-03-30T13:11:46.879516+0000","last_became_active":"2024-03-30T13:11:40.045844+0000","last_became_peered":"2024-03-30T13:11:40.045844+0000","last_unstale":"2024-03-30T13:11:46.879516+0000","last_undegraded":"2024-03-30T13:11:46.879516+0000","last_fullsized":"2024-03-30T13:11:46.879516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:45:28.760784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878179+0000","last_change":"2024-03-30T13:11:45.113899+0000","last_active":"2024-03-30T13:11:46.878179+0000","last_peered":"2024-03-30T13:11:46.878179+0000","last_clean":"2024-03-30T13:11:46.878179+0000","last_became_active":"2024-03-30T13:11:45.113423+0000","last_became_peered":"2024-03-30T13:11:45.113423+0000","last_unstale":"2024-03-30T13:11:46.878179+0000","last_undegraded":"2024-03-30T13:11:46.878179+0000","last_fullsized":"2024-03-30T13:11:46.878179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:25.484425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101335+0000","last_change":"2024-03-30T13:11:41.061174+0000","last_active":"2024-03-30T13:11:46.101335+0000","last_peered":"2024-03-30T13:11:46.101335+0000","last_clean":"2024-03-30T13:11:46.101335+0000","last_became_active":"2024-03-30T13:11:41.053574+0000","last_became_peered":"2024-03-30T13:11:41.053574+0000","last_unstale":"2024-03-30T13:11:46.101335+0000","last_undegraded":"2024-03-30T13:11:46.101335+0000","last_fullsized":"2024-03-30T13:11:46.101335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:07:32.828569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875924+0000","last_change":"2024-03-30T13:11:40.049492+0000","last_active":"2024-03-30T13:11:46.875924+0000","last_peered":"2024-03-30T13:11:46.875924+0000","last_clean":"2024-03-30T13:11:46.875924+0000","last_became_active":"2024-03-30T13:11:40.049222+0000","last_became_peered":"2024-03-30T13:11:40.049222+0000","last_unstale":"2024-03-30T13:11:46.875924+0000","last_undegraded":"2024-03-30T13:11:46.875924+0000","last_fullsized":"2024-03-30T13:11:46.875924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:01:57.621288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730403+0000","last_change":"2024-03-30T13:11:45.118519+0000","last_active":"2024-03-30T13:11:46.730403+0000","last_peered":"2024-03-30T13:11:46.730403+0000","last_clean":"2024-03-30T13:11:46.730403+0000","last_became_active":"2024-03-30T13:11:45.118028+0000","last_became_peered":"2024-03-30T13:11:45.118028+0000","last_unstale":"2024-03-30T13:11:46.730403+0000","last_undegraded":"2024-03-30T13:11:46.730403+0000","last_fullsized":"2024-03-30T13:11:46.730403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:02:40.515040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102577+0000","last_change":"2024-03-30T13:11:41.049512+0000","last_active":"2024-03-30T13:11:46.102577+0000","last_peered":"2024-03-30T13:11:46.102577+0000","last_clean":"2024-03-30T13:11:46.102577+0000","last_became_active":"2024-03-30T13:11:41.047719+0000","last_became_peered":"2024-03-30T13:11:41.047719+0000","last_unstale":"2024-03-30T13:11:46.102577+0000","last_undegraded":"2024-03-30T13:11:46.102577+0000","last_fullsized":"2024-03-30T13:11:46.102577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:59.232981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103016+0000","last_change":"2024-03-30T13:11:40.060417+0000","last_active":"2024-03-30T13:11:46.103016+0000","last_peered":"2024-03-30T13:11:46.103016+0000","last_clean":"2024-03-30T13:11:46.103016+0000","last_became_active":"2024-03-30T13:11:40.058616+0000","last_became_peered":"2024-03-30T13:11:40.058616+0000","last_unstale":"2024-03-30T13:11:46.103016+0000","last_undegraded":"2024-03-30T13:11:46.103016+0000","last_fullsized":"2024-03-30T13:11:46.103016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:37:31.772967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101575+0000","last_change":"2024-03-30T13:11:45.129654+0000","last_active":"2024-03-30T13:11:46.101575+0000","last_peered":"2024-03-30T13:11:46.101575+0000","last_clean":"2024-03-30T13:11:46.101575+0000","last_became_active":"2024-03-30T13:11:45.129190+0000","last_became_peered":"2024-03-30T13:11:45.129190+0000","last_unstale":"2024-03-30T13:11:46.101575+0000","last_undegraded":"2024-03-30T13:11:46.101575+0000","last_fullsized":"2024-03-30T13:11:46.101575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:23.412062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101634+0000","last_change":"2024-03-30T13:11:41.059626+0000","last_active":"2024-03-30T13:11:46.101634+0000","last_peered":"2024-03-30T13:11:46.101634+0000","last_clean":"2024-03-30T13:11:46.101634+0000","last_became_active":"2024-03-30T13:11:41.058446+0000","last_became_peered":"2024-03-30T13:11:41.058446+0000","last_unstale":"2024-03-30T13:11:46.101634+0000","last_undegraded":"2024-03-30T13:11:46.101634+0000","last_fullsized":"2024-03-30T13:11:46.101634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:43.692694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879362+0000","last_change":"2024-03-30T13:11:40.064935+0000","last_active":"2024-03-30T13:11:46.879362+0000","last_peered":"2024-03-30T13:11:46.879362+0000","last_clean":"2024-03-30T13:11:46.879362+0000","last_became_active":"2024-03-30T13:11:40.062970+0000","last_became_peered":"2024-03-30T13:11:40.062970+0000","last_unstale":"2024-03-30T13:11:46.879362+0000","last_undegraded":"2024-03-30T13:11:46.879362+0000","last_fullsized":"2024-03-30T13:11:46.879362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:06.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101509+0000","last_change":"2024-03-30T13:11:45.130017+0000","last_active":"2024-03-30T13:11:46.101509+0000","last_peered":"2024-03-30T13:11:46.101509+0000","last_clean":"2024-03-30T13:11:46.101509+0000","last_became_active":"2024-03-30T13:11:45.129637+0000","last_became_peered":"2024-03-30T13:11:45.129637+0000","last_unstale":"2024-03-30T13:11:46.101509+0000","last_undegraded":"2024-03-30T13:11:46.101509+0000","last_fullsized":"2024-03-30T13:11:46.101509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:08:11.231971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730113+0000","last_change":"2024-03-30T13:11:41.046195+0000","last_active":"2024-03-30T13:11:46.730113+0000","last_peered":"2024-03-30T13:11:46.730113+0000","last_clean":"2024-03-30T13:11:46.730113+0000","last_became_active":"2024-03-30T13:11:41.045855+0000","last_became_peered":"2024-03-30T13:11:41.045855+0000","last_unstale":"2024-03-30T13:11:46.730113+0000","last_undegraded":"2024-03-30T13:11:46.730113+0000","last_fullsized":"2024-03-30T13:11:46.730113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:05:51.376531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730149+0000","last_change":"2024-03-30T13:11:40.055328+0000","last_active":"2024-03-30T13:11:46.730149+0000","last_peered":"2024-03-30T13:11:46.730149+0000","last_clean":"2024-03-30T13:11:46.730149+0000","last_became_active":"2024-03-30T13:11:40.054442+0000","last_became_peered":"2024-03-30T13:11:40.054442+0000","last_unstale":"2024-03-30T13:11:46.730149+0000","last_undegraded":"2024-03-30T13:11:46.730149+0000","last_fullsized":"2024-03-30T13:11:46.730149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:09.731487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881262+0000","last_change":"2024-03-30T13:11:45.111331+0000","last_active":"2024-03-30T13:11:46.881262+0000","last_peered":"2024-03-30T13:11:46.881262+0000","last_clean":"2024-03-30T13:11:46.881262+0000","last_became_active":"2024-03-30T13:11:45.110867+0000","last_became_peered":"2024-03-30T13:11:45.110867+0000","last_unstale":"2024-03-30T13:11:46.881262+0000","last_undegraded":"2024-03-30T13:11:46.881262+0000","last_fullsized":"2024-03-30T13:11:46.881262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:11:08.383284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101293+0000","last_change":"2024-03-30T13:11:41.050261+0000","last_active":"2024-03-30T13:11:46.101293+0000","last_peered":"2024-03-30T13:11:46.101293+0000","last_clean":"2024-03-30T13:11:46.101293+0000","last_became_active":"2024-03-30T13:11:41.049994+0000","last_became_peered":"2024-03-30T13:11:41.049994+0000","last_unstale":"2024-03-30T13:11:46.101293+0000","last_undegraded":"2024-03-30T13:11:46.101293+0000","last_fullsized":"2024-03-30T13:11:46.101293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:05:33.323351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:59.441353+0000","last_change":"2024-03-30T13:11:40.056699+0000","last_active":"2024-03-30T13:11:59.441353+0000","last_peered":"2024-03-30T13:11:59.441353+0000","last_clean":"2024-03-30T13:11:59.441353+0000","last_became_active":"2024-03-30T13:11:40.056278+0000","last_became_peered":"2024-03-30T13:11:40.056278+0000","last_unstale":"2024-03-30T13:11:59.441353+0000","last_undegraded":"2024-03-30T13:11:59.441353+0000","last_fullsized":"2024-03-30T13:11:59.441353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:06.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876228+0000","last_change":"2024-03-30T13:11:45.123273+0000","last_active":"2024-03-30T13:11:46.876228+0000","last_peered":"2024-03-30T13:11:46.876228+0000","last_clean":"2024-03-30T13:11:46.876228+0000","last_became_active":"2024-03-30T13:11:45.121491+0000","last_became_peered":"2024-03-30T13:11:45.121491+0000","last_unstale":"2024-03-30T13:11:46.876228+0000","last_undegraded":"2024-03-30T13:11:46.876228+0000","last_fullsized":"2024-03-30T13:11:46.876228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:33:31.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879397+0000","last_change":"2024-03-30T13:11:41.057070+0000","last_active":"2024-03-30T13:11:46.879397+0000","last_peered":"2024-03-30T13:11:46.879397+0000","last_clean":"2024-03-30T13:11:46.879397+0000","last_became_active":"2024-03-30T13:11:41.056836+0000","last_became_peered":"2024-03-30T13:11:41.056836+0000","last_unstale":"2024-03-30T13:11:46.879397+0000","last_undegraded":"2024-03-30T13:11:46.879397+0000","last_fullsized":"2024-03-30T13:11:46.879397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:28:09.366496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876480+0000","last_change":"2024-03-30T13:11:40.055926+0000","last_active":"2024-03-30T13:11:46.876480+0000","last_peered":"2024-03-30T13:11:46.876480+0000","last_clean":"2024-03-30T13:11:46.876480+0000","last_became_active":"2024-03-30T13:11:40.053853+0000","last_became_peered":"2024-03-30T13:11:40.053853+0000","last_unstale":"2024-03-30T13:11:46.876480+0000","last_undegraded":"2024-03-30T13:11:46.876480+0000","last_fullsized":"2024-03-30T13:11:46.876480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:12.149576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878894+0000","last_change":"2024-03-30T13:11:45.122152+0000","last_active":"2024-03-30T13:11:46.878894+0000","last_peered":"2024-03-30T13:11:46.878894+0000","last_clean":"2024-03-30T13:11:46.878894+0000","last_became_active":"2024-03-30T13:11:45.121264+0000","last_became_peered":"2024-03-30T13:11:45.121264+0000","last_unstale":"2024-03-30T13:11:46.878894+0000","last_undegraded":"2024-03-30T13:11:46.878894+0000","last_fullsized":"2024-03-30T13:11:46.878894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:59:33.643606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730553+0000","last_change":"2024-03-30T13:11:41.068464+0000","last_active":"2024-03-30T13:11:46.730553+0000","last_peered":"2024-03-30T13:11:46.730553+0000","last_clean":"2024-03-30T13:11:46.730553+0000","last_became_active":"2024-03-30T13:11:41.068061+0000","last_became_peered":"2024-03-30T13:11:41.068061+0000","last_unstale":"2024-03-30T13:11:46.730553+0000","last_undegraded":"2024-03-30T13:11:46.730553+0000","last_fullsized":"2024-03-30T13:11:46.730553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:55.484149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881041+0000","last_change":"2024-03-30T13:11:40.062612+0000","last_active":"2024-03-30T13:11:46.881041+0000","last_peered":"2024-03-30T13:11:46.881041+0000","last_clean":"2024-03-30T13:11:46.881041+0000","last_became_active":"2024-03-30T13:11:40.061971+0000","last_became_peered":"2024-03-30T13:11:40.061971+0000","last_unstale":"2024-03-30T13:11:46.881041+0000","last_undegraded":"2024-03-30T13:11:46.881041+0000","last_fullsized":"2024-03-30T13:11:46.881041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:10:46.181474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099913+0000","last_change":"2024-03-30T13:11:45.114995+0000","last_active":"2024-03-30T13:11:46.099913+0000","last_peered":"2024-03-30T13:11:46.099913+0000","last_clean":"2024-03-30T13:11:46.099913+0000","last_became_active":"2024-03-30T13:11:45.114482+0000","last_became_peered":"2024-03-30T13:11:45.114482+0000","last_unstale":"2024-03-30T13:11:46.099913+0000","last_undegraded":"2024-03-30T13:11:46.099913+0000","last_fullsized":"2024-03-30T13:11:46.099913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:29.950161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880748+0000","last_change":"2024-03-30T13:11:41.042685+0000","last_active":"2024-03-30T13:11:46.880748+0000","last_peered":"2024-03-30T13:11:46.880748+0000","last_clean":"2024-03-30T13:11:46.880748+0000","last_became_active":"2024-03-30T13:11:41.042404+0000","last_became_peered":"2024-03-30T13:11:41.042404+0000","last_unstale":"2024-03-30T13:11:46.880748+0000","last_undegraded":"2024-03-30T13:11:46.880748+0000","last_fullsized":"2024-03-30T13:11:46.880748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:18:53.034802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105469+0000","last_change":"2024-03-30T13:11:40.052419+0000","last_active":"2024-03-30T13:11:46.105469+0000","last_peered":"2024-03-30T13:11:46.105469+0000","last_clean":"2024-03-30T13:11:46.105469+0000","last_became_active":"2024-03-30T13:11:40.052072+0000","last_became_peered":"2024-03-30T13:11:40.052072+0000","last_unstale":"2024-03-30T13:11:46.105469+0000","last_undegraded":"2024-03-30T13:11:46.105469+0000","last_fullsized":"2024-03-30T13:11:46.105469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:49:27.793465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099771+0000","last_change":"2024-03-30T13:11:45.125449+0000","last_active":"2024-03-30T13:11:46.099771+0000","last_peered":"2024-03-30T13:11:46.099771+0000","last_clean":"2024-03-30T13:11:46.099771+0000","last_became_active":"2024-03-30T13:11:45.115932+0000","last_became_peered":"2024-03-30T13:11:45.115932+0000","last_unstale":"2024-03-30T13:11:46.099771+0000","last_undegraded":"2024-03-30T13:11:46.099771+0000","last_fullsized":"2024-03-30T13:11:46.099771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:20:14.235523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729971+0000","last_change":"2024-03-30T13:11:45.116967+0000","last_active":"2024-03-30T13:11:46.729971+0000","last_peered":"2024-03-30T13:11:46.729971+0000","last_clean":"2024-03-30T13:11:46.729971+0000","last_became_active":"2024-03-30T13:11:45.116228+0000","last_became_peered":"2024-03-30T13:11:45.116228+0000","last_unstale":"2024-03-30T13:11:46.729971+0000","last_undegraded":"2024-03-30T13:11:46.729971+0000","last_fullsized":"2024-03-30T13:11:46.729971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:32:28.206719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875605+0000","last_change":"2024-03-30T13:11:41.049464+0000","last_active":"2024-03-30T13:11:46.875605+0000","last_peered":"2024-03-30T13:11:46.875605+0000","last_clean":"2024-03-30T13:11:46.875605+0000","last_became_active":"2024-03-30T13:11:41.048486+0000","last_became_peered":"2024-03-30T13:11:41.048486+0000","last_unstale":"2024-03-30T13:11:46.875605+0000","last_undegraded":"2024-03-30T13:11:46.875605+0000","last_fullsized":"2024-03-30T13:11:46.875605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:55.484149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877383+0000","last_change":"2024-03-30T13:11:40.053490+0000","last_active":"2024-03-30T13:11:46.877383+0000","last_peered":"2024-03-30T13:11:46.877383+0000","last_clean":"2024-03-30T13:11:46.877383+0000","last_became_active":"2024-03-30T13:11:40.053256+0000","last_became_peered":"2024-03-30T13:11:40.053256+0000","last_unstale":"2024-03-30T13:11:46.877383+0000","last_undegraded":"2024-03-30T13:11:46.877383+0000","last_fullsized":"2024-03-30T13:11:46.877383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:27.119414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105172+0000","last_change":"2024-03-30T13:11:45.108563+0000","last_active":"2024-03-30T13:11:46.105172+0000","last_peered":"2024-03-30T13:11:46.105172+0000","last_clean":"2024-03-30T13:11:46.105172+0000","last_became_active":"2024-03-30T13:11:45.108155+0000","last_became_peered":"2024-03-30T13:11:45.108155+0000","last_unstale":"2024-03-30T13:11:46.105172+0000","last_undegraded":"2024-03-30T13:11:46.105172+0000","last_fullsized":"2024-03-30T13:11:46.105172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:26:01.282080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100080+0000","last_change":"2024-03-30T13:11:41.067378+0000","last_active":"2024-03-30T13:11:46.100080+0000","last_peered":"2024-03-30T13:11:46.100080+0000","last_clean":"2024-03-30T13:11:46.100080+0000","last_became_active":"2024-03-30T13:11:41.067068+0000","last_became_peered":"2024-03-30T13:11:41.067068+0000","last_unstale":"2024-03-30T13:11:46.100080+0000","last_undegraded":"2024-03-30T13:11:46.100080+0000","last_fullsized":"2024-03-30T13:11:46.100080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:42.594649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100702+0000","last_change":"2024-03-30T13:11:40.057479+0000","last_active":"2024-03-30T13:11:46.100702+0000","last_peered":"2024-03-30T13:11:46.100702+0000","last_clean":"2024-03-30T13:11:46.100702+0000","last_became_active":"2024-03-30T13:11:40.057191+0000","last_became_peered":"2024-03-30T13:11:40.057191+0000","last_unstale":"2024-03-30T13:11:46.100702+0000","last_undegraded":"2024-03-30T13:11:46.100702+0000","last_fullsized":"2024-03-30T13:11:46.100702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:40:48.482839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.104472+0000","last_change":"2024-03-30T13:11:40.059886+0000","last_active":"2024-03-30T13:11:46.104472+0000","last_peered":"2024-03-30T13:11:46.104472+0000","last_clean":"2024-03-30T13:11:46.104472+0000","last_became_active":"2024-03-30T13:11:40.058788+0000","last_became_peered":"2024-03-30T13:11:40.058788+0000","last_unstale":"2024-03-30T13:11:46.104472+0000","last_undegraded":"2024-03-30T13:11:46.104472+0000","last_fullsized":"2024-03-30T13:11:46.104472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:27.119414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730038+0000","last_change":"2024-03-30T13:11:41.061750+0000","last_active":"2024-03-30T13:11:46.730038+0000","last_peered":"2024-03-30T13:11:46.730038+0000","last_clean":"2024-03-30T13:11:46.730038+0000","last_became_active":"2024-03-30T13:11:41.061360+0000","last_became_peered":"2024-03-30T13:11:41.061360+0000","last_unstale":"2024-03-30T13:11:46.730038+0000","last_undegraded":"2024-03-30T13:11:46.730038+0000","last_fullsized":"2024-03-30T13:11:46.730038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:42:07.042799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875906+0000","last_change":"2024-03-30T13:11:45.121807+0000","last_active":"2024-03-30T13:11:46.875906+0000","last_peered":"2024-03-30T13:11:46.875906+0000","last_clean":"2024-03-30T13:11:46.875906+0000","last_became_active":"2024-03-30T13:11:45.121296+0000","last_became_peered":"2024-03-30T13:11:45.121296+0000","last_unstale":"2024-03-30T13:11:46.875906+0000","last_undegraded":"2024-03-30T13:11:46.875906+0000","last_fullsized":"2024-03-30T13:11:46.875906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:47.934200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101407+0000","last_change":"2024-03-30T13:11:40.061323+0000","last_active":"2024-03-30T13:11:46.101407+0000","last_peered":"2024-03-30T13:11:46.101407+0000","last_clean":"2024-03-30T13:11:46.101407+0000","last_became_active":"2024-03-30T13:11:40.059857+0000","last_became_peered":"2024-03-30T13:11:40.059857+0000","last_unstale":"2024-03-30T13:11:46.101407+0000","last_undegraded":"2024-03-30T13:11:46.101407+0000","last_fullsized":"2024-03-30T13:11:46.101407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:57:50.563331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878627+0000","last_change":"2024-03-30T13:11:41.059805+0000","last_active":"2024-03-30T13:11:46.878627+0000","last_peered":"2024-03-30T13:11:46.878627+0000","last_clean":"2024-03-30T13:11:46.878627+0000","last_became_active":"2024-03-30T13:11:41.058849+0000","last_became_peered":"2024-03-30T13:11:41.058849+0000","last_unstale":"2024-03-30T13:11:46.878627+0000","last_undegraded":"2024-03-30T13:11:46.878627+0000","last_fullsized":"2024-03-30T13:11:46.878627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:13.163926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102772+0000","last_change":"2024-03-30T13:11:45.130314+0000","last_active":"2024-03-30T13:11:46.102772+0000","last_peered":"2024-03-30T13:11:46.102772+0000","last_clean":"2024-03-30T13:11:46.102772+0000","last_became_active":"2024-03-30T13:11:45.129546+0000","last_became_peered":"2024-03-30T13:11:45.129546+0000","last_unstale":"2024-03-30T13:11:46.102772+0000","last_undegraded":"2024-03-30T13:11:46.102772+0000","last_fullsized":"2024-03-30T13:11:46.102772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:59.314585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102194+0000","last_change":"2024-03-30T13:11:41.057474+0000","last_active":"2024-03-30T13:11:46.102194+0000","last_peered":"2024-03-30T13:11:46.102194+0000","last_clean":"2024-03-30T13:11:46.102194+0000","last_became_active":"2024-03-30T13:11:41.057248+0000","last_became_peered":"2024-03-30T13:11:41.057248+0000","last_unstale":"2024-03-30T13:11:46.102194+0000","last_undegraded":"2024-03-30T13:11:46.102194+0000","last_fullsized":"2024-03-30T13:11:46.102194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:19:21.066570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876002+0000","last_change":"2024-03-30T13:11:41.044974+0000","last_active":"2024-03-30T13:11:46.876002+0000","last_peered":"2024-03-30T13:11:46.876002+0000","last_clean":"2024-03-30T13:11:46.876002+0000","last_became_active":"2024-03-30T13:11:41.044110+0000","last_became_peered":"2024-03-30T13:11:41.044110+0000","last_unstale":"2024-03-30T13:11:46.876002+0000","last_undegraded":"2024-03-30T13:11:46.876002+0000","last_fullsized":"2024-03-30T13:11:46.876002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:49.757992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880445+0000","last_change":"2024-03-30T13:11:41.051210+0000","last_active":"2024-03-30T13:11:46.880445+0000","last_peered":"2024-03-30T13:11:46.880445+0000","last_clean":"2024-03-30T13:11:46.880445+0000","last_became_active":"2024-03-30T13:11:41.050902+0000","last_became_peered":"2024-03-30T13:11:41.050902+0000","last_unstale":"2024-03-30T13:11:46.880445+0000","last_undegraded":"2024-03-30T13:11:46.880445+0000","last_fullsized":"2024-03-30T13:11:46.880445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:44:44.472713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730069+0000","last_change":"2024-03-30T13:11:41.056828+0000","last_active":"2024-03-30T13:11:46.730069+0000","last_peered":"2024-03-30T13:11:46.730069+0000","last_clean":"2024-03-30T13:11:46.730069+0000","last_became_active":"2024-03-30T13:11:41.055447+0000","last_became_peered":"2024-03-30T13:11:41.055447+0000","last_unstale":"2024-03-30T13:11:46.730069+0000","last_undegraded":"2024-03-30T13:11:46.730069+0000","last_fullsized":"2024-03-30T13:11:46.730069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:29.578558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101808+0000","last_change":"2024-03-30T13:11:41.062703+0000","last_active":"2024-03-30T13:11:46.101808+0000","last_peered":"2024-03-30T13:11:46.101808+0000","last_clean":"2024-03-30T13:11:46.101808+0000","last_became_active":"2024-03-30T13:11:41.062375+0000","last_became_peered":"2024-03-30T13:11:41.062375+0000","last_unstale":"2024-03-30T13:11:46.101808+0000","last_undegraded":"2024-03-30T13:11:46.101808+0000","last_fullsized":"2024-03-30T13:11:46.101808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:59:29.592029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876328+0000","last_change":"2024-03-30T13:11:41.047959+0000","last_active":"2024-03-30T13:11:46.876328+0000","last_peered":"2024-03-30T13:11:46.876328+0000","last_clean":"2024-03-30T13:11:46.876328+0000","last_became_active":"2024-03-30T13:11:41.047563+0000","last_became_peered":"2024-03-30T13:11:41.047563+0000","last_unstale":"2024-03-30T13:11:46.876328+0000","last_undegraded":"2024-03-30T13:11:46.876328+0000","last_fullsized":"2024-03-30T13:11:46.876328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:05:51.376531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.107604+0000","last_change":"2024-03-30T13:11:41.051909+0000","last_active":"2024-03-30T13:11:46.107604+0000","last_peered":"2024-03-30T13:11:46.107604+0000","last_clean":"2024-03-30T13:11:46.107604+0000","last_became_active":"2024-03-30T13:11:41.049935+0000","last_became_peered":"2024-03-30T13:11:41.049935+0000","last_unstale":"2024-03-30T13:11:46.107604+0000","last_undegraded":"2024-03-30T13:11:46.107604+0000","last_fullsized":"2024-03-30T13:11:46.107604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:08:02.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101288+0000","last_change":"2024-03-30T13:11:41.067163+0000","last_active":"2024-03-30T13:11:46.101288+0000","last_peered":"2024-03-30T13:11:46.101288+0000","last_clean":"2024-03-30T13:11:46.101288+0000","last_became_active":"2024-03-30T13:11:41.066912+0000","last_became_peered":"2024-03-30T13:11:41.066912+0000","last_unstale":"2024-03-30T13:11:46.101288+0000","last_undegraded":"2024-03-30T13:11:46.101288+0000","last_fullsized":"2024-03-30T13:11:46.101288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:42:07.042799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877312+0000","last_change":"2024-03-30T13:11:41.047542+0000","last_active":"2024-03-30T13:11:46.877312+0000","last_peered":"2024-03-30T13:11:46.877312+0000","last_clean":"2024-03-30T13:11:46.877312+0000","last_became_active":"2024-03-30T13:11:41.046947+0000","last_became_peered":"2024-03-30T13:11:41.046947+0000","last_unstale":"2024-03-30T13:11:46.877312+0000","last_undegraded":"2024-03-30T13:11:46.877312+0000","last_fullsized":"2024-03-30T13:11:46.877312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:19.146268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100367+0000","last_change":"2024-03-30T13:11:41.068416+0000","last_active":"2024-03-30T13:11:46.100367+0000","last_peered":"2024-03-30T13:11:46.100367+0000","last_clean":"2024-03-30T13:11:46.100367+0000","last_became_active":"2024-03-30T13:11:41.067651+0000","last_became_peered":"2024-03-30T13:11:41.067651+0000","last_unstale":"2024-03-30T13:11:46.100367+0000","last_undegraded":"2024-03-30T13:11:46.100367+0000","last_fullsized":"2024-03-30T13:11:46.100367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:07.157771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878282+0000","last_change":"2024-03-30T13:11:41.037581+0000","last_active":"2024-03-30T13:11:46.878282+0000","last_peered":"2024-03-30T13:11:46.878282+0000","last_clean":"2024-03-30T13:11:46.878282+0000","last_became_active":"2024-03-30T13:11:41.037266+0000","last_became_peered":"2024-03-30T13:11:41.037266+0000","last_unstale":"2024-03-30T13:11:46.878282+0000","last_undegraded":"2024-03-30T13:11:46.878282+0000","last_fullsized":"2024-03-30T13:11:46.878282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:34.039026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729580+0000","last_change":"2024-03-30T13:11:41.053939+0000","last_active":"2024-03-30T13:11:46.729580+0000","last_peered":"2024-03-30T13:11:46.729580+0000","last_clean":"2024-03-30T13:11:46.729580+0000","last_became_active":"2024-03-30T13:11:41.053762+0000","last_became_peered":"2024-03-30T13:11:41.053762+0000","last_unstale":"2024-03-30T13:11:46.729580+0000","last_undegraded":"2024-03-30T13:11:46.729580+0000","last_fullsized":"2024-03-30T13:11:46.729580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:21.432848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.104253+0000","last_change":"2024-03-30T13:11:41.053322+0000","last_active":"2024-03-30T13:11:46.104253+0000","last_peered":"2024-03-30T13:11:46.104253+0000","last_clean":"2024-03-30T13:11:46.104253+0000","last_became_active":"2024-03-30T13:11:41.053016+0000","last_became_peered":"2024-03-30T13:11:41.053016+0000","last_unstale":"2024-03-30T13:11:46.104253+0000","last_undegraded":"2024-03-30T13:11:46.104253+0000","last_fullsized":"2024-03-30T13:11:46.104253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:42:40.947191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102031+0000","last_change":"2024-03-30T13:11:41.048361+0000","last_active":"2024-03-30T13:11:46.102031+0000","last_peered":"2024-03-30T13:11:46.102031+0000","last_clean":"2024-03-30T13:11:46.102031+0000","last_became_active":"2024-03-30T13:11:41.048095+0000","last_became_peered":"2024-03-30T13:11:41.048095+0000","last_unstale":"2024-03-30T13:11:46.102031+0000","last_undegraded":"2024-03-30T13:11:46.102031+0000","last_fullsized":"2024-03-30T13:11:46.102031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:46:04.352790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875772+0000","last_change":"2024-03-30T13:11:41.038135+0000","last_active":"2024-03-30T13:11:46.875772+0000","last_peered":"2024-03-30T13:11:46.875772+0000","last_clean":"2024-03-30T13:11:46.875772+0000","last_became_active":"2024-03-30T13:11:41.036822+0000","last_became_peered":"2024-03-30T13:11:41.036822+0000","last_unstale":"2024-03-30T13:11:46.875772+0000","last_undegraded":"2024-03-30T13:11:46.875772+0000","last_fullsized":"2024-03-30T13:11:46.875772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:36:52.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881424+0000","last_change":"2024-03-30T13:11:41.048493+0000","last_active":"2024-03-30T13:11:46.881424+0000","last_peered":"2024-03-30T13:11:46.881424+0000","last_clean":"2024-03-30T13:11:46.881424+0000","last_became_active":"2024-03-30T13:11:41.047123+0000","last_became_peered":"2024-03-30T13:11:41.047123+0000","last_unstale":"2024-03-30T13:11:46.881424+0000","last_undegraded":"2024-03-30T13:11:46.881424+0000","last_fullsized":"2024-03-30T13:11:46.881424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:46:04.352790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877192+0000","last_change":"2024-03-30T13:11:41.047289+0000","last_active":"2024-03-30T13:11:46.877192+0000","last_peered":"2024-03-30T13:11:46.877192+0000","last_clean":"2024-03-30T13:11:46.877192+0000","last_became_active":"2024-03-30T13:11:41.046589+0000","last_became_peered":"2024-03-30T13:11:41.046589+0000","last_unstale":"2024-03-30T13:11:46.877192+0000","last_undegraded":"2024-03-30T13:11:46.877192+0000","last_fullsized":"2024-03-30T13:11:46.877192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:08:02.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875723+0000","last_change":"2024-03-30T13:11:41.052085+0000","last_active":"2024-03-30T13:11:46.875723+0000","last_peered":"2024-03-30T13:11:46.875723+0000","last_clean":"2024-03-30T13:11:46.875723+0000","last_became_active":"2024-03-30T13:11:41.051800+0000","last_became_peered":"2024-03-30T13:11:41.051800+0000","last_unstale":"2024-03-30T13:11:46.875723+0000","last_undegraded":"2024-03-30T13:11:46.875723+0000","last_fullsized":"2024-03-30T13:11:46.875723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:07.157771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730017+0000","last_change":"2024-03-30T13:11:41.052282+0000","last_active":"2024-03-30T13:11:46.730017+0000","last_peered":"2024-03-30T13:11:46.730017+0000","last_clean":"2024-03-30T13:11:46.730017+0000","last_became_active":"2024-03-30T13:11:41.052009+0000","last_became_peered":"2024-03-30T13:11:41.052009+0000","last_unstale":"2024-03-30T13:11:46.730017+0000","last_undegraded":"2024-03-30T13:11:46.730017+0000","last_fullsized":"2024-03-30T13:11:46.730017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:14:06.832559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102678+0000","last_change":"2024-03-30T13:11:41.050105+0000","last_active":"2024-03-30T13:11:46.102678+0000","last_peered":"2024-03-30T13:11:46.102678+0000","last_clean":"2024-03-30T13:11:46.102678+0000","last_became_active":"2024-03-30T13:11:41.048387+0000","last_became_peered":"2024-03-30T13:11:41.048387+0000","last_unstale":"2024-03-30T13:11:46.102678+0000","last_undegraded":"2024-03-30T13:11:46.102678+0000","last_fullsized":"2024-03-30T13:11:46.102678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:55.484149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879166+0000","last_change":"2024-03-30T13:11:41.055816+0000","last_active":"2024-03-30T13:11:46.879166+0000","last_peered":"2024-03-30T13:11:46.879166+0000","last_clean":"2024-03-30T13:11:46.879166+0000","last_became_active":"2024-03-30T13:11:41.051061+0000","last_became_peered":"2024-03-30T13:11:41.051061+0000","last_unstale":"2024-03-30T13:11:46.879166+0000","last_undegraded":"2024-03-30T13:11:46.879166+0000","last_fullsized":"2024-03-30T13:11:46.879166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:49.178652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.106145+0000","last_change":"2024-03-30T13:11:41.061725+0000","last_active":"2024-03-30T13:11:46.106145+0000","last_peered":"2024-03-30T13:11:46.106145+0000","last_clean":"2024-03-30T13:11:46.106145+0000","last_became_active":"2024-03-30T13:11:41.061432+0000","last_became_peered":"2024-03-30T13:11:41.061432+0000","last_unstale":"2024-03-30T13:11:46.106145+0000","last_undegraded":"2024-03-30T13:11:46.106145+0000","last_fullsized":"2024-03-30T13:11:46.106145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:13:46.043702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.107474+0000","last_change":"2024-03-30T13:11:41.060125+0000","last_active":"2024-03-30T13:11:46.107474+0000","last_peered":"2024-03-30T13:11:46.107474+0000","last_clean":"2024-03-30T13:11:46.107474+0000","last_became_active":"2024-03-30T13:11:41.059839+0000","last_became_peered":"2024-03-30T13:11:41.059839+0000","last_unstale":"2024-03-30T13:11:46.107474+0000","last_undegraded":"2024-03-30T13:11:46.107474+0000","last_fullsized":"2024-03-30T13:11:46.107474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:19.146268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103554+0000","last_change":"2024-03-30T13:11:41.066403+0000","last_active":"2024-03-30T13:11:46.103554+0000","last_peered":"2024-03-30T13:11:46.103554+0000","last_clean":"2024-03-30T13:11:46.103554+0000","last_became_active":"2024-03-30T13:11:41.066148+0000","last_became_peered":"2024-03-30T13:11:41.066148+0000","last_unstale":"2024-03-30T13:11:46.103554+0000","last_undegraded":"2024-03-30T13:11:46.103554+0000","last_fullsized":"2024-03-30T13:11:46.103554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:23:32.604365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099258+0000","last_change":"2024-03-30T13:11:41.072872+0000","last_active":"2024-03-30T13:11:46.099258+0000","last_peered":"2024-03-30T13:11:46.099258+0000","last_clean":"2024-03-30T13:11:46.099258+0000","last_became_active":"2024-03-30T13:11:41.066749+0000","last_became_peered":"2024-03-30T13:11:41.066749+0000","last_unstale":"2024-03-30T13:11:46.099258+0000","last_undegraded":"2024-03-30T13:11:46.099258+0000","last_fullsized":"2024-03-30T13:11:46.099258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:14:06.832559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101194+0000","last_change":"2024-03-30T13:11:41.051881+0000","last_active":"2024-03-30T13:11:46.101194+0000","last_peered":"2024-03-30T13:11:46.101194+0000","last_clean":"2024-03-30T13:11:46.101194+0000","last_became_active":"2024-03-30T13:11:41.051569+0000","last_became_peered":"2024-03-30T13:11:41.051569+0000","last_unstale":"2024-03-30T13:11:46.101194+0000","last_undegraded":"2024-03-30T13:11:46.101194+0000","last_fullsized":"2024-03-30T13:11:46.101194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:48:13.158195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878052+0000","last_change":"2024-03-30T13:11:41.052969+0000","last_active":"2024-03-30T13:11:46.878052+0000","last_peered":"2024-03-30T13:11:46.878052+0000","last_clean":"2024-03-30T13:11:46.878052+0000","last_became_active":"2024-03-30T13:11:41.052626+0000","last_became_peered":"2024-03-30T13:11:41.052626+0000","last_unstale":"2024-03-30T13:11:46.878052+0000","last_undegraded":"2024-03-30T13:11:46.878052+0000","last_fullsized":"2024-03-30T13:11:46.878052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:12.520741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101308+0000","last_change":"2024-03-30T13:11:41.044957+0000","last_active":"2024-03-30T13:11:46.101308+0000","last_peered":"2024-03-30T13:11:46.101308+0000","last_clean":"2024-03-30T13:11:46.101308+0000","last_became_active":"2024-03-30T13:11:41.044658+0000","last_became_peered":"2024-03-30T13:11:41.044658+0000","last_unstale":"2024-03-30T13:11:46.101308+0000","last_undegraded":"2024-03-30T13:11:46.101308+0000","last_fullsized":"2024-03-30T13:11:46.101308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:18:53.034802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880588+0000","last_change":"2024-03-30T13:11:41.056707+0000","last_active":"2024-03-30T13:11:46.880588+0000","last_peered":"2024-03-30T13:11:46.880588+0000","last_clean":"2024-03-30T13:11:46.880588+0000","last_became_active":"2024-03-30T13:11:41.055440+0000","last_became_peered":"2024-03-30T13:11:41.055440+0000","last_unstale":"2024-03-30T13:11:46.880588+0000","last_undegraded":"2024-03-30T13:11:46.880588+0000","last_fullsized":"2024-03-30T13:11:46.880588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:07:32.828569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729706+0000","last_change":"2024-03-30T13:11:41.046907+0000","last_active":"2024-03-30T13:11:46.729706+0000","last_peered":"2024-03-30T13:11:46.729706+0000","last_clean":"2024-03-30T13:11:46.729706+0000","last_became_active":"2024-03-30T13:11:41.046092+0000","last_became_peered":"2024-03-30T13:11:41.046092+0000","last_unstale":"2024-03-30T13:11:46.729706+0000","last_undegraded":"2024-03-30T13:11:46.729706+0000","last_fullsized":"2024-03-30T13:11:46.729706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:04:23.461918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876628+0000","last_change":"2024-03-30T13:11:41.043762+0000","last_active":"2024-03-30T13:11:46.876628+0000","last_peered":"2024-03-30T13:11:46.876628+0000","last_clean":"2024-03-30T13:11:46.876628+0000","last_became_active":"2024-03-30T13:11:41.043468+0000","last_became_peered":"2024-03-30T13:11:41.043468+0000","last_unstale":"2024-03-30T13:11:46.876628+0000","last_undegraded":"2024-03-30T13:11:46.876628+0000","last_fullsized":"2024-03-30T13:11:46.876628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:29.578558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103044+0000","last_change":"2024-03-30T13:11:41.051937+0000","last_active":"2024-03-30T13:11:46.103044+0000","last_peered":"2024-03-30T13:11:46.103044+0000","last_clean":"2024-03-30T13:11:46.103044+0000","last_became_active":"2024-03-30T13:11:41.051536+0000","last_became_peered":"2024-03-30T13:11:41.051536+0000","last_unstale":"2024-03-30T13:11:46.103044+0000","last_undegraded":"2024-03-30T13:11:46.103044+0000","last_fullsized":"2024-03-30T13:11:46.103044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:49:02.326260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":701669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":110809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":110845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":110879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":701725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:12:09.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:12:10.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.008+0000 7f3d19e00640 1 Processor -- start 2024-03-30T13:12:10.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.009+0000 7f3d19e00640 1 -- start start 2024-03-30T13:12:10.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.010+0000 7f3d19e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3d1415e340 0x7f3d140b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.010+0000 7f3d19e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d140d2620 con 0x7f3d140d2f20 2024-03-30T13:12:10.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.010+0000 7f3d19e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d140b42b0 con 0x7f3d140d2170 2024-03-30T13:12:10.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.010+0000 7f3d19e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f3d140b4590 con 0x7f3d1415e340 2024-03-30T13:12:10.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.010+0000 7f3d19400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3d140d2f20 0x7f3d140ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56770/0 (socket says 172.21.15.44:56770) 2024-03-30T13:12:10.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.010+0000 7f3d19400640 1 -- 172.21.15.44:0/167196195 learned_addr learned my addr 172.21.15.44:0/167196195 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:10.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.011+0000 7f3d18a00640 1 --2- 172.21.15.44:0/167196195 >> v2:172.21.15.151:3300/0 conn(0x7f3d1415e340 0x7f3d140b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.011+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4090534279 0 0) 0x7f3d140d2620 con 0x7f3d140d2f20 2024-03-30T13:12:10.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.011+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cfc003520 con 0x7f3d140d2f20 2024-03-30T13:12:10.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.011+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2272033304 0 0) 0x7f3cfc003520 con 0x7f3d140d2f20 2024-03-30T13:12:10.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.011+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 >> v2:172.21.15.151:3300/0 conn(0x7f3d1415e340 msgr2=0x7f3d140b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:10.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.011+0000 7f3d13400640 1 --2- 172.21.15.44:0/167196195 >> v2:172.21.15.151:3300/0 conn(0x7f3d1415e340 0x7f3d140b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.011+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 >> v1:172.21.15.151:6789/0 conn(0x7f3d140d2170 legacy=0x7f3d140d2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.011+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d140b4870 con 0x7f3d140d2f20 2024-03-30T13:12:10.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.011+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f3d0c0019f0 con 0x7f3d140d2f20 2024-03-30T13:12:10.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 >> v1:172.21.15.44:6789/0 conn(0x7f3d140d2f20 legacy=0x7f3d140ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d13400640 1 --2- 172.21.15.44:0/167196195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc0039b0 0x7f3cfc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d13400640 1 --2- 172.21.15.44:0/167196195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc004800 0x7f3cfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d13400640 1 --2- 172.21.15.44:0/167196195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cfc0051c0 0x7f3cfc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3d140b4590 con 0x7f3cfc0039b0 2024-03-30T13:12:10.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc00c060 con 0x7f3cfc004800 2024-03-30T13:12:10.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3cfc00c260 con 0x7f3cfc0051c0 2024-03-30T13:12:10.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d18a00640 1 --2- 172.21.15.44:0/167196195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc0039b0 0x7f3cfc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d13e00640 1 --2- 172.21.15.44:0/167196195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc004800 0x7f3cfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d18a00640 1 -- 172.21.15.44:0/167196195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cfc0051c0 msgr2=0x7f3cfc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:10.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d18a00640 1 --2- 172.21.15.44:0/167196195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3cfc0051c0 0x7f3cfc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d18a00640 1 -- 172.21.15.44:0/167196195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc004800 msgr2=0x7f3cfc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:10.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d18a00640 1 --2- 172.21.15.44:0/167196195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc004800 0x7f3cfc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d18a00640 1 -- 172.21.15.44:0/167196195 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc003520 con 0x7f3cfc0039b0 2024-03-30T13:12:10.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.012+0000 7f3d19400640 1 -- 172.21.15.44:0/167196195 reap_dead start 2024-03-30T13:12:10.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.014+0000 7f3d18a00640 1 --2- 172.21.15.44:0/167196195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc0039b0 0x7f3cfc003dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009ac0 tx=0x7f3cfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59300329d980ca39 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:10.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.014+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08039070 con 0x7f3cfc0039b0 2024-03-30T13:12:10.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.014+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0802c6d0 con 0x7f3cfc0039b0 2024-03-30T13:12:10.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.014+0000 7f3d13400640 1 -- 172.21.15.44:0/167196195 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08009690 con 0x7f3cfc0039b0 2024-03-30T13:12:10.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.014+0000 7f3d19e00640 1 -- 172.21.15.44:0/167196195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc0039b0 msgr2=0x7f3cfc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.014+0000 7f3d19e00640 1 --2- 172.21.15.44:0/167196195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc0039b0 0x7f3cfc003dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3d08009ac0 tx=0x7f3cfc005830 comp rx=0 tx=0).stop 2024-03-30T13:12:10.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.015+0000 7f3d19e00640 1 -- 172.21.15.44:0/167196195 shutdown_connections 2024-03-30T13:12:10.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.015+0000 7f3d19e00640 1 --2- 172.21.15.44:0/167196195 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3cfc0039b0 0x7f3cfc003dd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.015+0000 7f3d19e00640 1 -- 172.21.15.44:0/167196195 >> 172.21.15.44:0/167196195 conn(0x7f3d1408dc60 msgr2=0x7f3d1409d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:10.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.015+0000 7f3d19e00640 1 -- 172.21.15.44:0/167196195 shutdown_connections 2024-03-30T13:12:10.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.015+0000 7f3d19e00640 1 -- 172.21.15.44:0/167196195 wait complete. 2024-03-30T13:12:10.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.016+0000 7f3d19e00640 1 Processor -- start 2024-03-30T13:12:10.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.017+0000 7f3d19e00640 1 -- start start 2024-03-30T13:12:10.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d19e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc0039b0 0x7f3d141613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d19e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d14157170 0x7f3d140b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d19e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d141534e0 0x7f3d14153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d19e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3d1415e720 con 0x7f3d14157170 2024-03-30T13:12:10.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d19e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3d140b4e30 con 0x7f3cfc0039b0 2024-03-30T13:12:10.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d19e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3d1415e8a0 con 0x7f3d141534e0 2024-03-30T13:12:10.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d13e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d14157170 0x7f3d140b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d13e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d14157170 0x7f3d140b8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39142/0 (socket says 172.21.15.44:39142) 2024-03-30T13:12:10.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d13e00640 1 -- 172.21.15.44:0/2655804599 learned_addr learned my addr 172.21.15.44:0/2655804599 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:10.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d18a00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc0039b0 0x7f3d141613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d19400640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d141534e0 0x7f3d14153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d13e00640 1 -- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d141534e0 msgr2=0x7f3d14153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d13e00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d141534e0 0x7f3d14153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d13e00640 1 -- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc0039b0 msgr2=0x7f3d141613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d13e00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc0039b0 0x7f3d141613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.018+0000 7f3d13e00640 1 -- 172.21.15.44:0/2655804599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d140b9c30 con 0x7f3d14157170 2024-03-30T13:12:10.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.019+0000 7f3d13e00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d14157170 0x7f3d140b8fc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000e4d0 tx=0x7f3d0000e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:10.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.019+0000 7f3d10c00640 1 -- 172.21.15.44:0/2655804599 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d000053a0 con 0x7f3d14157170 2024-03-30T13:12:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.019+0000 7f3d10c00640 1 -- 172.21.15.44:0/2655804599 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d00018070 con 0x7f3d14157170 2024-03-30T13:12:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.019+0000 7f3d19e00640 1 -- 172.21.15.44:0/2655804599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d14156760 con 0x7f3d14157170 2024-03-30T13:12:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.019+0000 7f3d10c00640 1 -- 172.21.15.44:0/2655804599 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00003810 con 0x7f3d14157170 2024-03-30T13:12:10.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.019+0000 7f3d19e00640 1 -- 172.21.15.44:0/2655804599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d14156480 con 0x7f3d14157170 2024-03-30T13:12:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.020+0000 7f3d19e00640 1 -- 172.21.15.44:0/2655804599 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d140b20c0 con 0x7f3d14157170 2024-03-30T13:12:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.021+0000 7f3d10c00640 1 -- 172.21.15.44:0/2655804599 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3d000039b0 con 0x7f3d14157170 2024-03-30T13:12:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.022+0000 7f3d10c00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3cf406c560 0x7f3cf406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.022+0000 7f3d10c00640 1 -- 172.21.15.44:0/2655804599 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3d0008b730 con 0x7f3d14157170 2024-03-30T13:12:10.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.023+0000 7f3d18a00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3cf406c560 0x7f3cf406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.024+0000 7f3d18a00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3cf406c560 0x7f3cf406ea20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3d08036000 tx=0x7f3d08030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:10.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.027+0000 7f3d10c00640 1 -- 172.21.15.44:0/2655804599 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3d00059a00 con 0x7f3d14157170 2024-03-30T13:12:10.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.226+0000 7f3d19e00640 1 -- 172.21.15.44:0/2655804599 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3d140b1de0 con 0x7f3cf406c560 2024-03-30T13:12:10.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.251+0000 7f3d10c00640 1 -- 172.21.15.44:0/2655804599 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7f3d08096310 con 0x7f3cf406c560 2024-03-30T13:12:10.258 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:10.262 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:12:10.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.259+0000 7f3d19e00640 1 -- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3cf406c560 msgr2=0x7f3cf406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.259+0000 7f3d19e00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3cf406c560 0x7f3cf406ea20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3d08036000 tx=0x7f3d08030000 comp rx=0 tx=0).stop 2024-03-30T13:12:10.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.259+0000 7f3d19e00640 1 -- 172.21.15.44:0/2655804599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d14157170 msgr2=0x7f3d140b8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.259+0000 7f3d19e00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d14157170 0x7f3d140b8fc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000e4d0 tx=0x7f3d0000e990 comp rx=0 tx=0).stop 2024-03-30T13:12:10.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.259+0000 7f3d19e00640 1 -- 172.21.15.44:0/2655804599 shutdown_connections 2024-03-30T13:12:10.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.259+0000 7f3d19e00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d141534e0 0x7f3d14153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.259+0000 7f3d19e00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d14157170 0x7f3d140b8fc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.259+0000 7f3d19e00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3cf406c560 0x7f3cf406ea20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.259+0000 7f3d19e00640 1 --2- 172.21.15.44:0/2655804599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc0039b0 0x7f3d141613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.259+0000 7f3d19e00640 1 -- 172.21.15.44:0/2655804599 >> 172.21.15.44:0/2655804599 conn(0x7f3d1408dc60 msgr2=0x7f3d1415d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:10.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.259+0000 7f3d19e00640 1 -- 172.21.15.44:0/2655804599 shutdown_connections 2024-03-30T13:12:10.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.260+0000 7f3d19e00640 1 -- 172.21.15.44:0/2655804599 wait complete. 2024-03-30T13:12:10.285 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-03-30T13:12:09.958523+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219592,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755128,"statfs":{"total":773094113280,"available":772869251072,"internally_reserved":0,"allocated":3514368,"data_stored":2075768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005025"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730687+0000","last_change":"2024-03-30T13:11:40.057283+0000","last_active":"2024-03-30T13:11:46.730687+0000","last_peered":"2024-03-30T13:11:46.730687+0000","last_clean":"2024-03-30T13:11:46.730687+0000","last_became_active":"2024-03-30T13:11:40.056762+0000","last_became_peered":"2024-03-30T13:11:40.056762+0000","last_unstale":"2024-03-30T13:11:46.730687+0000","last_undegraded":"2024-03-30T13:11:46.730687+0000","last_fullsized":"2024-03-30T13:11:46.730687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:40:48.482839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101982+0000","last_change":"2024-03-30T13:11:41.053361+0000","last_active":"2024-03-30T13:11:46.101982+0000","last_peered":"2024-03-30T13:11:46.101982+0000","last_clean":"2024-03-30T13:11:46.101982+0000","last_became_active":"2024-03-30T13:11:41.053113+0000","last_became_peered":"2024-03-30T13:11:41.053113+0000","last_unstale":"2024-03-30T13:11:46.101982+0000","last_undegraded":"2024-03-30T13:11:46.101982+0000","last_fullsized":"2024-03-30T13:11:46.101982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:26:18.201405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099642+0000","last_change":"2024-03-30T13:11:45.128908+0000","last_active":"2024-03-30T13:11:46.099642+0000","last_peered":"2024-03-30T13:11:46.099642+0000","last_clean":"2024-03-30T13:11:46.099642+0000","last_became_active":"2024-03-30T13:11:45.125033+0000","last_became_peered":"2024-03-30T13:11:45.125033+0000","last_unstale":"2024-03-30T13:11:46.099642+0000","last_undegraded":"2024-03-30T13:11:46.099642+0000","last_fullsized":"2024-03-30T13:11:46.099642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:47.578255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102346+0000","last_change":"2024-03-30T13:11:40.061864+0000","last_active":"2024-03-30T13:11:46.102346+0000","last_peered":"2024-03-30T13:11:46.102346+0000","last_clean":"2024-03-30T13:11:46.102346+0000","last_became_active":"2024-03-30T13:11:40.061541+0000","last_became_peered":"2024-03-30T13:11:40.061541+0000","last_unstale":"2024-03-30T13:11:46.102346+0000","last_undegraded":"2024-03-30T13:11:46.102346+0000","last_fullsized":"2024-03-30T13:11:46.102346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:00:09.740838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730387+0000","last_change":"2024-03-30T13:11:41.071991+0000","last_active":"2024-03-30T13:11:46.730387+0000","last_peered":"2024-03-30T13:11:46.730387+0000","last_clean":"2024-03-30T13:11:46.730387+0000","last_became_active":"2024-03-30T13:11:41.068214+0000","last_became_peered":"2024-03-30T13:11:41.068214+0000","last_unstale":"2024-03-30T13:11:46.730387+0000","last_undegraded":"2024-03-30T13:11:46.730387+0000","last_fullsized":"2024-03-30T13:11:46.730387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:07.157771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878229+0000","last_change":"2024-03-30T13:11:45.118196+0000","last_active":"2024-03-30T13:11:46.878229+0000","last_peered":"2024-03-30T13:11:46.878229+0000","last_clean":"2024-03-30T13:11:46.878229+0000","last_became_active":"2024-03-30T13:11:45.117348+0000","last_became_peered":"2024-03-30T13:11:45.117348+0000","last_unstale":"2024-03-30T13:11:46.878229+0000","last_undegraded":"2024-03-30T13:11:46.878229+0000","last_fullsized":"2024-03-30T13:11:46.878229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:33.630135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101841+0000","last_change":"2024-03-30T13:11:40.060593+0000","last_active":"2024-03-30T13:11:46.101841+0000","last_peered":"2024-03-30T13:11:46.101841+0000","last_clean":"2024-03-30T13:11:46.101841+0000","last_became_active":"2024-03-30T13:11:40.060297+0000","last_became_peered":"2024-03-30T13:11:40.060297+0000","last_unstale":"2024-03-30T13:11:46.101841+0000","last_undegraded":"2024-03-30T13:11:46.101841+0000","last_fullsized":"2024-03-30T13:11:46.101841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:26:00.941858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880714+0000","last_change":"2024-03-30T13:11:41.059936+0000","last_active":"2024-03-30T13:11:46.880714+0000","last_peered":"2024-03-30T13:11:46.880714+0000","last_clean":"2024-03-30T13:11:46.880714+0000","last_became_active":"2024-03-30T13:11:41.058955+0000","last_became_peered":"2024-03-30T13:11:41.058955+0000","last_unstale":"2024-03-30T13:11:46.880714+0000","last_undegraded":"2024-03-30T13:11:46.880714+0000","last_fullsized":"2024-03-30T13:11:46.880714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:48:13.158195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878602+0000","last_change":"2024-03-30T13:11:45.122549+0000","last_active":"2024-03-30T13:11:46.878602+0000","last_peered":"2024-03-30T13:11:46.878602+0000","last_clean":"2024-03-30T13:11:46.878602+0000","last_became_active":"2024-03-30T13:11:45.121869+0000","last_became_peered":"2024-03-30T13:11:45.121869+0000","last_unstale":"2024-03-30T13:11:46.878602+0000","last_undegraded":"2024-03-30T13:11:46.878602+0000","last_fullsized":"2024-03-30T13:11:46.878602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:08.813927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101843+0000","last_change":"2024-03-30T13:11:40.064355+0000","last_active":"2024-03-30T13:11:46.101843+0000","last_peered":"2024-03-30T13:11:46.101843+0000","last_clean":"2024-03-30T13:11:46.101843+0000","last_became_active":"2024-03-30T13:11:40.063509+0000","last_became_peered":"2024-03-30T13:11:40.063509+0000","last_unstale":"2024-03-30T13:11:46.101843+0000","last_undegraded":"2024-03-30T13:11:46.101843+0000","last_fullsized":"2024-03-30T13:11:46.101843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:08:08.320399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881004+0000","last_change":"2024-03-30T13:11:41.056587+0000","last_active":"2024-03-30T13:11:46.881004+0000","last_peered":"2024-03-30T13:11:46.881004+0000","last_clean":"2024-03-30T13:11:46.881004+0000","last_became_active":"2024-03-30T13:11:41.055308+0000","last_became_peered":"2024-03-30T13:11:41.055308+0000","last_unstale":"2024-03-30T13:11:46.881004+0000","last_undegraded":"2024-03-30T13:11:46.881004+0000","last_fullsized":"2024-03-30T13:11:46.881004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:05:33.323351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878545+0000","last_change":"2024-03-30T13:11:45.110636+0000","last_active":"2024-03-30T13:11:46.878545+0000","last_peered":"2024-03-30T13:11:46.878545+0000","last_clean":"2024-03-30T13:11:46.878545+0000","last_became_active":"2024-03-30T13:11:45.110148+0000","last_became_peered":"2024-03-30T13:11:45.110148+0000","last_unstale":"2024-03-30T13:11:46.878545+0000","last_undegraded":"2024-03-30T13:11:46.878545+0000","last_fullsized":"2024-03-30T13:11:46.878545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:42:11.094376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103982+0000","last_change":"2024-03-30T13:11:41.060135+0000","last_active":"2024-03-30T13:11:46.103982+0000","last_peered":"2024-03-30T13:11:46.103982+0000","last_clean":"2024-03-30T13:11:46.103982+0000","last_became_active":"2024-03-30T13:11:41.059868+0000","last_became_peered":"2024-03-30T13:11:41.059868+0000","last_unstale":"2024-03-30T13:11:46.103982+0000","last_undegraded":"2024-03-30T13:11:46.103982+0000","last_fullsized":"2024-03-30T13:11:46.103982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:01:39.869927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103046+0000","last_change":"2024-03-30T13:11:40.062596+0000","last_active":"2024-03-30T13:11:46.103046+0000","last_peered":"2024-03-30T13:11:46.103046+0000","last_clean":"2024-03-30T13:11:46.103046+0000","last_became_active":"2024-03-30T13:11:40.061171+0000","last_became_peered":"2024-03-30T13:11:40.061171+0000","last_unstale":"2024-03-30T13:11:46.103046+0000","last_undegraded":"2024-03-30T13:11:46.103046+0000","last_fullsized":"2024-03-30T13:11:46.103046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:36:51.946896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879271+0000","last_change":"2024-03-30T13:11:45.114509+0000","last_active":"2024-03-30T13:11:46.879271+0000","last_peered":"2024-03-30T13:11:46.879271+0000","last_clean":"2024-03-30T13:11:46.879271+0000","last_became_active":"2024-03-30T13:11:45.112300+0000","last_became_peered":"2024-03-30T13:11:45.112300+0000","last_unstale":"2024-03-30T13:11:46.879271+0000","last_undegraded":"2024-03-30T13:11:46.879271+0000","last_fullsized":"2024-03-30T13:11:46.879271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:20.547592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100409+0000","last_change":"2024-03-30T13:11:41.055501+0000","last_active":"2024-03-30T13:11:46.100409+0000","last_peered":"2024-03-30T13:11:46.100409+0000","last_clean":"2024-03-30T13:11:46.100409+0000","last_became_active":"2024-03-30T13:11:41.050140+0000","last_became_peered":"2024-03-30T13:11:41.050140+0000","last_unstale":"2024-03-30T13:11:46.100409+0000","last_undegraded":"2024-03-30T13:11:46.100409+0000","last_fullsized":"2024-03-30T13:11:46.100409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:29.578558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876526+0000","last_change":"2024-03-30T13:11:40.052089+0000","last_active":"2024-03-30T13:11:46.876526+0000","last_peered":"2024-03-30T13:11:46.876526+0000","last_clean":"2024-03-30T13:11:46.876526+0000","last_became_active":"2024-03-30T13:11:40.051812+0000","last_became_peered":"2024-03-30T13:11:40.051812+0000","last_unstale":"2024-03-30T13:11:46.876526+0000","last_undegraded":"2024-03-30T13:11:46.876526+0000","last_fullsized":"2024-03-30T13:11:46.876526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:11:46.050978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878901+0000","last_change":"2024-03-30T13:11:45.121795+0000","last_active":"2024-03-30T13:11:46.878901+0000","last_peered":"2024-03-30T13:11:46.878901+0000","last_clean":"2024-03-30T13:11:46.878901+0000","last_became_active":"2024-03-30T13:11:45.121345+0000","last_became_peered":"2024-03-30T13:11:45.121345+0000","last_unstale":"2024-03-30T13:11:46.878901+0000","last_undegraded":"2024-03-30T13:11:46.878901+0000","last_fullsized":"2024-03-30T13:11:46.878901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:26:22.252982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100364+0000","last_change":"2024-03-30T13:11:41.060945+0000","last_active":"2024-03-30T13:11:46.100364+0000","last_peered":"2024-03-30T13:11:46.100364+0000","last_clean":"2024-03-30T13:11:46.100364+0000","last_became_active":"2024-03-30T13:11:41.060615+0000","last_became_peered":"2024-03-30T13:11:41.060615+0000","last_unstale":"2024-03-30T13:11:46.100364+0000","last_undegraded":"2024-03-30T13:11:46.100364+0000","last_fullsized":"2024-03-30T13:11:46.100364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:05:51.376531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875830+0000","last_change":"2024-03-30T13:11:40.060348+0000","last_active":"2024-03-30T13:11:46.875830+0000","last_peered":"2024-03-30T13:11:46.875830+0000","last_clean":"2024-03-30T13:11:46.875830+0000","last_became_active":"2024-03-30T13:11:40.059848+0000","last_became_peered":"2024-03-30T13:11:40.059848+0000","last_unstale":"2024-03-30T13:11:46.875830+0000","last_undegraded":"2024-03-30T13:11:46.875830+0000","last_fullsized":"2024-03-30T13:11:46.875830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:28:08.352146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876924+0000","last_change":"2024-03-30T13:11:45.116711+0000","last_active":"2024-03-30T13:11:46.876924+0000","last_peered":"2024-03-30T13:11:46.876924+0000","last_clean":"2024-03-30T13:11:46.876924+0000","last_became_active":"2024-03-30T13:11:45.114206+0000","last_became_peered":"2024-03-30T13:11:45.114206+0000","last_unstale":"2024-03-30T13:11:46.876924+0000","last_undegraded":"2024-03-30T13:11:46.876924+0000","last_fullsized":"2024-03-30T13:11:46.876924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:32:28.206719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880010+0000","last_change":"2024-03-30T13:11:41.056070+0000","last_active":"2024-03-30T13:11:46.880010+0000","last_peered":"2024-03-30T13:11:46.880010+0000","last_clean":"2024-03-30T13:11:46.880010+0000","last_became_active":"2024-03-30T13:11:41.053456+0000","last_became_peered":"2024-03-30T13:11:41.053456+0000","last_unstale":"2024-03-30T13:11:46.880010+0000","last_undegraded":"2024-03-30T13:11:46.880010+0000","last_fullsized":"2024-03-30T13:11:46.880010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:16:30.169967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100577+0000","last_change":"2024-03-30T13:11:40.064409+0000","last_active":"2024-03-30T13:11:46.100577+0000","last_peered":"2024-03-30T13:11:46.100577+0000","last_clean":"2024-03-30T13:11:46.100577+0000","last_became_active":"2024-03-30T13:11:40.063354+0000","last_became_peered":"2024-03-30T13:11:40.063354+0000","last_unstale":"2024-03-30T13:11:46.100577+0000","last_undegraded":"2024-03-30T13:11:46.100577+0000","last_fullsized":"2024-03-30T13:11:46.100577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:10:46.181474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879273+0000","last_change":"2024-03-30T13:11:45.121709+0000","last_active":"2024-03-30T13:11:46.879273+0000","last_peered":"2024-03-30T13:11:46.879273+0000","last_clean":"2024-03-30T13:11:46.879273+0000","last_became_active":"2024-03-30T13:11:45.121209+0000","last_became_peered":"2024-03-30T13:11:45.121209+0000","last_unstale":"2024-03-30T13:11:46.879273+0000","last_undegraded":"2024-03-30T13:11:46.879273+0000","last_fullsized":"2024-03-30T13:11:46.879273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:22:00.571371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730831+0000","last_change":"2024-03-30T13:11:41.050382+0000","last_active":"2024-03-30T13:11:46.730831+0000","last_peered":"2024-03-30T13:11:46.730831+0000","last_clean":"2024-03-30T13:11:46.730831+0000","last_became_active":"2024-03-30T13:11:41.050104+0000","last_became_peered":"2024-03-30T13:11:41.050104+0000","last_unstale":"2024-03-30T13:11:46.730831+0000","last_undegraded":"2024-03-30T13:11:46.730831+0000","last_fullsized":"2024-03-30T13:11:46.730831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:42.594649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105935+0000","last_change":"2024-03-30T13:11:40.055011+0000","last_active":"2024-03-30T13:11:46.105935+0000","last_peered":"2024-03-30T13:11:46.105935+0000","last_clean":"2024-03-30T13:11:46.105935+0000","last_became_active":"2024-03-30T13:11:40.054495+0000","last_became_peered":"2024-03-30T13:11:40.054495+0000","last_unstale":"2024-03-30T13:11:46.105935+0000","last_undegraded":"2024-03-30T13:11:46.105935+0000","last_fullsized":"2024-03-30T13:11:46.105935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:10:46.181474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879720+0000","last_change":"2024-03-30T13:11:45.102475+0000","last_active":"2024-03-30T13:11:46.879720+0000","last_peered":"2024-03-30T13:11:46.879720+0000","last_clean":"2024-03-30T13:11:46.879720+0000","last_became_active":"2024-03-30T13:11:45.102062+0000","last_became_peered":"2024-03-30T13:11:45.102062+0000","last_unstale":"2024-03-30T13:11:46.879720+0000","last_undegraded":"2024-03-30T13:11:46.879720+0000","last_fullsized":"2024-03-30T13:11:46.879720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:14:57.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101633+0000","last_change":"2024-03-30T13:11:41.060379+0000","last_active":"2024-03-30T13:11:46.101633+0000","last_peered":"2024-03-30T13:11:46.101633+0000","last_clean":"2024-03-30T13:11:46.101633+0000","last_became_active":"2024-03-30T13:11:41.060173+0000","last_became_peered":"2024-03-30T13:11:41.060173+0000","last_unstale":"2024-03-30T13:11:46.101633+0000","last_undegraded":"2024-03-30T13:11:46.101633+0000","last_fullsized":"2024-03-30T13:11:46.101633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:04.762350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876716+0000","last_change":"2024-03-30T13:11:40.055192+0000","last_active":"2024-03-30T13:11:46.876716+0000","last_peered":"2024-03-30T13:11:46.876716+0000","last_clean":"2024-03-30T13:11:46.876716+0000","last_became_active":"2024-03-30T13:11:40.054791+0000","last_became_peered":"2024-03-30T13:11:40.054791+0000","last_unstale":"2024-03-30T13:11:46.876716+0000","last_undegraded":"2024-03-30T13:11:46.876716+0000","last_fullsized":"2024-03-30T13:11:46.876716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:48.164301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099353+0000","last_change":"2024-03-30T13:11:45.126240+0000","last_active":"2024-03-30T13:11:46.099353+0000","last_peered":"2024-03-30T13:11:46.099353+0000","last_clean":"2024-03-30T13:11:46.099353+0000","last_became_active":"2024-03-30T13:11:45.123879+0000","last_became_peered":"2024-03-30T13:11:45.123879+0000","last_unstale":"2024-03-30T13:11:46.099353+0000","last_undegraded":"2024-03-30T13:11:46.099353+0000","last_fullsized":"2024-03-30T13:11:46.099353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:39.782287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876292+0000","last_change":"2024-03-30T13:11:41.034727+0000","last_active":"2024-03-30T13:11:46.876292+0000","last_peered":"2024-03-30T13:11:46.876292+0000","last_clean":"2024-03-30T13:11:46.876292+0000","last_became_active":"2024-03-30T13:11:41.034082+0000","last_became_peered":"2024-03-30T13:11:41.034082+0000","last_unstale":"2024-03-30T13:11:46.876292+0000","last_undegraded":"2024-03-30T13:11:46.876292+0000","last_fullsized":"2024-03-30T13:11:46.876292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:21.432848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102205+0000","last_change":"2024-03-30T13:11:40.062157+0000","last_active":"2024-03-30T13:11:46.102205+0000","last_peered":"2024-03-30T13:11:46.102205+0000","last_clean":"2024-03-30T13:11:46.102205+0000","last_became_active":"2024-03-30T13:11:40.061803+0000","last_became_peered":"2024-03-30T13:11:40.061803+0000","last_unstale":"2024-03-30T13:11:46.102205+0000","last_undegraded":"2024-03-30T13:11:46.102205+0000","last_fullsized":"2024-03-30T13:11:46.102205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:42.868273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729905+0000","last_change":"2024-03-30T13:11:45.123226+0000","last_active":"2024-03-30T13:11:46.729905+0000","last_peered":"2024-03-30T13:11:46.729905+0000","last_clean":"2024-03-30T13:11:46.729905+0000","last_became_active":"2024-03-30T13:11:45.122718+0000","last_became_peered":"2024-03-30T13:11:45.122718+0000","last_unstale":"2024-03-30T13:11:46.729905+0000","last_undegraded":"2024-03-30T13:11:46.729905+0000","last_fullsized":"2024-03-30T13:11:46.729905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:33:31.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881174+0000","last_change":"2024-03-30T13:11:41.052392+0000","last_active":"2024-03-30T13:11:46.881174+0000","last_peered":"2024-03-30T13:11:46.881174+0000","last_clean":"2024-03-30T13:11:46.881174+0000","last_became_active":"2024-03-30T13:11:41.052060+0000","last_became_peered":"2024-03-30T13:11:41.052060+0000","last_unstale":"2024-03-30T13:11:46.881174+0000","last_undegraded":"2024-03-30T13:11:46.881174+0000","last_fullsized":"2024-03-30T13:11:46.881174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:43.692694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876402+0000","last_change":"2024-03-30T13:11:40.048150+0000","last_active":"2024-03-30T13:11:46.876402+0000","last_peered":"2024-03-30T13:11:46.876402+0000","last_clean":"2024-03-30T13:11:46.876402+0000","last_became_active":"2024-03-30T13:11:40.047850+0000","last_became_peered":"2024-03-30T13:11:40.047850+0000","last_unstale":"2024-03-30T13:11:46.876402+0000","last_undegraded":"2024-03-30T13:11:46.876402+0000","last_fullsized":"2024-03-30T13:11:46.876402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:16:29.155616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876047+0000","last_change":"2024-03-30T13:11:45.113367+0000","last_active":"2024-03-30T13:11:46.876047+0000","last_peered":"2024-03-30T13:11:46.876047+0000","last_clean":"2024-03-30T13:11:46.876047+0000","last_became_active":"2024-03-30T13:11:45.111513+0000","last_became_peered":"2024-03-30T13:11:45.111513+0000","last_unstale":"2024-03-30T13:11:46.876047+0000","last_undegraded":"2024-03-30T13:11:46.876047+0000","last_fullsized":"2024-03-30T13:11:46.876047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:14:57.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878997+0000","last_change":"2024-03-30T13:11:41.056650+0000","last_active":"2024-03-30T13:11:46.878997+0000","last_peered":"2024-03-30T13:11:46.878997+0000","last_clean":"2024-03-30T13:11:46.878997+0000","last_became_active":"2024-03-30T13:11:41.056039+0000","last_became_peered":"2024-03-30T13:11:41.056039+0000","last_unstale":"2024-03-30T13:11:46.878997+0000","last_undegraded":"2024-03-30T13:11:46.878997+0000","last_fullsized":"2024-03-30T13:11:46.878997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:17:03.655789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879619+0000","last_change":"2024-03-30T13:11:40.054357+0000","last_active":"2024-03-30T13:11:46.879619+0000","last_peered":"2024-03-30T13:11:46.879619+0000","last_clean":"2024-03-30T13:11:46.879619+0000","last_became_active":"2024-03-30T13:11:40.054059+0000","last_became_peered":"2024-03-30T13:11:40.054059+0000","last_unstale":"2024-03-30T13:11:46.879619+0000","last_undegraded":"2024-03-30T13:11:46.879619+0000","last_fullsized":"2024-03-30T13:11:46.879619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:49:27.793465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876330+0000","last_change":"2024-03-30T13:11:45.118213+0000","last_active":"2024-03-30T13:11:46.876330+0000","last_peered":"2024-03-30T13:11:46.876330+0000","last_clean":"2024-03-30T13:11:46.876330+0000","last_became_active":"2024-03-30T13:11:45.117767+0000","last_became_peered":"2024-03-30T13:11:45.117767+0000","last_unstale":"2024-03-30T13:11:46.876330+0000","last_undegraded":"2024-03-30T13:11:46.876330+0000","last_fullsized":"2024-03-30T13:11:46.876330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:06:10.320614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875760+0000","last_change":"2024-03-30T13:11:41.034348+0000","last_active":"2024-03-30T13:11:46.875760+0000","last_peered":"2024-03-30T13:11:46.875760+0000","last_clean":"2024-03-30T13:11:46.875760+0000","last_became_active":"2024-03-30T13:11:41.033932+0000","last_became_peered":"2024-03-30T13:11:41.033932+0000","last_unstale":"2024-03-30T13:11:46.875760+0000","last_undegraded":"2024-03-30T13:11:46.875760+0000","last_fullsized":"2024-03-30T13:11:46.875760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:42.594649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876009+0000","last_change":"2024-03-30T13:11:40.051550+0000","last_active":"2024-03-30T13:11:46.876009+0000","last_peered":"2024-03-30T13:11:46.876009+0000","last_clean":"2024-03-30T13:11:46.876009+0000","last_became_active":"2024-03-30T13:11:40.051234+0000","last_became_peered":"2024-03-30T13:11:40.051234+0000","last_unstale":"2024-03-30T13:11:46.876009+0000","last_undegraded":"2024-03-30T13:11:46.876009+0000","last_fullsized":"2024-03-30T13:11:46.876009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:27.119414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877003+0000","last_change":"2024-03-30T13:11:45.119951+0000","last_active":"2024-03-30T13:11:46.877003+0000","last_peered":"2024-03-30T13:11:46.877003+0000","last_clean":"2024-03-30T13:11:46.877003+0000","last_became_active":"2024-03-30T13:11:45.111516+0000","last_became_peered":"2024-03-30T13:11:45.111516+0000","last_unstale":"2024-03-30T13:11:46.877003+0000","last_undegraded":"2024-03-30T13:11:46.877003+0000","last_fullsized":"2024-03-30T13:11:46.877003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:02:40.515040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729368+0000","last_change":"2024-03-30T13:11:41.042344+0000","last_active":"2024-03-30T13:11:46.729368+0000","last_peered":"2024-03-30T13:11:46.729368+0000","last_clean":"2024-03-30T13:11:46.729368+0000","last_became_active":"2024-03-30T13:11:41.042069+0000","last_became_peered":"2024-03-30T13:11:41.042069+0000","last_unstale":"2024-03-30T13:11:46.729368+0000","last_undegraded":"2024-03-30T13:11:46.729368+0000","last_fullsized":"2024-03-30T13:11:46.729368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:58:30.289414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100827+0000","last_change":"2024-03-30T13:11:40.058392+0000","last_active":"2024-03-30T13:11:46.100827+0000","last_peered":"2024-03-30T13:11:46.100827+0000","last_clean":"2024-03-30T13:11:46.100827+0000","last_became_active":"2024-03-30T13:11:40.058061+0000","last_became_peered":"2024-03-30T13:11:40.058061+0000","last_unstale":"2024-03-30T13:11:46.100827+0000","last_undegraded":"2024-03-30T13:11:46.100827+0000","last_fullsized":"2024-03-30T13:11:46.100827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:48.743642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730652+0000","last_change":"2024-03-30T13:11:45.116598+0000","last_active":"2024-03-30T13:11:46.730652+0000","last_peered":"2024-03-30T13:11:46.730652+0000","last_clean":"2024-03-30T13:11:46.730652+0000","last_became_active":"2024-03-30T13:11:45.114214+0000","last_became_peered":"2024-03-30T13:11:45.114214+0000","last_unstale":"2024-03-30T13:11:46.730652+0000","last_undegraded":"2024-03-30T13:11:46.730652+0000","last_fullsized":"2024-03-30T13:11:46.730652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:41.073690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101902+0000","last_change":"2024-03-30T13:11:41.053875+0000","last_active":"2024-03-30T13:11:46.101902+0000","last_peered":"2024-03-30T13:11:46.101902+0000","last_clean":"2024-03-30T13:11:46.101902+0000","last_became_active":"2024-03-30T13:11:41.053564+0000","last_became_peered":"2024-03-30T13:11:41.053564+0000","last_unstale":"2024-03-30T13:11:46.101902+0000","last_undegraded":"2024-03-30T13:11:46.101902+0000","last_fullsized":"2024-03-30T13:11:46.101902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:21.432848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880378+0000","last_change":"2024-03-30T13:11:40.052525+0000","last_active":"2024-03-30T13:11:46.880378+0000","last_peered":"2024-03-30T13:11:46.880378+0000","last_clean":"2024-03-30T13:11:46.880378+0000","last_became_active":"2024-03-30T13:11:40.052228+0000","last_became_peered":"2024-03-30T13:11:40.052228+0000","last_unstale":"2024-03-30T13:11:46.880378+0000","last_undegraded":"2024-03-30T13:11:46.880378+0000","last_fullsized":"2024-03-30T13:11:46.880378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:37:31.772967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101036+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:11:46.101036+0000","last_peered":"2024-03-30T13:11:46.101036+0000","last_clean":"2024-03-30T13:11:46.101036+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:11:46.101036+0000","last_undegraded":"2024-03-30T13:11:46.101036+0000","last_fullsized":"2024-03-30T13:11:46.101036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105800+0000","last_change":"2024-03-30T13:11:45.115266+0000","last_active":"2024-03-30T13:11:46.105800+0000","last_peered":"2024-03-30T13:11:46.105800+0000","last_clean":"2024-03-30T13:11:46.105800+0000","last_became_active":"2024-03-30T13:11:45.114824+0000","last_became_peered":"2024-03-30T13:11:45.114824+0000","last_unstale":"2024-03-30T13:11:46.105800+0000","last_undegraded":"2024-03-30T13:11:46.105800+0000","last_fullsized":"2024-03-30T13:11:46.105800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:18:57.086379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101484+0000","last_change":"2024-03-30T13:11:41.064932+0000","last_active":"2024-03-30T13:11:46.101484+0000","last_peered":"2024-03-30T13:11:46.101484+0000","last_clean":"2024-03-30T13:11:46.101484+0000","last_became_active":"2024-03-30T13:11:41.064572+0000","last_became_peered":"2024-03-30T13:11:41.064572+0000","last_unstale":"2024-03-30T13:11:46.101484+0000","last_undegraded":"2024-03-30T13:11:46.101484+0000","last_fullsized":"2024-03-30T13:11:46.101484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:25:57.230503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876099+0000","last_change":"2024-03-30T13:11:40.053963+0000","last_active":"2024-03-30T13:11:46.876099+0000","last_peered":"2024-03-30T13:11:46.876099+0000","last_clean":"2024-03-30T13:11:46.876099+0000","last_became_active":"2024-03-30T13:11:40.053682+0000","last_became_peered":"2024-03-30T13:11:40.053682+0000","last_unstale":"2024-03-30T13:11:46.876099+0000","last_undegraded":"2024-03-30T13:11:46.876099+0000","last_fullsized":"2024-03-30T13:11:46.876099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:37:31.772967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103831+0000","last_change":"2024-03-30T13:11:45.108253+0000","last_active":"2024-03-30T13:11:46.103831+0000","last_peered":"2024-03-30T13:11:46.103831+0000","last_clean":"2024-03-30T13:11:46.103831+0000","last_became_active":"2024-03-30T13:11:45.107313+0000","last_became_peered":"2024-03-30T13:11:45.107313+0000","last_unstale":"2024-03-30T13:11:46.103831+0000","last_undegraded":"2024-03-30T13:11:46.103831+0000","last_fullsized":"2024-03-30T13:11:46.103831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:05:37.374928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880809+0000","last_change":"2024-03-30T13:11:41.043218+0000","last_active":"2024-03-30T13:11:46.880809+0000","last_peered":"2024-03-30T13:11:46.880809+0000","last_clean":"2024-03-30T13:11:46.880809+0000","last_became_active":"2024-03-30T13:11:41.042943+0000","last_became_peered":"2024-03-30T13:11:41.042943+0000","last_unstale":"2024-03-30T13:11:46.880809+0000","last_undegraded":"2024-03-30T13:11:46.880809+0000","last_fullsized":"2024-03-30T13:11:46.880809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:25:57.230503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876549+0000","last_change":"2024-03-30T13:11:40.053353+0000","last_active":"2024-03-30T13:11:46.876549+0000","last_peered":"2024-03-30T13:11:46.876549+0000","last_clean":"2024-03-30T13:11:46.876549+0000","last_became_active":"2024-03-30T13:11:40.052963+0000","last_became_peered":"2024-03-30T13:11:40.052963+0000","last_unstale":"2024-03-30T13:11:46.876549+0000","last_undegraded":"2024-03-30T13:11:46.876549+0000","last_fullsized":"2024-03-30T13:11:46.876549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:17:02.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729934+0000","last_change":"2024-03-30T13:11:45.121685+0000","last_active":"2024-03-30T13:11:46.729934+0000","last_peered":"2024-03-30T13:11:46.729934+0000","last_clean":"2024-03-30T13:11:46.729934+0000","last_became_active":"2024-03-30T13:11:45.121227+0000","last_became_peered":"2024-03-30T13:11:45.121227+0000","last_unstale":"2024-03-30T13:11:46.729934+0000","last_undegraded":"2024-03-30T13:11:46.729934+0000","last_fullsized":"2024-03-30T13:11:46.729934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:06:10.320614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103743+0000","last_change":"2024-03-30T13:11:41.058714+0000","last_active":"2024-03-30T13:11:46.103743+0000","last_peered":"2024-03-30T13:11:46.103743+0000","last_clean":"2024-03-30T13:11:46.103743+0000","last_became_active":"2024-03-30T13:11:41.058349+0000","last_became_peered":"2024-03-30T13:11:41.058349+0000","last_unstale":"2024-03-30T13:11:46.103743+0000","last_undegraded":"2024-03-30T13:11:46.103743+0000","last_fullsized":"2024-03-30T13:11:46.103743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:11:57.137995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875850+0000","last_change":"2024-03-30T13:11:40.062027+0000","last_active":"2024-03-30T13:11:46.875850+0000","last_peered":"2024-03-30T13:11:46.875850+0000","last_clean":"2024-03-30T13:11:46.875850+0000","last_became_active":"2024-03-30T13:11:40.060193+0000","last_became_peered":"2024-03-30T13:11:40.060193+0000","last_unstale":"2024-03-30T13:11:46.875850+0000","last_undegraded":"2024-03-30T13:11:46.875850+0000","last_fullsized":"2024-03-30T13:11:46.875850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:06.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877217+0000","last_change":"2024-03-30T13:11:45.104166+0000","last_active":"2024-03-30T13:11:46.877217+0000","last_peered":"2024-03-30T13:11:46.877217+0000","last_clean":"2024-03-30T13:11:46.877217+0000","last_became_active":"2024-03-30T13:11:45.103571+0000","last_became_peered":"2024-03-30T13:11:45.103571+0000","last_unstale":"2024-03-30T13:11:46.877217+0000","last_undegraded":"2024-03-30T13:11:46.877217+0000","last_fullsized":"2024-03-30T13:11:46.877217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:01:25.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103495+0000","last_change":"2024-03-30T13:11:41.052693+0000","last_active":"2024-03-30T13:11:46.103495+0000","last_peered":"2024-03-30T13:11:46.103495+0000","last_clean":"2024-03-30T13:11:46.103495+0000","last_became_active":"2024-03-30T13:11:41.052258+0000","last_became_peered":"2024-03-30T13:11:41.052258+0000","last_unstale":"2024-03-30T13:11:46.103495+0000","last_undegraded":"2024-03-30T13:11:46.103495+0000","last_fullsized":"2024-03-30T13:11:46.103495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:44:44.472713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879516+0000","last_change":"2024-03-30T13:11:40.046274+0000","last_active":"2024-03-30T13:11:46.879516+0000","last_peered":"2024-03-30T13:11:46.879516+0000","last_clean":"2024-03-30T13:11:46.879516+0000","last_became_active":"2024-03-30T13:11:40.045844+0000","last_became_peered":"2024-03-30T13:11:40.045844+0000","last_unstale":"2024-03-30T13:11:46.879516+0000","last_undegraded":"2024-03-30T13:11:46.879516+0000","last_fullsized":"2024-03-30T13:11:46.879516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:45:28.760784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878179+0000","last_change":"2024-03-30T13:11:45.113899+0000","last_active":"2024-03-30T13:11:46.878179+0000","last_peered":"2024-03-30T13:11:46.878179+0000","last_clean":"2024-03-30T13:11:46.878179+0000","last_became_active":"2024-03-30T13:11:45.113423+0000","last_became_peered":"2024-03-30T13:11:45.113423+0000","last_unstale":"2024-03-30T13:11:46.878179+0000","last_undegraded":"2024-03-30T13:11:46.878179+0000","last_fullsized":"2024-03-30T13:11:46.878179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:25.484425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101335+0000","last_change":"2024-03-30T13:11:41.061174+0000","last_active":"2024-03-30T13:11:46.101335+0000","last_peered":"2024-03-30T13:11:46.101335+0000","last_clean":"2024-03-30T13:11:46.101335+0000","last_became_active":"2024-03-30T13:11:41.053574+0000","last_became_peered":"2024-03-30T13:11:41.053574+0000","last_unstale":"2024-03-30T13:11:46.101335+0000","last_undegraded":"2024-03-30T13:11:46.101335+0000","last_fullsized":"2024-03-30T13:11:46.101335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:07:32.828569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875924+0000","last_change":"2024-03-30T13:11:40.049492+0000","last_active":"2024-03-30T13:11:46.875924+0000","last_peered":"2024-03-30T13:11:46.875924+0000","last_clean":"2024-03-30T13:11:46.875924+0000","last_became_active":"2024-03-30T13:11:40.049222+0000","last_became_peered":"2024-03-30T13:11:40.049222+0000","last_unstale":"2024-03-30T13:11:46.875924+0000","last_undegraded":"2024-03-30T13:11:46.875924+0000","last_fullsized":"2024-03-30T13:11:46.875924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:01:57.621288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730403+0000","last_change":"2024-03-30T13:11:45.118519+0000","last_active":"2024-03-30T13:11:46.730403+0000","last_peered":"2024-03-30T13:11:46.730403+0000","last_clean":"2024-03-30T13:11:46.730403+0000","last_became_active":"2024-03-30T13:11:45.118028+0000","last_became_peered":"2024-03-30T13:11:45.118028+0000","last_unstale":"2024-03-30T13:11:46.730403+0000","last_undegraded":"2024-03-30T13:11:46.730403+0000","last_fullsized":"2024-03-30T13:11:46.730403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:02:40.515040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102577+0000","last_change":"2024-03-30T13:11:41.049512+0000","last_active":"2024-03-30T13:11:46.102577+0000","last_peered":"2024-03-30T13:11:46.102577+0000","last_clean":"2024-03-30T13:11:46.102577+0000","last_became_active":"2024-03-30T13:11:41.047719+0000","last_became_peered":"2024-03-30T13:11:41.047719+0000","last_unstale":"2024-03-30T13:11:46.102577+0000","last_undegraded":"2024-03-30T13:11:46.102577+0000","last_fullsized":"2024-03-30T13:11:46.102577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:59.232981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103016+0000","last_change":"2024-03-30T13:11:40.060417+0000","last_active":"2024-03-30T13:11:46.103016+0000","last_peered":"2024-03-30T13:11:46.103016+0000","last_clean":"2024-03-30T13:11:46.103016+0000","last_became_active":"2024-03-30T13:11:40.058616+0000","last_became_peered":"2024-03-30T13:11:40.058616+0000","last_unstale":"2024-03-30T13:11:46.103016+0000","last_undegraded":"2024-03-30T13:11:46.103016+0000","last_fullsized":"2024-03-30T13:11:46.103016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:37:31.772967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101575+0000","last_change":"2024-03-30T13:11:45.129654+0000","last_active":"2024-03-30T13:11:46.101575+0000","last_peered":"2024-03-30T13:11:46.101575+0000","last_clean":"2024-03-30T13:11:46.101575+0000","last_became_active":"2024-03-30T13:11:45.129190+0000","last_became_peered":"2024-03-30T13:11:45.129190+0000","last_unstale":"2024-03-30T13:11:46.101575+0000","last_undegraded":"2024-03-30T13:11:46.101575+0000","last_fullsized":"2024-03-30T13:11:46.101575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:23.412062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101634+0000","last_change":"2024-03-30T13:11:41.059626+0000","last_active":"2024-03-30T13:11:46.101634+0000","last_peered":"2024-03-30T13:11:46.101634+0000","last_clean":"2024-03-30T13:11:46.101634+0000","last_became_active":"2024-03-30T13:11:41.058446+0000","last_became_peered":"2024-03-30T13:11:41.058446+0000","last_unstale":"2024-03-30T13:11:46.101634+0000","last_undegraded":"2024-03-30T13:11:46.101634+0000","last_fullsized":"2024-03-30T13:11:46.101634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:43.692694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879362+0000","last_change":"2024-03-30T13:11:40.064935+0000","last_active":"2024-03-30T13:11:46.879362+0000","last_peered":"2024-03-30T13:11:46.879362+0000","last_clean":"2024-03-30T13:11:46.879362+0000","last_became_active":"2024-03-30T13:11:40.062970+0000","last_became_peered":"2024-03-30T13:11:40.062970+0000","last_unstale":"2024-03-30T13:11:46.879362+0000","last_undegraded":"2024-03-30T13:11:46.879362+0000","last_fullsized":"2024-03-30T13:11:46.879362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:06.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101509+0000","last_change":"2024-03-30T13:11:45.130017+0000","last_active":"2024-03-30T13:11:46.101509+0000","last_peered":"2024-03-30T13:11:46.101509+0000","last_clean":"2024-03-30T13:11:46.101509+0000","last_became_active":"2024-03-30T13:11:45.129637+0000","last_became_peered":"2024-03-30T13:11:45.129637+0000","last_unstale":"2024-03-30T13:11:46.101509+0000","last_undegraded":"2024-03-30T13:11:46.101509+0000","last_fullsized":"2024-03-30T13:11:46.101509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:08:11.231971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730113+0000","last_change":"2024-03-30T13:11:41.046195+0000","last_active":"2024-03-30T13:11:46.730113+0000","last_peered":"2024-03-30T13:11:46.730113+0000","last_clean":"2024-03-30T13:11:46.730113+0000","last_became_active":"2024-03-30T13:11:41.045855+0000","last_became_peered":"2024-03-30T13:11:41.045855+0000","last_unstale":"2024-03-30T13:11:46.730113+0000","last_undegraded":"2024-03-30T13:11:46.730113+0000","last_fullsized":"2024-03-30T13:11:46.730113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:05:51.376531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730149+0000","last_change":"2024-03-30T13:11:40.055328+0000","last_active":"2024-03-30T13:11:46.730149+0000","last_peered":"2024-03-30T13:11:46.730149+0000","last_clean":"2024-03-30T13:11:46.730149+0000","last_became_active":"2024-03-30T13:11:40.054442+0000","last_became_peered":"2024-03-30T13:11:40.054442+0000","last_unstale":"2024-03-30T13:11:46.730149+0000","last_undegraded":"2024-03-30T13:11:46.730149+0000","last_fullsized":"2024-03-30T13:11:46.730149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:09.731487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881262+0000","last_change":"2024-03-30T13:11:45.111331+0000","last_active":"2024-03-30T13:11:46.881262+0000","last_peered":"2024-03-30T13:11:46.881262+0000","last_clean":"2024-03-30T13:11:46.881262+0000","last_became_active":"2024-03-30T13:11:45.110867+0000","last_became_peered":"2024-03-30T13:11:45.110867+0000","last_unstale":"2024-03-30T13:11:46.881262+0000","last_undegraded":"2024-03-30T13:11:46.881262+0000","last_fullsized":"2024-03-30T13:11:46.881262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:11:08.383284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101293+0000","last_change":"2024-03-30T13:11:41.050261+0000","last_active":"2024-03-30T13:11:46.101293+0000","last_peered":"2024-03-30T13:11:46.101293+0000","last_clean":"2024-03-30T13:11:46.101293+0000","last_became_active":"2024-03-30T13:11:41.049994+0000","last_became_peered":"2024-03-30T13:11:41.049994+0000","last_unstale":"2024-03-30T13:11:46.101293+0000","last_undegraded":"2024-03-30T13:11:46.101293+0000","last_fullsized":"2024-03-30T13:11:46.101293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:05:33.323351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:59.441353+0000","last_change":"2024-03-30T13:11:40.056699+0000","last_active":"2024-03-30T13:11:59.441353+0000","last_peered":"2024-03-30T13:11:59.441353+0000","last_clean":"2024-03-30T13:11:59.441353+0000","last_became_active":"2024-03-30T13:11:40.056278+0000","last_became_peered":"2024-03-30T13:11:40.056278+0000","last_unstale":"2024-03-30T13:11:59.441353+0000","last_undegraded":"2024-03-30T13:11:59.441353+0000","last_fullsized":"2024-03-30T13:11:59.441353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:06.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876228+0000","last_change":"2024-03-30T13:11:45.123273+0000","last_active":"2024-03-30T13:11:46.876228+0000","last_peered":"2024-03-30T13:11:46.876228+0000","last_clean":"2024-03-30T13:11:46.876228+0000","last_became_active":"2024-03-30T13:11:45.121491+0000","last_became_peered":"2024-03-30T13:11:45.121491+0000","last_unstale":"2024-03-30T13:11:46.876228+0000","last_undegraded":"2024-03-30T13:11:46.876228+0000","last_fullsized":"2024-03-30T13:11:46.876228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:33:31.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879397+0000","last_change":"2024-03-30T13:11:41.057070+0000","last_active":"2024-03-30T13:11:46.879397+0000","last_peered":"2024-03-30T13:11:46.879397+0000","last_clean":"2024-03-30T13:11:46.879397+0000","last_became_active":"2024-03-30T13:11:41.056836+0000","last_became_peered":"2024-03-30T13:11:41.056836+0000","last_unstale":"2024-03-30T13:11:46.879397+0000","last_undegraded":"2024-03-30T13:11:46.879397+0000","last_fullsized":"2024-03-30T13:11:46.879397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:28:09.366496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876480+0000","last_change":"2024-03-30T13:11:40.055926+0000","last_active":"2024-03-30T13:11:46.876480+0000","last_peered":"2024-03-30T13:11:46.876480+0000","last_clean":"2024-03-30T13:11:46.876480+0000","last_became_active":"2024-03-30T13:11:40.053853+0000","last_became_peered":"2024-03-30T13:11:40.053853+0000","last_unstale":"2024-03-30T13:11:46.876480+0000","last_undegraded":"2024-03-30T13:11:46.876480+0000","last_fullsized":"2024-03-30T13:11:46.876480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:12.149576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878894+0000","last_change":"2024-03-30T13:11:45.122152+0000","last_active":"2024-03-30T13:11:46.878894+0000","last_peered":"2024-03-30T13:11:46.878894+0000","last_clean":"2024-03-30T13:11:46.878894+0000","last_became_active":"2024-03-30T13:11:45.121264+0000","last_became_peered":"2024-03-30T13:11:45.121264+0000","last_unstale":"2024-03-30T13:11:46.878894+0000","last_undegraded":"2024-03-30T13:11:46.878894+0000","last_fullsized":"2024-03-30T13:11:46.878894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:59:33.643606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730553+0000","last_change":"2024-03-30T13:11:41.068464+0000","last_active":"2024-03-30T13:11:46.730553+0000","last_peered":"2024-03-30T13:11:46.730553+0000","last_clean":"2024-03-30T13:11:46.730553+0000","last_became_active":"2024-03-30T13:11:41.068061+0000","last_became_peered":"2024-03-30T13:11:41.068061+0000","last_unstale":"2024-03-30T13:11:46.730553+0000","last_undegraded":"2024-03-30T13:11:46.730553+0000","last_fullsized":"2024-03-30T13:11:46.730553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:55.484149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881041+0000","last_change":"2024-03-30T13:11:40.062612+0000","last_active":"2024-03-30T13:11:46.881041+0000","last_peered":"2024-03-30T13:11:46.881041+0000","last_clean":"2024-03-30T13:11:46.881041+0000","last_became_active":"2024-03-30T13:11:40.061971+0000","last_became_peered":"2024-03-30T13:11:40.061971+0000","last_unstale":"2024-03-30T13:11:46.881041+0000","last_undegraded":"2024-03-30T13:11:46.881041+0000","last_fullsized":"2024-03-30T13:11:46.881041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:10:46.181474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099913+0000","last_change":"2024-03-30T13:11:45.114995+0000","last_active":"2024-03-30T13:11:46.099913+0000","last_peered":"2024-03-30T13:11:46.099913+0000","last_clean":"2024-03-30T13:11:46.099913+0000","last_became_active":"2024-03-30T13:11:45.114482+0000","last_became_peered":"2024-03-30T13:11:45.114482+0000","last_unstale":"2024-03-30T13:11:46.099913+0000","last_undegraded":"2024-03-30T13:11:46.099913+0000","last_fullsized":"2024-03-30T13:11:46.099913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:29.950161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880748+0000","last_change":"2024-03-30T13:11:41.042685+0000","last_active":"2024-03-30T13:11:46.880748+0000","last_peered":"2024-03-30T13:11:46.880748+0000","last_clean":"2024-03-30T13:11:46.880748+0000","last_became_active":"2024-03-30T13:11:41.042404+0000","last_became_peered":"2024-03-30T13:11:41.042404+0000","last_unstale":"2024-03-30T13:11:46.880748+0000","last_undegraded":"2024-03-30T13:11:46.880748+0000","last_fullsized":"2024-03-30T13:11:46.880748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:18:53.034802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105469+0000","last_change":"2024-03-30T13:11:40.052419+0000","last_active":"2024-03-30T13:11:46.105469+0000","last_peered":"2024-03-30T13:11:46.105469+0000","last_clean":"2024-03-30T13:11:46.105469+0000","last_became_active":"2024-03-30T13:11:40.052072+0000","last_became_peered":"2024-03-30T13:11:40.052072+0000","last_unstale":"2024-03-30T13:11:46.105469+0000","last_undegraded":"2024-03-30T13:11:46.105469+0000","last_fullsized":"2024-03-30T13:11:46.105469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:49:27.793465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099771+0000","last_change":"2024-03-30T13:11:45.125449+0000","last_active":"2024-03-30T13:11:46.099771+0000","last_peered":"2024-03-30T13:11:46.099771+0000","last_clean":"2024-03-30T13:11:46.099771+0000","last_became_active":"2024-03-30T13:11:45.115932+0000","last_became_peered":"2024-03-30T13:11:45.115932+0000","last_unstale":"2024-03-30T13:11:46.099771+0000","last_undegraded":"2024-03-30T13:11:46.099771+0000","last_fullsized":"2024-03-30T13:11:46.099771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:20:14.235523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729971+0000","last_change":"2024-03-30T13:11:45.116967+0000","last_active":"2024-03-30T13:11:46.729971+0000","last_peered":"2024-03-30T13:11:46.729971+0000","last_clean":"2024-03-30T13:11:46.729971+0000","last_became_active":"2024-03-30T13:11:45.116228+0000","last_became_peered":"2024-03-30T13:11:45.116228+0000","last_unstale":"2024-03-30T13:11:46.729971+0000","last_undegraded":"2024-03-30T13:11:46.729971+0000","last_fullsized":"2024-03-30T13:11:46.729971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:32:28.206719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875605+0000","last_change":"2024-03-30T13:11:41.049464+0000","last_active":"2024-03-30T13:11:46.875605+0000","last_peered":"2024-03-30T13:11:46.875605+0000","last_clean":"2024-03-30T13:11:46.875605+0000","last_became_active":"2024-03-30T13:11:41.048486+0000","last_became_peered":"2024-03-30T13:11:41.048486+0000","last_unstale":"2024-03-30T13:11:46.875605+0000","last_undegraded":"2024-03-30T13:11:46.875605+0000","last_fullsized":"2024-03-30T13:11:46.875605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:55.484149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877383+0000","last_change":"2024-03-30T13:11:40.053490+0000","last_active":"2024-03-30T13:11:46.877383+0000","last_peered":"2024-03-30T13:11:46.877383+0000","last_clean":"2024-03-30T13:11:46.877383+0000","last_became_active":"2024-03-30T13:11:40.053256+0000","last_became_peered":"2024-03-30T13:11:40.053256+0000","last_unstale":"2024-03-30T13:11:46.877383+0000","last_undegraded":"2024-03-30T13:11:46.877383+0000","last_fullsized":"2024-03-30T13:11:46.877383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:27.119414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105172+0000","last_change":"2024-03-30T13:11:45.108563+0000","last_active":"2024-03-30T13:11:46.105172+0000","last_peered":"2024-03-30T13:11:46.105172+0000","last_clean":"2024-03-30T13:11:46.105172+0000","last_became_active":"2024-03-30T13:11:45.108155+0000","last_became_peered":"2024-03-30T13:11:45.108155+0000","last_unstale":"2024-03-30T13:11:46.105172+0000","last_undegraded":"2024-03-30T13:11:46.105172+0000","last_fullsized":"2024-03-30T13:11:46.105172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:26:01.282080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100080+0000","last_change":"2024-03-30T13:11:41.067378+0000","last_active":"2024-03-30T13:11:46.100080+0000","last_peered":"2024-03-30T13:11:46.100080+0000","last_clean":"2024-03-30T13:11:46.100080+0000","last_became_active":"2024-03-30T13:11:41.067068+0000","last_became_peered":"2024-03-30T13:11:41.067068+0000","last_unstale":"2024-03-30T13:11:46.100080+0000","last_undegraded":"2024-03-30T13:11:46.100080+0000","last_fullsized":"2024-03-30T13:11:46.100080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:42.594649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100702+0000","last_change":"2024-03-30T13:11:40.057479+0000","last_active":"2024-03-30T13:11:46.100702+0000","last_peered":"2024-03-30T13:11:46.100702+0000","last_clean":"2024-03-30T13:11:46.100702+0000","last_became_active":"2024-03-30T13:11:40.057191+0000","last_became_peered":"2024-03-30T13:11:40.057191+0000","last_unstale":"2024-03-30T13:11:46.100702+0000","last_undegraded":"2024-03-30T13:11:46.100702+0000","last_fullsized":"2024-03-30T13:11:46.100702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:40:48.482839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.104472+0000","last_change":"2024-03-30T13:11:40.059886+0000","last_active":"2024-03-30T13:11:46.104472+0000","last_peered":"2024-03-30T13:11:46.104472+0000","last_clean":"2024-03-30T13:11:46.104472+0000","last_became_active":"2024-03-30T13:11:40.058788+0000","last_became_peered":"2024-03-30T13:11:40.058788+0000","last_unstale":"2024-03-30T13:11:46.104472+0000","last_undegraded":"2024-03-30T13:11:46.104472+0000","last_fullsized":"2024-03-30T13:11:46.104472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:27.119414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730038+0000","last_change":"2024-03-30T13:11:41.061750+0000","last_active":"2024-03-30T13:11:46.730038+0000","last_peered":"2024-03-30T13:11:46.730038+0000","last_clean":"2024-03-30T13:11:46.730038+0000","last_became_active":"2024-03-30T13:11:41.061360+0000","last_became_peered":"2024-03-30T13:11:41.061360+0000","last_unstale":"2024-03-30T13:11:46.730038+0000","last_undegraded":"2024-03-30T13:11:46.730038+0000","last_fullsized":"2024-03-30T13:11:46.730038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:42:07.042799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875906+0000","last_change":"2024-03-30T13:11:45.121807+0000","last_active":"2024-03-30T13:11:46.875906+0000","last_peered":"2024-03-30T13:11:46.875906+0000","last_clean":"2024-03-30T13:11:46.875906+0000","last_became_active":"2024-03-30T13:11:45.121296+0000","last_became_peered":"2024-03-30T13:11:45.121296+0000","last_unstale":"2024-03-30T13:11:46.875906+0000","last_undegraded":"2024-03-30T13:11:46.875906+0000","last_fullsized":"2024-03-30T13:11:46.875906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:47.934200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101407+0000","last_change":"2024-03-30T13:11:40.061323+0000","last_active":"2024-03-30T13:11:46.101407+0000","last_peered":"2024-03-30T13:11:46.101407+0000","last_clean":"2024-03-30T13:11:46.101407+0000","last_became_active":"2024-03-30T13:11:40.059857+0000","last_became_peered":"2024-03-30T13:11:40.059857+0000","last_unstale":"2024-03-30T13:11:46.101407+0000","last_undegraded":"2024-03-30T13:11:46.101407+0000","last_fullsized":"2024-03-30T13:11:46.101407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:57:50.563331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878627+0000","last_change":"2024-03-30T13:11:41.059805+0000","last_active":"2024-03-30T13:11:46.878627+0000","last_peered":"2024-03-30T13:11:46.878627+0000","last_clean":"2024-03-30T13:11:46.878627+0000","last_became_active":"2024-03-30T13:11:41.058849+0000","last_became_peered":"2024-03-30T13:11:41.058849+0000","last_unstale":"2024-03-30T13:11:46.878627+0000","last_undegraded":"2024-03-30T13:11:46.878627+0000","last_fullsized":"2024-03-30T13:11:46.878627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:13.163926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102772+0000","last_change":"2024-03-30T13:11:45.130314+0000","last_active":"2024-03-30T13:11:46.102772+0000","last_peered":"2024-03-30T13:11:46.102772+0000","last_clean":"2024-03-30T13:11:46.102772+0000","last_became_active":"2024-03-30T13:11:45.129546+0000","last_became_peered":"2024-03-30T13:11:45.129546+0000","last_unstale":"2024-03-30T13:11:46.102772+0000","last_undegraded":"2024-03-30T13:11:46.102772+0000","last_fullsized":"2024-03-30T13:11:46.102772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:59.314585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102194+0000","last_change":"2024-03-30T13:11:41.057474+0000","last_active":"2024-03-30T13:11:46.102194+0000","last_peered":"2024-03-30T13:11:46.102194+0000","last_clean":"2024-03-30T13:11:46.102194+0000","last_became_active":"2024-03-30T13:11:41.057248+0000","last_became_peered":"2024-03-30T13:11:41.057248+0000","last_unstale":"2024-03-30T13:11:46.102194+0000","last_undegraded":"2024-03-30T13:11:46.102194+0000","last_fullsized":"2024-03-30T13:11:46.102194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:19:21.066570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876002+0000","last_change":"2024-03-30T13:11:41.044974+0000","last_active":"2024-03-30T13:11:46.876002+0000","last_peered":"2024-03-30T13:11:46.876002+0000","last_clean":"2024-03-30T13:11:46.876002+0000","last_became_active":"2024-03-30T13:11:41.044110+0000","last_became_peered":"2024-03-30T13:11:41.044110+0000","last_unstale":"2024-03-30T13:11:46.876002+0000","last_undegraded":"2024-03-30T13:11:46.876002+0000","last_fullsized":"2024-03-30T13:11:46.876002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:49.757992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880445+0000","last_change":"2024-03-30T13:11:41.051210+0000","last_active":"2024-03-30T13:11:46.880445+0000","last_peered":"2024-03-30T13:11:46.880445+0000","last_clean":"2024-03-30T13:11:46.880445+0000","last_became_active":"2024-03-30T13:11:41.050902+0000","last_became_peered":"2024-03-30T13:11:41.050902+0000","last_unstale":"2024-03-30T13:11:46.880445+0000","last_undegraded":"2024-03-30T13:11:46.880445+0000","last_fullsized":"2024-03-30T13:11:46.880445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:44:44.472713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730069+0000","last_change":"2024-03-30T13:11:41.056828+0000","last_active":"2024-03-30T13:11:46.730069+0000","last_peered":"2024-03-30T13:11:46.730069+0000","last_clean":"2024-03-30T13:11:46.730069+0000","last_became_active":"2024-03-30T13:11:41.055447+0000","last_became_peered":"2024-03-30T13:11:41.055447+0000","last_unstale":"2024-03-30T13:11:46.730069+0000","last_undegraded":"2024-03-30T13:11:46.730069+0000","last_fullsized":"2024-03-30T13:11:46.730069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:29.578558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101808+0000","last_change":"2024-03-30T13:11:41.062703+0000","last_active":"2024-03-30T13:11:46.101808+0000","last_peered":"2024-03-30T13:11:46.101808+0000","last_clean":"2024-03-30T13:11:46.101808+0000","last_became_active":"2024-03-30T13:11:41.062375+0000","last_became_peered":"2024-03-30T13:11:41.062375+0000","last_unstale":"2024-03-30T13:11:46.101808+0000","last_undegraded":"2024-03-30T13:11:46.101808+0000","last_fullsized":"2024-03-30T13:11:46.101808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:59:29.592029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876328+0000","last_change":"2024-03-30T13:11:41.047959+0000","last_active":"2024-03-30T13:11:46.876328+0000","last_peered":"2024-03-30T13:11:46.876328+0000","last_clean":"2024-03-30T13:11:46.876328+0000","last_became_active":"2024-03-30T13:11:41.047563+0000","last_became_peered":"2024-03-30T13:11:41.047563+0000","last_unstale":"2024-03-30T13:11:46.876328+0000","last_undegraded":"2024-03-30T13:11:46.876328+0000","last_fullsized":"2024-03-30T13:11:46.876328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:05:51.376531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.107604+0000","last_change":"2024-03-30T13:11:41.051909+0000","last_active":"2024-03-30T13:11:46.107604+0000","last_peered":"2024-03-30T13:11:46.107604+0000","last_clean":"2024-03-30T13:11:46.107604+0000","last_became_active":"2024-03-30T13:11:41.049935+0000","last_became_peered":"2024-03-30T13:11:41.049935+0000","last_unstale":"2024-03-30T13:11:46.107604+0000","last_undegraded":"2024-03-30T13:11:46.107604+0000","last_fullsized":"2024-03-30T13:11:46.107604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:08:02.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101288+0000","last_change":"2024-03-30T13:11:41.067163+0000","last_active":"2024-03-30T13:11:46.101288+0000","last_peered":"2024-03-30T13:11:46.101288+0000","last_clean":"2024-03-30T13:11:46.101288+0000","last_became_active":"2024-03-30T13:11:41.066912+0000","last_became_peered":"2024-03-30T13:11:41.066912+0000","last_unstale":"2024-03-30T13:11:46.101288+0000","last_undegraded":"2024-03-30T13:11:46.101288+0000","last_fullsized":"2024-03-30T13:11:46.101288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:42:07.042799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877312+0000","last_change":"2024-03-30T13:11:41.047542+0000","last_active":"2024-03-30T13:11:46.877312+0000","last_peered":"2024-03-30T13:11:46.877312+0000","last_clean":"2024-03-30T13:11:46.877312+0000","last_became_active":"2024-03-30T13:11:41.046947+0000","last_became_peered":"2024-03-30T13:11:41.046947+0000","last_unstale":"2024-03-30T13:11:46.877312+0000","last_undegraded":"2024-03-30T13:11:46.877312+0000","last_fullsized":"2024-03-30T13:11:46.877312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:19.146268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100367+0000","last_change":"2024-03-30T13:11:41.068416+0000","last_active":"2024-03-30T13:11:46.100367+0000","last_peered":"2024-03-30T13:11:46.100367+0000","last_clean":"2024-03-30T13:11:46.100367+0000","last_became_active":"2024-03-30T13:11:41.067651+0000","last_became_peered":"2024-03-30T13:11:41.067651+0000","last_unstale":"2024-03-30T13:11:46.100367+0000","last_undegraded":"2024-03-30T13:11:46.100367+0000","last_fullsized":"2024-03-30T13:11:46.100367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:07.157771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878282+0000","last_change":"2024-03-30T13:11:41.037581+0000","last_active":"2024-03-30T13:11:46.878282+0000","last_peered":"2024-03-30T13:11:46.878282+0000","last_clean":"2024-03-30T13:11:46.878282+0000","last_became_active":"2024-03-30T13:11:41.037266+0000","last_became_peered":"2024-03-30T13:11:41.037266+0000","last_unstale":"2024-03-30T13:11:46.878282+0000","last_undegraded":"2024-03-30T13:11:46.878282+0000","last_fullsized":"2024-03-30T13:11:46.878282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:34.039026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729580+0000","last_change":"2024-03-30T13:11:41.053939+0000","last_active":"2024-03-30T13:11:46.729580+0000","last_peered":"2024-03-30T13:11:46.729580+0000","last_clean":"2024-03-30T13:11:46.729580+0000","last_became_active":"2024-03-30T13:11:41.053762+0000","last_became_peered":"2024-03-30T13:11:41.053762+0000","last_unstale":"2024-03-30T13:11:46.729580+0000","last_undegraded":"2024-03-30T13:11:46.729580+0000","last_fullsized":"2024-03-30T13:11:46.729580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:21.432848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.104253+0000","last_change":"2024-03-30T13:11:41.053322+0000","last_active":"2024-03-30T13:11:46.104253+0000","last_peered":"2024-03-30T13:11:46.104253+0000","last_clean":"2024-03-30T13:11:46.104253+0000","last_became_active":"2024-03-30T13:11:41.053016+0000","last_became_peered":"2024-03-30T13:11:41.053016+0000","last_unstale":"2024-03-30T13:11:46.104253+0000","last_undegraded":"2024-03-30T13:11:46.104253+0000","last_fullsized":"2024-03-30T13:11:46.104253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:42:40.947191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102031+0000","last_change":"2024-03-30T13:11:41.048361+0000","last_active":"2024-03-30T13:11:46.102031+0000","last_peered":"2024-03-30T13:11:46.102031+0000","last_clean":"2024-03-30T13:11:46.102031+0000","last_became_active":"2024-03-30T13:11:41.048095+0000","last_became_peered":"2024-03-30T13:11:41.048095+0000","last_unstale":"2024-03-30T13:11:46.102031+0000","last_undegraded":"2024-03-30T13:11:46.102031+0000","last_fullsized":"2024-03-30T13:11:46.102031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:46:04.352790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875772+0000","last_change":"2024-03-30T13:11:41.038135+0000","last_active":"2024-03-30T13:11:46.875772+0000","last_peered":"2024-03-30T13:11:46.875772+0000","last_clean":"2024-03-30T13:11:46.875772+0000","last_became_active":"2024-03-30T13:11:41.036822+0000","last_became_peered":"2024-03-30T13:11:41.036822+0000","last_unstale":"2024-03-30T13:11:46.875772+0000","last_undegraded":"2024-03-30T13:11:46.875772+0000","last_fullsized":"2024-03-30T13:11:46.875772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:36:52.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881424+0000","last_change":"2024-03-30T13:11:41.048493+0000","last_active":"2024-03-30T13:11:46.881424+0000","last_peered":"2024-03-30T13:11:46.881424+0000","last_clean":"2024-03-30T13:11:46.881424+0000","last_became_active":"2024-03-30T13:11:41.047123+0000","last_became_peered":"2024-03-30T13:11:41.047123+0000","last_unstale":"2024-03-30T13:11:46.881424+0000","last_undegraded":"2024-03-30T13:11:46.881424+0000","last_fullsized":"2024-03-30T13:11:46.881424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:46:04.352790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877192+0000","last_change":"2024-03-30T13:11:41.047289+0000","last_active":"2024-03-30T13:11:46.877192+0000","last_peered":"2024-03-30T13:11:46.877192+0000","last_clean":"2024-03-30T13:11:46.877192+0000","last_became_active":"2024-03-30T13:11:41.046589+0000","last_became_peered":"2024-03-30T13:11:41.046589+0000","last_unstale":"2024-03-30T13:11:46.877192+0000","last_undegraded":"2024-03-30T13:11:46.877192+0000","last_fullsized":"2024-03-30T13:11:46.877192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:08:02.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875723+0000","last_change":"2024-03-30T13:11:41.052085+0000","last_active":"2024-03-30T13:11:46.875723+0000","last_peered":"2024-03-30T13:11:46.875723+0000","last_clean":"2024-03-30T13:11:46.875723+0000","last_became_active":"2024-03-30T13:11:41.051800+0000","last_became_peered":"2024-03-30T13:11:41.051800+0000","last_unstale":"2024-03-30T13:11:46.875723+0000","last_undegraded":"2024-03-30T13:11:46.875723+0000","last_fullsized":"2024-03-30T13:11:46.875723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:07.157771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730017+0000","last_change":"2024-03-30T13:11:41.052282+0000","last_active":"2024-03-30T13:11:46.730017+0000","last_peered":"2024-03-30T13:11:46.730017+0000","last_clean":"2024-03-30T13:11:46.730017+0000","last_became_active":"2024-03-30T13:11:41.052009+0000","last_became_peered":"2024-03-30T13:11:41.052009+0000","last_unstale":"2024-03-30T13:11:46.730017+0000","last_undegraded":"2024-03-30T13:11:46.730017+0000","last_fullsized":"2024-03-30T13:11:46.730017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:14:06.832559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102678+0000","last_change":"2024-03-30T13:11:41.050105+0000","last_active":"2024-03-30T13:11:46.102678+0000","last_peered":"2024-03-30T13:11:46.102678+0000","last_clean":"2024-03-30T13:11:46.102678+0000","last_became_active":"2024-03-30T13:11:41.048387+0000","last_became_peered":"2024-03-30T13:11:41.048387+0000","last_unstale":"2024-03-30T13:11:46.102678+0000","last_undegraded":"2024-03-30T13:11:46.102678+0000","last_fullsized":"2024-03-30T13:11:46.102678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:55.484149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879166+0000","last_change":"2024-03-30T13:11:41.055816+0000","last_active":"2024-03-30T13:11:46.879166+0000","last_peered":"2024-03-30T13:11:46.879166+0000","last_clean":"2024-03-30T13:11:46.879166+0000","last_became_active":"2024-03-30T13:11:41.051061+0000","last_became_peered":"2024-03-30T13:11:41.051061+0000","last_unstale":"2024-03-30T13:11:46.879166+0000","last_undegraded":"2024-03-30T13:11:46.879166+0000","last_fullsized":"2024-03-30T13:11:46.879166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:49.178652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.106145+0000","last_change":"2024-03-30T13:11:41.061725+0000","last_active":"2024-03-30T13:11:46.106145+0000","last_peered":"2024-03-30T13:11:46.106145+0000","last_clean":"2024-03-30T13:11:46.106145+0000","last_became_active":"2024-03-30T13:11:41.061432+0000","last_became_peered":"2024-03-30T13:11:41.061432+0000","last_unstale":"2024-03-30T13:11:46.106145+0000","last_undegraded":"2024-03-30T13:11:46.106145+0000","last_fullsized":"2024-03-30T13:11:46.106145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:13:46.043702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.107474+0000","last_change":"2024-03-30T13:11:41.060125+0000","last_active":"2024-03-30T13:11:46.107474+0000","last_peered":"2024-03-30T13:11:46.107474+0000","last_clean":"2024-03-30T13:11:46.107474+0000","last_became_active":"2024-03-30T13:11:41.059839+0000","last_became_peered":"2024-03-30T13:11:41.059839+0000","last_unstale":"2024-03-30T13:11:46.107474+0000","last_undegraded":"2024-03-30T13:11:46.107474+0000","last_fullsized":"2024-03-30T13:11:46.107474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:19.146268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103554+0000","last_change":"2024-03-30T13:11:41.066403+0000","last_active":"2024-03-30T13:11:46.103554+0000","last_peered":"2024-03-30T13:11:46.103554+0000","last_clean":"2024-03-30T13:11:46.103554+0000","last_became_active":"2024-03-30T13:11:41.066148+0000","last_became_peered":"2024-03-30T13:11:41.066148+0000","last_unstale":"2024-03-30T13:11:46.103554+0000","last_undegraded":"2024-03-30T13:11:46.103554+0000","last_fullsized":"2024-03-30T13:11:46.103554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:23:32.604365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099258+0000","last_change":"2024-03-30T13:11:41.072872+0000","last_active":"2024-03-30T13:11:46.099258+0000","last_peered":"2024-03-30T13:11:46.099258+0000","last_clean":"2024-03-30T13:11:46.099258+0000","last_became_active":"2024-03-30T13:11:41.066749+0000","last_became_peered":"2024-03-30T13:11:41.066749+0000","last_unstale":"2024-03-30T13:11:46.099258+0000","last_undegraded":"2024-03-30T13:11:46.099258+0000","last_fullsized":"2024-03-30T13:11:46.099258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:14:06.832559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101194+0000","last_change":"2024-03-30T13:11:41.051881+0000","last_active":"2024-03-30T13:11:46.101194+0000","last_peered":"2024-03-30T13:11:46.101194+0000","last_clean":"2024-03-30T13:11:46.101194+0000","last_became_active":"2024-03-30T13:11:41.051569+0000","last_became_peered":"2024-03-30T13:11:41.051569+0000","last_unstale":"2024-03-30T13:11:46.101194+0000","last_undegraded":"2024-03-30T13:11:46.101194+0000","last_fullsized":"2024-03-30T13:11:46.101194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:48:13.158195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878052+0000","last_change":"2024-03-30T13:11:41.052969+0000","last_active":"2024-03-30T13:11:46.878052+0000","last_peered":"2024-03-30T13:11:46.878052+0000","last_clean":"2024-03-30T13:11:46.878052+0000","last_became_active":"2024-03-30T13:11:41.052626+0000","last_became_peered":"2024-03-30T13:11:41.052626+0000","last_unstale":"2024-03-30T13:11:46.878052+0000","last_undegraded":"2024-03-30T13:11:46.878052+0000","last_fullsized":"2024-03-30T13:11:46.878052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:12.520741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101308+0000","last_change":"2024-03-30T13:11:41.044957+0000","last_active":"2024-03-30T13:11:46.101308+0000","last_peered":"2024-03-30T13:11:46.101308+0000","last_clean":"2024-03-30T13:11:46.101308+0000","last_became_active":"2024-03-30T13:11:41.044658+0000","last_became_peered":"2024-03-30T13:11:41.044658+0000","last_unstale":"2024-03-30T13:11:46.101308+0000","last_undegraded":"2024-03-30T13:11:46.101308+0000","last_fullsized":"2024-03-30T13:11:46.101308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:18:53.034802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880588+0000","last_change":"2024-03-30T13:11:41.056707+0000","last_active":"2024-03-30T13:11:46.880588+0000","last_peered":"2024-03-30T13:11:46.880588+0000","last_clean":"2024-03-30T13:11:46.880588+0000","last_became_active":"2024-03-30T13:11:41.055440+0000","last_became_peered":"2024-03-30T13:11:41.055440+0000","last_unstale":"2024-03-30T13:11:46.880588+0000","last_undegraded":"2024-03-30T13:11:46.880588+0000","last_fullsized":"2024-03-30T13:11:46.880588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:07:32.828569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729706+0000","last_change":"2024-03-30T13:11:41.046907+0000","last_active":"2024-03-30T13:11:46.729706+0000","last_peered":"2024-03-30T13:11:46.729706+0000","last_clean":"2024-03-30T13:11:46.729706+0000","last_became_active":"2024-03-30T13:11:41.046092+0000","last_became_peered":"2024-03-30T13:11:41.046092+0000","last_unstale":"2024-03-30T13:11:46.729706+0000","last_undegraded":"2024-03-30T13:11:46.729706+0000","last_fullsized":"2024-03-30T13:11:46.729706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:04:23.461918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876628+0000","last_change":"2024-03-30T13:11:41.043762+0000","last_active":"2024-03-30T13:11:46.876628+0000","last_peered":"2024-03-30T13:11:46.876628+0000","last_clean":"2024-03-30T13:11:46.876628+0000","last_became_active":"2024-03-30T13:11:41.043468+0000","last_became_peered":"2024-03-30T13:11:41.043468+0000","last_unstale":"2024-03-30T13:11:46.876628+0000","last_undegraded":"2024-03-30T13:11:46.876628+0000","last_fullsized":"2024-03-30T13:11:46.876628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:29.578558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103044+0000","last_change":"2024-03-30T13:11:41.051937+0000","last_active":"2024-03-30T13:11:46.103044+0000","last_peered":"2024-03-30T13:11:46.103044+0000","last_clean":"2024-03-30T13:11:46.103044+0000","last_became_active":"2024-03-30T13:11:41.051536+0000","last_became_peered":"2024-03-30T13:11:41.051536+0000","last_unstale":"2024-03-30T13:11:46.103044+0000","last_undegraded":"2024-03-30T13:11:46.103044+0000","last_fullsized":"2024-03-30T13:11:46.103044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:49:02.326260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":701669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":110809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":110845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":110879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":701725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:12:10.290 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-30T13:12:10.291 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-30T13:12:10.291 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-30T13:12:10.291 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-30T13:12:10.291 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-30T13:12:10.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.556+0000 7f0bb5e00640 1 Processor -- start 2024-03-30T13:12:10.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.557+0000 7f0bb5e00640 1 -- start start 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.558+0000 7f0bb5e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0bb00d0d30 0x7f0bb00cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.558+0000 7f0bb5e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb00d4950 0x7f0bb0161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.558+0000 7f0bb5e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb00b5b60 con 0x7f0bb00d1110 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.558+0000 7f0bb5e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb00c7b90 con 0x7f0bb00d0d30 2024-03-30T13:12:10.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.558+0000 7f0bb5e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb00d4fc0 con 0x7f0bb00d4950 2024-03-30T13:12:10.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.559+0000 7f0bb4a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0bb00d0d30 0x7f0bb00cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.559+0000 7f0bb5400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0bb00d1110 0x7f0bb00b3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56786/0 (socket says 172.21.15.44:56786) 2024-03-30T13:12:10.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.559+0000 7f0bb5400640 1 -- 172.21.15.44:0/1059397774 learned_addr learned my addr 172.21.15.44:0/1059397774 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:10.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.559+0000 7f0bafe00640 1 --2- 172.21.15.44:0/1059397774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb00d4950 0x7f0bb0161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.559+0000 7f0baf400640 1 -- 172.21.15.44:0/1059397774 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 960708960 0 0) 0x7f0bb00b5b60 con 0x7f0bb00d1110 2024-03-30T13:12:10.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.559+0000 7f0baf400640 1 -- 172.21.15.44:0/1059397774 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b94003520 con 0x7f0bb00d1110 2024-03-30T13:12:10.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.559+0000 7f0bb4a00640 1 -- 172.21.15.44:0/1059397774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb00d4950 msgr2=0x7f0bb0161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:10.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.559+0000 7f0bb4a00640 1 --2- 172.21.15.44:0/1059397774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb00d4950 0x7f0bb0161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.559+0000 7f0bb4a00640 1 -- 172.21.15.44:0/1059397774 >> v1:172.21.15.44:6789/0 conn(0x7f0bb00d1110 legacy=0x7f0bb00b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.559+0000 7f0bb4a00640 1 -- 172.21.15.44:0/1059397774 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb00b57f0 con 0x7f0bb00d0d30 2024-03-30T13:12:10.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.561+0000 7f0bb4a00640 1 --2- 172.21.15.44:0/1059397774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bb00d0d30 0x7f0bb00cfde0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0b980097a0 tx=0x7f0b9802b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b11c4e9cafb7a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:10.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.561+0000 7f0baf400640 1 -- 172.21.15.44:0/1059397774 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b98034070 con 0x7f0bb00d0d30 2024-03-30T13:12:10.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.561+0000 7f0baf400640 1 -- 172.21.15.44:0/1059397774 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b98030800 con 0x7f0bb00d0d30 2024-03-30T13:12:10.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.561+0000 7f0baf400640 1 -- 172.21.15.44:0/1059397774 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b98030bd0 con 0x7f0bb00d0d30 2024-03-30T13:12:10.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.561+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1059397774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bb00d0d30 msgr2=0x7f0bb00cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.561+0000 7f0bb5e00640 1 --2- 172.21.15.44:0/1059397774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bb00d0d30 0x7f0bb00cfde0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0b980097a0 tx=0x7f0b9802b940 comp rx=0 tx=0).stop 2024-03-30T13:12:10.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.562+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1059397774 shutdown_connections 2024-03-30T13:12:10.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.562+0000 7f0bb5e00640 1 --2- 172.21.15.44:0/1059397774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb00d4950 0x7f0bb0161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.562+0000 7f0bb5e00640 1 --2- 172.21.15.44:0/1059397774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bb00d0d30 0x7f0bb00cfde0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.562+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1059397774 >> 172.21.15.44:0/1059397774 conn(0x7f0bb009d570 msgr2=0x7f0bb00d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:10.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.562+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1059397774 shutdown_connections 2024-03-30T13:12:10.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.562+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1059397774 wait complete. 2024-03-30T13:12:10.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.563+0000 7f0bb5e00640 1 Processor -- start 2024-03-30T13:12:10.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.563+0000 7f0bb5e00640 1 -- start start 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.564+0000 7f0bb5e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb00d0d30 0x7f0bb01f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.564+0000 7f0bb5e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bb00d1110 0x7f0bb00c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.564+0000 7f0bb5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bb00d4950 0x7f0bb00c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.564+0000 7f0bb5e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb00b3300 con 0x7f0bb00d4950 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.564+0000 7f0bb5e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb00b3180 con 0x7f0bb00d1110 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.564+0000 7f0bb5e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb00d3150 con 0x7f0bb00d0d30 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.565+0000 7f0bb5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bb00d4950 0x7f0bb00c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.565+0000 7f0bb5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bb00d4950 0x7f0bb00c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39160/0 (socket says 172.21.15.44:39160) 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.565+0000 7f0bb5400640 1 -- 172.21.15.44:0/1765959694 learned_addr learned my addr 172.21.15.44:0/1765959694 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.565+0000 7f0bafe00640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bb00d1110 0x7f0bb00c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.565+0000 7f0bb4a00640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb00d0d30 0x7f0bb01f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.565+0000 7f0bb5400640 1 -- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb00d0d30 msgr2=0x7f0bb01f43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.565+0000 7f0bb5400640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb00d0d30 0x7f0bb01f43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.565+0000 7f0bb5400640 1 -- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bb00d1110 msgr2=0x7f0bb00c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.565+0000 7f0bb5400640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bb00d1110 0x7f0bb00c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.565+0000 7f0bb5400640 1 -- 172.21.15.44:0/1765959694 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb00b9bd0 con 0x7f0bb00d4950 2024-03-30T13:12:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.565+0000 7f0bb4a00640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb00d0d30 0x7f0bb01f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:10.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.565+0000 7f0bb5400640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bb00d4950 0x7f0bb00c9fa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c430 tx=0x7f0ba800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:10.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.566+0000 7f0bacc00640 1 -- 172.21.15.44:0/1765959694 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8017070 con 0x7f0bb00d4950 2024-03-30T13:12:10.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.566+0000 7f0bacc00640 1 -- 172.21.15.44:0/1765959694 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba8005ce0 con 0x7f0bb00d4950 2024-03-30T13:12:10.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.566+0000 7f0bacc00640 1 -- 172.21.15.44:0/1765959694 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8007310 con 0x7f0bb00d4950 2024-03-30T13:12:10.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.566+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1765959694 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb01e7550 con 0x7f0bb00d4950 2024-03-30T13:12:10.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.566+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1765959694 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb01e7b10 con 0x7f0bb00d4950 2024-03-30T13:12:10.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.567+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1765959694 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb006c660 con 0x7f0bb00d4950 2024-03-30T13:12:10.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.568+0000 7f0bacc00640 1 -- 172.21.15.44:0/1765959694 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0ba801a070 con 0x7f0bb00d4950 2024-03-30T13:12:10.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.569+0000 7f0bacc00640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0b8c06c530 0x7f0b8c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:10.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.569+0000 7f0bacc00640 1 -- 172.21.15.44:0/1765959694 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0ba808af60 con 0x7f0bb00d4950 2024-03-30T13:12:10.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.570+0000 7f0bb4a00640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0b8c06c530 0x7f0b8c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:10.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.571+0000 7f0bb4a00640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0b8c06c530 0x7f0b8c06e9f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0b98036000 tx=0x7f0b9803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:10.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.573+0000 7f0bacc00640 1 -- 172.21.15.44:0/1765959694 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0bb006c660 con 0x7f0bb00d4950 2024-03-30T13:12:10.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.833+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1765959694 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0bb0075890 con 0x7f0bb00d4950 2024-03-30T13:12:10.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.839+0000 7f0bacc00640 1 -- 172.21.15.44:0/1765959694 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173740 (secure 0 0 0) 0x7f0ba80591a0 con 0x7f0bb00d4950 2024-03-30T13:12:10.845 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:10.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.844+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0b8c06c530 msgr2=0x7f0b8c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.844+0000 7f0bb5e00640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0b8c06c530 0x7f0b8c06e9f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0b98036000 tx=0x7f0b9803b040 comp rx=0 tx=0).stop 2024-03-30T13:12:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.844+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1765959694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bb00d4950 msgr2=0x7f0bb00c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.844+0000 7f0bb5e00640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bb00d4950 0x7f0bb00c9fa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c430 tx=0x7f0ba800c8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.845+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1765959694 shutdown_connections 2024-03-30T13:12:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.845+0000 7f0bb5e00640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bb00d4950 0x7f0bb00c9fa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.845+0000 7f0bb5e00640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0b8c06c530 0x7f0b8c06e9f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.845+0000 7f0bb5e00640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bb00d1110 0x7f0bb00c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.845+0000 7f0bb5e00640 1 --2- 172.21.15.44:0/1765959694 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bb00d0d30 0x7f0bb01f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.845+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1765959694 >> 172.21.15.44:0/1765959694 conn(0x7f0bb009d570 msgr2=0x7f0bb00b4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.845+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1765959694 shutdown_connections 2024-03-30T13:12:10.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:10.845+0000 7f0bb5e00640 1 -- 172.21.15.44:0/1765959694 wait complete. 2024-03-30T13:12:10.870 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":4285775013},{"type":"v1","addr":"172.21.15.151:6833","nonce":4285775013}]},"active_addr":"172.21.15.151:6833/4285775013","active_change":"2024-03-30T13:11:25.919034+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":3297789643}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":212657865}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":2396669517}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":118690366}]}]} 2024-03-30T13:12:10.874 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-30T13:12:10.874 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-30T13:12:10.874 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:11.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.092+0000 7fe3eca00640 1 Processor -- start 2024-03-30T13:12:11.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.093+0000 7fe3eca00640 1 -- start start 2024-03-30T13:12:11.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.094+0000 7fe3eca00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe3e80d4950 0x7fe3e8161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.094+0000 7fe3eca00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80d1110 0x7fe3e8161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.094+0000 7fe3eca00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e80b5b60 con 0x7fe3e80d0d30 2024-03-30T13:12:11.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.094+0000 7fe3eca00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fe3e80c7b90 con 0x7fe3e80d4950 2024-03-30T13:12:11.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.094+0000 7fe3eca00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e80d4fc0 con 0x7fe3e80d1110 2024-03-30T13:12:11.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.095+0000 7fe3e7400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe3e80d0d30 0x7fe3e80cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56788/0 (socket says 172.21.15.44:56788) 2024-03-30T13:12:11.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.095+0000 7fe3e7400640 1 -- 172.21.15.44:0/1880964062 learned_addr learned my addr 172.21.15.44:0/1880964062 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:11.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.095+0000 7fe3e7e00640 1 --2- 172.21.15.44:0/1880964062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80d1110 0x7fe3e8161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.095+0000 7fe3e6a00640 1 --2- 172.21.15.44:0/1880964062 >> v2:172.21.15.151:3300/0 conn(0x7fe3e80d4950 0x7fe3e8161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.095+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2628363522 0 0) 0x7fe3e80b5b60 con 0x7fe3e80d0d30 2024-03-30T13:12:11.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.095+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3cc003520 con 0x7fe3e80d0d30 2024-03-30T13:12:11.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.095+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2433893361 0 0) 0x7fe3cc003520 con 0x7fe3e80d0d30 2024-03-30T13:12:11.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.095+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80d1110 msgr2=0x7fe3e8161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:11.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.095+0000 7fe3e6000640 1 --2- 172.21.15.44:0/1880964062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80d1110 0x7fe3e8161ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.095+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 >> v2:172.21.15.151:3300/0 conn(0x7fe3e80d4950 msgr2=0x7fe3e8161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.095+0000 7fe3e6000640 1 --2- 172.21.15.44:0/1880964062 >> v2:172.21.15.151:3300/0 conn(0x7fe3e80d4950 0x7fe3e8161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.095+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e80b57f0 con 0x7fe3e80d0d30 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.096+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fe3d8001670 con 0x7fe3e80d0d30 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.096+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 >> v1:172.21.15.44:6789/0 conn(0x7fe3e80d0d30 legacy=0x7fe3e80cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.096+0000 7fe3e6000640 1 --2- 172.21.15.44:0/1880964062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80d1110 0x7fe3cc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.096+0000 7fe3e6000640 1 --2- 172.21.15.44:0/1880964062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3cc003f80 0x7fe3cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.096+0000 7fe3e6000640 1 --2- 172.21.15.44:0/1880964062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3cc004d40 0x7fe3cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.096+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e80c7b90 con 0x7fe3cc004d40 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.096+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e80d4fc0 con 0x7fe3cc003f80 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.096+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe3cc00ba70 con 0x7fe3e80d1110 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.096+0000 7fe3e7e00640 1 --2- 172.21.15.44:0/1880964062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3cc004d40 0x7fe3cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.096+0000 7fe3e6a00640 1 --2- 172.21.15.44:0/1880964062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3cc003f80 0x7fe3cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.096+0000 7fe3e7400640 1 --2- 172.21.15.44:0/1880964062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80d1110 0x7fe3cc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.097+0000 7fe3e7e00640 1 -- 172.21.15.44:0/1880964062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80d1110 msgr2=0x7fe3cc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.097+0000 7fe3e7e00640 1 --2- 172.21.15.44:0/1880964062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80d1110 0x7fe3cc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.097+0000 7fe3e7e00640 1 -- 172.21.15.44:0/1880964062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3cc003f80 msgr2=0x7fe3cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.097+0000 7fe3e7e00640 1 --2- 172.21.15.44:0/1880964062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3cc003f80 0x7fe3cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.097+0000 7fe3e7e00640 1 -- 172.21.15.44:0/1880964062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3cc003520 con 0x7fe3cc004d40 2024-03-30T13:12:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.098+0000 7fe3e7e00640 1 --2- 172.21.15.44:0/1880964062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3cc004d40 0x7fe3cc0051c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009fc0 tx=0x7fe3cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4986b76d328edd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.098+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0039070 con 0x7fe3cc004d40 2024-03-30T13:12:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.098+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e002cc20 con 0x7fe3cc004d40 2024-03-30T13:12:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.098+0000 7fe3e6000640 1 -- 172.21.15.44:0/1880964062 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0009c10 con 0x7fe3cc004d40 2024-03-30T13:12:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.099+0000 7fe3eca00640 1 -- 172.21.15.44:0/1880964062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3cc004d40 msgr2=0x7fe3cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.099+0000 7fe3eca00640 1 --2- 172.21.15.44:0/1880964062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3cc004d40 0x7fe3cc0051c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009fc0 tx=0x7fe3cc005830 comp rx=0 tx=0).stop 2024-03-30T13:12:11.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.099+0000 7fe3e7e00640 1 -- 172.21.15.44:0/1880964062 reap_dead start 2024-03-30T13:12:11.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.099+0000 7fe3eca00640 1 -- 172.21.15.44:0/1880964062 shutdown_connections 2024-03-30T13:12:11.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.099+0000 7fe3eca00640 1 -- 172.21.15.44:0/1880964062 >> 172.21.15.44:0/1880964062 conn(0x7fe3e809d570 msgr2=0x7fe3e80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:11.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.099+0000 7fe3eca00640 1 -- 172.21.15.44:0/1880964062 shutdown_connections 2024-03-30T13:12:11.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.099+0000 7fe3eca00640 1 -- 172.21.15.44:0/1880964062 wait complete. 2024-03-30T13:12:11.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.101+0000 7fe3eca00640 1 Processor -- start 2024-03-30T13:12:11.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.101+0000 7fe3eca00640 1 -- start start 2024-03-30T13:12:11.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3eca00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3e8154b00 0x7fe3e80cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3eca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3e80cc040 0x7fe3e80cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3eca00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80ce170 0x7fe3e81f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3eca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e80d32d0 con 0x7fe3e80cc040 2024-03-30T13:12:11.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3eca00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e80d3150 con 0x7fe3e8154b00 2024-03-30T13:12:11.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3eca00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e80d3450 con 0x7fe3e80ce170 2024-03-30T13:12:11.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3e6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3e80cc040 0x7fe3e80cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3e6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3e80cc040 0x7fe3e80cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39176/0 (socket says 172.21.15.44:39176) 2024-03-30T13:12:11.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3e6a00640 1 -- 172.21.15.44:0/701715719 learned_addr learned my addr 172.21.15.44:0/701715719 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:11.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3e7400640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3e8154b00 0x7fe3e80cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3e7e00640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80ce170 0x7fe3e81f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3e6a00640 1 -- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80ce170 msgr2=0x7fe3e81f76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.102+0000 7fe3e6a00640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80ce170 0x7fe3e81f76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.103+0000 7fe3e6a00640 1 -- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3e8154b00 msgr2=0x7fe3e80cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.103+0000 7fe3e6a00640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3e8154b00 0x7fe3e80cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.103+0000 7fe3e6a00640 1 -- 172.21.15.44:0/701715719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e80cc5c0 con 0x7fe3e80cc040 2024-03-30T13:12:11.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.103+0000 7fe3e6a00640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3e80cc040 0x7fe3e80cdc30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0011660 tx=0x7fe3d0011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:11.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.103+0000 7fe3df400640 1 -- 172.21.15.44:0/701715719 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000f960 con 0x7fe3e80cc040 2024-03-30T13:12:11.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.103+0000 7fe3df400640 1 -- 172.21.15.44:0/701715719 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d000fb00 con 0x7fe3e80cc040 2024-03-30T13:12:11.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.103+0000 7fe3df400640 1 -- 172.21.15.44:0/701715719 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0015460 con 0x7fe3e80cc040 2024-03-30T13:12:11.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.103+0000 7fe3eca00640 1 -- 172.21.15.44:0/701715719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e80c7f60 con 0x7fe3e80cc040 2024-03-30T13:12:11.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.103+0000 7fe3eca00640 1 -- 172.21.15.44:0/701715719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e80ce620 con 0x7fe3e80cc040 2024-03-30T13:12:11.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.105+0000 7fe3eca00640 1 -- 172.21.15.44:0/701715719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e8075890 con 0x7fe3e80cc040 2024-03-30T13:12:11.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.105+0000 7fe3df400640 1 -- 172.21.15.44:0/701715719 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe3d0015600 con 0x7fe3e80cc040 2024-03-30T13:12:11.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.106+0000 7fe3df400640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe3c406c5b0 0x7fe3c406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.106+0000 7fe3df400640 1 -- 172.21.15.44:0/701715719 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe3d008c150 con 0x7fe3e80cc040 2024-03-30T13:12:11.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.107+0000 7fe3e7400640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe3c406c5b0 0x7fe3c406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.108+0000 7fe3e7400640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe3c406c5b0 0x7fe3c406ea70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8004840 tx=0x7fe3d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:11.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.111+0000 7fe3df400640 1 -- 172.21.15.44:0/701715719 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe3d0019030 con 0x7fe3e80cc040 2024-03-30T13:12:11.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.319+0000 7fe3eca00640 1 -- 172.21.15.44:0/701715719 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3e80d0160 con 0x7fe3e80cc040 2024-03-30T13:12:11.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.322+0000 7fe3df400640 1 -- 172.21.15.44:0/701715719 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7fe3d005a5a0 con 0x7fe3e80cc040 2024-03-30T13:12:11.326 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:11.326 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:11.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.324+0000 7fe3eca00640 1 -- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe3c406c5b0 msgr2=0x7fe3c406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.324+0000 7fe3eca00640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe3c406c5b0 0x7fe3c406ea70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8004840 tx=0x7fe3d8009040 comp rx=0 tx=0).stop 2024-03-30T13:12:11.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.324+0000 7fe3eca00640 1 -- 172.21.15.44:0/701715719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3e80cc040 msgr2=0x7fe3e80cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.324+0000 7fe3eca00640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3e80cc040 0x7fe3e80cdc30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0011660 tx=0x7fe3d0011b20 comp rx=0 tx=0).stop 2024-03-30T13:12:11.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.325+0000 7fe3eca00640 1 -- 172.21.15.44:0/701715719 shutdown_connections 2024-03-30T13:12:11.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.325+0000 7fe3eca00640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe3e80ce170 0x7fe3e81f76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.325+0000 7fe3eca00640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe3e80cc040 0x7fe3e80cdc30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.325+0000 7fe3eca00640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe3c406c5b0 0x7fe3c406ea70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.325+0000 7fe3eca00640 1 --2- 172.21.15.44:0/701715719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3e8154b00 0x7fe3e80cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.325+0000 7fe3eca00640 1 -- 172.21.15.44:0/701715719 >> 172.21.15.44:0/701715719 conn(0x7fe3e809d570 msgr2=0x7fe3e8160300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:11.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.325+0000 7fe3eca00640 1 -- 172.21.15.44:0/701715719 shutdown_connections 2024-03-30T13:12:11.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.325+0000 7fe3eca00640 1 -- 172.21.15.44:0/701715719 wait complete. 2024-03-30T13:12:11.350 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-30T13:12:11.350 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:11.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.575+0000 7f32f2000640 1 Processor -- start 2024-03-30T13:12:11.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.575+0000 7f32f2000640 1 -- start start 2024-03-30T13:12:11.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.577+0000 7f32f2000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f32ec145c60 0x7f32ec071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.577+0000 7f32f2000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ec146040 con 0x7f32ec071a60 2024-03-30T13:12:11.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.577+0000 7f32f2000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ec160e50 con 0x7f32ec160830 2024-03-30T13:12:11.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.577+0000 7f32f2000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f32ec071ed0 con 0x7f32ec145c60 2024-03-30T13:12:11.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.577+0000 7f32eaa00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f32ec071a60 0x7f32ec160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56804/0 (socket says 172.21.15.44:56804) 2024-03-30T13:12:11.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.577+0000 7f32eaa00640 1 -- 172.21.15.44:0/268385673 learned_addr learned my addr 172.21.15.44:0/268385673 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:11.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.577+0000 7f32eb400640 1 --2- 172.21.15.44:0/268385673 >> v2:172.21.15.151:3300/0 conn(0x7f32ec145c60 0x7f32ec071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788815223 0 0) 0x7f32ec146040 con 0x7f32ec071a60 2024-03-30T13:12:11.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32d0003520 con 0x7f32ec071a60 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3260855702 0 0) 0x7f32d0003520 con 0x7f32ec071a60 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 >> v2:172.21.15.151:3300/0 conn(0x7f32ec145c60 msgr2=0x7f32ec071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 --2- 172.21.15.44:0/268385673 >> v2:172.21.15.151:3300/0 conn(0x7f32ec145c60 0x7f32ec071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 >> v1:172.21.15.151:6789/0 conn(0x7f32ec160830 legacy=0x7f32ec0ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec15d8b0 con 0x7f32ec071a60 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f32d8001670 con 0x7f32ec071a60 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 >> v1:172.21.15.44:6789/0 conn(0x7f32ec071a60 legacy=0x7f32ec160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 --2- 172.21.15.44:0/268385673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32d00039b0 0x7f32d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 --2- 172.21.15.44:0/268385673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32d0004800 0x7f32d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 --2- 172.21.15.44:0/268385673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32d00051c0 0x7f32d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec071ed0 con 0x7f32d00051c0 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f32d000c160 con 0x7f32d00039b0 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.578+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f32d000c360 con 0x7f32d0004800 2024-03-30T13:12:11.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.579+0000 7f32ebe00640 1 --2- 172.21.15.44:0/268385673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32d00051c0 0x7f32d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.579+0000 7f32eb400640 1 --2- 172.21.15.44:0/268385673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32d00039b0 0x7f32d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.579+0000 7f32eaa00640 1 --2- 172.21.15.44:0/268385673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32d0004800 0x7f32d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.579+0000 7f32ebe00640 1 -- 172.21.15.44:0/268385673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32d0004800 msgr2=0x7f32d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:11.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.579+0000 7f32ebe00640 1 --2- 172.21.15.44:0/268385673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32d0004800 0x7f32d0004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.579+0000 7f32ebe00640 1 -- 172.21.15.44:0/268385673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32d00039b0 msgr2=0x7f32d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:11.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.579+0000 7f32ebe00640 1 --2- 172.21.15.44:0/268385673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32d00039b0 0x7f32d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.579+0000 7f32ebe00640 1 -- 172.21.15.44:0/268385673 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d0003520 con 0x7f32d00051c0 2024-03-30T13:12:11.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.580+0000 7f32ebe00640 1 -- 172.21.15.44:0/268385673 reap_dead start 2024-03-30T13:12:11.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.580+0000 7f32ebe00640 1 --2- 172.21.15.44:0/268385673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32d00051c0 0x7f32d000b9c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f32e4001e50 tx=0x7f32d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bc4fa4f132442 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:11.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.581+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4001a70 con 0x7f32d00051c0 2024-03-30T13:12:11.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.581+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e4003b90 con 0x7f32d00051c0 2024-03-30T13:12:11.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.581+0000 7f32ea000640 1 -- 172.21.15.44:0/268385673 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e40050d0 con 0x7f32d00051c0 2024-03-30T13:12:11.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.581+0000 7f32f2000640 1 -- 172.21.15.44:0/268385673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32d00051c0 msgr2=0x7f32d000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.581+0000 7f32f2000640 1 --2- 172.21.15.44:0/268385673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32d00051c0 0x7f32d000b9c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f32e4001e50 tx=0x7f32d0005830 comp rx=0 tx=0).stop 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.581+0000 7f32f2000640 1 -- 172.21.15.44:0/268385673 shutdown_connections 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.581+0000 7f32f2000640 1 --2- 172.21.15.44:0/268385673 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32d00051c0 0x7f32d000b9c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.581+0000 7f32f2000640 1 -- 172.21.15.44:0/268385673 >> 172.21.15.44:0/268385673 conn(0x7f32ec0b1c90 msgr2=0x7f32ec0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.581+0000 7f32f2000640 1 -- 172.21.15.44:0/268385673 shutdown_connections 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.581+0000 7f32f2000640 1 -- 172.21.15.44:0/268385673 wait complete. 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.583+0000 7f32f2000640 1 Processor -- start 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.583+0000 7f32f2000640 1 -- start start 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.584+0000 7f32f2000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32d00051c0 0x7f32ec0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.584+0000 7f32f2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ec0cdb40 0x7f32ec1420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.584+0000 7f32f2000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ec13f680 0x7f32ec15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.584+0000 7f32f2000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec15d0b0 con 0x7f32ec0cdb40 2024-03-30T13:12:11.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.584+0000 7f32f2000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec15cdd0 con 0x7f32d00051c0 2024-03-30T13:12:11.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.584+0000 7f32f2000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f32ec071520 con 0x7f32ec13f680 2024-03-30T13:12:11.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.585+0000 7f32eaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ec0cdb40 0x7f32ec1420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.585+0000 7f32eaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ec0cdb40 0x7f32ec1420e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39198/0 (socket says 172.21.15.44:39198) 2024-03-30T13:12:11.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.585+0000 7f32eaa00640 1 -- 172.21.15.44:0/2928400217 learned_addr learned my addr 172.21.15.44:0/2928400217 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:11.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.585+0000 7f32eb400640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32d00051c0 0x7f32ec0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.585+0000 7f32ebe00640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ec13f680 0x7f32ec15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.585+0000 7f32eaa00640 1 -- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ec13f680 msgr2=0x7f32ec15b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.585+0000 7f32eaa00640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ec13f680 0x7f32ec15b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.585+0000 7f32eaa00640 1 -- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32d00051c0 msgr2=0x7f32ec0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.585+0000 7f32eaa00640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32d00051c0 0x7f32ec0cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.585+0000 7f32eaa00640 1 -- 172.21.15.44:0/2928400217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec0ce0b0 con 0x7f32ec0cdb40 2024-03-30T13:12:11.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.586+0000 7f32eaa00640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ec0cdb40 0x7f32ec1420e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f32d800d7a0 tx=0x7f32d800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:11.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.586+0000 7f32e3400640 1 -- 172.21.15.44:0/2928400217 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d8019070 con 0x7f32ec0cdb40 2024-03-30T13:12:11.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.586+0000 7f32e3400640 1 -- 172.21.15.44:0/2928400217 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d800de50 con 0x7f32ec0cdb40 2024-03-30T13:12:11.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.586+0000 7f32e3400640 1 -- 172.21.15.44:0/2928400217 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d80047e0 con 0x7f32ec0cdb40 2024-03-30T13:12:11.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.586+0000 7f32f2000640 1 -- 172.21.15.44:0/2928400217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec0ce390 con 0x7f32ec0cdb40 2024-03-30T13:12:11.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.586+0000 7f32f2000640 1 -- 172.21.15.44:0/2928400217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec0ce950 con 0x7f32ec0cdb40 2024-03-30T13:12:11.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.587+0000 7f32f2000640 1 -- 172.21.15.44:0/2928400217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ec075a10 con 0x7f32ec0cdb40 2024-03-30T13:12:11.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.588+0000 7f32e3400640 1 -- 172.21.15.44:0/2928400217 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f32d801c070 con 0x7f32ec0cdb40 2024-03-30T13:12:11.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.589+0000 7f32e3400640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f32cc06c580 0x7f32cc06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:11.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.589+0000 7f32e3400640 1 -- 172.21.15.44:0/2928400217 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f32d808b5d0 con 0x7f32ec0cdb40 2024-03-30T13:12:11.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.590+0000 7f32eb400640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f32cc06c580 0x7f32cc06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:11.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.591+0000 7f32eb400640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f32cc06c580 0x7f32cc06ea40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0cfd50 tx=0x7f32dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:11.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.594+0000 7f32e3400640 1 -- 172.21.15.44:0/2928400217 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f32d8059890 con 0x7f32ec0cdb40 2024-03-30T13:12:11.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.806+0000 7f32f2000640 1 -- 172.21.15.44:0/2928400217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32ec0ca610 con 0x7f32ec0cdb40 2024-03-30T13:12:11.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.809+0000 7f32e3400640 1 -- 172.21.15.44:0/2928400217 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7f32d8059190 con 0x7f32ec0cdb40 2024-03-30T13:12:11.813 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:11.814 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:11.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.812+0000 7f32f2000640 1 -- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f32cc06c580 msgr2=0x7f32cc06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.812+0000 7f32f2000640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f32cc06c580 0x7f32cc06ea40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0cfd50 tx=0x7f32dc008040 comp rx=0 tx=0).stop 2024-03-30T13:12:11.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.812+0000 7f32f2000640 1 -- 172.21.15.44:0/2928400217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ec0cdb40 msgr2=0x7f32ec1420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.812+0000 7f32f2000640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ec0cdb40 0x7f32ec1420e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f32d800d7a0 tx=0x7f32d800dc60 comp rx=0 tx=0).stop 2024-03-30T13:12:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.812+0000 7f32f2000640 1 -- 172.21.15.44:0/2928400217 shutdown_connections 2024-03-30T13:12:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.812+0000 7f32f2000640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ec13f680 0x7f32ec15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.812+0000 7f32f2000640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ec0cdb40 0x7f32ec1420e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.812+0000 7f32f2000640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f32cc06c580 0x7f32cc06ea40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.812+0000 7f32f2000640 1 --2- 172.21.15.44:0/2928400217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32d00051c0 0x7f32ec0cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.812+0000 7f32f2000640 1 -- 172.21.15.44:0/2928400217 >> 172.21.15.44:0/2928400217 conn(0x7f32ec0b1c90 msgr2=0x7f32ec0ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.813+0000 7f32f2000640 1 -- 172.21.15.44:0/2928400217 shutdown_connections 2024-03-30T13:12:11.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:11.813+0000 7f32f2000640 1 -- 172.21.15.44:0/2928400217 wait complete. 2024-03-30T13:12:11.837 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-30T13:12:11.838 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-30T13:12:11.838 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-30T13:12:11.839 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-30T13:12:11.839 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-30T13:12:11.840 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-30T13:12:11.840 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-30T13:12:11.840 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-30T13:12:12.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.149+0000 7f3669c00640 1 Processor -- start 2024-03-30T13:12:12.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.150+0000 7f3669c00640 1 -- start start 2024-03-30T13:12:12.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.152+0000 7f3669c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36640ce330 0x7f3664162d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.152+0000 7f3669c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f366406ed50 0x7f36640717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.153+0000 7f3662a00640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f366415e560 0x7f36640cdc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:54572/0 (socket says 172.21.15.44:54572) 2024-03-30T13:12:12.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.153+0000 7f3662a00640 1 -- 172.21.15.44:0/2780267077 learned_addr learned my addr 172.21.15.44:0/2780267077 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:12.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.153+0000 7f3669c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36640ceb00 con 0x7f366415e560 2024-03-30T13:12:12.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.153+0000 7f3669c00640 1 -- 172.21.15.44:0/2780267077 --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3664163290 con 0x7f366406ed50 2024-03-30T13:12:12.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.153+0000 7f3669c00640 1 -- 172.21.15.44:0/2780267077 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f366406fe00 con 0x7f36640ce330 2024-03-30T13:12:12.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.154+0000 7f3663400640 1 --2- 172.21.15.44:0/2780267077 >> v2:172.21.15.44:3300/0 conn(0x7f366406ed50 0x7f36640717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.154+0000 7f3661600640 1 -- 172.21.15.44:0/2780267077 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369253211 0 0) 0x7f36640ceb00 con 0x7f366415e560 2024-03-30T13:12:12.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.154+0000 7f3661600640 1 -- 172.21.15.44:0/2780267077 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3648003520 con 0x7f366415e560 2024-03-30T13:12:12.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.154+0000 7f3662000640 1 --2- 172.21.15.44:0/2780267077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36640ce330 0x7f3664162d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.155+0000 7f3661600640 1 -- 172.21.15.44:0/2780267077 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1628300580 0 0) 0x7f3648003520 con 0x7f366415e560 2024-03-30T13:12:12.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.155+0000 7f3e41000640 1 Processor -- start 2024-03-30T13:12:12.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.155+0000 7f3e41000640 1 -- start start 2024-03-30T13:12:12.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.155+0000 7f3663400640 1 -- 172.21.15.44:0/2780267077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36640ce330 msgr2=0x7f3664162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.155+0000 7f3663400640 1 --2- 172.21.15.44:0/2780267077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36640ce330 0x7f3664162d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.155+0000 7f3663400640 1 -- 172.21.15.44:0/2780267077 >> v1:172.21.15.151:6789/0 conn(0x7f366415e560 legacy=0x7f36640cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.156+0000 7f42ad600640 1 Processor -- start 2024-03-30T13:12:12.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.157+0000 7f3e41000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3e3c0c3590 0x7f3e3c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.157+0000 7f3e41000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e3c0cf4c0 con 0x7f3e3c166820 2024-03-30T13:12:12.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.157+0000 7f3e41000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e3c164100 con 0x7f3e3c0cf0e0 2024-03-30T13:12:12.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.157+0000 7f3e41000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f3e3c166de0 con 0x7f3e3c0c3590 2024-03-30T13:12:12.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.156+0000 7f3663400640 1 -- 172.21.15.44:0/2780267077 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366406f280 con 0x7f366406ed50 2024-03-30T13:12:12.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.157+0000 7f3663400640 1 --2- 172.21.15.44:0/2780267077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f366406ed50 0x7f36640717b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f365c009d90 tx=0x7f365c02bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683de25accb970d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.158+0000 7f3e39400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3e3c0c3590 0x7f3e3c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.158+0000 7f3e3a800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3e3c166820 0x7f3e3c0d0230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56806/0 (socket says 172.21.15.44:56806) 2024-03-30T13:12:12.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.158+0000 7f3e3a800640 1 -- 172.21.15.44:0/1986508107 learned_addr learned my addr 172.21.15.44:0/1986508107 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:12.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.158+0000 7f3661600640 1 -- 172.21.15.44:0/2780267077 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c039070 con 0x7f366406ed50 2024-03-30T13:12:12.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.157+0000 7f42ad600640 1 -- start start 2024-03-30T13:12:12.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.158+0000 7f3e39400640 1 -- 172.21.15.44:0/1986508107 >> v1:172.21.15.151:6789/0 conn(0x7f3e3c0cf0e0 legacy=0x7f3e3c0c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.158+0000 7f3e39400640 1 -- 172.21.15.44:0/1986508107 >> v1:172.21.15.44:6789/0 conn(0x7f3e3c166820 legacy=0x7f3e3c0d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.158+0000 7f3661600640 1 -- 172.21.15.44:0/2780267077 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c02c810 con 0x7f366406ed50 2024-03-30T13:12:12.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.158+0000 7f3661600640 1 -- 172.21.15.44:0/2780267077 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3650001690 con 0x7f366406ed50 2024-03-30T13:12:12.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.159+0000 7f42ad600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f42a00e30f0 0x7f42a0057dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.158+0000 7f3e39400640 1 -- 172.21.15.44:0/1986508107 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3c1670c0 con 0x7f3e3c0c3590 2024-03-30T13:12:12.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.159+0000 7fd257800640 1 Processor -- start 2024-03-30T13:12:12.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.159+0000 7f42ad600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a003e870 0x7f42a0053c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.159+0000 7f42ad600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a0058300 con 0x7f42a0054160 2024-03-30T13:12:12.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.159+0000 7f42ad600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f42a00585a0 con 0x7f42a00e30f0 2024-03-30T13:12:12.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.159+0000 7f42ad600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f42a0058880 con 0x7f42a003e870 2024-03-30T13:12:12.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.159+0000 7fd257800640 1 -- start start 2024-03-30T13:12:12.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.160+0000 7f3669c00640 1 -- 172.21.15.44:0/2780267077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f366406ed50 msgr2=0x7f36640717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.160+0000 7f3669c00640 1 --2- 172.21.15.44:0/2780267077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f366406ed50 0x7f36640717b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f365c009d90 tx=0x7f365c02bce0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.160+0000 7f42a7400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f42a0054160 0x7f42a00e6c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56808/0 (socket says 172.21.15.44:56808) 2024-03-30T13:12:12.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.160+0000 7f42a6000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a003e870 0x7f42a0053c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.160+0000 7f42a6000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a003e870 0x7f42a0053c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36562/0 (socket says 172.21.15.44:36562) 2024-03-30T13:12:12.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.160+0000 7f42a7400640 1 -- 172.21.15.44:0/42561402 learned_addr learned my addr 172.21.15.44:0/42561402 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:12.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.160+0000 7f42a6a00640 1 --2- 172.21.15.44:0/42561402 >> v2:172.21.15.151:3300/0 conn(0x7f42a00e30f0 0x7f42a0057dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.160+0000 7f3669c00640 1 -- 172.21.15.44:0/2780267077 shutdown_connections 2024-03-30T13:12:12.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.160+0000 7f3669c00640 1 --2- 172.21.15.44:0/2780267077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f366406ed50 0x7f36640717b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.160+0000 7f3669c00640 1 --2- 172.21.15.44:0/2780267077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f36640ce330 0x7f3664162d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.160+0000 7f3669c00640 1 -- 172.21.15.44:0/2780267077 >> 172.21.15.44:0/2780267077 conn(0x7f36640b1c20 msgr2=0x7f36640b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.161+0000 7f42a5600640 1 -- 172.21.15.44:0/42561402 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908019551 0 0) 0x7f42a0058300 con 0x7f42a0054160 2024-03-30T13:12:12.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.161+0000 7f42a5600640 1 -- 172.21.15.44:0/42561402 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f428c003520 con 0x7f42a0054160 2024-03-30T13:12:12.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.161+0000 7f3669c00640 1 -- 172.21.15.44:0/2780267077 shutdown_connections 2024-03-30T13:12:12.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.161+0000 7f792d400640 1 Processor -- start 2024-03-30T13:12:12.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.161+0000 7f42a6a00640 1 -- 172.21.15.44:0/42561402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a003e870 msgr2=0x7f42a0053c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.161+0000 7f42a6a00640 1 --2- 172.21.15.44:0/42561402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a003e870 0x7f42a0053c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.161+0000 7f42a6a00640 1 -- 172.21.15.44:0/42561402 >> v1:172.21.15.44:6789/0 conn(0x7f42a0054160 legacy=0x7f42a00e6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.161+0000 7f42a6a00640 1 -- 172.21.15.44:0/42561402 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a0058b60 con 0x7f42a00e30f0 2024-03-30T13:12:12.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.161+0000 7f3e39400640 1 --2- 172.21.15.44:0/1986508107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c0c3590 0x7f3e3c0ce130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0097a0 tx=0x7f3e2c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d90b77501b61dc3f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.161+0000 7f3669c00640 1 -- 172.21.15.44:0/2780267077 wait complete. 2024-03-30T13:12:12.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.161+0000 7f792d400640 1 -- start start 2024-03-30T13:12:12.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.162+0000 7f3e38a00640 1 -- 172.21.15.44:0/1986508107 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c035020 con 0x7f3e3c0c3590 2024-03-30T13:12:12.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.162+0000 7f3e38a00640 1 -- 172.21.15.44:0/1986508107 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e2c031830 con 0x7f3e3c0c3590 2024-03-30T13:12:12.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.162+0000 7f3e38a00640 1 -- 172.21.15.44:0/1986508107 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c031c00 con 0x7f3e3c0c3590 2024-03-30T13:12:12.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.163+0000 7f42a6a00640 1 --2- 172.21.15.44:0/42561402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a00e30f0 0x7f42a0057dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f42980097a0 tx=0x7f429802b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=828b1339e70c4c91 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.163+0000 7f42a5600640 1 -- 172.21.15.44:0/42561402 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298034070 con 0x7f42a00e30f0 2024-03-30T13:12:12.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.163+0000 7f42a5600640 1 -- 172.21.15.44:0/42561402 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4298030800 con 0x7f42a00e30f0 2024-03-30T13:12:12.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7f42ad600640 1 -- 172.21.15.44:0/42561402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a00e30f0 msgr2=0x7f42a0057dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7f42a5600640 1 -- 172.21.15.44:0/42561402 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298030bd0 con 0x7f42a00e30f0 2024-03-30T13:12:12.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7f42ad600640 1 --2- 172.21.15.44:0/42561402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a00e30f0 0x7f42a0057dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f42980097a0 tx=0x7f429802b940 comp rx=0 tx=0).stop 2024-03-30T13:12:12.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.163+0000 7fd257800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd25015e830 0x7fd2500d23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.163+0000 7fd257800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2500d2920 0x7fd2500b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.163+0000 7fd257800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2500d4040 con 0x7fd2500b6320 2024-03-30T13:12:12.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.163+0000 7fd257800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd2500d2d80 con 0x7fd25015e830 2024-03-30T13:12:12.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.163+0000 7fd257800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd2500b9fd0 con 0x7fd2500d2920 2024-03-30T13:12:12.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7fd255800640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fd2500b6320 0x7fd25006c600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:54588/0 (socket says 172.21.15.44:54588) 2024-03-30T13:12:12.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7fd255800640 1 -- 172.21.15.44:0/1935402633 learned_addr learned my addr 172.21.15.44:0/1935402633 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:12.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7fd254e00640 1 --2- 172.21.15.44:0/1935402633 >> v2:172.21.15.44:3300/0 conn(0x7fd25015e830 0x7fd2500d23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7fd24fe00640 1 --2- 172.21.15.44:0/1935402633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2500d2920 0x7fd2500b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.163+0000 7f792d400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79280cec60 0x7f79280d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7f792d400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79280d3120 con 0x7f792815e7a0 2024-03-30T13:12:12.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7f792d400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79280d3400 con 0x7f79280d3ee0 2024-03-30T13:12:12.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7f792d400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f79280cfc40 con 0x7f79280cec60 2024-03-30T13:12:12.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7f7926800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f792815e7a0 0x7f79280cf3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56814/0 (socket says 172.21.15.44:56814) 2024-03-30T13:12:12.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7f7927200640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f79280d3ee0 0x7f79280b75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:54598/0 (socket says 172.21.15.44:54598) 2024-03-30T13:12:12.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7f7927200640 1 -- 172.21.15.44:0/2761667545 learned_addr learned my addr 172.21.15.44:0/2761667545 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:12.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.165+0000 7f42ad600640 1 -- 172.21.15.44:0/42561402 shutdown_connections 2024-03-30T13:12:12.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.165+0000 7f42ad600640 1 --2- 172.21.15.44:0/42561402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a003e870 0x7f42a0053c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.165+0000 7f42ad600640 1 --2- 172.21.15.44:0/42561402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a00e30f0 0x7f42a0057dc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7f3669c00640 1 Processor -- start 2024-03-30T13:12:12.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.164+0000 7f3669c00640 1 -- start start 2024-03-30T13:12:12.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.165+0000 7f42ad600640 1 -- 172.21.15.44:0/42561402 >> 172.21.15.44:0/42561402 conn(0x7f42a0055a10 msgr2=0x7f42a0055e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.165+0000 7f3e41000640 1 -- 172.21.15.44:0/1986508107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c0c3590 msgr2=0x7f3e3c0ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.165+0000 7f3e41000640 1 --2- 172.21.15.44:0/1986508107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c0c3590 0x7f3e3c0ce130 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0097a0 tx=0x7f3e2c02b8d0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.165+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131920729 0 0) 0x7f79280d3400 con 0x7f79280d3ee0 2024-03-30T13:12:12.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.165+0000 7f7925e00640 1 --2- 172.21.15.44:0/2761667545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79280cec60 0x7f79280d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.165+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f790c003520 con 0x7f79280d3ee0 2024-03-30T13:12:12.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.165+0000 7fd24f400640 1 -- 172.21.15.44:0/1935402633 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2003017526 0 0) 0x7fd2500d4040 con 0x7fd2500b6320 2024-03-30T13:12:12.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.166+0000 7f3e41000640 1 -- 172.21.15.44:0/1986508107 shutdown_connections 2024-03-30T13:12:12.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.166+0000 7f3e41000640 1 --2- 172.21.15.44:0/1986508107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c0c3590 0x7f3e3c0ce130 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.166+0000 7f3e41000640 1 -- 172.21.15.44:0/1986508107 >> 172.21.15.44:0/1986508107 conn(0x7f3e3c06d610 msgr2=0x7f3e3c06da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.165+0000 7f42ad600640 1 -- 172.21.15.44:0/42561402 shutdown_connections 2024-03-30T13:12:12.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.166+0000 7f42ad600640 1 -- 172.21.15.44:0/42561402 wait complete. 2024-03-30T13:12:12.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.166+0000 7f3e41000640 1 -- 172.21.15.44:0/1986508107 shutdown_connections 2024-03-30T13:12:12.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.166+0000 7fd24f400640 1 -- 172.21.15.44:0/1935402633 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd234003520 con 0x7fd2500b6320 2024-03-30T13:12:12.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.166+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1107017316 0 0) 0x7f790c003520 con 0x7f79280d3ee0 2024-03-30T13:12:12.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.166+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79280cec60 msgr2=0x7f79280d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7f7925400640 1 --2- 172.21.15.44:0/2761667545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79280cec60 0x7f79280d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 >> v1:172.21.15.44:6789/0 conn(0x7f792815e7a0 legacy=0x7f79280cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.166+0000 7f3e41000640 1 -- 172.21.15.44:0/1986508107 wait complete. 2024-03-30T13:12:12.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.166+0000 7f3669c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f366406ed50 0x7f366408ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7f3669c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36640ce330 0x7f3664153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7f3669c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f366415e560 0x7f3664159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7f3669c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f366406fb20 con 0x7f36640ce330 2024-03-30T13:12:12.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7f3669c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f366406f840 con 0x7f366415e560 2024-03-30T13:12:12.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7f3669c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f366415e940 con 0x7f366406ed50 2024-03-30T13:12:12.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7f3662a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f366406ed50 0x7f366408ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7f3662000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36640ce330 0x7f3664153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7f3662000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36640ce330 0x7f3664153160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39220/0 (socket says 172.21.15.44:39220) 2024-03-30T13:12:12.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7f3662000640 1 -- 172.21.15.44:0/2658611149 learned_addr learned my addr 172.21.15.44:0/2658611149 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7f3663400640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f366415e560 0x7f3664159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f3662000640 1 -- 172.21.15.44:0/2658611149 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f366406ed50 msgr2=0x7f366408ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f3662000640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f366406ed50 0x7f366408ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f3662000640 1 -- 172.21.15.44:0/2658611149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f366415e560 msgr2=0x7f3664159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f3662000640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f366415e560 0x7f3664159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f3662000640 1 -- 172.21.15.44:0/2658611149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3664153bb0 con 0x7f36640ce330 2024-03-30T13:12:12.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f3662a00640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f366406ed50 0x7f366408ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:12.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f3662000640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36640ce330 0x7f3664153160 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f365400e9b0 tx=0x7f365400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7fe441a00640 1 Processor -- start 2024-03-30T13:12:12.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7fe441a00640 1 -- start start 2024-03-30T13:12:12.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7fc228400640 1 Processor -- start 2024-03-30T13:12:12.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7fc228400640 1 -- start start 2024-03-30T13:12:12.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79280d36e0 con 0x7f79280d3ee0 2024-03-30T13:12:12.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f7920001650 con 0x7f79280d3ee0 2024-03-30T13:12:12.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 >> v1:172.21.15.151:6789/0 conn(0x7f79280d3ee0 legacy=0x7f79280b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f7925400640 1 --2- 172.21.15.44:0/2761667545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f790c0039b0 0x7f790c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f7925400640 1 --2- 172.21.15.44:0/2761667545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f790c004800 0x7f790c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f7925400640 1 --2- 172.21.15.44:0/2761667545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f790c0051c0 0x7f790c0141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7f14f5800640 1 Processor -- start 2024-03-30T13:12:12.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79280cfc40 con 0x7f790c0039b0 2024-03-30T13:12:12.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f790c014870 con 0x7f790c004800 2024-03-30T13:12:12.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7f365aa00640 1 -- 172.21.15.44:0/2658611149 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3654017070 con 0x7f36640ce330 2024-03-30T13:12:12.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7f365aa00640 1 -- 172.21.15.44:0/2658611149 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365400c9a0 con 0x7f36640ce330 2024-03-30T13:12:12.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7f365aa00640 1 -- 172.21.15.44:0/2658611149 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365400cd90 con 0x7f36640ce330 2024-03-30T13:12:12.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7fd24fe00640 1 -- 172.21.15.44:0/1935402633 >> v2:172.21.15.44:3300/0 conn(0x7fd25015e830 msgr2=0x7fd2500d23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7fd24fe00640 1 --2- 172.21.15.44:0/1935402633 >> v2:172.21.15.44:3300/0 conn(0x7fd25015e830 0x7fd2500d23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7fd24fe00640 1 -- 172.21.15.44:0/1935402633 >> v1:172.21.15.151:6789/0 conn(0x7fd2500b6320 legacy=0x7fd25006c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.167+0000 7fd24fe00640 1 -- 172.21.15.44:0/1935402633 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2500d2fa0 con 0x7fd2500d2920 2024-03-30T13:12:12.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7fd24fe00640 1 --2- 172.21.15.44:0/1935402633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2500d2920 0x7fd2500b5de0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd2400097a0 tx=0x7fd24002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd07f51776bb5281 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7fd24f400640 1 -- 172.21.15.44:0/1935402633 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240035020 con 0x7fd2500d2920 2024-03-30T13:12:12.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.168+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f790c014a70 con 0x7f790c0051c0 2024-03-30T13:12:12.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7f42ad600640 1 Processor -- start 2024-03-30T13:12:12.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7fd24f400640 1 -- 172.21.15.44:0/1935402633 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd240031830 con 0x7fd2500d2920 2024-03-30T13:12:12.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7fd24f400640 1 -- 172.21.15.44:0/1935402633 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240031be0 con 0x7fd2500d2920 2024-03-30T13:12:12.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7f7925e00640 1 --2- 172.21.15.44:0/2761667545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79280cec60 0x7f79280d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:12.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7f3e41000640 1 Processor -- start 2024-03-30T13:12:12.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7f3669c00640 1 -- 172.21.15.44:0/2658611149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3664153e90 con 0x7f36640ce330 2024-03-30T13:12:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7fe441a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe43c0d1280 0x7fe43c0d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7fe441a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe43c0cf0f0 0x7fe43c148200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7f3e41000640 1 -- start start 2024-03-30T13:12:12.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7fe441a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe43c1666e0 con 0x7fe43c0d2290 2024-03-30T13:12:12.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7fe441a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe43c0d4200 con 0x7fe43c0d1280 2024-03-30T13:12:12.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7fe441a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fe43c0d1ba0 con 0x7fe43c0cf0f0 2024-03-30T13:12:12.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7fc228400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc2200cf0e0 0x7fc2200ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7fc228400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2200cf4c0 con 0x7fc2200c3590 2024-03-30T13:12:12.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7fc228400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc220164100 con 0x7fc220166820 2024-03-30T13:12:12.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7fc228400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc220166de0 con 0x7fc2200cf0e0 2024-03-30T13:12:12.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7f3669c00640 1 -- 172.21.15.44:0/2658611149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36641584e0 con 0x7f36640ce330 2024-03-30T13:12:12.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7fd257800640 1 -- 172.21.15.44:0/1935402633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2500d2920 msgr2=0x7fd2500b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7fd257800640 1 --2- 172.21.15.44:0/1935402633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2500d2920 0x7fd2500b5de0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd2400097a0 tx=0x7fd24002b8d0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7f7927200640 1 --2- 172.21.15.44:0/2761667545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f790c0051c0 0x7f790c0141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7f7927200640 1 -- 172.21.15.44:0/2761667545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f790c004800 msgr2=0x7f790c004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-30T13:12:12.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7f7927200640 1 --2- 172.21.15.44:0/2761667545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f790c004800 0x7f790c004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7f7927200640 1 -- 172.21.15.44:0/2761667545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f790c0039b0 msgr2=0x7f790c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7f7927200640 1 --2- 172.21.15.44:0/2761667545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f790c0039b0 0x7f790c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7f7927200640 1 -- 172.21.15.44:0/2761667545 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79280d36e0 con 0x7f790c0051c0 2024-03-30T13:12:12.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.171+0000 7f42ad600640 1 -- start start 2024-03-30T13:12:12.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.170+0000 7fc225a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc2200cf0e0 0x7fc2200ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.171+0000 7fc225a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc2200cf0e0 0x7fc2200ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39234/0 (socket says 172.21.15.44:39234) 2024-03-30T13:12:12.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.171+0000 7fc225a00640 1 -- 172.21.15.44:0/967202218 learned_addr learned my addr 172.21.15.44:0/967202218 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.171+0000 7fe43b400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe43c0cf0f0 0x7fe43c148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.171+0000 7fe43aa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe43c0d1280 0x7fe43c0d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.171+0000 7fe43b400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe43c0cf0f0 0x7fe43c148200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:42564/0 (socket says 172.21.15.44:42564) 2024-03-30T13:12:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.171+0000 7fe43b400640 1 -- 172.21.15.44:0/2726336394 learned_addr learned my addr 172.21.15.44:0/2726336394 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.171+0000 7fd257800640 1 -- 172.21.15.44:0/1935402633 shutdown_connections 2024-03-30T13:12:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.171+0000 7fd257800640 1 --2- 172.21.15.44:0/1935402633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2500d2920 0x7fd2500b5de0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.171+0000 7fd257800640 1 --2- 172.21.15.44:0/1935402633 >> v2:172.21.15.44:3300/0 conn(0x7fd25015e830 0x7fd2500d23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.171+0000 7fd257800640 1 -- 172.21.15.44:0/1935402633 >> 172.21.15.44:0/1935402633 conn(0x7fd2500678f0 msgr2=0x7fd2500d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.169+0000 7f14f5800640 1 -- start start 2024-03-30T13:12:12.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7fd257800640 1 -- 172.21.15.44:0/1935402633 shutdown_connections 2024-03-30T13:12:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7f14f5800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f14f00b64f0 0x7f14f0169210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7f14f5800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f00d4040 con 0x7f14f015e830 2024-03-30T13:12:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7f14f5800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f00d2fa0 con 0x7f14f00d2af0 2024-03-30T13:12:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7f14f5800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f14f00b9fd0 con 0x7f14f00b64f0 2024-03-30T13:12:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7f7927200640 1 --2- 172.21.15.44:0/2761667545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f790c0051c0 0x7f790c0141d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f792000c190 tx=0x7f790c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b7163479495ff9f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7fe43b400640 1 -- 172.21.15.44:0/2726336394 >> v2:172.21.15.44:3300/0 conn(0x7fe43c0d1280 msgr2=0x7fe43c0d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7fe43b400640 1 --2- 172.21.15.44:0/2726336394 >> v2:172.21.15.44:3300/0 conn(0x7fe43c0d1280 0x7fe43c0d1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7fe43b400640 1 -- 172.21.15.44:0/2726336394 >> v1:172.21.15.151:6789/0 conn(0x7fe43c0d2290 legacy=0x7fe43c0ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7fe43b400640 1 -- 172.21.15.44:0/2726336394 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c166980 con 0x7fe43c0cf0f0 2024-03-30T13:12:12.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7fd257800640 1 -- 172.21.15.44:0/1935402633 wait complete. 2024-03-30T13:12:12.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2387595835 0 0) 0x7fc220164100 con 0x7fc220166820 2024-03-30T13:12:12.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc208003520 con 0x7fc220166820 2024-03-30T13:12:12.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7f42ad600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42a003e870 0x7f42a0051fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7f42ad600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a0054160 0x7f42a0052930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7f14ef400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f14f00b64f0 0x7f14f0169210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7f14ef400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f14f00b64f0 0x7f14f0169210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:42568/0 (socket says 172.21.15.44:42568) 2024-03-30T13:12:12.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.172+0000 7f14ef400640 1 -- 172.21.15.44:0/2368428541 learned_addr learned my addr 172.21.15.44:0/2368428541 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1796332733 0 0) 0x7fc208003520 con 0x7fc220166820 2024-03-30T13:12:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 >> v2:172.21.15.44:3300/0 conn(0x7fc2200cf0e0 msgr2=0x7fc2200ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 --2- 172.21.15.44:0/967202218 >> v2:172.21.15.44:3300/0 conn(0x7fc2200cf0e0 0x7fc2200ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 >> v1:172.21.15.44:6789/0 conn(0x7fc2200c3590 legacy=0x7fc2200d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7f14ef400640 1 -- 172.21.15.44:0/2368428541 >> v1:172.21.15.151:6789/0 conn(0x7f14f00d2af0 legacy=0x7f14f00b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7f14ef400640 1 -- 172.21.15.44:0/2368428541 >> v1:172.21.15.44:6789/0 conn(0x7f14f015e830 legacy=0x7f14f00d23e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-30T13:12:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7f42ad600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a00e30f0 0x7f42a00d8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7f42ad600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f42a00e34d0 con 0x7f42a003e870 2024-03-30T13:12:12.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2201670c0 con 0x7fc220166820 2024-03-30T13:12:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fc214001670 con 0x7fc220166820 2024-03-30T13:12:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 >> v1:172.21.15.151:6789/0 conn(0x7fc220166820 legacy=0x7fc2200c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 --2- 172.21.15.44:0/967202218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2080039b0 0x7fc208003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 --2- 172.21.15.44:0/967202218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc208004800 0x7fc208004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 --2- 172.21.15.44:0/967202218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2080051c0 0x7fc20800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc220166de0 con 0x7fc2080051c0 2024-03-30T13:12:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc20800c0f0 con 0x7fc2080039b0 2024-03-30T13:12:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc20800c2f0 con 0x7fc208004800 2024-03-30T13:12:12.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7f42a6000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a0054160 0x7f42a0052930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920007c80 con 0x7f790c0051c0 2024-03-30T13:12:12.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7fc225a00640 1 --2- 172.21.15.44:0/967202218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2080039b0 0x7fc208003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7f42ad600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f42a003bff0 con 0x7f42a00e30f0 2024-03-30T13:12:12.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7f42ad600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f42a0007910 con 0x7f42a0054160 2024-03-30T13:12:12.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7f3e41000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e3c0c3590 0x7f3e3c162710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.173+0000 7f3669c00640 1 -- 172.21.15.44:0/2658611149 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f36641540d0 con 0x7f36640ce330 2024-03-30T13:12:12.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7fd257800640 1 Processor -- start 2024-03-30T13:12:12.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7f14ef400640 1 -- 172.21.15.44:0/2368428541 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f00d3280 con 0x7f14f00b64f0 2024-03-30T13:12:12.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7f3e41000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c0cf0e0 0x7f3e3c204380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7fc225000640 1 --2- 172.21.15.44:0/967202218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc208004800 0x7fc208004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7fd257800640 1 -- start start 2024-03-30T13:12:12.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7f3e41000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c166820 0x7f3e3c1ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7f3e41000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c167680 con 0x7f3e3c0c3590 2024-03-30T13:12:12.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7f3e41000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c0cfd10 con 0x7f3e3c0cf0e0 2024-03-30T13:12:12.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7f3e41000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3c0ccf40 con 0x7f3e3c166820 2024-03-30T13:12:12.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.174+0000 7f7925400640 1 -- 172.21.15.44:0/2761667545 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7920030030 con 0x7f790c0051c0 2024-03-30T13:12:12.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7f42a7400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a00e30f0 0x7f42a00d8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7f42a6000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a0054160 0x7f42a0052930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36598/0 (socket says 172.21.15.44:36598) 2024-03-30T13:12:12.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7f42a6000640 1 -- 172.21.15.44:0/3408952877 learned_addr learned my addr 172.21.15.44:0/3408952877 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7f3e3a800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c166820 0x7f3e3c1ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7f3e3a800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c166820 0x7f3e3c1ecf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36620/0 (socket says 172.21.15.44:36620) 2024-03-30T13:12:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7f3e3a800640 1 -- 172.21.15.44:0/424629211 learned_addr learned my addr 172.21.15.44:0/424629211 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7f3e39400640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c0cf0e0 0x7f3e3c204380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7f792d400640 1 -- 172.21.15.44:0/2761667545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f790c0051c0 msgr2=0x7f790c0141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7f792d400640 1 --2- 172.21.15.44:0/2761667545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f790c0051c0 0x7f790c0141d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f792000c190 tx=0x7f790c005830 comp rx=0 tx=0).stop 2024-03-30T13:12:12.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7fc225000640 1 -- 172.21.15.44:0/967202218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2080039b0 msgr2=0x7fc208003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7fc225000640 1 --2- 172.21.15.44:0/967202218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2080039b0 0x7fc208003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7fc225000640 1 -- 172.21.15.44:0/967202218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2080051c0 msgr2=0x7fc20800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7fc225000640 1 --2- 172.21.15.44:0/967202218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2080051c0 0x7fc20800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7fc225000640 1 -- 172.21.15.44:0/967202218 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2201670c0 con 0x7fc208004800 2024-03-30T13:12:12.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7f42a6a00640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42a003e870 0x7f42a0051fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7fd257800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2500b6320 0x7fd2500cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7fd257800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2500d2920 0x7fd2500cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7fd257800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd25015e830 0x7fd2500b9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7fd257800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd2500d3840 con 0x7fd2500b6320 2024-03-30T13:12:12.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7fd257800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd2500d3560 con 0x7fd2500d2920 2024-03-30T13:12:12.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7fd257800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd2500d3b20 con 0x7fd25015e830 2024-03-30T13:12:12.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.175+0000 7f7927200640 1 -- 172.21.15.44:0/2761667545 reap_dead start 2024-03-30T13:12:12.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7fd254e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2500b6320 0x7fd2500cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7fd254e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2500b6320 0x7fd2500cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39282/0 (socket says 172.21.15.44:39282) 2024-03-30T13:12:12.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7fd254e00640 1 -- 172.21.15.44:0/563094823 learned_addr learned my addr 172.21.15.44:0/563094823 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7f792d400640 1 -- 172.21.15.44:0/2761667545 shutdown_connections 2024-03-30T13:12:12.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7f792d400640 1 -- 172.21.15.44:0/2761667545 >> 172.21.15.44:0/2761667545 conn(0x7f79280676b0 msgr2=0x7f7928067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7f14ef400640 1 --2- 172.21.15.44:0/2368428541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f00b64f0 0x7f14f0169210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009e50 tx=0x7f14e802bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c6133ff31b58797 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7fc226400640 1 -- 172.21.15.44:0/967202218 reap_dead start 2024-03-30T13:12:12.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7f3e39e00640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e3c0c3590 0x7f3e3c162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7f792d400640 1 -- 172.21.15.44:0/2761667545 shutdown_connections 2024-03-30T13:12:12.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7fd24fe00640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2500d2920 0x7fd2500cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7f792d400640 1 -- 172.21.15.44:0/2761667545 wait complete. 2024-03-30T13:12:12.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7fe43b400640 1 --2- 172.21.15.44:0/2726336394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe43c0cf0f0 0x7fe43c148200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe43c06ca80 tx=0x7fe43402be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28839f321083474f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7f42a6a00640 1 -- 172.21.15.44:0/3408952877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a0054160 msgr2=0x7f42a0052930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7f42a6a00640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a0054160 0x7f42a0052930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7f42a6a00640 1 -- 172.21.15.44:0/3408952877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a00e30f0 msgr2=0x7f42a00d8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7f42a6a00640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a00e30f0 0x7f42a00d8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7f42a6a00640 1 -- 172.21.15.44:0/3408952877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a017c7b0 con 0x7f42a003e870 2024-03-30T13:12:12.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7f3e3a800640 1 -- 172.21.15.44:0/424629211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c0cf0e0 msgr2=0x7f3e3c204380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7f3e3a800640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c0cf0e0 0x7f3e3c204380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7f3e3a800640 1 -- 172.21.15.44:0/424629211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e3c0c3590 msgr2=0x7f3e3c162710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.176+0000 7f3e3a800640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e3c0c3590 0x7f3e3c162710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7f3e3a800640 1 -- 172.21.15.44:0/424629211 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3c2032e0 con 0x7f3e3c166820 2024-03-30T13:12:12.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7f3e39e00640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e3c0c3590 0x7f3e3c162710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:12.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7fd254e00640 1 -- 172.21.15.44:0/563094823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd25015e830 msgr2=0x7fd2500b9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7fd254e00640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd25015e830 0x7fd2500b9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7fe439600640 1 -- 172.21.15.44:0/2726336394 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43402c9f0 con 0x7fe43c0cf0f0 2024-03-30T13:12:12.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7fe439600640 1 -- 172.21.15.44:0/2726336394 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43402cb90 con 0x7fe43c0cf0f0 2024-03-30T13:12:12.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7fe439600640 1 -- 172.21.15.44:0/2726336394 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4340343f0 con 0x7fe43c0cf0f0 2024-03-30T13:12:12.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7f14ed600640 1 -- 172.21.15.44:0/2368428541 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e802ca80 con 0x7f14f00b64f0 2024-03-30T13:12:12.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7f14ed600640 1 -- 172.21.15.44:0/2368428541 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e802cc20 con 0x7f14f00b64f0 2024-03-30T13:12:12.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7f14ed600640 1 -- 172.21.15.44:0/2368428541 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e802ca80 con 0x7f14f00b64f0 2024-03-30T13:12:12.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7fd254e00640 1 -- 172.21.15.44:0/563094823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2500d2920 msgr2=0x7fd2500cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7fd254e00640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2500d2920 0x7fd2500cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7fd254e00640 1 -- 172.21.15.44:0/563094823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2500cbeb0 con 0x7fd2500b6320 2024-03-30T13:12:12.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fc225000640 1 --2- 172.21.15.44:0/967202218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc208004800 0x7fc208004c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc21400c160 tx=0x7fc208005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa00da0f33d8c98f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.177+0000 7f42a6a00640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42a003e870 0x7f42a0051fa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4298033000 tx=0x7f42980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7f3e3a800640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c166820 0x7f3e3c1ecf20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400ca20 tx=0x7f3e3400cee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7f365aa00640 1 -- 172.21.15.44:0/2658611149 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f365401a070 con 0x7f36640ce330 2024-03-30T13:12:12.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7f429ea00640 1 -- 172.21.15.44:0/3408952877 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298034040 con 0x7f42a003e870 2024-03-30T13:12:12.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fe441a00640 1 -- 172.21.15.44:0/2726336394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe43c0cf0f0 msgr2=0x7fe43c148200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fe441a00640 1 --2- 172.21.15.44:0/2726336394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe43c0cf0f0 0x7fe43c148200 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe43c06ca80 tx=0x7fe43402be50 comp rx=0 tx=0).stop 2024-03-30T13:12:12.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fe441a00640 1 -- 172.21.15.44:0/2726336394 shutdown_connections 2024-03-30T13:12:12.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fe441a00640 1 --2- 172.21.15.44:0/2726336394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe43c0cf0f0 0x7fe43c148200 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fe441a00640 1 --2- 172.21.15.44:0/2726336394 >> v2:172.21.15.44:3300/0 conn(0x7fe43c0d1280 0x7fe43c0d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fe441a00640 1 -- 172.21.15.44:0/2726336394 >> 172.21.15.44:0/2726336394 conn(0x7fe43c0676b0 msgr2=0x7fe43c067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fe441a00640 1 -- 172.21.15.44:0/2726336394 shutdown_connections 2024-03-30T13:12:12.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fe441a00640 1 -- 172.21.15.44:0/2726336394 wait complete. 2024-03-30T13:12:12.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fd254e00640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2500b6320 0x7fd2500cd750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00e8a0 tx=0x7fd23c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7f429ea00640 1 -- 172.21.15.44:0/3408952877 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4298030e40 con 0x7f42a003e870 2024-03-30T13:12:12.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7f42ad600640 1 -- 172.21.15.44:0/3408952877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a017ca90 con 0x7f42a003e870 2024-03-30T13:12:12.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214007c80 con 0x7fc208004800 2024-03-30T13:12:12.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7f792d400640 1 Processor -- start 2024-03-30T13:12:12.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc214030070 con 0x7fc208004800 2024-03-30T13:12:12.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.178+0000 7fc21fe00640 1 -- 172.21.15.44:0/967202218 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21402ccd0 con 0x7fc208004800 2024-03-30T13:12:12.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7f3e32000640 1 -- 172.21.15.44:0/424629211 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e34017070 con 0x7f3e3c166820 2024-03-30T13:12:12.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7f3e32000640 1 -- 172.21.15.44:0/424629211 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3400abd0 con 0x7f3e3c166820 2024-03-30T13:12:12.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7f3e32000640 1 -- 172.21.15.44:0/424629211 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e34012400 con 0x7f3e3c166820 2024-03-30T13:12:12.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7f3e41000640 1 -- 172.21.15.44:0/424629211 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3c2035c0 con 0x7f3e3c166820 2024-03-30T13:12:12.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7f3e41000640 1 -- 172.21.15.44:0/424629211 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e3c203b80 con 0x7f3e3c166820 2024-03-30T13:12:12.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7f14f5800640 1 -- 172.21.15.44:0/2368428541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f00b64f0 msgr2=0x7f14f0169210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7f14f5800640 1 --2- 172.21.15.44:0/2368428541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f00b64f0 0x7f14f0169210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f14e8009e50 tx=0x7f14e802bee0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7f792d400640 1 -- start start 2024-03-30T13:12:12.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7fc228400640 1 -- 172.21.15.44:0/967202218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc208004800 msgr2=0x7fc208004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.179+0000 7fc228400640 1 --2- 172.21.15.44:0/967202218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc208004800 0x7fc208004c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc21400c160 tx=0x7fc208005830 comp rx=0 tx=0).stop 2024-03-30T13:12:12.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.180+0000 7f429ea00640 1 -- 172.21.15.44:0/3408952877 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429802f560 con 0x7f42a003e870 2024-03-30T13:12:12.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.180+0000 7f42ad600640 1 -- 172.21.15.44:0/3408952877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a017d050 con 0x7f42a003e870 2024-03-30T13:12:12.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.180+0000 7f365aa00640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f364406c580 0x7f364406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.180+0000 7fd24cc00640 1 -- 172.21.15.44:0/563094823 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c017070 con 0x7fd2500b6320 2024-03-30T13:12:12.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.180+0000 7fd24cc00640 1 -- 172.21.15.44:0/563094823 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23c00c940 con 0x7fd2500b6320 2024-03-30T13:12:12.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.180+0000 7fd24cc00640 1 -- 172.21.15.44:0/563094823 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00cd30 con 0x7fd2500b6320 2024-03-30T13:12:12.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.180+0000 7fd257800640 1 -- 172.21.15.44:0/563094823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2500cc190 con 0x7fd2500b6320 2024-03-30T13:12:12.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.180+0000 7f14f5800640 1 -- 172.21.15.44:0/2368428541 shutdown_connections 2024-03-30T13:12:12.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.180+0000 7f14f5800640 1 --2- 172.21.15.44:0/2368428541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f00b64f0 0x7f14f0169210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.180+0000 7f14f5800640 1 -- 172.21.15.44:0/2368428541 >> 172.21.15.44:0/2368428541 conn(0x7f14f00678f0 msgr2=0x7f14f00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.180+0000 7f365aa00640 1 -- 172.21.15.44:0/2658611149 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f365408c130 con 0x7f36640ce330 2024-03-30T13:12:12.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.180+0000 7fd257800640 1 -- 172.21.15.44:0/563094823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2500cc750 con 0x7fd2500b6320 2024-03-30T13:12:12.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7f365aa00640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] conn(0x7f3644075d00 0x7f3644078140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7f365aa00640 1 -- 172.21.15.44:0/2658611149 --> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3644078810 con 0x7f3644075d00 2024-03-30T13:12:12.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7f365aa00640 1 -- 172.21.15.44:0/2658611149 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f365408c4e0 con 0x7f36640ce330 2024-03-30T13:12:12.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7f3662a00640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f364406c580 0x7f364406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7fe441a00640 1 Processor -- start 2024-03-30T13:12:12.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7fc228400640 1 -- 172.21.15.44:0/967202218 shutdown_connections 2024-03-30T13:12:12.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7fc228400640 1 --2- 172.21.15.44:0/967202218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc208004800 0x7fc208004c80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7fc228400640 1 -- 172.21.15.44:0/967202218 >> 172.21.15.44:0/967202218 conn(0x7fc22006d610 msgr2=0x7fc22006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7f792d400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f790c0051c0 0x7f79280b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7f792d400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79280b6790 0x7f79281588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7f792d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79280cd530 0x7f79280cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7f792d400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79280b7e30 con 0x7f79280cd530 2024-03-30T13:12:12.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7f792d400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f79280b7cb0 con 0x7f79280b6790 2024-03-30T13:12:12.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7f792d400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f79280b7fb0 con 0x7f790c0051c0 2024-03-30T13:12:12.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.182+0000 7f14f5800640 1 -- 172.21.15.44:0/2368428541 shutdown_connections 2024-03-30T13:12:12.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.181+0000 7f3e41000640 1 -- 172.21.15.44:0/424629211 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e14001030 con 0x7f3e3c166820 2024-03-30T13:12:12.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.182+0000 7f7926800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f790c0051c0 0x7f79280b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.182+0000 7f7926800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f790c0051c0 0x7f79280b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36640/0 (socket says 172.21.15.44:36640) 2024-03-30T13:12:12.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.182+0000 7f7926800640 1 -- 172.21.15.44:0/194237420 learned_addr learned my addr 172.21.15.44:0/194237420 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.182+0000 7f7925e00640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79280b6790 0x7f79281588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.182+0000 7fc228400640 1 -- 172.21.15.44:0/967202218 shutdown_connections 2024-03-30T13:12:12.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.182+0000 7fc228400640 1 -- 172.21.15.44:0/967202218 wait complete. 2024-03-30T13:12:12.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.182+0000 7f3663400640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] conn(0x7f3644075d00 0x7f3644078140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.183+0000 7f7925e00640 1 -- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f790c0051c0 msgr2=0x7f79280b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.183+0000 7f7925e00640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f790c0051c0 0x7f79280b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.183+0000 7f7925e00640 1 -- 172.21.15.44:0/194237420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79280cd530 msgr2=0x7f79280cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.183+0000 7f7925e00640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79280cd530 0x7f79280cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.183+0000 7f7925e00640 1 -- 172.21.15.44:0/194237420 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79280b5640 con 0x7f79280b6790 2024-03-30T13:12:12.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.182+0000 7f14f5800640 1 -- 172.21.15.44:0/2368428541 wait complete. 2024-03-30T13:12:12.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.184+0000 7fd257800640 1 -- 172.21.15.44:0/563094823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd250075900 con 0x7fd2500b6320 2024-03-30T13:12:12.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.184+0000 7f7925e00640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79280b6790 0x7f79281588e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f791800ef40 tx=0x7f791800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.182+0000 7f42ad600640 1 -- 172.21.15.44:0/3408952877 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4280001030 con 0x7f42a003e870 2024-03-30T13:12:12.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.184+0000 7f429ea00640 1 -- 172.21.15.44:0/3408952877 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4298037070 con 0x7f42a003e870 2024-03-30T13:12:12.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.184+0000 7f14f5800640 1 Processor -- start 2024-03-30T13:12:12.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.183+0000 7f3662a00640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f364406c580 0x7f364406ea40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3664158010 tx=0x7f3650001df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7f14f5800640 1 -- start start 2024-03-30T13:12:12.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7fc228400640 1 Processor -- start 2024-03-30T13:12:12.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7f429ea00640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f428406c630 0x7f428406eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7f429ea00640 1 -- 172.21.15.44:0/3408952877 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f42980adc70 con 0x7f42a003e870 2024-03-30T13:12:12.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7fd24cc00640 1 -- 172.21.15.44:0/563094823 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd23c01a070 con 0x7fd2500b6320 2024-03-30T13:12:12.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7f791ea00640 1 -- 172.21.15.44:0/194237420 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918018030 con 0x7f79280b6790 2024-03-30T13:12:12.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.184+0000 7f3e32000640 1 -- 172.21.15.44:0/424629211 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3e3401a070 con 0x7f3e3c166820 2024-03-30T13:12:12.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.184+0000 7fe441a00640 1 -- start start 2024-03-30T13:12:12.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7fe441a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe43c0cf0f0 0x7fe43c0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7fe441a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe43c0d1280 0x7fe43c0b9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7fe441a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe43c0d2290 0x7fe43c1f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7fe441a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c167220 con 0x7fe43c0d2290 2024-03-30T13:12:12.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7fe441a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c166f40 con 0x7fe43c0d1280 2024-03-30T13:12:12.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7fe441a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe43c159ca0 con 0x7fe43c0cf0f0 2024-03-30T13:12:12.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7f429ea00640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] conn(0x7f4284075d30 0x7f4284078170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7f429ea00640 1 -- 172.21.15.44:0/3408952877 --> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f429800af30 con 0x7f4284075d30 2024-03-30T13:12:12.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7f791ea00640 1 -- 172.21.15.44:0/194237420 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791800cd30 con 0x7f79280b6790 2024-03-30T13:12:12.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7f791ea00640 1 -- 172.21.15.44:0/194237420 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918003bb0 con 0x7f79280b6790 2024-03-30T13:12:12.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7f429ea00640 1 -- 172.21.15.44:0/3408952877 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f429807b2d0 con 0x7f42a003e870 2024-03-30T13:12:12.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7fe43b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe43c0d2290 0x7fe43c1f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7f792d400640 1 -- 172.21.15.44:0/194237420 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7928158e20 con 0x7f79280b6790 2024-03-30T13:12:12.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7f42a7400640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] conn(0x7f4284075d30 0x7f4284078170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7f3e32000640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3e1806c600 0x7f3e1806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7f3663400640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] conn(0x7f3644075d00 0x7f3644078140 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7fe43aa00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe43c0cf0f0 0x7fe43c0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7fe43b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe43c0d2290 0x7fe43c1f8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39292/0 (socket says 172.21.15.44:39292) 2024-03-30T13:12:12.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.186+0000 7fe43b400640 1 -- 172.21.15.44:0/58402362 learned_addr learned my addr 172.21.15.44:0/58402362 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7f3e32000640 1 -- 172.21.15.44:0/424629211 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3e3408b610 con 0x7f3e3c166820 2024-03-30T13:12:12.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.185+0000 7fc228400640 1 -- start start 2024-03-30T13:12:12.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7fd24cc00640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd23006c580 0x7fd23006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7fe43a000640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe43c0d1280 0x7fe43c0b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7f3e32000640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] conn(0x7f3e18075d80 0x7f3e180781c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7fe43b400640 1 -- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe43c0cf0f0 msgr2=0x7fe43c0cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7fe43b400640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe43c0cf0f0 0x7fe43c0cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7fe43b400640 1 -- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe43c0d1280 msgr2=0x7fe43c0b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7fc228400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc208004800 0x7fc22015db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7fe43b400640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe43c0d1280 0x7fe43c0b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7fe43b400640 1 -- 172.21.15.44:0/58402362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c0cb590 con 0x7fe43c0d2290 2024-03-30T13:12:12.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7fe43aa00640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe43c0cf0f0 0x7fe43c0cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:12.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7f42a7400640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] conn(0x7f4284075d30 0x7f4284078170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7f3e32000640 1 -- 172.21.15.44:0/424629211 --> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e18078890 con 0x7f3e18075d80 2024-03-30T13:12:12.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7fc228400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2201615f0 0x7fc220161a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7f3e32000640 1 -- 172.21.15.44:0/424629211 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3e34092050 con 0x7f3e3c166820 2024-03-30T13:12:12.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7fe43a000640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe43c0d1280 0x7fe43c0b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:12.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7fd24cc00640 1 -- 172.21.15.44:0/563094823 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd23c08bb60 con 0x7fd2500b6320 2024-03-30T13:12:12.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7fd24cc00640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] conn(0x7fd230075c80 0x7fd2300780c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7fd24cc00640 1 -- 172.21.15.44:0/563094823 --> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd230078790 con 0x7fd230075c80 2024-03-30T13:12:12.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7f14f5800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14f00b64f0 0x7f14f01fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7f14f5800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14f00d2af0 0x7f14f0158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7f14f5800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f015e830 0x7f14f0158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7f14f5800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f14f00d3b20 con 0x7f14f00b64f0 2024-03-30T13:12:12.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7f14f5800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f14f00d3840 con 0x7f14f015e830 2024-03-30T13:12:12.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.187+0000 7f14f5800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f14f00b84a0 con 0x7f14f00d2af0 2024-03-30T13:12:12.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7f365aa00640 1 -- 172.21.15.44:0/2658611149 <== osd.2 v2:172.21.15.44:6816/3473014849 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3644078810 con 0x7f3644075d00 2024-03-30T13:12:12.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7fc228400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2201fc640 0x7fc2201fcac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7f42a6000640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f428406c630 0x7f428406eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7fe43b400640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe43c0d2290 0x7fe43c1f8ce0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe434036040 tx=0x7fe434004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7f3e39e00640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3e1806c600 0x7f3e1806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7f14ee000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14f00d2af0 0x7f14f0158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7fc228400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc220167680 con 0x7fc2201fc640 2024-03-30T13:12:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7fd24fe00640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd23006c580 0x7fd23006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7fd24cc00640 1 -- 172.21.15.44:0/563094823 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd23c055ac0 con 0x7fd2500b6320 2024-03-30T13:12:12.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7fd255800640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] conn(0x7fd230075c80 0x7fd2300780c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7f14ee000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14f00d2af0 0x7f14f0158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36668/0 (socket says 172.21.15.44:36668) 2024-03-30T13:12:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7fc225a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc208004800 0x7fc22015db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7fc225000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2201615f0 0x7fc220161a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7fc225000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2201615f0 0x7fc220161a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:42632/0 (socket says 172.21.15.44:42632) 2024-03-30T13:12:12.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7fc225000640 1 -- 172.21.15.44:0/104002903 learned_addr learned my addr 172.21.15.44:0/104002903 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7f792d400640 1 -- 172.21.15.44:0/194237420 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79280b5080 con 0x7f79280b6790 2024-03-30T13:12:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7fe432a00640 1 -- 172.21.15.44:0/58402362 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434043020 con 0x7fe43c0d2290 2024-03-30T13:12:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7fe432a00640 1 -- 172.21.15.44:0/58402362 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43403e450 con 0x7fe43c0d2290 2024-03-30T13:12:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7fe432a00640 1 -- 172.21.15.44:0/58402362 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434009510 con 0x7fe43c0d2290 2024-03-30T13:12:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7fe441a00640 1 -- 172.21.15.44:0/58402362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43c0cb870 con 0x7fe43c0d2290 2024-03-30T13:12:12.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc2200cfd10 con 0x7fc2201615f0 2024-03-30T13:12:12.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.188+0000 7f14ee000640 1 -- 172.21.15.44:0/3540537161 learned_addr learned my addr 172.21.15.44:0/3540537161 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.190+0000 7f429ea00640 1 -- 172.21.15.44:0/3408952877 <== osd.0 v2:172.21.15.44:6808/117092933 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f429800af30 con 0x7f4284075d30 2024-03-30T13:12:12.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc2200ce130 con 0x7fc208004800 2024-03-30T13:12:12.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.190+0000 7f3e39e00640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3e1806c600 0x7f3e1806eac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e24007fd0 tx=0x7f3e24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7f14ee000640 1 -- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f015e830 msgr2=0x7f14f0158ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T13:12:12.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7f14ee000640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f015e830 0x7f14f0158ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.189+0000 7f14ee000640 1 -- 172.21.15.44:0/3540537161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14f00b64f0 msgr2=0x7f14f01fe7a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-30T13:12:12.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.190+0000 7f14eea00640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14f00b64f0 0x7f14f01fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.190+0000 7f14ee000640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14f00b64f0 0x7f14f01fe7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.190+0000 7f14ee000640 1 -- 172.21.15.44:0/3540537161 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f00ca150 con 0x7f14f00d2af0 2024-03-30T13:12:12.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.190+0000 7f3e39400640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] conn(0x7f3e18075d80 0x7f3e180781c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.190+0000 7fe441a00640 1 -- 172.21.15.44:0/58402362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe43c0cbe30 con 0x7fe43c0d2290 2024-03-30T13:12:12.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.190+0000 7f14ee000640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14f00d2af0 0x7f14f0158590 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c460 tx=0x7f14d800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.190+0000 7fc226400640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2201fc640 0x7fc2201fcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.190+0000 7f791ea00640 1 -- 172.21.15.44:0/194237420 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f791801b070 con 0x7f79280b6790 2024-03-30T13:12:12.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.191+0000 7f42a6000640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f428406c630 0x7f428406eaf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f42a00d6eb0 tx=0x7f4290009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.191+0000 7f792d400640 1 -- 172.21.15.44:0/194237420 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f792815b160 con 0x7f79280b6790 2024-03-30T13:12:12.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.191+0000 7fc225a00640 1 -- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2201615f0 msgr2=0x7fc220161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.191+0000 7fc225a00640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2201615f0 0x7fc220161a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.191+0000 7fc225a00640 1 -- 172.21.15.44:0/104002903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2201fc640 msgr2=0x7fc2201fcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.191+0000 7fc225a00640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2201fc640 0x7fc2201fcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.191+0000 7fc225a00640 1 -- 172.21.15.44:0/104002903 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc220149050 con 0x7fc208004800 2024-03-30T13:12:12.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.190+0000 7fd255800640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] conn(0x7fd230075c80 0x7fd2300780c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.191+0000 7fd24fe00640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd23006c580 0x7fd23006ea40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd240036000 tx=0x7fd240008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.192+0000 7f3e39400640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] conn(0x7f3e18075d80 0x7f3e180781c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.192+0000 7f14e6a00640 1 -- 172.21.15.44:0/3540537161 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8016020 con 0x7f14f00d2af0 2024-03-30T13:12:12.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.192+0000 7fd24cc00640 1 -- 172.21.15.44:0/563094823 <== osd.3 v2:172.21.15.44:6824/667769912 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd230078790 con 0x7fd230075c80 2024-03-30T13:12:12.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.192+0000 7f14e6a00640 1 -- 172.21.15.44:0/3540537161 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8012870 con 0x7f14f00d2af0 2024-03-30T13:12:12.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.192+0000 7f14e6a00640 1 -- 172.21.15.44:0/3540537161 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8012c60 con 0x7f14f00d2af0 2024-03-30T13:12:12.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.193+0000 7f14f5800640 1 -- 172.21.15.44:0/3540537161 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f00ca430 con 0x7f14f00d2af0 2024-03-30T13:12:12.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.193+0000 7fc225a00640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc208004800 0x7fc22015db50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc20c011960 tx=0x7fc20c011e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.193+0000 7f14f5800640 1 -- 172.21.15.44:0/3540537161 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f00ca9f0 con 0x7f14f00d2af0 2024-03-30T13:12:12.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.193+0000 7f3e32000640 1 -- 172.21.15.44:0/424629211 <== osd.1 v2:172.21.15.44:6800/1186302707 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e18078890 con 0x7f3e18075d80 2024-03-30T13:12:12.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.193+0000 7f791ea00640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f790406c5b0 0x7f790406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.193+0000 7f791ea00640 1 -- 172.21.15.44:0/194237420 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7918090060 con 0x7f79280b6790 2024-03-30T13:12:12.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.194+0000 7f791ea00640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] conn(0x7f7904075d30 0x7f7904078170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.194+0000 7f791ea00640 1 -- 172.21.15.44:0/194237420 --> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7918009200 con 0x7f7904075d30 2024-03-30T13:12:12.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.194+0000 7f791ea00640 1 -- 172.21.15.44:0/194237420 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f791808b810 con 0x7f79280b6790 2024-03-30T13:12:12.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.194+0000 7fe441a00640 1 -- 172.21.15.44:0/58402362 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe43c165e40 con 0x7fe43c0d2290 2024-03-30T13:12:12.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.194+0000 7fc21d600640 1 -- 172.21.15.44:0/104002903 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c019070 con 0x7fc208004800 2024-03-30T13:12:12.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.194+0000 7fc21d600640 1 -- 172.21.15.44:0/104002903 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20c004300 con 0x7fc208004800 2024-03-30T13:12:12.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.194+0000 7fc21d600640 1 -- 172.21.15.44:0/104002903 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00fa80 con 0x7fc208004800 2024-03-30T13:12:12.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.194+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2201492f0 con 0x7fc208004800 2024-03-30T13:12:12.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.194+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2201498b0 con 0x7fc208004800 2024-03-30T13:12:12.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.194+0000 7f7926800640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f790406c5b0 0x7f790406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.195+0000 7f7927200640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] conn(0x7f7904075d30 0x7f7904078170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.195+0000 7f14f5800640 1 -- 172.21.15.44:0/3540537161 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14f0075900 con 0x7f14f00d2af0 2024-03-30T13:12:12.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.195+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc220146d00 con 0x7fc208004800 2024-03-30T13:12:12.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.196+0000 7f7926800640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f790406c5b0 0x7f790406ea70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7910000f60 tx=0x7f7910007e20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.196+0000 7f7927200640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] conn(0x7f7904075d30 0x7f7904078170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.195+0000 7fe432a00640 1 -- 172.21.15.44:0/58402362 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe434046020 con 0x7fe43c0d2290 2024-03-30T13:12:12.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.197+0000 7f14e6a00640 1 -- 172.21.15.44:0/3540537161 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f14d8019020 con 0x7f14f00d2af0 2024-03-30T13:12:12.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.197+0000 7f14e6a00640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f14cc06c600 0x7f14cc06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.197+0000 7f14e6a00640 1 -- 172.21.15.44:0/3540537161 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f14d808b6f0 con 0x7f14f00d2af0 2024-03-30T13:12:12.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.197+0000 7fe432a00640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe41c06c530 0x7fe41c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.197+0000 7fe432a00640 1 -- 172.21.15.44:0/58402362 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe4340ae2a0 con 0x7fe43c0d2290 2024-03-30T13:12:12.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.197+0000 7fe432a00640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] conn(0x7fe41c075c30 0x7fe41c078070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.198+0000 7f14e6a00640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] conn(0x7f14cc075d70 0x7f14cc0781b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.198+0000 7f14e6a00640 1 -- 172.21.15.44:0/3540537161 --> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14cc078880 con 0x7f14cc075d70 2024-03-30T13:12:12.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.198+0000 7f14e6a00640 1 -- 172.21.15.44:0/3540537161 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f14d8092050 con 0x7f14f00d2af0 2024-03-30T13:12:12.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.198+0000 7fe432a00640 1 -- 172.21.15.44:0/58402362 --> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe43403be50 con 0x7fe41c075c30 2024-03-30T13:12:12.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.198+0000 7fe432a00640 1 -- 172.21.15.44:0/58402362 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe4340b5050 con 0x7fe43c0d2290 2024-03-30T13:12:12.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.198+0000 7fe43aa00640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe41c06c530 0x7fe41c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.198+0000 7f14eea00640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f14cc06c600 0x7f14cc06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.198+0000 7f14ef400640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] conn(0x7f14cc075d70 0x7f14cc0781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.199+0000 7fe43a000640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] conn(0x7fe41c075c30 0x7fe41c078070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.199+0000 7fc21d600640 1 -- 172.21.15.44:0/104002903 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc20c01c070 con 0x7fc208004800 2024-03-30T13:12:12.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.199+0000 7f791ea00640 1 -- 172.21.15.44:0/194237420 <== osd.4 v2:172.21.15.151:6816/1952435005 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7918009200 con 0x7f7904075d30 2024-03-30T13:12:12.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.200+0000 7fc21d600640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc20006c560 0x7fc20006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.200+0000 7fc21d600640 1 -- 172.21.15.44:0/104002903 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc20c08c480 con 0x7fc208004800 2024-03-30T13:12:12.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.200+0000 7fc21d600640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] conn(0x7fc200075cd0 0x7fc200078110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.200+0000 7fc21d600640 1 -- 172.21.15.44:0/104002903 --> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2000787e0 con 0x7fc200075cd0 2024-03-30T13:12:12.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.200+0000 7fc21d600640 1 -- 172.21.15.44:0/104002903 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc20c08c870 con 0x7fc208004800 2024-03-30T13:12:12.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.200+0000 7fe43a000640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] conn(0x7fe41c075c30 0x7fe41c078070 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.200+0000 7f14ef400640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] conn(0x7f14cc075d70 0x7f14cc0781b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.200+0000 7f14eea00640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f14cc06c600 0x7f14cc06eac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f14e0003d90 tx=0x7f14e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.201+0000 7fe43aa00640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe41c06c530 0x7fe41c06e9f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe42c006fd0 tx=0x7fe42c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.201+0000 7fc226400640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] conn(0x7fc200075cd0 0x7fc200078110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.201+0000 7fc225000640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc20006c560 0x7fc20006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.202+0000 7fc226400640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] conn(0x7fc200075cd0 0x7fc200078110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.203+0000 7fc225000640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc20006c560 0x7fc20006ea20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc214000fb0 tx=0x7fc214009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.203+0000 7fe432a00640 1 -- 172.21.15.44:0/58402362 <== osd.5 v2:172.21.15.151:6800/3241621332 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe43403be50 con 0x7fe41c075c30 2024-03-30T13:12:12.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.203+0000 7f14e6a00640 1 -- 172.21.15.44:0/3540537161 <== osd.6 v2:172.21.15.151:6824/3023883464 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14cc078880 con 0x7f14cc075d70 2024-03-30T13:12:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.205+0000 7fc21d600640 1 -- 172.21.15.44:0/104002903 <== osd.7 v2:172.21.15.151:6808/684556134 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc2000787e0 con 0x7fc200075cd0 2024-03-30T13:12:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.219+0000 7f14f5800640 1 -- 172.21.15.44:0/3540537161 --> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f14f00cc210 con 0x7f14cc075d70 2024-03-30T13:12:12.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.220+0000 7f14e6a00640 1 -- 172.21.15.44:0/3540537161 <== osd.6 v2:172.21.15.151:6824/3023883464 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f14e8003990 con 0x7f14cc075d70 2024-03-30T13:12:12.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.220+0000 7f14f5800640 1 -- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] conn(0x7f14cc075d70 msgr2=0x7f14cc0781b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.220+0000 7f14f5800640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] conn(0x7f14cc075d70 0x7f14cc0781b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.221+0000 7f14f5800640 1 -- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f14cc06c600 msgr2=0x7f14cc06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.221+0000 7f14f5800640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f14cc06c600 0x7f14cc06eac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f14e0003d90 tx=0x7f14e0009040 comp rx=0 tx=0).stop 2024-03-30T13:12:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.221+0000 7f14f5800640 1 -- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14f00d2af0 msgr2=0x7f14f0158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.221+0000 7f14f5800640 1 --2- 172.21.15.44:0/3540537161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14f00d2af0 0x7f14f0158590 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c460 tx=0x7f14d800c920 comp rx=0 tx=0).stop 2024-03-30T13:12:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.221+0000 7f14ef400640 1 -- 172.21.15.44:0/3540537161 reap_dead start 2024-03-30T13:12:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.221+0000 7f14f5800640 1 -- 172.21.15.44:0/3540537161 shutdown_connections 2024-03-30T13:12:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.221+0000 7f14f5800640 1 -- 172.21.15.44:0/3540537161 >> 172.21.15.44:0/3540537161 conn(0x7f14f00678f0 msgr2=0x7f14f00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.222+0000 7f14f5800640 1 -- 172.21.15.44:0/3540537161 shutdown_connections 2024-03-30T13:12:12.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.222+0000 7f14f5800640 1 -- 172.21.15.44:0/3540537161 wait complete. 2024-03-30T13:12:12.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.223+0000 7f42ad600640 1 -- 172.21.15.44:0/3408952877 --> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4280002dd0 con 0x7f4284075d30 2024-03-30T13:12:12.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.224+0000 7f3669c00640 1 -- 172.21.15.44:0/2658611149 --> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3664075900 con 0x7f3644075d00 2024-03-30T13:12:12.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.224+0000 7f365aa00640 1 -- 172.21.15.44:0/2658611149 <== osd.2 v2:172.21.15.44:6816/3473014849 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3664075900 con 0x7f3644075d00 2024-03-30T13:12:12.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.225+0000 7f3e41000640 1 -- 172.21.15.44:0/424629211 --> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e14002dd0 con 0x7f3e18075d80 2024-03-30T13:12:12.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.225+0000 7f3669c00640 1 -- 172.21.15.44:0/2658611149 >> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] conn(0x7f3644075d00 msgr2=0x7f3644078140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.225+0000 7f3669c00640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] conn(0x7f3644075d00 0x7f3644078140 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.225+0000 7f3669c00640 1 -- 172.21.15.44:0/2658611149 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f364406c580 msgr2=0x7f364406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.225+0000 7f3669c00640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f364406c580 0x7f364406ea40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3664158010 tx=0x7f3650001df0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.226+0000 7f3669c00640 1 -- 172.21.15.44:0/2658611149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36640ce330 msgr2=0x7f3664153160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.226+0000 7f3669c00640 1 --2- 172.21.15.44:0/2658611149 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f36640ce330 0x7f3664153160 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f365400e9b0 tx=0x7f365400ee70 comp rx=0 tx=0).stop 2024-03-30T13:12:12.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.226+0000 7f3e32000640 1 -- 172.21.15.44:0/424629211 <== osd.1 v2:172.21.15.44:6800/1186302707 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3e14002dd0 con 0x7f3e18075d80 2024-03-30T13:12:12.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.226+0000 7f3663400640 1 -- 172.21.15.44:0/2658611149 reap_dead start 2024-03-30T13:12:12.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.227+0000 7f3e41000640 1 -- 172.21.15.44:0/424629211 >> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] conn(0x7f3e18075d80 msgr2=0x7f3e180781c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.227+0000 7f429ea00640 1 -- 172.21.15.44:0/3408952877 <== osd.0 v2:172.21.15.44:6808/117092933 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4280002dd0 con 0x7f4284075d30 2024-03-30T13:12:12.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.227+0000 7f3e41000640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] conn(0x7f3e18075d80 0x7f3e180781c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.227+0000 7f3e41000640 1 -- 172.21.15.44:0/424629211 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3e1806c600 msgr2=0x7f3e1806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.227+0000 7f3669c00640 1 -- 172.21.15.44:0/2658611149 shutdown_connections 2024-03-30T13:12:12.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.227+0000 7f3669c00640 1 -- 172.21.15.44:0/2658611149 >> 172.21.15.44:0/2658611149 conn(0x7f36640b1c20 msgr2=0x7f366415ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.227+0000 7f42ad600640 1 -- 172.21.15.44:0/3408952877 >> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] conn(0x7f4284075d30 msgr2=0x7f4284078170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.227+0000 7f42ad600640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] conn(0x7f4284075d30 0x7f4284078170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.227+0000 7f3e41000640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3e1806c600 0x7f3e1806eac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e24007fd0 tx=0x7f3e24009040 comp rx=0 tx=0).stop 2024-03-30T13:12:12.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f3669c00640 1 -- 172.21.15.44:0/2658611149 shutdown_connections 2024-03-30T13:12:12.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f3669c00640 1 -- 172.21.15.44:0/2658611149 wait complete. 2024-03-30T13:12:12.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f42ad600640 1 -- 172.21.15.44:0/3408952877 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f428406c630 msgr2=0x7f428406eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f42ad600640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f428406c630 0x7f428406eaf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f42a00d6eb0 tx=0x7f4290009190 comp rx=0 tx=0).stop 2024-03-30T13:12:12.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f42ad600640 1 -- 172.21.15.44:0/3408952877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42a003e870 msgr2=0x7f42a0051fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f42ad600640 1 --2- 172.21.15.44:0/3408952877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f42a003e870 0x7f42a0051fa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4298033000 tx=0x7f42980046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f3e41000640 1 -- 172.21.15.44:0/424629211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c166820 msgr2=0x7f3e3c1ecf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f3e41000640 1 --2- 172.21.15.44:0/424629211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c166820 0x7f3e3c1ecf20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400ca20 tx=0x7f3e3400cee0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f3e3a800640 1 -- 172.21.15.44:0/424629211 reap_dead start 2024-03-30T13:12:12.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f3e41000640 1 -- 172.21.15.44:0/424629211 shutdown_connections 2024-03-30T13:12:12.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f3e41000640 1 -- 172.21.15.44:0/424629211 >> 172.21.15.44:0/424629211 conn(0x7f3e3c06d610 msgr2=0x7f3e3c165e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f42a7400640 1 -- 172.21.15.44:0/3408952877 reap_dead start 2024-03-30T13:12:12.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f42ad600640 1 -- 172.21.15.44:0/3408952877 shutdown_connections 2024-03-30T13:12:12.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f42ad600640 1 -- 172.21.15.44:0/3408952877 >> 172.21.15.44:0/3408952877 conn(0x7f42a0055a10 msgr2=0x7f42a00df950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f42ad600640 1 -- 172.21.15.44:0/3408952877 shutdown_connections 2024-03-30T13:12:12.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7f42ad600640 1 -- 172.21.15.44:0/3408952877 wait complete. 2024-03-30T13:12:12.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.228+0000 7fd257800640 1 -- 172.21.15.44:0/563094823 --> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd2500d4f00 con 0x7fd230075c80 2024-03-30T13:12:12.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.229+0000 7f3e41000640 1 -- 172.21.15.44:0/424629211 shutdown_connections 2024-03-30T13:12:12.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.229+0000 7fd24cc00640 1 -- 172.21.15.44:0/563094823 <== osd.3 v2:172.21.15.44:6824/667769912 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd2500d4f00 con 0x7fd230075c80 2024-03-30T13:12:12.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.229+0000 7f3e41000640 1 -- 172.21.15.44:0/424629211 wait complete. 2024-03-30T13:12:12.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.230+0000 7fd257800640 1 -- 172.21.15.44:0/563094823 >> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] conn(0x7fd230075c80 msgr2=0x7fd2300780c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.230+0000 7fd257800640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] conn(0x7fd230075c80 0x7fd2300780c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.230+0000 7fd257800640 1 -- 172.21.15.44:0/563094823 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd23006c580 msgr2=0x7fd23006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.230+0000 7fd257800640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd23006c580 0x7fd23006ea40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd240036000 tx=0x7fd240008030 comp rx=0 tx=0).stop 2024-03-30T13:12:12.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.230+0000 7fd257800640 1 -- 172.21.15.44:0/563094823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2500b6320 msgr2=0x7fd2500cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.230+0000 7fd257800640 1 --2- 172.21.15.44:0/563094823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2500b6320 0x7fd2500cd750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00e8a0 tx=0x7fd23c00ed60 comp rx=0 tx=0).stop 2024-03-30T13:12:12.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.230+0000 7fd255800640 1 -- 172.21.15.44:0/563094823 reap_dead start 2024-03-30T13:12:12.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.231+0000 7fd257800640 1 -- 172.21.15.44:0/563094823 shutdown_connections 2024-03-30T13:12:12.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.231+0000 7fd257800640 1 -- 172.21.15.44:0/563094823 >> 172.21.15.44:0/563094823 conn(0x7fd2500678f0 msgr2=0x7fd2500b7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.231+0000 7fd257800640 1 -- 172.21.15.44:0/563094823 shutdown_connections 2024-03-30T13:12:12.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.231+0000 7fd257800640 1 -- 172.21.15.44:0/563094823 wait complete. 2024-03-30T13:12:12.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.240+0000 7fe441a00640 1 -- 172.21.15.44:0/58402362 --> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe43c075900 con 0x7fe41c075c30 2024-03-30T13:12:12.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.241+0000 7fe432a00640 1 -- 172.21.15.44:0/58402362 <== osd.5 v2:172.21.15.151:6800/3241621332 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe43c075900 con 0x7fe41c075c30 2024-03-30T13:12:12.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.242+0000 7fe441a00640 1 -- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] conn(0x7fe41c075c30 msgr2=0x7fe41c078070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.242+0000 7fe441a00640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] conn(0x7fe41c075c30 0x7fe41c078070 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.242+0000 7fe441a00640 1 -- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe41c06c530 msgr2=0x7fe41c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.242+0000 7fe441a00640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe41c06c530 0x7fe41c06e9f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe42c006fd0 tx=0x7fe42c008040 comp rx=0 tx=0).stop 2024-03-30T13:12:12.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.242+0000 7fe441a00640 1 -- 172.21.15.44:0/58402362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe43c0d2290 msgr2=0x7fe43c1f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.242+0000 7fe441a00640 1 --2- 172.21.15.44:0/58402362 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe43c0d2290 0x7fe43c1f8ce0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe434036040 tx=0x7fe434004a40 comp rx=0 tx=0).stop 2024-03-30T13:12:12.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.244+0000 7f792d400640 1 -- 172.21.15.44:0/194237420 --> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7928075900 con 0x7f7904075d30 2024-03-30T13:12:12.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.244+0000 7fe43b400640 1 -- 172.21.15.44:0/58402362 reap_dead start 2024-03-30T13:12:12.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.244+0000 7fe441a00640 1 -- 172.21.15.44:0/58402362 shutdown_connections 2024-03-30T13:12:12.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.245+0000 7fe441a00640 1 -- 172.21.15.44:0/58402362 >> 172.21.15.44:0/58402362 conn(0x7fe43c0676b0 msgr2=0x7fe43c15ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.245+0000 7fe441a00640 1 -- 172.21.15.44:0/58402362 shutdown_connections 2024-03-30T13:12:12.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.245+0000 7fe441a00640 1 -- 172.21.15.44:0/58402362 wait complete. 2024-03-30T13:12:12.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.245+0000 7f791ea00640 1 -- 172.21.15.44:0/194237420 <== osd.4 v2:172.21.15.151:6816/1952435005 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7928075900 con 0x7f7904075d30 2024-03-30T13:12:12.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.250+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 --> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc220075900 con 0x7fc200075cd0 2024-03-30T13:12:12.290 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-03-30T13:12:12.291 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-30T13:12:12.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.251+0000 7fc21d600640 1 -- 172.21.15.44:0/104002903 <== osd.7 v2:172.21.15.151:6808/684556134 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc220075900 con 0x7fc200075cd0 2024-03-30T13:12:12.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.251+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] conn(0x7fc200075cd0 msgr2=0x7fc200078110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.251+0000 7fc228400640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] conn(0x7fc200075cd0 0x7fc200078110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.251+0000 7f792d400640 1 -- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] conn(0x7f7904075d30 msgr2=0x7f7904078170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7f792d400640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] conn(0x7f7904075d30 0x7f7904078170 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc20006c560 msgr2=0x7fc20006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7fc228400640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc20006c560 0x7fc20006ea20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc214000fb0 tx=0x7fc214009030 comp rx=0 tx=0).stop 2024-03-30T13:12:12.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc208004800 msgr2=0x7fc22015db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7f792d400640 1 -- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f790406c5b0 msgr2=0x7f790406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7f792d400640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f790406c5b0 0x7f790406ea70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7910000f60 tx=0x7f7910007e20 comp rx=0 tx=0).stop 2024-03-30T13:12:12.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7f792d400640 1 -- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79280b6790 msgr2=0x7f79281588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7f792d400640 1 --2- 172.21.15.44:0/194237420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79280b6790 0x7f79281588e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f791800ef40 tx=0x7f791800c490 comp rx=0 tx=0).stop 2024-03-30T13:12:12.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7fc228400640 1 --2- 172.21.15.44:0/104002903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc208004800 0x7fc22015db50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc20c011960 tx=0x7fc20c011e20 comp rx=0 tx=0).stop 2024-03-30T13:12:12.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7fc226400640 1 -- 172.21.15.44:0/104002903 reap_dead start 2024-03-30T13:12:12.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 shutdown_connections 2024-03-30T13:12:12.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 >> 172.21.15.44:0/104002903 conn(0x7fc22006d610 msgr2=0x7fc2200c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7f7927200640 1 -- 172.21.15.44:0/194237420 reap_dead start 2024-03-30T13:12:12.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7f792d400640 1 -- 172.21.15.44:0/194237420 shutdown_connections 2024-03-30T13:12:12.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7f792d400640 1 -- 172.21.15.44:0/194237420 >> 172.21.15.44:0/194237420 conn(0x7f79280676b0 msgr2=0x7f792815d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7f792d400640 1 -- 172.21.15.44:0/194237420 shutdown_connections 2024-03-30T13:12:12.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.252+0000 7f792d400640 1 -- 172.21.15.44:0/194237420 wait complete. 2024-03-30T13:12:12.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.254+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 shutdown_connections 2024-03-30T13:12:12.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.254+0000 7fc228400640 1 -- 172.21.15.44:0/104002903 wait complete. 2024-03-30T13:12:12.296 INFO:teuthology.orchestra.run.smithi044.stdout:64424509449 2024-03-30T13:12:12.296 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-30T13:12:12.297 INFO:teuthology.orchestra.run.smithi044.stdout:60129542154 2024-03-30T13:12:12.297 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-30T13:12:12.298 INFO:teuthology.orchestra.run.smithi044.stdout:64424509451 2024-03-30T13:12:12.298 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-30T13:12:12.299 INFO:teuthology.orchestra.run.smithi044.stdout:64424509451 2024-03-30T13:12:12.299 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-30T13:12:12.300 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-03-30T13:12:12.300 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-30T13:12:12.301 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-03-30T13:12:12.301 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-30T13:12:12.302 INFO:teuthology.orchestra.run.smithi044.stdout:64424509451 2024-03-30T13:12:12.303 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-30T13:12:12.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.630+0000 7f342e600640 1 Processor -- start 2024-03-30T13:12:12.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.630+0000 7f342e600640 1 -- start start 2024-03-30T13:12:12.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.633+0000 7f342e600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200589c0 0x7f3420053530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.633+0000 7f342d200640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f34200e7710 0x7f342004ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56838/0 (socket says 172.21.15.44:56838) 2024-03-30T13:12:12.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.633+0000 7f342d200640 1 -- 172.21.15.44:0/2720789785 learned_addr learned my addr 172.21.15.44:0/2720789785 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:12.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.634+0000 7f3427e00640 1 --2- 172.21.15.44:0/2720789785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200589c0 0x7f3420053530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.634+0000 7f342e600640 1 --2- 172.21.15.44:0/2720789785 >> v2:172.21.15.151:3300/0 conn(0x7f3420056ab0 0x7f3420053a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.634+0000 7f342e600640 1 -- 172.21.15.44:0/2720789785 --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3420057d90 con 0x7f34200e7710 2024-03-30T13:12:12.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.634+0000 7f342e600640 1 -- 172.21.15.44:0/2720789785 --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f3420006260 con 0x7f3420056ab0 2024-03-30T13:12:12.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.634+0000 7f342e600640 1 -- 172.21.15.44:0/2720789785 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3420006540 con 0x7f34200589c0 2024-03-30T13:12:12.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.635+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2765503119 0 0) 0x7f3420057d90 con 0x7f34200e7710 2024-03-30T13:12:12.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.634+0000 7f342dc00640 1 --2- 172.21.15.44:0/2720789785 >> v2:172.21.15.151:3300/0 conn(0x7f3420056ab0 0x7f3420053a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.635+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3410003520 con 0x7f34200e7710 2024-03-30T13:12:12.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.635+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 205841265 0 0) 0x7f3410003520 con 0x7f34200e7710 2024-03-30T13:12:12.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.635+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200589c0 msgr2=0x7f3420053530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.635+0000 7f3427400640 1 --2- 172.21.15.44:0/2720789785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200589c0 0x7f3420053530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.635+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 >> v2:172.21.15.151:3300/0 conn(0x7f3420056ab0 msgr2=0x7f3420053a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.635+0000 7f3427400640 1 --2- 172.21.15.44:0/2720789785 >> v2:172.21.15.151:3300/0 conn(0x7f3420056ab0 0x7f3420053a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.635+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3420006820 con 0x7f34200e7710 2024-03-30T13:12:12.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.636+0000 7f342dc00640 1 --2- 172.21.15.44:0/2720789785 >> v2:172.21.15.151:3300/0 conn(0x7f3420056ab0 0x7f3420053a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:12.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.636+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f3414001670 con 0x7f34200e7710 2024-03-30T13:12:12.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.636+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 >> v1:172.21.15.44:6789/0 conn(0x7f34200e7710 legacy=0x7f342004ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.636+0000 7f3427400640 1 --2- 172.21.15.44:0/2720789785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34100039d0 0x7f3410003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.636+0000 7f3427400640 1 --2- 172.21.15.44:0/2720789785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3410004800 0x7f3410004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.636+0000 7f3427400640 1 --2- 172.21.15.44:0/2720789785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200589c0 0x7f34100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.636+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3420006260 con 0x7f34100039d0 2024-03-30T13:12:12.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.636+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3420006540 con 0x7f3410004800 2024-03-30T13:12:12.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.636+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f341000baf0 con 0x7f34200589c0 2024-03-30T13:12:12.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.637+0000 7f342d200640 1 --2- 172.21.15.44:0/2720789785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34100039d0 0x7f3410003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.637+0000 7f342dc00640 1 --2- 172.21.15.44:0/2720789785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200589c0 0x7f34100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.637+0000 7f3427e00640 1 --2- 172.21.15.44:0/2720789785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3410004800 0x7f3410004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.638+0000 7f342d200640 1 -- 172.21.15.44:0/2720789785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200589c0 msgr2=0x7f34100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.638+0000 7f342d200640 1 --2- 172.21.15.44:0/2720789785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200589c0 0x7f34100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.638+0000 7f342d200640 1 -- 172.21.15.44:0/2720789785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3410004800 msgr2=0x7f3410004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.638+0000 7f342d200640 1 --2- 172.21.15.44:0/2720789785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3410004800 0x7f3410004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.638+0000 7f342d200640 1 -- 172.21.15.44:0/2720789785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3420006820 con 0x7f34100039d0 2024-03-30T13:12:12.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.639+0000 7f8dc1a00640 1 Processor -- start 2024-03-30T13:12:12.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.639+0000 7f02edc00640 1 Processor -- start 2024-03-30T13:12:12.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.640+0000 7f02edc00640 1 -- start start 2024-03-30T13:12:12.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.641+0000 7f02edc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e00e7810 0x7f02e0038270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.639+0000 7f342d200640 1 --2- 172.21.15.44:0/2720789785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34100039d0 0x7f3410003e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f341401d520 tx=0x7f3410005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d69f067b6a72313 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.640+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341401d0f0 con 0x7f34100039d0 2024-03-30T13:12:12.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.640+0000 7f3427400640 1 -- 172.21.15.44:0/2720789785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3414041030 con 0x7f34100039d0 2024-03-30T13:12:12.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.641+0000 7f342e600640 1 -- 172.21.15.44:0/2720789785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34100039d0 msgr2=0x7f3410003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.641+0000 7f342e600640 1 --2- 172.21.15.44:0/2720789785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34100039d0 0x7f3410003e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f341401d520 tx=0x7f3410005830 comp rx=0 tx=0).stop 2024-03-30T13:12:12.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.642+0000 7f342dc00640 1 -- 172.21.15.44:0/2720789785 reap_dead start 2024-03-30T13:12:12.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.642+0000 7f342e600640 1 -- 172.21.15.44:0/2720789785 shutdown_connections 2024-03-30T13:12:12.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.642+0000 7f342e600640 1 -- 172.21.15.44:0/2720789785 >> 172.21.15.44:0/2720789785 conn(0x7f3420058ee0 msgr2=0x7f34200592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.642+0000 7f02edc00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f02e0006190 0x7f02e0006620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.642+0000 7f02edc00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e00e7bf0 con 0x7f02e00eb2f0 2024-03-30T13:12:12.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.639+0000 7f8dc1a00640 1 -- start start 2024-03-30T13:12:12.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.642+0000 7f02edc00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f02e0057f10 con 0x7f02e0006190 2024-03-30T13:12:12.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.642+0000 7f02edc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f02e00581f0 con 0x7f02e00e7810 2024-03-30T13:12:12.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.642+0000 7f02e6000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f02e00eb2f0 0x7f02e00eb770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56864/0 (socket says 172.21.15.44:56864) 2024-03-30T13:12:12.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.642+0000 7f02e6000640 1 -- 172.21.15.44:0/2982684181 learned_addr learned my addr 172.21.15.44:0/2982684181 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:12.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.642+0000 7f02e6a00640 1 --2- 172.21.15.44:0/2982684181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e00e7810 0x7f02e0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.641+0000 7f8dc1a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8db40ebb50 0x7f8db4055300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.641+0000 7f8dc1a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8db40061a0 0x7f8db4006610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.641+0000 7f8dc1a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db40387e0 con 0x7f8db40eb060 2024-03-30T13:12:12.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.641+0000 7f8dc1a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8db4057e30 con 0x7f8db40ebb50 2024-03-30T13:12:12.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.641+0000 7f8dc1a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f8db40579a0 con 0x7f8db40061a0 2024-03-30T13:12:12.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.642+0000 7f8dbbe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8db40eb060 0x7f8db40eb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56854/0 (socket says 172.21.15.44:56854) 2024-03-30T13:12:12.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.642+0000 7f8dbb400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8db40ebb50 0x7f8db4055300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.643+0000 7f8dbb400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8db40ebb50 0x7f8db4055300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39350/0 (socket says 172.21.15.44:39350) 2024-03-30T13:12:12.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.643+0000 7f8dbb400640 1 -- 172.21.15.44:0/1913960016 learned_addr learned my addr 172.21.15.44:0/1913960016 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.643+0000 7f8dc1000640 1 --2- 172.21.15.44:0/1913960016 >> v2:172.21.15.151:3300/0 conn(0x7f8db40061a0 0x7f8db4006610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.643+0000 7f8dbb400640 1 -- 172.21.15.44:0/1913960016 >> v2:172.21.15.151:3300/0 conn(0x7f8db40061a0 msgr2=0x7f8db4006610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.643+0000 7f8dbb400640 1 --2- 172.21.15.44:0/1913960016 >> v2:172.21.15.151:3300/0 conn(0x7f8db40061a0 0x7f8db4006610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.643+0000 7f342e600640 1 -- 172.21.15.44:0/2720789785 shutdown_connections 2024-03-30T13:12:12.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.643+0000 7f342e600640 1 -- 172.21.15.44:0/2720789785 wait complete. 2024-03-30T13:12:12.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.643+0000 7f02e7400640 1 --2- 172.21.15.44:0/2982684181 >> v2:172.21.15.151:3300/0 conn(0x7f02e0006190 0x7f02e0006620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.643+0000 7f8dbb400640 1 -- 172.21.15.44:0/1913960016 >> v1:172.21.15.44:6789/0 conn(0x7f8db40eb060 legacy=0x7f8db40eb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.644+0000 7f02e7400640 1 -- 172.21.15.44:0/2982684181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e00e7810 msgr2=0x7f02e0038270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.644+0000 7f02e7400640 1 --2- 172.21.15.44:0/2982684181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e00e7810 0x7f02e0038270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.644+0000 7f02e7400640 1 -- 172.21.15.44:0/2982684181 >> v1:172.21.15.44:6789/0 conn(0x7f02e00eb2f0 legacy=0x7f02e00eb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.644+0000 7f02e5600640 1 -- 172.21.15.44:0/2982684181 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2163973 0 0) 0x7f02e00e7bf0 con 0x7f02e00eb2f0 2024-03-30T13:12:12.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.644+0000 7f02e7400640 1 -- 172.21.15.44:0/2982684181 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e00584d0 con 0x7f02e0006190 2024-03-30T13:12:12.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.644+0000 7f8dbb400640 1 -- 172.21.15.44:0/1913960016 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db4056d90 con 0x7f8db40ebb50 2024-03-30T13:12:12.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.646+0000 7f342e600640 1 Processor -- start 2024-03-30T13:12:12.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.646+0000 7f02e7400640 1 --2- 172.21.15.44:0/2982684181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e0006190 0x7f02e0006620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02d80097a0 tx=0x7f02d802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f426b73462fee13 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.646+0000 7f02e5600640 1 -- 172.21.15.44:0/2982684181 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8035020 con 0x7f02e0006190 2024-03-30T13:12:12.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.646+0000 7f8dbb400640 1 --2- 172.21.15.44:0/1913960016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8db40ebb50 0x7f8db4055300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8db4008660 tx=0x7f8db002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704b507bfff67346 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.646+0000 7f342e600640 1 -- start start 2024-03-30T13:12:12.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.646+0000 7f02e5600640 1 -- 172.21.15.44:0/2982684181 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d8031640 con 0x7f02e0006190 2024-03-30T13:12:12.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.647+0000 7f8dbaa00640 1 -- 172.21.15.44:0/1913960016 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db002e070 con 0x7f8db40ebb50 2024-03-30T13:12:12.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.647+0000 7f8dbaa00640 1 -- 172.21.15.44:0/1913960016 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db0037070 con 0x7f8db40ebb50 2024-03-30T13:12:12.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.647+0000 7f8dbaa00640 1 -- 172.21.15.44:0/1913960016 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0031a00 con 0x7f8db40ebb50 2024-03-30T13:12:12.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.647+0000 7f342e600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34200d9330 0x7f34200e3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.647+0000 7f02e5600640 1 -- 172.21.15.44:0/2982684181 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d802d040 con 0x7f02e0006190 2024-03-30T13:12:12.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f02edc00640 1 -- 172.21.15.44:0/2982684181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e0006190 msgr2=0x7f02e0006620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f02edc00640 1 --2- 172.21.15.44:0/2982684181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e0006190 0x7f02e0006620 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02d80097a0 tx=0x7f02d802b8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f02edc00640 1 -- 172.21.15.44:0/2982684181 shutdown_connections 2024-03-30T13:12:12.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.647+0000 7f342e600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34200d9710 0x7f34200ea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f02edc00640 1 --2- 172.21.15.44:0/2982684181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e0006190 0x7f02e0006620 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.647+0000 7f342e600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200385f0 0x7f3420038a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f342e600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3420057b20 con 0x7f34200d9710 2024-03-30T13:12:12.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f342e600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f34200579a0 con 0x7f34200d9330 2024-03-30T13:12:12.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f342e600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3420053530 con 0x7f34200385f0 2024-03-30T13:12:12.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f3427e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34200d9710 0x7f34200ea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f3427e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34200d9710 0x7f34200ea4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39360/0 (socket says 172.21.15.44:39360) 2024-03-30T13:12:12.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f3427e00640 1 -- 172.21.15.44:0/1783792112 learned_addr learned my addr 172.21.15.44:0/1783792112 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f342d200640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34200d9330 0x7f34200e3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f8dc1a00640 1 -- 172.21.15.44:0/1913960016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8db40ebb50 msgr2=0x7f8db4055300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.648+0000 7f8dc1a00640 1 --2- 172.21.15.44:0/1913960016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8db40ebb50 0x7f8db4055300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8db4008660 tx=0x7f8db002b880 comp rx=0 tx=0).stop 2024-03-30T13:12:12.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.649+0000 7f02edc00640 1 --2- 172.21.15.44:0/2982684181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e00e7810 0x7f02e0038270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.649+0000 7f02edc00640 1 -- 172.21.15.44:0/2982684181 >> 172.21.15.44:0/2982684181 conn(0x7f02e00559d0 msgr2=0x7f02e0055de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.649+0000 7f02edc00640 1 -- 172.21.15.44:0/2982684181 shutdown_connections 2024-03-30T13:12:12.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.649+0000 7f342dc00640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200385f0 0x7f3420038a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.649+0000 7f3427e00640 1 -- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200385f0 msgr2=0x7f3420038a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.649+0000 7f3427e00640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200385f0 0x7f3420038a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.649+0000 7f3427e00640 1 -- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34200d9330 msgr2=0x7f34200e3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.649+0000 7f3427e00640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34200d9330 0x7f34200e3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.650+0000 7f8dc1a00640 1 -- 172.21.15.44:0/1913960016 shutdown_connections 2024-03-30T13:12:12.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.650+0000 7f8dc1a00640 1 --2- 172.21.15.44:0/1913960016 >> v2:172.21.15.151:3300/0 conn(0x7f8db40061a0 0x7f8db4006610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.650+0000 7f8dc1a00640 1 --2- 172.21.15.44:0/1913960016 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8db40ebb50 0x7f8db4055300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.650+0000 7f8dc1a00640 1 -- 172.21.15.44:0/1913960016 >> 172.21.15.44:0/1913960016 conn(0x7f8db40559e0 msgr2=0x7f8db4055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.650+0000 7f8dc1a00640 1 -- 172.21.15.44:0/1913960016 shutdown_connections 2024-03-30T13:12:12.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.650+0000 7f8dc1a00640 1 -- 172.21.15.44:0/1913960016 wait complete. 2024-03-30T13:12:12.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.649+0000 7f3427e00640 1 -- 172.21.15.44:0/1783792112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3420039f40 con 0x7f34200d9710 2024-03-30T13:12:12.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.650+0000 7f02edc00640 1 -- 172.21.15.44:0/2982684181 wait complete. 2024-03-30T13:12:12.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.650+0000 7f1497e00640 1 Processor -- start 2024-03-30T13:12:12.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.650+0000 7f3427e00640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34200d9710 0x7f34200ea4a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f341c00f880 tx=0x7f341c00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.651+0000 7f3424c00640 1 -- 172.21.15.44:0/1783792112 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c019020 con 0x7f34200d9710 2024-03-30T13:12:12.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.651+0000 7f3424c00640 1 -- 172.21.15.44:0/1783792112 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f341c00d8e0 con 0x7f34200d9710 2024-03-30T13:12:12.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.651+0000 7f3424c00640 1 -- 172.21.15.44:0/1783792112 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c00dcd0 con 0x7f34200d9710 2024-03-30T13:12:12.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.651+0000 7f342e600640 1 -- 172.21.15.44:0/1783792112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34200ea9e0 con 0x7f34200d9710 2024-03-30T13:12:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.650+0000 7f1497e00640 1 -- start start 2024-03-30T13:12:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.652+0000 7f1497e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f149815e6e0 0x7f14980d2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.652+0000 7f1497e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14980cfe80 con 0x7f14980d4940 2024-03-30T13:12:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.652+0000 7f1497e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14980d1f10 con 0x7f14980d0b90 2024-03-30T13:12:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.652+0000 7f1497e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f14980d2840 con 0x7f149815e6e0 2024-03-30T13:12:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.653+0000 7f1496a00640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f14980d0b90 0x7f14980d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:54640/0 (socket says 172.21.15.44:54640) 2024-03-30T13:12:12.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.653+0000 7f1496a00640 1 -- 172.21.15.44:0/1298377485 learned_addr learned my addr 172.21.15.44:0/1298377485 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:12.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.653+0000 7f02edc00640 1 Processor -- start 2024-03-30T13:12:12.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.653+0000 7f02edc00640 1 -- start start 2024-03-30T13:12:12.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.654+0000 7f20d7200640 1 Processor -- start 2024-03-30T13:12:12.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.653+0000 7f342e600640 1 -- 172.21.15.44:0/1783792112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3420039980 con 0x7f34200d9710 2024-03-30T13:12:12.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.654+0000 7f8dc1a00640 1 Processor -- start 2024-03-30T13:12:12.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.654+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121905943 0 0) 0x7f14980d1f10 con 0x7f14980d0b90 2024-03-30T13:12:12.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.654+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f147c003520 con 0x7f14980d0b90 2024-03-30T13:12:12.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.654+0000 7f1435c00640 1 Processor -- start 2024-03-30T13:12:12.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.654+0000 7f8dc1a00640 1 -- start start 2024-03-30T13:12:12.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.655+0000 7f02edc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e0006190 0x7f02e00ea760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.655+0000 7f02edc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e00e7810 0x7f02e00e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.655+0000 7f02edc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e00eb2f0 0x7f02e00d1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.655+0000 7f02edc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f02e00ebe80 con 0x7f02e00eb2f0 2024-03-30T13:12:12.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.654+0000 7f20d7200640 1 -- start start 2024-03-30T13:12:12.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f1496000640 1 --2- 172.21.15.44:0/1298377485 >> v2:172.21.15.44:3300/0 conn(0x7f149815e6e0 0x7f14980d2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.655+0000 7f02edc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f02e00ec190 con 0x7f02e00e7810 2024-03-30T13:12:12.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.655+0000 7f02edc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f02e0058cd0 con 0x7f02e0006190 2024-03-30T13:12:12.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2599867184 0 0) 0x7f147c003520 con 0x7f14980d0b90 2024-03-30T13:12:12.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 >> v2:172.21.15.44:3300/0 conn(0x7f149815e6e0 msgr2=0x7f14980d2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f342e600640 1 -- 172.21.15.44:0/1783792112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3420005390 con 0x7f34200d9710 2024-03-30T13:12:12.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f1495600640 1 --2- 172.21.15.44:0/1298377485 >> v2:172.21.15.44:3300/0 conn(0x7f149815e6e0 0x7f14980d2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 >> v1:172.21.15.44:6789/0 conn(0x7f14980d4940 legacy=0x7f14980cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f20d7200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f20d00cec60 0x7f20d00d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f20d7200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 0x7f20d00d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f20d7200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d00d3120 con 0x7f20d015e7a0 2024-03-30T13:12:12.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f20d7200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f20d00cfc40 con 0x7f20d00cec60 2024-03-30T13:12:12.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f20d7200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f20d00d3400 con 0x7f20d00d3ee0 2024-03-30T13:12:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.654+0000 7f1435c00640 1 -- start start 2024-03-30T13:12:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f1435c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f143006eac0 0x7f14300b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f8dc1a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db40061a0 0x7f8db40e1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.656+0000 7f1435c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f143006eea0 0x7f1430166a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14980d21f0 con 0x7f14980d0b90 2024-03-30T13:12:12.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f1435c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1430071f10 con 0x7f1430072b30 2024-03-30T13:12:12.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f1435c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f1430071cc0 con 0x7f143006eea0 2024-03-30T13:12:12.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f1435c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f14300721f0 con 0x7f143006eac0 2024-03-30T13:12:12.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f1480001670 con 0x7f14980d0b90 2024-03-30T13:12:12.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f8dc1a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8db40eb060 0x7f8db40deda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f8dc1a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8db40ebb50 0x7f8db40df2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 >> v1:172.21.15.151:6789/0 conn(0x7f14980d0b90 legacy=0x7f14980d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f1495600640 1 --2- 172.21.15.44:0/1298377485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f147c003a00 0x7f147c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f1495600640 1 --2- 172.21.15.44:0/1298377485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f147c004800 0x7f147c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f1495600640 1 --2- 172.21.15.44:0/1298377485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 0x7f147c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f14980d2840 con 0x7f147c003a00 2024-03-30T13:12:12.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f147c00c140 con 0x7f147c005210 2024-03-30T13:12:12.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f147c00c340 con 0x7f147c004800 2024-03-30T13:12:12.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f02e6000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e00e7810 0x7f02e00e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f02e7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e00eb2f0 0x7f02e00d1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f02e7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e00eb2f0 0x7f02e00d1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39376/0 (socket says 172.21.15.44:39376) 2024-03-30T13:12:12.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f02e7400640 1 -- 172.21.15.44:0/2842662411 learned_addr learned my addr 172.21.15.44:0/2842662411 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f142ea00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f143006eac0 0x7f14300b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f20cf400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f20d00cec60 0x7f20d00d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f8dbbe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db40061a0 0x7f8db40e1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f142e000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f143006eea0 0x7f1430166a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f142ea00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f143006eac0 0x7f14300b7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36724/0 (socket says 172.21.15.44:36724) 2024-03-30T13:12:12.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f142ea00640 1 -- 172.21.15.44:0/3816704369 learned_addr learned my addr 172.21.15.44:0/3816704369 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f20d5200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 0x7f20d00d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.658+0000 7f20d5200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 0x7f20d00d17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36746/0 (socket says 172.21.15.44:36746) 2024-03-30T13:12:12.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.658+0000 7f20d5200640 1 -- 172.21.15.44:0/536585765 learned_addr learned my addr 172.21.15.44:0/536585765 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f8dc1a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8db4057630 con 0x7f8db40ebb50 2024-03-30T13:12:12.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f8dc1a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8db4057350 con 0x7f8db40eb060 2024-03-30T13:12:12.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.657+0000 7f8dc1a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f8db40e1e10 con 0x7f8db40061a0 2024-03-30T13:12:12.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.658+0000 7f8dbbe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db40061a0 0x7f8db40e1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36736/0 (socket says 172.21.15.44:36736) 2024-03-30T13:12:12.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.658+0000 7f8dbb400640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8db40eb060 0x7f8db40deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.658+0000 7f8dbbe00640 1 -- 172.21.15.44:0/2151859642 learned_addr learned my addr 172.21.15.44:0/2151859642 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.658+0000 7f02e6a00640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e0006190 0x7f02e00ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.658+0000 7f1497400640 1 --2- 172.21.15.44:0/1298377485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 0x7f147c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.658+0000 7f142ea00640 1 -- 172.21.15.44:0/3816704369 >> v2:172.21.15.151:3300/0 conn(0x7f143006eea0 msgr2=0x7f1430166a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.658+0000 7f142ea00640 1 --2- 172.21.15.44:0/3816704369 >> v2:172.21.15.151:3300/0 conn(0x7f143006eea0 0x7f1430166a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.658+0000 7f142ea00640 1 -- 172.21.15.44:0/3816704369 >> v1:172.21.15.44:6789/0 conn(0x7f1430072b30 legacy=0x7f14300bc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.658+0000 7f142ea00640 1 -- 172.21.15.44:0/3816704369 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14300bb9d0 con 0x7f143006eac0 2024-03-30T13:12:12.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.659+0000 7f1496000640 1 --2- 172.21.15.44:0/1298377485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f147c004800 0x7f147c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.659+0000 7f20d5200640 1 -- 172.21.15.44:0/536585765 >> v2:172.21.15.151:3300/0 conn(0x7f20d00cec60 msgr2=0x7f20d00d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.659+0000 7f20d5200640 1 --2- 172.21.15.44:0/536585765 >> v2:172.21.15.151:3300/0 conn(0x7f20d00cec60 0x7f20d00d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.659+0000 7f20d5200640 1 -- 172.21.15.44:0/536585765 >> v1:172.21.15.44:6789/0 conn(0x7f20d015e7a0 legacy=0x7f20d00cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.659+0000 7f20d5200640 1 -- 172.21.15.44:0/536585765 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d00d36e0 con 0x7f20d00d3ee0 2024-03-30T13:12:12.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.659+0000 7f8dbb400640 1 -- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db40061a0 msgr2=0x7f8db40e1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.659+0000 7f8dbb400640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db40061a0 0x7f8db40e1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.659+0000 7f8dbb400640 1 -- 172.21.15.44:0/2151859642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8db40ebb50 msgr2=0x7f8db40df2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.659+0000 7f8dbb400640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8db40ebb50 0x7f8db40df2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.659+0000 7f8dbb400640 1 -- 172.21.15.44:0/2151859642 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db40e19c0 con 0x7f8db40eb060 2024-03-30T13:12:12.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.659+0000 7f3424c00640 1 -- 172.21.15.44:0/1783792112 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f341c01c020 con 0x7f34200d9710 2024-03-30T13:12:12.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.660+0000 7f1497400640 1 -- 172.21.15.44:0/1298377485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f147c004800 msgr2=0x7f147c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.660+0000 7f1497400640 1 --2- 172.21.15.44:0/1298377485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f147c004800 0x7f147c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.660+0000 7f1497400640 1 -- 172.21.15.44:0/1298377485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f147c003a00 msgr2=0x7f147c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.660+0000 7f1497400640 1 --2- 172.21.15.44:0/1298377485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f147c003a00 0x7f147c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.660+0000 7f1497400640 1 -- 172.21.15.44:0/1298377485 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c003520 con 0x7f147c005210 2024-03-30T13:12:12.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.660+0000 7f02e7400640 1 -- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e0006190 msgr2=0x7f02e00ea760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.660+0000 7f02e7400640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e0006190 0x7f02e00ea760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.660+0000 7f02e7400640 1 -- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e00e7810 msgr2=0x7f02e00e0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.660+0000 7f02e7400640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e00e7810 0x7f02e00e0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.660+0000 7f02e7400640 1 -- 172.21.15.44:0/2842662411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e00e0e70 con 0x7f02e00eb2f0 2024-03-30T13:12:12.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.660+0000 7f8dbb400640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8db40eb060 0x7f8db40deda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8db0033000 tx=0x7f8db00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.660+0000 7f142ea00640 1 --2- 172.21.15.44:0/3816704369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f143006eac0 0x7f14300b7f10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1420009870 tx=0x7f142002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c25b7e15fffb0c36 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f1497400640 1 -- 172.21.15.44:0/1298377485 reap_dead start 2024-03-30T13:12:12.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f20d5200640 1 --2- 172.21.15.44:0/536585765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 0x7f20d00d17f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009870 tx=0x7f20bc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5adc709791577617 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f3424c00640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f340806c560 0x7f340806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f3424c00640 1 -- 172.21.15.44:0/1783792112 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f341c08c2d0 con 0x7f34200d9710 2024-03-30T13:12:12.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f142d600640 1 -- 172.21.15.44:0/3816704369 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14200317c0 con 0x7f143006eac0 2024-03-30T13:12:12.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f02e7400640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e00eb2f0 0x7f02e00d1dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f02d80097a0 tx=0x7f02d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f8dafe00640 1 -- 172.21.15.44:0/2151859642 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0032880 con 0x7f8db40eb060 2024-03-30T13:12:12.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f8dafe00640 1 -- 172.21.15.44:0/2151859642 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db0032a60 con 0x7f8db40eb060 2024-03-30T13:12:12.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f8dafe00640 1 -- 172.21.15.44:0/2151859642 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0032e50 con 0x7f8db40eb060 2024-03-30T13:12:12.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f8dc1a00640 1 -- 172.21.15.44:0/2151859642 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db4009fa0 con 0x7f8db40eb060 2024-03-30T13:12:12.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f142d600640 1 -- 172.21.15.44:0/3816704369 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1420037070 con 0x7f143006eac0 2024-03-30T13:12:12.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f142d600640 1 -- 172.21.15.44:0/3816704369 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1420031b80 con 0x7f143006eac0 2024-03-30T13:12:12.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.661+0000 7f1497400640 1 --2- 172.21.15.44:0/1298377485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 0x7f147c00b9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f149808e9e0 tx=0x7f147c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc69969efe9cbc02 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.662+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490001240 con 0x7f147c005210 2024-03-30T13:12:12.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.662+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1490005290 con 0x7f147c005210 2024-03-30T13:12:12.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.662+0000 7f1495600640 1 -- 172.21.15.44:0/1298377485 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490003830 con 0x7f147c005210 2024-03-30T13:12:12.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.662+0000 7f8dc1a00640 1 -- 172.21.15.44:0/2151859642 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db400c670 con 0x7f8db40eb060 2024-03-30T13:12:12.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f342d200640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f340806c560 0x7f340806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f20cea00640 1 -- 172.21.15.44:0/536585765 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc035020 con 0x7f20d00d3ee0 2024-03-30T13:12:12.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f20cea00640 1 -- 172.21.15.44:0/536585765 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20bc031640 con 0x7f20d00d3ee0 2024-03-30T13:12:12.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f20cea00640 1 -- 172.21.15.44:0/536585765 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc02d040 con 0x7f20d00d3ee0 2024-03-30T13:12:12.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f1497e00640 1 -- 172.21.15.44:0/1298377485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 msgr2=0x7f147c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f1497e00640 1 --2- 172.21.15.44:0/1298377485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 0x7f147c00b9c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f149808e9e0 tx=0x7f147c005830 comp rx=0 tx=0).stop 2024-03-30T13:12:12.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.662+0000 7f1435c00640 1 -- 172.21.15.44:0/3816704369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f143006eac0 msgr2=0x7f14300b7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.662+0000 7f1435c00640 1 --2- 172.21.15.44:0/3816704369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f143006eac0 0x7f14300b7f10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1420009870 tx=0x7f142002b860 comp rx=0 tx=0).stop 2024-03-30T13:12:12.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f1435c00640 1 -- 172.21.15.44:0/3816704369 shutdown_connections 2024-03-30T13:12:12.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f1435c00640 1 --2- 172.21.15.44:0/3816704369 >> v2:172.21.15.151:3300/0 conn(0x7f143006eea0 0x7f1430166a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f1435c00640 1 --2- 172.21.15.44:0/3816704369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f143006eac0 0x7f14300b7f10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f1435c00640 1 -- 172.21.15.44:0/3816704369 >> 172.21.15.44:0/3816704369 conn(0x7f143006d5b0 msgr2=0x7f143006d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f1497e00640 1 -- 172.21.15.44:0/1298377485 shutdown_connections 2024-03-30T13:12:12.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f1497e00640 1 --2- 172.21.15.44:0/1298377485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 0x7f147c00b9c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f1497e00640 1 -- 172.21.15.44:0/1298377485 >> 172.21.15.44:0/1298377485 conn(0x7f149809d4e0 msgr2=0x7f14980d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f551ee00640 1 Processor -- start 2024-03-30T13:12:12.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f1497e00640 1 -- 172.21.15.44:0/1298377485 shutdown_connections 2024-03-30T13:12:12.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.663+0000 7f1497e00640 1 -- 172.21.15.44:0/1298377485 wait complete. 2024-03-30T13:12:12.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.664+0000 7f20d7200640 1 -- 172.21.15.44:0/536585765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 msgr2=0x7f20d00d17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.664+0000 7f20d7200640 1 --2- 172.21.15.44:0/536585765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 0x7f20d00d17f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009870 tx=0x7f20bc02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.664+0000 7f1435c00640 1 -- 172.21.15.44:0/3816704369 shutdown_connections 2024-03-30T13:12:12.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.664+0000 7f8dc1a00640 1 -- 172.21.15.44:0/2151859642 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db400c460 con 0x7f8db40eb060 2024-03-30T13:12:12.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.664+0000 7f20d7200640 1 -- 172.21.15.44:0/536585765 shutdown_connections 2024-03-30T13:12:12.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.664+0000 7f551ee00640 1 -- start start 2024-03-30T13:12:12.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.664+0000 7f20d7200640 1 --2- 172.21.15.44:0/536585765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 0x7f20d00d17f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.664+0000 7f20d7200640 1 --2- 172.21.15.44:0/536585765 >> v2:172.21.15.151:3300/0 conn(0x7f20d00cec60 0x7f20d00d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.664+0000 7f20d7200640 1 -- 172.21.15.44:0/536585765 >> 172.21.15.44:0/536585765 conn(0x7f20d00676b0 msgr2=0x7f20d0067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.664+0000 7f1435c00640 1 -- 172.21.15.44:0/3816704369 wait complete. 2024-03-30T13:12:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.665+0000 7f1497e00640 1 Processor -- start 2024-03-30T13:12:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.665+0000 7f20d7200640 1 -- 172.21.15.44:0/536585765 shutdown_connections 2024-03-30T13:12:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.665+0000 7f342d200640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f340806c560 0x7f340806ea20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3414045000 tx=0x7f341401a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.666+0000 7f551ee00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5518166820 0x7f55180ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.666+0000 7f551ee00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55180cf4c0 con 0x7f55180c3590 2024-03-30T13:12:12.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.666+0000 7f1497e00640 1 -- start start 2024-03-30T13:12:12.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.666+0000 7f1435c00640 1 Processor -- start 2024-03-30T13:12:12.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.666+0000 7f551ee00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5518164100 con 0x7f55180cf0e0 2024-03-30T13:12:12.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.666+0000 7f551ee00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f5518166de0 con 0x7f5518166820 2024-03-30T13:12:12.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.666+0000 7f1435c00640 1 -- start start 2024-03-30T13:12:12.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.667+0000 7f5517e00640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f55180cf0e0 0x7f55180c2e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:54654/0 (socket says 172.21.15.44:54654) 2024-03-30T13:12:12.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.667+0000 7f551ce00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5518166820 0x7f55180ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.667+0000 7f1497e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 0x7f1498158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.667+0000 7f5517e00640 1 -- 172.21.15.44:0/2983294865 learned_addr learned my addr 172.21.15.44:0/2983294865 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:12.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.667+0000 7f1497e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14980cd530 0x7f149806fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.667+0000 7f1497e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14980cd9b0 0x7f1498070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f1496a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 0x7f1498158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f1496a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 0x7f1498158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:42760/0 (socket says 172.21.15.44:42760) 2024-03-30T13:12:12.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.666+0000 7f20d7200640 1 -- 172.21.15.44:0/536585765 wait complete. 2024-03-30T13:12:12.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.666+0000 7f8dafe00640 1 -- 172.21.15.44:0/2151859642 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8db003b3f0 con 0x7f8db40eb060 2024-03-30T13:12:12.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f8dafe00640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8d9c06c7a0 0x7f8d9c06ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f8dafe00640 1 -- 172.21.15.44:0/2151859642 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8db00ad9c0 con 0x7f8db40eb060 2024-03-30T13:12:12.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f20d7200640 1 Processor -- start 2024-03-30T13:12:12.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f1497e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f14980d2e50 con 0x7f14980cd530 2024-03-30T13:12:12.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f1497e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f14980d2cd0 con 0x7f147c005210 2024-03-30T13:12:12.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f1497e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f14980d2fd0 con 0x7f14980cd9b0 2024-03-30T13:12:12.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f1496a00640 1 -- 172.21.15.44:0/4168632066 learned_addr learned my addr 172.21.15.44:0/4168632066 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f1435c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f143006eac0 0x7f1430159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f1435c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f143006eea0 0x7f143015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f1435c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1430072b30 0x7f14301fc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f20d7200640 1 -- start start 2024-03-30T13:12:12.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.668+0000 7f1496000640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14980cd530 0x7f149806fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f551ce00640 1 -- 172.21.15.44:0/2983294865 >> v1:172.21.15.151:6789/0 conn(0x7f55180cf0e0 legacy=0x7f55180c2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f142ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f143006eac0 0x7f1430159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f1435c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f14301632c0 con 0x7f143006eac0 2024-03-30T13:12:12.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f142ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f143006eac0 0x7f1430159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39402/0 (socket says 172.21.15.44:39402) 2024-03-30T13:12:12.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f142ea00640 1 -- 172.21.15.44:0/921160159 learned_addr learned my addr 172.21.15.44:0/921160159 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f1497400640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14980cd9b0 0x7f1498070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f551ce00640 1 -- 172.21.15.44:0/2983294865 >> v1:172.21.15.44:6789/0 conn(0x7f55180c3590 legacy=0x7f55180d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f1435c00640 1 -- 172.21.15.44:0/921160159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f14300bbcb0 con 0x7f1430072b30 2024-03-30T13:12:12.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f1435c00640 1 -- 172.21.15.44:0/921160159 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1430163440 con 0x7f143006eea0 2024-03-30T13:12:12.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f142f400640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1430072b30 0x7f14301fc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f1496000640 1 -- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14980cd9b0 msgr2=0x7f1498070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f1496000640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14980cd9b0 0x7f1498070200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f1496000640 1 -- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 msgr2=0x7f1498158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f1496000640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 0x7f1498158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f1496000640 1 -- 172.21.15.44:0/4168632066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14980a1910 con 0x7f14980cd530 2024-03-30T13:12:12.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f551ce00640 1 -- 172.21.15.44:0/2983294865 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55181670c0 con 0x7f5518166820 2024-03-30T13:12:12.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f8dbbe00640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8d9c06c7a0 0x7f8d9c06ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.669+0000 7f142e000640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f143006eea0 0x7f143015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.670+0000 7f1496a00640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 0x7f1498158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:12.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.670+0000 7f1496000640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14980cd530 0x7f149806fcc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1488009c80 tx=0x7f1488007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.670+0000 7f02dea00640 1 -- 172.21.15.44:0/2842662411 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8040070 con 0x7f02e00eb2f0 2024-03-30T13:12:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.670+0000 7f20d7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20d00cec60 0x7f20d015a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.670+0000 7f3424c00640 1 -- 172.21.15.44:0/1783792112 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f341c023020 con 0x7f34200d9710 2024-03-30T13:12:12.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f02dea00640 1 -- 172.21.15.44:0/2842662411 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d80398f0 con 0x7f02e00eb2f0 2024-03-30T13:12:12.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.670+0000 7f20d7200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 0x7f20d00b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.670+0000 7f142f400640 1 -- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f143006eea0 msgr2=0x7f143015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.670+0000 7f142f400640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f143006eea0 0x7f143015cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.670+0000 7f142f400640 1 -- 172.21.15.44:0/921160159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f143006eac0 msgr2=0x7f1430159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f02dea00640 1 -- 172.21.15.44:0/2842662411 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8035040 con 0x7f02e00eb2f0 2024-03-30T13:12:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f20d7200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20d00b60f0 0x7f20d01f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.670+0000 7f142f400640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f143006eac0 0x7f1430159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f02edc00640 1 -- 172.21.15.44:0/2842662411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e0051a90 con 0x7f02e00eb2f0 2024-03-30T13:12:12.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f20cfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20d00cec60 0x7f20d015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f148ea00640 1 -- 172.21.15.44:0/4168632066 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1488014610 con 0x7f14980cd530 2024-03-30T13:12:12.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f1497e00640 1 -- 172.21.15.44:0/4168632066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14980ccd70 con 0x7f14980cd530 2024-03-30T13:12:12.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f1497e00640 1 -- 172.21.15.44:0/4168632066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14980cd010 con 0x7f14980cd530 2024-03-30T13:12:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f20d7200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f20d00b7720 con 0x7f20d00cec60 2024-03-30T13:12:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f20cfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20d00cec60 0x7f20d015a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39414/0 (socket says 172.21.15.44:39414) 2024-03-30T13:12:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f20cfe00640 1 -- 172.21.15.44:0/2201652207 learned_addr learned my addr 172.21.15.44:0/2201652207 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f20d7200640 1 -- 172.21.15.44:0/2201652207 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f20d00b75a0 con 0x7f20d00b60f0 2024-03-30T13:12:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.670+0000 7f142f400640 1 -- 172.21.15.44:0/921160159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14301595a0 con 0x7f1430072b30 2024-03-30T13:12:12.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f142f400640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1430072b30 0x7f14301fc640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f142800c780 tx=0x7f142800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f20d7200640 1 -- 172.21.15.44:0/2201652207 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f20d00b78a0 con 0x7f20d00d3ee0 2024-03-30T13:12:12.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f8dbbe00640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8d9c06c7a0 0x7f8d9c06ec60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc050e40 tx=0x7f8dbc069360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.672+0000 7f551ce00640 1 --2- 172.21.15.44:0/2983294865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5518166820 0x7f55180ce130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5510009d90 tx=0x7f551002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50f65a387762577a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.671+0000 7f20d5200640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20d00b60f0 0x7f20d01f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.672+0000 7f20cf400640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 0x7f20d00b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.672+0000 7f20d5200640 1 -- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 msgr2=0x7f20d00b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.672+0000 7f20d5200640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 0x7f20d00b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.672+0000 7f02edc00640 1 -- 172.21.15.44:0/2842662411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e0052050 con 0x7f02e00eb2f0 2024-03-30T13:12:12.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.672+0000 7f20d5200640 1 -- 172.21.15.44:0/2201652207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20d00cec60 msgr2=0x7f20d015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.672+0000 7f20d5200640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20d00cec60 0x7f20d015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.673+0000 7f7f07200640 1 Processor -- start 2024-03-30T13:12:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.673+0000 7f20d5200640 1 -- 172.21.15.44:0/2201652207 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d00b4b80 con 0x7f20d00b60f0 2024-03-30T13:12:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.672+0000 7f20cf400640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 0x7f20d00b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.673+0000 7f7f07200640 1 -- start start 2024-03-30T13:12:12.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.673+0000 7f20d5200640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20d00b60f0 0x7f20d01f5150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f20bc033000 tx=0x7f20bc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.674+0000 7f148ea00640 1 -- 172.21.15.44:0/4168632066 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1488019070 con 0x7f14980cd530 2024-03-30T13:12:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.674+0000 7f148ea00640 1 -- 172.21.15.44:0/4168632066 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14880149b0 con 0x7f14980cd530 2024-03-30T13:12:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.674+0000 7f02edc00640 1 -- 172.21.15.44:0/2842662411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e00057d0 con 0x7f02e00eb2f0 2024-03-30T13:12:12.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.674+0000 7f7f07200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7f0003e840 0x7f7f00053bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.674+0000 7f7f07200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f7f00054130 0x7f7f000068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.674+0000 7f7f07200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f00058570 con 0x7f7f000e30c0 2024-03-30T13:12:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.674+0000 7f7f07200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f7f000545a0 con 0x7f7f00054130 2024-03-30T13:12:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.674+0000 7f7f07200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f7f00058850 con 0x7f7f0003e840 2024-03-30T13:12:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.675+0000 7f148ea00640 1 -- 172.21.15.44:0/4168632066 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1488014b50 con 0x7f14980cd530 2024-03-30T13:12:12.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.675+0000 7f1497e00640 1 -- 172.21.15.44:0/4168632066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1470005290 con 0x7f14980cd530 2024-03-30T13:12:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.675+0000 7f7f05e00640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f7f000e30c0 0x7f7f00057d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:54664/0 (socket says 172.21.15.44:54664) 2024-03-30T13:12:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.675+0000 7f7f05e00640 1 -- 172.21.15.44:0/3719466539 learned_addr learned my addr 172.21.15.44:0/3719466539 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.675+0000 7f7f06800640 1 --2- 172.21.15.44:0/3719466539 >> v2:172.21.15.44:3300/0 conn(0x7f7f00054130 0x7f7f000068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.675+0000 7f7f05400640 1 --2- 172.21.15.44:0/3719466539 >> v2:172.21.15.151:3300/0 conn(0x7f7f0003e840 0x7f7f00053bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.675+0000 7f7f06800640 1 -- 172.21.15.44:0/3719466539 >> v2:172.21.15.151:3300/0 conn(0x7f7f0003e840 msgr2=0x7f7f00053bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.675+0000 7f7f06800640 1 --2- 172.21.15.44:0/3719466539 >> v2:172.21.15.151:3300/0 conn(0x7f7f0003e840 0x7f7f00053bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.675+0000 7f7f06800640 1 -- 172.21.15.44:0/3719466539 >> v1:172.21.15.151:6789/0 conn(0x7f7f000e30c0 legacy=0x7f7f00057d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:12.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.675+0000 7f7f06800640 1 -- 172.21.15.44:0/3719466539 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f00058b30 con 0x7f7f00054130 2024-03-30T13:12:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.676+0000 7f148ea00640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f147406c560 0x7f147406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.676+0000 7f148ea00640 1 -- 172.21.15.44:0/4168632066 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f148808c250 con 0x7f14980cd530 2024-03-30T13:12:12.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.676+0000 7f7f06800640 1 --2- 172.21.15.44:0/3719466539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f00054130 0x7f7f000068d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f08000b60 tx=0x7f7f080a70a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bc38b9ad73018c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.677+0000 7f1496a00640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f147406c560 0x7f147406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.678+0000 7f1496a00640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f147406c560 0x7f147406ea20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1480007060 tx=0x7f1480001ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.678+0000 7f02dea00640 1 -- 172.21.15.44:0/2842662411 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f02d8038020 con 0x7f02e00eb2f0 2024-03-30T13:12:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.679+0000 7f02dea00640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f02c806c600 0x7f02c806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.679+0000 7f02dea00640 1 -- 172.21.15.44:0/2842662411 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f02d80ad760 con 0x7f02e00eb2f0 2024-03-30T13:12:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.680+0000 7f02e6a00640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f02c806c600 0x7f02c806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.681+0000 7f02e6a00640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f02c806c600 0x7f02c806eac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f02e802d940 tx=0x7f02e806f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.681+0000 7f02dea00640 1 -- 172.21.15.44:0/2842662411 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f02d807ba20 con 0x7f02e00eb2f0 2024-03-30T13:12:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.685+0000 7f7f04a00640 1 -- 172.21.15.44:0/3719466539 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f080b4070 con 0x7f7f00054130 2024-03-30T13:12:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.685+0000 7f7f04a00640 1 -- 172.21.15.44:0/3719466539 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f080af440 con 0x7f7f00054130 2024-03-30T13:12:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.685+0000 7f7f04a00640 1 -- 172.21.15.44:0/3719466539 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f080af8d0 con 0x7f7f00054130 2024-03-30T13:12:12.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.685+0000 7f148ea00640 1 -- 172.21.15.44:0/4168632066 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f148805a4d0 con 0x7f14980cd530 2024-03-30T13:12:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.685+0000 7f7f07200640 1 -- 172.21.15.44:0/3719466539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f00054130 msgr2=0x7f7f000068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.685+0000 7f7f07200640 1 --2- 172.21.15.44:0/3719466539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f00054130 0x7f7f000068d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f08000b60 tx=0x7f7f080a70a0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.686+0000 7f7f07200640 1 -- 172.21.15.44:0/3719466539 shutdown_connections 2024-03-30T13:12:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.686+0000 7f7f07200640 1 --2- 172.21.15.44:0/3719466539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f00054130 0x7f7f000068d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.686+0000 7f7f07200640 1 --2- 172.21.15.44:0/3719466539 >> v2:172.21.15.151:3300/0 conn(0x7f7f0003e840 0x7f7f00053bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.686+0000 7f7f07200640 1 -- 172.21.15.44:0/3719466539 >> 172.21.15.44:0/3719466539 conn(0x7f7f000559e0 msgr2=0x7f7f00055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.686+0000 7f7f07200640 1 -- 172.21.15.44:0/3719466539 shutdown_connections 2024-03-30T13:12:12.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.686+0000 7f7f07200640 1 -- 172.21.15.44:0/3719466539 wait complete. 2024-03-30T13:12:12.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.687+0000 7f20c7e00640 1 -- 172.21.15.44:0/2201652207 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc040070 con 0x7f20d00b60f0 2024-03-30T13:12:12.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.687+0000 7f20c7e00640 1 -- 172.21.15.44:0/2201652207 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20bc039b90 con 0x7f20d00b60f0 2024-03-30T13:12:12.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.687+0000 7f20c7e00640 1 -- 172.21.15.44:0/2201652207 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc035040 con 0x7f20d00b60f0 2024-03-30T13:12:12.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.687+0000 7f20d7200640 1 -- 172.21.15.44:0/2201652207 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d00b4df0 con 0x7f20d00b60f0 2024-03-30T13:12:12.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.686+0000 7f1426a00640 1 -- 172.21.15.44:0/921160159 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1428017070 con 0x7f1430072b30 2024-03-30T13:12:12.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.687+0000 7f1426a00640 1 -- 172.21.15.44:0/921160159 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1428003b70 con 0x7f1430072b30 2024-03-30T13:12:12.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.687+0000 7f1435c00640 1 -- 172.21.15.44:0/921160159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143015d010 con 0x7f1430072b30 2024-03-30T13:12:12.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.687+0000 7f1426a00640 1 -- 172.21.15.44:0/921160159 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1428005070 con 0x7f1430072b30 2024-03-30T13:12:12.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.687+0000 7f1435c00640 1 -- 172.21.15.44:0/921160159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14300b4410 con 0x7f1430072b30 2024-03-30T13:12:12.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.687+0000 7f8dafe00640 1 -- 172.21.15.44:0/2151859642 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8db40e19c0 con 0x7f8db40eb060 2024-03-30T13:12:12.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.687+0000 7f20d7200640 1 -- 172.21.15.44:0/2201652207 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d00b53b0 con 0x7f20d00b60f0 2024-03-30T13:12:12.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.688+0000 7f5517400640 1 -- 172.21.15.44:0/2983294865 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510039070 con 0x7f5518166820 2024-03-30T13:12:12.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.689+0000 7f5517400640 1 -- 172.21.15.44:0/2983294865 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551002cc60 con 0x7f5518166820 2024-03-30T13:12:12.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.689+0000 7f5517400640 1 -- 172.21.15.44:0/2983294865 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5510034660 con 0x7f5518166820 2024-03-30T13:12:12.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.690+0000 7f7f07200640 1 Processor -- start 2024-03-30T13:12:12.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.690+0000 7f7f07200640 1 -- start start 2024-03-30T13:12:12.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.690+0000 7f551ee00640 1 -- 172.21.15.44:0/2983294865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5518166820 msgr2=0x7f55180ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.690+0000 7f551ee00640 1 --2- 172.21.15.44:0/2983294865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5518166820 0x7f55180ce130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5510009d90 tx=0x7f551002beb0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.691+0000 7f20c7e00640 1 -- 172.21.15.44:0/2201652207 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f20bc04b060 con 0x7f20d00b60f0 2024-03-30T13:12:12.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.691+0000 7f20c7e00640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f20b006c530 0x7f20b006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.693+0000 7f551ee00640 1 -- 172.21.15.44:0/2983294865 shutdown_connections 2024-03-30T13:12:12.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.693+0000 7f551ee00640 1 --2- 172.21.15.44:0/2983294865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5518166820 0x7f55180ce130 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.692+0000 7f20c7e00640 1 -- 172.21.15.44:0/2201652207 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f20bc04edf0 con 0x7f20d00b60f0 2024-03-30T13:12:12.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.693+0000 7f20d7200640 1 -- 172.21.15.44:0/2201652207 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a8005290 con 0x7f20d00b60f0 2024-03-30T13:12:12.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.693+0000 7f551ee00640 1 -- 172.21.15.44:0/2983294865 >> 172.21.15.44:0/2983294865 conn(0x7f551806d610 msgr2=0x7f551806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:12.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.692+0000 7f20cfe00640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f20b006c530 0x7f20b006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.693+0000 7f551ee00640 1 -- 172.21.15.44:0/2983294865 shutdown_connections 2024-03-30T13:12:12.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.693+0000 7f7f07200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f0003e840 0x7f7f000d8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.692+0000 7f1426a00640 1 -- 172.21.15.44:0/921160159 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1428005210 con 0x7f1430072b30 2024-03-30T13:12:12.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.692+0000 7f1435c00640 1 -- 172.21.15.44:0/921160159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1430072670 con 0x7f1430072b30 2024-03-30T13:12:12.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.693+0000 7f1426a00640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f141006c530 0x7f141006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.693+0000 7f551ee00640 1 -- 172.21.15.44:0/2983294865 wait complete. 2024-03-30T13:12:12.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.693+0000 7f7f07200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f00054130 0x7f7f000dd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.694+0000 7f1426a00640 1 -- 172.21.15.44:0/921160159 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1428056be0 con 0x7f1430072b30 2024-03-30T13:12:12.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.694+0000 7f7f07200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f000e30c0 0x7f7f000df3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.694+0000 7f7f07200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7f000e34a0 con 0x7f7f00054130 2024-03-30T13:12:12.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.694+0000 7f7f05400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f00054130 0x7f7f000dd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.694+0000 7f142ea00640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f141006c530 0x7f141006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.694+0000 7f20cfe00640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f20b006c530 0x7f20b006e9f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f20d00cb510 tx=0x7f20c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.694+0000 7f7f05e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f0003e840 0x7f7f000d8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.694+0000 7f7f05400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f00054130 0x7f7f000dd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39422/0 (socket says 172.21.15.44:39422) 2024-03-30T13:12:12.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.694+0000 7f7f05400640 1 -- 172.21.15.44:0/3328379631 learned_addr learned my addr 172.21.15.44:0/3328379631 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.694+0000 7f7f06800640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f000e30c0 0x7f7f000df3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.695+0000 7f7f07200640 1 -- 172.21.15.44:0/3328379631 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0003bfc0 con 0x7f7f0003e840 2024-03-30T13:12:12.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.695+0000 7f7f07200640 1 -- 172.21.15.44:0/3328379631 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7f00006e10 con 0x7f7f000e30c0 2024-03-30T13:12:12.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.695+0000 7f7f05400640 1 -- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f000e30c0 msgr2=0x7f7f000df3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.695+0000 7f7f05400640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f000e30c0 0x7f7f000df3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.696+0000 7f7f05400640 1 -- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f0003e840 msgr2=0x7f7f000d8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.696+0000 7f7f05400640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f0003e840 0x7f7f000d8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.696+0000 7f7f05400640 1 -- 172.21.15.44:0/3328379631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f000d9010 con 0x7f7f00054130 2024-03-30T13:12:12.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.696+0000 7f551ee00640 1 Processor -- start 2024-03-30T13:12:12.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.696+0000 7f551ee00640 1 -- start start 2024-03-30T13:12:12.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.696+0000 7f7f05400640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f00054130 0x7f7f000dd130 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400e9b0 tx=0x7f7ef400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.696+0000 7f142ea00640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f141006c530 0x7f141006e9f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1420000c00 tx=0x7f142003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.697+0000 7f7efe000640 1 -- 172.21.15.44:0/3328379631 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4017070 con 0x7f7f00054130 2024-03-30T13:12:12.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.697+0000 7f7efe000640 1 -- 172.21.15.44:0/3328379631 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef400c9a0 con 0x7f7f00054130 2024-03-30T13:12:12.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.697+0000 7f7efe000640 1 -- 172.21.15.44:0/3328379631 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400cd90 con 0x7f7f00054130 2024-03-30T13:12:12.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.697+0000 7f7f07200640 1 -- 172.21.15.44:0/3328379631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f000ddaa0 con 0x7f7f00054130 2024-03-30T13:12:12.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.697+0000 7f7f07200640 1 -- 172.21.15.44:0/3328379631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f000de060 con 0x7f7f00054130 2024-03-30T13:12:12.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.697+0000 7f551ee00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55180c3590 0x7f5518154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.697+0000 7f551ee00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55180cf0e0 0x7f55180c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.698+0000 7f551ee00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5518166820 0x7f55180bec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.698+0000 7f551ee00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5518167680 con 0x7f5518166820 2024-03-30T13:12:12.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.698+0000 7f551ee00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f55180cfd10 con 0x7f55180c3590 2024-03-30T13:12:12.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.698+0000 7f551ee00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f55180ccf40 con 0x7f55180cf0e0 2024-03-30T13:12:12.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.699+0000 7f5517e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55180c3590 0x7f5518154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.699+0000 7f7f07200640 1 -- 172.21.15.44:0/3328379631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f000057e0 con 0x7f7f00054130 2024-03-30T13:12:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.699+0000 7f550fe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55180cf0e0 0x7f55180c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.699+0000 7f551ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5518166820 0x7f55180bec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.699+0000 7f550fe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55180cf0e0 0x7f55180c4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36820/0 (socket says 172.21.15.44:36820) 2024-03-30T13:12:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.699+0000 7f550fe00640 1 -- 172.21.15.44:0/3540538833 learned_addr learned my addr 172.21.15.44:0/3540538833 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.700+0000 7f550fe00640 1 -- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55180c3590 msgr2=0x7f5518154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.700+0000 7f550fe00640 1 --2- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55180c3590 0x7f5518154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.700+0000 7f550fe00640 1 -- 172.21.15.44:0/3540538833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5518166820 msgr2=0x7f55180bec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:12.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.700+0000 7f550fe00640 1 --2- 172.21.15.44:0/3540538833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5518166820 0x7f55180bec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:12.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.700+0000 7f550fe00640 1 -- 172.21.15.44:0/3540538833 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55180c53f0 con 0x7f55180cf0e0 2024-03-30T13:12:12.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.701+0000 7f550fe00640 1 --2- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55180cf0e0 0x7f55180c4930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f550000c450 tx=0x7f550000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.702+0000 7f5514c00640 1 -- 172.21.15.44:0/3540538833 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55000052d0 con 0x7f55180cf0e0 2024-03-30T13:12:12.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.702+0000 7f5514c00640 1 -- 172.21.15.44:0/3540538833 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5500005470 con 0x7f55180cf0e0 2024-03-30T13:12:12.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.702+0000 7f5514c00640 1 -- 172.21.15.44:0/3540538833 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500012870 con 0x7f55180cf0e0 2024-03-30T13:12:12.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.702+0000 7f551ee00640 1 -- 172.21.15.44:0/3540538833 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55180c5730 con 0x7f55180cf0e0 2024-03-30T13:12:12.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.703+0000 7f7efe000640 1 -- 172.21.15.44:0/3328379631 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7ef401a070 con 0x7f7f00054130 2024-03-30T13:12:12.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.703+0000 7f551ee00640 1 -- 172.21.15.44:0/3540538833 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f55180c5f70 con 0x7f55180cf0e0 2024-03-30T13:12:12.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.704+0000 7f7efe000640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7ee806c600 0x7f7ee806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.704+0000 7f7efe000640 1 -- 172.21.15.44:0/3328379631 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7ef408c1b0 con 0x7f7f00054130 2024-03-30T13:12:12.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.704+0000 7f551ee00640 1 -- 172.21.15.44:0/3540538833 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5518075900 con 0x7f55180cf0e0 2024-03-30T13:12:12.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.705+0000 7f7f05e00640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7ee806c600 0x7f7ee806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.706+0000 7f7f05e00640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7ee806c600 0x7f7ee806eac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80092a0 tx=0x7f7ef8009230 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.707+0000 7f5514c00640 1 -- 172.21.15.44:0/3540538833 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5500012a10 con 0x7f55180cf0e0 2024-03-30T13:12:12.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.708+0000 7f5514c00640 1 --2- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f54f406c580 0x7f54f406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:12.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.708+0000 7f5514c00640 1 -- 172.21.15.44:0/3540538833 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f550008bf30 con 0x7f55180cf0e0 2024-03-30T13:12:12.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.708+0000 7f7efe000640 1 -- 172.21.15.44:0/3328379631 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7f000d9010 con 0x7f7f00054130 2024-03-30T13:12:12.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.709+0000 7f5517e00640 1 --2- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f54f406c580 0x7f54f406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:12.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.710+0000 7f5517e00640 1 --2- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f54f406c580 0x7f54f406ea40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5508005880 tx=0x7f5508009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:12.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.714+0000 7f20c7e00640 1 -- 172.21.15.44:0/2201652207 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f20bc07b5e0 con 0x7f20d00b60f0 2024-03-30T13:12:12.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.739+0000 7f5514c00640 1 -- 172.21.15.44:0/3540538833 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f55180c5730 con 0x7f55180cf0e0 2024-03-30T13:12:12.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:12.739+0000 7f1426a00640 1 -- 172.21.15.44:0/921160159 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1430072670 con 0x7f1430072b30 2024-03-30T13:12:13.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.109+0000 7f342e600640 1 -- 172.21.15.44:0/1783792112 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f34200e6300 con 0x7f34200d9710 2024-03-30T13:12:13.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.109+0000 7f3424c00640 1 -- 172.21.15.44:0/1783792112 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f341c05a480 con 0x7f34200d9710 2024-03-30T13:12:13.117 INFO:teuthology.orchestra.run.smithi044.stdout:64424509449 2024-03-30T13:12:13.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.114+0000 7f341a000640 1 -- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f340806c560 msgr2=0x7f340806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.114+0000 7f341a000640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f340806c560 0x7f340806ea20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3414045000 tx=0x7f341401a000 comp rx=0 tx=0).stop 2024-03-30T13:12:13.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.114+0000 7f341a000640 1 -- 172.21.15.44:0/1783792112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34200d9710 msgr2=0x7f34200ea4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.114+0000 7f341a000640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34200d9710 0x7f34200ea4a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f341c00f880 tx=0x7f341c00fd40 comp rx=0 tx=0).stop 2024-03-30T13:12:13.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.117+0000 7f341a000640 1 -- 172.21.15.44:0/1783792112 shutdown_connections 2024-03-30T13:12:13.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.117+0000 7f341a000640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34200385f0 0x7f3420038a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.117+0000 7f341a000640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34200d9710 0x7f34200ea4a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.117+0000 7f341a000640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f340806c560 0x7f340806ea20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.117+0000 7f341a000640 1 --2- 172.21.15.44:0/1783792112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34200d9330 0x7f34200e3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.117+0000 7f341a000640 1 -- 172.21.15.44:0/1783792112 >> 172.21.15.44:0/1783792112 conn(0x7f3420058ee0 msgr2=0x7f3420006e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:13.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.118+0000 7f341a000640 1 -- 172.21.15.44:0/1783792112 shutdown_connections 2024-03-30T13:12:13.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.118+0000 7f341a000640 1 -- 172.21.15.44:0/1783792112 wait complete. 2024-03-30T13:12:13.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.119+0000 7f02edc00640 1 -- 172.21.15.44:0/2842662411 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f02e0056000 con 0x7f02e00eb2f0 2024-03-30T13:12:13.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.120+0000 7f02dea00640 1 -- 172.21.15.44:0/2842662411 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f02d807b320 con 0x7f02e00eb2f0 2024-03-30T13:12:13.127 INFO:teuthology.orchestra.run.smithi044.stdout:60129542153 2024-03-30T13:12:13.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.123+0000 7f02edc00640 1 -- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f02c806c600 msgr2=0x7f02c806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.124+0000 7f02edc00640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f02c806c600 0x7f02c806eac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f02e802d940 tx=0x7f02e806f040 comp rx=0 tx=0).stop 2024-03-30T13:12:13.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.124+0000 7f02edc00640 1 -- 172.21.15.44:0/2842662411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e00eb2f0 msgr2=0x7f02e00d1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.124+0000 7f02edc00640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e00eb2f0 0x7f02e00d1dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f02d80097a0 tx=0x7f02d80046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.124+0000 7f02edc00640 1 -- 172.21.15.44:0/2842662411 shutdown_connections 2024-03-30T13:12:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.124+0000 7f02edc00640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f02e00eb2f0 0x7f02e00d1dd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.124+0000 7f02edc00640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f02c806c600 0x7f02c806eac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.124+0000 7f02edc00640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02e00e7810 0x7f02e00e0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.124+0000 7f02edc00640 1 --2- 172.21.15.44:0/2842662411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f02e0006190 0x7f02e00ea760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.124+0000 7f02edc00640 1 -- 172.21.15.44:0/2842662411 >> 172.21.15.44:0/2842662411 conn(0x7f02e00559d0 msgr2=0x7f02e003dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:13.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.125+0000 7f02edc00640 1 -- 172.21.15.44:0/2842662411 shutdown_connections 2024-03-30T13:12:13.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.125+0000 7f02edc00640 1 -- 172.21.15.44:0/2842662411 wait complete. 2024-03-30T13:12:13.145 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-03-30T13:12:13.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.138+0000 7f1497e00640 1 -- 172.21.15.44:0/4168632066 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1470005580 con 0x7f14980cd530 2024-03-30T13:12:13.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.138+0000 7f148ea00640 1 -- 172.21.15.44:0/4168632066 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1488059dd0 con 0x7f14980cd530 2024-03-30T13:12:13.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.142+0000 7f1497e00640 1 -- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f147406c560 msgr2=0x7f147406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.142+0000 7f1497e00640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f147406c560 0x7f147406ea20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1480007060 tx=0x7f1480001ad0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.142+0000 7f1497e00640 1 -- 172.21.15.44:0/4168632066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14980cd530 msgr2=0x7f149806fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.142+0000 7f1497e00640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14980cd530 0x7f149806fcc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1488009c80 tx=0x7f1488007700 comp rx=0 tx=0).stop 2024-03-30T13:12:13.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.143+0000 7f1497e00640 1 -- 172.21.15.44:0/4168632066 shutdown_connections 2024-03-30T13:12:13.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.143+0000 7f1497e00640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14980cd9b0 0x7f1498070200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.143+0000 7f1497e00640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14980cd530 0x7f149806fcc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.143+0000 7f1497e00640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f147406c560 0x7f147406ea20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.143+0000 7f1497e00640 1 --2- 172.21.15.44:0/4168632066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147c005210 0x7f1498158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.143+0000 7f1497e00640 1 -- 172.21.15.44:0/4168632066 >> 172.21.15.44:0/4168632066 conn(0x7f149809d4e0 msgr2=0x7f149815fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:13.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.143+0000 7f1497e00640 1 -- 172.21.15.44:0/4168632066 shutdown_connections 2024-03-30T13:12:13.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.143+0000 7f1497e00640 1 -- 172.21.15.44:0/4168632066 wait complete. 2024-03-30T13:12:13.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.146+0000 7f8dc1a00640 1 -- 172.21.15.44:0/2151859642 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8db40057e0 con 0x7f8db40eb060 2024-03-30T13:12:13.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-03-30T13:12:13.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.147+0000 7f8dafe00640 1 -- 172.21.15.44:0/2151859642 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8db0040070 con 0x7f8db40eb060 2024-03-30T13:12:13.157 INFO:teuthology.orchestra.run.smithi044.stdout:64424509448 2024-03-30T13:12:13.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.150+0000 7f8dc1a00640 1 -- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8d9c06c7a0 msgr2=0x7f8d9c06ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.150+0000 7f8dc1a00640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8d9c06c7a0 0x7f8d9c06ec60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc050e40 tx=0x7f8dbc069360 comp rx=0 tx=0).stop 2024-03-30T13:12:13.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.151+0000 7f8dc1a00640 1 -- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8db40eb060 msgr2=0x7f8db40deda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.151+0000 7f8dc1a00640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8db40eb060 0x7f8db40deda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8db0033000 tx=0x7f8db00046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.151+0000 7f8dc1a00640 1 -- 172.21.15.44:0/2151859642 shutdown_connections 2024-03-30T13:12:13.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.151+0000 7f8dc1a00640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8db40ebb50 0x7f8db40df2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.151+0000 7f8dc1a00640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8d9c06c7a0 0x7f8d9c06ec60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.151+0000 7f8dc1a00640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8db40eb060 0x7f8db40deda0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.151+0000 7f8dc1a00640 1 --2- 172.21.15.44:0/2151859642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8db40061a0 0x7f8db40e1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.151+0000 7f8dc1a00640 1 -- 172.21.15.44:0/2151859642 >> 172.21.15.44:0/2151859642 conn(0x7f8db40559e0 msgr2=0x7f8db4007360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:13.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.151+0000 7f8dc1a00640 1 -- 172.21.15.44:0/2151859642 shutdown_connections 2024-03-30T13:12:13.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.151+0000 7f8dc1a00640 1 -- 172.21.15.44:0/2151859642 wait complete. 2024-03-30T13:12:13.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.2 2024-03-30T13:12:13.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.156+0000 7f20d7200640 1 -- 172.21.15.44:0/2201652207 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f20a8005850 con 0x7f20d00b60f0 2024-03-30T13:12:13.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.157+0000 7f20c7e00640 1 -- 172.21.15.44:0/2201652207 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f20bc07aee0 con 0x7f20d00b60f0 2024-03-30T13:12:13.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.157+0000 7f7f07200640 1 -- 172.21.15.44:0/3328379631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7f00009000 con 0x7f7f00054130 2024-03-30T13:12:13.162 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-03-30T13:12:13.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.157+0000 7f7efe000640 1 -- 172.21.15.44:0/3328379631 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7ef4059e20 con 0x7f7f00054130 2024-03-30T13:12:13.163 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-03-30T13:12:13.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.159+0000 7f20d7200640 1 -- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f20b006c530 msgr2=0x7f20b006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.159+0000 7f20d7200640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f20b006c530 0x7f20b006e9f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f20d00cb510 tx=0x7f20c0009040 comp rx=0 tx=0).stop 2024-03-30T13:12:13.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.159+0000 7f20d7200640 1 -- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20d00b60f0 msgr2=0x7f20d01f5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.159+0000 7f20d7200640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20d00b60f0 0x7f20d01f5150 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f20bc033000 tx=0x7f20bc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.159+0000 7f20d7200640 1 -- 172.21.15.44:0/2201652207 shutdown_connections 2024-03-30T13:12:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.159+0000 7f20d7200640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f20b006c530 0x7f20b006e9f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.159+0000 7f20d7200640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20d00b60f0 0x7f20d01f5150 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.159+0000 7f20d7200640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20d00d3ee0 0x7f20d00b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.159+0000 7f20d7200640 1 --2- 172.21.15.44:0/2201652207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f20d00cec60 0x7f20d015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.159+0000 7f20d7200640 1 -- 172.21.15.44:0/2201652207 >> 172.21.15.44:0/2201652207 conn(0x7f20d00676b0 msgr2=0x7f20d0067a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.160+0000 7f20d7200640 1 -- 172.21.15.44:0/2201652207 shutdown_connections 2024-03-30T13:12:13.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.160+0000 7f20d7200640 1 -- 172.21.15.44:0/2201652207 wait complete. 2024-03-30T13:12:13.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.162+0000 7f7f07200640 1 -- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7ee806c600 msgr2=0x7f7ee806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.162+0000 7f7f07200640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7ee806c600 0x7f7ee806eac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80092a0 tx=0x7f7ef8009230 comp rx=0 tx=0).stop 2024-03-30T13:12:13.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.162+0000 7f7f07200640 1 -- 172.21.15.44:0/3328379631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f00054130 msgr2=0x7f7f000dd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.162+0000 7f7f07200640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f00054130 0x7f7f000dd130 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400e9b0 tx=0x7f7ef400ee70 comp rx=0 tx=0).stop 2024-03-30T13:12:13.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.162+0000 7f7f07200640 1 -- 172.21.15.44:0/3328379631 shutdown_connections 2024-03-30T13:12:13.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.162+0000 7f7f07200640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f000e30c0 0x7f7f000df3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.162+0000 7f7f07200640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f00054130 0x7f7f000dd130 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.162+0000 7f7f07200640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7ee806c600 0x7f7ee806eac0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80092a0 tx=0x7f7ef8009230 comp rx=0 tx=0).stop 2024-03-30T13:12:13.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.162+0000 7f7f07200640 1 --2- 172.21.15.44:0/3328379631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f0003e840 0x7f7f000d8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.162+0000 7f7f07200640 1 -- 172.21.15.44:0/3328379631 >> 172.21.15.44:0/3328379631 conn(0x7f7f000559e0 msgr2=0x7f7f0003a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:13.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.1 2024-03-30T13:12:13.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.164+0000 7f7f07200640 1 -- 172.21.15.44:0/3328379631 shutdown_connections 2024-03-30T13:12:13.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.165+0000 7f7f07200640 1 -- 172.21.15.44:0/3328379631 wait complete. 2024-03-30T13:12:13.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-03-30T13:12:13.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2024-03-30T13:12:13.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.7 2024-03-30T13:12:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.200+0000 7f1435c00640 1 -- 172.21.15.44:0/921160159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f14300bd5e0 con 0x7f1430072b30 2024-03-30T13:12:13.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.201+0000 7f1426a00640 1 -- 172.21.15.44:0/921160159 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1428058b40 con 0x7f1430072b30 2024-03-30T13:12:13.206 INFO:teuthology.orchestra.run.smithi044.stdout:64424509449 2024-03-30T13:12:13.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.201+0000 7f551ee00640 1 -- 172.21.15.44:0/3540538833 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f551806f5c0 con 0x7f55180cf0e0 2024-03-30T13:12:13.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.202+0000 7f5514c00640 1 -- 172.21.15.44:0/3540538833 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5500059ca0 con 0x7f55180cf0e0 2024-03-30T13:12:13.207 INFO:teuthology.orchestra.run.smithi044.stdout:64424509449 2024-03-30T13:12:13.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.204+0000 7f1435c00640 1 -- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f141006c530 msgr2=0x7f141006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.204+0000 7f1435c00640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f141006c530 0x7f141006e9f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1420000c00 tx=0x7f142003d040 comp rx=0 tx=0).stop 2024-03-30T13:12:13.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.204+0000 7f1435c00640 1 -- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1430072b30 msgr2=0x7f14301fc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.204+0000 7f1435c00640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1430072b30 0x7f14301fc640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f142800c780 tx=0x7f142800cc40 comp rx=0 tx=0).stop 2024-03-30T13:12:13.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.204+0000 7f1435c00640 1 -- 172.21.15.44:0/921160159 shutdown_connections 2024-03-30T13:12:13.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.204+0000 7f1435c00640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f141006c530 0x7f141006e9f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.204+0000 7f1435c00640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1430072b30 0x7f14301fc640 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.204+0000 7f1435c00640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f143006eea0 0x7f143015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.204+0000 7f1435c00640 1 --2- 172.21.15.44:0/921160159 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f143006eac0 0x7f1430159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.204+0000 7f1435c00640 1 -- 172.21.15.44:0/921160159 >> 172.21.15.44:0/921160159 conn(0x7f143006d5b0 msgr2=0x7f143015fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:13.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.204+0000 7f1435c00640 1 -- 172.21.15.44:0/921160159 shutdown_connections 2024-03-30T13:12:13.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.204+0000 7f1435c00640 1 -- 172.21.15.44:0/921160159 wait complete. 2024-03-30T13:12:13.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.205+0000 7f551ee00640 1 -- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f54f406c580 msgr2=0x7f54f406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.205+0000 7f551ee00640 1 --2- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f54f406c580 0x7f54f406ea40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5508005880 tx=0x7f5508009040 comp rx=0 tx=0).stop 2024-03-30T13:12:13.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.205+0000 7f551ee00640 1 -- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55180cf0e0 msgr2=0x7f55180c4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:13.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.205+0000 7f551ee00640 1 --2- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55180cf0e0 0x7f55180c4930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f550000c450 tx=0x7f550000c910 comp rx=0 tx=0).stop 2024-03-30T13:12:13.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.205+0000 7f551ee00640 1 -- 172.21.15.44:0/3540538833 shutdown_connections 2024-03-30T13:12:13.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.205+0000 7f551ee00640 1 --2- 172.21.15.44:0/3540538833 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5518166820 0x7f55180bec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.205+0000 7f551ee00640 1 --2- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55180cf0e0 0x7f55180c4930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.205+0000 7f551ee00640 1 --2- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f54f406c580 0x7f54f406ea40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.205+0000 7f551ee00640 1 --2- 172.21.15.44:0/3540538833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55180c3590 0x7f5518154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:13.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.205+0000 7f551ee00640 1 -- 172.21.15.44:0/3540538833 >> 172.21.15.44:0/3540538833 conn(0x7f551806d610 msgr2=0x7f55181642f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:13.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.205+0000 7f551ee00640 1 -- 172.21.15.44:0/3540538833 shutdown_connections 2024-03-30T13:12:13.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:13.205+0000 7f551ee00640 1 -- 172.21.15.44:0/3540538833 wait complete. 2024-03-30T13:12:13.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.4 2024-03-30T13:12:13.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.5 2024-03-30T13:12:14.152 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-30T13:12:14.161 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-30T13:12:14.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-30T13:12:14.178 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-30T13:12:14.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-30T13:12:14.188 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-30T13:12:14.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-30T13:12:14.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-30T13:12:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.442+0000 7fb85bc00640 1 Processor -- start 2024-03-30T13:12:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.442+0000 7fb85bc00640 1 -- start start 2024-03-30T13:12:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.444+0000 7fb85bc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8540ccac0 0x7fb8540cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.444+0000 7fb85bc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb85415a710 0x7fb85415df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.444+0000 7fb85bc00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb8540ccea0 0x7fb85415b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.445+0000 7fb85bc00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb8540cb070 con 0x7fb85415a710 2024-03-30T13:12:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.446+0000 7fb859200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8540ccac0 0x7fb8540cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.446+0000 7fb853e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb85415a710 0x7fb85415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.446+0000 7fb853e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb85415a710 0x7fb85415df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39432/0 (socket says 172.21.15.44:39432) 2024-03-30T13:12:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.446+0000 7fb853e00640 1 -- 172.21.15.44:0/757667203 learned_addr learned my addr 172.21.15.44:0/757667203 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:14.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.446+0000 7fb859c00640 1 --2- 172.21.15.44:0/757667203 >> v2:172.21.15.151:3300/0 conn(0x7fb8540ccea0 0x7fb85415b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.446+0000 7fb85bc00640 1 -- 172.21.15.44:0/757667203 --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fb85415ad40 con 0x7fb8540ccea0 2024-03-30T13:12:14.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.446+0000 7fb85bc00640 1 -- 172.21.15.44:0/757667203 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb85415e490 con 0x7fb8540ccac0 2024-03-30T13:12:14.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.448+0000 7fb859200640 1 -- 172.21.15.44:0/757667203 >> v2:172.21.15.151:3300/0 conn(0x7fb8540ccea0 msgr2=0x7fb85415b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.448+0000 7fb859200640 1 --2- 172.21.15.44:0/757667203 >> v2:172.21.15.151:3300/0 conn(0x7fb8540ccea0 0x7fb85415b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.448+0000 7fb859200640 1 -- 172.21.15.44:0/757667203 >> v2:172.21.15.44:3300/0 conn(0x7fb85415a710 msgr2=0x7fb85415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.448+0000 7fb859200640 1 --2- 172.21.15.44:0/757667203 >> v2:172.21.15.44:3300/0 conn(0x7fb85415a710 0x7fb85415df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.449+0000 7fb859200640 1 -- 172.21.15.44:0/757667203 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85415e710 con 0x7fb8540ccac0 2024-03-30T13:12:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.450+0000 7fb859c00640 1 --2- 172.21.15.44:0/757667203 >> v2:172.21.15.151:3300/0 conn(0x7fb8540ccea0 0x7fb85415b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.450+0000 7fb853e00640 1 --2- 172.21.15.44:0/757667203 >> v2:172.21.15.44:3300/0 conn(0x7fb85415a710 0x7fb85415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.451+0000 7fb859200640 1 --2- 172.21.15.44:0/757667203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8540ccac0 0x7fb8540cf7b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb85406ea00 tx=0x7fb84402b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51c7b7235673753f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.452+0000 7fb853400640 1 -- 172.21.15.44:0/757667203 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84402e070 con 0x7fb8540ccac0 2024-03-30T13:12:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.452+0000 7fb853400640 1 -- 172.21.15.44:0/757667203 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb844037070 con 0x7fb8540ccac0 2024-03-30T13:12:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.452+0000 7fb853400640 1 -- 172.21.15.44:0/757667203 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844031a40 con 0x7fb8540ccac0 2024-03-30T13:12:14.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.453+0000 7fb85bc00640 1 -- 172.21.15.44:0/757667203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8540ccac0 msgr2=0x7fb8540cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.453+0000 7fb85bc00640 1 --2- 172.21.15.44:0/757667203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8540ccac0 0x7fb8540cf7b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb85406ea00 tx=0x7fb84402b880 comp rx=0 tx=0).stop 2024-03-30T13:12:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.454+0000 7fb85bc00640 1 -- 172.21.15.44:0/757667203 shutdown_connections 2024-03-30T13:12:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.454+0000 7fb85bc00640 1 --2- 172.21.15.44:0/757667203 >> v2:172.21.15.151:3300/0 conn(0x7fb8540ccea0 0x7fb85415b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.454+0000 7fb85bc00640 1 --2- 172.21.15.44:0/757667203 >> v2:172.21.15.44:3300/0 conn(0x7fb85415a710 0x7fb85415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.454+0000 7fb85bc00640 1 --2- 172.21.15.44:0/757667203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8540ccac0 0x7fb8540cf7b0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb85406ea00 tx=0x7fb84402b880 comp rx=0 tx=0).stop 2024-03-30T13:12:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.454+0000 7fb85bc00640 1 -- 172.21.15.44:0/757667203 >> 172.21.15.44:0/757667203 conn(0x7fb8540b1800 msgr2=0x7fb8540b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.455+0000 7fb85bc00640 1 -- 172.21.15.44:0/757667203 shutdown_connections 2024-03-30T13:12:14.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.455+0000 7fb85bc00640 1 -- 172.21.15.44:0/757667203 wait complete. 2024-03-30T13:12:14.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.461+0000 7fb85bc00640 1 Processor -- start 2024-03-30T13:12:14.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.461+0000 7fb85bc00640 1 -- start start 2024-03-30T13:12:14.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.463+0000 7fb85bc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8540ccea0 0x7fb854159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.463+0000 7fb85bc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb85415a710 0x7fb8540b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.463+0000 7fb85bc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8540b39b0 0x7fb8540c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.463+0000 7fb85bc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb8540cd330 con 0x7fb8540ccea0 2024-03-30T13:12:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.463+0000 7fb85bc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb85415ecd0 con 0x7fb85415a710 2024-03-30T13:12:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.463+0000 7fb85bc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb85415b710 con 0x7fb8540b39b0 2024-03-30T13:12:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.465+0000 7fb859200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8540ccea0 0x7fb854159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.465+0000 7fb859c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8540b39b0 0x7fb8540c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.465+0000 7fb859c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8540b39b0 0x7fb8540c9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36842/0 (socket says 172.21.15.44:36842) 2024-03-30T13:12:14.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.465+0000 7fb859c00640 1 -- 172.21.15.44:0/3056968296 learned_addr learned my addr 172.21.15.44:0/3056968296 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:14.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.465+0000 7fb853e00640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb85415a710 0x7fb8540b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.466+0000 7fb859200640 1 -- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8540b39b0 msgr2=0x7fb8540c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.466+0000 7fb859200640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8540b39b0 0x7fb8540c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.466+0000 7fb859200640 1 -- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb85415a710 msgr2=0x7fb8540b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.466+0000 7fb859200640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb85415a710 0x7fb8540b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.466+0000 7fb859200640 1 -- 172.21.15.44:0/3056968296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8540b3eb0 con 0x7fb8540ccea0 2024-03-30T13:12:14.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.467+0000 7fb859200640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8540ccea0 0x7fb854159910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb844033000 tx=0x7fb8440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.468+0000 7fb850c00640 1 -- 172.21.15.44:0/3056968296 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84404a070 con 0x7fb8540ccea0 2024-03-30T13:12:14.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.468+0000 7fb850c00640 1 -- 172.21.15.44:0/3056968296 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb844032470 con 0x7fb8540ccea0 2024-03-30T13:12:14.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.468+0000 7fb850c00640 1 -- 172.21.15.44:0/3056968296 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844032840 con 0x7fb8540ccea0 2024-03-30T13:12:14.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.468+0000 7fb85bc00640 1 -- 172.21.15.44:0/3056968296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8540b4190 con 0x7fb8540ccea0 2024-03-30T13:12:14.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.469+0000 7fb85bc00640 1 -- 172.21.15.44:0/3056968296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8540b4750 con 0x7fb8540ccea0 2024-03-30T13:12:14.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.474+0000 7fb850c00640 1 -- 172.21.15.44:0/3056968296 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb84404d070 con 0x7fb8540ccea0 2024-03-30T13:12:14.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.476+0000 7fb850c00640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb83406c580 0x7fb83406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.476+0000 7fb850c00640 1 -- 172.21.15.44:0/3056968296 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb8440ad130 con 0x7fb8540ccea0 2024-03-30T13:12:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.477+0000 7fb84a000640 1 -- 172.21.15.44:0/3056968296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb828005290 con 0x7fb8540ccea0 2024-03-30T13:12:14.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.481+0000 7fb853e00640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb83406c580 0x7fb83406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.482+0000 7fb853e00640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb83406c580 0x7fb83406ea40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8541f36f0 tx=0x7fb84c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.488+0000 7fb850c00640 1 -- 172.21.15.44:0/3056968296 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb844040070 con 0x7fb8540ccea0 2024-03-30T13:12:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.492+0000 7f0798c00640 1 Processor -- start 2024-03-30T13:12:14.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.493+0000 7f0798c00640 1 -- start start 2024-03-30T13:12:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.495+0000 7f0798c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 0x7f078c04fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.495+0000 7f0798c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078c0503a0 con 0x7f078c054260 2024-03-30T13:12:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.496+0000 7f0798c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078c006ae0 con 0x7f078c0df410 2024-03-30T13:12:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.496+0000 7f0791e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 0x7f078c04fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.496+0000 7f0791e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 0x7f078c04fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36850/0 (socket says 172.21.15.44:36850) 2024-03-30T13:12:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.496+0000 7f0791e00640 1 -- 172.21.15.44:0/3192110455 learned_addr learned my addr 172.21.15.44:0/3192110455 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.496+0000 7f0791400640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f078c0df410 0x7f078c0382b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:54680/0 (socket says 172.21.15.44:54680) 2024-03-30T13:12:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.496+0000 7f0792800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f078c054260 0x7f078c0389c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56894/0 (socket says 172.21.15.44:56894) 2024-03-30T13:12:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.497+0000 7f0798c00640 1 -- 172.21.15.44:0/3192110455 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f078c006890 con 0x7f078c04fa80 2024-03-30T13:12:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.497+0000 7fe05a800640 1 Processor -- start 2024-03-30T13:12:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.497+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216399410 0 0) 0x7f078c006ae0 con 0x7f078c0df410 2024-03-30T13:12:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0778003520 con 0x7f078c0df410 2024-03-30T13:12:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1308096113 0 0) 0x7f078c0503a0 con 0x7f078c054260 2024-03-30T13:12:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f078c006ae0 con 0x7f078c054260 2024-03-30T13:12:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3981190822 0 0) 0x7f078c006ae0 con 0x7f078c054260 2024-03-30T13:12:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 msgr2=0x7f078c04fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 --2- 172.21.15.44:0/3192110455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 0x7f078c04fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 >> v1:172.21.15.151:6789/0 conn(0x7f078c0df410 legacy=0x7f078c0382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c006dc0 con 0x7f078c054260 2024-03-30T13:12:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f0780001670 con 0x7f078c054260 2024-03-30T13:12:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 >> v1:172.21.15.44:6789/0 conn(0x7f078c054260 legacy=0x7f078c0389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 --2- 172.21.15.44:0/3192110455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0778004d50 0x7f07780037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 --2- 172.21.15.44:0/3192110455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 0x7f0778003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 --2- 172.21.15.44:0/3192110455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0778004300 0x7f0778013c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f078c006890 con 0x7f0778004d50 2024-03-30T13:12:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0778014150 con 0x7f0778004300 2024-03-30T13:12:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.498+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0778014350 con 0x7f078c04fa80 2024-03-30T13:12:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.497+0000 7fe05a800640 1 -- start start 2024-03-30T13:12:14.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.499+0000 7fc7d1c00640 1 Processor -- start 2024-03-30T13:12:14.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.499+0000 7f0791400640 1 --2- 172.21.15.44:0/3192110455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 0x7f0778003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7fe05a800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 0x7fe054166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7fe05a800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe0540ca340 0x7fe0540cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7fe05a800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe0540ccc40 0x7fe05406d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7fe05a800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe0540ce290 con 0x7fe0540ca340 2024-03-30T13:12:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7fe05a800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fe054162b50 con 0x7fe0540ccc40 2024-03-30T13:12:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7fe05a800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe0540caab0 con 0x7fe054162770 2024-03-30T13:12:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7f0791400640 1 -- 172.21.15.44:0/3192110455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0778004300 msgr2=0x7f0778013c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7f0791400640 1 --2- 172.21.15.44:0/3192110455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0778004300 0x7f0778013c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7f0791400640 1 -- 172.21.15.44:0/3192110455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0778004d50 msgr2=0x7f07780037a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7f0791400640 1 --2- 172.21.15.44:0/3192110455 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0778004d50 0x7f07780037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7f0791400640 1 -- 172.21.15.44:0/3192110455 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c006dc0 con 0x7f078c04fa80 2024-03-30T13:12:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7fe059400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 0x7fe054166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7fc7d1c00640 1 -- start start 2024-03-30T13:12:14.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7fe059400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 0x7fe054166dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36864/0 (socket says 172.21.15.44:36864) 2024-03-30T13:12:14.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.500+0000 7fe059400640 1 -- 172.21.15.44:0/3134478161 learned_addr learned my addr 172.21.15.44:0/3134478161 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:14.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.501+0000 7fe059e00640 1 --2- 172.21.15.44:0/3134478161 >> v2:172.21.15.151:3300/0 conn(0x7fe0540ccc40 0x7fe05406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.501+0000 7f85db200640 1 Processor -- start 2024-03-30T13:12:14.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.501+0000 7fe058a00640 1 --2- 172.21.15.44:0/3134478161 >> v2:172.21.15.44:3300/0 conn(0x7fe0540ca340 0x7fe0540cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.501+0000 7fe059e00640 1 -- 172.21.15.44:0/3134478161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 msgr2=0x7fe054166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.501+0000 7f0791400640 1 --2- 172.21.15.44:0/3192110455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 0x7f0778003d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0794069cf0 tx=0x7f0778004820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b4dc763d1854392 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.501+0000 7fe059e00640 1 --2- 172.21.15.44:0/3134478161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 0x7fe054166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.502+0000 7fe059e00640 1 -- 172.21.15.44:0/3134478161 >> v2:172.21.15.44:3300/0 conn(0x7fe0540ca340 msgr2=0x7fe0540cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.502+0000 7fe059e00640 1 --2- 172.21.15.44:0/3134478161 >> v2:172.21.15.44:3300/0 conn(0x7fe0540ca340 0x7fe0540cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.502+0000 7fe059e00640 1 -- 172.21.15.44:0/3134478161 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0540cd960 con 0x7fe0540ccc40 2024-03-30T13:12:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.502+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07940507e0 con 0x7f078c04fa80 2024-03-30T13:12:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.502+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07940ab070 con 0x7f078c04fa80 2024-03-30T13:12:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.502+0000 7f0790a00640 1 -- 172.21.15.44:0/3192110455 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079406d2b0 con 0x7f078c04fa80 2024-03-30T13:12:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.502+0000 7fc7d1c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 0x7fc7c40e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.502+0000 7fc7d1c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7c4058810 con 0x7fc7c40e3160 2024-03-30T13:12:14.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.502+0000 7fc7d1c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7c4058af0 con 0x7fc7c403c0a0 2024-03-30T13:12:14.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.502+0000 7fc7d1c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c4007b70 con 0x7fc7c40543c0 2024-03-30T13:12:14.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.502+0000 7fe059400640 1 --2- 172.21.15.44:0/3134478161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 0x7fe054166dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:14.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.502+0000 7f85db200640 1 -- start start 2024-03-30T13:12:14.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.503+0000 7f0798c00640 1 -- 172.21.15.44:0/3192110455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 msgr2=0x7f0778003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.503+0000 7f0798c00640 1 --2- 172.21.15.44:0/3192110455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 0x7f0778003d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0794069cf0 tx=0x7f0778004820 comp rx=0 tx=0).stop 2024-03-30T13:12:14.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.503+0000 7f0792800640 1 -- 172.21.15.44:0/3192110455 reap_dead start 2024-03-30T13:12:14.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.503+0000 7fc7d1200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 0x7fc7c40e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.503+0000 7fc7d1200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 0x7fc7c40e7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36868/0 (socket says 172.21.15.44:36868) 2024-03-30T13:12:14.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.503+0000 7fc7d1200640 1 -- 172.21.15.44:0/3599039321 learned_addr learned my addr 172.21.15.44:0/3599039321 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:14.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.503+0000 7fc7cbe00640 1 --1- 172.21.15.44:0/3599039321 >> v1:172.21.15.44:6789/0 conn(0x7fc7c40e3160 0x7fc7c4058050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56898/0 (socket says 172.21.15.44:56898) 2024-03-30T13:12:14.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.503+0000 7f85db200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d00e30c0 0x7f85d0057d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.503+0000 7f85db200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f85d003e840 0x7f85d0053bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.504+0000 7f85db200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d00582d0 con 0x7f85d0054130 2024-03-30T13:12:14.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.504+0000 7f85db200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f85d0058570 con 0x7f85d003e840 2024-03-30T13:12:14.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.504+0000 7f85db200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f85d0058850 con 0x7f85d00e30c0 2024-03-30T13:12:14.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.504+0000 7f0798c00640 1 -- 172.21.15.44:0/3192110455 shutdown_connections 2024-03-30T13:12:14.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.504+0000 7f0798c00640 1 -- 172.21.15.44:0/3192110455 >> 172.21.15.44:0/3192110455 conn(0x7f078c009fa0 msgr2=0x7f078c00a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.504+0000 7fc7caa00640 1 -- 172.21.15.44:0/3599039321 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100988738 0 0) 0x7fc7c4058810 con 0x7fc7c40e3160 2024-03-30T13:12:14.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.504+0000 7fc7caa00640 1 -- 172.21.15.44:0/3599039321 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7b4003520 con 0x7fc7c40e3160 2024-03-30T13:12:14.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.504+0000 7fc7d1200640 1 -- 172.21.15.44:0/3599039321 >> v1:172.21.15.151:6789/0 conn(0x7fc7c403c0a0 legacy=0x7fc7c4053cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.504+0000 7fc7d1200640 1 -- 172.21.15.44:0/3599039321 >> v1:172.21.15.44:6789/0 conn(0x7fc7c40e3160 legacy=0x7fc7c4058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.504+0000 7fc7d1200640 1 -- 172.21.15.44:0/3599039321 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c4006360 con 0x7fc7c40543c0 2024-03-30T13:12:14.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.504+0000 7f85da800640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f85d0054130 0x7f85d00e6c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:54696/0 (socket says 172.21.15.44:54696) 2024-03-30T13:12:14.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.504+0000 7f85da800640 1 -- 172.21.15.44:0/1851109158 learned_addr learned my addr 172.21.15.44:0/1851109158 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:14.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.505+0000 7f85d9400640 1 --2- 172.21.15.44:0/1851109158 >> v2:172.21.15.151:3300/0 conn(0x7f85d003e840 0x7f85d0053bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.505+0000 7f0798c00640 1 -- 172.21.15.44:0/3192110455 shutdown_connections 2024-03-30T13:12:14.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.505+0000 7f85d9e00640 1 --2- 172.21.15.44:0/1851109158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d00e30c0 0x7f85d0057d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.505+0000 7fe059e00640 1 --2- 172.21.15.44:0/3134478161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0540ccc40 0x7fe05406d140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe0540cbab0 tx=0x7fe04c02be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73219c1afa9aaf25 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.505+0000 7f0798c00640 1 -- 172.21.15.44:0/3192110455 wait complete. 2024-03-30T13:12:14.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.506+0000 7fe053e00640 1 -- 172.21.15.44:0/3134478161 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c039070 con 0x7fe0540ccc40 2024-03-30T13:12:14.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.506+0000 7fe053e00640 1 -- 172.21.15.44:0/3134478161 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c02cbe0 con 0x7fe0540ccc40 2024-03-30T13:12:14.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.506+0000 7fe053e00640 1 -- 172.21.15.44:0/3134478161 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c034440 con 0x7fe0540ccc40 2024-03-30T13:12:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.506+0000 7f85d9e00640 1 -- 172.21.15.44:0/1851109158 >> v2:172.21.15.151:3300/0 conn(0x7f85d003e840 msgr2=0x7f85d0053bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.506+0000 7f85d9e00640 1 --2- 172.21.15.44:0/1851109158 >> v2:172.21.15.151:3300/0 conn(0x7f85d003e840 0x7f85d0053bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.506+0000 7f85d9e00640 1 -- 172.21.15.44:0/1851109158 >> v1:172.21.15.151:6789/0 conn(0x7f85d0054130 legacy=0x7f85d00e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.506+0000 7f85d9e00640 1 -- 172.21.15.44:0/1851109158 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d0058b30 con 0x7f85d00e30c0 2024-03-30T13:12:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.506+0000 7fc7d1200640 1 --2- 172.21.15.44:0/3599039321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 0x7fc7c40e7780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc06abd0 tx=0x7fc7cc0a7020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c833bd6c58f6495 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.507+0000 7fe05a800640 1 -- 172.21.15.44:0/3134478161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0540ccc40 msgr2=0x7fe05406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.507+0000 7fe05a800640 1 --2- 172.21.15.44:0/3134478161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0540ccc40 0x7fe05406d140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe0540cbab0 tx=0x7fe04c02be30 comp rx=0 tx=0).stop 2024-03-30T13:12:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.507+0000 7fe05a800640 1 -- 172.21.15.44:0/3134478161 shutdown_connections 2024-03-30T13:12:14.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.507+0000 7fc7caa00640 1 -- 172.21.15.44:0/3599039321 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0b4070 con 0x7fc7c40543c0 2024-03-30T13:12:14.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.507+0000 7fe05a800640 1 --2- 172.21.15.44:0/3134478161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0540ccc40 0x7fe05406d140 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.507+0000 7fe05a800640 1 --2- 172.21.15.44:0/3134478161 >> v2:172.21.15.44:3300/0 conn(0x7fe0540ca340 0x7fe0540cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.507+0000 7fe05a800640 1 --2- 172.21.15.44:0/3134478161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 0x7fe054166dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.507+0000 7fe05a800640 1 -- 172.21.15.44:0/3134478161 >> 172.21.15.44:0/3134478161 conn(0x7fe0540b1800 msgr2=0x7fe0540b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.507+0000 7fc7caa00640 1 -- 172.21.15.44:0/3599039321 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7cc0af440 con 0x7fc7c40543c0 2024-03-30T13:12:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.507+0000 7fc7caa00640 1 -- 172.21.15.44:0/3599039321 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0af8f0 con 0x7fc7c40543c0 2024-03-30T13:12:14.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.508+0000 7fe05a800640 1 -- 172.21.15.44:0/3134478161 shutdown_connections 2024-03-30T13:12:14.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.508+0000 7fe05a800640 1 -- 172.21.15.44:0/3134478161 wait complete. 2024-03-30T13:12:14.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.508+0000 7fc7d1c00640 1 -- 172.21.15.44:0/3599039321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 msgr2=0x7fc7c40e7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.508+0000 7fc7d1c00640 1 --2- 172.21.15.44:0/3599039321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 0x7fc7c40e7780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc06abd0 tx=0x7fc7cc0a7020 comp rx=0 tx=0).stop 2024-03-30T13:12:14.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.508+0000 7f0798c00640 1 Processor -- start 2024-03-30T13:12:14.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.508+0000 7fc7d1c00640 1 -- 172.21.15.44:0/3599039321 shutdown_connections 2024-03-30T13:12:14.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.508+0000 7fc7d1c00640 1 --2- 172.21.15.44:0/3599039321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 0x7fc7c40e7780 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.508+0000 7fc7d1c00640 1 -- 172.21.15.44:0/3599039321 >> 172.21.15.44:0/3599039321 conn(0x7fc7c4058ee0 msgr2=0x7fc7c40592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.509+0000 7fc7d1c00640 1 -- 172.21.15.44:0/3599039321 shutdown_connections 2024-03-30T13:12:14.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.509+0000 7f85d9e00640 1 --2- 172.21.15.44:0/1851109158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d00e30c0 0x7f85d0057d90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f85c80097a0 tx=0x7f85c802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3280a36b6ccff6ad server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.509+0000 7fc7d1c00640 1 -- 172.21.15.44:0/3599039321 wait complete. 2024-03-30T13:12:14.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.509+0000 7f0798c00640 1 -- start start 2024-03-30T13:12:14.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.509+0000 7ffa9e800640 1 Processor -- start 2024-03-30T13:12:14.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.509+0000 7f85d8a00640 1 -- 172.21.15.44:0/1851109158 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c8037070 con 0x7f85d00e30c0 2024-03-30T13:12:14.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.509+0000 7f85d8a00640 1 -- 172.21.15.44:0/1851109158 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c8030710 con 0x7f85d00e30c0 2024-03-30T13:12:14.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.509+0000 7f85d8a00640 1 -- 172.21.15.44:0/1851109158 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c8030ae0 con 0x7f85d00e30c0 2024-03-30T13:12:14.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.510+0000 7fe05a800640 1 Processor -- start 2024-03-30T13:12:14.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.510+0000 7f85db200640 1 -- 172.21.15.44:0/1851109158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d00e30c0 msgr2=0x7f85d0057d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.510+0000 7f85db200640 1 --2- 172.21.15.44:0/1851109158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d00e30c0 0x7f85d0057d90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f85c80097a0 tx=0x7f85c802b800 comp rx=0 tx=0).stop 2024-03-30T13:12:14.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.510+0000 7ffa9e800640 1 -- start start 2024-03-30T13:12:14.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.511+0000 7fe05a800640 1 -- start start 2024-03-30T13:12:14.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.511+0000 7fc7d1c00640 1 Processor -- start 2024-03-30T13:12:14.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.511+0000 7f85db200640 1 -- 172.21.15.44:0/1851109158 shutdown_connections 2024-03-30T13:12:14.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.511+0000 7f85db200640 1 --2- 172.21.15.44:0/1851109158 >> v2:172.21.15.151:3300/0 conn(0x7f85d003e840 0x7f85d0053bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.511+0000 7f85db200640 1 --2- 172.21.15.44:0/1851109158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d00e30c0 0x7f85d0057d90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.512+0000 7f0798c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 0x7f078c0e2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.512+0000 7f0798c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f078c0cd070 0x7f078c0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.511+0000 7f85db200640 1 -- 172.21.15.44:0/1851109158 >> 172.21.15.44:0/1851109158 conn(0x7f85d00559e0 msgr2=0x7f85d0055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.512+0000 7ffa9e800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa980d2ee0 0x7ffa980ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.512+0000 7fe05a800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0540ca340 0x7fe0541521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.512+0000 7fe05a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0540ccc40 0x7fe0540b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.512+0000 7fe05a800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 0x7fe0540b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.512+0000 7fe05a800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe0540ca7a0 con 0x7fe0540ccc40 2024-03-30T13:12:14.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.512+0000 7fe05a800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe0540cdf20 con 0x7fe0540ca340 2024-03-30T13:12:14.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.512+0000 7fe05a800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe05406d680 con 0x7fe054162770 2024-03-30T13:12:14.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.511+0000 7fc7d1c00640 1 -- start start 2024-03-30T13:12:14.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7fe059e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 0x7fe0540b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7ffa9e800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa980d0140 con 0x7ffa980cf2d0 2024-03-30T13:12:14.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7ffa9e800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa980cfb80 con 0x7ffa9815e7c0 2024-03-30T13:12:14.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7ffa9e800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ffa9815eba0 con 0x7ffa980d2ee0 2024-03-30T13:12:14.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7fc7d1c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7c403c0a0 0x7fc7c404ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7fc7d1c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 0x7fc7c40d6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7fe059e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 0x7fe0540b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36900/0 (socket says 172.21.15.44:36900) 2024-03-30T13:12:14.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7fe059e00640 1 -- 172.21.15.44:0/2672521051 learned_addr learned my addr 172.21.15.44:0/2672521051 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:14.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7ffa9ca00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa980d2ee0 0x7ffa980ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7ffa9de00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ffa980cf2d0 0x7ffa980b43f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56900/0 (socket says 172.21.15.44:56900) 2024-03-30T13:12:14.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7ffa9de00640 1 -- 172.21.15.44:0/1060030311 learned_addr learned my addr 172.21.15.44:0/1060030311 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:14.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7f85db200640 1 -- 172.21.15.44:0/1851109158 shutdown_connections 2024-03-30T13:12:14.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7f85db200640 1 -- 172.21.15.44:0/1851109158 wait complete. 2024-03-30T13:12:14.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fc7d1c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c40e3160 0x7fc7c40e4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fe059400640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0540ca340 0x7fe0541521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fc7cb400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 0x7fc7c40d6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fc7cb400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 0x7fc7c40d6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36902/0 (socket says 172.21.15.44:36902) 2024-03-30T13:12:14.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fc7cb400640 1 -- 172.21.15.44:0/408743204 learned_addr learned my addr 172.21.15.44:0/408743204 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:14.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.512+0000 7f0798c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078c0ca5c0 0x7f078c04db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.513+0000 7f0792800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078c0ca5c0 0x7f078c04db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7f0792800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078c0ca5c0 0x7f078c04db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39460/0 (socket says 172.21.15.44:39460) 2024-03-30T13:12:14.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7f0791400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f078c0cd070 0x7f078c0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7f0792800640 1 -- 172.21.15.44:0/641619110 learned_addr learned my addr 172.21.15.44:0/641619110 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:14.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c40ee050 con 0x7fc7c40e3160 2024-03-30T13:12:14.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f078c0546f0 con 0x7f078c0ca5c0 2024-03-30T13:12:14.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f078c007380 con 0x7f078c0cd070 2024-03-30T13:12:14.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f078c054870 con 0x7f078c04fa80 2024-03-30T13:12:14.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c40e3540 con 0x7fc7c403c0a0 2024-03-30T13:12:14.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c40ee1d0 con 0x7fc7c40543c0 2024-03-30T13:12:14.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fe059e00640 1 -- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0540ca340 msgr2=0x7fe0541521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fe059e00640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0540ca340 0x7fe0541521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fe059e00640 1 -- 172.21.15.44:0/2672521051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0540ccc40 msgr2=0x7fe0540b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fe059e00640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0540ccc40 0x7fe0540b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.514+0000 7fe059e00640 1 -- 172.21.15.44:0/2672521051 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05415b650 con 0x7fe054162770 2024-03-30T13:12:14.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.515+0000 7fc7cbe00640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7c403c0a0 0x7fc7c404ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.515+0000 7f0791400640 1 -- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 msgr2=0x7f078c0e2190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-30T13:12:14.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.515+0000 7f0791400640 1 --2- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 0x7f078c0e2190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.515+0000 7f0791400640 1 -- 172.21.15.44:0/641619110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078c0ca5c0 msgr2=0x7f078c04db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.515+0000 7f0791400640 1 --2- 172.21.15.44:0/641619110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078c0ca5c0 0x7f078c04db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.515+0000 7f0791400640 1 -- 172.21.15.44:0/641619110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078c0cd580 con 0x7f078c0cd070 2024-03-30T13:12:14.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.515+0000 7fc7d1200640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c40e3160 0x7fc7c40e4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.515+0000 7ffa97e00640 1 -- 172.21.15.44:0/1060030311 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4111933700 0 0) 0x7ffa980d0140 con 0x7ffa980cf2d0 2024-03-30T13:12:14.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.515+0000 7fe059e00640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 0x7fe0540b2e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009e50 tx=0x7fe04c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7fc7cb400640 1 -- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7c403c0a0 msgr2=0x7fc7c404ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7fc7cb400640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7c403c0a0 0x7fc7c404ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7fc7cb400640 1 -- 172.21.15.44:0/408743204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c40e3160 msgr2=0x7fc7c40e4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7fc7cb400640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c40e3160 0x7fc7c40e4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7f85db200640 1 Processor -- start 2024-03-30T13:12:14.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.515+0000 7ffa97e00640 1 -- 172.21.15.44:0/1060030311 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa80003520 con 0x7ffa980cf2d0 2024-03-30T13:12:14.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7ffa97e00640 1 -- 172.21.15.44:0/1060030311 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060265023 0 0) 0x7ffa980cfb80 con 0x7ffa9815e7c0 2024-03-30T13:12:14.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7ffa97e00640 1 -- 172.21.15.44:0/1060030311 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa980d0140 con 0x7ffa9815e7c0 2024-03-30T13:12:14.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7ffa9ca00640 1 -- 172.21.15.44:0/1060030311 >> v1:172.21.15.151:6789/0 conn(0x7ffa9815e7c0 legacy=0x7ffa980d27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7ffa9ca00640 1 -- 172.21.15.44:0/1060030311 >> v1:172.21.15.44:6789/0 conn(0x7ffa980cf2d0 legacy=0x7ffa980b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7ffa9ca00640 1 -- 172.21.15.44:0/1060030311 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa980cfe60 con 0x7ffa980d2ee0 2024-03-30T13:12:14.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7f85db200640 1 -- start start 2024-03-30T13:12:14.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7f0791400640 1 --2- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f078c0cd070 0x7f078c0cb010 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0794063150 tx=0x7f0794069360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.517+0000 7f078a000640 1 -- 172.21.15.44:0/641619110 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079406bdb0 con 0x7f078c0cd070 2024-03-30T13:12:14.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.517+0000 7f078a000640 1 -- 172.21.15.44:0/641619110 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07940b0470 con 0x7f078c0cd070 2024-03-30T13:12:14.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.517+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078c0cd860 con 0x7f078c0cd070 2024-03-30T13:12:14.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.517+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f078c0cde20 con 0x7f078c0cd070 2024-03-30T13:12:14.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.517+0000 7f078a000640 1 -- 172.21.15.44:0/641619110 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07940b0860 con 0x7f078c0cd070 2024-03-30T13:12:14.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.516+0000 7fc7cb400640 1 -- 172.21.15.44:0/408743204 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c40d6b40 con 0x7fc7c40543c0 2024-03-30T13:12:14.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.517+0000 7fe051600640 1 -- 172.21.15.44:0/2672521051 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c044020 con 0x7fe054162770 2024-03-30T13:12:14.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.517+0000 7fe051600640 1 -- 172.21.15.44:0/2672521051 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe04c03a040 con 0x7fe054162770 2024-03-30T13:12:14.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.517+0000 7fe051600640 1 -- 172.21.15.44:0/2672521051 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c039070 con 0x7fe054162770 2024-03-30T13:12:14.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.518+0000 7f85db200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d003e840 0x7f85d017d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.518+0000 7f85db200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0054130 0x7f85d00ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.518+0000 7f85db200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d00e30c0 0x7f85d00ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.518+0000 7f85db200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f85d00e34a0 con 0x7f85d003e840 2024-03-30T13:12:14.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.518+0000 7f85db200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f85d003bfc0 con 0x7f85d00e30c0 2024-03-30T13:12:14.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.518+0000 7f85db200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f85d00078e0 con 0x7f85d0054130 2024-03-30T13:12:14.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.518+0000 7fc7cb400640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 0x7fc7c40d6600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c440 tx=0x7fc7b800c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.519+0000 7f85d9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d003e840 0x7f85d017d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.519+0000 7fc7bfe00640 1 -- 172.21.15.44:0/408743204 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8017070 con 0x7fc7c40543c0 2024-03-30T13:12:14.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.518+0000 7fe05a800640 1 -- 172.21.15.44:0/2672521051 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0540b55a0 con 0x7fe054162770 2024-03-30T13:12:14.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.519+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c4051440 con 0x7fc7c40543c0 2024-03-30T13:12:14.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.519+0000 7fc7bfe00640 1 -- 172.21.15.44:0/408743204 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b80035f0 con 0x7fc7c40543c0 2024-03-30T13:12:14.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.518+0000 7fe05a800640 1 -- 172.21.15.44:0/2672521051 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0540c7b80 con 0x7fe054162770 2024-03-30T13:12:14.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.519+0000 7f85d9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d003e840 0x7f85d017d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39488/0 (socket says 172.21.15.44:39488) 2024-03-30T13:12:14.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.519+0000 7f85d9e00640 1 -- 172.21.15.44:0/3134315559 learned_addr learned my addr 172.21.15.44:0/3134315559 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:14.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.519+0000 7f85d9400640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0054130 0x7f85d00ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.519+0000 7fc7bfe00640 1 -- 172.21.15.44:0/408743204 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80039e0 con 0x7fc7c40543c0 2024-03-30T13:12:14.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.519+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c4051a00 con 0x7fc7c40543c0 2024-03-30T13:12:14.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.519+0000 7f85da800640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d00e30c0 0x7f85d00ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.520+0000 7fe05a800640 1 -- 172.21.15.44:0/2672521051 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe054075890 con 0x7fe054162770 2024-03-30T13:12:14.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.520+0000 7f85da800640 1 -- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0054130 msgr2=0x7f85d00ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.520+0000 7f85da800640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0054130 0x7f85d00ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.520+0000 7f85da800640 1 -- 172.21.15.44:0/3134315559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d003e840 msgr2=0x7f85d017d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.520+0000 7f85da800640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d003e840 0x7f85d017d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.521+0000 7f85da800640 1 -- 172.21.15.44:0/3134315559 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d000c0d0 con 0x7f85d00e30c0 2024-03-30T13:12:14.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.521+0000 7f85d9400640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0054130 0x7f85d00ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:14.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.521+0000 7ffa9ca00640 1 --2- 172.21.15.44:0/1060030311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa980d2ee0 0x7ffa980ced90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c0097a0 tx=0x7ffa8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582890203d7babec server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.521+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a8005290 con 0x7fc7c40543c0 2024-03-30T13:12:14.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.521+0000 7f85da800640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d00e30c0 0x7f85d00ce580 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f85d4075dd0 tx=0x7f85d4074420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.521+0000 7ffa97e00640 1 -- 172.21.15.44:0/1060030311 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c035020 con 0x7ffa980d2ee0 2024-03-30T13:12:14.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.522+0000 7ffa97e00640 1 -- 172.21.15.44:0/1060030311 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa8c031830 con 0x7ffa980d2ee0 2024-03-30T13:12:14.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.523+0000 7fe051600640 1 -- 172.21.15.44:0/2672521051 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe04c047020 con 0x7fe054162770 2024-03-30T13:12:14.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.522+0000 7ffa97e00640 1 -- 172.21.15.44:0/1060030311 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c031c00 con 0x7ffa980d2ee0 2024-03-30T13:12:14.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.523+0000 7ffa9e800640 1 -- 172.21.15.44:0/1060030311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa980d2ee0 msgr2=0x7ffa980ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.523+0000 7ffa9e800640 1 --2- 172.21.15.44:0/1060030311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa980d2ee0 0x7ffa980ced90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c0097a0 tx=0x7ffa8c02b8d0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.522+0000 7f85ce000640 1 -- 172.21.15.44:0/3134315559 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d4075130 con 0x7f85d00e30c0 2024-03-30T13:12:14.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.522+0000 7f85ce000640 1 -- 172.21.15.44:0/3134315559 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d40746d0 con 0x7f85d00e30c0 2024-03-30T13:12:14.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.522+0000 7f85ce000640 1 -- 172.21.15.44:0/3134315559 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d406b7c0 con 0x7f85d00e30c0 2024-03-30T13:12:14.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.523+0000 7f85db200640 1 -- 172.21.15.44:0/3134315559 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d000c3b0 con 0x7f85d00e30c0 2024-03-30T13:12:14.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.523+0000 7f85db200640 1 -- 172.21.15.44:0/3134315559 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d00cc330 con 0x7f85d00e30c0 2024-03-30T13:12:14.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.524+0000 7ffa9e800640 1 -- 172.21.15.44:0/1060030311 shutdown_connections 2024-03-30T13:12:14.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.524+0000 7ffa9e800640 1 --2- 172.21.15.44:0/1060030311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa980d2ee0 0x7ffa980ced90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.524+0000 7ffa9e800640 1 -- 172.21.15.44:0/1060030311 >> 172.21.15.44:0/1060030311 conn(0x7ffa9809d520 msgr2=0x7ffa980d41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.524+0000 7fc7bfe00640 1 -- 172.21.15.44:0/408743204 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc7b801a070 con 0x7fc7c40543c0 2024-03-30T13:12:14.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.521+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f076c005290 con 0x7f078c0cd070 2024-03-30T13:12:14.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.524+0000 7fe051600640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe03406c630 0x7fe03406eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.524+0000 7fe051600640 1 -- 172.21.15.44:0/2672521051 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe04c0ae180 con 0x7fe054162770 2024-03-30T13:12:14.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.524+0000 7ffa9e800640 1 -- 172.21.15.44:0/1060030311 shutdown_connections 2024-03-30T13:12:14.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.525+0000 7f078a000640 1 -- 172.21.15.44:0/641619110 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f07940b8030 con 0x7f078c0cd070 2024-03-30T13:12:14.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.525+0000 7f85db200640 1 -- 172.21.15.44:0/3134315559 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d00057e0 con 0x7f85d00e30c0 2024-03-30T13:12:14.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.525+0000 7ffa9e800640 1 -- 172.21.15.44:0/1060030311 wait complete. 2024-03-30T13:12:14.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.525+0000 7fe059400640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe03406c630 0x7fe03406eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.525+0000 7fc7bfe00640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc7ac06c530 0x7fc7ac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.525+0000 7fc7bfe00640 1 -- 172.21.15.44:0/408743204 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc7b808b140 con 0x7fc7c40543c0 2024-03-30T13:12:14.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.526+0000 7fc7cbe00640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc7ac06c530 0x7fc7ac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.526+0000 7f078a000640 1 --2- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f077406c5b0 0x7f077406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.527+0000 7f078a000640 1 -- 172.21.15.44:0/641619110 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0794128590 con 0x7f078c0cd070 2024-03-30T13:12:14.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.527+0000 7ffa9e800640 1 Processor -- start 2024-03-30T13:12:14.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.527+0000 7ffa9e800640 1 -- start start 2024-03-30T13:12:14.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.527+0000 7f0791e00640 1 --2- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f077406c5b0 0x7f077406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.527+0000 7fc7cbe00640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc7ac06c530 0x7fc7ac06e9f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40dddf0 tx=0x7fc7c0007c80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.527+0000 7fe059400640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe03406c630 0x7fe03406eaf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe048009a40 tx=0x7fe048008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.528+0000 7ffa9e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa980cf2d0 0x7ffa9814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.528+0000 7ffa9e800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa980d2ee0 0x7ffa980cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.528+0000 7ffa9e800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa9815e7c0 0x7ffa98160f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.528+0000 7ffa9e800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa980cf760 con 0x7ffa980cf2d0 2024-03-30T13:12:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.528+0000 7ffa9e800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffa980b3f60 con 0x7ffa980d2ee0 2024-03-30T13:12:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.528+0000 7ffa9e800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ffa980cf8e0 con 0x7ffa9815e7c0 2024-03-30T13:12:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.529+0000 7ffa9d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa980cf2d0 0x7ffa9814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.529+0000 7f0791e00640 1 --2- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f077406c5b0 0x7f077406ea70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0784006e00 tx=0x7f0784006cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.529+0000 7ffa9d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa980cf2d0 0x7ffa9814ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39490/0 (socket says 172.21.15.44:39490) 2024-03-30T13:12:14.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.529+0000 7ffa9d400640 1 -- 172.21.15.44:0/265435540 learned_addr learned my addr 172.21.15.44:0/265435540 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:14.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.529+0000 7ffa9ca00640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa980d2ee0 0x7ffa980cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.529+0000 7ffa9de00640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa9815e7c0 0x7ffa98160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.529+0000 7ffa9d400640 1 -- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa9815e7c0 msgr2=0x7ffa98160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.529+0000 7ffa9d400640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa9815e7c0 0x7ffa98160f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.529+0000 7ffa9d400640 1 -- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa980d2ee0 msgr2=0x7ffa980cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.529+0000 7ffa9d400640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa980d2ee0 0x7ffa980cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.529+0000 7ffa9d400640 1 -- 172.21.15.44:0/265435540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9815fea0 con 0x7ffa980cf2d0 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.530+0000 7ffa9d400640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa980cf2d0 0x7ffa9814ad10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c870 tx=0x7ffa9000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.530+0000 7ffa95600640 1 -- 172.21.15.44:0/265435540 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90003b70 con 0x7ffa980cf2d0 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.530+0000 7ffa95600640 1 -- 172.21.15.44:0/265435540 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa90003d30 con 0x7ffa980cf2d0 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.530+0000 7ffa95600640 1 -- 172.21.15.44:0/265435540 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000aa90 con 0x7ffa980cf2d0 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.530+0000 7ffa9e800640 1 -- 172.21.15.44:0/265435540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa98160140 con 0x7ffa980cf2d0 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.531+0000 7ffa9e800640 1 -- 172.21.15.44:0/265435540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa98160700 con 0x7ffa980cf2d0 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.532+0000 7ffa9e800640 1 -- 172.21.15.44:0/265435540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa98075890 con 0x7ffa980cf2d0 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.533+0000 7ffa95600640 1 -- 172.21.15.44:0/265435540 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ffa9000ac30 con 0x7ffa980cf2d0 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.535+0000 7ffa95600640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffa7c06c580 0x7ffa7c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.535+0000 7ffa95600640 1 -- 172.21.15.44:0/265435540 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ffa9008b7d0 con 0x7ffa980cf2d0 2024-03-30T13:12:14.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.535+0000 7ffa9ca00640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffa7c06c580 0x7ffa7c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.537+0000 7ffa9ca00640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffa7c06c580 0x7ffa7c06ea40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c036000 tx=0x7ffa8c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.541+0000 7f078a000640 1 -- 172.21.15.44:0/641619110 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f07940b6040 con 0x7f078c0cd070 2024-03-30T13:12:14.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.543+0000 7ffa95600640 1 -- 172.21.15.44:0/265435540 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ffa90059c20 con 0x7ffa980cf2d0 2024-03-30T13:12:14.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.543+0000 7fc7bfe00640 1 -- 172.21.15.44:0/408743204 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc7b8021020 con 0x7fc7c40543c0 2024-03-30T13:12:14.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.544+0000 7f85ce000640 1 -- 172.21.15.44:0/3134315559 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f85d406b960 con 0x7f85d00e30c0 2024-03-30T13:12:14.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.545+0000 7f85ce000640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f85b806c600 0x7f85b806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.545+0000 7f85ce000640 1 -- 172.21.15.44:0/3134315559 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f85d4106eb0 con 0x7f85d00e30c0 2024-03-30T13:12:14.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.546+0000 7f85d9e00640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f85b806c600 0x7f85b806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.547+0000 7f85d9e00640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f85b806c600 0x7f85b806eac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85c80097a0 tx=0x7f85c8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.551+0000 7f8dca400640 1 Processor -- start 2024-03-30T13:12:14.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.552+0000 7f8dca400640 1 -- start start 2024-03-30T13:12:14.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.553+0000 7f8dca400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8dc4155bf0 0x7f8dc406e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.553+0000 7f8dca400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8dc40b69e0 0x7f8dc406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.553+0000 7f8dca400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc4072510 con 0x7f8dc40b6600 2024-03-30T13:12:14.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.553+0000 7f8dca400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8dc40735b0 con 0x7f8dc40b69e0 2024-03-30T13:12:14.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.553+0000 7f8dca400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc40727f0 con 0x7f8dc4155bf0 2024-03-30T13:12:14.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.554+0000 7f8dc3e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8dc40b69e0 0x7f8dc406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.554+0000 7f8dc3400640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f8dc40b6600 0x7f8dc41554e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:54722/0 (socket says 172.21.15.44:54722) 2024-03-30T13:12:14.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.554+0000 7f8dc3e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8dc40b69e0 0x7f8dc406ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39502/0 (socket says 172.21.15.44:39502) 2024-03-30T13:12:14.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.554+0000 7f8dc3400640 1 -- 172.21.15.44:0/980252920 learned_addr learned my addr 172.21.15.44:0/980252920 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:14.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.554+0000 7f0398a00640 1 Processor -- start 2024-03-30T13:12:14.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.554+0000 7f8dc2a00640 1 --2- 172.21.15.44:0/980252920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8dc4155bf0 0x7f8dc406e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.554+0000 7f0398a00640 1 -- start start 2024-03-30T13:12:14.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.554+0000 7f8dc3e00640 1 -- 172.21.15.44:0/980252920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8dc4155bf0 msgr2=0x7f8dc406e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:14.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.555+0000 7f8dc3e00640 1 --2- 172.21.15.44:0/980252920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8dc4155bf0 0x7f8dc406e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.555+0000 7f8dc3e00640 1 -- 172.21.15.44:0/980252920 >> v1:172.21.15.151:6789/0 conn(0x7f8dc40b6600 legacy=0x7f8dc41554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.555+0000 7f8dc3e00640 1 -- 172.21.15.44:0/980252920 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc4072ad0 con 0x7f8dc40b69e0 2024-03-30T13:12:14.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.555+0000 7f8dc2a00640 1 --2- 172.21.15.44:0/980252920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8dc4155bf0 0x7f8dc406e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:14.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.556+0000 7f8dc3e00640 1 --2- 172.21.15.44:0/980252920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc40b69e0 0x7f8dc406ec10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009d90 tx=0x7f8dbc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4018069ad2544080 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.556+0000 7f85ce000640 1 -- 172.21.15.44:0/3134315559 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f85d40d4bb0 con 0x7f85d00e30c0 2024-03-30T13:12:14.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.557+0000 7f8dc2000640 1 -- 172.21.15.44:0/980252920 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc039070 con 0x7f8dc40b69e0 2024-03-30T13:12:14.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.557+0000 7f8dc2000640 1 -- 172.21.15.44:0/980252920 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dbc02cc60 con 0x7f8dc40b69e0 2024-03-30T13:12:14.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.557+0000 7f8dc2000640 1 -- 172.21.15.44:0/980252920 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc034660 con 0x7f8dc40b69e0 2024-03-30T13:12:14.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.557+0000 7f0398a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f03940d19c0 0x7f0394169140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.557+0000 7f0398a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03940d3120 con 0x7f039415e7a0 2024-03-30T13:12:14.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.557+0000 7f0398a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03940d3400 con 0x7f03940cec60 2024-03-30T13:12:14.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.557+0000 7f0398a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f03940cfc40 con 0x7f03940d19c0 2024-03-30T13:12:14.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.558+0000 7f8dca400640 1 -- 172.21.15.44:0/980252920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc40b69e0 msgr2=0x7f8dc406ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.558+0000 7f8dca400640 1 --2- 172.21.15.44:0/980252920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc40b69e0 0x7f8dc406ec10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc009d90 tx=0x7f8dbc02beb0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.558+0000 7f0391400640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f03940cec60 0x7f03940d12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:54738/0 (socket says 172.21.15.44:54738) 2024-03-30T13:12:14.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.558+0000 7f0392800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f03940d19c0 0x7f0394169140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.558+0000 7f0391400640 1 -- 172.21.15.44:0/1998538758 learned_addr learned my addr 172.21.15.44:0/1998538758 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:14.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.558+0000 7f8dca400640 1 -- 172.21.15.44:0/980252920 shutdown_connections 2024-03-30T13:12:14.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.558+0000 7f8dca400640 1 --2- 172.21.15.44:0/980252920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc40b69e0 0x7f8dc406ec10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.558+0000 7f8dca400640 1 --2- 172.21.15.44:0/980252920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8dc4155bf0 0x7f8dc406e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.558+0000 7f8dca400640 1 -- 172.21.15.44:0/980252920 >> 172.21.15.44:0/980252920 conn(0x7f8dc40d1170 msgr2=0x7f8dc40d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.559+0000 7f0390a00640 1 -- 172.21.15.44:0/1998538758 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2968542643 0 0) 0x7f03940d3400 con 0x7f03940cec60 2024-03-30T13:12:14.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.560+0000 7fe051600640 1 -- 172.21.15.44:0/2672521051 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe04c04e070 con 0x7fe054162770 2024-03-30T13:12:14.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.559+0000 7f0392800640 1 -- 172.21.15.44:0/1998538758 >> v1:172.21.15.151:6789/0 conn(0x7f03940cec60 legacy=0x7f03940d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.559+0000 7f0392800640 1 -- 172.21.15.44:0/1998538758 >> v1:172.21.15.44:6789/0 conn(0x7f039415e7a0 legacy=0x7f03940cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.559+0000 7f0392800640 1 -- 172.21.15.44:0/1998538758 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03940d36e0 con 0x7f03940d19c0 2024-03-30T13:12:14.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.561+0000 7f8dca400640 1 -- 172.21.15.44:0/980252920 shutdown_connections 2024-03-30T13:12:14.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.561+0000 7f0392800640 1 --2- 172.21.15.44:0/1998538758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03940d19c0 0x7f0394169140 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f038c009d90 tx=0x7f038c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=493d56130ec7ec37 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.561+0000 7f0390a00640 1 -- 172.21.15.44:0/1998538758 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c039070 con 0x7f03940d19c0 2024-03-30T13:12:14.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.561+0000 7f0390a00640 1 -- 172.21.15.44:0/1998538758 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f038c02cc60 con 0x7f03940d19c0 2024-03-30T13:12:14.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.561+0000 7f0390a00640 1 -- 172.21.15.44:0/1998538758 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c034660 con 0x7f03940d19c0 2024-03-30T13:12:14.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.563+0000 7f0398a00640 1 -- 172.21.15.44:0/1998538758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03940d19c0 msgr2=0x7f0394169140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.563+0000 7f0398a00640 1 --2- 172.21.15.44:0/1998538758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03940d19c0 0x7f0394169140 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f038c009d90 tx=0x7f038c02beb0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.563+0000 7f0398a00640 1 -- 172.21.15.44:0/1998538758 shutdown_connections 2024-03-30T13:12:14.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.563+0000 7f0398a00640 1 --2- 172.21.15.44:0/1998538758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03940d19c0 0x7f0394169140 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.563+0000 7f0398a00640 1 -- 172.21.15.44:0/1998538758 >> 172.21.15.44:0/1998538758 conn(0x7f03940676b0 msgr2=0x7f0394067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.561+0000 7f8dca400640 1 -- 172.21.15.44:0/980252920 wait complete. 2024-03-30T13:12:14.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.563+0000 7f8dca400640 1 Processor -- start 2024-03-30T13:12:14.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.564+0000 7f8dca400640 1 -- start start 2024-03-30T13:12:14.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.566+0000 7f8dca400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc40b6600 0x7f8dc4150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.566+0000 7f8dca400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8dc40b69e0 0x7f8dc415f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.567+0000 7f0398a00640 1 -- 172.21.15.44:0/1998538758 shutdown_connections 2024-03-30T13:12:14.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.567+0000 7f8dca400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8dc4155bf0 0x7f8dc4154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.567+0000 7f8dca400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc406f150 con 0x7f8dc40b6600 2024-03-30T13:12:14.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.567+0000 7f8dca400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4073090 con 0x7f8dc40b69e0 2024-03-30T13:12:14.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.567+0000 7f8dca400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc406b580 con 0x7f8dc4155bf0 2024-03-30T13:12:14.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.567+0000 7f8dc2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8dc40b69e0 0x7f8dc415f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.567+0000 7f8dc2a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8dc40b69e0 0x7f8dc415f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:42924/0 (socket says 172.21.15.44:42924) 2024-03-30T13:12:14.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.567+0000 7f8dc2a00640 1 -- 172.21.15.44:0/385057331 learned_addr learned my addr 172.21.15.44:0/385057331 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:14.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.567+0000 7f8dc3e00640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8dc4155bf0 0x7f8dc4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.568+0000 7f8dc2a00640 1 -- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8dc4155bf0 msgr2=0x7f8dc4154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.568+0000 7f8dc2a00640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8dc4155bf0 0x7f8dc4154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.568+0000 7f8dc2a00640 1 -- 172.21.15.44:0/385057331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc40b6600 msgr2=0x7f8dc4150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.568+0000 7f8dc2a00640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc40b6600 0x7f8dc4150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.568+0000 7f8dc2a00640 1 -- 172.21.15.44:0/385057331 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc415e560 con 0x7f8dc40b69e0 2024-03-30T13:12:14.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.569+0000 7f8dc2a00640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8dc40b69e0 0x7f8dc415f600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8db000d990 tx=0x7f8db000dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.567+0000 7f0398a00640 1 -- 172.21.15.44:0/1998538758 wait complete. 2024-03-30T13:12:14.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.569+0000 7f0398a00640 1 Processor -- start 2024-03-30T13:12:14.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.569+0000 7f8dbb400640 1 -- 172.21.15.44:0/385057331 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db0004230 con 0x7f8dc40b69e0 2024-03-30T13:12:14.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.570+0000 7f0398a00640 1 -- start start 2024-03-30T13:12:14.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.570+0000 7f8dbb400640 1 -- 172.21.15.44:0/385057331 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db00043d0 con 0x7f8dc40b69e0 2024-03-30T13:12:14.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.570+0000 7f8dbb400640 1 -- 172.21.15.44:0/385057331 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db000ab00 con 0x7f8dc40b69e0 2024-03-30T13:12:14.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.570+0000 7f8dca400640 1 -- 172.21.15.44:0/385057331 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc415e840 con 0x7f8dc40b69e0 2024-03-30T13:12:14.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.570+0000 7f8dca400640 1 -- 172.21.15.44:0/385057331 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc415ee00 con 0x7f8dc40b69e0 2024-03-30T13:12:14.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.571+0000 7f8dca400640 1 -- 172.21.15.44:0/385057331 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dc4075900 con 0x7f8dc40b69e0 2024-03-30T13:12:14.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.574+0000 7f8dbb400640 1 -- 172.21.15.44:0/385057331 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8db000aca0 con 0x7f8dc40b69e0 2024-03-30T13:12:14.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.575+0000 7f0398a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03940cec60 0x7f03940b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.576+0000 7f8dbb400640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8da406c5b0 0x7f8da406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.576+0000 7f0398a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03940d19c0 0x7f0394161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.576+0000 7f8dbb400640 1 -- 172.21.15.44:0/385057331 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8db008bff0 con 0x7f8dc40b69e0 2024-03-30T13:12:14.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.576+0000 7f0398a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03941f5720 0x7f039415a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.576+0000 7f0398a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f03940d4060 con 0x7f03940cec60 2024-03-30T13:12:14.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.577+0000 7f0398a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f03940d3ee0 con 0x7f03941f5720 2024-03-30T13:12:14.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.577+0000 7f8dc3400640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8da406c5b0 0x7f8da406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.577+0000 7f0391400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03940d19c0 0x7f0394161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.577+0000 7f0391400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03940d19c0 0x7f0394161050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:36942/0 (socket says 172.21.15.44:36942) 2024-03-30T13:12:14.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.577+0000 7f0391400640 1 -- 172.21.15.44:0/3487985054 learned_addr learned my addr 172.21.15.44:0/3487985054 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:14.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.578+0000 7f0398a00640 1 -- 172.21.15.44:0/3487985054 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f03940d41e0 con 0x7f03940d19c0 2024-03-30T13:12:14.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.578+0000 7f0392800640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03941f5720 0x7f039415a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.578+0000 7f8dc3400640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8da406c5b0 0x7f8da406ea70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8db4000f60 tx=0x7f8db4007a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.578+0000 7f0391e00640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03940cec60 0x7f03940b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.579+0000 7f0391400640 1 -- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03941f5720 msgr2=0x7f039415a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.580+0000 7f0391400640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03941f5720 0x7f039415a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.580+0000 7f0391400640 1 -- 172.21.15.44:0/3487985054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03940cec60 msgr2=0x7f03940b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.580+0000 7f0391400640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03940cec60 0x7f03940b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.580+0000 7f0391400640 1 -- 172.21.15.44:0/3487985054 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03940cacb0 con 0x7f03940d19c0 2024-03-30T13:12:14.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.580+0000 7f0391e00640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03940cec60 0x7f03940b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:14.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.580+0000 7f0392800640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03941f5720 0x7f039415a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:14.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.580+0000 7f0391400640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03940d19c0 0x7f0394161050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f038400c3c0 tx=0x7f038400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.581+0000 7f038a000640 1 -- 172.21.15.44:0/3487985054 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03840074e0 con 0x7f03940d19c0 2024-03-30T13:12:14.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.581+0000 7f038a000640 1 -- 172.21.15.44:0/3487985054 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03840047e0 con 0x7f03940d19c0 2024-03-30T13:12:14.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.581+0000 7f038a000640 1 -- 172.21.15.44:0/3487985054 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384004bb0 con 0x7f03940d19c0 2024-03-30T13:12:14.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.581+0000 7f0398a00640 1 -- 172.21.15.44:0/3487985054 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03940b6880 con 0x7f03940d19c0 2024-03-30T13:12:14.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.581+0000 7f0398a00640 1 -- 172.21.15.44:0/3487985054 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f03941f4f20 con 0x7f03940d19c0 2024-03-30T13:12:14.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.584+0000 7f0398a00640 1 -- 172.21.15.44:0/3487985054 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f036c005290 con 0x7f03940d19c0 2024-03-30T13:12:14.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.586+0000 7f038a000640 1 -- 172.21.15.44:0/3487985054 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0384011070 con 0x7f03940d19c0 2024-03-30T13:12:14.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.588+0000 7f038a000640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f037006c530 0x7f037006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:14.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.588+0000 7f038a000640 1 -- 172.21.15.44:0/3487985054 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f038408b580 con 0x7f03940d19c0 2024-03-30T13:12:14.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.588+0000 7f0391e00640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f037006c530 0x7f037006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:14.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.590+0000 7f8dbb400640 1 -- 172.21.15.44:0/385057331 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8db0015070 con 0x7f8dc40b69e0 2024-03-30T13:12:14.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.590+0000 7f0391e00640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f037006c530 0x7f037006e9f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f037c001b70 tx=0x7f037c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:14.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.602+0000 7f038a000640 1 -- 172.21.15.44:0/3487985054 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0384059850 con 0x7f03940d19c0 2024-03-30T13:12:14.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.907+0000 7fb84a000640 1 -- 172.21.15.44:0/3056968296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb828005850 con 0x7fb8540ccea0 2024-03-30T13:12:14.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.908+0000 7fb850c00640 1 -- 172.21.15.44:0/3056968296 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb8440093b0 con 0x7fb8540ccea0 2024-03-30T13:12:14.914 INFO:teuthology.orchestra.run.smithi044.stdout:64424509451 2024-03-30T13:12:14.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.912+0000 7fb84a000640 1 -- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb83406c580 msgr2=0x7fb83406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.912+0000 7fb84a000640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb83406c580 0x7fb83406ea40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb8541f36f0 tx=0x7fb84c009040 comp rx=0 tx=0).stop 2024-03-30T13:12:14.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.912+0000 7fb84a000640 1 -- 172.21.15.44:0/3056968296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8540ccea0 msgr2=0x7fb854159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.912+0000 7fb84a000640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8540ccea0 0x7fb854159910 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb844033000 tx=0x7fb8440046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.913+0000 7fb84a000640 1 -- 172.21.15.44:0/3056968296 shutdown_connections 2024-03-30T13:12:14.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.913+0000 7fb84a000640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8540b39b0 0x7fb8540c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.913+0000 7fb84a000640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb83406c580 0x7fb83406ea40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.913+0000 7fb84a000640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb85415a710 0x7fb8540b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.913+0000 7fb84a000640 1 --2- 172.21.15.44:0/3056968296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8540ccea0 0x7fb854159910 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.913+0000 7fb84a000640 1 -- 172.21.15.44:0/3056968296 >> 172.21.15.44:0/3056968296 conn(0x7fb8540b1800 msgr2=0x7fb854154d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.913+0000 7fb84a000640 1 -- 172.21.15.44:0/3056968296 shutdown_connections 2024-03-30T13:12:14.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.913+0000 7fb84a000640 1 -- 172.21.15.44:0/3056968296 wait complete. 2024-03-30T13:12:14.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.6 2024-03-30T13:12:14.944 DEBUG:teuthology.parallel:result is None 2024-03-30T13:12:14.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.966+0000 7ffa9e800640 1 -- 172.21.15.44:0/265435540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ffa980d3d00 con 0x7ffa980cf2d0 2024-03-30T13:12:14.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.967+0000 7ffa95600640 1 -- 172.21.15.44:0/265435540 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffa90059520 con 0x7ffa980cf2d0 2024-03-30T13:12:14.978 INFO:teuthology.orchestra.run.smithi044.stdout:64424509452 2024-03-30T13:12:14.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.970+0000 7ffa9e800640 1 -- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffa7c06c580 msgr2=0x7ffa7c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.970+0000 7ffa9e800640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffa7c06c580 0x7ffa7c06ea40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c036000 tx=0x7ffa8c008030 comp rx=0 tx=0).stop 2024-03-30T13:12:14.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.970+0000 7ffa9e800640 1 -- 172.21.15.44:0/265435540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa980cf2d0 msgr2=0x7ffa9814ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.970+0000 7ffa9e800640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa980cf2d0 0x7ffa9814ad10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000c870 tx=0x7ffa9000cd30 comp rx=0 tx=0).stop 2024-03-30T13:12:14.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.971+0000 7ffa9e800640 1 -- 172.21.15.44:0/265435540 shutdown_connections 2024-03-30T13:12:14.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.971+0000 7ffa9e800640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa9815e7c0 0x7ffa98160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.971+0000 7ffa9e800640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffa7c06c580 0x7ffa7c06ea40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.971+0000 7ffa9e800640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa980d2ee0 0x7ffa980cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.971+0000 7ffa9e800640 1 --2- 172.21.15.44:0/265435540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa980cf2d0 0x7ffa9814ad10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.971+0000 7ffa9e800640 1 -- 172.21.15.44:0/265435540 >> 172.21.15.44:0/265435540 conn(0x7ffa9809d520 msgr2=0x7ffa980d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.971+0000 7ffa9e800640 1 -- 172.21.15.44:0/265435540 shutdown_connections 2024-03-30T13:12:14.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.971+0000 7ffa9e800640 1 -- 172.21.15.44:0/265435540 wait complete. 2024-03-30T13:12:14.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.972+0000 7fe05a800640 1 -- 172.21.15.44:0/2672521051 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe0540b5c70 con 0x7fe054162770 2024-03-30T13:12:14.981 INFO:teuthology.orchestra.run.smithi044.stdout:64424509452 2024-03-30T13:12:14.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.973+0000 7fe051600640 1 -- 172.21.15.44:0/2672521051 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe04c07c440 con 0x7fe054162770 2024-03-30T13:12:14.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.975+0000 7fe05a800640 1 -- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe03406c630 msgr2=0x7fe03406eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.975+0000 7fe05a800640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe03406c630 0x7fe03406eaf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe048009a40 tx=0x7fe048008040 comp rx=0 tx=0).stop 2024-03-30T13:12:14.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.975+0000 7fe05a800640 1 -- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 msgr2=0x7fe0540b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.975+0000 7fe05a800640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 0x7fe0540b2e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009e50 tx=0x7fe04c004a40 comp rx=0 tx=0).stop 2024-03-30T13:12:14.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.975+0000 7fe05a800640 1 -- 172.21.15.44:0/2672521051 shutdown_connections 2024-03-30T13:12:14.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.975+0000 7fe05a800640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe054162770 0x7fe0540b2e80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.976+0000 7fe05a800640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0540ccc40 0x7fe0540b2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.976+0000 7fe05a800640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe03406c630 0x7fe03406eaf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.976+0000 7fe05a800640 1 --2- 172.21.15.44:0/2672521051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0540ca340 0x7fe0541521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.976+0000 7fe05a800640 1 -- 172.21.15.44:0/2672521051 >> 172.21.15.44:0/2672521051 conn(0x7fe0540b1800 msgr2=0x7fe054071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.976+0000 7fe05a800640 1 -- 172.21.15.44:0/2672521051 shutdown_connections 2024-03-30T13:12:14.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.976+0000 7fe05a800640 1 -- 172.21.15.44:0/2672521051 wait complete. 2024-03-30T13:12:14.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.987+0000 7f85db200640 1 -- 172.21.15.44:0/3134315559 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f85d0053bf0 con 0x7f85d00e30c0 2024-03-30T13:12:14.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.988+0000 7f85ce000640 1 -- 172.21.15.44:0/3134315559 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f85d40d8eb0 con 0x7f85d00e30c0 2024-03-30T13:12:14.992 INFO:teuthology.orchestra.run.smithi044.stdout:64424509452 2024-03-30T13:12:14.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.992+0000 7f85db200640 1 -- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f85b806c600 msgr2=0x7f85b806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.992+0000 7f85db200640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f85b806c600 0x7f85b806eac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85c80097a0 tx=0x7f85c8008030 comp rx=0 tx=0).stop 2024-03-30T13:12:14.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.992+0000 7f85db200640 1 -- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d00e30c0 msgr2=0x7f85d00ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:14.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.992+0000 7f85db200640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d00e30c0 0x7f85d00ce580 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f85d4075dd0 tx=0x7f85d4074420 comp rx=0 tx=0).stop 2024-03-30T13:12:14.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.992+0000 7f85db200640 1 -- 172.21.15.44:0/3134315559 shutdown_connections 2024-03-30T13:12:14.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.992+0000 7f85db200640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f85b806c600 0x7f85b806eac0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85c80097a0 tx=0x7f85c8008030 comp rx=0 tx=0).stop 2024-03-30T13:12:14.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.992+0000 7f85db200640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d00e30c0 0x7f85d00ce580 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.992+0000 7f85db200640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0054130 0x7f85d00ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.992+0000 7f85db200640 1 --2- 172.21.15.44:0/3134315559 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f85d003e840 0x7f85d017d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:14.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.992+0000 7f85db200640 1 -- 172.21.15.44:0/3134315559 >> 172.21.15.44:0/3134315559 conn(0x7f85d00559e0 msgr2=0x7f85d003c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:14.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.993+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f076c005580 con 0x7f078c0cd070 2024-03-30T13:12:14.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.993+0000 7f85db200640 1 -- 172.21.15.44:0/3134315559 shutdown_connections 2024-03-30T13:12:14.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.993+0000 7f078a000640 1 -- 172.21.15.44:0/641619110 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f07940f6740 con 0x7f078c0cd070 2024-03-30T13:12:14.998 INFO:teuthology.orchestra.run.smithi044.stdout:60129542155 2024-03-30T13:12:14.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.994+0000 7f85db200640 1 -- 172.21.15.44:0/3134315559 wait complete. 2024-03-30T13:12:15.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.3 2024-03-30T13:12:15.000 DEBUG:teuthology.parallel:result is None 2024-03-30T13:12:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.997+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f077406c5b0 msgr2=0x7f077406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.997+0000 7f0798c00640 1 --2- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f077406c5b0 0x7f077406ea70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0784006e00 tx=0x7f0784006cd0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.997+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f078c0cd070 msgr2=0x7f078c0cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.997+0000 7f0798c00640 1 --2- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f078c0cd070 0x7f078c0cb010 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0794063150 tx=0x7f0794069360 comp rx=0 tx=0).stop 2024-03-30T13:12:15.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.7 2024-03-30T13:12:15.003 DEBUG:teuthology.parallel:result is None 2024-03-30T13:12:15.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.998+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 shutdown_connections 2024-03-30T13:12:15.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.998+0000 7f0798c00640 1 --2- 172.21.15.44:0/641619110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f078c0ca5c0 0x7f078c04db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.998+0000 7f0798c00640 1 --2- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f077406c5b0 0x7f077406ea70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.998+0000 7f0798c00640 1 --2- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f078c0cd070 0x7f078c0cb010 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.998+0000 7f0798c00640 1 --2- 172.21.15.44:0/641619110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f078c04fa80 0x7f078c0e2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.998+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 >> 172.21.15.44:0/641619110 conn(0x7f078c009fa0 msgr2=0x7f078c0de6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:15.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.998+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 shutdown_connections 2024-03-30T13:12:15.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.998+0000 7f0798c00640 1 -- 172.21.15.44:0/641619110 wait complete. 2024-03-30T13:12:15.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:14.999+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc7a8005850 con 0x7fc7c40543c0 2024-03-30T13:12:15.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.000+0000 7fc7bfe00640 1 -- 172.21.15.44:0/408743204 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc7b8059490 con 0x7fc7c40543c0 2024-03-30T13:12:15.005 INFO:teuthology.orchestra.run.smithi044.stdout:64424509450 2024-03-30T13:12:15.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.004+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc7ac06c530 msgr2=0x7fc7ac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.004+0000 7fc7d1c00640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc7ac06c530 0x7fc7ac06e9f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40dddf0 tx=0x7fc7c0007c80 comp rx=0 tx=0).stop 2024-03-30T13:12:15.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.004+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 msgr2=0x7fc7c40d6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.004+0000 7fc7d1c00640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 0x7fc7c40d6600 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800c440 tx=0x7fc7b800c900 comp rx=0 tx=0).stop 2024-03-30T13:12:15.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.004+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 shutdown_connections 2024-03-30T13:12:15.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.004+0000 7fc7d1c00640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc7c40e3160 0x7fc7c40e4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.004+0000 7fc7d1c00640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7c40543c0 0x7fc7c40d6600 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.004+0000 7fc7d1c00640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc7ac06c530 0x7fc7ac06e9f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.004+0000 7fc7d1c00640 1 --2- 172.21.15.44:0/408743204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7c403c0a0 0x7fc7c404ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.004+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 >> 172.21.15.44:0/408743204 conn(0x7fc7c4058ee0 msgr2=0x7fc7c4056e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:15.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.004+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 shutdown_connections 2024-03-30T13:12:15.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.004+0000 7fc7d1c00640 1 -- 172.21.15.44:0/408743204 wait complete. 2024-03-30T13:12:15.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.013+0000 7f8dca400640 1 -- 172.21.15.44:0/385057331 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8dc415a710 con 0x7f8dc40b69e0 2024-03-30T13:12:15.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.013+0000 7f8dbb400640 1 -- 172.21.15.44:0/385057331 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8db0059d10 con 0x7f8dc40b69e0 2024-03-30T13:12:15.018 INFO:teuthology.orchestra.run.smithi044.stdout:64424509451 2024-03-30T13:12:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.016+0000 7f8dca400640 1 -- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8da406c5b0 msgr2=0x7f8da406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.016+0000 7f8dca400640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8da406c5b0 0x7f8da406ea70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8db4000f60 tx=0x7f8db4007a80 comp rx=0 tx=0).stop 2024-03-30T13:12:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.016+0000 7f8dca400640 1 -- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8dc40b69e0 msgr2=0x7f8dc415f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.016+0000 7f8dca400640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8dc40b69e0 0x7f8dc415f600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8db000d990 tx=0x7f8db000dd90 comp rx=0 tx=0).stop 2024-03-30T13:12:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.016+0000 7f8dca400640 1 -- 172.21.15.44:0/385057331 shutdown_connections 2024-03-30T13:12:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.016+0000 7f8dca400640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8dc4155bf0 0x7f8dc4154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.016+0000 7f8dca400640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8da406c5b0 0x7f8da406ea70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.016+0000 7f8dca400640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8dc40b69e0 0x7f8dc415f600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.016+0000 7f8dca400640 1 --2- 172.21.15.44:0/385057331 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8dc40b6600 0x7f8dc4150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.016+0000 7f8dca400640 1 -- 172.21.15.44:0/385057331 >> 172.21.15.44:0/385057331 conn(0x7f8dc40d1170 msgr2=0x7f8dc415ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:15.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.016+0000 7f8dca400640 1 -- 172.21.15.44:0/385057331 shutdown_connections 2024-03-30T13:12:15.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.016+0000 7f8dca400640 1 -- 172.21.15.44:0/385057331 wait complete. 2024-03-30T13:12:15.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.1 2024-03-30T13:12:15.027 DEBUG:teuthology.parallel:result is None 2024-03-30T13:12:15.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542155 for osd.2 2024-03-30T13:12:15.028 DEBUG:teuthology.parallel:result is None 2024-03-30T13:12:15.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.0 2024-03-30T13:12:15.029 DEBUG:teuthology.parallel:result is None 2024-03-30T13:12:15.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.028+0000 7f0398a00640 1 -- 172.21.15.44:0/3487985054 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f036c005580 con 0x7f03940d19c0 2024-03-30T13:12:15.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.029+0000 7f038a000640 1 -- 172.21.15.44:0/3487985054 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0384059150 con 0x7f03940d19c0 2024-03-30T13:12:15.034 INFO:teuthology.orchestra.run.smithi044.stdout:64424509451 2024-03-30T13:12:15.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.031+0000 7f0398a00640 1 -- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f037006c530 msgr2=0x7f037006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.031+0000 7f0398a00640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f037006c530 0x7f037006e9f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f037c001b70 tx=0x7f037c009040 comp rx=0 tx=0).stop 2024-03-30T13:12:15.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.031+0000 7f0398a00640 1 -- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03940d19c0 msgr2=0x7f0394161050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.031+0000 7f0398a00640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03940d19c0 0x7f0394161050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f038400c3c0 tx=0x7f038400c880 comp rx=0 tx=0).stop 2024-03-30T13:12:15.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.031+0000 7f0398a00640 1 -- 172.21.15.44:0/3487985054 shutdown_connections 2024-03-30T13:12:15.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.031+0000 7f0398a00640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f037006c530 0x7f037006e9f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.031+0000 7f0398a00640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03941f5720 0x7f039415a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.031+0000 7f0398a00640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03940d19c0 0x7f0394161050 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.031+0000 7f0398a00640 1 --2- 172.21.15.44:0/3487985054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03940cec60 0x7f03940b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.031+0000 7f0398a00640 1 -- 172.21.15.44:0/3487985054 >> 172.21.15.44:0/3487985054 conn(0x7f03940676b0 msgr2=0x7f03940d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.031+0000 7f0398a00640 1 -- 172.21.15.44:0/3487985054 shutdown_connections 2024-03-30T13:12:15.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.031+0000 7f0398a00640 1 -- 172.21.15.44:0/3487985054 wait complete. 2024-03-30T13:12:15.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.5 2024-03-30T13:12:15.038 DEBUG:teuthology.parallel:result is None 2024-03-30T13:12:15.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.4 2024-03-30T13:12:15.053 DEBUG:teuthology.parallel:result is None 2024-03-30T13:12:15.053 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-30T13:12:15.053 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:12:15.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.303+0000 7fc01f000640 1 Processor -- start 2024-03-30T13:12:15.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.303+0000 7fc01f000640 1 -- start start 2024-03-30T13:12:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.304+0000 7fc01f000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0181562f0 0x7fc0181566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.304+0000 7fc01f000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc018160c20 con 0x7fc0180d09a0 2024-03-30T13:12:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.304+0000 7fc01f000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0181600a0 con 0x7fc018142300 2024-03-30T13:12:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.304+0000 7fc01f000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc018156c10 con 0x7fc0181562f0 2024-03-30T13:12:15.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.305+0000 7fc01e600640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc0180d09a0 0x7fc01815ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56914/0 (socket says 172.21.15.44:56914) 2024-03-30T13:12:15.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.305+0000 7fc01e600640 1 -- 172.21.15.44:0/1942505170 learned_addr learned my addr 172.21.15.44:0/1942505170 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.305+0000 7fc01dc00640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0181562f0 0x7fc0181566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.305+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522461994 0 0) 0x7fc018160c20 con 0x7fc0180d09a0 2024-03-30T13:12:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.305+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc000003520 con 0x7fc0180d09a0 2024-03-30T13:12:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3487418021 0 0) 0x7fc000003520 con 0x7fc0180d09a0 2024-03-30T13:12:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0181562f0 msgr2=0x7fc0181566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0181562f0 0x7fc0181566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 >> v1:172.21.15.151:6789/0 conn(0x7fc018142300 legacy=0x7fc0180d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc018160380 con 0x7fc0180d09a0 2024-03-30T13:12:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fc0100019f0 con 0x7fc0180d09a0 2024-03-30T13:12:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 >> v1:172.21.15.44:6789/0 conn(0x7fc0180d09a0 legacy=0x7fc01815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0000039e0 0x7fc000003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0181562f0 0x7fc000004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc000004d40 0x7fc0000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc018156c10 con 0x7fc000004d40 2024-03-30T13:12:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc00000ba70 con 0x7fc0000039e0 2024-03-30T13:12:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc00000bc70 con 0x7fc0181562f0 2024-03-30T13:12:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc01e600640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc000004d40 0x7fc0000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.306+0000 7fc01dc00640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0000039e0 0x7fc000003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.307+0000 7fc01e600640 1 -- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0181562f0 msgr2=0x7fc000004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.307+0000 7fc01d200640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0181562f0 0x7fc000004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.307+0000 7fc01e600640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0181562f0 0x7fc000004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.307+0000 7fc01e600640 1 -- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0000039e0 msgr2=0x7fc000003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.307+0000 7fc01e600640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0000039e0 0x7fc000003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.307+0000 7fc01e600640 1 -- 172.21.15.44:0/1942505170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc000003520 con 0x7fc000004d40 2024-03-30T13:12:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.307+0000 7fc01dc00640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0000039e0 0x7fc000003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:15.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.307+0000 7fc01d200640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0181562f0 0x7fc000004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:15.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.308+0000 7fc01e600640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc000004d40 0x7fc0000051c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc0180ce0d0 tx=0x7fc000005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c45a3b70f046b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:15.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.308+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01000a460 con 0x7fc000004d40 2024-03-30T13:12:15.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.308+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc010034650 con 0x7fc000004d40 2024-03-30T13:12:15.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.308+0000 7fc017e00640 1 -- 172.21.15.44:0/1942505170 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc010034a40 con 0x7fc000004d40 2024-03-30T13:12:15.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.309+0000 7fc01f000640 1 -- 172.21.15.44:0/1942505170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc000004d40 msgr2=0x7fc0000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.309+0000 7fc01f000640 1 --2- 172.21.15.44:0/1942505170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc000004d40 0x7fc0000051c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc0180ce0d0 tx=0x7fc000005830 comp rx=0 tx=0).stop 2024-03-30T13:12:15.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.309+0000 7fc01e600640 1 -- 172.21.15.44:0/1942505170 reap_dead start 2024-03-30T13:12:15.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.309+0000 7fc01f000640 1 -- 172.21.15.44:0/1942505170 shutdown_connections 2024-03-30T13:12:15.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.309+0000 7fc01f000640 1 -- 172.21.15.44:0/1942505170 >> 172.21.15.44:0/1942505170 conn(0x7fc01806b9a0 msgr2=0x7fc01806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:15.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.309+0000 7fc01f000640 1 -- 172.21.15.44:0/1942505170 shutdown_connections 2024-03-30T13:12:15.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.309+0000 7fc01f000640 1 -- 172.21.15.44:0/1942505170 wait complete. 2024-03-30T13:12:15.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.310+0000 7fc01f000640 1 Processor -- start 2024-03-30T13:12:15.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.311+0000 7fc01f000640 1 -- start start 2024-03-30T13:12:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.311+0000 7fc01f000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc000004d40 0x7fc01813a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.311+0000 7fc01f000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc01814a750 0x7fc01815b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.311+0000 7fc01f000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc01815bc80 0x7fc0180b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.311+0000 7fc01f000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc018142780 con 0x7fc000004d40 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01f000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc018160940 con 0x7fc01815bc80 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01f000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc0180cca20 con 0x7fc01814a750 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc000004d40 0x7fc01813a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc000004d40 0x7fc01813a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39528/0 (socket says 172.21.15.44:39528) 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01dc00640 1 -- 172.21.15.44:0/1141836922 learned_addr learned my addr 172.21.15.44:0/1141836922 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01d200640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc01814a750 0x7fc01815b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01dc00640 1 -- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc01814a750 msgr2=0x7fc01815b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01dc00640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc01814a750 0x7fc01815b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01dc00640 1 -- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc01815bc80 msgr2=0x7fc0180b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01dc00640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc01815bc80 0x7fc0180b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01dc00640 1 -- 172.21.15.44:0/1141836922 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc01813ae80 con 0x7fc000004d40 2024-03-30T13:12:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01d200640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc01814a750 0x7fc01815b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.312+0000 7fc01dc00640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc000004d40 0x7fc01813a940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc00c011630 tx=0x7fc00c011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.313+0000 7fc015600640 1 -- 172.21.15.44:0/1141836922 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c015870 con 0x7fc000004d40 2024-03-30T13:12:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.313+0000 7fc015600640 1 -- 172.21.15.44:0/1141836922 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc00c015a10 con 0x7fc000004d40 2024-03-30T13:12:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.313+0000 7fc015600640 1 -- 172.21.15.44:0/1141836922 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c015de0 con 0x7fc000004d40 2024-03-30T13:12:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.313+0000 7fc01f000640 1 -- 172.21.15.44:0/1141836922 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0180b1cf0 con 0x7fc000004d40 2024-03-30T13:12:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.313+0000 7fc01f000640 1 -- 172.21.15.44:0/1141836922 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0180b22b0 con 0x7fc000004d40 2024-03-30T13:12:15.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.314+0000 7fc01f000640 1 -- 172.21.15.44:0/1141836922 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc018075890 con 0x7fc000004d40 2024-03-30T13:12:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.315+0000 7fc015600640 1 -- 172.21.15.44:0/1141836922 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc00c013430 con 0x7fc000004d40 2024-03-30T13:12:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.316+0000 7fc015600640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbff806c530 0x7fbff806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.316+0000 7fc015600640 1 -- 172.21.15.44:0/1141836922 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc00c08c300 con 0x7fc000004d40 2024-03-30T13:12:15.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.316+0000 7fc01d200640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbff806c530 0x7fbff806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.317+0000 7fc01d200640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbff806c530 0x7fbff806e9f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc018155f50 tx=0x7fc004009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:15.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.320+0000 7fc015600640 1 -- 172.21.15.44:0/1141836922 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc01813ae80 con 0x7fc000004d40 2024-03-30T13:12:15.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.519+0000 7fc01f000640 1 -- 172.21.15.44:0/1141836922 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0180cf1c0 con 0x7fbff806c530 2024-03-30T13:12:15.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.558+0000 7fc015600640 1 -- 172.21.15.44:0/1141836922 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7fc0180cf1c0 con 0x7fbff806c530 2024-03-30T13:12:15.568 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:15.570 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:12:15.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.564+0000 7fc01f000640 1 -- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbff806c530 msgr2=0x7fbff806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.564+0000 7fc01f000640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbff806c530 0x7fbff806e9f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc018155f50 tx=0x7fc004009040 comp rx=0 tx=0).stop 2024-03-30T13:12:15.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.564+0000 7fc01f000640 1 -- 172.21.15.44:0/1141836922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc000004d40 msgr2=0x7fc01813a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.564+0000 7fc01f000640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc000004d40 0x7fc01813a940 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc00c011630 tx=0x7fc00c011af0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.565+0000 7fc01f000640 1 -- 172.21.15.44:0/1141836922 shutdown_connections 2024-03-30T13:12:15.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.565+0000 7fc01f000640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbff806c530 0x7fbff806e9f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.565+0000 7fc01f000640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc01815bc80 0x7fc0180b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.565+0000 7fc01f000640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc01814a750 0x7fc01815b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.565+0000 7fc01f000640 1 --2- 172.21.15.44:0/1141836922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc000004d40 0x7fc01813a940 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.565+0000 7fc01f000640 1 -- 172.21.15.44:0/1141836922 >> 172.21.15.44:0/1141836922 conn(0x7fc01806b9a0 msgr2=0x7fc0180cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.565+0000 7fc01f000640 1 -- 172.21.15.44:0/1141836922 shutdown_connections 2024-03-30T13:12:15.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.565+0000 7fc01f000640 1 -- 172.21.15.44:0/1141836922 wait complete. 2024-03-30T13:12:15.586 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-03-30T13:12:13.960355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219592,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755128,"statfs":{"total":773094113280,"available":772869251072,"internally_reserved":0,"allocated":3514368,"data_stored":2075768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005000"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730687+0000","last_change":"2024-03-30T13:11:40.057283+0000","last_active":"2024-03-30T13:11:46.730687+0000","last_peered":"2024-03-30T13:11:46.730687+0000","last_clean":"2024-03-30T13:11:46.730687+0000","last_became_active":"2024-03-30T13:11:40.056762+0000","last_became_peered":"2024-03-30T13:11:40.056762+0000","last_unstale":"2024-03-30T13:11:46.730687+0000","last_undegraded":"2024-03-30T13:11:46.730687+0000","last_fullsized":"2024-03-30T13:11:46.730687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:40:48.482839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101982+0000","last_change":"2024-03-30T13:11:41.053361+0000","last_active":"2024-03-30T13:11:46.101982+0000","last_peered":"2024-03-30T13:11:46.101982+0000","last_clean":"2024-03-30T13:11:46.101982+0000","last_became_active":"2024-03-30T13:11:41.053113+0000","last_became_peered":"2024-03-30T13:11:41.053113+0000","last_unstale":"2024-03-30T13:11:46.101982+0000","last_undegraded":"2024-03-30T13:11:46.101982+0000","last_fullsized":"2024-03-30T13:11:46.101982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:26:18.201405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099642+0000","last_change":"2024-03-30T13:11:45.128908+0000","last_active":"2024-03-30T13:11:46.099642+0000","last_peered":"2024-03-30T13:11:46.099642+0000","last_clean":"2024-03-30T13:11:46.099642+0000","last_became_active":"2024-03-30T13:11:45.125033+0000","last_became_peered":"2024-03-30T13:11:45.125033+0000","last_unstale":"2024-03-30T13:11:46.099642+0000","last_undegraded":"2024-03-30T13:11:46.099642+0000","last_fullsized":"2024-03-30T13:11:46.099642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:47.578255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102346+0000","last_change":"2024-03-30T13:11:40.061864+0000","last_active":"2024-03-30T13:11:46.102346+0000","last_peered":"2024-03-30T13:11:46.102346+0000","last_clean":"2024-03-30T13:11:46.102346+0000","last_became_active":"2024-03-30T13:11:40.061541+0000","last_became_peered":"2024-03-30T13:11:40.061541+0000","last_unstale":"2024-03-30T13:11:46.102346+0000","last_undegraded":"2024-03-30T13:11:46.102346+0000","last_fullsized":"2024-03-30T13:11:46.102346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:00:09.740838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730387+0000","last_change":"2024-03-30T13:11:41.071991+0000","last_active":"2024-03-30T13:11:46.730387+0000","last_peered":"2024-03-30T13:11:46.730387+0000","last_clean":"2024-03-30T13:11:46.730387+0000","last_became_active":"2024-03-30T13:11:41.068214+0000","last_became_peered":"2024-03-30T13:11:41.068214+0000","last_unstale":"2024-03-30T13:11:46.730387+0000","last_undegraded":"2024-03-30T13:11:46.730387+0000","last_fullsized":"2024-03-30T13:11:46.730387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:07.157771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878229+0000","last_change":"2024-03-30T13:11:45.118196+0000","last_active":"2024-03-30T13:11:46.878229+0000","last_peered":"2024-03-30T13:11:46.878229+0000","last_clean":"2024-03-30T13:11:46.878229+0000","last_became_active":"2024-03-30T13:11:45.117348+0000","last_became_peered":"2024-03-30T13:11:45.117348+0000","last_unstale":"2024-03-30T13:11:46.878229+0000","last_undegraded":"2024-03-30T13:11:46.878229+0000","last_fullsized":"2024-03-30T13:11:46.878229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:33.630135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101841+0000","last_change":"2024-03-30T13:11:40.060593+0000","last_active":"2024-03-30T13:11:46.101841+0000","last_peered":"2024-03-30T13:11:46.101841+0000","last_clean":"2024-03-30T13:11:46.101841+0000","last_became_active":"2024-03-30T13:11:40.060297+0000","last_became_peered":"2024-03-30T13:11:40.060297+0000","last_unstale":"2024-03-30T13:11:46.101841+0000","last_undegraded":"2024-03-30T13:11:46.101841+0000","last_fullsized":"2024-03-30T13:11:46.101841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:26:00.941858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880714+0000","last_change":"2024-03-30T13:11:41.059936+0000","last_active":"2024-03-30T13:11:46.880714+0000","last_peered":"2024-03-30T13:11:46.880714+0000","last_clean":"2024-03-30T13:11:46.880714+0000","last_became_active":"2024-03-30T13:11:41.058955+0000","last_became_peered":"2024-03-30T13:11:41.058955+0000","last_unstale":"2024-03-30T13:11:46.880714+0000","last_undegraded":"2024-03-30T13:11:46.880714+0000","last_fullsized":"2024-03-30T13:11:46.880714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:48:13.158195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878602+0000","last_change":"2024-03-30T13:11:45.122549+0000","last_active":"2024-03-30T13:11:46.878602+0000","last_peered":"2024-03-30T13:11:46.878602+0000","last_clean":"2024-03-30T13:11:46.878602+0000","last_became_active":"2024-03-30T13:11:45.121869+0000","last_became_peered":"2024-03-30T13:11:45.121869+0000","last_unstale":"2024-03-30T13:11:46.878602+0000","last_undegraded":"2024-03-30T13:11:46.878602+0000","last_fullsized":"2024-03-30T13:11:46.878602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:08.813927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101843+0000","last_change":"2024-03-30T13:11:40.064355+0000","last_active":"2024-03-30T13:11:46.101843+0000","last_peered":"2024-03-30T13:11:46.101843+0000","last_clean":"2024-03-30T13:11:46.101843+0000","last_became_active":"2024-03-30T13:11:40.063509+0000","last_became_peered":"2024-03-30T13:11:40.063509+0000","last_unstale":"2024-03-30T13:11:46.101843+0000","last_undegraded":"2024-03-30T13:11:46.101843+0000","last_fullsized":"2024-03-30T13:11:46.101843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:08:08.320399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881004+0000","last_change":"2024-03-30T13:11:41.056587+0000","last_active":"2024-03-30T13:11:46.881004+0000","last_peered":"2024-03-30T13:11:46.881004+0000","last_clean":"2024-03-30T13:11:46.881004+0000","last_became_active":"2024-03-30T13:11:41.055308+0000","last_became_peered":"2024-03-30T13:11:41.055308+0000","last_unstale":"2024-03-30T13:11:46.881004+0000","last_undegraded":"2024-03-30T13:11:46.881004+0000","last_fullsized":"2024-03-30T13:11:46.881004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:05:33.323351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878545+0000","last_change":"2024-03-30T13:11:45.110636+0000","last_active":"2024-03-30T13:11:46.878545+0000","last_peered":"2024-03-30T13:11:46.878545+0000","last_clean":"2024-03-30T13:11:46.878545+0000","last_became_active":"2024-03-30T13:11:45.110148+0000","last_became_peered":"2024-03-30T13:11:45.110148+0000","last_unstale":"2024-03-30T13:11:46.878545+0000","last_undegraded":"2024-03-30T13:11:46.878545+0000","last_fullsized":"2024-03-30T13:11:46.878545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:42:11.094376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103982+0000","last_change":"2024-03-30T13:11:41.060135+0000","last_active":"2024-03-30T13:11:46.103982+0000","last_peered":"2024-03-30T13:11:46.103982+0000","last_clean":"2024-03-30T13:11:46.103982+0000","last_became_active":"2024-03-30T13:11:41.059868+0000","last_became_peered":"2024-03-30T13:11:41.059868+0000","last_unstale":"2024-03-30T13:11:46.103982+0000","last_undegraded":"2024-03-30T13:11:46.103982+0000","last_fullsized":"2024-03-30T13:11:46.103982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:01:39.869927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103046+0000","last_change":"2024-03-30T13:11:40.062596+0000","last_active":"2024-03-30T13:11:46.103046+0000","last_peered":"2024-03-30T13:11:46.103046+0000","last_clean":"2024-03-30T13:11:46.103046+0000","last_became_active":"2024-03-30T13:11:40.061171+0000","last_became_peered":"2024-03-30T13:11:40.061171+0000","last_unstale":"2024-03-30T13:11:46.103046+0000","last_undegraded":"2024-03-30T13:11:46.103046+0000","last_fullsized":"2024-03-30T13:11:46.103046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:36:51.946896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879271+0000","last_change":"2024-03-30T13:11:45.114509+0000","last_active":"2024-03-30T13:11:46.879271+0000","last_peered":"2024-03-30T13:11:46.879271+0000","last_clean":"2024-03-30T13:11:46.879271+0000","last_became_active":"2024-03-30T13:11:45.112300+0000","last_became_peered":"2024-03-30T13:11:45.112300+0000","last_unstale":"2024-03-30T13:11:46.879271+0000","last_undegraded":"2024-03-30T13:11:46.879271+0000","last_fullsized":"2024-03-30T13:11:46.879271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:20.547592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100409+0000","last_change":"2024-03-30T13:11:41.055501+0000","last_active":"2024-03-30T13:11:46.100409+0000","last_peered":"2024-03-30T13:11:46.100409+0000","last_clean":"2024-03-30T13:11:46.100409+0000","last_became_active":"2024-03-30T13:11:41.050140+0000","last_became_peered":"2024-03-30T13:11:41.050140+0000","last_unstale":"2024-03-30T13:11:46.100409+0000","last_undegraded":"2024-03-30T13:11:46.100409+0000","last_fullsized":"2024-03-30T13:11:46.100409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:29.578558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876526+0000","last_change":"2024-03-30T13:11:40.052089+0000","last_active":"2024-03-30T13:11:46.876526+0000","last_peered":"2024-03-30T13:11:46.876526+0000","last_clean":"2024-03-30T13:11:46.876526+0000","last_became_active":"2024-03-30T13:11:40.051812+0000","last_became_peered":"2024-03-30T13:11:40.051812+0000","last_unstale":"2024-03-30T13:11:46.876526+0000","last_undegraded":"2024-03-30T13:11:46.876526+0000","last_fullsized":"2024-03-30T13:11:46.876526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:11:46.050978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878901+0000","last_change":"2024-03-30T13:11:45.121795+0000","last_active":"2024-03-30T13:11:46.878901+0000","last_peered":"2024-03-30T13:11:46.878901+0000","last_clean":"2024-03-30T13:11:46.878901+0000","last_became_active":"2024-03-30T13:11:45.121345+0000","last_became_peered":"2024-03-30T13:11:45.121345+0000","last_unstale":"2024-03-30T13:11:46.878901+0000","last_undegraded":"2024-03-30T13:11:46.878901+0000","last_fullsized":"2024-03-30T13:11:46.878901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:26:22.252982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100364+0000","last_change":"2024-03-30T13:11:41.060945+0000","last_active":"2024-03-30T13:11:46.100364+0000","last_peered":"2024-03-30T13:11:46.100364+0000","last_clean":"2024-03-30T13:11:46.100364+0000","last_became_active":"2024-03-30T13:11:41.060615+0000","last_became_peered":"2024-03-30T13:11:41.060615+0000","last_unstale":"2024-03-30T13:11:46.100364+0000","last_undegraded":"2024-03-30T13:11:46.100364+0000","last_fullsized":"2024-03-30T13:11:46.100364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:05:51.376531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875830+0000","last_change":"2024-03-30T13:11:40.060348+0000","last_active":"2024-03-30T13:11:46.875830+0000","last_peered":"2024-03-30T13:11:46.875830+0000","last_clean":"2024-03-30T13:11:46.875830+0000","last_became_active":"2024-03-30T13:11:40.059848+0000","last_became_peered":"2024-03-30T13:11:40.059848+0000","last_unstale":"2024-03-30T13:11:46.875830+0000","last_undegraded":"2024-03-30T13:11:46.875830+0000","last_fullsized":"2024-03-30T13:11:46.875830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:28:08.352146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876924+0000","last_change":"2024-03-30T13:11:45.116711+0000","last_active":"2024-03-30T13:11:46.876924+0000","last_peered":"2024-03-30T13:11:46.876924+0000","last_clean":"2024-03-30T13:11:46.876924+0000","last_became_active":"2024-03-30T13:11:45.114206+0000","last_became_peered":"2024-03-30T13:11:45.114206+0000","last_unstale":"2024-03-30T13:11:46.876924+0000","last_undegraded":"2024-03-30T13:11:46.876924+0000","last_fullsized":"2024-03-30T13:11:46.876924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:32:28.206719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880010+0000","last_change":"2024-03-30T13:11:41.056070+0000","last_active":"2024-03-30T13:11:46.880010+0000","last_peered":"2024-03-30T13:11:46.880010+0000","last_clean":"2024-03-30T13:11:46.880010+0000","last_became_active":"2024-03-30T13:11:41.053456+0000","last_became_peered":"2024-03-30T13:11:41.053456+0000","last_unstale":"2024-03-30T13:11:46.880010+0000","last_undegraded":"2024-03-30T13:11:46.880010+0000","last_fullsized":"2024-03-30T13:11:46.880010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:16:30.169967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100577+0000","last_change":"2024-03-30T13:11:40.064409+0000","last_active":"2024-03-30T13:11:46.100577+0000","last_peered":"2024-03-30T13:11:46.100577+0000","last_clean":"2024-03-30T13:11:46.100577+0000","last_became_active":"2024-03-30T13:11:40.063354+0000","last_became_peered":"2024-03-30T13:11:40.063354+0000","last_unstale":"2024-03-30T13:11:46.100577+0000","last_undegraded":"2024-03-30T13:11:46.100577+0000","last_fullsized":"2024-03-30T13:11:46.100577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:10:46.181474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879273+0000","last_change":"2024-03-30T13:11:45.121709+0000","last_active":"2024-03-30T13:11:46.879273+0000","last_peered":"2024-03-30T13:11:46.879273+0000","last_clean":"2024-03-30T13:11:46.879273+0000","last_became_active":"2024-03-30T13:11:45.121209+0000","last_became_peered":"2024-03-30T13:11:45.121209+0000","last_unstale":"2024-03-30T13:11:46.879273+0000","last_undegraded":"2024-03-30T13:11:46.879273+0000","last_fullsized":"2024-03-30T13:11:46.879273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:22:00.571371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730831+0000","last_change":"2024-03-30T13:11:41.050382+0000","last_active":"2024-03-30T13:11:46.730831+0000","last_peered":"2024-03-30T13:11:46.730831+0000","last_clean":"2024-03-30T13:11:46.730831+0000","last_became_active":"2024-03-30T13:11:41.050104+0000","last_became_peered":"2024-03-30T13:11:41.050104+0000","last_unstale":"2024-03-30T13:11:46.730831+0000","last_undegraded":"2024-03-30T13:11:46.730831+0000","last_fullsized":"2024-03-30T13:11:46.730831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:42.594649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105935+0000","last_change":"2024-03-30T13:11:40.055011+0000","last_active":"2024-03-30T13:11:46.105935+0000","last_peered":"2024-03-30T13:11:46.105935+0000","last_clean":"2024-03-30T13:11:46.105935+0000","last_became_active":"2024-03-30T13:11:40.054495+0000","last_became_peered":"2024-03-30T13:11:40.054495+0000","last_unstale":"2024-03-30T13:11:46.105935+0000","last_undegraded":"2024-03-30T13:11:46.105935+0000","last_fullsized":"2024-03-30T13:11:46.105935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:10:46.181474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879720+0000","last_change":"2024-03-30T13:11:45.102475+0000","last_active":"2024-03-30T13:11:46.879720+0000","last_peered":"2024-03-30T13:11:46.879720+0000","last_clean":"2024-03-30T13:11:46.879720+0000","last_became_active":"2024-03-30T13:11:45.102062+0000","last_became_peered":"2024-03-30T13:11:45.102062+0000","last_unstale":"2024-03-30T13:11:46.879720+0000","last_undegraded":"2024-03-30T13:11:46.879720+0000","last_fullsized":"2024-03-30T13:11:46.879720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:14:57.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101633+0000","last_change":"2024-03-30T13:11:41.060379+0000","last_active":"2024-03-30T13:11:46.101633+0000","last_peered":"2024-03-30T13:11:46.101633+0000","last_clean":"2024-03-30T13:11:46.101633+0000","last_became_active":"2024-03-30T13:11:41.060173+0000","last_became_peered":"2024-03-30T13:11:41.060173+0000","last_unstale":"2024-03-30T13:11:46.101633+0000","last_undegraded":"2024-03-30T13:11:46.101633+0000","last_fullsized":"2024-03-30T13:11:46.101633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:04.762350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876716+0000","last_change":"2024-03-30T13:11:40.055192+0000","last_active":"2024-03-30T13:11:46.876716+0000","last_peered":"2024-03-30T13:11:46.876716+0000","last_clean":"2024-03-30T13:11:46.876716+0000","last_became_active":"2024-03-30T13:11:40.054791+0000","last_became_peered":"2024-03-30T13:11:40.054791+0000","last_unstale":"2024-03-30T13:11:46.876716+0000","last_undegraded":"2024-03-30T13:11:46.876716+0000","last_fullsized":"2024-03-30T13:11:46.876716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:48.164301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099353+0000","last_change":"2024-03-30T13:11:45.126240+0000","last_active":"2024-03-30T13:11:46.099353+0000","last_peered":"2024-03-30T13:11:46.099353+0000","last_clean":"2024-03-30T13:11:46.099353+0000","last_became_active":"2024-03-30T13:11:45.123879+0000","last_became_peered":"2024-03-30T13:11:45.123879+0000","last_unstale":"2024-03-30T13:11:46.099353+0000","last_undegraded":"2024-03-30T13:11:46.099353+0000","last_fullsized":"2024-03-30T13:11:46.099353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:39.782287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876292+0000","last_change":"2024-03-30T13:11:41.034727+0000","last_active":"2024-03-30T13:11:46.876292+0000","last_peered":"2024-03-30T13:11:46.876292+0000","last_clean":"2024-03-30T13:11:46.876292+0000","last_became_active":"2024-03-30T13:11:41.034082+0000","last_became_peered":"2024-03-30T13:11:41.034082+0000","last_unstale":"2024-03-30T13:11:46.876292+0000","last_undegraded":"2024-03-30T13:11:46.876292+0000","last_fullsized":"2024-03-30T13:11:46.876292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:21.432848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102205+0000","last_change":"2024-03-30T13:11:40.062157+0000","last_active":"2024-03-30T13:11:46.102205+0000","last_peered":"2024-03-30T13:11:46.102205+0000","last_clean":"2024-03-30T13:11:46.102205+0000","last_became_active":"2024-03-30T13:11:40.061803+0000","last_became_peered":"2024-03-30T13:11:40.061803+0000","last_unstale":"2024-03-30T13:11:46.102205+0000","last_undegraded":"2024-03-30T13:11:46.102205+0000","last_fullsized":"2024-03-30T13:11:46.102205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:42.868273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729905+0000","last_change":"2024-03-30T13:11:45.123226+0000","last_active":"2024-03-30T13:11:46.729905+0000","last_peered":"2024-03-30T13:11:46.729905+0000","last_clean":"2024-03-30T13:11:46.729905+0000","last_became_active":"2024-03-30T13:11:45.122718+0000","last_became_peered":"2024-03-30T13:11:45.122718+0000","last_unstale":"2024-03-30T13:11:46.729905+0000","last_undegraded":"2024-03-30T13:11:46.729905+0000","last_fullsized":"2024-03-30T13:11:46.729905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:33:31.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881174+0000","last_change":"2024-03-30T13:11:41.052392+0000","last_active":"2024-03-30T13:11:46.881174+0000","last_peered":"2024-03-30T13:11:46.881174+0000","last_clean":"2024-03-30T13:11:46.881174+0000","last_became_active":"2024-03-30T13:11:41.052060+0000","last_became_peered":"2024-03-30T13:11:41.052060+0000","last_unstale":"2024-03-30T13:11:46.881174+0000","last_undegraded":"2024-03-30T13:11:46.881174+0000","last_fullsized":"2024-03-30T13:11:46.881174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:43.692694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876402+0000","last_change":"2024-03-30T13:11:40.048150+0000","last_active":"2024-03-30T13:11:46.876402+0000","last_peered":"2024-03-30T13:11:46.876402+0000","last_clean":"2024-03-30T13:11:46.876402+0000","last_became_active":"2024-03-30T13:11:40.047850+0000","last_became_peered":"2024-03-30T13:11:40.047850+0000","last_unstale":"2024-03-30T13:11:46.876402+0000","last_undegraded":"2024-03-30T13:11:46.876402+0000","last_fullsized":"2024-03-30T13:11:46.876402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:16:29.155616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876047+0000","last_change":"2024-03-30T13:11:45.113367+0000","last_active":"2024-03-30T13:11:46.876047+0000","last_peered":"2024-03-30T13:11:46.876047+0000","last_clean":"2024-03-30T13:11:46.876047+0000","last_became_active":"2024-03-30T13:11:45.111513+0000","last_became_peered":"2024-03-30T13:11:45.111513+0000","last_unstale":"2024-03-30T13:11:46.876047+0000","last_undegraded":"2024-03-30T13:11:46.876047+0000","last_fullsized":"2024-03-30T13:11:46.876047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:14:57.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878997+0000","last_change":"2024-03-30T13:11:41.056650+0000","last_active":"2024-03-30T13:11:46.878997+0000","last_peered":"2024-03-30T13:11:46.878997+0000","last_clean":"2024-03-30T13:11:46.878997+0000","last_became_active":"2024-03-30T13:11:41.056039+0000","last_became_peered":"2024-03-30T13:11:41.056039+0000","last_unstale":"2024-03-30T13:11:46.878997+0000","last_undegraded":"2024-03-30T13:11:46.878997+0000","last_fullsized":"2024-03-30T13:11:46.878997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:17:03.655789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879619+0000","last_change":"2024-03-30T13:11:40.054357+0000","last_active":"2024-03-30T13:11:46.879619+0000","last_peered":"2024-03-30T13:11:46.879619+0000","last_clean":"2024-03-30T13:11:46.879619+0000","last_became_active":"2024-03-30T13:11:40.054059+0000","last_became_peered":"2024-03-30T13:11:40.054059+0000","last_unstale":"2024-03-30T13:11:46.879619+0000","last_undegraded":"2024-03-30T13:11:46.879619+0000","last_fullsized":"2024-03-30T13:11:46.879619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:49:27.793465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876330+0000","last_change":"2024-03-30T13:11:45.118213+0000","last_active":"2024-03-30T13:11:46.876330+0000","last_peered":"2024-03-30T13:11:46.876330+0000","last_clean":"2024-03-30T13:11:46.876330+0000","last_became_active":"2024-03-30T13:11:45.117767+0000","last_became_peered":"2024-03-30T13:11:45.117767+0000","last_unstale":"2024-03-30T13:11:46.876330+0000","last_undegraded":"2024-03-30T13:11:46.876330+0000","last_fullsized":"2024-03-30T13:11:46.876330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:06:10.320614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875760+0000","last_change":"2024-03-30T13:11:41.034348+0000","last_active":"2024-03-30T13:11:46.875760+0000","last_peered":"2024-03-30T13:11:46.875760+0000","last_clean":"2024-03-30T13:11:46.875760+0000","last_became_active":"2024-03-30T13:11:41.033932+0000","last_became_peered":"2024-03-30T13:11:41.033932+0000","last_unstale":"2024-03-30T13:11:46.875760+0000","last_undegraded":"2024-03-30T13:11:46.875760+0000","last_fullsized":"2024-03-30T13:11:46.875760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:42.594649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876009+0000","last_change":"2024-03-30T13:11:40.051550+0000","last_active":"2024-03-30T13:11:46.876009+0000","last_peered":"2024-03-30T13:11:46.876009+0000","last_clean":"2024-03-30T13:11:46.876009+0000","last_became_active":"2024-03-30T13:11:40.051234+0000","last_became_peered":"2024-03-30T13:11:40.051234+0000","last_unstale":"2024-03-30T13:11:46.876009+0000","last_undegraded":"2024-03-30T13:11:46.876009+0000","last_fullsized":"2024-03-30T13:11:46.876009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:27.119414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877003+0000","last_change":"2024-03-30T13:11:45.119951+0000","last_active":"2024-03-30T13:11:46.877003+0000","last_peered":"2024-03-30T13:11:46.877003+0000","last_clean":"2024-03-30T13:11:46.877003+0000","last_became_active":"2024-03-30T13:11:45.111516+0000","last_became_peered":"2024-03-30T13:11:45.111516+0000","last_unstale":"2024-03-30T13:11:46.877003+0000","last_undegraded":"2024-03-30T13:11:46.877003+0000","last_fullsized":"2024-03-30T13:11:46.877003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:02:40.515040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729368+0000","last_change":"2024-03-30T13:11:41.042344+0000","last_active":"2024-03-30T13:11:46.729368+0000","last_peered":"2024-03-30T13:11:46.729368+0000","last_clean":"2024-03-30T13:11:46.729368+0000","last_became_active":"2024-03-30T13:11:41.042069+0000","last_became_peered":"2024-03-30T13:11:41.042069+0000","last_unstale":"2024-03-30T13:11:46.729368+0000","last_undegraded":"2024-03-30T13:11:46.729368+0000","last_fullsized":"2024-03-30T13:11:46.729368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:58:30.289414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100827+0000","last_change":"2024-03-30T13:11:40.058392+0000","last_active":"2024-03-30T13:11:46.100827+0000","last_peered":"2024-03-30T13:11:46.100827+0000","last_clean":"2024-03-30T13:11:46.100827+0000","last_became_active":"2024-03-30T13:11:40.058061+0000","last_became_peered":"2024-03-30T13:11:40.058061+0000","last_unstale":"2024-03-30T13:11:46.100827+0000","last_undegraded":"2024-03-30T13:11:46.100827+0000","last_fullsized":"2024-03-30T13:11:46.100827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:48.743642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730652+0000","last_change":"2024-03-30T13:11:45.116598+0000","last_active":"2024-03-30T13:11:46.730652+0000","last_peered":"2024-03-30T13:11:46.730652+0000","last_clean":"2024-03-30T13:11:46.730652+0000","last_became_active":"2024-03-30T13:11:45.114214+0000","last_became_peered":"2024-03-30T13:11:45.114214+0000","last_unstale":"2024-03-30T13:11:46.730652+0000","last_undegraded":"2024-03-30T13:11:46.730652+0000","last_fullsized":"2024-03-30T13:11:46.730652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:41.073690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101902+0000","last_change":"2024-03-30T13:11:41.053875+0000","last_active":"2024-03-30T13:11:46.101902+0000","last_peered":"2024-03-30T13:11:46.101902+0000","last_clean":"2024-03-30T13:11:46.101902+0000","last_became_active":"2024-03-30T13:11:41.053564+0000","last_became_peered":"2024-03-30T13:11:41.053564+0000","last_unstale":"2024-03-30T13:11:46.101902+0000","last_undegraded":"2024-03-30T13:11:46.101902+0000","last_fullsized":"2024-03-30T13:11:46.101902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:21.432848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880378+0000","last_change":"2024-03-30T13:11:40.052525+0000","last_active":"2024-03-30T13:11:46.880378+0000","last_peered":"2024-03-30T13:11:46.880378+0000","last_clean":"2024-03-30T13:11:46.880378+0000","last_became_active":"2024-03-30T13:11:40.052228+0000","last_became_peered":"2024-03-30T13:11:40.052228+0000","last_unstale":"2024-03-30T13:11:46.880378+0000","last_undegraded":"2024-03-30T13:11:46.880378+0000","last_fullsized":"2024-03-30T13:11:46.880378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:37:31.772967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101036+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:11:46.101036+0000","last_peered":"2024-03-30T13:11:46.101036+0000","last_clean":"2024-03-30T13:11:46.101036+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:11:46.101036+0000","last_undegraded":"2024-03-30T13:11:46.101036+0000","last_fullsized":"2024-03-30T13:11:46.101036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105800+0000","last_change":"2024-03-30T13:11:45.115266+0000","last_active":"2024-03-30T13:11:46.105800+0000","last_peered":"2024-03-30T13:11:46.105800+0000","last_clean":"2024-03-30T13:11:46.105800+0000","last_became_active":"2024-03-30T13:11:45.114824+0000","last_became_peered":"2024-03-30T13:11:45.114824+0000","last_unstale":"2024-03-30T13:11:46.105800+0000","last_undegraded":"2024-03-30T13:11:46.105800+0000","last_fullsized":"2024-03-30T13:11:46.105800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:18:57.086379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101484+0000","last_change":"2024-03-30T13:11:41.064932+0000","last_active":"2024-03-30T13:11:46.101484+0000","last_peered":"2024-03-30T13:11:46.101484+0000","last_clean":"2024-03-30T13:11:46.101484+0000","last_became_active":"2024-03-30T13:11:41.064572+0000","last_became_peered":"2024-03-30T13:11:41.064572+0000","last_unstale":"2024-03-30T13:11:46.101484+0000","last_undegraded":"2024-03-30T13:11:46.101484+0000","last_fullsized":"2024-03-30T13:11:46.101484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:25:57.230503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876099+0000","last_change":"2024-03-30T13:11:40.053963+0000","last_active":"2024-03-30T13:11:46.876099+0000","last_peered":"2024-03-30T13:11:46.876099+0000","last_clean":"2024-03-30T13:11:46.876099+0000","last_became_active":"2024-03-30T13:11:40.053682+0000","last_became_peered":"2024-03-30T13:11:40.053682+0000","last_unstale":"2024-03-30T13:11:46.876099+0000","last_undegraded":"2024-03-30T13:11:46.876099+0000","last_fullsized":"2024-03-30T13:11:46.876099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:37:31.772967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103831+0000","last_change":"2024-03-30T13:11:45.108253+0000","last_active":"2024-03-30T13:11:46.103831+0000","last_peered":"2024-03-30T13:11:46.103831+0000","last_clean":"2024-03-30T13:11:46.103831+0000","last_became_active":"2024-03-30T13:11:45.107313+0000","last_became_peered":"2024-03-30T13:11:45.107313+0000","last_unstale":"2024-03-30T13:11:46.103831+0000","last_undegraded":"2024-03-30T13:11:46.103831+0000","last_fullsized":"2024-03-30T13:11:46.103831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:05:37.374928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880809+0000","last_change":"2024-03-30T13:11:41.043218+0000","last_active":"2024-03-30T13:11:46.880809+0000","last_peered":"2024-03-30T13:11:46.880809+0000","last_clean":"2024-03-30T13:11:46.880809+0000","last_became_active":"2024-03-30T13:11:41.042943+0000","last_became_peered":"2024-03-30T13:11:41.042943+0000","last_unstale":"2024-03-30T13:11:46.880809+0000","last_undegraded":"2024-03-30T13:11:46.880809+0000","last_fullsized":"2024-03-30T13:11:46.880809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:25:57.230503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876549+0000","last_change":"2024-03-30T13:11:40.053353+0000","last_active":"2024-03-30T13:11:46.876549+0000","last_peered":"2024-03-30T13:11:46.876549+0000","last_clean":"2024-03-30T13:11:46.876549+0000","last_became_active":"2024-03-30T13:11:40.052963+0000","last_became_peered":"2024-03-30T13:11:40.052963+0000","last_unstale":"2024-03-30T13:11:46.876549+0000","last_undegraded":"2024-03-30T13:11:46.876549+0000","last_fullsized":"2024-03-30T13:11:46.876549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:17:02.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729934+0000","last_change":"2024-03-30T13:11:45.121685+0000","last_active":"2024-03-30T13:11:46.729934+0000","last_peered":"2024-03-30T13:11:46.729934+0000","last_clean":"2024-03-30T13:11:46.729934+0000","last_became_active":"2024-03-30T13:11:45.121227+0000","last_became_peered":"2024-03-30T13:11:45.121227+0000","last_unstale":"2024-03-30T13:11:46.729934+0000","last_undegraded":"2024-03-30T13:11:46.729934+0000","last_fullsized":"2024-03-30T13:11:46.729934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:06:10.320614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103743+0000","last_change":"2024-03-30T13:11:41.058714+0000","last_active":"2024-03-30T13:11:46.103743+0000","last_peered":"2024-03-30T13:11:46.103743+0000","last_clean":"2024-03-30T13:11:46.103743+0000","last_became_active":"2024-03-30T13:11:41.058349+0000","last_became_peered":"2024-03-30T13:11:41.058349+0000","last_unstale":"2024-03-30T13:11:46.103743+0000","last_undegraded":"2024-03-30T13:11:46.103743+0000","last_fullsized":"2024-03-30T13:11:46.103743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:11:57.137995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875850+0000","last_change":"2024-03-30T13:11:40.062027+0000","last_active":"2024-03-30T13:11:46.875850+0000","last_peered":"2024-03-30T13:11:46.875850+0000","last_clean":"2024-03-30T13:11:46.875850+0000","last_became_active":"2024-03-30T13:11:40.060193+0000","last_became_peered":"2024-03-30T13:11:40.060193+0000","last_unstale":"2024-03-30T13:11:46.875850+0000","last_undegraded":"2024-03-30T13:11:46.875850+0000","last_fullsized":"2024-03-30T13:11:46.875850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:06.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877217+0000","last_change":"2024-03-30T13:11:45.104166+0000","last_active":"2024-03-30T13:11:46.877217+0000","last_peered":"2024-03-30T13:11:46.877217+0000","last_clean":"2024-03-30T13:11:46.877217+0000","last_became_active":"2024-03-30T13:11:45.103571+0000","last_became_peered":"2024-03-30T13:11:45.103571+0000","last_unstale":"2024-03-30T13:11:46.877217+0000","last_undegraded":"2024-03-30T13:11:46.877217+0000","last_fullsized":"2024-03-30T13:11:46.877217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:01:25.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103495+0000","last_change":"2024-03-30T13:11:41.052693+0000","last_active":"2024-03-30T13:11:46.103495+0000","last_peered":"2024-03-30T13:11:46.103495+0000","last_clean":"2024-03-30T13:11:46.103495+0000","last_became_active":"2024-03-30T13:11:41.052258+0000","last_became_peered":"2024-03-30T13:11:41.052258+0000","last_unstale":"2024-03-30T13:11:46.103495+0000","last_undegraded":"2024-03-30T13:11:46.103495+0000","last_fullsized":"2024-03-30T13:11:46.103495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:44:44.472713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879516+0000","last_change":"2024-03-30T13:11:40.046274+0000","last_active":"2024-03-30T13:11:46.879516+0000","last_peered":"2024-03-30T13:11:46.879516+0000","last_clean":"2024-03-30T13:11:46.879516+0000","last_became_active":"2024-03-30T13:11:40.045844+0000","last_became_peered":"2024-03-30T13:11:40.045844+0000","last_unstale":"2024-03-30T13:11:46.879516+0000","last_undegraded":"2024-03-30T13:11:46.879516+0000","last_fullsized":"2024-03-30T13:11:46.879516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:45:28.760784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878179+0000","last_change":"2024-03-30T13:11:45.113899+0000","last_active":"2024-03-30T13:11:46.878179+0000","last_peered":"2024-03-30T13:11:46.878179+0000","last_clean":"2024-03-30T13:11:46.878179+0000","last_became_active":"2024-03-30T13:11:45.113423+0000","last_became_peered":"2024-03-30T13:11:45.113423+0000","last_unstale":"2024-03-30T13:11:46.878179+0000","last_undegraded":"2024-03-30T13:11:46.878179+0000","last_fullsized":"2024-03-30T13:11:46.878179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:25.484425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101335+0000","last_change":"2024-03-30T13:11:41.061174+0000","last_active":"2024-03-30T13:11:46.101335+0000","last_peered":"2024-03-30T13:11:46.101335+0000","last_clean":"2024-03-30T13:11:46.101335+0000","last_became_active":"2024-03-30T13:11:41.053574+0000","last_became_peered":"2024-03-30T13:11:41.053574+0000","last_unstale":"2024-03-30T13:11:46.101335+0000","last_undegraded":"2024-03-30T13:11:46.101335+0000","last_fullsized":"2024-03-30T13:11:46.101335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:07:32.828569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875924+0000","last_change":"2024-03-30T13:11:40.049492+0000","last_active":"2024-03-30T13:11:46.875924+0000","last_peered":"2024-03-30T13:11:46.875924+0000","last_clean":"2024-03-30T13:11:46.875924+0000","last_became_active":"2024-03-30T13:11:40.049222+0000","last_became_peered":"2024-03-30T13:11:40.049222+0000","last_unstale":"2024-03-30T13:11:46.875924+0000","last_undegraded":"2024-03-30T13:11:46.875924+0000","last_fullsized":"2024-03-30T13:11:46.875924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:01:57.621288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730403+0000","last_change":"2024-03-30T13:11:45.118519+0000","last_active":"2024-03-30T13:11:46.730403+0000","last_peered":"2024-03-30T13:11:46.730403+0000","last_clean":"2024-03-30T13:11:46.730403+0000","last_became_active":"2024-03-30T13:11:45.118028+0000","last_became_peered":"2024-03-30T13:11:45.118028+0000","last_unstale":"2024-03-30T13:11:46.730403+0000","last_undegraded":"2024-03-30T13:11:46.730403+0000","last_fullsized":"2024-03-30T13:11:46.730403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:02:40.515040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102577+0000","last_change":"2024-03-30T13:11:41.049512+0000","last_active":"2024-03-30T13:11:46.102577+0000","last_peered":"2024-03-30T13:11:46.102577+0000","last_clean":"2024-03-30T13:11:46.102577+0000","last_became_active":"2024-03-30T13:11:41.047719+0000","last_became_peered":"2024-03-30T13:11:41.047719+0000","last_unstale":"2024-03-30T13:11:46.102577+0000","last_undegraded":"2024-03-30T13:11:46.102577+0000","last_fullsized":"2024-03-30T13:11:46.102577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:59.232981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103016+0000","last_change":"2024-03-30T13:11:40.060417+0000","last_active":"2024-03-30T13:11:46.103016+0000","last_peered":"2024-03-30T13:11:46.103016+0000","last_clean":"2024-03-30T13:11:46.103016+0000","last_became_active":"2024-03-30T13:11:40.058616+0000","last_became_peered":"2024-03-30T13:11:40.058616+0000","last_unstale":"2024-03-30T13:11:46.103016+0000","last_undegraded":"2024-03-30T13:11:46.103016+0000","last_fullsized":"2024-03-30T13:11:46.103016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:37:31.772967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101575+0000","last_change":"2024-03-30T13:11:45.129654+0000","last_active":"2024-03-30T13:11:46.101575+0000","last_peered":"2024-03-30T13:11:46.101575+0000","last_clean":"2024-03-30T13:11:46.101575+0000","last_became_active":"2024-03-30T13:11:45.129190+0000","last_became_peered":"2024-03-30T13:11:45.129190+0000","last_unstale":"2024-03-30T13:11:46.101575+0000","last_undegraded":"2024-03-30T13:11:46.101575+0000","last_fullsized":"2024-03-30T13:11:46.101575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:23.412062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101634+0000","last_change":"2024-03-30T13:11:41.059626+0000","last_active":"2024-03-30T13:11:46.101634+0000","last_peered":"2024-03-30T13:11:46.101634+0000","last_clean":"2024-03-30T13:11:46.101634+0000","last_became_active":"2024-03-30T13:11:41.058446+0000","last_became_peered":"2024-03-30T13:11:41.058446+0000","last_unstale":"2024-03-30T13:11:46.101634+0000","last_undegraded":"2024-03-30T13:11:46.101634+0000","last_fullsized":"2024-03-30T13:11:46.101634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:43.692694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879362+0000","last_change":"2024-03-30T13:11:40.064935+0000","last_active":"2024-03-30T13:11:46.879362+0000","last_peered":"2024-03-30T13:11:46.879362+0000","last_clean":"2024-03-30T13:11:46.879362+0000","last_became_active":"2024-03-30T13:11:40.062970+0000","last_became_peered":"2024-03-30T13:11:40.062970+0000","last_unstale":"2024-03-30T13:11:46.879362+0000","last_undegraded":"2024-03-30T13:11:46.879362+0000","last_fullsized":"2024-03-30T13:11:46.879362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:06.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101509+0000","last_change":"2024-03-30T13:11:45.130017+0000","last_active":"2024-03-30T13:11:46.101509+0000","last_peered":"2024-03-30T13:11:46.101509+0000","last_clean":"2024-03-30T13:11:46.101509+0000","last_became_active":"2024-03-30T13:11:45.129637+0000","last_became_peered":"2024-03-30T13:11:45.129637+0000","last_unstale":"2024-03-30T13:11:46.101509+0000","last_undegraded":"2024-03-30T13:11:46.101509+0000","last_fullsized":"2024-03-30T13:11:46.101509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:08:11.231971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730113+0000","last_change":"2024-03-30T13:11:41.046195+0000","last_active":"2024-03-30T13:11:46.730113+0000","last_peered":"2024-03-30T13:11:46.730113+0000","last_clean":"2024-03-30T13:11:46.730113+0000","last_became_active":"2024-03-30T13:11:41.045855+0000","last_became_peered":"2024-03-30T13:11:41.045855+0000","last_unstale":"2024-03-30T13:11:46.730113+0000","last_undegraded":"2024-03-30T13:11:46.730113+0000","last_fullsized":"2024-03-30T13:11:46.730113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:05:51.376531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730149+0000","last_change":"2024-03-30T13:11:40.055328+0000","last_active":"2024-03-30T13:11:46.730149+0000","last_peered":"2024-03-30T13:11:46.730149+0000","last_clean":"2024-03-30T13:11:46.730149+0000","last_became_active":"2024-03-30T13:11:40.054442+0000","last_became_peered":"2024-03-30T13:11:40.054442+0000","last_unstale":"2024-03-30T13:11:46.730149+0000","last_undegraded":"2024-03-30T13:11:46.730149+0000","last_fullsized":"2024-03-30T13:11:46.730149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:09.731487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881262+0000","last_change":"2024-03-30T13:11:45.111331+0000","last_active":"2024-03-30T13:11:46.881262+0000","last_peered":"2024-03-30T13:11:46.881262+0000","last_clean":"2024-03-30T13:11:46.881262+0000","last_became_active":"2024-03-30T13:11:45.110867+0000","last_became_peered":"2024-03-30T13:11:45.110867+0000","last_unstale":"2024-03-30T13:11:46.881262+0000","last_undegraded":"2024-03-30T13:11:46.881262+0000","last_fullsized":"2024-03-30T13:11:46.881262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:11:08.383284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101293+0000","last_change":"2024-03-30T13:11:41.050261+0000","last_active":"2024-03-30T13:11:46.101293+0000","last_peered":"2024-03-30T13:11:46.101293+0000","last_clean":"2024-03-30T13:11:46.101293+0000","last_became_active":"2024-03-30T13:11:41.049994+0000","last_became_peered":"2024-03-30T13:11:41.049994+0000","last_unstale":"2024-03-30T13:11:46.101293+0000","last_undegraded":"2024-03-30T13:11:46.101293+0000","last_fullsized":"2024-03-30T13:11:46.101293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:05:33.323351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:59.441353+0000","last_change":"2024-03-30T13:11:40.056699+0000","last_active":"2024-03-30T13:11:59.441353+0000","last_peered":"2024-03-30T13:11:59.441353+0000","last_clean":"2024-03-30T13:11:59.441353+0000","last_became_active":"2024-03-30T13:11:40.056278+0000","last_became_peered":"2024-03-30T13:11:40.056278+0000","last_unstale":"2024-03-30T13:11:59.441353+0000","last_undegraded":"2024-03-30T13:11:59.441353+0000","last_fullsized":"2024-03-30T13:11:59.441353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:06.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876228+0000","last_change":"2024-03-30T13:11:45.123273+0000","last_active":"2024-03-30T13:11:46.876228+0000","last_peered":"2024-03-30T13:11:46.876228+0000","last_clean":"2024-03-30T13:11:46.876228+0000","last_became_active":"2024-03-30T13:11:45.121491+0000","last_became_peered":"2024-03-30T13:11:45.121491+0000","last_unstale":"2024-03-30T13:11:46.876228+0000","last_undegraded":"2024-03-30T13:11:46.876228+0000","last_fullsized":"2024-03-30T13:11:46.876228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:33:31.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879397+0000","last_change":"2024-03-30T13:11:41.057070+0000","last_active":"2024-03-30T13:11:46.879397+0000","last_peered":"2024-03-30T13:11:46.879397+0000","last_clean":"2024-03-30T13:11:46.879397+0000","last_became_active":"2024-03-30T13:11:41.056836+0000","last_became_peered":"2024-03-30T13:11:41.056836+0000","last_unstale":"2024-03-30T13:11:46.879397+0000","last_undegraded":"2024-03-30T13:11:46.879397+0000","last_fullsized":"2024-03-30T13:11:46.879397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:28:09.366496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876480+0000","last_change":"2024-03-30T13:11:40.055926+0000","last_active":"2024-03-30T13:11:46.876480+0000","last_peered":"2024-03-30T13:11:46.876480+0000","last_clean":"2024-03-30T13:11:46.876480+0000","last_became_active":"2024-03-30T13:11:40.053853+0000","last_became_peered":"2024-03-30T13:11:40.053853+0000","last_unstale":"2024-03-30T13:11:46.876480+0000","last_undegraded":"2024-03-30T13:11:46.876480+0000","last_fullsized":"2024-03-30T13:11:46.876480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:12.149576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878894+0000","last_change":"2024-03-30T13:11:45.122152+0000","last_active":"2024-03-30T13:11:46.878894+0000","last_peered":"2024-03-30T13:11:46.878894+0000","last_clean":"2024-03-30T13:11:46.878894+0000","last_became_active":"2024-03-30T13:11:45.121264+0000","last_became_peered":"2024-03-30T13:11:45.121264+0000","last_unstale":"2024-03-30T13:11:46.878894+0000","last_undegraded":"2024-03-30T13:11:46.878894+0000","last_fullsized":"2024-03-30T13:11:46.878894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:59:33.643606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730553+0000","last_change":"2024-03-30T13:11:41.068464+0000","last_active":"2024-03-30T13:11:46.730553+0000","last_peered":"2024-03-30T13:11:46.730553+0000","last_clean":"2024-03-30T13:11:46.730553+0000","last_became_active":"2024-03-30T13:11:41.068061+0000","last_became_peered":"2024-03-30T13:11:41.068061+0000","last_unstale":"2024-03-30T13:11:46.730553+0000","last_undegraded":"2024-03-30T13:11:46.730553+0000","last_fullsized":"2024-03-30T13:11:46.730553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:55.484149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881041+0000","last_change":"2024-03-30T13:11:40.062612+0000","last_active":"2024-03-30T13:11:46.881041+0000","last_peered":"2024-03-30T13:11:46.881041+0000","last_clean":"2024-03-30T13:11:46.881041+0000","last_became_active":"2024-03-30T13:11:40.061971+0000","last_became_peered":"2024-03-30T13:11:40.061971+0000","last_unstale":"2024-03-30T13:11:46.881041+0000","last_undegraded":"2024-03-30T13:11:46.881041+0000","last_fullsized":"2024-03-30T13:11:46.881041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:10:46.181474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099913+0000","last_change":"2024-03-30T13:11:45.114995+0000","last_active":"2024-03-30T13:11:46.099913+0000","last_peered":"2024-03-30T13:11:46.099913+0000","last_clean":"2024-03-30T13:11:46.099913+0000","last_became_active":"2024-03-30T13:11:45.114482+0000","last_became_peered":"2024-03-30T13:11:45.114482+0000","last_unstale":"2024-03-30T13:11:46.099913+0000","last_undegraded":"2024-03-30T13:11:46.099913+0000","last_fullsized":"2024-03-30T13:11:46.099913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:29.950161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880748+0000","last_change":"2024-03-30T13:11:41.042685+0000","last_active":"2024-03-30T13:11:46.880748+0000","last_peered":"2024-03-30T13:11:46.880748+0000","last_clean":"2024-03-30T13:11:46.880748+0000","last_became_active":"2024-03-30T13:11:41.042404+0000","last_became_peered":"2024-03-30T13:11:41.042404+0000","last_unstale":"2024-03-30T13:11:46.880748+0000","last_undegraded":"2024-03-30T13:11:46.880748+0000","last_fullsized":"2024-03-30T13:11:46.880748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:18:53.034802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105469+0000","last_change":"2024-03-30T13:11:40.052419+0000","last_active":"2024-03-30T13:11:46.105469+0000","last_peered":"2024-03-30T13:11:46.105469+0000","last_clean":"2024-03-30T13:11:46.105469+0000","last_became_active":"2024-03-30T13:11:40.052072+0000","last_became_peered":"2024-03-30T13:11:40.052072+0000","last_unstale":"2024-03-30T13:11:46.105469+0000","last_undegraded":"2024-03-30T13:11:46.105469+0000","last_fullsized":"2024-03-30T13:11:46.105469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:49:27.793465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099771+0000","last_change":"2024-03-30T13:11:45.125449+0000","last_active":"2024-03-30T13:11:46.099771+0000","last_peered":"2024-03-30T13:11:46.099771+0000","last_clean":"2024-03-30T13:11:46.099771+0000","last_became_active":"2024-03-30T13:11:45.115932+0000","last_became_peered":"2024-03-30T13:11:45.115932+0000","last_unstale":"2024-03-30T13:11:46.099771+0000","last_undegraded":"2024-03-30T13:11:46.099771+0000","last_fullsized":"2024-03-30T13:11:46.099771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:20:14.235523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729971+0000","last_change":"2024-03-30T13:11:45.116967+0000","last_active":"2024-03-30T13:11:46.729971+0000","last_peered":"2024-03-30T13:11:46.729971+0000","last_clean":"2024-03-30T13:11:46.729971+0000","last_became_active":"2024-03-30T13:11:45.116228+0000","last_became_peered":"2024-03-30T13:11:45.116228+0000","last_unstale":"2024-03-30T13:11:46.729971+0000","last_undegraded":"2024-03-30T13:11:46.729971+0000","last_fullsized":"2024-03-30T13:11:46.729971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:32:28.206719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875605+0000","last_change":"2024-03-30T13:11:41.049464+0000","last_active":"2024-03-30T13:11:46.875605+0000","last_peered":"2024-03-30T13:11:46.875605+0000","last_clean":"2024-03-30T13:11:46.875605+0000","last_became_active":"2024-03-30T13:11:41.048486+0000","last_became_peered":"2024-03-30T13:11:41.048486+0000","last_unstale":"2024-03-30T13:11:46.875605+0000","last_undegraded":"2024-03-30T13:11:46.875605+0000","last_fullsized":"2024-03-30T13:11:46.875605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:55.484149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877383+0000","last_change":"2024-03-30T13:11:40.053490+0000","last_active":"2024-03-30T13:11:46.877383+0000","last_peered":"2024-03-30T13:11:46.877383+0000","last_clean":"2024-03-30T13:11:46.877383+0000","last_became_active":"2024-03-30T13:11:40.053256+0000","last_became_peered":"2024-03-30T13:11:40.053256+0000","last_unstale":"2024-03-30T13:11:46.877383+0000","last_undegraded":"2024-03-30T13:11:46.877383+0000","last_fullsized":"2024-03-30T13:11:46.877383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:27.119414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105172+0000","last_change":"2024-03-30T13:11:45.108563+0000","last_active":"2024-03-30T13:11:46.105172+0000","last_peered":"2024-03-30T13:11:46.105172+0000","last_clean":"2024-03-30T13:11:46.105172+0000","last_became_active":"2024-03-30T13:11:45.108155+0000","last_became_peered":"2024-03-30T13:11:45.108155+0000","last_unstale":"2024-03-30T13:11:46.105172+0000","last_undegraded":"2024-03-30T13:11:46.105172+0000","last_fullsized":"2024-03-30T13:11:46.105172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:26:01.282080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100080+0000","last_change":"2024-03-30T13:11:41.067378+0000","last_active":"2024-03-30T13:11:46.100080+0000","last_peered":"2024-03-30T13:11:46.100080+0000","last_clean":"2024-03-30T13:11:46.100080+0000","last_became_active":"2024-03-30T13:11:41.067068+0000","last_became_peered":"2024-03-30T13:11:41.067068+0000","last_unstale":"2024-03-30T13:11:46.100080+0000","last_undegraded":"2024-03-30T13:11:46.100080+0000","last_fullsized":"2024-03-30T13:11:46.100080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:42.594649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100702+0000","last_change":"2024-03-30T13:11:40.057479+0000","last_active":"2024-03-30T13:11:46.100702+0000","last_peered":"2024-03-30T13:11:46.100702+0000","last_clean":"2024-03-30T13:11:46.100702+0000","last_became_active":"2024-03-30T13:11:40.057191+0000","last_became_peered":"2024-03-30T13:11:40.057191+0000","last_unstale":"2024-03-30T13:11:46.100702+0000","last_undegraded":"2024-03-30T13:11:46.100702+0000","last_fullsized":"2024-03-30T13:11:46.100702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:40:48.482839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.104472+0000","last_change":"2024-03-30T13:11:40.059886+0000","last_active":"2024-03-30T13:11:46.104472+0000","last_peered":"2024-03-30T13:11:46.104472+0000","last_clean":"2024-03-30T13:11:46.104472+0000","last_became_active":"2024-03-30T13:11:40.058788+0000","last_became_peered":"2024-03-30T13:11:40.058788+0000","last_unstale":"2024-03-30T13:11:46.104472+0000","last_undegraded":"2024-03-30T13:11:46.104472+0000","last_fullsized":"2024-03-30T13:11:46.104472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:27.119414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730038+0000","last_change":"2024-03-30T13:11:41.061750+0000","last_active":"2024-03-30T13:11:46.730038+0000","last_peered":"2024-03-30T13:11:46.730038+0000","last_clean":"2024-03-30T13:11:46.730038+0000","last_became_active":"2024-03-30T13:11:41.061360+0000","last_became_peered":"2024-03-30T13:11:41.061360+0000","last_unstale":"2024-03-30T13:11:46.730038+0000","last_undegraded":"2024-03-30T13:11:46.730038+0000","last_fullsized":"2024-03-30T13:11:46.730038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:42:07.042799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875906+0000","last_change":"2024-03-30T13:11:45.121807+0000","last_active":"2024-03-30T13:11:46.875906+0000","last_peered":"2024-03-30T13:11:46.875906+0000","last_clean":"2024-03-30T13:11:46.875906+0000","last_became_active":"2024-03-30T13:11:45.121296+0000","last_became_peered":"2024-03-30T13:11:45.121296+0000","last_unstale":"2024-03-30T13:11:46.875906+0000","last_undegraded":"2024-03-30T13:11:46.875906+0000","last_fullsized":"2024-03-30T13:11:46.875906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:47.934200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101407+0000","last_change":"2024-03-30T13:11:40.061323+0000","last_active":"2024-03-30T13:11:46.101407+0000","last_peered":"2024-03-30T13:11:46.101407+0000","last_clean":"2024-03-30T13:11:46.101407+0000","last_became_active":"2024-03-30T13:11:40.059857+0000","last_became_peered":"2024-03-30T13:11:40.059857+0000","last_unstale":"2024-03-30T13:11:46.101407+0000","last_undegraded":"2024-03-30T13:11:46.101407+0000","last_fullsized":"2024-03-30T13:11:46.101407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:57:50.563331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878627+0000","last_change":"2024-03-30T13:11:41.059805+0000","last_active":"2024-03-30T13:11:46.878627+0000","last_peered":"2024-03-30T13:11:46.878627+0000","last_clean":"2024-03-30T13:11:46.878627+0000","last_became_active":"2024-03-30T13:11:41.058849+0000","last_became_peered":"2024-03-30T13:11:41.058849+0000","last_unstale":"2024-03-30T13:11:46.878627+0000","last_undegraded":"2024-03-30T13:11:46.878627+0000","last_fullsized":"2024-03-30T13:11:46.878627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:13.163926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102772+0000","last_change":"2024-03-30T13:11:45.130314+0000","last_active":"2024-03-30T13:11:46.102772+0000","last_peered":"2024-03-30T13:11:46.102772+0000","last_clean":"2024-03-30T13:11:46.102772+0000","last_became_active":"2024-03-30T13:11:45.129546+0000","last_became_peered":"2024-03-30T13:11:45.129546+0000","last_unstale":"2024-03-30T13:11:46.102772+0000","last_undegraded":"2024-03-30T13:11:46.102772+0000","last_fullsized":"2024-03-30T13:11:46.102772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:59.314585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102194+0000","last_change":"2024-03-30T13:11:41.057474+0000","last_active":"2024-03-30T13:11:46.102194+0000","last_peered":"2024-03-30T13:11:46.102194+0000","last_clean":"2024-03-30T13:11:46.102194+0000","last_became_active":"2024-03-30T13:11:41.057248+0000","last_became_peered":"2024-03-30T13:11:41.057248+0000","last_unstale":"2024-03-30T13:11:46.102194+0000","last_undegraded":"2024-03-30T13:11:46.102194+0000","last_fullsized":"2024-03-30T13:11:46.102194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:19:21.066570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876002+0000","last_change":"2024-03-30T13:11:41.044974+0000","last_active":"2024-03-30T13:11:46.876002+0000","last_peered":"2024-03-30T13:11:46.876002+0000","last_clean":"2024-03-30T13:11:46.876002+0000","last_became_active":"2024-03-30T13:11:41.044110+0000","last_became_peered":"2024-03-30T13:11:41.044110+0000","last_unstale":"2024-03-30T13:11:46.876002+0000","last_undegraded":"2024-03-30T13:11:46.876002+0000","last_fullsized":"2024-03-30T13:11:46.876002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:49.757992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880445+0000","last_change":"2024-03-30T13:11:41.051210+0000","last_active":"2024-03-30T13:11:46.880445+0000","last_peered":"2024-03-30T13:11:46.880445+0000","last_clean":"2024-03-30T13:11:46.880445+0000","last_became_active":"2024-03-30T13:11:41.050902+0000","last_became_peered":"2024-03-30T13:11:41.050902+0000","last_unstale":"2024-03-30T13:11:46.880445+0000","last_undegraded":"2024-03-30T13:11:46.880445+0000","last_fullsized":"2024-03-30T13:11:46.880445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:44:44.472713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730069+0000","last_change":"2024-03-30T13:11:41.056828+0000","last_active":"2024-03-30T13:11:46.730069+0000","last_peered":"2024-03-30T13:11:46.730069+0000","last_clean":"2024-03-30T13:11:46.730069+0000","last_became_active":"2024-03-30T13:11:41.055447+0000","last_became_peered":"2024-03-30T13:11:41.055447+0000","last_unstale":"2024-03-30T13:11:46.730069+0000","last_undegraded":"2024-03-30T13:11:46.730069+0000","last_fullsized":"2024-03-30T13:11:46.730069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:29.578558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101808+0000","last_change":"2024-03-30T13:11:41.062703+0000","last_active":"2024-03-30T13:11:46.101808+0000","last_peered":"2024-03-30T13:11:46.101808+0000","last_clean":"2024-03-30T13:11:46.101808+0000","last_became_active":"2024-03-30T13:11:41.062375+0000","last_became_peered":"2024-03-30T13:11:41.062375+0000","last_unstale":"2024-03-30T13:11:46.101808+0000","last_undegraded":"2024-03-30T13:11:46.101808+0000","last_fullsized":"2024-03-30T13:11:46.101808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:59:29.592029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876328+0000","last_change":"2024-03-30T13:11:41.047959+0000","last_active":"2024-03-30T13:11:46.876328+0000","last_peered":"2024-03-30T13:11:46.876328+0000","last_clean":"2024-03-30T13:11:46.876328+0000","last_became_active":"2024-03-30T13:11:41.047563+0000","last_became_peered":"2024-03-30T13:11:41.047563+0000","last_unstale":"2024-03-30T13:11:46.876328+0000","last_undegraded":"2024-03-30T13:11:46.876328+0000","last_fullsized":"2024-03-30T13:11:46.876328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:05:51.376531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.107604+0000","last_change":"2024-03-30T13:11:41.051909+0000","last_active":"2024-03-30T13:11:46.107604+0000","last_peered":"2024-03-30T13:11:46.107604+0000","last_clean":"2024-03-30T13:11:46.107604+0000","last_became_active":"2024-03-30T13:11:41.049935+0000","last_became_peered":"2024-03-30T13:11:41.049935+0000","last_unstale":"2024-03-30T13:11:46.107604+0000","last_undegraded":"2024-03-30T13:11:46.107604+0000","last_fullsized":"2024-03-30T13:11:46.107604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:08:02.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101288+0000","last_change":"2024-03-30T13:11:41.067163+0000","last_active":"2024-03-30T13:11:46.101288+0000","last_peered":"2024-03-30T13:11:46.101288+0000","last_clean":"2024-03-30T13:11:46.101288+0000","last_became_active":"2024-03-30T13:11:41.066912+0000","last_became_peered":"2024-03-30T13:11:41.066912+0000","last_unstale":"2024-03-30T13:11:46.101288+0000","last_undegraded":"2024-03-30T13:11:46.101288+0000","last_fullsized":"2024-03-30T13:11:46.101288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:42:07.042799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877312+0000","last_change":"2024-03-30T13:11:41.047542+0000","last_active":"2024-03-30T13:11:46.877312+0000","last_peered":"2024-03-30T13:11:46.877312+0000","last_clean":"2024-03-30T13:11:46.877312+0000","last_became_active":"2024-03-30T13:11:41.046947+0000","last_became_peered":"2024-03-30T13:11:41.046947+0000","last_unstale":"2024-03-30T13:11:46.877312+0000","last_undegraded":"2024-03-30T13:11:46.877312+0000","last_fullsized":"2024-03-30T13:11:46.877312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:19.146268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100367+0000","last_change":"2024-03-30T13:11:41.068416+0000","last_active":"2024-03-30T13:11:46.100367+0000","last_peered":"2024-03-30T13:11:46.100367+0000","last_clean":"2024-03-30T13:11:46.100367+0000","last_became_active":"2024-03-30T13:11:41.067651+0000","last_became_peered":"2024-03-30T13:11:41.067651+0000","last_unstale":"2024-03-30T13:11:46.100367+0000","last_undegraded":"2024-03-30T13:11:46.100367+0000","last_fullsized":"2024-03-30T13:11:46.100367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:07.157771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878282+0000","last_change":"2024-03-30T13:11:41.037581+0000","last_active":"2024-03-30T13:11:46.878282+0000","last_peered":"2024-03-30T13:11:46.878282+0000","last_clean":"2024-03-30T13:11:46.878282+0000","last_became_active":"2024-03-30T13:11:41.037266+0000","last_became_peered":"2024-03-30T13:11:41.037266+0000","last_unstale":"2024-03-30T13:11:46.878282+0000","last_undegraded":"2024-03-30T13:11:46.878282+0000","last_fullsized":"2024-03-30T13:11:46.878282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:34.039026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729580+0000","last_change":"2024-03-30T13:11:41.053939+0000","last_active":"2024-03-30T13:11:46.729580+0000","last_peered":"2024-03-30T13:11:46.729580+0000","last_clean":"2024-03-30T13:11:46.729580+0000","last_became_active":"2024-03-30T13:11:41.053762+0000","last_became_peered":"2024-03-30T13:11:41.053762+0000","last_unstale":"2024-03-30T13:11:46.729580+0000","last_undegraded":"2024-03-30T13:11:46.729580+0000","last_fullsized":"2024-03-30T13:11:46.729580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:21.432848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.104253+0000","last_change":"2024-03-30T13:11:41.053322+0000","last_active":"2024-03-30T13:11:46.104253+0000","last_peered":"2024-03-30T13:11:46.104253+0000","last_clean":"2024-03-30T13:11:46.104253+0000","last_became_active":"2024-03-30T13:11:41.053016+0000","last_became_peered":"2024-03-30T13:11:41.053016+0000","last_unstale":"2024-03-30T13:11:46.104253+0000","last_undegraded":"2024-03-30T13:11:46.104253+0000","last_fullsized":"2024-03-30T13:11:46.104253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:42:40.947191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102031+0000","last_change":"2024-03-30T13:11:41.048361+0000","last_active":"2024-03-30T13:11:46.102031+0000","last_peered":"2024-03-30T13:11:46.102031+0000","last_clean":"2024-03-30T13:11:46.102031+0000","last_became_active":"2024-03-30T13:11:41.048095+0000","last_became_peered":"2024-03-30T13:11:41.048095+0000","last_unstale":"2024-03-30T13:11:46.102031+0000","last_undegraded":"2024-03-30T13:11:46.102031+0000","last_fullsized":"2024-03-30T13:11:46.102031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:46:04.352790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875772+0000","last_change":"2024-03-30T13:11:41.038135+0000","last_active":"2024-03-30T13:11:46.875772+0000","last_peered":"2024-03-30T13:11:46.875772+0000","last_clean":"2024-03-30T13:11:46.875772+0000","last_became_active":"2024-03-30T13:11:41.036822+0000","last_became_peered":"2024-03-30T13:11:41.036822+0000","last_unstale":"2024-03-30T13:11:46.875772+0000","last_undegraded":"2024-03-30T13:11:46.875772+0000","last_fullsized":"2024-03-30T13:11:46.875772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:36:52.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881424+0000","last_change":"2024-03-30T13:11:41.048493+0000","last_active":"2024-03-30T13:11:46.881424+0000","last_peered":"2024-03-30T13:11:46.881424+0000","last_clean":"2024-03-30T13:11:46.881424+0000","last_became_active":"2024-03-30T13:11:41.047123+0000","last_became_peered":"2024-03-30T13:11:41.047123+0000","last_unstale":"2024-03-30T13:11:46.881424+0000","last_undegraded":"2024-03-30T13:11:46.881424+0000","last_fullsized":"2024-03-30T13:11:46.881424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:46:04.352790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877192+0000","last_change":"2024-03-30T13:11:41.047289+0000","last_active":"2024-03-30T13:11:46.877192+0000","last_peered":"2024-03-30T13:11:46.877192+0000","last_clean":"2024-03-30T13:11:46.877192+0000","last_became_active":"2024-03-30T13:11:41.046589+0000","last_became_peered":"2024-03-30T13:11:41.046589+0000","last_unstale":"2024-03-30T13:11:46.877192+0000","last_undegraded":"2024-03-30T13:11:46.877192+0000","last_fullsized":"2024-03-30T13:11:46.877192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:08:02.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875723+0000","last_change":"2024-03-30T13:11:41.052085+0000","last_active":"2024-03-30T13:11:46.875723+0000","last_peered":"2024-03-30T13:11:46.875723+0000","last_clean":"2024-03-30T13:11:46.875723+0000","last_became_active":"2024-03-30T13:11:41.051800+0000","last_became_peered":"2024-03-30T13:11:41.051800+0000","last_unstale":"2024-03-30T13:11:46.875723+0000","last_undegraded":"2024-03-30T13:11:46.875723+0000","last_fullsized":"2024-03-30T13:11:46.875723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:07.157771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730017+0000","last_change":"2024-03-30T13:11:41.052282+0000","last_active":"2024-03-30T13:11:46.730017+0000","last_peered":"2024-03-30T13:11:46.730017+0000","last_clean":"2024-03-30T13:11:46.730017+0000","last_became_active":"2024-03-30T13:11:41.052009+0000","last_became_peered":"2024-03-30T13:11:41.052009+0000","last_unstale":"2024-03-30T13:11:46.730017+0000","last_undegraded":"2024-03-30T13:11:46.730017+0000","last_fullsized":"2024-03-30T13:11:46.730017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:14:06.832559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102678+0000","last_change":"2024-03-30T13:11:41.050105+0000","last_active":"2024-03-30T13:11:46.102678+0000","last_peered":"2024-03-30T13:11:46.102678+0000","last_clean":"2024-03-30T13:11:46.102678+0000","last_became_active":"2024-03-30T13:11:41.048387+0000","last_became_peered":"2024-03-30T13:11:41.048387+0000","last_unstale":"2024-03-30T13:11:46.102678+0000","last_undegraded":"2024-03-30T13:11:46.102678+0000","last_fullsized":"2024-03-30T13:11:46.102678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:55.484149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879166+0000","last_change":"2024-03-30T13:11:41.055816+0000","last_active":"2024-03-30T13:11:46.879166+0000","last_peered":"2024-03-30T13:11:46.879166+0000","last_clean":"2024-03-30T13:11:46.879166+0000","last_became_active":"2024-03-30T13:11:41.051061+0000","last_became_peered":"2024-03-30T13:11:41.051061+0000","last_unstale":"2024-03-30T13:11:46.879166+0000","last_undegraded":"2024-03-30T13:11:46.879166+0000","last_fullsized":"2024-03-30T13:11:46.879166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:49.178652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.106145+0000","last_change":"2024-03-30T13:11:41.061725+0000","last_active":"2024-03-30T13:11:46.106145+0000","last_peered":"2024-03-30T13:11:46.106145+0000","last_clean":"2024-03-30T13:11:46.106145+0000","last_became_active":"2024-03-30T13:11:41.061432+0000","last_became_peered":"2024-03-30T13:11:41.061432+0000","last_unstale":"2024-03-30T13:11:46.106145+0000","last_undegraded":"2024-03-30T13:11:46.106145+0000","last_fullsized":"2024-03-30T13:11:46.106145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:13:46.043702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.107474+0000","last_change":"2024-03-30T13:11:41.060125+0000","last_active":"2024-03-30T13:11:46.107474+0000","last_peered":"2024-03-30T13:11:46.107474+0000","last_clean":"2024-03-30T13:11:46.107474+0000","last_became_active":"2024-03-30T13:11:41.059839+0000","last_became_peered":"2024-03-30T13:11:41.059839+0000","last_unstale":"2024-03-30T13:11:46.107474+0000","last_undegraded":"2024-03-30T13:11:46.107474+0000","last_fullsized":"2024-03-30T13:11:46.107474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:19.146268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103554+0000","last_change":"2024-03-30T13:11:41.066403+0000","last_active":"2024-03-30T13:11:46.103554+0000","last_peered":"2024-03-30T13:11:46.103554+0000","last_clean":"2024-03-30T13:11:46.103554+0000","last_became_active":"2024-03-30T13:11:41.066148+0000","last_became_peered":"2024-03-30T13:11:41.066148+0000","last_unstale":"2024-03-30T13:11:46.103554+0000","last_undegraded":"2024-03-30T13:11:46.103554+0000","last_fullsized":"2024-03-30T13:11:46.103554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:23:32.604365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099258+0000","last_change":"2024-03-30T13:11:41.072872+0000","last_active":"2024-03-30T13:11:46.099258+0000","last_peered":"2024-03-30T13:11:46.099258+0000","last_clean":"2024-03-30T13:11:46.099258+0000","last_became_active":"2024-03-30T13:11:41.066749+0000","last_became_peered":"2024-03-30T13:11:41.066749+0000","last_unstale":"2024-03-30T13:11:46.099258+0000","last_undegraded":"2024-03-30T13:11:46.099258+0000","last_fullsized":"2024-03-30T13:11:46.099258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:14:06.832559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101194+0000","last_change":"2024-03-30T13:11:41.051881+0000","last_active":"2024-03-30T13:11:46.101194+0000","last_peered":"2024-03-30T13:11:46.101194+0000","last_clean":"2024-03-30T13:11:46.101194+0000","last_became_active":"2024-03-30T13:11:41.051569+0000","last_became_peered":"2024-03-30T13:11:41.051569+0000","last_unstale":"2024-03-30T13:11:46.101194+0000","last_undegraded":"2024-03-30T13:11:46.101194+0000","last_fullsized":"2024-03-30T13:11:46.101194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:48:13.158195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878052+0000","last_change":"2024-03-30T13:11:41.052969+0000","last_active":"2024-03-30T13:11:46.878052+0000","last_peered":"2024-03-30T13:11:46.878052+0000","last_clean":"2024-03-30T13:11:46.878052+0000","last_became_active":"2024-03-30T13:11:41.052626+0000","last_became_peered":"2024-03-30T13:11:41.052626+0000","last_unstale":"2024-03-30T13:11:46.878052+0000","last_undegraded":"2024-03-30T13:11:46.878052+0000","last_fullsized":"2024-03-30T13:11:46.878052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:12.520741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101308+0000","last_change":"2024-03-30T13:11:41.044957+0000","last_active":"2024-03-30T13:11:46.101308+0000","last_peered":"2024-03-30T13:11:46.101308+0000","last_clean":"2024-03-30T13:11:46.101308+0000","last_became_active":"2024-03-30T13:11:41.044658+0000","last_became_peered":"2024-03-30T13:11:41.044658+0000","last_unstale":"2024-03-30T13:11:46.101308+0000","last_undegraded":"2024-03-30T13:11:46.101308+0000","last_fullsized":"2024-03-30T13:11:46.101308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:18:53.034802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880588+0000","last_change":"2024-03-30T13:11:41.056707+0000","last_active":"2024-03-30T13:11:46.880588+0000","last_peered":"2024-03-30T13:11:46.880588+0000","last_clean":"2024-03-30T13:11:46.880588+0000","last_became_active":"2024-03-30T13:11:41.055440+0000","last_became_peered":"2024-03-30T13:11:41.055440+0000","last_unstale":"2024-03-30T13:11:46.880588+0000","last_undegraded":"2024-03-30T13:11:46.880588+0000","last_fullsized":"2024-03-30T13:11:46.880588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:07:32.828569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729706+0000","last_change":"2024-03-30T13:11:41.046907+0000","last_active":"2024-03-30T13:11:46.729706+0000","last_peered":"2024-03-30T13:11:46.729706+0000","last_clean":"2024-03-30T13:11:46.729706+0000","last_became_active":"2024-03-30T13:11:41.046092+0000","last_became_peered":"2024-03-30T13:11:41.046092+0000","last_unstale":"2024-03-30T13:11:46.729706+0000","last_undegraded":"2024-03-30T13:11:46.729706+0000","last_fullsized":"2024-03-30T13:11:46.729706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:04:23.461918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876628+0000","last_change":"2024-03-30T13:11:41.043762+0000","last_active":"2024-03-30T13:11:46.876628+0000","last_peered":"2024-03-30T13:11:46.876628+0000","last_clean":"2024-03-30T13:11:46.876628+0000","last_became_active":"2024-03-30T13:11:41.043468+0000","last_became_peered":"2024-03-30T13:11:41.043468+0000","last_unstale":"2024-03-30T13:11:46.876628+0000","last_undegraded":"2024-03-30T13:11:46.876628+0000","last_fullsized":"2024-03-30T13:11:46.876628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:29.578558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103044+0000","last_change":"2024-03-30T13:11:41.051937+0000","last_active":"2024-03-30T13:11:46.103044+0000","last_peered":"2024-03-30T13:11:46.103044+0000","last_clean":"2024-03-30T13:11:46.103044+0000","last_became_active":"2024-03-30T13:11:41.051536+0000","last_became_peered":"2024-03-30T13:11:41.051536+0000","last_unstale":"2024-03-30T13:11:46.103044+0000","last_undegraded":"2024-03-30T13:11:46.103044+0000","last_fullsized":"2024-03-30T13:11:46.103044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:49:02.326260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":701669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":110809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":110845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":110879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":701725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:12:15.591 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:12:15.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.837+0000 7f24a6800640 1 Processor -- start 2024-03-30T13:12:15.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.837+0000 7f24a6800640 1 -- start start 2024-03-30T13:12:15.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.839+0000 7f24a6800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24a00cddd0 0x7f24a0169330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.839+0000 7f24a6800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a006d750 con 0x7f24a015e4f0 2024-03-30T13:12:15.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.839+0000 7f24a6800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a00d0ed0 con 0x7f24a00b3250 2024-03-30T13:12:15.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.839+0000 7f24a6800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f24a00cc650 con 0x7f24a00cddd0 2024-03-30T13:12:15.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.839+0000 7f24a5400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f24a015e4f0 0x7f24a006c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56926/0 (socket says 172.21.15.44:56926) 2024-03-30T13:12:15.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.839+0000 7f24a5400640 1 -- 172.21.15.44:0/2692366193 learned_addr learned my addr 172.21.15.44:0/2692366193 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:15.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 84592088 0 0) 0x7f24a006d750 con 0x7f24a015e4f0 2024-03-30T13:12:15.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2488003520 con 0x7f24a015e4f0 2024-03-30T13:12:15.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f24a5e00640 1 --2- 172.21.15.44:0/2692366193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24a00cddd0 0x7f24a0169330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4139264984 0 0) 0x7f2488003520 con 0x7f24a015e4f0 2024-03-30T13:12:15.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24a00cddd0 msgr2=0x7f24a0169330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:15.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 --2- 172.21.15.44:0/2692366193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24a00cddd0 0x7f24a0169330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 >> v1:172.21.15.151:6789/0 conn(0x7f24a00b3250 legacy=0x7f24a006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a00d11b0 con 0x7f24a015e4f0 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f2494001670 con 0x7f24a015e4f0 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 >> v1:172.21.15.44:6789/0 conn(0x7f24a015e4f0 legacy=0x7f24a006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 --2- 172.21.15.44:0/2692366193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24880039e0 0x7f2488003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 --2- 172.21.15.44:0/2692366193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2488004800 0x7f2488004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 --2- 172.21.15.44:0/2692366193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24a00cddd0 0x7f2488005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f24a00cc650 con 0x7f24880039e0 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f248800baf0 con 0x7f2488004800 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f248800bcf0 con 0x7f24a00cddd0 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.840+0000 7f24a5400640 1 --2- 172.21.15.44:0/2692366193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24880039e0 0x7f2488003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.841+0000 7f24a4a00640 1 --2- 172.21.15.44:0/2692366193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2488004800 0x7f2488004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.841+0000 7f24a5400640 1 -- 172.21.15.44:0/2692366193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24a00cddd0 msgr2=0x7f2488005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:15.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.841+0000 7f24a5400640 1 --2- 172.21.15.44:0/2692366193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24a00cddd0 0x7f2488005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.841+0000 7f24a5400640 1 -- 172.21.15.44:0/2692366193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2488004800 msgr2=0x7f2488004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:15.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.841+0000 7f24a5400640 1 --2- 172.21.15.44:0/2692366193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2488004800 0x7f2488004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.841+0000 7f24a5400640 1 -- 172.21.15.44:0/2692366193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2488003520 con 0x7f24880039e0 2024-03-30T13:12:15.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.842+0000 7f24a5400640 1 --2- 172.21.15.44:0/2692366193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24880039e0 0x7f2488003e00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f249400c210 tx=0x7f2488005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34583dcdc923008a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:15.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.842+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494007d30 con 0x7f24880039e0 2024-03-30T13:12:15.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.842+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2494030070 con 0x7f24880039e0 2024-03-30T13:12:15.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.842+0000 7f249fe00640 1 -- 172.21.15.44:0/2692366193 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249402cd60 con 0x7f24880039e0 2024-03-30T13:12:15.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.843+0000 7f24a6800640 1 -- 172.21.15.44:0/2692366193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24880039e0 msgr2=0x7f2488003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.843+0000 7f24a6800640 1 --2- 172.21.15.44:0/2692366193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24880039e0 0x7f2488003e00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f249400c210 tx=0x7f2488005830 comp rx=0 tx=0).stop 2024-03-30T13:12:15.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.843+0000 7f24a5e00640 1 -- 172.21.15.44:0/2692366193 reap_dead start 2024-03-30T13:12:15.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.843+0000 7f24a6800640 1 -- 172.21.15.44:0/2692366193 shutdown_connections 2024-03-30T13:12:15.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.843+0000 7f24a6800640 1 -- 172.21.15.44:0/2692366193 >> 172.21.15.44:0/2692366193 conn(0x7f24a00b3af0 msgr2=0x7f24a00b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:15.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.843+0000 7f24a6800640 1 -- 172.21.15.44:0/2692366193 shutdown_connections 2024-03-30T13:12:15.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.843+0000 7f24a6800640 1 -- 172.21.15.44:0/2692366193 wait complete. 2024-03-30T13:12:15.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.845+0000 7f24a6800640 1 Processor -- start 2024-03-30T13:12:15.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.845+0000 7f24a6800640 1 -- start start 2024-03-30T13:12:15.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24880039e0 0x7f24a00c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a6800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24a00cb6a0 0x7f24a0153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a6800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24a0154ab0 0x7f24a0154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a6800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f24a00cc8a0 con 0x7f24880039e0 2024-03-30T13:12:15.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a6800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f24a009ba40 con 0x7f24a0154ab0 2024-03-30T13:12:15.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a6800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f24a015e8d0 con 0x7f24a00cb6a0 2024-03-30T13:12:15.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24880039e0 0x7f24a00c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24880039e0 0x7f24a00c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39548/0 (socket says 172.21.15.44:39548) 2024-03-30T13:12:15.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a5400640 1 -- 172.21.15.44:0/322778610 learned_addr learned my addr 172.21.15.44:0/322778610 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:15.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a4a00640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24a00cb6a0 0x7f24a0153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a5e00640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24a0154ab0 0x7f24a0154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a5400640 1 -- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24a00cb6a0 msgr2=0x7f24a0153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a5400640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24a00cb6a0 0x7f24a0153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a5400640 1 -- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24a0154ab0 msgr2=0x7f24a0154f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:15.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a5400640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24a0154ab0 0x7f24a0154f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:15.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a5400640 1 -- 172.21.15.44:0/322778610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a00c6c00 con 0x7f24880039e0 2024-03-30T13:12:15.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.846+0000 7f24a5e00640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24a0154ab0 0x7f24a0154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:15.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.847+0000 7f24a5400640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24880039e0 0x7f24a00c6540 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2494001970 tx=0x7f2494001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:15.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.847+0000 7f249d600640 1 -- 172.21.15.44:0/322778610 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494046070 con 0x7f24880039e0 2024-03-30T13:12:15.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.847+0000 7f249d600640 1 -- 172.21.15.44:0/322778610 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2494000ed0 con 0x7f24880039e0 2024-03-30T13:12:15.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.847+0000 7f249d600640 1 -- 172.21.15.44:0/322778610 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494004e30 con 0x7f24880039e0 2024-03-30T13:12:15.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.847+0000 7f24a6800640 1 -- 172.21.15.44:0/322778610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a00c6ee0 con 0x7f24880039e0 2024-03-30T13:12:15.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.847+0000 7f24a6800640 1 -- 172.21.15.44:0/322778610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a00c74a0 con 0x7f24880039e0 2024-03-30T13:12:15.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.848+0000 7f24a6800640 1 -- 172.21.15.44:0/322778610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a006ddb0 con 0x7f24880039e0 2024-03-30T13:12:15.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.849+0000 7f249d600640 1 -- 172.21.15.44:0/322778610 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2494007070 con 0x7f24880039e0 2024-03-30T13:12:15.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.850+0000 7f249d600640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f248006c530 0x7f248006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:15.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.851+0000 7f249d600640 1 -- 172.21.15.44:0/322778610 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f24940acd90 con 0x7f24880039e0 2024-03-30T13:12:15.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.851+0000 7f24a4a00640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f248006c530 0x7f248006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:15.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.852+0000 7f24a4a00640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f248006c530 0x7f248006e9f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f248c000c00 tx=0x7f248c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:15.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:15.855+0000 7f249d600640 1 -- 172.21.15.44:0/322778610 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f249407b0e0 con 0x7f24880039e0 2024-03-30T13:12:16.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.047+0000 7f24a6800640 1 -- 172.21.15.44:0/322778610 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24a006f6b0 con 0x7f248006c530 2024-03-30T13:12:16.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.072+0000 7f249d600640 1 -- 172.21.15.44:0/322778610 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332535 (secure 0 0 0) 0x7f24a006f6b0 con 0x7f248006c530 2024-03-30T13:12:16.082 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:16.084 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:12:16.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.078+0000 7f24a6800640 1 -- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f248006c530 msgr2=0x7f248006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.078+0000 7f24a6800640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f248006c530 0x7f248006e9f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f248c000c00 tx=0x7f248c009040 comp rx=0 tx=0).stop 2024-03-30T13:12:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.078+0000 7f24a6800640 1 -- 172.21.15.44:0/322778610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24880039e0 msgr2=0x7f24a00c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.078+0000 7f24a6800640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24880039e0 0x7f24a00c6540 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2494001970 tx=0x7f2494001a40 comp rx=0 tx=0).stop 2024-03-30T13:12:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.078+0000 7f24a6800640 1 -- 172.21.15.44:0/322778610 shutdown_connections 2024-03-30T13:12:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.079+0000 7f24a6800640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f248006c530 0x7f248006e9f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.079+0000 7f24a6800640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24a0154ab0 0x7f24a0154f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.079+0000 7f24a6800640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24a00cb6a0 0x7f24a0153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.079+0000 7f24a6800640 1 --2- 172.21.15.44:0/322778610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f24880039e0 0x7f24a00c6540 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.079+0000 7f24a6800640 1 -- 172.21.15.44:0/322778610 >> 172.21.15.44:0/322778610 conn(0x7f24a00b3af0 msgr2=0x7f24a006fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.079+0000 7f24a6800640 1 -- 172.21.15.44:0/322778610 shutdown_connections 2024-03-30T13:12:16.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.079+0000 7f24a6800640 1 -- 172.21.15.44:0/322778610 wait complete. 2024-03-30T13:12:16.103 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-03-30T13:12:15.961535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219592,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755128,"statfs":{"total":773094113280,"available":772869251072,"internally_reserved":0,"allocated":3514368,"data_stored":2075768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005593"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730687+0000","last_change":"2024-03-30T13:11:40.057283+0000","last_active":"2024-03-30T13:11:46.730687+0000","last_peered":"2024-03-30T13:11:46.730687+0000","last_clean":"2024-03-30T13:11:46.730687+0000","last_became_active":"2024-03-30T13:11:40.056762+0000","last_became_peered":"2024-03-30T13:11:40.056762+0000","last_unstale":"2024-03-30T13:11:46.730687+0000","last_undegraded":"2024-03-30T13:11:46.730687+0000","last_fullsized":"2024-03-30T13:11:46.730687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:40:48.482839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101982+0000","last_change":"2024-03-30T13:11:41.053361+0000","last_active":"2024-03-30T13:11:46.101982+0000","last_peered":"2024-03-30T13:11:46.101982+0000","last_clean":"2024-03-30T13:11:46.101982+0000","last_became_active":"2024-03-30T13:11:41.053113+0000","last_became_peered":"2024-03-30T13:11:41.053113+0000","last_unstale":"2024-03-30T13:11:46.101982+0000","last_undegraded":"2024-03-30T13:11:46.101982+0000","last_fullsized":"2024-03-30T13:11:46.101982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:26:18.201405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099642+0000","last_change":"2024-03-30T13:11:45.128908+0000","last_active":"2024-03-30T13:11:46.099642+0000","last_peered":"2024-03-30T13:11:46.099642+0000","last_clean":"2024-03-30T13:11:46.099642+0000","last_became_active":"2024-03-30T13:11:45.125033+0000","last_became_peered":"2024-03-30T13:11:45.125033+0000","last_unstale":"2024-03-30T13:11:46.099642+0000","last_undegraded":"2024-03-30T13:11:46.099642+0000","last_fullsized":"2024-03-30T13:11:46.099642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:02:47.578255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102346+0000","last_change":"2024-03-30T13:11:40.061864+0000","last_active":"2024-03-30T13:11:46.102346+0000","last_peered":"2024-03-30T13:11:46.102346+0000","last_clean":"2024-03-30T13:11:46.102346+0000","last_became_active":"2024-03-30T13:11:40.061541+0000","last_became_peered":"2024-03-30T13:11:40.061541+0000","last_unstale":"2024-03-30T13:11:46.102346+0000","last_undegraded":"2024-03-30T13:11:46.102346+0000","last_fullsized":"2024-03-30T13:11:46.102346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:00:09.740838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730387+0000","last_change":"2024-03-30T13:11:41.071991+0000","last_active":"2024-03-30T13:11:46.730387+0000","last_peered":"2024-03-30T13:11:46.730387+0000","last_clean":"2024-03-30T13:11:46.730387+0000","last_became_active":"2024-03-30T13:11:41.068214+0000","last_became_peered":"2024-03-30T13:11:41.068214+0000","last_unstale":"2024-03-30T13:11:46.730387+0000","last_undegraded":"2024-03-30T13:11:46.730387+0000","last_fullsized":"2024-03-30T13:11:46.730387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:07.157771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878229+0000","last_change":"2024-03-30T13:11:45.118196+0000","last_active":"2024-03-30T13:11:46.878229+0000","last_peered":"2024-03-30T13:11:46.878229+0000","last_clean":"2024-03-30T13:11:46.878229+0000","last_became_active":"2024-03-30T13:11:45.117348+0000","last_became_peered":"2024-03-30T13:11:45.117348+0000","last_unstale":"2024-03-30T13:11:46.878229+0000","last_undegraded":"2024-03-30T13:11:46.878229+0000","last_fullsized":"2024-03-30T13:11:46.878229+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:33.630135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101841+0000","last_change":"2024-03-30T13:11:40.060593+0000","last_active":"2024-03-30T13:11:46.101841+0000","last_peered":"2024-03-30T13:11:46.101841+0000","last_clean":"2024-03-30T13:11:46.101841+0000","last_became_active":"2024-03-30T13:11:40.060297+0000","last_became_peered":"2024-03-30T13:11:40.060297+0000","last_unstale":"2024-03-30T13:11:46.101841+0000","last_undegraded":"2024-03-30T13:11:46.101841+0000","last_fullsized":"2024-03-30T13:11:46.101841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:26:00.941858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880714+0000","last_change":"2024-03-30T13:11:41.059936+0000","last_active":"2024-03-30T13:11:46.880714+0000","last_peered":"2024-03-30T13:11:46.880714+0000","last_clean":"2024-03-30T13:11:46.880714+0000","last_became_active":"2024-03-30T13:11:41.058955+0000","last_became_peered":"2024-03-30T13:11:41.058955+0000","last_unstale":"2024-03-30T13:11:46.880714+0000","last_undegraded":"2024-03-30T13:11:46.880714+0000","last_fullsized":"2024-03-30T13:11:46.880714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:48:13.158195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878602+0000","last_change":"2024-03-30T13:11:45.122549+0000","last_active":"2024-03-30T13:11:46.878602+0000","last_peered":"2024-03-30T13:11:46.878602+0000","last_clean":"2024-03-30T13:11:46.878602+0000","last_became_active":"2024-03-30T13:11:45.121869+0000","last_became_peered":"2024-03-30T13:11:45.121869+0000","last_unstale":"2024-03-30T13:11:46.878602+0000","last_undegraded":"2024-03-30T13:11:46.878602+0000","last_fullsized":"2024-03-30T13:11:46.878602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:08.813927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101843+0000","last_change":"2024-03-30T13:11:40.064355+0000","last_active":"2024-03-30T13:11:46.101843+0000","last_peered":"2024-03-30T13:11:46.101843+0000","last_clean":"2024-03-30T13:11:46.101843+0000","last_became_active":"2024-03-30T13:11:40.063509+0000","last_became_peered":"2024-03-30T13:11:40.063509+0000","last_unstale":"2024-03-30T13:11:46.101843+0000","last_undegraded":"2024-03-30T13:11:46.101843+0000","last_fullsized":"2024-03-30T13:11:46.101843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:08:08.320399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881004+0000","last_change":"2024-03-30T13:11:41.056587+0000","last_active":"2024-03-30T13:11:46.881004+0000","last_peered":"2024-03-30T13:11:46.881004+0000","last_clean":"2024-03-30T13:11:46.881004+0000","last_became_active":"2024-03-30T13:11:41.055308+0000","last_became_peered":"2024-03-30T13:11:41.055308+0000","last_unstale":"2024-03-30T13:11:46.881004+0000","last_undegraded":"2024-03-30T13:11:46.881004+0000","last_fullsized":"2024-03-30T13:11:46.881004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:05:33.323351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878545+0000","last_change":"2024-03-30T13:11:45.110636+0000","last_active":"2024-03-30T13:11:46.878545+0000","last_peered":"2024-03-30T13:11:46.878545+0000","last_clean":"2024-03-30T13:11:46.878545+0000","last_became_active":"2024-03-30T13:11:45.110148+0000","last_became_peered":"2024-03-30T13:11:45.110148+0000","last_unstale":"2024-03-30T13:11:46.878545+0000","last_undegraded":"2024-03-30T13:11:46.878545+0000","last_fullsized":"2024-03-30T13:11:46.878545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:42:11.094376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103982+0000","last_change":"2024-03-30T13:11:41.060135+0000","last_active":"2024-03-30T13:11:46.103982+0000","last_peered":"2024-03-30T13:11:46.103982+0000","last_clean":"2024-03-30T13:11:46.103982+0000","last_became_active":"2024-03-30T13:11:41.059868+0000","last_became_peered":"2024-03-30T13:11:41.059868+0000","last_unstale":"2024-03-30T13:11:46.103982+0000","last_undegraded":"2024-03-30T13:11:46.103982+0000","last_fullsized":"2024-03-30T13:11:46.103982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:01:39.869927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103046+0000","last_change":"2024-03-30T13:11:40.062596+0000","last_active":"2024-03-30T13:11:46.103046+0000","last_peered":"2024-03-30T13:11:46.103046+0000","last_clean":"2024-03-30T13:11:46.103046+0000","last_became_active":"2024-03-30T13:11:40.061171+0000","last_became_peered":"2024-03-30T13:11:40.061171+0000","last_unstale":"2024-03-30T13:11:46.103046+0000","last_undegraded":"2024-03-30T13:11:46.103046+0000","last_fullsized":"2024-03-30T13:11:46.103046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:36:51.946896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879271+0000","last_change":"2024-03-30T13:11:45.114509+0000","last_active":"2024-03-30T13:11:46.879271+0000","last_peered":"2024-03-30T13:11:46.879271+0000","last_clean":"2024-03-30T13:11:46.879271+0000","last_became_active":"2024-03-30T13:11:45.112300+0000","last_became_peered":"2024-03-30T13:11:45.112300+0000","last_unstale":"2024-03-30T13:11:46.879271+0000","last_undegraded":"2024-03-30T13:11:46.879271+0000","last_fullsized":"2024-03-30T13:11:46.879271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:32:20.547592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100409+0000","last_change":"2024-03-30T13:11:41.055501+0000","last_active":"2024-03-30T13:11:46.100409+0000","last_peered":"2024-03-30T13:11:46.100409+0000","last_clean":"2024-03-30T13:11:46.100409+0000","last_became_active":"2024-03-30T13:11:41.050140+0000","last_became_peered":"2024-03-30T13:11:41.050140+0000","last_unstale":"2024-03-30T13:11:46.100409+0000","last_undegraded":"2024-03-30T13:11:46.100409+0000","last_fullsized":"2024-03-30T13:11:46.100409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:29.578558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876526+0000","last_change":"2024-03-30T13:11:40.052089+0000","last_active":"2024-03-30T13:11:46.876526+0000","last_peered":"2024-03-30T13:11:46.876526+0000","last_clean":"2024-03-30T13:11:46.876526+0000","last_became_active":"2024-03-30T13:11:40.051812+0000","last_became_peered":"2024-03-30T13:11:40.051812+0000","last_unstale":"2024-03-30T13:11:46.876526+0000","last_undegraded":"2024-03-30T13:11:46.876526+0000","last_fullsized":"2024-03-30T13:11:46.876526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:11:46.050978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878901+0000","last_change":"2024-03-30T13:11:45.121795+0000","last_active":"2024-03-30T13:11:46.878901+0000","last_peered":"2024-03-30T13:11:46.878901+0000","last_clean":"2024-03-30T13:11:46.878901+0000","last_became_active":"2024-03-30T13:11:45.121345+0000","last_became_peered":"2024-03-30T13:11:45.121345+0000","last_unstale":"2024-03-30T13:11:46.878901+0000","last_undegraded":"2024-03-30T13:11:46.878901+0000","last_fullsized":"2024-03-30T13:11:46.878901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:26:22.252982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100364+0000","last_change":"2024-03-30T13:11:41.060945+0000","last_active":"2024-03-30T13:11:46.100364+0000","last_peered":"2024-03-30T13:11:46.100364+0000","last_clean":"2024-03-30T13:11:46.100364+0000","last_became_active":"2024-03-30T13:11:41.060615+0000","last_became_peered":"2024-03-30T13:11:41.060615+0000","last_unstale":"2024-03-30T13:11:46.100364+0000","last_undegraded":"2024-03-30T13:11:46.100364+0000","last_fullsized":"2024-03-30T13:11:46.100364+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:05:51.376531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875830+0000","last_change":"2024-03-30T13:11:40.060348+0000","last_active":"2024-03-30T13:11:46.875830+0000","last_peered":"2024-03-30T13:11:46.875830+0000","last_clean":"2024-03-30T13:11:46.875830+0000","last_became_active":"2024-03-30T13:11:40.059848+0000","last_became_peered":"2024-03-30T13:11:40.059848+0000","last_unstale":"2024-03-30T13:11:46.875830+0000","last_undegraded":"2024-03-30T13:11:46.875830+0000","last_fullsized":"2024-03-30T13:11:46.875830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:28:08.352146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876924+0000","last_change":"2024-03-30T13:11:45.116711+0000","last_active":"2024-03-30T13:11:46.876924+0000","last_peered":"2024-03-30T13:11:46.876924+0000","last_clean":"2024-03-30T13:11:46.876924+0000","last_became_active":"2024-03-30T13:11:45.114206+0000","last_became_peered":"2024-03-30T13:11:45.114206+0000","last_unstale":"2024-03-30T13:11:46.876924+0000","last_undegraded":"2024-03-30T13:11:46.876924+0000","last_fullsized":"2024-03-30T13:11:46.876924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:32:28.206719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880010+0000","last_change":"2024-03-30T13:11:41.056070+0000","last_active":"2024-03-30T13:11:46.880010+0000","last_peered":"2024-03-30T13:11:46.880010+0000","last_clean":"2024-03-30T13:11:46.880010+0000","last_became_active":"2024-03-30T13:11:41.053456+0000","last_became_peered":"2024-03-30T13:11:41.053456+0000","last_unstale":"2024-03-30T13:11:46.880010+0000","last_undegraded":"2024-03-30T13:11:46.880010+0000","last_fullsized":"2024-03-30T13:11:46.880010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:16:30.169967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100577+0000","last_change":"2024-03-30T13:11:40.064409+0000","last_active":"2024-03-30T13:11:46.100577+0000","last_peered":"2024-03-30T13:11:46.100577+0000","last_clean":"2024-03-30T13:11:46.100577+0000","last_became_active":"2024-03-30T13:11:40.063354+0000","last_became_peered":"2024-03-30T13:11:40.063354+0000","last_unstale":"2024-03-30T13:11:46.100577+0000","last_undegraded":"2024-03-30T13:11:46.100577+0000","last_fullsized":"2024-03-30T13:11:46.100577+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:10:46.181474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879273+0000","last_change":"2024-03-30T13:11:45.121709+0000","last_active":"2024-03-30T13:11:46.879273+0000","last_peered":"2024-03-30T13:11:46.879273+0000","last_clean":"2024-03-30T13:11:46.879273+0000","last_became_active":"2024-03-30T13:11:45.121209+0000","last_became_peered":"2024-03-30T13:11:45.121209+0000","last_unstale":"2024-03-30T13:11:46.879273+0000","last_undegraded":"2024-03-30T13:11:46.879273+0000","last_fullsized":"2024-03-30T13:11:46.879273+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:22:00.571371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730831+0000","last_change":"2024-03-30T13:11:41.050382+0000","last_active":"2024-03-30T13:11:46.730831+0000","last_peered":"2024-03-30T13:11:46.730831+0000","last_clean":"2024-03-30T13:11:46.730831+0000","last_became_active":"2024-03-30T13:11:41.050104+0000","last_became_peered":"2024-03-30T13:11:41.050104+0000","last_unstale":"2024-03-30T13:11:46.730831+0000","last_undegraded":"2024-03-30T13:11:46.730831+0000","last_fullsized":"2024-03-30T13:11:46.730831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:42.594649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105935+0000","last_change":"2024-03-30T13:11:40.055011+0000","last_active":"2024-03-30T13:11:46.105935+0000","last_peered":"2024-03-30T13:11:46.105935+0000","last_clean":"2024-03-30T13:11:46.105935+0000","last_became_active":"2024-03-30T13:11:40.054495+0000","last_became_peered":"2024-03-30T13:11:40.054495+0000","last_unstale":"2024-03-30T13:11:46.105935+0000","last_undegraded":"2024-03-30T13:11:46.105935+0000","last_fullsized":"2024-03-30T13:11:46.105935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:10:46.181474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879720+0000","last_change":"2024-03-30T13:11:45.102475+0000","last_active":"2024-03-30T13:11:46.879720+0000","last_peered":"2024-03-30T13:11:46.879720+0000","last_clean":"2024-03-30T13:11:46.879720+0000","last_became_active":"2024-03-30T13:11:45.102062+0000","last_became_peered":"2024-03-30T13:11:45.102062+0000","last_unstale":"2024-03-30T13:11:46.879720+0000","last_undegraded":"2024-03-30T13:11:46.879720+0000","last_fullsized":"2024-03-30T13:11:46.879720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:14:57.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101633+0000","last_change":"2024-03-30T13:11:41.060379+0000","last_active":"2024-03-30T13:11:46.101633+0000","last_peered":"2024-03-30T13:11:46.101633+0000","last_clean":"2024-03-30T13:11:46.101633+0000","last_became_active":"2024-03-30T13:11:41.060173+0000","last_became_peered":"2024-03-30T13:11:41.060173+0000","last_unstale":"2024-03-30T13:11:46.101633+0000","last_undegraded":"2024-03-30T13:11:46.101633+0000","last_fullsized":"2024-03-30T13:11:46.101633+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:57:04.762350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876716+0000","last_change":"2024-03-30T13:11:40.055192+0000","last_active":"2024-03-30T13:11:46.876716+0000","last_peered":"2024-03-30T13:11:46.876716+0000","last_clean":"2024-03-30T13:11:46.876716+0000","last_became_active":"2024-03-30T13:11:40.054791+0000","last_became_peered":"2024-03-30T13:11:40.054791+0000","last_unstale":"2024-03-30T13:11:46.876716+0000","last_undegraded":"2024-03-30T13:11:46.876716+0000","last_fullsized":"2024-03-30T13:11:46.876716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:48.164301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099353+0000","last_change":"2024-03-30T13:11:45.126240+0000","last_active":"2024-03-30T13:11:46.099353+0000","last_peered":"2024-03-30T13:11:46.099353+0000","last_clean":"2024-03-30T13:11:46.099353+0000","last_became_active":"2024-03-30T13:11:45.123879+0000","last_became_peered":"2024-03-30T13:11:45.123879+0000","last_unstale":"2024-03-30T13:11:46.099353+0000","last_undegraded":"2024-03-30T13:11:46.099353+0000","last_fullsized":"2024-03-30T13:11:46.099353+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:18:39.782287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876292+0000","last_change":"2024-03-30T13:11:41.034727+0000","last_active":"2024-03-30T13:11:46.876292+0000","last_peered":"2024-03-30T13:11:46.876292+0000","last_clean":"2024-03-30T13:11:46.876292+0000","last_became_active":"2024-03-30T13:11:41.034082+0000","last_became_peered":"2024-03-30T13:11:41.034082+0000","last_unstale":"2024-03-30T13:11:46.876292+0000","last_undegraded":"2024-03-30T13:11:46.876292+0000","last_fullsized":"2024-03-30T13:11:46.876292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:21.432848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102205+0000","last_change":"2024-03-30T13:11:40.062157+0000","last_active":"2024-03-30T13:11:46.102205+0000","last_peered":"2024-03-30T13:11:46.102205+0000","last_clean":"2024-03-30T13:11:46.102205+0000","last_became_active":"2024-03-30T13:11:40.061803+0000","last_became_peered":"2024-03-30T13:11:40.061803+0000","last_unstale":"2024-03-30T13:11:46.102205+0000","last_undegraded":"2024-03-30T13:11:46.102205+0000","last_fullsized":"2024-03-30T13:11:46.102205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:42.868273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729905+0000","last_change":"2024-03-30T13:11:45.123226+0000","last_active":"2024-03-30T13:11:46.729905+0000","last_peered":"2024-03-30T13:11:46.729905+0000","last_clean":"2024-03-30T13:11:46.729905+0000","last_became_active":"2024-03-30T13:11:45.122718+0000","last_became_peered":"2024-03-30T13:11:45.122718+0000","last_unstale":"2024-03-30T13:11:46.729905+0000","last_undegraded":"2024-03-30T13:11:46.729905+0000","last_fullsized":"2024-03-30T13:11:46.729905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:33:31.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881174+0000","last_change":"2024-03-30T13:11:41.052392+0000","last_active":"2024-03-30T13:11:46.881174+0000","last_peered":"2024-03-30T13:11:46.881174+0000","last_clean":"2024-03-30T13:11:46.881174+0000","last_became_active":"2024-03-30T13:11:41.052060+0000","last_became_peered":"2024-03-30T13:11:41.052060+0000","last_unstale":"2024-03-30T13:11:46.881174+0000","last_undegraded":"2024-03-30T13:11:46.881174+0000","last_fullsized":"2024-03-30T13:11:46.881174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:43.692694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876402+0000","last_change":"2024-03-30T13:11:40.048150+0000","last_active":"2024-03-30T13:11:46.876402+0000","last_peered":"2024-03-30T13:11:46.876402+0000","last_clean":"2024-03-30T13:11:46.876402+0000","last_became_active":"2024-03-30T13:11:40.047850+0000","last_became_peered":"2024-03-30T13:11:40.047850+0000","last_unstale":"2024-03-30T13:11:46.876402+0000","last_undegraded":"2024-03-30T13:11:46.876402+0000","last_fullsized":"2024-03-30T13:11:46.876402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:16:29.155616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876047+0000","last_change":"2024-03-30T13:11:45.113367+0000","last_active":"2024-03-30T13:11:46.876047+0000","last_peered":"2024-03-30T13:11:46.876047+0000","last_clean":"2024-03-30T13:11:46.876047+0000","last_became_active":"2024-03-30T13:11:45.111513+0000","last_became_peered":"2024-03-30T13:11:45.111513+0000","last_unstale":"2024-03-30T13:11:46.876047+0000","last_undegraded":"2024-03-30T13:11:46.876047+0000","last_fullsized":"2024-03-30T13:11:46.876047+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:14:57.462974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878997+0000","last_change":"2024-03-30T13:11:41.056650+0000","last_active":"2024-03-30T13:11:46.878997+0000","last_peered":"2024-03-30T13:11:46.878997+0000","last_clean":"2024-03-30T13:11:46.878997+0000","last_became_active":"2024-03-30T13:11:41.056039+0000","last_became_peered":"2024-03-30T13:11:41.056039+0000","last_unstale":"2024-03-30T13:11:46.878997+0000","last_undegraded":"2024-03-30T13:11:46.878997+0000","last_fullsized":"2024-03-30T13:11:46.878997+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:17:03.655789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879619+0000","last_change":"2024-03-30T13:11:40.054357+0000","last_active":"2024-03-30T13:11:46.879619+0000","last_peered":"2024-03-30T13:11:46.879619+0000","last_clean":"2024-03-30T13:11:46.879619+0000","last_became_active":"2024-03-30T13:11:40.054059+0000","last_became_peered":"2024-03-30T13:11:40.054059+0000","last_unstale":"2024-03-30T13:11:46.879619+0000","last_undegraded":"2024-03-30T13:11:46.879619+0000","last_fullsized":"2024-03-30T13:11:46.879619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:49:27.793465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876330+0000","last_change":"2024-03-30T13:11:45.118213+0000","last_active":"2024-03-30T13:11:46.876330+0000","last_peered":"2024-03-30T13:11:46.876330+0000","last_clean":"2024-03-30T13:11:46.876330+0000","last_became_active":"2024-03-30T13:11:45.117767+0000","last_became_peered":"2024-03-30T13:11:45.117767+0000","last_unstale":"2024-03-30T13:11:46.876330+0000","last_undegraded":"2024-03-30T13:11:46.876330+0000","last_fullsized":"2024-03-30T13:11:46.876330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:06:10.320614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875760+0000","last_change":"2024-03-30T13:11:41.034348+0000","last_active":"2024-03-30T13:11:46.875760+0000","last_peered":"2024-03-30T13:11:46.875760+0000","last_clean":"2024-03-30T13:11:46.875760+0000","last_became_active":"2024-03-30T13:11:41.033932+0000","last_became_peered":"2024-03-30T13:11:41.033932+0000","last_unstale":"2024-03-30T13:11:46.875760+0000","last_undegraded":"2024-03-30T13:11:46.875760+0000","last_fullsized":"2024-03-30T13:11:46.875760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:42.594649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876009+0000","last_change":"2024-03-30T13:11:40.051550+0000","last_active":"2024-03-30T13:11:46.876009+0000","last_peered":"2024-03-30T13:11:46.876009+0000","last_clean":"2024-03-30T13:11:46.876009+0000","last_became_active":"2024-03-30T13:11:40.051234+0000","last_became_peered":"2024-03-30T13:11:40.051234+0000","last_unstale":"2024-03-30T13:11:46.876009+0000","last_undegraded":"2024-03-30T13:11:46.876009+0000","last_fullsized":"2024-03-30T13:11:46.876009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:27.119414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877003+0000","last_change":"2024-03-30T13:11:45.119951+0000","last_active":"2024-03-30T13:11:46.877003+0000","last_peered":"2024-03-30T13:11:46.877003+0000","last_clean":"2024-03-30T13:11:46.877003+0000","last_became_active":"2024-03-30T13:11:45.111516+0000","last_became_peered":"2024-03-30T13:11:45.111516+0000","last_unstale":"2024-03-30T13:11:46.877003+0000","last_undegraded":"2024-03-30T13:11:46.877003+0000","last_fullsized":"2024-03-30T13:11:46.877003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:02:40.515040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729368+0000","last_change":"2024-03-30T13:11:41.042344+0000","last_active":"2024-03-30T13:11:46.729368+0000","last_peered":"2024-03-30T13:11:46.729368+0000","last_clean":"2024-03-30T13:11:46.729368+0000","last_became_active":"2024-03-30T13:11:41.042069+0000","last_became_peered":"2024-03-30T13:11:41.042069+0000","last_unstale":"2024-03-30T13:11:46.729368+0000","last_undegraded":"2024-03-30T13:11:46.729368+0000","last_fullsized":"2024-03-30T13:11:46.729368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:58:30.289414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100827+0000","last_change":"2024-03-30T13:11:40.058392+0000","last_active":"2024-03-30T13:11:46.100827+0000","last_peered":"2024-03-30T13:11:46.100827+0000","last_clean":"2024-03-30T13:11:46.100827+0000","last_became_active":"2024-03-30T13:11:40.058061+0000","last_became_peered":"2024-03-30T13:11:40.058061+0000","last_unstale":"2024-03-30T13:11:46.100827+0000","last_undegraded":"2024-03-30T13:11:46.100827+0000","last_fullsized":"2024-03-30T13:11:46.100827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:48.743642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730652+0000","last_change":"2024-03-30T13:11:45.116598+0000","last_active":"2024-03-30T13:11:46.730652+0000","last_peered":"2024-03-30T13:11:46.730652+0000","last_clean":"2024-03-30T13:11:46.730652+0000","last_became_active":"2024-03-30T13:11:45.114214+0000","last_became_peered":"2024-03-30T13:11:45.114214+0000","last_unstale":"2024-03-30T13:11:46.730652+0000","last_undegraded":"2024-03-30T13:11:46.730652+0000","last_fullsized":"2024-03-30T13:11:46.730652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:54:41.073690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101902+0000","last_change":"2024-03-30T13:11:41.053875+0000","last_active":"2024-03-30T13:11:46.101902+0000","last_peered":"2024-03-30T13:11:46.101902+0000","last_clean":"2024-03-30T13:11:46.101902+0000","last_became_active":"2024-03-30T13:11:41.053564+0000","last_became_peered":"2024-03-30T13:11:41.053564+0000","last_unstale":"2024-03-30T13:11:46.101902+0000","last_undegraded":"2024-03-30T13:11:46.101902+0000","last_fullsized":"2024-03-30T13:11:46.101902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:21.432848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880378+0000","last_change":"2024-03-30T13:11:40.052525+0000","last_active":"2024-03-30T13:11:46.880378+0000","last_peered":"2024-03-30T13:11:46.880378+0000","last_clean":"2024-03-30T13:11:46.880378+0000","last_became_active":"2024-03-30T13:11:40.052228+0000","last_became_peered":"2024-03-30T13:11:40.052228+0000","last_unstale":"2024-03-30T13:11:46.880378+0000","last_undegraded":"2024-03-30T13:11:46.880378+0000","last_fullsized":"2024-03-30T13:11:46.880378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:37:31.772967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101036+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:11:46.101036+0000","last_peered":"2024-03-30T13:11:46.101036+0000","last_clean":"2024-03-30T13:11:46.101036+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:11:46.101036+0000","last_undegraded":"2024-03-30T13:11:46.101036+0000","last_fullsized":"2024-03-30T13:11:46.101036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105800+0000","last_change":"2024-03-30T13:11:45.115266+0000","last_active":"2024-03-30T13:11:46.105800+0000","last_peered":"2024-03-30T13:11:46.105800+0000","last_clean":"2024-03-30T13:11:46.105800+0000","last_became_active":"2024-03-30T13:11:45.114824+0000","last_became_peered":"2024-03-30T13:11:45.114824+0000","last_unstale":"2024-03-30T13:11:46.105800+0000","last_undegraded":"2024-03-30T13:11:46.105800+0000","last_fullsized":"2024-03-30T13:11:46.105800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:18:57.086379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101484+0000","last_change":"2024-03-30T13:11:41.064932+0000","last_active":"2024-03-30T13:11:46.101484+0000","last_peered":"2024-03-30T13:11:46.101484+0000","last_clean":"2024-03-30T13:11:46.101484+0000","last_became_active":"2024-03-30T13:11:41.064572+0000","last_became_peered":"2024-03-30T13:11:41.064572+0000","last_unstale":"2024-03-30T13:11:46.101484+0000","last_undegraded":"2024-03-30T13:11:46.101484+0000","last_fullsized":"2024-03-30T13:11:46.101484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:25:57.230503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876099+0000","last_change":"2024-03-30T13:11:40.053963+0000","last_active":"2024-03-30T13:11:46.876099+0000","last_peered":"2024-03-30T13:11:46.876099+0000","last_clean":"2024-03-30T13:11:46.876099+0000","last_became_active":"2024-03-30T13:11:40.053682+0000","last_became_peered":"2024-03-30T13:11:40.053682+0000","last_unstale":"2024-03-30T13:11:46.876099+0000","last_undegraded":"2024-03-30T13:11:46.876099+0000","last_fullsized":"2024-03-30T13:11:46.876099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:37:31.772967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103831+0000","last_change":"2024-03-30T13:11:45.108253+0000","last_active":"2024-03-30T13:11:46.103831+0000","last_peered":"2024-03-30T13:11:46.103831+0000","last_clean":"2024-03-30T13:11:46.103831+0000","last_became_active":"2024-03-30T13:11:45.107313+0000","last_became_peered":"2024-03-30T13:11:45.107313+0000","last_unstale":"2024-03-30T13:11:46.103831+0000","last_undegraded":"2024-03-30T13:11:46.103831+0000","last_fullsized":"2024-03-30T13:11:46.103831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:05:37.374928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880809+0000","last_change":"2024-03-30T13:11:41.043218+0000","last_active":"2024-03-30T13:11:46.880809+0000","last_peered":"2024-03-30T13:11:46.880809+0000","last_clean":"2024-03-30T13:11:46.880809+0000","last_became_active":"2024-03-30T13:11:41.042943+0000","last_became_peered":"2024-03-30T13:11:41.042943+0000","last_unstale":"2024-03-30T13:11:46.880809+0000","last_undegraded":"2024-03-30T13:11:46.880809+0000","last_fullsized":"2024-03-30T13:11:46.880809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:25:57.230503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876549+0000","last_change":"2024-03-30T13:11:40.053353+0000","last_active":"2024-03-30T13:11:46.876549+0000","last_peered":"2024-03-30T13:11:46.876549+0000","last_clean":"2024-03-30T13:11:46.876549+0000","last_became_active":"2024-03-30T13:11:40.052963+0000","last_became_peered":"2024-03-30T13:11:40.052963+0000","last_unstale":"2024-03-30T13:11:46.876549+0000","last_undegraded":"2024-03-30T13:11:46.876549+0000","last_fullsized":"2024-03-30T13:11:46.876549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:17:02.641438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729934+0000","last_change":"2024-03-30T13:11:45.121685+0000","last_active":"2024-03-30T13:11:46.729934+0000","last_peered":"2024-03-30T13:11:46.729934+0000","last_clean":"2024-03-30T13:11:46.729934+0000","last_became_active":"2024-03-30T13:11:45.121227+0000","last_became_peered":"2024-03-30T13:11:45.121227+0000","last_unstale":"2024-03-30T13:11:46.729934+0000","last_undegraded":"2024-03-30T13:11:46.729934+0000","last_fullsized":"2024-03-30T13:11:46.729934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:06:10.320614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103743+0000","last_change":"2024-03-30T13:11:41.058714+0000","last_active":"2024-03-30T13:11:46.103743+0000","last_peered":"2024-03-30T13:11:46.103743+0000","last_clean":"2024-03-30T13:11:46.103743+0000","last_became_active":"2024-03-30T13:11:41.058349+0000","last_became_peered":"2024-03-30T13:11:41.058349+0000","last_unstale":"2024-03-30T13:11:46.103743+0000","last_undegraded":"2024-03-30T13:11:46.103743+0000","last_fullsized":"2024-03-30T13:11:46.103743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:11:57.137995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875850+0000","last_change":"2024-03-30T13:11:40.062027+0000","last_active":"2024-03-30T13:11:46.875850+0000","last_peered":"2024-03-30T13:11:46.875850+0000","last_clean":"2024-03-30T13:11:46.875850+0000","last_became_active":"2024-03-30T13:11:40.060193+0000","last_became_peered":"2024-03-30T13:11:40.060193+0000","last_unstale":"2024-03-30T13:11:46.875850+0000","last_undegraded":"2024-03-30T13:11:46.875850+0000","last_fullsized":"2024-03-30T13:11:46.875850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:06.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877217+0000","last_change":"2024-03-30T13:11:45.104166+0000","last_active":"2024-03-30T13:11:46.877217+0000","last_peered":"2024-03-30T13:11:46.877217+0000","last_clean":"2024-03-30T13:11:46.877217+0000","last_became_active":"2024-03-30T13:11:45.103571+0000","last_became_peered":"2024-03-30T13:11:45.103571+0000","last_unstale":"2024-03-30T13:11:46.877217+0000","last_undegraded":"2024-03-30T13:11:46.877217+0000","last_fullsized":"2024-03-30T13:11:46.877217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:01:25.461645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103495+0000","last_change":"2024-03-30T13:11:41.052693+0000","last_active":"2024-03-30T13:11:46.103495+0000","last_peered":"2024-03-30T13:11:46.103495+0000","last_clean":"2024-03-30T13:11:46.103495+0000","last_became_active":"2024-03-30T13:11:41.052258+0000","last_became_peered":"2024-03-30T13:11:41.052258+0000","last_unstale":"2024-03-30T13:11:46.103495+0000","last_undegraded":"2024-03-30T13:11:46.103495+0000","last_fullsized":"2024-03-30T13:11:46.103495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:44:44.472713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879516+0000","last_change":"2024-03-30T13:11:40.046274+0000","last_active":"2024-03-30T13:11:46.879516+0000","last_peered":"2024-03-30T13:11:46.879516+0000","last_clean":"2024-03-30T13:11:46.879516+0000","last_became_active":"2024-03-30T13:11:40.045844+0000","last_became_peered":"2024-03-30T13:11:40.045844+0000","last_unstale":"2024-03-30T13:11:46.879516+0000","last_undegraded":"2024-03-30T13:11:46.879516+0000","last_fullsized":"2024-03-30T13:11:46.879516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:45:28.760784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878179+0000","last_change":"2024-03-30T13:11:45.113899+0000","last_active":"2024-03-30T13:11:46.878179+0000","last_peered":"2024-03-30T13:11:46.878179+0000","last_clean":"2024-03-30T13:11:46.878179+0000","last_became_active":"2024-03-30T13:11:45.113423+0000","last_became_peered":"2024-03-30T13:11:45.113423+0000","last_unstale":"2024-03-30T13:11:46.878179+0000","last_undegraded":"2024-03-30T13:11:46.878179+0000","last_fullsized":"2024-03-30T13:11:46.878179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:25.484425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101335+0000","last_change":"2024-03-30T13:11:41.061174+0000","last_active":"2024-03-30T13:11:46.101335+0000","last_peered":"2024-03-30T13:11:46.101335+0000","last_clean":"2024-03-30T13:11:46.101335+0000","last_became_active":"2024-03-30T13:11:41.053574+0000","last_became_peered":"2024-03-30T13:11:41.053574+0000","last_unstale":"2024-03-30T13:11:46.101335+0000","last_undegraded":"2024-03-30T13:11:46.101335+0000","last_fullsized":"2024-03-30T13:11:46.101335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:07:32.828569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875924+0000","last_change":"2024-03-30T13:11:40.049492+0000","last_active":"2024-03-30T13:11:46.875924+0000","last_peered":"2024-03-30T13:11:46.875924+0000","last_clean":"2024-03-30T13:11:46.875924+0000","last_became_active":"2024-03-30T13:11:40.049222+0000","last_became_peered":"2024-03-30T13:11:40.049222+0000","last_unstale":"2024-03-30T13:11:46.875924+0000","last_undegraded":"2024-03-30T13:11:46.875924+0000","last_fullsized":"2024-03-30T13:11:46.875924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:01:57.621288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730403+0000","last_change":"2024-03-30T13:11:45.118519+0000","last_active":"2024-03-30T13:11:46.730403+0000","last_peered":"2024-03-30T13:11:46.730403+0000","last_clean":"2024-03-30T13:11:46.730403+0000","last_became_active":"2024-03-30T13:11:45.118028+0000","last_became_peered":"2024-03-30T13:11:45.118028+0000","last_unstale":"2024-03-30T13:11:46.730403+0000","last_undegraded":"2024-03-30T13:11:46.730403+0000","last_fullsized":"2024-03-30T13:11:46.730403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:02:40.515040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102577+0000","last_change":"2024-03-30T13:11:41.049512+0000","last_active":"2024-03-30T13:11:46.102577+0000","last_peered":"2024-03-30T13:11:46.102577+0000","last_clean":"2024-03-30T13:11:46.102577+0000","last_became_active":"2024-03-30T13:11:41.047719+0000","last_became_peered":"2024-03-30T13:11:41.047719+0000","last_unstale":"2024-03-30T13:11:46.102577+0000","last_undegraded":"2024-03-30T13:11:46.102577+0000","last_fullsized":"2024-03-30T13:11:46.102577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:59.232981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103016+0000","last_change":"2024-03-30T13:11:40.060417+0000","last_active":"2024-03-30T13:11:46.103016+0000","last_peered":"2024-03-30T13:11:46.103016+0000","last_clean":"2024-03-30T13:11:46.103016+0000","last_became_active":"2024-03-30T13:11:40.058616+0000","last_became_peered":"2024-03-30T13:11:40.058616+0000","last_unstale":"2024-03-30T13:11:46.103016+0000","last_undegraded":"2024-03-30T13:11:46.103016+0000","last_fullsized":"2024-03-30T13:11:46.103016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:37:31.772967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101575+0000","last_change":"2024-03-30T13:11:45.129654+0000","last_active":"2024-03-30T13:11:46.101575+0000","last_peered":"2024-03-30T13:11:46.101575+0000","last_clean":"2024-03-30T13:11:46.101575+0000","last_became_active":"2024-03-30T13:11:45.129190+0000","last_became_peered":"2024-03-30T13:11:45.129190+0000","last_unstale":"2024-03-30T13:11:46.101575+0000","last_undegraded":"2024-03-30T13:11:46.101575+0000","last_fullsized":"2024-03-30T13:11:46.101575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:23.412062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101634+0000","last_change":"2024-03-30T13:11:41.059626+0000","last_active":"2024-03-30T13:11:46.101634+0000","last_peered":"2024-03-30T13:11:46.101634+0000","last_clean":"2024-03-30T13:11:46.101634+0000","last_became_active":"2024-03-30T13:11:41.058446+0000","last_became_peered":"2024-03-30T13:11:41.058446+0000","last_unstale":"2024-03-30T13:11:46.101634+0000","last_undegraded":"2024-03-30T13:11:46.101634+0000","last_fullsized":"2024-03-30T13:11:46.101634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:58:43.692694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879362+0000","last_change":"2024-03-30T13:11:40.064935+0000","last_active":"2024-03-30T13:11:46.879362+0000","last_peered":"2024-03-30T13:11:46.879362+0000","last_clean":"2024-03-30T13:11:46.879362+0000","last_became_active":"2024-03-30T13:11:40.062970+0000","last_became_peered":"2024-03-30T13:11:40.062970+0000","last_unstale":"2024-03-30T13:11:46.879362+0000","last_undegraded":"2024-03-30T13:11:46.879362+0000","last_fullsized":"2024-03-30T13:11:46.879362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:06.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101509+0000","last_change":"2024-03-30T13:11:45.130017+0000","last_active":"2024-03-30T13:11:46.101509+0000","last_peered":"2024-03-30T13:11:46.101509+0000","last_clean":"2024-03-30T13:11:46.101509+0000","last_became_active":"2024-03-30T13:11:45.129637+0000","last_became_peered":"2024-03-30T13:11:45.129637+0000","last_unstale":"2024-03-30T13:11:46.101509+0000","last_undegraded":"2024-03-30T13:11:46.101509+0000","last_fullsized":"2024-03-30T13:11:46.101509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:08:11.231971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730113+0000","last_change":"2024-03-30T13:11:41.046195+0000","last_active":"2024-03-30T13:11:46.730113+0000","last_peered":"2024-03-30T13:11:46.730113+0000","last_clean":"2024-03-30T13:11:46.730113+0000","last_became_active":"2024-03-30T13:11:41.045855+0000","last_became_peered":"2024-03-30T13:11:41.045855+0000","last_unstale":"2024-03-30T13:11:46.730113+0000","last_undegraded":"2024-03-30T13:11:46.730113+0000","last_fullsized":"2024-03-30T13:11:46.730113+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:05:51.376531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730149+0000","last_change":"2024-03-30T13:11:40.055328+0000","last_active":"2024-03-30T13:11:46.730149+0000","last_peered":"2024-03-30T13:11:46.730149+0000","last_clean":"2024-03-30T13:11:46.730149+0000","last_became_active":"2024-03-30T13:11:40.054442+0000","last_became_peered":"2024-03-30T13:11:40.054442+0000","last_unstale":"2024-03-30T13:11:46.730149+0000","last_undegraded":"2024-03-30T13:11:46.730149+0000","last_fullsized":"2024-03-30T13:11:46.730149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:29:09.731487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881262+0000","last_change":"2024-03-30T13:11:45.111331+0000","last_active":"2024-03-30T13:11:46.881262+0000","last_peered":"2024-03-30T13:11:46.881262+0000","last_clean":"2024-03-30T13:11:46.881262+0000","last_became_active":"2024-03-30T13:11:45.110867+0000","last_became_peered":"2024-03-30T13:11:45.110867+0000","last_unstale":"2024-03-30T13:11:46.881262+0000","last_undegraded":"2024-03-30T13:11:46.881262+0000","last_fullsized":"2024-03-30T13:11:46.881262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:11:08.383284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101293+0000","last_change":"2024-03-30T13:11:41.050261+0000","last_active":"2024-03-30T13:11:46.101293+0000","last_peered":"2024-03-30T13:11:46.101293+0000","last_clean":"2024-03-30T13:11:46.101293+0000","last_became_active":"2024-03-30T13:11:41.049994+0000","last_became_peered":"2024-03-30T13:11:41.049994+0000","last_unstale":"2024-03-30T13:11:46.101293+0000","last_undegraded":"2024-03-30T13:11:46.101293+0000","last_fullsized":"2024-03-30T13:11:46.101293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:05:33.323351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:59.441353+0000","last_change":"2024-03-30T13:11:40.056699+0000","last_active":"2024-03-30T13:11:59.441353+0000","last_peered":"2024-03-30T13:11:59.441353+0000","last_clean":"2024-03-30T13:11:59.441353+0000","last_became_active":"2024-03-30T13:11:40.056278+0000","last_became_peered":"2024-03-30T13:11:40.056278+0000","last_unstale":"2024-03-30T13:11:59.441353+0000","last_undegraded":"2024-03-30T13:11:59.441353+0000","last_fullsized":"2024-03-30T13:11:59.441353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:22:06.762511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876228+0000","last_change":"2024-03-30T13:11:45.123273+0000","last_active":"2024-03-30T13:11:46.876228+0000","last_peered":"2024-03-30T13:11:46.876228+0000","last_clean":"2024-03-30T13:11:46.876228+0000","last_became_active":"2024-03-30T13:11:45.121491+0000","last_became_peered":"2024-03-30T13:11:45.121491+0000","last_unstale":"2024-03-30T13:11:46.876228+0000","last_undegraded":"2024-03-30T13:11:46.876228+0000","last_fullsized":"2024-03-30T13:11:46.876228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:33:31.019943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879397+0000","last_change":"2024-03-30T13:11:41.057070+0000","last_active":"2024-03-30T13:11:46.879397+0000","last_peered":"2024-03-30T13:11:46.879397+0000","last_clean":"2024-03-30T13:11:46.879397+0000","last_became_active":"2024-03-30T13:11:41.056836+0000","last_became_peered":"2024-03-30T13:11:41.056836+0000","last_unstale":"2024-03-30T13:11:46.879397+0000","last_undegraded":"2024-03-30T13:11:46.879397+0000","last_fullsized":"2024-03-30T13:11:46.879397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:28:09.366496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876480+0000","last_change":"2024-03-30T13:11:40.055926+0000","last_active":"2024-03-30T13:11:46.876480+0000","last_peered":"2024-03-30T13:11:46.876480+0000","last_clean":"2024-03-30T13:11:46.876480+0000","last_became_active":"2024-03-30T13:11:40.053853+0000","last_became_peered":"2024-03-30T13:11:40.053853+0000","last_unstale":"2024-03-30T13:11:46.876480+0000","last_undegraded":"2024-03-30T13:11:46.876480+0000","last_fullsized":"2024-03-30T13:11:46.876480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:12.149576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878894+0000","last_change":"2024-03-30T13:11:45.122152+0000","last_active":"2024-03-30T13:11:46.878894+0000","last_peered":"2024-03-30T13:11:46.878894+0000","last_clean":"2024-03-30T13:11:46.878894+0000","last_became_active":"2024-03-30T13:11:45.121264+0000","last_became_peered":"2024-03-30T13:11:45.121264+0000","last_unstale":"2024-03-30T13:11:46.878894+0000","last_undegraded":"2024-03-30T13:11:46.878894+0000","last_fullsized":"2024-03-30T13:11:46.878894+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:59:33.643606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730553+0000","last_change":"2024-03-30T13:11:41.068464+0000","last_active":"2024-03-30T13:11:46.730553+0000","last_peered":"2024-03-30T13:11:46.730553+0000","last_clean":"2024-03-30T13:11:46.730553+0000","last_became_active":"2024-03-30T13:11:41.068061+0000","last_became_peered":"2024-03-30T13:11:41.068061+0000","last_unstale":"2024-03-30T13:11:46.730553+0000","last_undegraded":"2024-03-30T13:11:46.730553+0000","last_fullsized":"2024-03-30T13:11:46.730553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:55.484149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881041+0000","last_change":"2024-03-30T13:11:40.062612+0000","last_active":"2024-03-30T13:11:46.881041+0000","last_peered":"2024-03-30T13:11:46.881041+0000","last_clean":"2024-03-30T13:11:46.881041+0000","last_became_active":"2024-03-30T13:11:40.061971+0000","last_became_peered":"2024-03-30T13:11:40.061971+0000","last_unstale":"2024-03-30T13:11:46.881041+0000","last_undegraded":"2024-03-30T13:11:46.881041+0000","last_fullsized":"2024-03-30T13:11:46.881041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:10:46.181474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099913+0000","last_change":"2024-03-30T13:11:45.114995+0000","last_active":"2024-03-30T13:11:46.099913+0000","last_peered":"2024-03-30T13:11:46.099913+0000","last_clean":"2024-03-30T13:11:46.099913+0000","last_became_active":"2024-03-30T13:11:45.114482+0000","last_became_peered":"2024-03-30T13:11:45.114482+0000","last_unstale":"2024-03-30T13:11:46.099913+0000","last_undegraded":"2024-03-30T13:11:46.099913+0000","last_fullsized":"2024-03-30T13:11:46.099913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:23:29.950161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880748+0000","last_change":"2024-03-30T13:11:41.042685+0000","last_active":"2024-03-30T13:11:46.880748+0000","last_peered":"2024-03-30T13:11:46.880748+0000","last_clean":"2024-03-30T13:11:46.880748+0000","last_became_active":"2024-03-30T13:11:41.042404+0000","last_became_peered":"2024-03-30T13:11:41.042404+0000","last_unstale":"2024-03-30T13:11:46.880748+0000","last_undegraded":"2024-03-30T13:11:46.880748+0000","last_fullsized":"2024-03-30T13:11:46.880748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:18:53.034802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105469+0000","last_change":"2024-03-30T13:11:40.052419+0000","last_active":"2024-03-30T13:11:46.105469+0000","last_peered":"2024-03-30T13:11:46.105469+0000","last_clean":"2024-03-30T13:11:46.105469+0000","last_became_active":"2024-03-30T13:11:40.052072+0000","last_became_peered":"2024-03-30T13:11:40.052072+0000","last_unstale":"2024-03-30T13:11:46.105469+0000","last_undegraded":"2024-03-30T13:11:46.105469+0000","last_fullsized":"2024-03-30T13:11:46.105469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:49:27.793465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099771+0000","last_change":"2024-03-30T13:11:45.125449+0000","last_active":"2024-03-30T13:11:46.099771+0000","last_peered":"2024-03-30T13:11:46.099771+0000","last_clean":"2024-03-30T13:11:46.099771+0000","last_became_active":"2024-03-30T13:11:45.115932+0000","last_became_peered":"2024-03-30T13:11:45.115932+0000","last_unstale":"2024-03-30T13:11:46.099771+0000","last_undegraded":"2024-03-30T13:11:46.099771+0000","last_fullsized":"2024-03-30T13:11:46.099771+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:20:14.235523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729971+0000","last_change":"2024-03-30T13:11:45.116967+0000","last_active":"2024-03-30T13:11:46.729971+0000","last_peered":"2024-03-30T13:11:46.729971+0000","last_clean":"2024-03-30T13:11:46.729971+0000","last_became_active":"2024-03-30T13:11:45.116228+0000","last_became_peered":"2024-03-30T13:11:45.116228+0000","last_unstale":"2024-03-30T13:11:46.729971+0000","last_undegraded":"2024-03-30T13:11:46.729971+0000","last_fullsized":"2024-03-30T13:11:46.729971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:32:28.206719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875605+0000","last_change":"2024-03-30T13:11:41.049464+0000","last_active":"2024-03-30T13:11:46.875605+0000","last_peered":"2024-03-30T13:11:46.875605+0000","last_clean":"2024-03-30T13:11:46.875605+0000","last_became_active":"2024-03-30T13:11:41.048486+0000","last_became_peered":"2024-03-30T13:11:41.048486+0000","last_unstale":"2024-03-30T13:11:46.875605+0000","last_undegraded":"2024-03-30T13:11:46.875605+0000","last_fullsized":"2024-03-30T13:11:46.875605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:55.484149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877383+0000","last_change":"2024-03-30T13:11:40.053490+0000","last_active":"2024-03-30T13:11:46.877383+0000","last_peered":"2024-03-30T13:11:46.877383+0000","last_clean":"2024-03-30T13:11:46.877383+0000","last_became_active":"2024-03-30T13:11:40.053256+0000","last_became_peered":"2024-03-30T13:11:40.053256+0000","last_unstale":"2024-03-30T13:11:46.877383+0000","last_undegraded":"2024-03-30T13:11:46.877383+0000","last_fullsized":"2024-03-30T13:11:46.877383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:27.119414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.105172+0000","last_change":"2024-03-30T13:11:45.108563+0000","last_active":"2024-03-30T13:11:46.105172+0000","last_peered":"2024-03-30T13:11:46.105172+0000","last_clean":"2024-03-30T13:11:46.105172+0000","last_became_active":"2024-03-30T13:11:45.108155+0000","last_became_peered":"2024-03-30T13:11:45.108155+0000","last_unstale":"2024-03-30T13:11:46.105172+0000","last_undegraded":"2024-03-30T13:11:46.105172+0000","last_fullsized":"2024-03-30T13:11:46.105172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:26:01.282080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100080+0000","last_change":"2024-03-30T13:11:41.067378+0000","last_active":"2024-03-30T13:11:46.100080+0000","last_peered":"2024-03-30T13:11:46.100080+0000","last_clean":"2024-03-30T13:11:46.100080+0000","last_became_active":"2024-03-30T13:11:41.067068+0000","last_became_peered":"2024-03-30T13:11:41.067068+0000","last_unstale":"2024-03-30T13:11:46.100080+0000","last_undegraded":"2024-03-30T13:11:46.100080+0000","last_fullsized":"2024-03-30T13:11:46.100080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:03:42.594649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100702+0000","last_change":"2024-03-30T13:11:40.057479+0000","last_active":"2024-03-30T13:11:46.100702+0000","last_peered":"2024-03-30T13:11:46.100702+0000","last_clean":"2024-03-30T13:11:46.100702+0000","last_became_active":"2024-03-30T13:11:40.057191+0000","last_became_peered":"2024-03-30T13:11:40.057191+0000","last_unstale":"2024-03-30T13:11:46.100702+0000","last_undegraded":"2024-03-30T13:11:46.100702+0000","last_fullsized":"2024-03-30T13:11:46.100702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:40:48.482839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.104472+0000","last_change":"2024-03-30T13:11:40.059886+0000","last_active":"2024-03-30T13:11:46.104472+0000","last_peered":"2024-03-30T13:11:46.104472+0000","last_clean":"2024-03-30T13:11:46.104472+0000","last_became_active":"2024-03-30T13:11:40.058788+0000","last_became_peered":"2024-03-30T13:11:40.058788+0000","last_unstale":"2024-03-30T13:11:46.104472+0000","last_undegraded":"2024-03-30T13:11:46.104472+0000","last_fullsized":"2024-03-30T13:11:46.104472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:50:27.119414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730038+0000","last_change":"2024-03-30T13:11:41.061750+0000","last_active":"2024-03-30T13:11:46.730038+0000","last_peered":"2024-03-30T13:11:46.730038+0000","last_clean":"2024-03-30T13:11:46.730038+0000","last_became_active":"2024-03-30T13:11:41.061360+0000","last_became_peered":"2024-03-30T13:11:41.061360+0000","last_unstale":"2024-03-30T13:11:46.730038+0000","last_undegraded":"2024-03-30T13:11:46.730038+0000","last_fullsized":"2024-03-30T13:11:46.730038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:42:07.042799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875906+0000","last_change":"2024-03-30T13:11:45.121807+0000","last_active":"2024-03-30T13:11:46.875906+0000","last_peered":"2024-03-30T13:11:46.875906+0000","last_clean":"2024-03-30T13:11:46.875906+0000","last_became_active":"2024-03-30T13:11:45.121296+0000","last_became_peered":"2024-03-30T13:11:45.121296+0000","last_unstale":"2024-03-30T13:11:46.875906+0000","last_undegraded":"2024-03-30T13:11:46.875906+0000","last_fullsized":"2024-03-30T13:11:46.875906+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:47.934200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101407+0000","last_change":"2024-03-30T13:11:40.061323+0000","last_active":"2024-03-30T13:11:46.101407+0000","last_peered":"2024-03-30T13:11:46.101407+0000","last_clean":"2024-03-30T13:11:46.101407+0000","last_became_active":"2024-03-30T13:11:40.059857+0000","last_became_peered":"2024-03-30T13:11:40.059857+0000","last_unstale":"2024-03-30T13:11:46.101407+0000","last_undegraded":"2024-03-30T13:11:46.101407+0000","last_fullsized":"2024-03-30T13:11:46.101407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:38.987742+0000","last_clean_scrub_stamp":"2024-03-30T13:11:38.987742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:57:50.563331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878627+0000","last_change":"2024-03-30T13:11:41.059805+0000","last_active":"2024-03-30T13:11:46.878627+0000","last_peered":"2024-03-30T13:11:46.878627+0000","last_clean":"2024-03-30T13:11:46.878627+0000","last_became_active":"2024-03-30T13:11:41.058849+0000","last_became_peered":"2024-03-30T13:11:41.058849+0000","last_unstale":"2024-03-30T13:11:46.878627+0000","last_undegraded":"2024-03-30T13:11:46.878627+0000","last_fullsized":"2024-03-30T13:11:46.878627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:13.163926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102772+0000","last_change":"2024-03-30T13:11:45.130314+0000","last_active":"2024-03-30T13:11:46.102772+0000","last_peered":"2024-03-30T13:11:46.102772+0000","last_clean":"2024-03-30T13:11:46.102772+0000","last_became_active":"2024-03-30T13:11:45.129546+0000","last_became_peered":"2024-03-30T13:11:45.129546+0000","last_unstale":"2024-03-30T13:11:46.102772+0000","last_undegraded":"2024-03-30T13:11:46.102772+0000","last_fullsized":"2024-03-30T13:11:46.102772+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:44.053669+0000","last_clean_scrub_stamp":"2024-03-30T13:11:44.053669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:59.314585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102194+0000","last_change":"2024-03-30T13:11:41.057474+0000","last_active":"2024-03-30T13:11:46.102194+0000","last_peered":"2024-03-30T13:11:46.102194+0000","last_clean":"2024-03-30T13:11:46.102194+0000","last_became_active":"2024-03-30T13:11:41.057248+0000","last_became_peered":"2024-03-30T13:11:41.057248+0000","last_unstale":"2024-03-30T13:11:46.102194+0000","last_undegraded":"2024-03-30T13:11:46.102194+0000","last_fullsized":"2024-03-30T13:11:46.102194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:19:21.066570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876002+0000","last_change":"2024-03-30T13:11:41.044974+0000","last_active":"2024-03-30T13:11:46.876002+0000","last_peered":"2024-03-30T13:11:46.876002+0000","last_clean":"2024-03-30T13:11:46.876002+0000","last_became_active":"2024-03-30T13:11:41.044110+0000","last_became_peered":"2024-03-30T13:11:41.044110+0000","last_unstale":"2024-03-30T13:11:46.876002+0000","last_undegraded":"2024-03-30T13:11:46.876002+0000","last_fullsized":"2024-03-30T13:11:46.876002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:21:49.757992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880445+0000","last_change":"2024-03-30T13:11:41.051210+0000","last_active":"2024-03-30T13:11:46.880445+0000","last_peered":"2024-03-30T13:11:46.880445+0000","last_clean":"2024-03-30T13:11:46.880445+0000","last_became_active":"2024-03-30T13:11:41.050902+0000","last_became_peered":"2024-03-30T13:11:41.050902+0000","last_unstale":"2024-03-30T13:11:46.880445+0000","last_undegraded":"2024-03-30T13:11:46.880445+0000","last_fullsized":"2024-03-30T13:11:46.880445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:44:44.472713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730069+0000","last_change":"2024-03-30T13:11:41.056828+0000","last_active":"2024-03-30T13:11:46.730069+0000","last_peered":"2024-03-30T13:11:46.730069+0000","last_clean":"2024-03-30T13:11:46.730069+0000","last_became_active":"2024-03-30T13:11:41.055447+0000","last_became_peered":"2024-03-30T13:11:41.055447+0000","last_unstale":"2024-03-30T13:11:46.730069+0000","last_undegraded":"2024-03-30T13:11:46.730069+0000","last_fullsized":"2024-03-30T13:11:46.730069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:29.578558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101808+0000","last_change":"2024-03-30T13:11:41.062703+0000","last_active":"2024-03-30T13:11:46.101808+0000","last_peered":"2024-03-30T13:11:46.101808+0000","last_clean":"2024-03-30T13:11:46.101808+0000","last_became_active":"2024-03-30T13:11:41.062375+0000","last_became_peered":"2024-03-30T13:11:41.062375+0000","last_unstale":"2024-03-30T13:11:46.101808+0000","last_undegraded":"2024-03-30T13:11:46.101808+0000","last_fullsized":"2024-03-30T13:11:46.101808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:59:29.592029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876328+0000","last_change":"2024-03-30T13:11:41.047959+0000","last_active":"2024-03-30T13:11:46.876328+0000","last_peered":"2024-03-30T13:11:46.876328+0000","last_clean":"2024-03-30T13:11:46.876328+0000","last_became_active":"2024-03-30T13:11:41.047563+0000","last_became_peered":"2024-03-30T13:11:41.047563+0000","last_unstale":"2024-03-30T13:11:46.876328+0000","last_undegraded":"2024-03-30T13:11:46.876328+0000","last_fullsized":"2024-03-30T13:11:46.876328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:05:51.376531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.107604+0000","last_change":"2024-03-30T13:11:41.051909+0000","last_active":"2024-03-30T13:11:46.107604+0000","last_peered":"2024-03-30T13:11:46.107604+0000","last_clean":"2024-03-30T13:11:46.107604+0000","last_became_active":"2024-03-30T13:11:41.049935+0000","last_became_peered":"2024-03-30T13:11:41.049935+0000","last_unstale":"2024-03-30T13:11:46.107604+0000","last_undegraded":"2024-03-30T13:11:46.107604+0000","last_fullsized":"2024-03-30T13:11:46.107604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:08:02.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101288+0000","last_change":"2024-03-30T13:11:41.067163+0000","last_active":"2024-03-30T13:11:46.101288+0000","last_peered":"2024-03-30T13:11:46.101288+0000","last_clean":"2024-03-30T13:11:46.101288+0000","last_became_active":"2024-03-30T13:11:41.066912+0000","last_became_peered":"2024-03-30T13:11:41.066912+0000","last_unstale":"2024-03-30T13:11:46.101288+0000","last_undegraded":"2024-03-30T13:11:46.101288+0000","last_fullsized":"2024-03-30T13:11:46.101288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:42:07.042799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877312+0000","last_change":"2024-03-30T13:11:41.047542+0000","last_active":"2024-03-30T13:11:46.877312+0000","last_peered":"2024-03-30T13:11:46.877312+0000","last_clean":"2024-03-30T13:11:46.877312+0000","last_became_active":"2024-03-30T13:11:41.046947+0000","last_became_peered":"2024-03-30T13:11:41.046947+0000","last_unstale":"2024-03-30T13:11:46.877312+0000","last_undegraded":"2024-03-30T13:11:46.877312+0000","last_fullsized":"2024-03-30T13:11:46.877312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:19.146268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.100367+0000","last_change":"2024-03-30T13:11:41.068416+0000","last_active":"2024-03-30T13:11:46.100367+0000","last_peered":"2024-03-30T13:11:46.100367+0000","last_clean":"2024-03-30T13:11:46.100367+0000","last_became_active":"2024-03-30T13:11:41.067651+0000","last_became_peered":"2024-03-30T13:11:41.067651+0000","last_unstale":"2024-03-30T13:11:46.100367+0000","last_undegraded":"2024-03-30T13:11:46.100367+0000","last_fullsized":"2024-03-30T13:11:46.100367+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:07.157771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878282+0000","last_change":"2024-03-30T13:11:41.037581+0000","last_active":"2024-03-30T13:11:46.878282+0000","last_peered":"2024-03-30T13:11:46.878282+0000","last_clean":"2024-03-30T13:11:46.878282+0000","last_became_active":"2024-03-30T13:11:41.037266+0000","last_became_peered":"2024-03-30T13:11:41.037266+0000","last_unstale":"2024-03-30T13:11:46.878282+0000","last_undegraded":"2024-03-30T13:11:46.878282+0000","last_fullsized":"2024-03-30T13:11:46.878282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:34.039026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729580+0000","last_change":"2024-03-30T13:11:41.053939+0000","last_active":"2024-03-30T13:11:46.729580+0000","last_peered":"2024-03-30T13:11:46.729580+0000","last_clean":"2024-03-30T13:11:46.729580+0000","last_became_active":"2024-03-30T13:11:41.053762+0000","last_became_peered":"2024-03-30T13:11:41.053762+0000","last_unstale":"2024-03-30T13:11:46.729580+0000","last_undegraded":"2024-03-30T13:11:46.729580+0000","last_fullsized":"2024-03-30T13:11:46.729580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:58:21.432848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.104253+0000","last_change":"2024-03-30T13:11:41.053322+0000","last_active":"2024-03-30T13:11:46.104253+0000","last_peered":"2024-03-30T13:11:46.104253+0000","last_clean":"2024-03-30T13:11:46.104253+0000","last_became_active":"2024-03-30T13:11:41.053016+0000","last_became_peered":"2024-03-30T13:11:41.053016+0000","last_unstale":"2024-03-30T13:11:46.104253+0000","last_undegraded":"2024-03-30T13:11:46.104253+0000","last_fullsized":"2024-03-30T13:11:46.104253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:42:40.947191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102031+0000","last_change":"2024-03-30T13:11:41.048361+0000","last_active":"2024-03-30T13:11:46.102031+0000","last_peered":"2024-03-30T13:11:46.102031+0000","last_clean":"2024-03-30T13:11:46.102031+0000","last_became_active":"2024-03-30T13:11:41.048095+0000","last_became_peered":"2024-03-30T13:11:41.048095+0000","last_unstale":"2024-03-30T13:11:46.102031+0000","last_undegraded":"2024-03-30T13:11:46.102031+0000","last_fullsized":"2024-03-30T13:11:46.102031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:46:04.352790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875772+0000","last_change":"2024-03-30T13:11:41.038135+0000","last_active":"2024-03-30T13:11:46.875772+0000","last_peered":"2024-03-30T13:11:46.875772+0000","last_clean":"2024-03-30T13:11:46.875772+0000","last_became_active":"2024-03-30T13:11:41.036822+0000","last_became_peered":"2024-03-30T13:11:41.036822+0000","last_unstale":"2024-03-30T13:11:46.875772+0000","last_undegraded":"2024-03-30T13:11:46.875772+0000","last_fullsized":"2024-03-30T13:11:46.875772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:36:52.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.881424+0000","last_change":"2024-03-30T13:11:41.048493+0000","last_active":"2024-03-30T13:11:46.881424+0000","last_peered":"2024-03-30T13:11:46.881424+0000","last_clean":"2024-03-30T13:11:46.881424+0000","last_became_active":"2024-03-30T13:11:41.047123+0000","last_became_peered":"2024-03-30T13:11:41.047123+0000","last_unstale":"2024-03-30T13:11:46.881424+0000","last_undegraded":"2024-03-30T13:11:46.881424+0000","last_fullsized":"2024-03-30T13:11:46.881424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:46:04.352790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.877192+0000","last_change":"2024-03-30T13:11:41.047289+0000","last_active":"2024-03-30T13:11:46.877192+0000","last_peered":"2024-03-30T13:11:46.877192+0000","last_clean":"2024-03-30T13:11:46.877192+0000","last_became_active":"2024-03-30T13:11:41.046589+0000","last_became_peered":"2024-03-30T13:11:41.046589+0000","last_unstale":"2024-03-30T13:11:46.877192+0000","last_undegraded":"2024-03-30T13:11:46.877192+0000","last_fullsized":"2024-03-30T13:11:46.877192+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:08:02.501262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.875723+0000","last_change":"2024-03-30T13:11:41.052085+0000","last_active":"2024-03-30T13:11:46.875723+0000","last_peered":"2024-03-30T13:11:46.875723+0000","last_clean":"2024-03-30T13:11:46.875723+0000","last_became_active":"2024-03-30T13:11:41.051800+0000","last_became_peered":"2024-03-30T13:11:41.051800+0000","last_unstale":"2024-03-30T13:11:46.875723+0000","last_undegraded":"2024-03-30T13:11:46.875723+0000","last_fullsized":"2024-03-30T13:11:46.875723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:51:07.157771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.730017+0000","last_change":"2024-03-30T13:11:41.052282+0000","last_active":"2024-03-30T13:11:46.730017+0000","last_peered":"2024-03-30T13:11:46.730017+0000","last_clean":"2024-03-30T13:11:46.730017+0000","last_became_active":"2024-03-30T13:11:41.052009+0000","last_became_peered":"2024-03-30T13:11:41.052009+0000","last_unstale":"2024-03-30T13:11:46.730017+0000","last_undegraded":"2024-03-30T13:11:46.730017+0000","last_fullsized":"2024-03-30T13:11:46.730017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:14:06.832559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.102678+0000","last_change":"2024-03-30T13:11:41.050105+0000","last_active":"2024-03-30T13:11:46.102678+0000","last_peered":"2024-03-30T13:11:46.102678+0000","last_clean":"2024-03-30T13:11:46.102678+0000","last_became_active":"2024-03-30T13:11:41.048387+0000","last_became_peered":"2024-03-30T13:11:41.048387+0000","last_unstale":"2024-03-30T13:11:46.102678+0000","last_undegraded":"2024-03-30T13:11:46.102678+0000","last_fullsized":"2024-03-30T13:11:46.102678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:39:55.484149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.879166+0000","last_change":"2024-03-30T13:11:41.055816+0000","last_active":"2024-03-30T13:11:46.879166+0000","last_peered":"2024-03-30T13:11:46.879166+0000","last_clean":"2024-03-30T13:11:46.879166+0000","last_became_active":"2024-03-30T13:11:41.051061+0000","last_became_peered":"2024-03-30T13:11:41.051061+0000","last_unstale":"2024-03-30T13:11:46.879166+0000","last_undegraded":"2024-03-30T13:11:46.879166+0000","last_fullsized":"2024-03-30T13:11:46.879166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:04:49.178652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.106145+0000","last_change":"2024-03-30T13:11:41.061725+0000","last_active":"2024-03-30T13:11:46.106145+0000","last_peered":"2024-03-30T13:11:46.106145+0000","last_clean":"2024-03-30T13:11:46.106145+0000","last_became_active":"2024-03-30T13:11:41.061432+0000","last_became_peered":"2024-03-30T13:11:41.061432+0000","last_unstale":"2024-03-30T13:11:46.106145+0000","last_undegraded":"2024-03-30T13:11:46.106145+0000","last_fullsized":"2024-03-30T13:11:46.106145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:13:46.043702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.107474+0000","last_change":"2024-03-30T13:11:41.060125+0000","last_active":"2024-03-30T13:11:46.107474+0000","last_peered":"2024-03-30T13:11:46.107474+0000","last_clean":"2024-03-30T13:11:46.107474+0000","last_became_active":"2024-03-30T13:11:41.059839+0000","last_became_peered":"2024-03-30T13:11:41.059839+0000","last_unstale":"2024-03-30T13:11:46.107474+0000","last_undegraded":"2024-03-30T13:11:46.107474+0000","last_fullsized":"2024-03-30T13:11:46.107474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:45:19.146268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103554+0000","last_change":"2024-03-30T13:11:41.066403+0000","last_active":"2024-03-30T13:11:46.103554+0000","last_peered":"2024-03-30T13:11:46.103554+0000","last_clean":"2024-03-30T13:11:46.103554+0000","last_became_active":"2024-03-30T13:11:41.066148+0000","last_became_peered":"2024-03-30T13:11:41.066148+0000","last_unstale":"2024-03-30T13:11:46.103554+0000","last_undegraded":"2024-03-30T13:11:46.103554+0000","last_fullsized":"2024-03-30T13:11:46.103554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:23:32.604365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.099258+0000","last_change":"2024-03-30T13:11:41.072872+0000","last_active":"2024-03-30T13:11:46.099258+0000","last_peered":"2024-03-30T13:11:46.099258+0000","last_clean":"2024-03-30T13:11:46.099258+0000","last_became_active":"2024-03-30T13:11:41.066749+0000","last_became_peered":"2024-03-30T13:11:41.066749+0000","last_unstale":"2024-03-30T13:11:46.099258+0000","last_undegraded":"2024-03-30T13:11:46.099258+0000","last_fullsized":"2024-03-30T13:11:46.099258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:14:06.832559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101194+0000","last_change":"2024-03-30T13:11:41.051881+0000","last_active":"2024-03-30T13:11:46.101194+0000","last_peered":"2024-03-30T13:11:46.101194+0000","last_clean":"2024-03-30T13:11:46.101194+0000","last_became_active":"2024-03-30T13:11:41.051569+0000","last_became_peered":"2024-03-30T13:11:41.051569+0000","last_unstale":"2024-03-30T13:11:46.101194+0000","last_undegraded":"2024-03-30T13:11:46.101194+0000","last_fullsized":"2024-03-30T13:11:46.101194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:48:13.158195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.878052+0000","last_change":"2024-03-30T13:11:41.052969+0000","last_active":"2024-03-30T13:11:46.878052+0000","last_peered":"2024-03-30T13:11:46.878052+0000","last_clean":"2024-03-30T13:11:46.878052+0000","last_became_active":"2024-03-30T13:11:41.052626+0000","last_became_peered":"2024-03-30T13:11:41.052626+0000","last_unstale":"2024-03-30T13:11:46.878052+0000","last_undegraded":"2024-03-30T13:11:46.878052+0000","last_fullsized":"2024-03-30T13:11:46.878052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:09:12.520741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.101308+0000","last_change":"2024-03-30T13:11:41.044957+0000","last_active":"2024-03-30T13:11:46.101308+0000","last_peered":"2024-03-30T13:11:46.101308+0000","last_clean":"2024-03-30T13:11:46.101308+0000","last_became_active":"2024-03-30T13:11:41.044658+0000","last_became_peered":"2024-03-30T13:11:41.044658+0000","last_unstale":"2024-03-30T13:11:46.101308+0000","last_undegraded":"2024-03-30T13:11:46.101308+0000","last_fullsized":"2024-03-30T13:11:46.101308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:18:53.034802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.880588+0000","last_change":"2024-03-30T13:11:41.056707+0000","last_active":"2024-03-30T13:11:46.880588+0000","last_peered":"2024-03-30T13:11:46.880588+0000","last_clean":"2024-03-30T13:11:46.880588+0000","last_became_active":"2024-03-30T13:11:41.055440+0000","last_became_peered":"2024-03-30T13:11:41.055440+0000","last_unstale":"2024-03-30T13:11:46.880588+0000","last_undegraded":"2024-03-30T13:11:46.880588+0000","last_fullsized":"2024-03-30T13:11:46.880588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:07:32.828569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.729706+0000","last_change":"2024-03-30T13:11:41.046907+0000","last_active":"2024-03-30T13:11:46.729706+0000","last_peered":"2024-03-30T13:11:46.729706+0000","last_clean":"2024-03-30T13:11:46.729706+0000","last_became_active":"2024-03-30T13:11:41.046092+0000","last_became_peered":"2024-03-30T13:11:41.046092+0000","last_unstale":"2024-03-30T13:11:46.729706+0000","last_undegraded":"2024-03-30T13:11:46.729706+0000","last_fullsized":"2024-03-30T13:11:46.729706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:04:23.461918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.876628+0000","last_change":"2024-03-30T13:11:41.043762+0000","last_active":"2024-03-30T13:11:46.876628+0000","last_peered":"2024-03-30T13:11:46.876628+0000","last_clean":"2024-03-30T13:11:46.876628+0000","last_became_active":"2024-03-30T13:11:41.043468+0000","last_became_peered":"2024-03-30T13:11:41.043468+0000","last_unstale":"2024-03-30T13:11:46.876628+0000","last_undegraded":"2024-03-30T13:11:46.876628+0000","last_fullsized":"2024-03-30T13:11:46.876628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:00:29.578558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-03-30T13:11:46.103044+0000","last_change":"2024-03-30T13:11:41.051937+0000","last_active":"2024-03-30T13:11:46.103044+0000","last_peered":"2024-03-30T13:11:46.103044+0000","last_clean":"2024-03-30T13:11:46.103044+0000","last_became_active":"2024-03-30T13:11:41.051536+0000","last_became_peered":"2024-03-30T13:11:41.051536+0000","last_unstale":"2024-03-30T13:11:46.103044+0000","last_undegraded":"2024-03-30T13:11:46.103044+0000","last_fullsized":"2024-03-30T13:11:46.103044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:40.002092+0000","last_clean_scrub_stamp":"2024-03-30T13:11:40.002092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:49:02.326260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":701669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":110809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":110845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":110879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":701725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:12:16.108 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-30T13:12:16.108 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-30T13:12:16.108 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-30T13:12:16.108 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-30T13:12:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.364+0000 7f0f2ec00640 1 Processor -- start 2024-03-30T13:12:16.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.365+0000 7f0f2ec00640 1 -- start start 2024-03-30T13:12:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.367+0000 7f0f2ec00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f281562f0 0x7f0f281566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.367+0000 7f0f2ec00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f28142300 0x7f0f280d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.367+0000 7f0f2ec00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0f280d07d0 0x7f0f2815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.367+0000 7f0f2ec00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0f28156c10 con 0x7f0f281562f0 2024-03-30T13:12:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.367+0000 7f0f2ec00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f0f280d0c40 con 0x7f0f280d07d0 2024-03-30T13:12:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.367+0000 7f0f2ec00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0f28160c20 con 0x7f0f28142300 2024-03-30T13:12:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.367+0000 7f0f2d800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f281562f0 0x7f0f281566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.367+0000 7f0f2d800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f281562f0 0x7f0f281566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39550/0 (socket says 172.21.15.44:39550) 2024-03-30T13:12:16.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.367+0000 7f0f2d800640 1 -- 172.21.15.44:0/1506944584 learned_addr learned my addr 172.21.15.44:0/1506944584 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:16.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.367+0000 7f0f2e200640 1 --2- 172.21.15.44:0/1506944584 >> v2:172.21.15.151:3300/0 conn(0x7f0f280d07d0 0x7f0f2815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.368+0000 7f0f2ce00640 1 --2- 172.21.15.44:0/1506944584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f28142300 0x7f0f280d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.368+0000 7f0f2d800640 1 -- 172.21.15.44:0/1506944584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f28142300 msgr2=0x7f0f280d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:16.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.368+0000 7f0f2d800640 1 --2- 172.21.15.44:0/1506944584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f28142300 0x7f0f280d0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.368+0000 7f0f2d800640 1 -- 172.21.15.44:0/1506944584 >> v2:172.21.15.151:3300/0 conn(0x7f0f280d07d0 msgr2=0x7f0f2815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:16.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.368+0000 7f0f2d800640 1 --2- 172.21.15.44:0/1506944584 >> v2:172.21.15.151:3300/0 conn(0x7f0f280d07d0 0x7f0f2815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.368+0000 7f0f2d800640 1 -- 172.21.15.44:0/1506944584 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f281427b0 con 0x7f0f281562f0 2024-03-30T13:12:16.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.368+0000 7f0f2e200640 1 --2- 172.21.15.44:0/1506944584 >> v2:172.21.15.151:3300/0 conn(0x7f0f280d07d0 0x7f0f2815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:16.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.369+0000 7f0f2d800640 1 --2- 172.21.15.44:0/1506944584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f281562f0 0x7f0f281566d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f2806eae0 tx=0x7f0f1c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46711d353ea5df2c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.369+0000 7f0f27e00640 1 -- 172.21.15.44:0/1506944584 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c02ca80 con 0x7f0f281562f0 2024-03-30T13:12:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.369+0000 7f0f27e00640 1 -- 172.21.15.44:0/1506944584 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1c02cc20 con 0x7f0f281562f0 2024-03-30T13:12:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.369+0000 7f0f27e00640 1 -- 172.21.15.44:0/1506944584 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c0343f0 con 0x7f0f281562f0 2024-03-30T13:12:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.370+0000 7f0f2ec00640 1 -- 172.21.15.44:0/1506944584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f281562f0 msgr2=0x7f0f281566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.370+0000 7f0f2ec00640 1 --2- 172.21.15.44:0/1506944584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f281562f0 0x7f0f281566d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0f2806eae0 tx=0x7f0f1c02bee0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.370+0000 7f0f2ec00640 1 -- 172.21.15.44:0/1506944584 shutdown_connections 2024-03-30T13:12:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.370+0000 7f0f2ec00640 1 --2- 172.21.15.44:0/1506944584 >> v2:172.21.15.151:3300/0 conn(0x7f0f280d07d0 0x7f0f2815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.370+0000 7f0f2ec00640 1 --2- 172.21.15.44:0/1506944584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f28142300 0x7f0f280d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.370+0000 7f0f2ec00640 1 --2- 172.21.15.44:0/1506944584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f281562f0 0x7f0f281566d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.370+0000 7f0f2ec00640 1 -- 172.21.15.44:0/1506944584 >> 172.21.15.44:0/1506944584 conn(0x7f0f2806b9a0 msgr2=0x7f0f2806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.370+0000 7f0f2ec00640 1 -- 172.21.15.44:0/1506944584 shutdown_connections 2024-03-30T13:12:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.370+0000 7f0f2ec00640 1 -- 172.21.15.44:0/1506944584 wait complete. 2024-03-30T13:12:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.372+0000 7f0f2ec00640 1 Processor -- start 2024-03-30T13:12:16.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.372+0000 7f0f2ec00640 1 -- start start 2024-03-30T13:12:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ec00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f280d07d0 0x7f0f28140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ec00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f28142300 0x7f0f280b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ec00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f281562f0 0x7f0f2815c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ec00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f28160660 con 0x7f0f28142300 2024-03-30T13:12:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ec00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0f28160380 con 0x7f0f281562f0 2024-03-30T13:12:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ec00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0f28160940 con 0x7f0f280d07d0 2024-03-30T13:12:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f28142300 0x7f0f280b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f28142300 0x7f0f280b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39552/0 (socket says 172.21.15.44:39552) 2024-03-30T13:12:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ce00640 1 -- 172.21.15.44:0/2984461924 learned_addr learned my addr 172.21.15.44:0/2984461924 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2e200640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f281562f0 0x7f0f2815c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2d800640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f280d07d0 0x7f0f28140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ce00640 1 -- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f280d07d0 msgr2=0x7f0f28140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ce00640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f280d07d0 0x7f0f28140ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ce00640 1 -- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f281562f0 msgr2=0x7f0f2815c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ce00640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f281562f0 0x7f0f2815c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2ce00640 1 -- 172.21.15.44:0/2984461924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f281e7980 con 0x7f0f28142300 2024-03-30T13:12:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.373+0000 7f0f2e200640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f281562f0 0x7f0f2815c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:16.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.374+0000 7f0f2ce00640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f28142300 0x7f0f280b1530 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400c7f0 tx=0x7f0f1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.374+0000 7f0f25600640 1 -- 172.21.15.44:0/2984461924 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f14015070 con 0x7f0f28142300 2024-03-30T13:12:16.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.374+0000 7f0f25600640 1 -- 172.21.15.44:0/2984461924 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f14004240 con 0x7f0f28142300 2024-03-30T13:12:16.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.374+0000 7f0f25600640 1 -- 172.21.15.44:0/2984461924 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f14007620 con 0x7f0f28142300 2024-03-30T13:12:16.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.374+0000 7f0f2ec00640 1 -- 172.21.15.44:0/2984461924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f280b0770 con 0x7f0f28142300 2024-03-30T13:12:16.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.374+0000 7f0f2ec00640 1 -- 172.21.15.44:0/2984461924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f280b1010 con 0x7f0f28142300 2024-03-30T13:12:16.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.375+0000 7f0f2ec00640 1 -- 172.21.15.44:0/2984461924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f280b0940 con 0x7f0f28142300 2024-03-30T13:12:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.376+0000 7f0f25600640 1 -- 172.21.15.44:0/2984461924 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0f140079d0 con 0x7f0f28142300 2024-03-30T13:12:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.377+0000 7f0f25600640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f0806c530 0x7f0f0806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.377+0000 7f0f25600640 1 -- 172.21.15.44:0/2984461924 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0f1408be10 con 0x7f0f28142300 2024-03-30T13:12:16.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.378+0000 7f0f2d800640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f0806c530 0x7f0f0806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.379+0000 7f0f2d800640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f0806c530 0x7f0f0806e9f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c035000 tx=0x7f0f1c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.381+0000 7f0f25600640 1 -- 172.21.15.44:0/2984461924 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0f1408f030 con 0x7f0f28142300 2024-03-30T13:12:16.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.623+0000 7f0f2ec00640 1 -- 172.21.15.44:0/2984461924 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0f280cc6e0 con 0x7f0f28142300 2024-03-30T13:12:16.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.624+0000 7f0f25600640 1 -- 172.21.15.44:0/2984461924 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0f280cc6e0 con 0x7f0f28142300 2024-03-30T13:12:16.629 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:16.629 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-30T13:12:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.627+0000 7f0f2ec00640 1 -- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f0806c530 msgr2=0x7f0f0806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.627+0000 7f0f2ec00640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f0806c530 0x7f0f0806e9f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c035000 tx=0x7f0f1c030000 comp rx=0 tx=0).stop 2024-03-30T13:12:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.627+0000 7f0f2ec00640 1 -- 172.21.15.44:0/2984461924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f28142300 msgr2=0x7f0f280b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.627+0000 7f0f2ec00640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f28142300 0x7f0f280b1530 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0f1400c7f0 tx=0x7f0f1400ccb0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.627+0000 7f0f2ec00640 1 -- 172.21.15.44:0/2984461924 shutdown_connections 2024-03-30T13:12:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.627+0000 7f0f2ec00640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f0806c530 0x7f0f0806e9f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.627+0000 7f0f2ec00640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f281562f0 0x7f0f2815c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.627+0000 7f0f2ec00640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f28142300 0x7f0f280b1530 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.627+0000 7f0f2ec00640 1 --2- 172.21.15.44:0/2984461924 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f280d07d0 0x7f0f28140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.627+0000 7f0f2ec00640 1 -- 172.21.15.44:0/2984461924 >> 172.21.15.44:0/2984461924 conn(0x7f0f2806b9a0 msgr2=0x7f0f280ce7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:16.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.627+0000 7f0f2ec00640 1 -- 172.21.15.44:0/2984461924 shutdown_connections 2024-03-30T13:12:16.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.627+0000 7f0f2ec00640 1 -- 172.21.15.44:0/2984461924 wait complete. 2024-03-30T13:12:16.650 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-30T13:12:16.650 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.862+0000 7f4005a00640 1 Processor -- start 2024-03-30T13:12:16.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.862+0000 7f4005a00640 1 -- start start 2024-03-30T13:12:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.864+0000 7f4005a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f40000d09a0 0x7f40001566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.864+0000 7f4005a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4000160c20 con 0x7f4000142300 2024-03-30T13:12:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.864+0000 7f4005a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40001427b0 con 0x7f40001562f0 2024-03-30T13:12:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.864+0000 7f4005a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4000156c10 con 0x7f40000d09a0 2024-03-30T13:12:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.864+0000 7f3fff400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f40000d09a0 0x7f40001566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.864+0000 7f4005000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4000142300 0x7f400015ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:56940/0 (socket says 172.21.15.44:56940) 2024-03-30T13:12:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.864+0000 7f4005000640 1 -- 172.21.15.44:0/687980670 learned_addr learned my addr 172.21.15.44:0/687980670 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:16.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.865+0000 7f3fff400640 1 -- 172.21.15.44:0/687980670 >> v1:172.21.15.151:6789/0 conn(0x7f40001562f0 legacy=0x7f40000d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:16.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.865+0000 7f3fff400640 1 -- 172.21.15.44:0/687980670 >> v1:172.21.15.44:6789/0 conn(0x7f4000142300 legacy=0x7f400015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.865+0000 7f3fff400640 1 -- 172.21.15.44:0/687980670 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40001600a0 con 0x7f40000d09a0 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.866+0000 7f3fff400640 1 --2- 172.21.15.44:0/687980670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40000d09a0 0x7f40001566d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80097a0 tx=0x7f3fe802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4386f2f3935620c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.866+0000 7f3ffea00640 1 -- 172.21.15.44:0/687980670 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe80315a0 con 0x7f40000d09a0 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.866+0000 7f3ffea00640 1 -- 172.21.15.44:0/687980670 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe8037070 con 0x7f40000d09a0 2024-03-30T13:12:16.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.866+0000 7f3ffea00640 1 -- 172.21.15.44:0/687980670 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8031960 con 0x7f40000d09a0 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.867+0000 7f4005a00640 1 -- 172.21.15.44:0/687980670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40000d09a0 msgr2=0x7f40001566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.867+0000 7f4005a00640 1 --2- 172.21.15.44:0/687980670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40000d09a0 0x7f40001566d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80097a0 tx=0x7f3fe802b840 comp rx=0 tx=0).stop 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.867+0000 7f4005a00640 1 -- 172.21.15.44:0/687980670 shutdown_connections 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.867+0000 7f4005a00640 1 --2- 172.21.15.44:0/687980670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40000d09a0 0x7f40001566d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.867+0000 7f4005a00640 1 -- 172.21.15.44:0/687980670 >> 172.21.15.44:0/687980670 conn(0x7f400006b9a0 msgr2=0x7f400006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.867+0000 7f4005a00640 1 -- 172.21.15.44:0/687980670 shutdown_connections 2024-03-30T13:12:16.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.867+0000 7f4005a00640 1 -- 172.21.15.44:0/687980670 wait complete. 2024-03-30T13:12:16.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.869+0000 7f4005a00640 1 Processor -- start 2024-03-30T13:12:16.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.869+0000 7f4005a00640 1 -- start start 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.871+0000 7f4005a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40000d09a0 0x7f4000146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.871+0000 7f4005a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4000142300 0x7f400015cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.871+0000 7f4005a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40001562f0 0x7f4000148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.871+0000 7f4005a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4000160940 con 0x7f40001562f0 2024-03-30T13:12:16.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.871+0000 7f4005a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4000160660 con 0x7f40000d09a0 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.871+0000 7f4005a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f40000cca20 con 0x7f4000142300 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.871+0000 7f4005000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40001562f0 0x7f4000148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.871+0000 7f4005000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40001562f0 0x7f4000148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39574/0 (socket says 172.21.15.44:39574) 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.871+0000 7f4005000640 1 -- 172.21.15.44:0/661627236 learned_addr learned my addr 172.21.15.44:0/661627236 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.871+0000 7f3fffe00640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40000d09a0 0x7f4000146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.871+0000 7f3fff400640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4000142300 0x7f400015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.872+0000 7f4005000640 1 -- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4000142300 msgr2=0x7f400015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.872+0000 7f4005000640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4000142300 0x7f400015cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.872+0000 7f4005000640 1 -- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40000d09a0 msgr2=0x7f4000146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.872+0000 7f4005000640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40000d09a0 0x7f4000146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.872+0000 7f4005000640 1 -- 172.21.15.44:0/661627236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400015f960 con 0x7f40001562f0 2024-03-30T13:12:16.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.872+0000 7f4005000640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40001562f0 0x7f4000148780 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800c3c0 tx=0x7f3ff800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.872+0000 7f3ff7e00640 1 -- 172.21.15.44:0/661627236 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8017070 con 0x7f40001562f0 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.872+0000 7f3ff7e00640 1 -- 172.21.15.44:0/661627236 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff8005ce0 con 0x7f40001562f0 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.872+0000 7f3ff7e00640 1 -- 172.21.15.44:0/661627236 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80072f0 con 0x7f40001562f0 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.872+0000 7f4005a00640 1 -- 172.21.15.44:0/661627236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40001e8eb0 con 0x7f40001562f0 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.873+0000 7f4005a00640 1 -- 172.21.15.44:0/661627236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40001e9470 con 0x7f40001562f0 2024-03-30T13:12:16.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.874+0000 7f4005a00640 1 -- 172.21.15.44:0/661627236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4000075890 con 0x7f40001562f0 2024-03-30T13:12:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.875+0000 7f3ff7e00640 1 -- 172.21.15.44:0/661627236 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3ff801a070 con 0x7f40001562f0 2024-03-30T13:12:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.876+0000 7f3ff7e00640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3fdc06c560 0x7f3fdc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.876+0000 7f3ff7e00640 1 -- 172.21.15.44:0/661627236 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3ff808ad10 con 0x7f40001562f0 2024-03-30T13:12:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.876+0000 7f3fffe00640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3fdc06c560 0x7f3fdc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:16.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.878+0000 7f3fffe00640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3fdc06c560 0x7f3fdc06ea20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009f20 tx=0x7f3ff00094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:16.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:16.880+0000 7f3ff7e00640 1 -- 172.21.15.44:0/661627236 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3ff8090020 con 0x7f40001562f0 2024-03-30T13:12:17.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.083+0000 7f4005a00640 1 -- 172.21.15.44:0/661627236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f400006ef60 con 0x7f40001562f0 2024-03-30T13:12:17.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.086+0000 7f3ff7e00640 1 -- 172.21.15.44:0/661627236 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7f3ff805de20 con 0x7f40001562f0 2024-03-30T13:12:17.091 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:17.091 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.088+0000 7f4005a00640 1 -- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3fdc06c560 msgr2=0x7f3fdc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.088+0000 7f4005a00640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3fdc06c560 0x7f3fdc06ea20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0009f20 tx=0x7f3ff00094d0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.088+0000 7f4005a00640 1 -- 172.21.15.44:0/661627236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40001562f0 msgr2=0x7f4000148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.088+0000 7f4005a00640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40001562f0 0x7f4000148780 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800c3c0 tx=0x7f3ff800c880 comp rx=0 tx=0).stop 2024-03-30T13:12:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.089+0000 7f4005a00640 1 -- 172.21.15.44:0/661627236 shutdown_connections 2024-03-30T13:12:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.089+0000 7f4005a00640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40001562f0 0x7f4000148780 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.089+0000 7f4005a00640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4000142300 0x7f400015cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.089+0000 7f4005a00640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3fdc06c560 0x7f3fdc06ea20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.089+0000 7f4005a00640 1 --2- 172.21.15.44:0/661627236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40000d09a0 0x7f4000146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.089+0000 7f4005a00640 1 -- 172.21.15.44:0/661627236 >> 172.21.15.44:0/661627236 conn(0x7f400006b9a0 msgr2=0x7f40000b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.089+0000 7f4005a00640 1 -- 172.21.15.44:0/661627236 shutdown_connections 2024-03-30T13:12:17.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.089+0000 7f4005a00640 1 -- 172.21.15.44:0/661627236 wait complete. 2024-03-30T13:12:17.114 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:12:17.114 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:12:17.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.330+0000 7f5bace00640 1 Processor -- start 2024-03-30T13:12:17.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.331+0000 7f5bace00640 1 -- start start 2024-03-30T13:12:17.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.332+0000 7f5bace00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5ba815e5a0 0x7f5ba8072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.332+0000 7f5bace00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5ba80b3fa0 0x7f5ba80cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.332+0000 7f5bace00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ba80b2f20 con 0x7f5ba8073440 2024-03-30T13:12:17.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.332+0000 7f5bace00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f5ba80b3b10 con 0x7f5ba80b3fa0 2024-03-30T13:12:17.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.332+0000 7f5bace00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f5ba815e980 con 0x7f5ba815e5a0 2024-03-30T13:12:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.333+0000 7f5ba6800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5ba8073440 0x7f5ba806d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44000/0 (socket says 172.21.15.44:44000) 2024-03-30T13:12:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.333+0000 7f5ba6800640 1 -- 172.21.15.44:0/2164550799 learned_addr learned my addr 172.21.15.44:0/2164550799 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.333+0000 7f5ba5400640 1 --2- 172.21.15.44:0/2164550799 >> v2:172.21.15.44:3300/0 conn(0x7f5ba80b3fa0 0x7f5ba80cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.333+0000 7f5ba5e00640 1 --2- 172.21.15.44:0/2164550799 >> v2:172.21.15.151:3300/0 conn(0x7f5ba815e5a0 0x7f5ba8072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.333+0000 7f5ba4a00640 1 -- 172.21.15.44:0/2164550799 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1719311826 0 0) 0x7f5ba80b2f20 con 0x7f5ba8073440 2024-03-30T13:12:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.333+0000 7f5ba4a00640 1 -- 172.21.15.44:0/2164550799 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b88003520 con 0x7f5ba8073440 2024-03-30T13:12:17.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.333+0000 7f5ba5400640 1 -- 172.21.15.44:0/2164550799 >> v2:172.21.15.151:3300/0 conn(0x7f5ba815e5a0 msgr2=0x7f5ba8072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.333+0000 7f5ba5400640 1 --2- 172.21.15.44:0/2164550799 >> v2:172.21.15.151:3300/0 conn(0x7f5ba815e5a0 0x7f5ba8072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.333+0000 7f5ba5400640 1 -- 172.21.15.44:0/2164550799 >> v1:172.21.15.44:6789/0 conn(0x7f5ba8073440 legacy=0x7f5ba806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.333+0000 7f5ba5400640 1 -- 172.21.15.44:0/2164550799 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba80b31e0 con 0x7f5ba80b3fa0 2024-03-30T13:12:17.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.335+0000 7f5ba5400640 1 --2- 172.21.15.44:0/2164550799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ba80b3fa0 0x7f5ba80cfc50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80b3c90 tx=0x7f5b9002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9aa3ea72982411 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.335+0000 7f5ba4a00640 1 -- 172.21.15.44:0/2164550799 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90039070 con 0x7f5ba80b3fa0 2024-03-30T13:12:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.335+0000 7f5ba4a00640 1 -- 172.21.15.44:0/2164550799 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9002cbd0 con 0x7f5ba80b3fa0 2024-03-30T13:12:17.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.336+0000 7f5ba4a00640 1 -- 172.21.15.44:0/2164550799 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b90034440 con 0x7f5ba80b3fa0 2024-03-30T13:12:17.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.336+0000 7f5bace00640 1 -- 172.21.15.44:0/2164550799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ba80b3fa0 msgr2=0x7f5ba80cfc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.336+0000 7f5bace00640 1 --2- 172.21.15.44:0/2164550799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ba80b3fa0 0x7f5ba80cfc50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80b3c90 tx=0x7f5b9002be20 comp rx=0 tx=0).stop 2024-03-30T13:12:17.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.336+0000 7f5bace00640 1 -- 172.21.15.44:0/2164550799 shutdown_connections 2024-03-30T13:12:17.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.336+0000 7f5bace00640 1 --2- 172.21.15.44:0/2164550799 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ba80b3fa0 0x7f5ba80cfc50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.336+0000 7f5bace00640 1 --2- 172.21.15.44:0/2164550799 >> v2:172.21.15.151:3300/0 conn(0x7f5ba815e5a0 0x7f5ba8072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.336+0000 7f5bace00640 1 -- 172.21.15.44:0/2164550799 >> 172.21.15.44:0/2164550799 conn(0x7f5ba80b5b00 msgr2=0x7f5ba806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:17.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.336+0000 7f5bace00640 1 -- 172.21.15.44:0/2164550799 shutdown_connections 2024-03-30T13:12:17.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.336+0000 7f5bace00640 1 -- 172.21.15.44:0/2164550799 wait complete. 2024-03-30T13:12:17.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.339+0000 7f5bace00640 1 Processor -- start 2024-03-30T13:12:17.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.339+0000 7f5bace00640 1 -- start start 2024-03-30T13:12:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.340+0000 7f5bace00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ba8073440 0x7f5ba814db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.340+0000 7f5bace00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ba80b3fa0 0x7f5ba80c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.340+0000 7f5bace00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ba815e5a0 0x7f5ba80c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.340+0000 7f5bace00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba80726a0 con 0x7f5ba815e5a0 2024-03-30T13:12:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.340+0000 7f5bace00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba80b37a0 con 0x7f5ba8073440 2024-03-30T13:12:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.340+0000 7f5bace00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba815f990 con 0x7f5ba80b3fa0 2024-03-30T13:12:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.341+0000 7f5ba6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ba815e5a0 0x7f5ba80c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.341+0000 7f5ba5e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ba8073440 0x7f5ba814db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.341+0000 7f5ba6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ba815e5a0 0x7f5ba80c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38106/0 (socket says 172.21.15.44:38106) 2024-03-30T13:12:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.341+0000 7f5ba6800640 1 -- 172.21.15.44:0/708365494 learned_addr learned my addr 172.21.15.44:0/708365494 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.341+0000 7f5ba5400640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ba80b3fa0 0x7f5ba80c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.341+0000 7f5ba6800640 1 -- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ba80b3fa0 msgr2=0x7f5ba80c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.341+0000 7f5ba6800640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ba80b3fa0 0x7f5ba80c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.341+0000 7f5ba6800640 1 -- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ba8073440 msgr2=0x7f5ba814db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.341+0000 7f5ba6800640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ba8073440 0x7f5ba814db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.341+0000 7f5ba6800640 1 -- 172.21.15.44:0/708365494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba80c58e0 con 0x7f5ba815e5a0 2024-03-30T13:12:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.342+0000 7f5ba6800640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ba815e5a0 0x7f5ba80c6840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c430 tx=0x7f5ba000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.342+0000 7f5b9e000640 1 -- 172.21.15.44:0/708365494 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0017070 con 0x7f5ba815e5a0 2024-03-30T13:12:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.342+0000 7f5b9e000640 1 -- 172.21.15.44:0/708365494 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba0005ce0 con 0x7f5ba815e5a0 2024-03-30T13:12:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.342+0000 7f5b9e000640 1 -- 172.21.15.44:0/708365494 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0007310 con 0x7f5ba815e5a0 2024-03-30T13:12:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.342+0000 7f5bace00640 1 -- 172.21.15.44:0/708365494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba80c5bc0 con 0x7f5ba815e5a0 2024-03-30T13:12:17.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.342+0000 7f5bace00640 1 -- 172.21.15.44:0/708365494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba80c6180 con 0x7f5ba815e5a0 2024-03-30T13:12:17.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.343+0000 7f5bace00640 1 -- 172.21.15.44:0/708365494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ba8075890 con 0x7f5ba815e5a0 2024-03-30T13:12:17.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.344+0000 7f5b9e000640 1 -- 172.21.15.44:0/708365494 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5ba001a070 con 0x7f5ba815e5a0 2024-03-30T13:12:17.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.345+0000 7f5b9e000640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5b8406c530 0x7f5b8406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.345+0000 7f5b9e000640 1 -- 172.21.15.44:0/708365494 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5ba008aee0 con 0x7f5ba815e5a0 2024-03-30T13:12:17.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.346+0000 7f5ba5e00640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5b8406c530 0x7f5b8406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.347+0000 7f5ba5e00640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5b8406c530 0x7f5b8406e9f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b980079a0 tx=0x7f5b98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:17.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.350+0000 7f5b9e000640 1 -- 172.21.15.44:0/708365494 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5ba0058ad0 con 0x7f5ba815e5a0 2024-03-30T13:12:17.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.552+0000 7f5bace00640 1 -- 172.21.15.44:0/708365494 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5ba80ae450 con 0x7f5ba815e5a0 2024-03-30T13:12:17.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.553+0000 7f5b9e000640 1 -- 172.21.15.44:0/708365494 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f5ba005cdd0 con 0x7f5ba815e5a0 2024-03-30T13:12:17.558 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:12:17.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.555+0000 7f5bace00640 1 -- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5b8406c530 msgr2=0x7f5b8406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.555+0000 7f5bace00640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5b8406c530 0x7f5b8406e9f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b980079a0 tx=0x7f5b98008040 comp rx=0 tx=0).stop 2024-03-30T13:12:17.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.555+0000 7f5bace00640 1 -- 172.21.15.44:0/708365494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ba815e5a0 msgr2=0x7f5ba80c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.555+0000 7f5bace00640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ba815e5a0 0x7f5ba80c6840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000c430 tx=0x7f5ba000c8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.555+0000 7f5bace00640 1 -- 172.21.15.44:0/708365494 shutdown_connections 2024-03-30T13:12:17.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.555+0000 7f5bace00640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5ba815e5a0 0x7f5ba80c6840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.555+0000 7f5bace00640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ba80b3fa0 0x7f5ba80c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.555+0000 7f5bace00640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5b8406c530 0x7f5b8406e9f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.555+0000 7f5bace00640 1 --2- 172.21.15.44:0/708365494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ba8073440 0x7f5ba814db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.555+0000 7f5bace00640 1 -- 172.21.15.44:0/708365494 >> 172.21.15.44:0/708365494 conn(0x7f5ba80b5b00 msgr2=0x7f5ba815d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:17.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.556+0000 7f5bace00640 1 -- 172.21.15.44:0/708365494 shutdown_connections 2024-03-30T13:12:17.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.556+0000 7f5bace00640 1 -- 172.21.15.44:0/708365494 wait complete. 2024-03-30T13:12:17.580 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:12:17.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.805+0000 7f5c72000640 1 Processor -- start 2024-03-30T13:12:17.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.805+0000 7f5c72000640 1 -- start start 2024-03-30T13:12:17.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.807+0000 7f5c72000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5c6c06e980 0x7f5c6c072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.807+0000 7f5c72000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c6c0ad2e0 con 0x7f5c6c0acd60 2024-03-30T13:12:17.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.807+0000 7f5c72000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c6c0716a0 con 0x7f5c6c0ae9d0 2024-03-30T13:12:17.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.807+0000 7f5c72000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f5c6c0ad5c0 con 0x7f5c6c06e980 2024-03-30T13:12:17.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.807+0000 7f5c6be00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5c6c0acd60 0x7f5c6c15d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44014/0 (socket says 172.21.15.44:44014) 2024-03-30T13:12:17.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.807+0000 7f5c6be00640 1 -- 172.21.15.44:0/1359096750 learned_addr learned my addr 172.21.15.44:0/1359096750 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:17.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c70c00640 1 --2- 172.21.15.44:0/1359096750 >> v2:172.21.15.151:3300/0 conn(0x7f5c6c06e980 0x7f5c6c072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3318949689 0 0) 0x7f5c6c0ad2e0 con 0x7f5c6c0acd60 2024-03-30T13:12:17.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c54003520 con 0x7f5c6c0acd60 2024-03-30T13:12:17.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2746265945 0 0) 0x7f5c54003520 con 0x7f5c6c0acd60 2024-03-30T13:12:17.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 >> v2:172.21.15.151:3300/0 conn(0x7f5c6c06e980 msgr2=0x7f5c6c072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:17.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c6b400640 1 --2- 172.21.15.44:0/1359096750 >> v2:172.21.15.151:3300/0 conn(0x7f5c6c06e980 0x7f5c6c072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 >> v1:172.21.15.151:6789/0 conn(0x7f5c6c0ae9d0 legacy=0x7f5c6c0aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c071980 con 0x7f5c6c0acd60 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f5c58001670 con 0x7f5c6c0acd60 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 >> v1:172.21.15.44:6789/0 conn(0x7f5c6c0acd60 legacy=0x7f5c6c15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c6b400640 1 --2- 172.21.15.44:0/1359096750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c54003a00 0x7f5c54003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c6b400640 1 --2- 172.21.15.44:0/1359096750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c54004800 0x7f5c54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.808+0000 7f5c6b400640 1 --2- 172.21.15.44:0/1359096750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c54005210 0x7f5c5400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.809+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5400c130 con 0x7f5c54004800 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.809+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5400c2e0 con 0x7f5c54003a00 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.809+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5c5400c4e0 con 0x7f5c54005210 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.809+0000 7f5c6be00640 1 --2- 172.21.15.44:0/1359096750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c54004800 0x7f5c54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.809+0000 7f5c71600640 1 --2- 172.21.15.44:0/1359096750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c54005210 0x7f5c5400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.809+0000 7f5c6be00640 1 -- 172.21.15.44:0/1359096750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c54005210 msgr2=0x7f5c5400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.809+0000 7f5c6be00640 1 --2- 172.21.15.44:0/1359096750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c54005210 0x7f5c5400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.809+0000 7f5c6be00640 1 -- 172.21.15.44:0/1359096750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c54003a00 msgr2=0x7f5c54003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:17.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.809+0000 7f5c6be00640 1 --2- 172.21.15.44:0/1359096750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c54003a00 0x7f5c54003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.809+0000 7f5c6be00640 1 -- 172.21.15.44:0/1359096750 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c54003520 con 0x7f5c54004800 2024-03-30T13:12:17.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.809+0000 7f5c71600640 1 -- 172.21.15.44:0/1359096750 reap_dead start 2024-03-30T13:12:17.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.810+0000 7f5c6be00640 1 --2- 172.21.15.44:0/1359096750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c54004800 0x7f5c54004c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800c0e0 tx=0x7f5c54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731a9283dea9a478 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:17.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.810+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58007c40 con 0x7f5c54004800 2024-03-30T13:12:17.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.811+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c58030070 con 0x7f5c54004800 2024-03-30T13:12:17.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.811+0000 7f5c6b400640 1 -- 172.21.15.44:0/1359096750 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58005db0 con 0x7f5c54004800 2024-03-30T13:12:17.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.811+0000 7f5c72000640 1 -- 172.21.15.44:0/1359096750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c54004800 msgr2=0x7f5c54004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.811+0000 7f5c72000640 1 --2- 172.21.15.44:0/1359096750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c54004800 0x7f5c54004c80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800c0e0 tx=0x7f5c54005830 comp rx=0 tx=0).stop 2024-03-30T13:12:17.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.811+0000 7f5c72000640 1 -- 172.21.15.44:0/1359096750 shutdown_connections 2024-03-30T13:12:17.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.811+0000 7f5c72000640 1 --2- 172.21.15.44:0/1359096750 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c54004800 0x7f5c54004c80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.811+0000 7f5c72000640 1 -- 172.21.15.44:0/1359096750 >> 172.21.15.44:0/1359096750 conn(0x7f5c6c0cfd90 msgr2=0x7f5c6c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:17.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.811+0000 7f5c72000640 1 -- 172.21.15.44:0/1359096750 shutdown_connections 2024-03-30T13:12:17.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.811+0000 7f5c72000640 1 -- 172.21.15.44:0/1359096750 wait complete. 2024-03-30T13:12:17.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.813+0000 7f5c72000640 1 Processor -- start 2024-03-30T13:12:17.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.813+0000 7f5c72000640 1 -- start start 2024-03-30T13:12:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.814+0000 7f5c72000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c54004800 0x7f5c6c09d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.814+0000 7f5c72000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c6c09aa30 0x7f5c6c0cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.814+0000 7f5c72000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c6c1523a0 0x7f5c6c152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.814+0000 7f5c72000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c072180 con 0x7f5c6c09aa30 2024-03-30T13:12:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.814+0000 7f5c72000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c071450 con 0x7f5c6c1523a0 2024-03-30T13:12:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.814+0000 7f5c72000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5c6c072300 con 0x7f5c54004800 2024-03-30T13:12:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.814+0000 7f5c6be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c6c09aa30 0x7f5c6c0cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.814+0000 7f5c6be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c6c09aa30 0x7f5c6c0cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38124/0 (socket says 172.21.15.44:38124) 2024-03-30T13:12:17.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.814+0000 7f5c6be00640 1 -- 172.21.15.44:0/309969064 learned_addr learned my addr 172.21.15.44:0/309969064 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:17.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c71600640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c6c1523a0 0x7f5c6c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c70c00640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c54004800 0x7f5c6c09d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c6be00640 1 -- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c54004800 msgr2=0x7f5c6c09d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c6be00640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c54004800 0x7f5c6c09d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c6be00640 1 -- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c6c1523a0 msgr2=0x7f5c6c152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:17.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c6be00640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c6c1523a0 0x7f5c6c152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:17.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c6be00640 1 -- 172.21.15.44:0/309969064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c09aeb0 con 0x7f5c6c09aa30 2024-03-30T13:12:17.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c71600640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c6c1523a0 0x7f5c6c152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:17.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c6be00640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c6c09aa30 0x7f5c6c0cb2c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800c200 tx=0x7f5c6c15c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:17.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c68c00640 1 -- 172.21.15.44:0/309969064 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58004bf0 con 0x7f5c6c09aa30 2024-03-30T13:12:17.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c68c00640 1 -- 172.21.15.44:0/309969064 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c58000ed0 con 0x7f5c6c09aa30 2024-03-30T13:12:17.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c68c00640 1 -- 172.21.15.44:0/309969064 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c58007070 con 0x7f5c6c09aa30 2024-03-30T13:12:17.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.815+0000 7f5c72000640 1 -- 172.21.15.44:0/309969064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6c09b160 con 0x7f5c6c09aa30 2024-03-30T13:12:17.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.816+0000 7f5c72000640 1 -- 172.21.15.44:0/309969064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c6c09b720 con 0x7f5c6c09aa30 2024-03-30T13:12:17.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.817+0000 7f5c72000640 1 -- 172.21.15.44:0/309969064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c6c075890 con 0x7f5c6c09aa30 2024-03-30T13:12:17.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.818+0000 7f5c68c00640 1 -- 172.21.15.44:0/309969064 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5c58047020 con 0x7f5c6c09aa30 2024-03-30T13:12:17.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.819+0000 7f5c68c00640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5c4c06c530 0x7f5c4c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:17.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.819+0000 7f5c68c00640 1 -- 172.21.15.44:0/309969064 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5c580acd90 con 0x7f5c6c09aa30 2024-03-30T13:12:17.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.819+0000 7f5c70c00640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5c4c06c530 0x7f5c4c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:17.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.820+0000 7f5c70c00640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5c4c06c530 0x7f5c4c06e9f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5c600099f0 tx=0x7f5c60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:17.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:17.823+0000 7f5c68c00640 1 -- 172.21.15.44:0/309969064 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5c5807b070 con 0x7f5c6c09aa30 2024-03-30T13:12:18.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.027+0000 7f5c72000640 1 -- 172.21.15.44:0/309969064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5c6c152d40 con 0x7f5c6c09aa30 2024-03-30T13:12:18.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.028+0000 7f5c68c00640 1 -- 172.21.15.44:0/309969064 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f5c5807a970 con 0x7f5c6c09aa30 2024-03-30T13:12:18.032 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:18.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.030+0000 7f5c72000640 1 -- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5c4c06c530 msgr2=0x7f5c4c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.030+0000 7f5c72000640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5c4c06c530 0x7f5c4c06e9f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5c600099f0 tx=0x7f5c60008040 comp rx=0 tx=0).stop 2024-03-30T13:12:18.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.030+0000 7f5c72000640 1 -- 172.21.15.44:0/309969064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c6c09aa30 msgr2=0x7f5c6c0cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.030+0000 7f5c72000640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c6c09aa30 0x7f5c6c0cb2c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800c200 tx=0x7f5c6c15c5f0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.031+0000 7f5c72000640 1 -- 172.21.15.44:0/309969064 shutdown_connections 2024-03-30T13:12:18.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.031+0000 7f5c72000640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5c4c06c530 0x7f5c4c06e9f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.031+0000 7f5c72000640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c6c1523a0 0x7f5c6c152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.031+0000 7f5c72000640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5c6c09aa30 0x7f5c6c0cb2c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.031+0000 7f5c72000640 1 --2- 172.21.15.44:0/309969064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5c54004800 0x7f5c6c09d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.031+0000 7f5c72000640 1 -- 172.21.15.44:0/309969064 >> 172.21.15.44:0/309969064 conn(0x7f5c6c0cfd90 msgr2=0x7f5c6c0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:18.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.031+0000 7f5c72000640 1 -- 172.21.15.44:0/309969064 shutdown_connections 2024-03-30T13:12:18.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.031+0000 7f5c72000640 1 -- 172.21.15.44:0/309969064 wait complete. 2024-03-30T13:12:18.054 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:12:18.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.264+0000 7f262fe00640 1 Processor -- start 2024-03-30T13:12:18.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.264+0000 7f262fe00640 1 -- start start 2024-03-30T13:12:18.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.265+0000 7f262fe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26300b4d00 0x7f26300d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.265+0000 7f262fe00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26300b54b0 con 0x7f26300b4920 2024-03-30T13:12:18.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.265+0000 7f262fe00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26300cfca0 con 0x7f26300d0b90 2024-03-30T13:12:18.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.265+0000 7f262fe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f26300d0260 con 0x7f26300b4d00 2024-03-30T13:12:18.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.265+0000 7f262ea00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f26300b4920 0x7f26300b3ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44030/0 (socket says 172.21.15.44:44030) 2024-03-30T13:12:18.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.265+0000 7f262ea00640 1 -- 172.21.15.44:0/639770917 learned_addr learned my addr 172.21.15.44:0/639770917 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.266+0000 7f262e000640 1 --2- 172.21.15.44:0/639770917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26300b4d00 0x7f26300d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.266+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1421180737 0 0) 0x7f2620001490 con 0x7f26300b4920 2024-03-30T13:12:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.266+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2614003520 con 0x7f26300b4920 2024-03-30T13:12:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.266+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 837297280 0 0) 0x7f2614003520 con 0x7f26300b4920 2024-03-30T13:12:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.266+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26300b4d00 msgr2=0x7f26300d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.266+0000 7f262d600640 1 --2- 172.21.15.44:0/639770917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26300b4d00 0x7f26300d4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.266+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 >> v1:172.21.15.151:6789/0 conn(0x7f26300d0b90 legacy=0x7f26300d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.266+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26300cff80 con 0x7f26300b4920 2024-03-30T13:12:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.266+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f2620001bc0 con 0x7f26300b4920 2024-03-30T13:12:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.266+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 >> v1:172.21.15.44:6789/0 conn(0x7f26300b4920 legacy=0x7f26300b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.266+0000 7f262d600640 1 --2- 172.21.15.44:0/639770917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26140039e0 0x7f2614003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.266+0000 7f262d600640 1 --2- 172.21.15.44:0/639770917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2614004800 0x7f2614004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.267+0000 7f262d600640 1 --2- 172.21.15.44:0/639770917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26300b4d00 0x7f2614005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.267+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f26300d0260 con 0x7f2614004800 2024-03-30T13:12:18.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.267+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f261400bb80 con 0x7f26140039e0 2024-03-30T13:12:18.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.267+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f261400bd80 con 0x7f26300b4d00 2024-03-30T13:12:18.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.267+0000 7f262e000640 1 --2- 172.21.15.44:0/639770917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2614004800 0x7f2614004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.267+0000 7f262ea00640 1 --2- 172.21.15.44:0/639770917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26140039e0 0x7f2614003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.267+0000 7f262e000640 1 -- 172.21.15.44:0/639770917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26300b4d00 msgr2=0x7f2614005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:18.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.267+0000 7f262e000640 1 --2- 172.21.15.44:0/639770917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f26300b4d00 0x7f2614005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.267+0000 7f262e000640 1 -- 172.21.15.44:0/639770917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26140039e0 msgr2=0x7f2614003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:18.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.267+0000 7f262e000640 1 --2- 172.21.15.44:0/639770917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26140039e0 0x7f2614003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.267+0000 7f262e000640 1 -- 172.21.15.44:0/639770917 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2614003520 con 0x7f2614004800 2024-03-30T13:12:18.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.269+0000 7f262e000640 1 --2- 172.21.15.44:0/639770917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2614004800 0x7f2614004c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2618009ac0 tx=0x7f2614005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df064a1bafc1355a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:18.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.269+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618039070 con 0x7f2614004800 2024-03-30T13:12:18.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.269+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f261802c710 con 0x7f2614004800 2024-03-30T13:12:18.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.269+0000 7f262d600640 1 -- 172.21.15.44:0/639770917 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618009690 con 0x7f2614004800 2024-03-30T13:12:18.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.269+0000 7f262fe00640 1 -- 172.21.15.44:0/639770917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2614004800 msgr2=0x7f2614004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.269+0000 7f262fe00640 1 --2- 172.21.15.44:0/639770917 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2614004800 0x7f2614004c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2618009ac0 tx=0x7f2614005830 comp rx=0 tx=0).stop 2024-03-30T13:12:18.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.270+0000 7f262f400640 1 -- 172.21.15.44:0/639770917 reap_dead start 2024-03-30T13:12:18.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.270+0000 7f262fe00640 1 -- 172.21.15.44:0/639770917 shutdown_connections 2024-03-30T13:12:18.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.270+0000 7f262fe00640 1 -- 172.21.15.44:0/639770917 >> 172.21.15.44:0/639770917 conn(0x7f263009d4e0 msgr2=0x7f26300d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:18.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.270+0000 7f262fe00640 1 -- 172.21.15.44:0/639770917 shutdown_connections 2024-03-30T13:12:18.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.270+0000 7f262fe00640 1 -- 172.21.15.44:0/639770917 wait complete. 2024-03-30T13:12:18.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.272+0000 7f262fe00640 1 Processor -- start 2024-03-30T13:12:18.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.272+0000 7f262fe00640 1 -- start start 2024-03-30T13:12:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2614004800 0x7f2630159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f263015cc00 0x7f263015d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262fe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f263015ab00 0x7f263015af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262fe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f26300cf8c0 con 0x7f263015cc00 2024-03-30T13:12:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262fe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f26300d2180 con 0x7f2614004800 2024-03-30T13:12:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262fe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f26300cfa40 con 0x7f263015ab00 2024-03-30T13:12:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f263015cc00 0x7f263015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f263015cc00 0x7f263015d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38140/0 (socket says 172.21.15.44:38140) 2024-03-30T13:12:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262e000640 1 -- 172.21.15.44:0/4211657247 learned_addr learned my addr 172.21.15.44:0/4211657247 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262f400640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f263015ab00 0x7f263015af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262ea00640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2614004800 0x7f2630159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262e000640 1 -- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f263015ab00 msgr2=0x7f263015af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.273+0000 7f262e000640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f263015ab00 0x7f263015af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.274+0000 7f262e000640 1 -- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2614004800 msgr2=0x7f2630159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.274+0000 7f262e000640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2614004800 0x7f2630159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.274+0000 7f262e000640 1 -- 172.21.15.44:0/4211657247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26300cb310 con 0x7f263015cc00 2024-03-30T13:12:18.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.274+0000 7f262ea00640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2614004800 0x7f2630159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:18.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.274+0000 7f262f400640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f263015ab00 0x7f263015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:18.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.274+0000 7f262e000640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f263015cc00 0x7f263015d080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f261802c380 tx=0x7f2618004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:18.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.274+0000 7f2626a00640 1 -- 172.21.15.44:0/4211657247 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618042020 con 0x7f263015cc00 2024-03-30T13:12:18.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.274+0000 7f2626a00640 1 -- 172.21.15.44:0/4211657247 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f261803a040 con 0x7f263015cc00 2024-03-30T13:12:18.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.274+0000 7f262fe00640 1 -- 172.21.15.44:0/4211657247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26300cb580 con 0x7f263015cc00 2024-03-30T13:12:18.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.274+0000 7f2626a00640 1 -- 172.21.15.44:0/4211657247 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618039070 con 0x7f263015cc00 2024-03-30T13:12:18.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.274+0000 7f262fe00640 1 -- 172.21.15.44:0/4211657247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26300cbb40 con 0x7f263015cc00 2024-03-30T13:12:18.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.275+0000 7f262fe00640 1 -- 172.21.15.44:0/4211657247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2630075890 con 0x7f263015cc00 2024-03-30T13:12:18.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.276+0000 7f2626a00640 1 -- 172.21.15.44:0/4211657247 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2618045020 con 0x7f263015cc00 2024-03-30T13:12:18.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.277+0000 7f2626a00640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f260c06c560 0x7f260c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.277+0000 7f2626a00640 1 -- 172.21.15.44:0/4211657247 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f26180acf50 con 0x7f263015cc00 2024-03-30T13:12:18.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.278+0000 7f262ea00640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f260c06c560 0x7f260c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.279+0000 7f262ea00640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f260c06c560 0x7f260c06ea20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2620001d30 tx=0x7f26200016a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:18.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.284+0000 7f2626a00640 1 -- 172.21.15.44:0/4211657247 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f261804c070 con 0x7f263015cc00 2024-03-30T13:12:18.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.487+0000 7f262fe00640 1 -- 172.21.15.44:0/4211657247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2630074b60 con 0x7f263015cc00 2024-03-30T13:12:18.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.488+0000 7f2626a00640 1 -- 172.21.15.44:0/4211657247 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f261807b190 con 0x7f263015cc00 2024-03-30T13:12:18.493 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:12:18.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.490+0000 7f262fe00640 1 -- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f260c06c560 msgr2=0x7f260c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.490+0000 7f262fe00640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f260c06c560 0x7f260c06ea20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2620001d30 tx=0x7f26200016a0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.490+0000 7f262fe00640 1 -- 172.21.15.44:0/4211657247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f263015cc00 msgr2=0x7f263015d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.490+0000 7f262fe00640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f263015cc00 0x7f263015d080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f261802c380 tx=0x7f2618004730 comp rx=0 tx=0).stop 2024-03-30T13:12:18.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.491+0000 7f262fe00640 1 -- 172.21.15.44:0/4211657247 shutdown_connections 2024-03-30T13:12:18.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.491+0000 7f262fe00640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f263015ab00 0x7f263015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.491+0000 7f262fe00640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f263015cc00 0x7f263015d080 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.491+0000 7f262fe00640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f260c06c560 0x7f260c06ea20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.491+0000 7f262fe00640 1 --2- 172.21.15.44:0/4211657247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2614004800 0x7f2630159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.491+0000 7f262fe00640 1 -- 172.21.15.44:0/4211657247 >> 172.21.15.44:0/4211657247 conn(0x7f263009d4e0 msgr2=0x7f26300b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:18.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.491+0000 7f262fe00640 1 -- 172.21.15.44:0/4211657247 shutdown_connections 2024-03-30T13:12:18.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.491+0000 7f262fe00640 1 -- 172.21.15.44:0/4211657247 wait complete. 2024-03-30T13:12:18.515 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:12:18.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.737+0000 7f65d7200640 1 Processor -- start 2024-03-30T13:12:18.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.738+0000 7f65d7200640 1 -- start start 2024-03-30T13:12:18.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.739+0000 7f65d7200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65d80af0e0 0x7f65d8072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.739+0000 7f65d7200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d80ad2e0 con 0x7f65d806e980 2024-03-30T13:12:18.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.739+0000 7f65d7200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d80716a0 con 0x7f65d80acd60 2024-03-30T13:12:18.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.739+0000 7f65d7200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f65d80ad5c0 con 0x7f65d80af0e0 2024-03-30T13:12:18.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.740+0000 7f65d6800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65d80af0e0 0x7f65d8072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.740+0000 7f65d5e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f65d806e980 0x7f65d815d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44036/0 (socket says 172.21.15.44:44036) 2024-03-30T13:12:18.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.740+0000 7f65d5e00640 1 -- 172.21.15.44:0/3008738826 learned_addr learned my addr 172.21.15.44:0/3008738826 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:18.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.740+0000 7f65d6800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f65d80af0e0 0x7f65d8072180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38150/0 (socket says 172.21.15.44:38150) 2024-03-30T13:12:18.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.740+0000 7f65d6800640 1 -- 172.21.15.44:0/3008738826 >> v1:172.21.15.151:6789/0 conn(0x7f65d80acd60 legacy=0x7f65d80ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.740+0000 7f65d6800640 1 -- 172.21.15.44:0/3008738826 >> v1:172.21.15.44:6789/0 conn(0x7f65d806e980 legacy=0x7f65d815d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.740+0000 7f65d6800640 1 -- 172.21.15.44:0/3008738826 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d8071980 con 0x7f65d80af0e0 2024-03-30T13:12:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.741+0000 7f65d6800640 1 --2- 172.21.15.44:0/3008738826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80af0e0 0x7f65d8072180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009d90 tx=0x7f65d002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3d1d024d861fb3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.742+0000 7f65d4a00640 1 -- 172.21.15.44:0/3008738826 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0039070 con 0x7f65d80af0e0 2024-03-30T13:12:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.742+0000 7f65d4a00640 1 -- 172.21.15.44:0/3008738826 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d002cc60 con 0x7f65d80af0e0 2024-03-30T13:12:18.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.742+0000 7f65d4a00640 1 -- 172.21.15.44:0/3008738826 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0034660 con 0x7f65d80af0e0 2024-03-30T13:12:18.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.743+0000 7f65d7200640 1 -- 172.21.15.44:0/3008738826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80af0e0 msgr2=0x7f65d8072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.743+0000 7f65d7200640 1 --2- 172.21.15.44:0/3008738826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80af0e0 0x7f65d8072180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f65d0009d90 tx=0x7f65d002beb0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.743+0000 7f65d7200640 1 -- 172.21.15.44:0/3008738826 shutdown_connections 2024-03-30T13:12:18.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.743+0000 7f65d7200640 1 --2- 172.21.15.44:0/3008738826 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80af0e0 0x7f65d8072180 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.743+0000 7f65d7200640 1 -- 172.21.15.44:0/3008738826 >> 172.21.15.44:0/3008738826 conn(0x7f65d80cfd90 msgr2=0x7f65d80d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:18.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.743+0000 7f65d7200640 1 -- 172.21.15.44:0/3008738826 shutdown_connections 2024-03-30T13:12:18.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.743+0000 7f65d7200640 1 -- 172.21.15.44:0/3008738826 wait complete. 2024-03-30T13:12:18.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.744+0000 7f65d7200640 1 Processor -- start 2024-03-30T13:12:18.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.745+0000 7f65d7200640 1 -- start start 2024-03-30T13:12:18.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d7200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65d806e980 0x7f65d8141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80acd60 0x7f65d80b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d7200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d80af0e0 0x7f65d80b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d7200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f65d8156020 con 0x7f65d80acd60 2024-03-30T13:12:18.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d7200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f65d8071450 con 0x7f65d80af0e0 2024-03-30T13:12:18.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d7200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f65d81561a0 con 0x7f65d806e980 2024-03-30T13:12:18.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80acd60 0x7f65d80b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80acd60 0x7f65d80b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38154/0 (socket says 172.21.15.44:38154) 2024-03-30T13:12:18.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d5400640 1 -- 172.21.15.44:0/1618386741 learned_addr learned my addr 172.21.15.44:0/1618386741 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:18.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d5e00640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65d806e980 0x7f65d8141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d6800640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d80af0e0 0x7f65d80b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d5400640 1 -- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65d806e980 msgr2=0x7f65d8141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d5400640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65d806e980 0x7f65d8141ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d5400640 1 -- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d80af0e0 msgr2=0x7f65d80b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d5400640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d80af0e0 0x7f65d80b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.746+0000 7f65d5400640 1 -- 172.21.15.44:0/1618386741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d81e6de0 con 0x7f65d80acd60 2024-03-30T13:12:18.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.747+0000 7f65d5400640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80acd60 0x7f65d80b08f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f65c800c450 tx=0x7f65c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:18.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.747+0000 7f65ce000640 1 -- 172.21.15.44:0/1618386741 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c80052d0 con 0x7f65d80acd60 2024-03-30T13:12:18.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.747+0000 7f65ce000640 1 -- 172.21.15.44:0/1618386741 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c8005470 con 0x7f65d80acd60 2024-03-30T13:12:18.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.747+0000 7f65ce000640 1 -- 172.21.15.44:0/1618386741 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8012870 con 0x7f65d80acd60 2024-03-30T13:12:18.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.747+0000 7f65d7200640 1 -- 172.21.15.44:0/1618386741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d8142420 con 0x7f65d80acd60 2024-03-30T13:12:18.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.747+0000 7f65d7200640 1 -- 172.21.15.44:0/1618386741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d81453d0 con 0x7f65d80acd60 2024-03-30T13:12:18.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.748+0000 7f65d7200640 1 -- 172.21.15.44:0/1618386741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d809d880 con 0x7f65d80acd60 2024-03-30T13:12:18.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.749+0000 7f65ce000640 1 -- 172.21.15.44:0/1618386741 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f65c8012a10 con 0x7f65d80acd60 2024-03-30T13:12:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.750+0000 7f65ce000640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f65b406c530 0x7f65b406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.750+0000 7f65ce000640 1 -- 172.21.15.44:0/1618386741 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f65c808b640 con 0x7f65d80acd60 2024-03-30T13:12:18.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.751+0000 7f65d5e00640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f65b406c530 0x7f65b406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:18.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.752+0000 7f65d5e00640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f65b406c530 0x7f65b406e9f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f65c0005880 tx=0x7f65c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:18.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.755+0000 7f65ce000640 1 -- 172.21.15.44:0/1618386741 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f65d809d880 con 0x7f65d80acd60 2024-03-30T13:12:18.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.958+0000 7f65d7200640 1 -- 172.21.15.44:0/1618386741 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f65d80cc580 con 0x7f65d80acd60 2024-03-30T13:12:18.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.960+0000 7f65ce000640 1 -- 172.21.15.44:0/1618386741 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f65c8059910 con 0x7f65d80acd60 2024-03-30T13:12:18.964 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.962+0000 7f65d7200640 1 -- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f65b406c530 msgr2=0x7f65b406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.962+0000 7f65d7200640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f65b406c530 0x7f65b406e9f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f65c0005880 tx=0x7f65c0009040 comp rx=0 tx=0).stop 2024-03-30T13:12:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.962+0000 7f65d7200640 1 -- 172.21.15.44:0/1618386741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80acd60 msgr2=0x7f65d80b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.962+0000 7f65d7200640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80acd60 0x7f65d80b08f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f65c800c450 tx=0x7f65c800c910 comp rx=0 tx=0).stop 2024-03-30T13:12:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.962+0000 7f65d7200640 1 -- 172.21.15.44:0/1618386741 shutdown_connections 2024-03-30T13:12:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.962+0000 7f65d7200640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f65b406c530 0x7f65b406e9f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.962+0000 7f65d7200640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d80af0e0 0x7f65d80b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.962+0000 7f65d7200640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65d80acd60 0x7f65d80b08f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.962+0000 7f65d7200640 1 --2- 172.21.15.44:0/1618386741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65d806e980 0x7f65d8141ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.962+0000 7f65d7200640 1 -- 172.21.15.44:0/1618386741 >> 172.21.15.44:0/1618386741 conn(0x7f65d80cfd90 msgr2=0x7f65d80d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.962+0000 7f65d7200640 1 -- 172.21.15.44:0/1618386741 shutdown_connections 2024-03-30T13:12:18.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:18.963+0000 7f65d7200640 1 -- 172.21.15.44:0/1618386741 wait complete. 2024-03-30T13:12:18.987 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:12:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.201+0000 7ffad6200640 1 Processor -- start 2024-03-30T13:12:19.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.201+0000 7ffad6200640 1 -- start start 2024-03-30T13:12:19.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.202+0000 7ffad6200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffad00d09a0 0x7ffad01566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.202+0000 7ffad6200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad0160c20 con 0x7ffad01562f0 2024-03-30T13:12:19.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.202+0000 7ffad6200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad01427b0 con 0x7ffad0142300 2024-03-30T13:12:19.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.202+0000 7ffad6200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ffad0156c10 con 0x7ffad00d09a0 2024-03-30T13:12:19.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.203+0000 7ffad4e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ffad01562f0 0x7ffad00d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44038/0 (socket says 172.21.15.44:44038) 2024-03-30T13:12:19.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.203+0000 7ffad4e00640 1 -- 172.21.15.44:0/1075070842 learned_addr learned my addr 172.21.15.44:0/1075070842 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:19.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.203+0000 7ffacfe00640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffad00d09a0 0x7ffad01566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:19.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.203+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 861318551 0 0) 0x7ffad0160c20 con 0x7ffad01562f0 2024-03-30T13:12:19.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.203+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffab4003520 con 0x7ffad01562f0 2024-03-30T13:12:19.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.203+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 679114962 0 0) 0x7ffab4003520 con 0x7ffad01562f0 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffad00d09a0 msgr2=0x7ffad01566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacf400640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffad00d09a0 0x7ffad01566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 >> v1:172.21.15.151:6789/0 conn(0x7ffad0142300 legacy=0x7ffad015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad01600a0 con 0x7ffad01562f0 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7ffac00019f0 con 0x7ffad01562f0 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 >> v1:172.21.15.44:6789/0 conn(0x7ffad01562f0 legacy=0x7ffad00d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacf400640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab40039e0 0x7ffab4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacf400640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab4004800 0x7ffab4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacf400640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffad00d09a0 0x7ffab40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffad0156c10 con 0x7ffab4004800 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffab400baa0 con 0x7ffab40039e0 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ffab400bca0 con 0x7ffad00d09a0 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacfe00640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab4004800 0x7ffab4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:19.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffad4e00640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab40039e0 0x7ffab4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffad5800640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffad00d09a0 0x7ffab40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.204+0000 7ffacfe00640 1 -- 172.21.15.44:0/1075070842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffad00d09a0 msgr2=0x7ffab40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.205+0000 7ffacfe00640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffad00d09a0 0x7ffab40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.205+0000 7ffacfe00640 1 -- 172.21.15.44:0/1075070842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab40039e0 msgr2=0x7ffab4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.205+0000 7ffacfe00640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab40039e0 0x7ffab4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.205+0000 7ffacfe00640 1 -- 172.21.15.44:0/1075070842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab4003520 con 0x7ffab4004800 2024-03-30T13:12:19.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.205+0000 7ffad5800640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffad00d09a0 0x7ffab40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:19.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.206+0000 7ffacfe00640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab4004800 0x7ffab4004c80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009a90 tx=0x7ffab4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd1229ff72fbaca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:19.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.206+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc039070 con 0x7ffab4004800 2024-03-30T13:12:19.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.206+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc02c680 con 0x7ffab4004800 2024-03-30T13:12:19.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.206+0000 7ffacf400640 1 -- 172.21.15.44:0/1075070842 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc009690 con 0x7ffab4004800 2024-03-30T13:12:19.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.207+0000 7ffad6200640 1 -- 172.21.15.44:0/1075070842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab4004800 msgr2=0x7ffab4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.207+0000 7ffad6200640 1 --2- 172.21.15.44:0/1075070842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffab4004800 0x7ffab4004c80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009a90 tx=0x7ffab4005830 comp rx=0 tx=0).stop 2024-03-30T13:12:19.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.207+0000 7ffad5800640 1 -- 172.21.15.44:0/1075070842 reap_dead start 2024-03-30T13:12:19.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.207+0000 7ffad6200640 1 -- 172.21.15.44:0/1075070842 shutdown_connections 2024-03-30T13:12:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.207+0000 7ffad6200640 1 -- 172.21.15.44:0/1075070842 >> 172.21.15.44:0/1075070842 conn(0x7ffad006b9a0 msgr2=0x7ffad006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.207+0000 7ffad6200640 1 -- 172.21.15.44:0/1075070842 shutdown_connections 2024-03-30T13:12:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.207+0000 7ffad6200640 1 -- 172.21.15.44:0/1075070842 wait complete. 2024-03-30T13:12:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.209+0000 7ffad6200640 1 Processor -- start 2024-03-30T13:12:19.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.209+0000 7ffad6200640 1 -- start start 2024-03-30T13:12:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffad6200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4004800 0x7ffad013a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffad6200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad0071f00 0x7ffad0072380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffad6200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad013b280 0x7ffad013b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffad6200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffad0160940 con 0x7ffad0071f00 2024-03-30T13:12:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffad6200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffad0160660 con 0x7ffad013b280 2024-03-30T13:12:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffad6200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ffad00cca20 con 0x7ffab4004800 2024-03-30T13:12:19.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffacfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad0071f00 0x7ffad0072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffacfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad0071f00 0x7ffad0072380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38174/0 (socket says 172.21.15.44:38174) 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffacfe00640 1 -- 172.21.15.44:0/1264310775 learned_addr learned my addr 172.21.15.44:0/1264310775 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffad5800640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad013b280 0x7ffad013b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffacfe00640 1 -- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4004800 msgr2=0x7ffad013a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffacfe00640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4004800 0x7ffad013a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffacfe00640 1 -- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad013b280 msgr2=0x7ffad013b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffacfe00640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad013b280 0x7ffad013b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.210+0000 7ffacfe00640 1 -- 172.21.15.44:0/1264310775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad013ad60 con 0x7ffad0071f00 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.211+0000 7ffacfe00640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad0071f00 0x7ffad0072380 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009bb0 tx=0x7ffabc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.211+0000 7ffaccc00640 1 -- 172.21.15.44:0/1264310775 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc042020 con 0x7ffad0071f00 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.211+0000 7ffaccc00640 1 -- 172.21.15.44:0/1264310775 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc03a040 con 0x7ffad0071f00 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.211+0000 7ffaccc00640 1 -- 172.21.15.44:0/1264310775 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc039070 con 0x7ffad0071f00 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.211+0000 7ffad6200640 1 -- 172.21.15.44:0/1264310775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad015d4a0 con 0x7ffad0071f00 2024-03-30T13:12:19.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.211+0000 7ffad6200640 1 -- 172.21.15.44:0/1264310775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad015da60 con 0x7ffad0071f00 2024-03-30T13:12:19.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.212+0000 7ffad6200640 1 -- 172.21.15.44:0/1264310775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad0075890 con 0x7ffad0071f00 2024-03-30T13:12:19.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.213+0000 7ffaccc00640 1 -- 172.21.15.44:0/1264310775 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ffabc045020 con 0x7ffad0071f00 2024-03-30T13:12:19.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.214+0000 7ffaccc00640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffab006c560 0x7ffab006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.214+0000 7ffaccc00640 1 -- 172.21.15.44:0/1264310775 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ffabc0ac910 con 0x7ffad0071f00 2024-03-30T13:12:19.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.215+0000 7ffad4e00640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffab006c560 0x7ffab006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:19.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.216+0000 7ffad4e00640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffab006c560 0x7ffab006ea20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffac0002230 tx=0x7ffac0001250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:19.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.219+0000 7ffaccc00640 1 -- 172.21.15.44:0/1264310775 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ffabc07ab50 con 0x7ffad0071f00 2024-03-30T13:12:19.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.455+0000 7ffad6200640 1 -- 172.21.15.44:0/1264310775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffad006ef60 con 0x7ffad0071f00 2024-03-30T13:12:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.456+0000 7ffaccc00640 1 -- 172.21.15.44:0/1264310775 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7ffabc07a450 con 0x7ffad0071f00 2024-03-30T13:12:19.461 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:19.461 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1458748329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1458748329},{"type":"v1","addr":"172.21.15.44:6834","nonce":1458748329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3921281718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3921281718},{"type":"v1","addr":"172.21.15.151:6837","nonce":3921281718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2065829800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2065829800},{"type":"v1","addr":"172.21.15.44:6835","nonce":2065829800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:11:40.531273+0000","modified":"2024-03-30T13:12:07.711287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/456394190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":456394190},{"type":"v1","addr":"172.21.15.151:6835","nonce":456394190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276]},"id":1}]} 2024-03-30T13:12:19.461 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-03-30T13:12:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.458+0000 7ffad6200640 1 -- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffab006c560 msgr2=0x7ffab006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.458+0000 7ffad6200640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffab006c560 0x7ffab006ea20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffac0002230 tx=0x7ffac0001250 comp rx=0 tx=0).stop 2024-03-30T13:12:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.458+0000 7ffad6200640 1 -- 172.21.15.44:0/1264310775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad0071f00 msgr2=0x7ffad0072380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.458+0000 7ffad6200640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad0071f00 0x7ffad0072380 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009bb0 tx=0x7ffabc004730 comp rx=0 tx=0).stop 2024-03-30T13:12:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.459+0000 7ffad6200640 1 -- 172.21.15.44:0/1264310775 shutdown_connections 2024-03-30T13:12:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.459+0000 7ffad6200640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffab006c560 0x7ffab006ea20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.459+0000 7ffad6200640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad013b280 0x7ffad013b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.459+0000 7ffad6200640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffad0071f00 0x7ffad0072380 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.459+0000 7ffad6200640 1 --2- 172.21.15.44:0/1264310775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4004800 0x7ffad013a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.459+0000 7ffad6200640 1 -- 172.21.15.44:0/1264310775 >> 172.21.15.44:0/1264310775 conn(0x7ffad006b9a0 msgr2=0x7ffad0071700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.459+0000 7ffad6200640 1 -- 172.21.15.44:0/1264310775 shutdown_connections 2024-03-30T13:12:19.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.459+0000 7ffad6200640 1 -- 172.21.15.44:0/1264310775 wait complete. 2024-03-30T13:12:19.482 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:19.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.685+0000 7f39f0000640 1 Processor -- start 2024-03-30T13:12:19.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.685+0000 7f39f0000640 1 -- start start 2024-03-30T13:12:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.686+0000 7f39f0000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f39e815f7e0 0x7f39e80cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.686+0000 7f39f0000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e815b650 con 0x7f39e80ccf10 2024-03-30T13:12:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.686+0000 7f39f0000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e8072ab0 con 0x7f39e815b270 2024-03-30T13:12:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.686+0000 7f39f0000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f39e80cd380 con 0x7f39e815f7e0 2024-03-30T13:12:19.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.687+0000 7f39ecc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f39e815f7e0 0x7f39e80cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.687+0000 7f39ee000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f39e80ccf10 0x7f39e80ca9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44054/0 (socket says 172.21.15.44:44054) 2024-03-30T13:12:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.687+0000 7f39ee000640 1 -- 172.21.15.44:0/2905106908 learned_addr learned my addr 172.21.15.44:0/2905106908 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.687+0000 7f39ecc00640 1 -- 172.21.15.44:0/2905106908 >> v1:172.21.15.151:6789/0 conn(0x7f39e815b270 legacy=0x7f39e8072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.687+0000 7f39ecc00640 1 -- 172.21.15.44:0/2905106908 >> v1:172.21.15.44:6789/0 conn(0x7f39e80ccf10 legacy=0x7f39e80ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.687+0000 7f39ecc00640 1 -- 172.21.15.44:0/2905106908 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e8072d90 con 0x7f39e815f7e0 2024-03-30T13:12:19.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.687+0000 7f39e7e00640 1 -- 172.21.15.44:0/2905106908 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733105535 0 0) 0x7f39e815b650 con 0x7f39e80ccf10 2024-03-30T13:12:19.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.689+0000 7f39ecc00640 1 --2- 172.21.15.44:0/2905106908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e815f7e0 0x7f39e80cc9d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009d90 tx=0x7f39dc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bdced9cbba1d8d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:19.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.689+0000 7f39e7e00640 1 -- 172.21.15.44:0/2905106908 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc039070 con 0x7f39e815f7e0 2024-03-30T13:12:19.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.689+0000 7f39e7e00640 1 -- 172.21.15.44:0/2905106908 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc02cd00 con 0x7f39e815f7e0 2024-03-30T13:12:19.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.689+0000 7f39e7e00640 1 -- 172.21.15.44:0/2905106908 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc034660 con 0x7f39e815f7e0 2024-03-30T13:12:19.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.690+0000 7f39f0000640 1 -- 172.21.15.44:0/2905106908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e815f7e0 msgr2=0x7f39e80cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.690+0000 7f39f0000640 1 --2- 172.21.15.44:0/2905106908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e815f7e0 0x7f39e80cc9d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009d90 tx=0x7f39dc02bf50 comp rx=0 tx=0).stop 2024-03-30T13:12:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.690+0000 7f39f0000640 1 -- 172.21.15.44:0/2905106908 shutdown_connections 2024-03-30T13:12:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.690+0000 7f39f0000640 1 --2- 172.21.15.44:0/2905106908 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e815f7e0 0x7f39e80cc9d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.690+0000 7f39f0000640 1 -- 172.21.15.44:0/2905106908 >> 172.21.15.44:0/2905106908 conn(0x7f39e80b1c90 msgr2=0x7f39e80b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.690+0000 7f39f0000640 1 -- 172.21.15.44:0/2905106908 shutdown_connections 2024-03-30T13:12:19.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.690+0000 7f39f0000640 1 -- 172.21.15.44:0/2905106908 wait complete. 2024-03-30T13:12:19.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.691+0000 7f39f0000640 1 Processor -- start 2024-03-30T13:12:19.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.692+0000 7f39f0000640 1 -- start start 2024-03-30T13:12:19.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.693+0000 7f39f0000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e80ccf10 0x7f39e814acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.693+0000 7f39f0000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39e815b270 0x7f39e80c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.693+0000 7f39f0000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39e815f7e0 0x7f39e81e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.693+0000 7f39f0000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f39e8073350 con 0x7f39e80ccf10 2024-03-30T13:12:19.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.693+0000 7f39f0000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f39e815fc40 con 0x7f39e815b270 2024-03-30T13:12:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.693+0000 7f39f0000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f39e8073630 con 0x7f39e815f7e0 2024-03-30T13:12:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.693+0000 7f39ed600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e80ccf10 0x7f39e814acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.693+0000 7f39ed600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e80ccf10 0x7f39e814acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38190/0 (socket says 172.21.15.44:38190) 2024-03-30T13:12:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.693+0000 7f39ed600640 1 -- 172.21.15.44:0/1654980365 learned_addr learned my addr 172.21.15.44:0/1654980365 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.693+0000 7f39ee000640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39e815f7e0 0x7f39e81e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.693+0000 7f39ecc00640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39e815b270 0x7f39e80c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.694+0000 7f39ed600640 1 -- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39e815f7e0 msgr2=0x7f39e81e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.694+0000 7f39ed600640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39e815f7e0 0x7f39e81e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.694+0000 7f39ed600640 1 -- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39e815b270 msgr2=0x7f39e80c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.694+0000 7f39ed600640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39e815b270 0x7f39e80c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.694+0000 7f39ed600640 1 -- 172.21.15.44:0/1654980365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e81e6d30 con 0x7f39e80ccf10 2024-03-30T13:12:19.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.694+0000 7f39ed600640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e80ccf10 0x7f39e814acb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f39d800c450 tx=0x7f39d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:19.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.694+0000 7f39e5600640 1 -- 172.21.15.44:0/1654980365 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d80052d0 con 0x7f39e80ccf10 2024-03-30T13:12:19.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.694+0000 7f39e5600640 1 -- 172.21.15.44:0/1654980365 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d8005470 con 0x7f39e80ccf10 2024-03-30T13:12:19.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.694+0000 7f39e5600640 1 -- 172.21.15.44:0/1654980365 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8012870 con 0x7f39e80ccf10 2024-03-30T13:12:19.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.694+0000 7f39f0000640 1 -- 172.21.15.44:0/1654980365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e815d100 con 0x7f39e80ccf10 2024-03-30T13:12:19.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.694+0000 7f39f0000640 1 -- 172.21.15.44:0/1654980365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e815d6c0 con 0x7f39e80ccf10 2024-03-30T13:12:19.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.695+0000 7f39f0000640 1 -- 172.21.15.44:0/1654980365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e8075a10 con 0x7f39e80ccf10 2024-03-30T13:12:19.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.696+0000 7f39e5600640 1 -- 172.21.15.44:0/1654980365 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f39d8012a10 con 0x7f39e80ccf10 2024-03-30T13:12:19.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.697+0000 7f39e5600640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f39cc06c530 0x7f39cc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:19.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.697+0000 7f39e5600640 1 -- 172.21.15.44:0/1654980365 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f39d808b7a0 con 0x7f39e80ccf10 2024-03-30T13:12:19.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.698+0000 7f39ecc00640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f39cc06c530 0x7f39cc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:19.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.699+0000 7f39ecc00640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f39cc06c530 0x7f39cc06e9f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f39dc036000 tx=0x7f39dc030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:19.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.702+0000 7f39e5600640 1 -- 172.21.15.44:0/1654980365 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f39d8059950 con 0x7f39e80ccf10 2024-03-30T13:12:19.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.897+0000 7f39f0000640 1 -- 172.21.15.44:0/1654980365 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39e80cd720 con 0x7f39e80ccf10 2024-03-30T13:12:19.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.900+0000 7f39e5600640 1 -- 172.21.15.44:0/1654980365 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7f39d8059250 con 0x7f39e80ccf10 2024-03-30T13:12:19.905 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:19.905 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.902+0000 7f39f0000640 1 -- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f39cc06c530 msgr2=0x7f39cc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.902+0000 7f39f0000640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f39cc06c530 0x7f39cc06e9f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f39dc036000 tx=0x7f39dc030000 comp rx=0 tx=0).stop 2024-03-30T13:12:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.903+0000 7f39f0000640 1 -- 172.21.15.44:0/1654980365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e80ccf10 msgr2=0x7f39e814acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.903+0000 7f39f0000640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e80ccf10 0x7f39e814acb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f39d800c450 tx=0x7f39d800c910 comp rx=0 tx=0).stop 2024-03-30T13:12:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.903+0000 7f39f0000640 1 -- 172.21.15.44:0/1654980365 shutdown_connections 2024-03-30T13:12:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.903+0000 7f39f0000640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39e815f7e0 0x7f39e81e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.903+0000 7f39f0000640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f39cc06c530 0x7f39cc06e9f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.903+0000 7f39f0000640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39e815b270 0x7f39e80c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.903+0000 7f39f0000640 1 --2- 172.21.15.44:0/1654980365 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f39e80ccf10 0x7f39e814acb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.903+0000 7f39f0000640 1 -- 172.21.15.44:0/1654980365 >> 172.21.15.44:0/1654980365 conn(0x7f39e80b1c90 msgr2=0x7f39e80ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:19.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.903+0000 7f39f0000640 1 -- 172.21.15.44:0/1654980365 shutdown_connections 2024-03-30T13:12:19.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:19.903+0000 7f39f0000640 1 -- 172.21.15.44:0/1654980365 wait complete. 2024-03-30T13:12:19.926 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:12:19.927 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:12:20.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.129+0000 7f4b65e00640 1 Processor -- start 2024-03-30T13:12:20.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.130+0000 7f4b65e00640 1 -- start start 2024-03-30T13:12:20.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.131+0000 7f4b65e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4b600b4d00 0x7f4b600d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.131+0000 7f4b65e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600d0b90 0x7f4b600d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.131+0000 7f4b65e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b600b54b0 con 0x7f4b600b4920 2024-03-30T13:12:20.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.131+0000 7f4b65e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f4b600d0260 con 0x7f4b600b4d00 2024-03-30T13:12:20.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.131+0000 7f4b65e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4b600cfca0 con 0x7f4b600d0b90 2024-03-30T13:12:20.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.131+0000 7f4b64a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4b600b4920 0x7f4b600b3ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44062/0 (socket says 172.21.15.44:44062) 2024-03-30T13:12:20.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.131+0000 7f4b64a00640 1 -- 172.21.15.44:0/1359369788 learned_addr learned my addr 172.21.15.44:0/1359369788 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:20.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b65400640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600d0b90 0x7f4b600d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5fe00640 1 --2- 172.21.15.44:0/1359369788 >> v2:172.21.15.151:3300/0 conn(0x7f4b600b4d00 0x7f4b600d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184133128 0 0) 0x7f4b50001490 con 0x7f4b600b4920 2024-03-30T13:12:20.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b44003520 con 0x7f4b600b4920 2024-03-30T13:12:20.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4028708681 0 0) 0x7f4b44003520 con 0x7f4b600b4920 2024-03-30T13:12:20.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600d0b90 msgr2=0x7f4b600d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:20.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600d0b90 0x7f4b600d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 >> v2:172.21.15.151:3300/0 conn(0x7f4b600b4d00 msgr2=0x7f4b600d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 --2- 172.21.15.44:0/1359369788 >> v2:172.21.15.151:3300/0 conn(0x7f4b600b4d00 0x7f4b600d4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b600cff80 con 0x7f4b600b4920 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f4b50001bc0 con 0x7f4b600b4920 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 >> v1:172.21.15.44:6789/0 conn(0x7f4b600b4920 legacy=0x7f4b600b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600d0b90 0x7f4b440039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b44003f80 0x7f4b44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b44004d40 0x7f4b440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4b600d0260 con 0x7f4b44004d40 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4b600cfca0 con 0x7f4b44003f80 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.132+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4b4400ba70 con 0x7f4b600d0b90 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.133+0000 7f4b65400640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b44004d40 0x7f4b440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.133+0000 7f4b5fe00640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b44003f80 0x7f4b44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.133+0000 7f4b64a00640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600d0b90 0x7f4b440039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.133+0000 7f4b65400640 1 -- 172.21.15.44:0/1359369788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600d0b90 msgr2=0x7f4b440039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:20.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.133+0000 7f4b65400640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600d0b90 0x7f4b440039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.133+0000 7f4b65400640 1 -- 172.21.15.44:0/1359369788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b44003f80 msgr2=0x7f4b44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:20.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.133+0000 7f4b65400640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b44003f80 0x7f4b44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.133+0000 7f4b65400640 1 -- 172.21.15.44:0/1359369788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b44003520 con 0x7f4b44004d40 2024-03-30T13:12:20.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.133+0000 7f4b5fe00640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b44003f80 0x7f4b44004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.134+0000 7f4b65400640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b44004d40 0x7f4b440051c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009ac0 tx=0x7f4b44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bdacbb4639eea7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.135+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58039070 con 0x7f4b44004d40 2024-03-30T13:12:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.135+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b5802c6b0 con 0x7f4b44004d40 2024-03-30T13:12:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.135+0000 7f4b5f400640 1 -- 172.21.15.44:0/1359369788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58009690 con 0x7f4b44004d40 2024-03-30T13:12:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.135+0000 7f4b65e00640 1 -- 172.21.15.44:0/1359369788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b44004d40 msgr2=0x7f4b440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.135+0000 7f4b65e00640 1 --2- 172.21.15.44:0/1359369788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b44004d40 0x7f4b440051c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009ac0 tx=0x7f4b44005830 comp rx=0 tx=0).stop 2024-03-30T13:12:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.135+0000 7f4b65400640 1 -- 172.21.15.44:0/1359369788 reap_dead start 2024-03-30T13:12:20.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.135+0000 7f4b65e00640 1 -- 172.21.15.44:0/1359369788 shutdown_connections 2024-03-30T13:12:20.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.135+0000 7f4b65e00640 1 -- 172.21.15.44:0/1359369788 >> 172.21.15.44:0/1359369788 conn(0x7f4b6009d4e0 msgr2=0x7f4b600d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:20.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.135+0000 7f4b65e00640 1 -- 172.21.15.44:0/1359369788 shutdown_connections 2024-03-30T13:12:20.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.135+0000 7f4b65e00640 1 -- 172.21.15.44:0/1359369788 wait complete. 2024-03-30T13:12:20.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.137+0000 7f4b65e00640 1 Processor -- start 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.137+0000 7f4b65e00640 1 -- start start 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.138+0000 7f4b65e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b44004d40 0x7f4b601521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.138+0000 7f4b65e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b600b80a0 0x7f4b600cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.138+0000 7f4b65e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600b96b0 0x7f4b6006ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.138+0000 7f4b65e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4b600d5000 con 0x7f4b600b80a0 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.138+0000 7f4b65e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4b600d2180 con 0x7f4b44004d40 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.138+0000 7f4b65e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4b600cf8c0 con 0x7f4b600b96b0 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.138+0000 7f4b5fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b600b80a0 0x7f4b600cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.138+0000 7f4b5fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b600b80a0 0x7f4b600cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38208/0 (socket says 172.21.15.44:38208) 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.138+0000 7f4b5fe00640 1 -- 172.21.15.44:0/1811372644 learned_addr learned my addr 172.21.15.44:0/1811372644 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.139+0000 7f4b64a00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b44004d40 0x7f4b601521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.139+0000 7f4b65400640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600b96b0 0x7f4b6006ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.139+0000 7f4b5fe00640 1 -- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600b96b0 msgr2=0x7f4b6006ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.139+0000 7f4b5fe00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600b96b0 0x7f4b6006ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.139+0000 7f4b5fe00640 1 -- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b44004d40 msgr2=0x7f4b601521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.139+0000 7f4b5fe00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b44004d40 0x7f4b601521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.139+0000 7f4b5fe00640 1 -- 172.21.15.44:0/1811372644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b600b8610 con 0x7f4b600b80a0 2024-03-30T13:12:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.139+0000 7f4b65400640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600b96b0 0x7f4b6006ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:20.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.139+0000 7f4b5fe00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b600b80a0 0x7f4b600cdf30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c011600 tx=0x7f4b4c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.139+0000 7f4b5cc00640 1 -- 172.21.15.44:0/1811372644 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c015870 con 0x7f4b600b80a0 2024-03-30T13:12:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.140+0000 7f4b5cc00640 1 -- 172.21.15.44:0/1811372644 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4c015a10 con 0x7f4b600b80a0 2024-03-30T13:12:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.140+0000 7f4b65e00640 1 -- 172.21.15.44:0/1811372644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b600b88f0 con 0x7f4b600b80a0 2024-03-30T13:12:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.140+0000 7f4b5cc00640 1 -- 172.21.15.44:0/1811372644 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c015de0 con 0x7f4b600b80a0 2024-03-30T13:12:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.140+0000 7f4b65e00640 1 -- 172.21.15.44:0/1811372644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b600b8eb0 con 0x7f4b600b80a0 2024-03-30T13:12:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.141+0000 7f4b65e00640 1 -- 172.21.15.44:0/1811372644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b60075890 con 0x7f4b600b80a0 2024-03-30T13:12:20.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.142+0000 7f4b5cc00640 1 -- 172.21.15.44:0/1811372644 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4b4c00f450 con 0x7f4b600b80a0 2024-03-30T13:12:20.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.143+0000 7f4b5cc00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4b4006c530 0x7f4b4006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.143+0000 7f4b5cc00640 1 -- 172.21.15.44:0/1811372644 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4b4c08c320 con 0x7f4b600b80a0 2024-03-30T13:12:20.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.143+0000 7f4b64a00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4b4006c530 0x7f4b4006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.144+0000 7f4b64a00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4b4006c530 0x7f4b4006e9f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4b50001630 tx=0x7f4b50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:20.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.147+0000 7f4b5cc00640 1 -- 172.21.15.44:0/1811372644 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4b4c019030 con 0x7f4b600b80a0 2024-03-30T13:12:20.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.351+0000 7f4b65e00640 1 -- 172.21.15.44:0/1811372644 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4b600d43e0 con 0x7f4b600b80a0 2024-03-30T13:12:20.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.352+0000 7f4b5cc00640 1 -- 172.21.15.44:0/1811372644 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f4b4c05a600 con 0x7f4b600b80a0 2024-03-30T13:12:20.357 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:12:20.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.355+0000 7f4b65e00640 1 -- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4b4006c530 msgr2=0x7f4b4006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.355+0000 7f4b65e00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4b4006c530 0x7f4b4006e9f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4b50001630 tx=0x7f4b50009040 comp rx=0 tx=0).stop 2024-03-30T13:12:20.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.355+0000 7f4b65e00640 1 -- 172.21.15.44:0/1811372644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b600b80a0 msgr2=0x7f4b600cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.355+0000 7f4b65e00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b600b80a0 0x7f4b600cdf30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c011600 tx=0x7f4b4c011ac0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.355+0000 7f4b65e00640 1 -- 172.21.15.44:0/1811372644 shutdown_connections 2024-03-30T13:12:20.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.355+0000 7f4b65e00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b600b96b0 0x7f4b6006ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.355+0000 7f4b65e00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4b600b80a0 0x7f4b600cdf30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.355+0000 7f4b65e00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4b4006c530 0x7f4b4006e9f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.355+0000 7f4b65e00640 1 --2- 172.21.15.44:0/1811372644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b44004d40 0x7f4b601521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.355+0000 7f4b65e00640 1 -- 172.21.15.44:0/1811372644 >> 172.21.15.44:0/1811372644 conn(0x7f4b6009d4e0 msgr2=0x7f4b60161750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:20.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.356+0000 7f4b65e00640 1 -- 172.21.15.44:0/1811372644 shutdown_connections 2024-03-30T13:12:20.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.356+0000 7f4b65e00640 1 -- 172.21.15.44:0/1811372644 wait complete. 2024-03-30T13:12:20.378 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:12:20.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.585+0000 7f9804c00640 1 Processor -- start 2024-03-30T13:12:20.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.586+0000 7f9804c00640 1 -- start start 2024-03-30T13:12:20.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.587+0000 7f9804c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f980006e980 0x7f9800072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.587+0000 7f9804c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f98000acd60 0x7f980015d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.587+0000 7f9804c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f980015d5b0 con 0x7f98000ae9d0 2024-03-30T13:12:20.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.587+0000 7f9804c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f98000ad5c0 con 0x7f98000acd60 2024-03-30T13:12:20.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.587+0000 7f9804c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f9800071450 con 0x7f980006e980 2024-03-30T13:12:20.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.588+0000 7f97f7e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f98000acd60 0x7f980015d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.588+0000 7f97ff400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f980006e980 0x7f9800072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.588+0000 7f97ff400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f980006e980 0x7f9800072180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:49610/0 (socket says 172.21.15.44:49610) 2024-03-30T13:12:20.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.588+0000 7f97ff400640 1 -- 172.21.15.44:0/505232141 learned_addr learned my addr 172.21.15.44:0/505232141 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:20.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.589+0000 7f97ff400640 1 -- 172.21.15.44:0/505232141 >> v2:172.21.15.151:3300/0 conn(0x7f98000acd60 msgr2=0x7f980015d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:20.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.589+0000 7f97ff400640 1 --2- 172.21.15.44:0/505232141 >> v2:172.21.15.151:3300/0 conn(0x7f98000acd60 0x7f980015d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.589+0000 7f97ff400640 1 -- 172.21.15.44:0/505232141 >> v1:172.21.15.151:6789/0 conn(0x7f98000ae9d0 legacy=0x7f98000aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.589+0000 7f97ff400640 1 -- 172.21.15.44:0/505232141 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98000ad2e0 con 0x7f980006e980 2024-03-30T13:12:20.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.589+0000 7f97f7e00640 1 --2- 172.21.15.44:0/505232141 >> v2:172.21.15.151:3300/0 conn(0x7f98000acd60 0x7f980015d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.590+0000 7f97ff400640 1 --2- 172.21.15.44:0/505232141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f980006e980 0x7f9800072180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009870 tx=0x7f97f002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=729f325e98cca8a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.591+0000 7f97fea00640 1 -- 172.21.15.44:0/505232141 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0035020 con 0x7f980006e980 2024-03-30T13:12:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.591+0000 7f97fea00640 1 -- 172.21.15.44:0/505232141 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f0031870 con 0x7f980006e980 2024-03-30T13:12:20.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.591+0000 7f97fea00640 1 -- 172.21.15.44:0/505232141 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0031c40 con 0x7f980006e980 2024-03-30T13:12:20.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.591+0000 7f9804c00640 1 -- 172.21.15.44:0/505232141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f980006e980 msgr2=0x7f9800072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.591+0000 7f9804c00640 1 --2- 172.21.15.44:0/505232141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f980006e980 0x7f9800072180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009870 tx=0x7f97f002b910 comp rx=0 tx=0).stop 2024-03-30T13:12:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.591+0000 7f9804c00640 1 -- 172.21.15.44:0/505232141 shutdown_connections 2024-03-30T13:12:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.591+0000 7f9804c00640 1 --2- 172.21.15.44:0/505232141 >> v2:172.21.15.151:3300/0 conn(0x7f98000acd60 0x7f980015d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.591+0000 7f9804c00640 1 --2- 172.21.15.44:0/505232141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f980006e980 0x7f9800072180 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.591+0000 7f9804c00640 1 -- 172.21.15.44:0/505232141 >> 172.21.15.44:0/505232141 conn(0x7f98000cfd90 msgr2=0x7f98000d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.591+0000 7f9804c00640 1 -- 172.21.15.44:0/505232141 shutdown_connections 2024-03-30T13:12:20.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.591+0000 7f9804c00640 1 -- 172.21.15.44:0/505232141 wait complete. 2024-03-30T13:12:20.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.593+0000 7f9804c00640 1 Processor -- start 2024-03-30T13:12:20.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.593+0000 7f9804c00640 1 -- start start 2024-03-30T13:12:20.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.594+0000 7f9804c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f980006e980 0x7f98001f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.594+0000 7f9804c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98000acd60 0x7f98000cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.594+0000 7f9804c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98000ae9d0 0x7f98000cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.594+0000 7f9804c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9800071c60 con 0x7f980006e980 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.594+0000 7f9804c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9800071980 con 0x7f98000ae9d0 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.594+0000 7f9804c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f9800156020 con 0x7f98000acd60 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.594+0000 7f97ff400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f980006e980 0x7f98001f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.594+0000 7f97ff400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f980006e980 0x7f98001f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38212/0 (socket says 172.21.15.44:38212) 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.595+0000 7f97ff400640 1 -- 172.21.15.44:0/748547020 learned_addr learned my addr 172.21.15.44:0/748547020 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.595+0000 7f97ffe00640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98000ae9d0 0x7f98000cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.595+0000 7f97f7e00640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98000acd60 0x7f98000cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.595+0000 7f97ff400640 1 -- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98000acd60 msgr2=0x7f98000cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.595+0000 7f97ff400640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98000acd60 0x7f98000cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.595+0000 7f97ff400640 1 -- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98000ae9d0 msgr2=0x7f98000cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.595+0000 7f97ff400640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98000ae9d0 0x7f98000cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.595+0000 7f97ff400640 1 -- 172.21.15.44:0/748547020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98000cd240 con 0x7f980006e980 2024-03-30T13:12:20.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.595+0000 7f97ffe00640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98000ae9d0 0x7f98000cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:20.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.595+0000 7f97ff400640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f980006e980 0x7f98001f51e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f97f0000c00 tx=0x7f97f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:20.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.596+0000 7f97f7400640 1 -- 172.21.15.44:0/748547020 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0040070 con 0x7f980006e980 2024-03-30T13:12:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.596+0000 7f97f7400640 1 -- 172.21.15.44:0/748547020 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f0030d00 con 0x7f980006e980 2024-03-30T13:12:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.596+0000 7f97f7400640 1 -- 172.21.15.44:0/748547020 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0035040 con 0x7f980006e980 2024-03-30T13:12:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.596+0000 7f9804c00640 1 -- 172.21.15.44:0/748547020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98000c9a90 con 0x7f980006e980 2024-03-30T13:12:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.596+0000 7f9804c00640 1 -- 172.21.15.44:0/748547020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98000ca050 con 0x7f980006e980 2024-03-30T13:12:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.597+0000 7f9804c00640 1 -- 172.21.15.44:0/748547020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98000cc240 con 0x7f980006e980 2024-03-30T13:12:20.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.598+0000 7f97f7400640 1 -- 172.21.15.44:0/748547020 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f97f004b060 con 0x7f980006e980 2024-03-30T13:12:20.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.599+0000 7f97f7400640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f97dc06c560 0x7f97dc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:20.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.599+0000 7f97f7400640 1 -- 172.21.15.44:0/748547020 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f97f00ad760 con 0x7f980006e980 2024-03-30T13:12:20.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.600+0000 7f97f7e00640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f97dc06c560 0x7f97dc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:20.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.601+0000 7f97f7e00640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f97dc06c560 0x7f97dc06ea20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f97e8009560 tx=0x7f97e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:20.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.606+0000 7f97f7400640 1 -- 172.21.15.44:0/748547020 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f97f007b9a0 con 0x7f980006e980 2024-03-30T13:12:20.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.809+0000 7f9804c00640 1 -- 172.21.15.44:0/748547020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9800075890 con 0x7f980006e980 2024-03-30T13:12:20.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.809+0000 7f97f7400640 1 -- 172.21.15.44:0/748547020 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f97f007b2a0 con 0x7f980006e980 2024-03-30T13:12:20.814 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:20.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.812+0000 7f9804c00640 1 -- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f97dc06c560 msgr2=0x7f97dc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.812+0000 7f9804c00640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f97dc06c560 0x7f97dc06ea20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f97e8009560 tx=0x7f97e8008040 comp rx=0 tx=0).stop 2024-03-30T13:12:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.812+0000 7f9804c00640 1 -- 172.21.15.44:0/748547020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f980006e980 msgr2=0x7f98001f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.812+0000 7f9804c00640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f980006e980 0x7f98001f51e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f97f0000c00 tx=0x7f97f00046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.812+0000 7f9804c00640 1 -- 172.21.15.44:0/748547020 shutdown_connections 2024-03-30T13:12:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.812+0000 7f9804c00640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f97dc06c560 0x7f97dc06ea20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.812+0000 7f9804c00640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98000ae9d0 0x7f98000cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.812+0000 7f9804c00640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98000acd60 0x7f98000cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.812+0000 7f9804c00640 1 --2- 172.21.15.44:0/748547020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f980006e980 0x7f98001f51e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.812+0000 7f9804c00640 1 -- 172.21.15.44:0/748547020 >> 172.21.15.44:0/748547020 conn(0x7f98000cfd90 msgr2=0x7f98000aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.812+0000 7f9804c00640 1 -- 172.21.15.44:0/748547020 shutdown_connections 2024-03-30T13:12:20.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:20.812+0000 7f9804c00640 1 -- 172.21.15.44:0/748547020 wait complete. 2024-03-30T13:12:20.837 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:12:21.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.062+0000 7f1bd1800640 1 Processor -- start 2024-03-30T13:12:21.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.062+0000 7f1bd1800640 1 -- start start 2024-03-30T13:12:21.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.064+0000 7f1bd1800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc15c040 0x7f1bcc15f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.064+0000 7f1bd1800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1bcc0d4880 0x7f1bcc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.064+0000 7f1bd1800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bcc0d32b0 con 0x7f1bcc0d18f0 2024-03-30T13:12:21.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.064+0000 7f1bd1800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f1bcc0d2210 con 0x7f1bcc0d4880 2024-03-30T13:12:21.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.064+0000 7f1bd1800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1bcc0d24f0 con 0x7f1bcc15c040 2024-03-30T13:12:21.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.064+0000 7f1bc3e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1bcc0d18f0 0x7f1bcc0d4170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44076/0 (socket says 172.21.15.44:44076) 2024-03-30T13:12:21.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.064+0000 7f1bc3e00640 1 -- 172.21.15.44:0/2713272514 learned_addr learned my addr 172.21.15.44:0/2713272514 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:21.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.064+0000 7f1bcbe00640 1 --2- 172.21.15.44:0/2713272514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc15c040 0x7f1bcc15f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.064+0000 7f1bd0e00640 1 --2- 172.21.15.44:0/2713272514 >> v2:172.21.15.151:3300/0 conn(0x7f1bcc0d4880 0x7f1bcc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 13401050 0 0) 0x7f1bcc0d32b0 con 0x7f1bcc0d18f0 2024-03-30T13:12:21.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bb0003520 con 0x7f1bcc0d18f0 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 424701005 0 0) 0x7f1bb0003520 con 0x7f1bcc0d18f0 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc15c040 msgr2=0x7f1bcc15f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 --2- 172.21.15.44:0/2713272514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc15c040 0x7f1bcc15f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 >> v2:172.21.15.151:3300/0 conn(0x7f1bcc0d4880 msgr2=0x7f1bcc0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 --2- 172.21.15.44:0/2713272514 >> v2:172.21.15.151:3300/0 conn(0x7f1bcc0d4880 0x7f1bcc0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc0d27d0 con 0x7f1bcc0d18f0 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f1bb4001670 con 0x7f1bcc0d18f0 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 >> v1:172.21.15.44:6789/0 conn(0x7f1bcc0d18f0 legacy=0x7f1bcc0d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 --2- 172.21.15.44:0/2713272514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc15c040 0x7f1bb00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 --2- 172.21.15.44:0/2713272514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb0003f30 0x7f1bb0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 --2- 172.21.15.44:0/2713272514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb0004d40 0x7f1bb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc0d2210 con 0x7f1bb0004d40 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc0d24f0 con 0x7f1bb0003f30 2024-03-30T13:12:21.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.065+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb000ba10 con 0x7f1bcc15c040 2024-03-30T13:12:21.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.066+0000 7f1bd0e00640 1 --2- 172.21.15.44:0/2713272514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb0004d40 0x7f1bb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.066+0000 7f1bcbe00640 1 --2- 172.21.15.44:0/2713272514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc15c040 0x7f1bb00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.066+0000 7f1bc3e00640 1 --2- 172.21.15.44:0/2713272514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb0003f30 0x7f1bb0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.066+0000 7f1bd0e00640 1 -- 172.21.15.44:0/2713272514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc15c040 msgr2=0x7f1bb00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.066+0000 7f1bd0e00640 1 --2- 172.21.15.44:0/2713272514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc15c040 0x7f1bb00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.066+0000 7f1bd0e00640 1 -- 172.21.15.44:0/2713272514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb0003f30 msgr2=0x7f1bb0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.066+0000 7f1bd0e00640 1 --2- 172.21.15.44:0/2713272514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb0003f30 0x7f1bb0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.066+0000 7f1bd0e00640 1 -- 172.21.15.44:0/2713272514 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb0003520 con 0x7f1bb0004d40 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.067+0000 7f1bd0e00640 1 --2- 172.21.15.44:0/2713272514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb0004d40 0x7f1bb00051c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009fc0 tx=0x7f1bb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e894c88ddda6221b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.068+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4039070 con 0x7f1bb0004d40 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.068+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc402cc00 con 0x7f1bb0004d40 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.068+0000 7f1bcb400640 1 -- 172.21.15.44:0/2713272514 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4009c10 con 0x7f1bb0004d40 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.068+0000 7f1bd1800640 1 -- 172.21.15.44:0/2713272514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb0004d40 msgr2=0x7f1bb00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.068+0000 7f1bd1800640 1 --2- 172.21.15.44:0/2713272514 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb0004d40 0x7f1bb00051c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009fc0 tx=0x7f1bb0005830 comp rx=0 tx=0).stop 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.068+0000 7f1bd0e00640 1 -- 172.21.15.44:0/2713272514 reap_dead start 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.068+0000 7f1bd1800640 1 -- 172.21.15.44:0/2713272514 shutdown_connections 2024-03-30T13:12:21.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.068+0000 7f1bd1800640 1 -- 172.21.15.44:0/2713272514 >> 172.21.15.44:0/2713272514 conn(0x7f1bcc08dbf0 msgr2=0x7f1bcc09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:21.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.069+0000 7f1bd1800640 1 -- 172.21.15.44:0/2713272514 shutdown_connections 2024-03-30T13:12:21.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.069+0000 7f1bd1800640 1 -- 172.21.15.44:0/2713272514 wait complete. 2024-03-30T13:12:21.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.070+0000 7f1bd1800640 1 Processor -- start 2024-03-30T13:12:21.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.071+0000 7f1bd1800640 1 -- start start 2024-03-30T13:12:21.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.071+0000 7f1bd1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb0004d40 0x7f1bcc0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.071+0000 7f1bd1800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc14d710 0x7f1bcc0b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.071+0000 7f1bd1800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bcc06c280 0x7f1bcc06c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.071+0000 7f1bd1800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc15c420 con 0x7f1bb0004d40 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.071+0000 7f1bd1800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc0d2d90 con 0x7f1bcc06c280 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.071+0000 7f1bd1800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1bcc0b5450 con 0x7f1bcc14d710 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.072+0000 7f1bcbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb0004d40 0x7f1bcc0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.072+0000 7f1bcbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb0004d40 0x7f1bcc0ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38226/0 (socket says 172.21.15.44:38226) 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.072+0000 7f1bcbe00640 1 -- 172.21.15.44:0/3982853199 learned_addr learned my addr 172.21.15.44:0/3982853199 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.072+0000 7f1bd0e00640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bcc06c280 0x7f1bcc06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.072+0000 7f1bc3e00640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc14d710 0x7f1bcc0b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.072+0000 7f1bcbe00640 1 -- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc14d710 msgr2=0x7f1bcc0b6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.072+0000 7f1bcbe00640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc14d710 0x7f1bcc0b6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.072+0000 7f1bcbe00640 1 -- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bcc06c280 msgr2=0x7f1bcc06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.072+0000 7f1bcbe00640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bcc06c280 0x7f1bcc06c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.072+0000 7f1bcbe00640 1 -- 172.21.15.44:0/3982853199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc0c9270 con 0x7f1bb0004d40 2024-03-30T13:12:21.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.072+0000 7f1bd0e00640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bcc06c280 0x7f1bcc06c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:21.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.073+0000 7f1bcbe00640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb0004d40 0x7f1bcc0ca310 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc011600 tx=0x7f1bbc011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:21.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.073+0000 7f1bc8c00640 1 -- 172.21.15.44:0/3982853199 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc00f920 con 0x7f1bb0004d40 2024-03-30T13:12:21.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.073+0000 7f1bc8c00640 1 -- 172.21.15.44:0/3982853199 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc00fac0 con 0x7f1bb0004d40 2024-03-30T13:12:21.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.073+0000 7f1bc8c00640 1 -- 172.21.15.44:0/3982853199 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc00fe70 con 0x7f1bb0004d40 2024-03-30T13:12:21.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.073+0000 7f1bd1800640 1 -- 172.21.15.44:0/3982853199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bcc0c9550 con 0x7f1bb0004d40 2024-03-30T13:12:21.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.073+0000 7f1bd1800640 1 -- 172.21.15.44:0/3982853199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bcc0c9b10 con 0x7f1bb0004d40 2024-03-30T13:12:21.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.074+0000 7f1bd1800640 1 -- 172.21.15.44:0/3982853199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bcc0b57e0 con 0x7f1bb0004d40 2024-03-30T13:12:21.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.075+0000 7f1bc8c00640 1 -- 172.21.15.44:0/3982853199 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1bbc015460 con 0x7f1bb0004d40 2024-03-30T13:12:21.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.076+0000 7f1bc8c00640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1ba806c5b0 0x7f1ba806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.076+0000 7f1bc8c00640 1 -- 172.21.15.44:0/3982853199 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1bbc08c320 con 0x7f1bb0004d40 2024-03-30T13:12:21.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.077+0000 7f1bc3e00640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1ba806c5b0 0x7f1ba806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.078+0000 7f1bc3e00640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1ba806c5b0 0x7f1ba806ea70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4001eb0 tx=0x7f1bb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:21.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.081+0000 7f1bc8c00640 1 -- 172.21.15.44:0/3982853199 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1bcc0b57e0 con 0x7f1bb0004d40 2024-03-30T13:12:21.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.285+0000 7f1bd1800640 1 -- 172.21.15.44:0/3982853199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1bcc075890 con 0x7f1bb0004d40 2024-03-30T13:12:21.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.286+0000 7f1bc8c00640 1 -- 172.21.15.44:0/3982853199 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f1bbc019030 con 0x7f1bb0004d40 2024-03-30T13:12:21.291 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:12:21.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.289+0000 7f1bd1800640 1 -- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1ba806c5b0 msgr2=0x7f1ba806ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.289+0000 7f1bd1800640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1ba806c5b0 0x7f1ba806ea70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4001eb0 tx=0x7f1bb4009040 comp rx=0 tx=0).stop 2024-03-30T13:12:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.289+0000 7f1bd1800640 1 -- 172.21.15.44:0/3982853199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb0004d40 msgr2=0x7f1bcc0ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.289+0000 7f1bd1800640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb0004d40 0x7f1bcc0ca310 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc011600 tx=0x7f1bbc011ac0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.289+0000 7f1bd1800640 1 -- 172.21.15.44:0/3982853199 shutdown_connections 2024-03-30T13:12:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.289+0000 7f1bd1800640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1ba806c5b0 0x7f1ba806ea70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.289+0000 7f1bd1800640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bcc06c280 0x7f1bcc06c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.289+0000 7f1bd1800640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bcc14d710 0x7f1bcc0b6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.289+0000 7f1bd1800640 1 --2- 172.21.15.44:0/3982853199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb0004d40 0x7f1bcc0ca310 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.289+0000 7f1bd1800640 1 -- 172.21.15.44:0/3982853199 >> 172.21.15.44:0/3982853199 conn(0x7f1bcc08dbf0 msgr2=0x7f1bcc0cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.289+0000 7f1bd1800640 1 -- 172.21.15.44:0/3982853199 shutdown_connections 2024-03-30T13:12:21.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.289+0000 7f1bd1800640 1 -- 172.21.15.44:0/3982853199 wait complete. 2024-03-30T13:12:21.313 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:12:21.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.526+0000 7ffbf7a00640 1 Processor -- start 2024-03-30T13:12:21.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.526+0000 7ffbf7a00640 1 -- start start 2024-03-30T13:12:21.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.528+0000 7ffbf7a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffbf013f0c0 0x7ffbf006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.528+0000 7ffbf7a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbf006d720 0x7ffbf015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.528+0000 7ffbf7a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffbf01603d0 0x7ffbf00cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.528+0000 7ffbf7a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ffbf0160e30 con 0x7ffbf01603d0 2024-03-30T13:12:21.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.528+0000 7ffbf7a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7ffbf00ce9c0 con 0x7ffbf013f0c0 2024-03-30T13:12:21.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.528+0000 7ffbf7a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ffbf0160b50 con 0x7ffbf006d720 2024-03-30T13:12:21.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.528+0000 7ffbf5a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffbf01603d0 0x7ffbf00cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.528+0000 7ffbf5a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffbf01603d0 0x7ffbf00cfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38234/0 (socket says 172.21.15.44:38234) 2024-03-30T13:12:21.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.528+0000 7ffbf5a00640 1 -- 172.21.15.44:0/2739856709 learned_addr learned my addr 172.21.15.44:0/2739856709 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:21.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.528+0000 7ffbf5000640 1 --2- 172.21.15.44:0/2739856709 >> v2:172.21.15.151:3300/0 conn(0x7ffbf013f0c0 0x7ffbf006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.528+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/2739856709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbf006d720 0x7ffbf015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.529+0000 7ffbf5a00640 1 -- 172.21.15.44:0/2739856709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbf006d720 msgr2=0x7ffbf015fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:21.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.529+0000 7ffbf5a00640 1 --2- 172.21.15.44:0/2739856709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbf006d720 0x7ffbf015fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.529+0000 7ffbf5a00640 1 -- 172.21.15.44:0/2739856709 >> v2:172.21.15.151:3300/0 conn(0x7ffbf013f0c0 msgr2=0x7ffbf006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:21.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.529+0000 7ffbf5a00640 1 --2- 172.21.15.44:0/2739856709 >> v2:172.21.15.151:3300/0 conn(0x7ffbf013f0c0 0x7ffbf006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.529+0000 7ffbf5a00640 1 -- 172.21.15.44:0/2739856709 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf013fa40 con 0x7ffbf01603d0 2024-03-30T13:12:21.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.530+0000 7ffbf5a00640 1 --2- 172.21.15.44:0/2739856709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf01603d0 0x7ffbf00cfbb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffbf006e2b0 tx=0x7ffbe802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccdee379470a51c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:21.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.530+0000 7ffbefe00640 1 -- 172.21.15.44:0/2739856709 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe802c950 con 0x7ffbf01603d0 2024-03-30T13:12:21.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.530+0000 7ffbefe00640 1 -- 172.21.15.44:0/2739856709 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe802caf0 con 0x7ffbf01603d0 2024-03-30T13:12:21.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.530+0000 7ffbefe00640 1 -- 172.21.15.44:0/2739856709 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe80343f0 con 0x7ffbf01603d0 2024-03-30T13:12:21.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.531+0000 7ffbf7a00640 1 -- 172.21.15.44:0/2739856709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf01603d0 msgr2=0x7ffbf00cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.531+0000 7ffbf7a00640 1 --2- 172.21.15.44:0/2739856709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf01603d0 0x7ffbf00cfbb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffbf006e2b0 tx=0x7ffbe802bdb0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.531+0000 7ffbf7a00640 1 -- 172.21.15.44:0/2739856709 shutdown_connections 2024-03-30T13:12:21.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.531+0000 7ffbf7a00640 1 --2- 172.21.15.44:0/2739856709 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf01603d0 0x7ffbf00cfbb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.531+0000 7ffbf7a00640 1 --2- 172.21.15.44:0/2739856709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbf006d720 0x7ffbf015fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.531+0000 7ffbf7a00640 1 --2- 172.21.15.44:0/2739856709 >> v2:172.21.15.151:3300/0 conn(0x7ffbf013f0c0 0x7ffbf006d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.531+0000 7ffbf7a00640 1 -- 172.21.15.44:0/2739856709 >> 172.21.15.44:0/2739856709 conn(0x7ffbf00b5b00 msgr2=0x7ffbf006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:21.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.531+0000 7ffbf7a00640 1 -- 172.21.15.44:0/2739856709 shutdown_connections 2024-03-30T13:12:21.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.531+0000 7ffbf7a00640 1 -- 172.21.15.44:0/2739856709 wait complete. 2024-03-30T13:12:21.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.533+0000 7ffbf7a00640 1 Processor -- start 2024-03-30T13:12:21.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.533+0000 7ffbf7a00640 1 -- start start 2024-03-30T13:12:21.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.534+0000 7ffbf7a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006d720 0x7ffbf0135a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.534+0000 7ffbf7a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbf013f0c0 0x7ffbf015ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.534+0000 7ffbf7a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbf01603d0 0x7ffbf014b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.534+0000 7ffbf7a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf0140000 con 0x7ffbf006d720 2024-03-30T13:12:21.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.534+0000 7ffbf7a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf013fd20 con 0x7ffbf013f0c0 2024-03-30T13:12:21.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.534+0000 7ffbf7a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ffbf0160820 con 0x7ffbf01603d0 2024-03-30T13:12:21.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.534+0000 7ffbf5000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006d720 0x7ffbf0135a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.534+0000 7ffbf5000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006d720 0x7ffbf0135a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38246/0 (socket says 172.21.15.44:38246) 2024-03-30T13:12:21.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.534+0000 7ffbf5000640 1 -- 172.21.15.44:0/1208011550 learned_addr learned my addr 172.21.15.44:0/1208011550 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:21.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbf013f0c0 0x7ffbf015ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbf5a00640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbf01603d0 0x7ffbf014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbf5000640 1 -- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbf01603d0 msgr2=0x7ffbf014b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbf5000640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbf01603d0 0x7ffbf014b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbf5000640 1 -- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbf013f0c0 msgr2=0x7ffbf015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbf5000640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbf013f0c0 0x7ffbf015ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbf5000640 1 -- 172.21.15.44:0/1208011550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf014b960 con 0x7ffbf006d720 2024-03-30T13:12:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbf013f0c0 0x7ffbf015ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbf5000640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006d720 0x7ffbf0135a30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000d620 tx=0x7ffbe000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbed600640 1 -- 172.21.15.44:0/1208011550 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe000b620 con 0x7ffbf006d720 2024-03-30T13:12:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbed600640 1 -- 172.21.15.44:0/1208011550 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe0019070 con 0x7ffbf006d720 2024-03-30T13:12:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbf7a00640 1 -- 172.21.15.44:0/1208011550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf015f6d0 con 0x7ffbf006d720 2024-03-30T13:12:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbed600640 1 -- 172.21.15.44:0/1208011550 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe000ba00 con 0x7ffbf006d720 2024-03-30T13:12:21.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.535+0000 7ffbf7a00640 1 -- 172.21.15.44:0/1208011550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf015fc90 con 0x7ffbf006d720 2024-03-30T13:12:21.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.537+0000 7ffbf7a00640 1 -- 172.21.15.44:0/1208011550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf0075890 con 0x7ffbf006d720 2024-03-30T13:12:21.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.538+0000 7ffbed600640 1 -- 172.21.15.44:0/1208011550 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ffbe000bba0 con 0x7ffbf006d720 2024-03-30T13:12:21.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.538+0000 7ffbed600640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffbcc06c560 0x7ffbcc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.539+0000 7ffbed600640 1 -- 172.21.15.44:0/1208011550 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ffbe008be00 con 0x7ffbf006d720 2024-03-30T13:12:21.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.539+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffbcc06c560 0x7ffbcc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.540+0000 7ffbe7e00640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffbcc06c560 0x7ffbcc06ea20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffbf015c110 tx=0x7ffbd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:21.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.543+0000 7ffbed600640 1 -- 172.21.15.44:0/1208011550 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ffbf014b960 con 0x7ffbf006d720 2024-03-30T13:12:21.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.749+0000 7ffbf7a00640 1 -- 172.21.15.44:0/1208011550 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ffbf0071420 con 0x7ffbf006d720 2024-03-30T13:12:21.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.750+0000 7ffbed600640 1 -- 172.21.15.44:0/1208011550 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7ffbe005a040 con 0x7ffbf006d720 2024-03-30T13:12:21.755 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:21.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.752+0000 7ffbf7a00640 1 -- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffbcc06c560 msgr2=0x7ffbcc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.752+0000 7ffbf7a00640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffbcc06c560 0x7ffbcc06ea20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffbf015c110 tx=0x7ffbd8008040 comp rx=0 tx=0).stop 2024-03-30T13:12:21.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.752+0000 7ffbf7a00640 1 -- 172.21.15.44:0/1208011550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006d720 msgr2=0x7ffbf0135a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.752+0000 7ffbf7a00640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006d720 0x7ffbf0135a30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffbe000d620 tx=0x7ffbe000dae0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.752+0000 7ffbf7a00640 1 -- 172.21.15.44:0/1208011550 shutdown_connections 2024-03-30T13:12:21.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.752+0000 7ffbf7a00640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbf01603d0 0x7ffbf014b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.752+0000 7ffbf7a00640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ffbcc06c560 0x7ffbcc06ea20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.752+0000 7ffbf7a00640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbf013f0c0 0x7ffbf015ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.752+0000 7ffbf7a00640 1 --2- 172.21.15.44:0/1208011550 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffbf006d720 0x7ffbf0135a30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:21.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.752+0000 7ffbf7a00640 1 -- 172.21.15.44:0/1208011550 >> 172.21.15.44:0/1208011550 conn(0x7ffbf00b5b00 msgr2=0x7ffbf006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:21.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.753+0000 7ffbf7a00640 1 -- 172.21.15.44:0/1208011550 shutdown_connections 2024-03-30T13:12:21.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.753+0000 7ffbf7a00640 1 -- 172.21.15.44:0/1208011550 wait complete. 2024-03-30T13:12:21.777 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:12:21.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.990+0000 7f813f000640 1 Processor -- start 2024-03-30T13:12:21.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.990+0000 7f813f000640 1 -- start start 2024-03-30T13:12:21.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.991+0000 7f813f000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f81381562f0 0x7f81381566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:21.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.991+0000 7f813f000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8138160c20 con 0x7f8138142300 2024-03-30T13:12:21.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.991+0000 7f813f000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81381600a0 con 0x7f81380d09a0 2024-03-30T13:12:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.991+0000 7f813f000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8138156c10 con 0x7f81381562f0 2024-03-30T13:12:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.992+0000 7f813dc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f81381562f0 0x7f81381566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.992+0000 7f813dc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f81381562f0 0x7f81381566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38256/0 (socket says 172.21.15.44:38256) 2024-03-30T13:12:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.992+0000 7f813dc00640 1 -- 172.21.15.44:0/1518648206 learned_addr learned my addr 172.21.15.44:0/1518648206 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.992+0000 7f813d200640 1 --1- 172.21.15.44:0/1518648206 >> v1:172.21.15.44:6789/0 conn(0x7f8138142300 0x7f81380d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44080/0 (socket says 172.21.15.44:44080) 2024-03-30T13:12:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.992+0000 7f813dc00640 1 -- 172.21.15.44:0/1518648206 >> v1:172.21.15.151:6789/0 conn(0x7f81380d09a0 legacy=0x7f813815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.992+0000 7f813dc00640 1 -- 172.21.15.44:0/1518648206 >> v1:172.21.15.44:6789/0 conn(0x7f8138142300 legacy=0x7f81380d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:21.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.992+0000 7f813dc00640 1 -- 172.21.15.44:0/1518648206 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8138160380 con 0x7f81381562f0 2024-03-30T13:12:22.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.993+0000 7f813dc00640 1 --2- 172.21.15.44:0/1518648206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81381562f0 0x7f81381566d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f812c009870 tx=0x7f812c02b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fd792aa8467c5c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:22.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.994+0000 7f8137e00640 1 -- 172.21.15.44:0/1518648206 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c034070 con 0x7f81381562f0 2024-03-30T13:12:22.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.994+0000 7f8137e00640 1 -- 172.21.15.44:0/1518648206 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812c030850 con 0x7f81381562f0 2024-03-30T13:12:22.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.994+0000 7f8137e00640 1 -- 172.21.15.44:0/1518648206 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c030c20 con 0x7f81381562f0 2024-03-30T13:12:22.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.994+0000 7f813f000640 1 -- 172.21.15.44:0/1518648206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81381562f0 msgr2=0x7f81381566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.994+0000 7f813f000640 1 --2- 172.21.15.44:0/1518648206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81381562f0 0x7f81381566d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f812c009870 tx=0x7f812c02b990 comp rx=0 tx=0).stop 2024-03-30T13:12:22.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.994+0000 7f813f000640 1 -- 172.21.15.44:0/1518648206 shutdown_connections 2024-03-30T13:12:22.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.994+0000 7f813f000640 1 --2- 172.21.15.44:0/1518648206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81381562f0 0x7f81381566d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.994+0000 7f813f000640 1 -- 172.21.15.44:0/1518648206 >> 172.21.15.44:0/1518648206 conn(0x7f813806b9a0 msgr2=0x7f813806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:22.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.995+0000 7f813f000640 1 -- 172.21.15.44:0/1518648206 shutdown_connections 2024-03-30T13:12:22.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.995+0000 7f813f000640 1 -- 172.21.15.44:0/1518648206 wait complete. 2024-03-30T13:12:22.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.996+0000 7f813f000640 1 Processor -- start 2024-03-30T13:12:22.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.997+0000 7f813f000640 1 -- start start 2024-03-30T13:12:22.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.997+0000 7f813f000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81380d09a0 0x7f81381557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813f000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8138142300 0x7f813815c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813f000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81381562f0 0x7f8138140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813f000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8138142780 con 0x7f81380d09a0 2024-03-30T13:12:22.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813f000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8138160940 con 0x7f81381562f0 2024-03-30T13:12:22.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813f000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f81380cca20 con 0x7f8138142300 2024-03-30T13:12:22.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81380d09a0 0x7f81381557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813dc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81380d09a0 0x7f81381557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38264/0 (socket says 172.21.15.44:38264) 2024-03-30T13:12:22.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813dc00640 1 -- 172.21.15.44:0/2518289667 learned_addr learned my addr 172.21.15.44:0/2518289667 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:22.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813e600640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81381562f0 0x7f8138140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813d200640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8138142300 0x7f813815c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813dc00640 1 -- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8138142300 msgr2=0x7f813815c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813dc00640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8138142300 0x7f813815c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813dc00640 1 -- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81381562f0 msgr2=0x7f8138140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813dc00640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81381562f0 0x7f8138140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813dc00640 1 -- 172.21.15.44:0/2518289667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8138155d30 con 0x7f81380d09a0 2024-03-30T13:12:22.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813e600640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81381562f0 0x7f8138140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:22.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.998+0000 7f813d200640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8138142300 0x7f813815c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:22.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.999+0000 7f813dc00640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81380d09a0 0x7f81381557f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f812c02b9d0 tx=0x7f812c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:22.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.999+0000 7f8135600640 1 -- 172.21.15.44:0/2518289667 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c034040 con 0x7f81380d09a0 2024-03-30T13:12:22.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.999+0000 7f8135600640 1 -- 172.21.15.44:0/2518289667 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812c0433f0 con 0x7f81380d09a0 2024-03-30T13:12:22.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.999+0000 7f8135600640 1 -- 172.21.15.44:0/2518289667 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c0437e0 con 0x7f81380d09a0 2024-03-30T13:12:22.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.999+0000 7f813f000640 1 -- 172.21.15.44:0/2518289667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813815d300 con 0x7f81380d09a0 2024-03-30T13:12:22.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:21.999+0000 7f813f000640 1 -- 172.21.15.44:0/2518289667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813815d8c0 con 0x7f81380d09a0 2024-03-30T13:12:22.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.000+0000 7f813f000640 1 -- 172.21.15.44:0/2518289667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8138075890 con 0x7f81380d09a0 2024-03-30T13:12:22.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.001+0000 7f8135600640 1 -- 172.21.15.44:0/2518289667 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f812c04a060 con 0x7f81380d09a0 2024-03-30T13:12:22.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.002+0000 7f8135600640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f811806c530 0x7f811806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.002+0000 7f8135600640 1 -- 172.21.15.44:0/2518289667 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f812c0adc40 con 0x7f81380d09a0 2024-03-30T13:12:22.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.003+0000 7f813d200640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f811806c530 0x7f811806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.004+0000 7f813d200640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f811806c530 0x7f811806e9f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f813815c120 tx=0x7f8124009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:22.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.007+0000 7f8135600640 1 -- 172.21.15.44:0/2518289667 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f812c03e070 con 0x7f81380d09a0 2024-03-30T13:12:22.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.251+0000 7f813f000640 1 -- 172.21.15.44:0/2518289667 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f813806ef60 con 0x7f81380d09a0 2024-03-30T13:12:22.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.252+0000 7f8135600640 1 -- 172.21.15.44:0/2518289667 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f812c0ad020 con 0x7f81380d09a0 2024-03-30T13:12:22.257 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:22.258 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1458748329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1458748329},{"type":"v1","addr":"172.21.15.44:6834","nonce":1458748329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3921281718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3921281718},{"type":"v1","addr":"172.21.15.151:6837","nonce":3921281718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2065829800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2065829800},{"type":"v1","addr":"172.21.15.44:6835","nonce":2065829800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:11:40.531273+0000","modified":"2024-03-30T13:12:07.711287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/456394190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":456394190},{"type":"v1","addr":"172.21.15.151:6835","nonce":456394190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276]},"id":1}]} 2024-03-30T13:12:22.258 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-03-30T13:12:22.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.255+0000 7f813f000640 1 -- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f811806c530 msgr2=0x7f811806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.255+0000 7f813f000640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f811806c530 0x7f811806e9f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f813815c120 tx=0x7f8124009040 comp rx=0 tx=0).stop 2024-03-30T13:12:22.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.255+0000 7f813f000640 1 -- 172.21.15.44:0/2518289667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81380d09a0 msgr2=0x7f81381557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.255+0000 7f813f000640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81380d09a0 0x7f81381557f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f812c02b9d0 tx=0x7f812c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.255+0000 7f813f000640 1 -- 172.21.15.44:0/2518289667 shutdown_connections 2024-03-30T13:12:22.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.255+0000 7f813f000640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f811806c530 0x7f811806e9f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.255+0000 7f813f000640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81381562f0 0x7f8138140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.255+0000 7f813f000640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8138142300 0x7f813815c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.255+0000 7f813f000640 1 --2- 172.21.15.44:0/2518289667 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f81380d09a0 0x7f81381557f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.255+0000 7f813f000640 1 -- 172.21.15.44:0/2518289667 >> 172.21.15.44:0/2518289667 conn(0x7f813806b9a0 msgr2=0x7f813815b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:22.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.255+0000 7f813f000640 1 -- 172.21.15.44:0/2518289667 shutdown_connections 2024-03-30T13:12:22.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.255+0000 7f813f000640 1 -- 172.21.15.44:0/2518289667 wait complete. 2024-03-30T13:12:22.280 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:22.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.500+0000 7fee33200640 1 Processor -- start 2024-03-30T13:12:22.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.501+0000 7fee33200640 1 -- start start 2024-03-30T13:12:22.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.502+0000 7fee33200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fee340d0d30 0x7fee340cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.502+0000 7fee33200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee340b5b60 con 0x7fee340d4950 2024-03-30T13:12:22.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.502+0000 7fee33200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee340d4fc0 con 0x7fee34161e70 2024-03-30T13:12:22.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.502+0000 7fee33200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fee340c7b90 con 0x7fee340d0d30 2024-03-30T13:12:22.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.502+0000 7fee31400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fee340d4950 0x7fee34161760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44094/0 (socket says 172.21.15.44:44094) 2024-03-30T13:12:22.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.502+0000 7fee31400640 1 -- 172.21.15.44:0/3473351181 learned_addr learned my addr 172.21.15.44:0/3473351181 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:22.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee31e00640 1 --2- 172.21.15.44:0/3473351181 >> v2:172.21.15.151:3300/0 conn(0x7fee340d0d30 0x7fee340cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 655104931 0 0) 0x7fee340b5b60 con 0x7fee340d4950 2024-03-30T13:12:22.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee14003520 con 0x7fee340d4950 2024-03-30T13:12:22.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3748675991 0 0) 0x7fee14003520 con 0x7fee340d4950 2024-03-30T13:12:22.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 >> v2:172.21.15.151:3300/0 conn(0x7fee340d0d30 msgr2=0x7fee340cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 --2- 172.21.15.44:0/3473351181 >> v2:172.21.15.151:3300/0 conn(0x7fee340d0d30 0x7fee340cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 >> v1:172.21.15.151:6789/0 conn(0x7fee34161e70 legacy=0x7fee340b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee340b57f0 con 0x7fee340d4950 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fee1c001670 con 0x7fee340d4950 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 >> v1:172.21.15.44:6789/0 conn(0x7fee340d4950 legacy=0x7fee34161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 --2- 172.21.15.44:0/3473351181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee14003a00 0x7fee14003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 --2- 172.21.15.44:0/3473351181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee14004800 0x7fee14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 --2- 172.21.15.44:0/3473351181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee140051c0 0x7fee1400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee340c7b90 con 0x7fee140051c0 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fee1400c0a0 con 0x7fee14003a00 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.503+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fee1400c2a0 con 0x7fee14004800 2024-03-30T13:12:22.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.504+0000 7fee32800640 1 --2- 172.21.15.44:0/3473351181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee140051c0 0x7fee1400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.504+0000 7fee31e00640 1 --2- 172.21.15.44:0/3473351181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee14003a00 0x7fee14003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.504+0000 7fee32800640 1 -- 172.21.15.44:0/3473351181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee14004800 msgr2=0x7fee14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:22.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.504+0000 7fee31400640 1 --2- 172.21.15.44:0/3473351181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee14004800 0x7fee14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.504+0000 7fee32800640 1 --2- 172.21.15.44:0/3473351181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee14004800 0x7fee14004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.504+0000 7fee32800640 1 -- 172.21.15.44:0/3473351181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee14003a00 msgr2=0x7fee14003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:22.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.504+0000 7fee32800640 1 --2- 172.21.15.44:0/3473351181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee14003a00 0x7fee14003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.504+0000 7fee32800640 1 -- 172.21.15.44:0/3473351181 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee14003520 con 0x7fee140051c0 2024-03-30T13:12:22.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.504+0000 7fee31e00640 1 --2- 172.21.15.44:0/3473351181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee14003a00 0x7fee14003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:22.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.505+0000 7fee32800640 1 -- 172.21.15.44:0/3473351181 reap_dead start 2024-03-30T13:12:22.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.505+0000 7fee32800640 1 --2- 172.21.15.44:0/3473351181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee140051c0 0x7fee1400b9c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee2c001e50 tx=0x7fee14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c23961178150622 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:22.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.506+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c001a70 con 0x7fee140051c0 2024-03-30T13:12:22.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.506+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee2c003b90 con 0x7fee140051c0 2024-03-30T13:12:22.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.506+0000 7fee30a00640 1 -- 172.21.15.44:0/3473351181 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0050d0 con 0x7fee140051c0 2024-03-30T13:12:22.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.506+0000 7fee33200640 1 -- 172.21.15.44:0/3473351181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee140051c0 msgr2=0x7fee1400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.506+0000 7fee33200640 1 --2- 172.21.15.44:0/3473351181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee140051c0 0x7fee1400b9c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee2c001e50 tx=0x7fee14005830 comp rx=0 tx=0).stop 2024-03-30T13:12:22.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.506+0000 7fee33200640 1 -- 172.21.15.44:0/3473351181 shutdown_connections 2024-03-30T13:12:22.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.506+0000 7fee33200640 1 --2- 172.21.15.44:0/3473351181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee140051c0 0x7fee1400b9c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.506+0000 7fee33200640 1 -- 172.21.15.44:0/3473351181 >> 172.21.15.44:0/3473351181 conn(0x7fee3409d570 msgr2=0x7fee340d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:22.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.506+0000 7fee33200640 1 -- 172.21.15.44:0/3473351181 shutdown_connections 2024-03-30T13:12:22.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.507+0000 7fee33200640 1 -- 172.21.15.44:0/3473351181 wait complete. 2024-03-30T13:12:22.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.508+0000 7fee33200640 1 Processor -- start 2024-03-30T13:12:22.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.508+0000 7fee33200640 1 -- start start 2024-03-30T13:12:22.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.509+0000 7fee33200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee140051c0 0x7fee3414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.509+0000 7fee33200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee340cb580 0x7fee341513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.509+0000 7fee33200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee340ce0d0 0x7fee340b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.509+0000 7fee33200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee340d1290 con 0x7fee340cb580 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.509+0000 7fee33200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fee340d1110 con 0x7fee140051c0 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.509+0000 7fee33200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fee340d1410 con 0x7fee340ce0d0 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.510+0000 7fee31400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee340cb580 0x7fee341513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.510+0000 7fee31400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee340cb580 0x7fee341513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38286/0 (socket says 172.21.15.44:38286) 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.510+0000 7fee31400640 1 -- 172.21.15.44:0/271268025 learned_addr learned my addr 172.21.15.44:0/271268025 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.510+0000 7fee31e00640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee140051c0 0x7fee3414e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.510+0000 7fee32800640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee340ce0d0 0x7fee340b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.510+0000 7fee31400640 1 -- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee340ce0d0 msgr2=0x7fee340b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.510+0000 7fee31400640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee340ce0d0 0x7fee340b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.510+0000 7fee31400640 1 -- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee140051c0 msgr2=0x7fee3414e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.510+0000 7fee31400640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee140051c0 0x7fee3414e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.510+0000 7fee31400640 1 -- 172.21.15.44:0/271268025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee341518e0 con 0x7fee340cb580 2024-03-30T13:12:22.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.511+0000 7fee31400640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee340cb580 0x7fee341513a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00d770 tx=0x7fee1c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:22.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.511+0000 7fee2a000640 1 -- 172.21.15.44:0/271268025 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c019070 con 0x7fee340cb580 2024-03-30T13:12:22.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.511+0000 7fee2a000640 1 -- 172.21.15.44:0/271268025 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1c0074e0 con 0x7fee340cb580 2024-03-30T13:12:22.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.511+0000 7fee2a000640 1 -- 172.21.15.44:0/271268025 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0049e0 con 0x7fee340cb580 2024-03-30T13:12:22.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.511+0000 7fee33200640 1 -- 172.21.15.44:0/271268025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee340cd030 con 0x7fee340cb580 2024-03-30T13:12:22.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.511+0000 7fee33200640 1 -- 172.21.15.44:0/271268025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee340cd5f0 con 0x7fee340cb580 2024-03-30T13:12:22.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.512+0000 7fee33200640 1 -- 172.21.15.44:0/271268025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee34075890 con 0x7fee340cb580 2024-03-30T13:12:22.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.513+0000 7fee2a000640 1 -- 172.21.15.44:0/271268025 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fee1c01c070 con 0x7fee340cb580 2024-03-30T13:12:22.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.514+0000 7fee2a000640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fee1006c530 0x7fee1006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.514+0000 7fee2a000640 1 -- 172.21.15.44:0/271268025 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fee1c08b360 con 0x7fee340cb580 2024-03-30T13:12:22.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.515+0000 7fee31e00640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fee1006c530 0x7fee1006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.516+0000 7fee31e00640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fee1006c530 0x7fee1006e9f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fee341f7b00 tx=0x7fee24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:22.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.519+0000 7fee2a000640 1 -- 172.21.15.44:0/271268025 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fee1c00de20 con 0x7fee340cb580 2024-03-30T13:12:22.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.723+0000 7fee33200640 1 -- 172.21.15.44:0/271268025 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee340b2b50 con 0x7fee340cb580 2024-03-30T13:12:22.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.725+0000 7fee2a000640 1 -- 172.21.15.44:0/271268025 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18490 (secure 0 0 0) 0x7fee1c058f50 con 0x7fee340cb580 2024-03-30T13:12:22.730 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:22.730 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":27,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:11:45.564677+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:22.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.727+0000 7fee33200640 1 -- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fee1006c530 msgr2=0x7fee1006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.727+0000 7fee33200640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fee1006c530 0x7fee1006e9f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fee341f7b00 tx=0x7fee24008040 comp rx=0 tx=0).stop 2024-03-30T13:12:22.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.727+0000 7fee33200640 1 -- 172.21.15.44:0/271268025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee340cb580 msgr2=0x7fee341513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.727+0000 7fee33200640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee340cb580 0x7fee341513a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00d770 tx=0x7fee1c00dc30 comp rx=0 tx=0).stop 2024-03-30T13:12:22.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.727+0000 7fee33200640 1 -- 172.21.15.44:0/271268025 shutdown_connections 2024-03-30T13:12:22.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.727+0000 7fee33200640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee340ce0d0 0x7fee340b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.727+0000 7fee33200640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee340cb580 0x7fee341513a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.727+0000 7fee33200640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fee1006c530 0x7fee1006e9f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.727+0000 7fee33200640 1 --2- 172.21.15.44:0/271268025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee140051c0 0x7fee3414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.727+0000 7fee33200640 1 -- 172.21.15.44:0/271268025 >> 172.21.15.44:0/271268025 conn(0x7fee3409d570 msgr2=0x7fee3406c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:22.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.728+0000 7fee33200640 1 -- 172.21.15.44:0/271268025 shutdown_connections 2024-03-30T13:12:22.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.728+0000 7fee33200640 1 -- 172.21.15.44:0/271268025 wait complete. 2024-03-30T13:12:22.754 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:12:22.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.972+0000 7f29bfe00640 1 Processor -- start 2024-03-30T13:12:22.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.972+0000 7f29bfe00640 1 -- start start 2024-03-30T13:12:22.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.974+0000 7f29bfe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29c0072370 0x7f29c00cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.974+0000 7f29bfe00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c00b4f70 con 0x7f29c00717a0 2024-03-30T13:12:22.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.974+0000 7f29bfe00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c00b5250 con 0x7f29c015a7f0 2024-03-30T13:12:22.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.974+0000 7f29bfe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f29c0072ac0 con 0x7f29c0072370 2024-03-30T13:12:22.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.975+0000 7f29bf400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f29c00717a0 0x7f29c006e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44098/0 (socket says 172.21.15.44:44098) 2024-03-30T13:12:22.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.975+0000 7f29bf400640 1 -- 172.21.15.44:0/2733032292 learned_addr learned my addr 172.21.15.44:0/2733032292 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:22.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.975+0000 7f29b6000640 1 --2- 172.21.15.44:0/2733032292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29c0072370 0x7f29c00cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.975+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3355484579 0 0) 0x7f29c00b4f70 con 0x7f29c00717a0 2024-03-30T13:12:22.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.975+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29a4003440 con 0x7f29c00717a0 2024-03-30T13:12:22.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.975+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904506924 0 0) 0x7f29c00b5250 con 0x7f29c015a7f0 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.975+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c00b4f70 con 0x7f29c015a7f0 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.975+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 714515032 0 0) 0x7f29a4003440 con 0x7f29c00717a0 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.975+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29c0072370 msgr2=0x7f29c00cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.975+0000 7f29be000640 1 --2- 172.21.15.44:0/2733032292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29c0072370 0x7f29c00cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.975+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 >> v1:172.21.15.151:6789/0 conn(0x7f29c015a7f0 legacy=0x7f29c0071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c006d590 con 0x7f29c00717a0 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f29b80019f0 con 0x7f29c00717a0 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 >> v1:172.21.15.44:6789/0 conn(0x7f29c00717a0 legacy=0x7f29c006e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29be000640 1 --2- 172.21.15.44:0/2733032292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a4003c60 0x7f29a4008850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29be000640 1 --2- 172.21.15.44:0/2733032292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29a4008d90 0x7f29a400b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29be000640 1 --2- 172.21.15.44:0/2733032292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29c0072370 0x7f29a400d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f29c0072ac0 con 0x7f29a4003c60 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f29a400dcc0 con 0x7f29a4008d90 2024-03-30T13:12:22.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f29a400de90 con 0x7f29c0072370 2024-03-30T13:12:22.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29bea00640 1 --2- 172.21.15.44:0/2733032292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a4003c60 0x7f29a4008850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29b6000640 1 --2- 172.21.15.44:0/2733032292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29a4008d90 0x7f29a400b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29bf400640 1 --2- 172.21.15.44:0/2733032292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29c0072370 0x7f29a400d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29bea00640 1 -- 172.21.15.44:0/2733032292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29c0072370 msgr2=0x7f29a400d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:22.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29bea00640 1 --2- 172.21.15.44:0/2733032292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29c0072370 0x7f29a400d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29bea00640 1 -- 172.21.15.44:0/2733032292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29a4008d90 msgr2=0x7f29a400b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:22.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29bea00640 1 --2- 172.21.15.44:0/2733032292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29a4008d90 0x7f29a400b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.976+0000 7f29bea00640 1 -- 172.21.15.44:0/2733032292 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a4003440 con 0x7f29a4003c60 2024-03-30T13:12:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.978+0000 7f29bea00640 1 --2- 172.21.15.44:0/2733032292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a4003c60 0x7f29a4008850 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f29b0001900 tx=0x7f29a4003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc1f987d2c68eb7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.978+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0037070 con 0x7f29a4003c60 2024-03-30T13:12:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.978+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b00052d0 con 0x7f29a4003c60 2024-03-30T13:12:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.978+0000 7f29be000640 1 -- 172.21.15.44:0/2733032292 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b00014f0 con 0x7f29a4003c60 2024-03-30T13:12:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.978+0000 7f29bfe00640 1 -- 172.21.15.44:0/2733032292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a4003c60 msgr2=0x7f29a4008850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.978+0000 7f29bfe00640 1 --2- 172.21.15.44:0/2733032292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a4003c60 0x7f29a4008850 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f29b0001900 tx=0x7f29a4003730 comp rx=0 tx=0).stop 2024-03-30T13:12:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.978+0000 7f29bf400640 1 -- 172.21.15.44:0/2733032292 reap_dead start 2024-03-30T13:12:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.979+0000 7f29bfe00640 1 -- 172.21.15.44:0/2733032292 shutdown_connections 2024-03-30T13:12:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.979+0000 7f29bfe00640 1 -- 172.21.15.44:0/2733032292 >> 172.21.15.44:0/2733032292 conn(0x7f29c006b9a0 msgr2=0x7f29c006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.979+0000 7f29bfe00640 1 -- 172.21.15.44:0/2733032292 shutdown_connections 2024-03-30T13:12:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.979+0000 7f29bfe00640 1 -- 172.21.15.44:0/2733032292 wait complete. 2024-03-30T13:12:22.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.980+0000 7f29bfe00640 1 Processor -- start 2024-03-30T13:12:22.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.980+0000 7f29bfe00640 1 -- start start 2024-03-30T13:12:22.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.981+0000 7f29bfe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29a4003c60 0x7f29c0151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.981+0000 7f29bfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29c013bf70 0x7f29c014ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.981+0000 7f29bfe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29c014f350 0x7f29c01f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.981+0000 7f29bfe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f29c015abd0 con 0x7f29c013bf70 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.981+0000 7f29bfe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f29c006db50 con 0x7f29c014f350 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.981+0000 7f29bfe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f29c00b4bf0 con 0x7f29a4003c60 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.982+0000 7f29b6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29c013bf70 0x7f29c014ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.982+0000 7f29b6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29c013bf70 0x7f29c014ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38316/0 (socket says 172.21.15.44:38316) 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.982+0000 7f29b6000640 1 -- 172.21.15.44:0/117852807 learned_addr learned my addr 172.21.15.44:0/117852807 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.982+0000 7f29bea00640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29a4003c60 0x7f29c0151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.982+0000 7f29bf400640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29c014f350 0x7f29c01f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.982+0000 7f29b6000640 1 -- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29a4003c60 msgr2=0x7f29c0151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.982+0000 7f29b6000640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29a4003c60 0x7f29c0151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.982+0000 7f29b6000640 1 -- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29c014f350 msgr2=0x7f29c01f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.982+0000 7f29b6000640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29c014f350 0x7f29c01f34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:22.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.982+0000 7f29b6000640 1 -- 172.21.15.44:0/117852807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c0150c00 con 0x7f29c013bf70 2024-03-30T13:12:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.982+0000 7f29bea00640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29a4003c60 0x7f29c0151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.983+0000 7f29b6000640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29c013bf70 0x7f29c014ee10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29a8011600 tx=0x7f29a8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.983+0000 7f29b7400640 1 -- 172.21.15.44:0/117852807 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a800f920 con 0x7f29c013bf70 2024-03-30T13:12:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.983+0000 7f29b7400640 1 -- 172.21.15.44:0/117852807 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a800fac0 con 0x7f29c013bf70 2024-03-30T13:12:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.983+0000 7f29b7400640 1 -- 172.21.15.44:0/117852807 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a800fe70 con 0x7f29c013bf70 2024-03-30T13:12:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.983+0000 7f29bfe00640 1 -- 172.21.15.44:0/117852807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c0150ee0 con 0x7f29c013bf70 2024-03-30T13:12:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.983+0000 7f29bfe00640 1 -- 172.21.15.44:0/117852807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c01514a0 con 0x7f29c013bf70 2024-03-30T13:12:22.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.984+0000 7f29bfe00640 1 -- 172.21.15.44:0/117852807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c0075890 con 0x7f29c013bf70 2024-03-30T13:12:22.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.985+0000 7f29b7400640 1 -- 172.21.15.44:0/117852807 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f29a8015460 con 0x7f29c013bf70 2024-03-30T13:12:22.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.986+0000 7f29b7400640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f299c06c530 0x7f299c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:22.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.986+0000 7f29b7400640 1 -- 172.21.15.44:0/117852807 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f29a808c480 con 0x7f29c013bf70 2024-03-30T13:12:22.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.987+0000 7f29bea00640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f299c06c530 0x7f299c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:22.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.988+0000 7f29bea00640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f299c06c530 0x7f299c06e9f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f29b0034000 tx=0x7f29b0031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:22.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:22.990+0000 7f29b7400640 1 -- 172.21.15.44:0/117852807 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f29a8019030 con 0x7f29c013bf70 2024-03-30T13:12:23.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.230+0000 7f29bfe00640 1 -- 172.21.15.44:0/117852807 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29c00b38b0 con 0x7f29c013bf70 2024-03-30T13:12:23.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.231+0000 7f29b7400640 1 -- 172.21.15.44:0/117852807 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f29a805a6c0 con 0x7f29c013bf70 2024-03-30T13:12:23.235 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:23.236 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1458748329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1458748329},{"type":"v1","addr":"172.21.15.44:6834","nonce":1458748329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3921281718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3921281718},{"type":"v1","addr":"172.21.15.151:6837","nonce":3921281718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2065829800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2065829800},{"type":"v1","addr":"172.21.15.44:6835","nonce":2065829800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:11:40.531273+0000","modified":"2024-03-30T13:12:07.711287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/456394190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":456394190},{"type":"v1","addr":"172.21.15.151:6835","nonce":456394190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276]},"id":1}]} 2024-03-30T13:12:23.236 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-03-30T13:12:23.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.233+0000 7f29bfe00640 1 -- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f299c06c530 msgr2=0x7f299c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:23.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.233+0000 7f29bfe00640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f299c06c530 0x7f299c06e9f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f29b0034000 tx=0x7f29b0031000 comp rx=0 tx=0).stop 2024-03-30T13:12:23.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.233+0000 7f29bfe00640 1 -- 172.21.15.44:0/117852807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29c013bf70 msgr2=0x7f29c014ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:23.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.233+0000 7f29bfe00640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29c013bf70 0x7f29c014ee10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29a8011600 tx=0x7f29a8011ac0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.234+0000 7f29bfe00640 1 -- 172.21.15.44:0/117852807 shutdown_connections 2024-03-30T13:12:23.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.234+0000 7f29bfe00640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f299c06c530 0x7f299c06e9f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.234+0000 7f29bfe00640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29c014f350 0x7f29c01f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.234+0000 7f29bfe00640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29c013bf70 0x7f29c014ee10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.234+0000 7f29bfe00640 1 --2- 172.21.15.44:0/117852807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29a4003c60 0x7f29c0151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.234+0000 7f29bfe00640 1 -- 172.21.15.44:0/117852807 >> 172.21.15.44:0/117852807 conn(0x7f29c006b9a0 msgr2=0x7f29c014e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:23.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.234+0000 7f29bfe00640 1 -- 172.21.15.44:0/117852807 shutdown_connections 2024-03-30T13:12:23.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.234+0000 7f29bfe00640 1 -- 172.21.15.44:0/117852807 wait complete. 2024-03-30T13:12:23.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T13:11:40.531273+0000', 'modified': '2024-03-30T13:12:07.711287+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6835/456394190', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 456394190}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 456394190}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4276, 'qdb_cluster': [4276]} 2024-03-30T13:12:23.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-30T13:12:23.659 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-30T13:12:23.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.885+0000 7f4737000640 1 Processor -- start 2024-03-30T13:12:23.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.886+0000 7f4737000640 1 -- start start 2024-03-30T13:12:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.887+0000 7f4737000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4730072230 0x7f473006bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.887+0000 7f4737000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4730072610 0x7f473015f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.887+0000 7f4737000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f473006c4d0 con 0x7f473006db10 2024-03-30T13:12:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.887+0000 7f4737000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f4730158f10 con 0x7f4730072230 2024-03-30T13:12:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.887+0000 7f4737000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f473015ef70 con 0x7f4730072610 2024-03-30T13:12:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.888+0000 7f4735000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f473006db10 0x7f473006df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44100/0 (socket says 172.21.15.44:44100) 2024-03-30T13:12:23.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.888+0000 7f4735000640 1 -- 172.21.15.44:0/2167956715 learned_addr learned my addr 172.21.15.44:0/2167956715 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:23.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.888+0000 7f472fe00640 1 --2- 172.21.15.44:0/2167956715 >> v2:172.21.15.151:3300/0 conn(0x7f4730072230 0x7f473006bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.888+0000 7f472f400640 1 --2- 172.21.15.44:0/2167956715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4730072610 0x7f473015f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.888+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475612514 0 0) 0x7f4728001110 con 0x7f473006db10 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.888+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4714003520 con 0x7f473006db10 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1879610475 0 0) 0x7f4714003520 con 0x7f473006db10 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4730072610 msgr2=0x7f473015f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 --2- 172.21.15.44:0/2167956715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4730072610 0x7f473015f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 >> v2:172.21.15.151:3300/0 conn(0x7f4730072230 msgr2=0x7f473006bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 --2- 172.21.15.44:0/2167956715 >> v2:172.21.15.151:3300/0 conn(0x7f4730072230 0x7f473006bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47300ce840 con 0x7f473006db10 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f4728001840 con 0x7f473006db10 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 >> v1:172.21.15.44:6789/0 conn(0x7f473006db10 legacy=0x7f473006df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 --2- 172.21.15.44:0/2167956715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140039b0 0x7f4714003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 --2- 172.21.15.44:0/2167956715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4714004800 0x7f4714004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 --2- 172.21.15.44:0/2167956715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4730072610 0x7f47140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4730158f10 con 0x7f47140039b0 2024-03-30T13:12:23.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f473015ef70 con 0x7f4714004800 2024-03-30T13:12:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f471400b9c0 con 0x7f4730072610 2024-03-30T13:12:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472fe00640 1 --2- 172.21.15.44:0/2167956715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140039b0 0x7f4714003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472fe00640 1 -- 172.21.15.44:0/2167956715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4730072610 msgr2=0x7f47140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472fe00640 1 --2- 172.21.15.44:0/2167956715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4730072610 0x7f47140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472f400640 1 --2- 172.21.15.44:0/2167956715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4714004800 0x7f4714004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472fe00640 1 -- 172.21.15.44:0/2167956715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4714004800 msgr2=0x7f4714004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472fe00640 1 --2- 172.21.15.44:0/2167956715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4714004800 0x7f4714004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.889+0000 7f472fe00640 1 -- 172.21.15.44:0/2167956715 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4714003520 con 0x7f47140039b0 2024-03-30T13:12:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.891+0000 7f472fe00640 1 --2- 172.21.15.44:0/2167956715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140039b0 0x7f4714003dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4720009fc0 tx=0x7f4714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad963cce0eb1a3a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.891+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720039070 con 0x7f47140039b0 2024-03-30T13:12:23.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.891+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472002cc60 con 0x7f47140039b0 2024-03-30T13:12:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.891+0000 7f472ea00640 1 -- 172.21.15.44:0/2167956715 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720009c10 con 0x7f47140039b0 2024-03-30T13:12:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.891+0000 7f4737000640 1 -- 172.21.15.44:0/2167956715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140039b0 msgr2=0x7f4714003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.891+0000 7f4737000640 1 --2- 172.21.15.44:0/2167956715 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47140039b0 0x7f4714003dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4720009fc0 tx=0x7f4714005830 comp rx=0 tx=0).stop 2024-03-30T13:12:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.892+0000 7f4735000640 1 -- 172.21.15.44:0/2167956715 reap_dead start 2024-03-30T13:12:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.892+0000 7f4737000640 1 -- 172.21.15.44:0/2167956715 shutdown_connections 2024-03-30T13:12:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.892+0000 7f4737000640 1 -- 172.21.15.44:0/2167956715 >> 172.21.15.44:0/2167956715 conn(0x7f47300d0cb0 msgr2=0x7f47300d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.892+0000 7f4737000640 1 -- 172.21.15.44:0/2167956715 shutdown_connections 2024-03-30T13:12:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.892+0000 7f4737000640 1 -- 172.21.15.44:0/2167956715 wait complete. 2024-03-30T13:12:23.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.893+0000 7f4737000640 1 Processor -- start 2024-03-30T13:12:23.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.894+0000 7f4737000640 1 -- start start 2024-03-30T13:12:23.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.894+0000 7f4737000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47140039b0 0x7f47301f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f4737000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47301f79a0 0x7f47301e8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f4737000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4730159ed0 0x7f47301e9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f4737000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f473006e670 con 0x7f47301f79a0 2024-03-30T13:12:23.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f4737000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f473015ec00 con 0x7f47140039b0 2024-03-30T13:12:23.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f4737000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4730072ac0 con 0x7f4730159ed0 2024-03-30T13:12:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f472f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47301f79a0 0x7f47301e8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f472f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47301f79a0 0x7f47301e8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38342/0 (socket says 172.21.15.44:38342) 2024-03-30T13:12:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f472f400640 1 -- 172.21.15.44:0/1259300738 learned_addr learned my addr 172.21.15.44:0/1259300738 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f472fe00640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47140039b0 0x7f47301f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f4735000640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4730159ed0 0x7f47301e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f472f400640 1 -- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4730159ed0 msgr2=0x7f47301e9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f472f400640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4730159ed0 0x7f47301e9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f472f400640 1 -- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47140039b0 msgr2=0x7f47301f7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f472f400640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47140039b0 0x7f47301f7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f472f400640 1 -- 172.21.15.44:0/1259300738 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4730159150 con 0x7f47301f79a0 2024-03-30T13:12:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.895+0000 7f472fe00640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47140039b0 0x7f47301f7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:23.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.896+0000 7f472f400640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47301f79a0 0x7f47301e8ad0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4718010890 tx=0x7f4718010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:23.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.896+0000 7f4727e00640 1 -- 172.21.15.44:0/1259300738 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471800f040 con 0x7f47301f79a0 2024-03-30T13:12:23.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.896+0000 7f4727e00640 1 -- 172.21.15.44:0/1259300738 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f471800eb60 con 0x7f47301f79a0 2024-03-30T13:12:23.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.896+0000 7f4727e00640 1 -- 172.21.15.44:0/1259300738 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471801c400 con 0x7f47301f79a0 2024-03-30T13:12:23.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.896+0000 7f4737000640 1 -- 172.21.15.44:0/1259300738 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47301593f0 con 0x7f47301f79a0 2024-03-30T13:12:23.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.896+0000 7f4737000640 1 -- 172.21.15.44:0/1259300738 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4730154950 con 0x7f47301f79a0 2024-03-30T13:12:23.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.898+0000 7f4727e00640 1 -- 172.21.15.44:0/1259300738 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f471801c5a0 con 0x7f47301f79a0 2024-03-30T13:12:23.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.900+0000 7f4727e00640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f470c06c530 0x7f470c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.900+0000 7f4727e00640 1 -- 172.21.15.44:0/1259300738 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f471808c0a0 con 0x7f47301f79a0 2024-03-30T13:12:23.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.900+0000 7f472fe00640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f470c06c530 0x7f470c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.900+0000 7f4739da3740 1 Processor -- start 2024-03-30T13:12:23.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.901+0000 7f4739da3740 1 -- start start 2024-03-30T13:12:23.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.901+0000 7f472fe00640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f470c06c530 0x7f470c06e9f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4720036000 tx=0x7f472002e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:23.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.901+0000 7f4739da3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 0x55660a4952a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.901+0000 7f4739da3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c26e0 0x55660a4c5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.901+0000 7f4739da3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4957e0 0x55660a4c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f4739da3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55660a45cc80 con 0x55660a4c2300 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f4739da3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55660a3fefa0 con 0x55660a4957e0 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f4739da3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55660a3a7560 con 0x55660a4c26e0 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f472fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 0x55660a4952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f472fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 0x55660a4952a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38358/0 (socket says 172.21.15.44:38358) 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f472fe00640 1 -- 172.21.15.44:0/3298277581 learned_addr learned my addr 172.21.15.44:0/3298277581 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f4735000640 1 --2- 172.21.15.44:0/3298277581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4957e0 0x55660a4c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f472f400640 1 --2- 172.21.15.44:0/3298277581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c26e0 0x55660a4c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f472fe00640 1 -- 172.21.15.44:0/3298277581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c26e0 msgr2=0x55660a4c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f472fe00640 1 --2- 172.21.15.44:0/3298277581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c26e0 0x55660a4c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f472fe00640 1 -- 172.21.15.44:0/3298277581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4957e0 msgr2=0x55660a4c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f472fe00640 1 --2- 172.21.15.44:0/3298277581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4957e0 0x55660a4c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f472fe00640 1 -- 172.21.15.44:0/3298277581 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55660a1132d0 con 0x55660a4c2300 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f4735000640 1 --2- 172.21.15.44:0/3298277581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4957e0 0x55660a4c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:23.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.902+0000 7f472f400640 1 --2- 172.21.15.44:0/3298277581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c26e0 0x55660a4c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:23.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.903+0000 7f472fe00640 1 --2- 172.21.15.44:0/3298277581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 0x55660a4952a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f472002ccb0 tx=0x7f472002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1f8536c24b192e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:23.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.903+0000 7f4724c00640 1 -- 172.21.15.44:0/3298277581 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720043070 con 0x55660a4c2300 2024-03-30T13:12:23.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.903+0000 7f4724c00640 1 -- 172.21.15.44:0/3298277581 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472004f070 con 0x55660a4c2300 2024-03-30T13:12:23.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.903+0000 7f4724c00640 1 -- 172.21.15.44:0/3298277581 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720039040 con 0x55660a4c2300 2024-03-30T13:12:23.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.903+0000 7f4739da3740 1 -- 172.21.15.44:0/3298277581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 msgr2=0x55660a4952a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:23.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.904+0000 7f4739da3740 1 --2- 172.21.15.44:0/3298277581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 0x55660a4952a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f472002ccb0 tx=0x7f472002e070 comp rx=0 tx=0).stop 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.904+0000 7f4739da3740 1 -- 172.21.15.44:0/3298277581 shutdown_connections 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.904+0000 7f4739da3740 1 --2- 172.21.15.44:0/3298277581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4957e0 0x55660a4c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.904+0000 7f4739da3740 1 --2- 172.21.15.44:0/3298277581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c26e0 0x55660a4c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.904+0000 7f4739da3740 1 --2- 172.21.15.44:0/3298277581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 0x55660a4952a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.904+0000 7f4739da3740 1 -- 172.21.15.44:0/3298277581 >> 172.21.15.44:0/3298277581 conn(0x55660a497510 msgr2=0x55660a4e0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.904+0000 7f4739da3740 1 -- 172.21.15.44:0/3298277581 shutdown_connections 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.904+0000 7f4739da3740 1 -- 172.21.15.44:0/3298277581 wait complete. 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.904+0000 7f4739da3740 1 -- start start 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.905+0000 7f4739da3740 1 Processor -- start 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f4739da3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c2300 0x55660a4d6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f4739da3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c26e0 0x55660a4c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f4739da3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c4a30 0x55660a4ac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f4739da3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55660a3ba920 con 0x55660a4c26e0 2024-03-30T13:12:23.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f4739da3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55660a3faf50 con 0x55660a4c2300 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f4739da3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55660a499ab0 con 0x55660a4c4a30 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f4739da3740 10 client.0 _ll_register_callbacks cb 0x55660a3ba310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f472f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c26e0 0x55660a4c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f472f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c26e0 0x55660a4c44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38366/0 (socket says 172.21.15.44:38366) 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f472f400640 1 -- 172.21.15.44:0/965423798 learned_addr learned my addr 172.21.15.44:0/965423798 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f472fe00640 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c2300 0x55660a4d6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f4735000640 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c4a30 0x55660a4ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f472f400640 1 -- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c4a30 msgr2=0x55660a4ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f472f400640 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c4a30 0x55660a4ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f472f400640 1 -- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c2300 msgr2=0x55660a4d6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.906+0000 7f472f400640 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c2300 0x55660a4d6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.907+0000 7f472f400640 1 -- 172.21.15.44:0/965423798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55660a1dd6b0 con 0x55660a4c26e0 2024-03-30T13:12:23.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.907+0000 7f472fe00640 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c2300 0x55660a4d6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.907+0000 7f472f400640 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c26e0 0x55660a4c44f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4718062320 tx=0x7f471805e020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84aabe0b389ce3ce server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.907+0000 7f471d600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.907+0000 7f471d600640 1 -- 172.21.15.44:0/965423798 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718072020 con 0x55660a4c26e0 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.907+0000 7f471d600640 1 -- 172.21.15.44:0/965423798 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f47180623c0 con 0x55660a4c26e0 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.907+0000 7f4739da3740 1 -- 172.21.15.44:0/965423798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f472004f070 con 0x55660a4c26e0 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.907+0000 7f471d600640 1 -- 172.21.15.44:0/965423798 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4718021040 con 0x55660a4c26e0 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.907+0000 7f4739da3740 10 client.4791 fetch_fsmap learned FSMap version 9 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.907+0000 7f4739da3740 1 -- 172.21.15.44:0/965423798 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55660a4acc40 con 0x55660a4c26e0 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.908+0000 7f471d600640 1 -- 172.21.15.44:0/965423798 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472004f070 con 0x55660a4c26e0 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.908+0000 7f471d600640 1 -- 172.21.15.44:0/965423798 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f4718059170 con 0x55660a4c26e0 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.908+0000 7f4739da3740 10 client.4791 fetch_fsmap finished waiting for FSMap version 9 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.908+0000 7f4739da3740 10 client.4791 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.908+0000 7f4739da3740 20 client.4791 populate_metadata read hostname 'smithi044' 2024-03-30T13:12:23.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.908+0000 7f4739da3740 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55660a4f28f0 0x55660a4f0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.908+0000 7f4739da3740 4 client.4791 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:12:23.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.908+0000 7f4739da3740 1 -- 172.21.15.44:0/965423798 --> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55660a40c4e0 con 0x55660a4f28f0 2024-03-30T13:12:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.908+0000 7f472fe00640 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55660a4f28f0 0x55660a4f0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.909+0000 7f472fe00640 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55660a4f28f0 0x55660a4f0710 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a873c214edc9930d server_cookie=8fffa9f973e42ddf in_seq=0 out_seq=0 2024-03-30T13:12:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.909+0000 7f471d600640 10 client.4791 ms_handle_connect on v2:172.21.15.151:6834/456394190 2024-03-30T13:12:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.911+0000 7f471d600640 1 -- 172.21.15.44:0/965423798 <== mds.0 v2:172.21.15.151:6834/456394190 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55660a40c4e0 con 0x55660a4f28f0 2024-03-30T13:12:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.911+0000 7f471d600640 10 client.4791 handle_command_reply: tid=0 2024-03-30T13:12:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f4739da3740 1 client.4791 shutdown 2024-03-30T13:12:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f4739da3740 1 -- 172.21.15.44:0/965423798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c26e0 msgr2=0x55660a4c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:23.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f4739da3740 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c26e0 0x55660a4c44f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4718062320 tx=0x7f471805e020 comp rx=0 tx=0).stop 2024-03-30T13:12:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f4739da3740 1 -- 172.21.15.44:0/965423798 shutdown_connections 2024-03-30T13:12:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f4739da3740 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55660a4f28f0 0x55660a4f0710 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f4739da3740 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c4a30 0x55660a4ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f4739da3740 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c26e0 0x55660a4c44f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f4739da3740 1 --2- 172.21.15.44:0/965423798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c2300 0x55660a4d6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f471d600640 0 client.4791 ms_handle_reset on v2:172.21.15.151:6834/456394190 2024-03-30T13:12:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f4739da3740 1 -- 172.21.15.44:0/965423798 >> 172.21.15.44:0/965423798 conn(0x55660a4957e0 msgr2=0x55660a494070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f4739da3740 1 -- 172.21.15.44:0/965423798 shutdown_connections 2024-03-30T13:12:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f4739da3740 1 -- 172.21.15.44:0/965423798 wait complete. 2024-03-30T13:12:23.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.912+0000 7f4739da3740 20 client.4791 trim_cache size 0 max 16384 2024-03-30T13:12:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.932+0000 7f4739da3740 1 Processor -- start 2024-03-30T13:12:23.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.932+0000 7f4739da3740 1 -- start start 2024-03-30T13:12:23.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.933+0000 7f4739da3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 0x55660a4ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.933+0000 7f4739da3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c26e0 0x55660a502c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.933+0000 7f4739da3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c4a30 0x55660a503180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f4739da3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4730201a10 con 0x55660a4c2300 2024-03-30T13:12:23.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f4739da3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4730200da0 con 0x55660a4c26e0 2024-03-30T13:12:23.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f4739da3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f47302013c0 con 0x55660a4c4a30 2024-03-30T13:12:23.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f472fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 0x55660a4ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f472fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 0x55660a4ef7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38382/0 (socket says 172.21.15.44:38382) 2024-03-30T13:12:23.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f472fe00640 1 -- 172.21.15.44:0/305146217 learned_addr learned my addr 172.21.15.44:0/305146217 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:23.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f472f400640 1 --2- 172.21.15.44:0/305146217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c26e0 0x55660a502c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f4735000640 1 --2- 172.21.15.44:0/305146217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c4a30 0x55660a503180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f472fe00640 1 -- 172.21.15.44:0/305146217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c4a30 msgr2=0x55660a503180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f472fe00640 1 --2- 172.21.15.44:0/305146217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c4a30 0x55660a503180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f472fe00640 1 -- 172.21.15.44:0/305146217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c26e0 msgr2=0x55660a502c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f472fe00640 1 --2- 172.21.15.44:0/305146217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c26e0 0x55660a502c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f472fe00640 1 -- 172.21.15.44:0/305146217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55660a4972a0 con 0x55660a4c2300 2024-03-30T13:12:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f472f400640 1 --2- 172.21.15.44:0/305146217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c26e0 0x55660a502c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.934+0000 7f472fe00640 1 --2- 172.21.15.44:0/305146217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 0x55660a4ef7f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f472000e200 tx=0x7f472003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce513decb62f4ffb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.935+0000 7f471fe00640 1 -- 172.21.15.44:0/305146217 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720062070 con 0x55660a4c2300 2024-03-30T13:12:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.935+0000 7f471fe00640 1 -- 172.21.15.44:0/305146217 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472004f040 con 0x55660a4c2300 2024-03-30T13:12:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.935+0000 7f471fe00640 1 -- 172.21.15.44:0/305146217 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720043040 con 0x55660a4c2300 2024-03-30T13:12:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.935+0000 7f4739da3740 1 -- 172.21.15.44:0/305146217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 msgr2=0x55660a4ef7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.935+0000 7f4739da3740 1 --2- 172.21.15.44:0/305146217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 0x55660a4ef7f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f472000e200 tx=0x7f472003f000 comp rx=0 tx=0).stop 2024-03-30T13:12:23.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.935+0000 7f4739da3740 1 -- 172.21.15.44:0/305146217 shutdown_connections 2024-03-30T13:12:23.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.935+0000 7f4739da3740 1 --2- 172.21.15.44:0/305146217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c4a30 0x55660a503180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.935+0000 7f4739da3740 1 --2- 172.21.15.44:0/305146217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c26e0 0x55660a502c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.935+0000 7f4739da3740 1 --2- 172.21.15.44:0/305146217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c2300 0x55660a4ef7f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.935+0000 7f4739da3740 1 -- 172.21.15.44:0/305146217 >> 172.21.15.44:0/305146217 conn(0x55660a4957e0 msgr2=0x55660a49c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:23.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.936+0000 7f4739da3740 1 -- 172.21.15.44:0/305146217 shutdown_connections 2024-03-30T13:12:23.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.936+0000 7f4739da3740 1 -- 172.21.15.44:0/305146217 wait complete. 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.936+0000 7f4739da3740 1 -- start start 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.937+0000 7f4739da3740 1 Processor -- start 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.937+0000 7f4739da3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c2300 0x55660a499a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.937+0000 7f4739da3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c26e0 0x55660a4c02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.937+0000 7f4739da3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c4a30 0x55660a5417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.937+0000 7f4739da3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55660a4f2770 con 0x55660a4c4a30 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.938+0000 7f4739da3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55660a4f20c0 con 0x55660a4c26e0 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.938+0000 7f4739da3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55660a4f2d90 con 0x55660a4c2300 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.938+0000 7f4739da3740 10 client.0 _ll_register_callbacks cb 0x7f4718059710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.938+0000 7f4735000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c4a30 0x55660a5417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.938+0000 7f4735000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c4a30 0x55660a5417b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38388/0 (socket says 172.21.15.44:38388) 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.938+0000 7f4735000640 1 -- 172.21.15.44:0/2794352933 learned_addr learned my addr 172.21.15.44:0/2794352933 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:23.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.938+0000 7f472fe00640 1 --2- 172.21.15.44:0/2794352933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c2300 0x55660a499a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.938+0000 7f4735000640 1 -- 172.21.15.44:0/2794352933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c2300 msgr2=0x55660a499a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.938+0000 7f4735000640 1 --2- 172.21.15.44:0/2794352933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c2300 0x55660a499a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.938+0000 7f4735000640 1 -- 172.21.15.44:0/2794352933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c26e0 msgr2=0x55660a4c02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.938+0000 7f4735000640 1 --2- 172.21.15.44:0/2794352933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c26e0 0x55660a4c02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.938+0000 7f4735000640 1 -- 172.21.15.44:0/2794352933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55660a49a250 con 0x55660a4c4a30 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.939+0000 7f4735000640 1 --2- 172.21.15.44:0/2794352933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c4a30 0x55660a5417b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f473006f100 tx=0x7f47280105b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac9dbf6c9eccdc8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.939+0000 7f471d600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.939+0000 7f471d600640 1 -- 172.21.15.44:0/2794352933 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4728014600 con 0x55660a4c4a30 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.939+0000 7f471d600640 1 -- 172.21.15.44:0/2794352933 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f47280147a0 con 0x55660a4c4a30 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.939+0000 7f4739da3740 1 -- 172.21.15.44:0/2794352933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f472004f040 con 0x55660a4c4a30 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.939+0000 7f471d600640 1 -- 172.21.15.44:0/2794352933 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4728010e80 con 0x55660a4c4a30 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.939+0000 7f4739da3740 10 client.4797 fetch_fsmap learned FSMap version 9 2024-03-30T13:12:23.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.939+0000 7f4739da3740 1 -- 172.21.15.44:0/2794352933 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55660a4c0b10 con 0x55660a4c4a30 2024-03-30T13:12:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.940+0000 7f471d600640 1 -- 172.21.15.44:0/2794352933 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472004f040 con 0x55660a4c4a30 2024-03-30T13:12:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.940+0000 7f471d600640 1 -- 172.21.15.44:0/2794352933 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f47280149a0 con 0x55660a4c4a30 2024-03-30T13:12:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.940+0000 7f4739da3740 10 client.4797 fetch_fsmap finished waiting for FSMap version 9 2024-03-30T13:12:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.940+0000 7f4739da3740 10 client.4797 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-30T13:12:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.940+0000 7f4739da3740 20 client.4797 populate_metadata read hostname 'smithi044' 2024-03-30T13:12:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.940+0000 7f4739da3740 1 --2- 172.21.15.44:0/2794352933 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55660a4aab50 0x55660a4aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.940+0000 7f4739da3740 4 client.4797 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-30T13:12:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.940+0000 7f4739da3740 1 -- 172.21.15.44:0/2794352933 --> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] -- command(tid 0: {"prefix": "status"}) -- 0x55660a406830 con 0x55660a4aab50 2024-03-30T13:12:23.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.940+0000 7f472fe00640 1 --2- 172.21.15.44:0/2794352933 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55660a4aab50 0x55660a4aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:23.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.941+0000 7f472fe00640 1 --2- 172.21.15.44:0/2794352933 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55660a4aab50 0x55660a4aaf30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=290dddab7671837c server_cookie=ac7cee14c9f40d8b in_seq=0 out_seq=0 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.941+0000 7f471d600640 10 client.4797 ms_handle_connect on v2:172.21.15.151:6834/456394190 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f471d600640 1 -- 172.21.15.44:0/2794352933 <== mds.0 v2:172.21.15.151:6834/456394190 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55660a406830 con 0x55660a4aab50 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f471d600640 10 client.4797 handle_command_reply: tid=0 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f4739da3740 1 client.4797 shutdown 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f4739da3740 1 -- 172.21.15.44:0/2794352933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c4a30 msgr2=0x55660a5417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f4739da3740 1 --2- 172.21.15.44:0/2794352933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c4a30 0x55660a5417b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f473006f100 tx=0x7f47280105b0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f4739da3740 1 -- 172.21.15.44:0/2794352933 shutdown_connections 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f4739da3740 1 --2- 172.21.15.44:0/2794352933 >> [v2:172.21.15.151:6834/456394190,v1:172.21.15.151:6835/456394190] conn(0x55660a4aab50 0x55660a4aaf30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f4739da3740 1 --2- 172.21.15.44:0/2794352933 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55660a4c4a30 0x55660a5417b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f4739da3740 1 --2- 172.21.15.44:0/2794352933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55660a4c26e0 0x55660a4c02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f4739da3740 1 --2- 172.21.15.44:0/2794352933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55660a4c2300 0x55660a499a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f4739da3740 1 -- 172.21.15.44:0/2794352933 >> 172.21.15.44:0/2794352933 conn(0x55660a4957e0 msgr2=0x55660a49c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f471d600640 0 client.4797 ms_handle_reset on v2:172.21.15.151:6834/456394190 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f4739da3740 1 -- 172.21.15.44:0/2794352933 shutdown_connections 2024-03-30T13:12:23.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.942+0000 7f4739da3740 1 -- 172.21.15.44:0/2794352933 wait complete. 2024-03-30T13:12:23.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.943+0000 7f4739da3740 20 client.4797 trim_cache size 0 max 16384 2024-03-30T13:12:23.950 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:12:23.950 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "cf82a1f9-ad5a-4657-adf6-b77304ed0e9d", 2024-03-30T13:12:23.950 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-03-30T13:12:23.950 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 4276, 2024-03-30T13:12:23.950 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-03-30T13:12:23.950 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-03-30T13:12:23.950 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-03-30T13:12:23.950 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 42.902535970999999, 2024-03-30T13:12:23.950 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 9, 2024-03-30T13:12:23.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 27, 2024-03-30T13:12:23.951 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 27, 2024-03-30T13:12:23.951 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 50.826489322999997 2024-03-30T13:12:23.951 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:12:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.943+0000 7f4737000640 1 -- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f470c06c530 msgr2=0x7f470c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.943+0000 7f4737000640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f470c06c530 0x7f470c06e9f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4720036000 tx=0x7f472002e000 comp rx=0 tx=0).stop 2024-03-30T13:12:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.943+0000 7f4737000640 1 -- 172.21.15.44:0/1259300738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47301f79a0 msgr2=0x7f47301e8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.943+0000 7f4737000640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47301f79a0 0x7f47301e8ad0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4718010890 tx=0x7f4718010d50 comp rx=0 tx=0).stop 2024-03-30T13:12:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.943+0000 7f4737000640 1 -- 172.21.15.44:0/1259300738 shutdown_connections 2024-03-30T13:12:23.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.943+0000 7f4737000640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4730159ed0 0x7f47301e9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.943+0000 7f4737000640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47301f79a0 0x7f47301e8ad0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.943+0000 7f4737000640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f470c06c530 0x7f470c06e9f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.943+0000 7f4737000640 1 --2- 172.21.15.44:0/1259300738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47140039b0 0x7f47301f7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.944+0000 7f4737000640 1 -- 172.21.15.44:0/1259300738 >> 172.21.15.44:0/1259300738 conn(0x7f47300d0cb0 msgr2=0x7f473015f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.944+0000 7f4737000640 1 -- 172.21.15.44:0/1259300738 shutdown_connections 2024-03-30T13:12:23.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:23.944+0000 7f4737000640 1 -- 172.21.15.44:0/1259300738 wait complete. 2024-03-30T13:12:23.966 INFO:teuthology.run_tasks:Running task sequential... 2024-03-30T13:12:23.976 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-03-30T13:12:23.976 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-30T13:12:23.977 INFO:teuthology.task.print:Enabling mgr modules 2024-03-30T13:12:23.977 INFO:teuthology.run_tasks:Running task kclient... 2024-03-30T13:12:23.992 INFO:tasks.kclient:Mounting kernel clients... 2024-03-30T13:12:23.993 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-30T13:12:23.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:23.993 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-03-30T13:12:24.046 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-03-30T13:12:24.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:24.048 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-30T13:12:24.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:24.148 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-03-30T13:12:24.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:24.286 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-03-30T13:12:24.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:24.335 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-03-30T13:12:24.411 INFO:teuthology.orchestra.run.smithi044.stderr:Cannot find device "ceph-brx" 2024-03-30T13:12:24.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:12:24.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:24.414 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2024-03-30T13:12:24.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:24.474 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2024-03-30T13:12:24.569 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2024-03-30T13:12:24.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:12:24.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:24.573 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2024-03-30T13:12:24.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:24.628 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2024-03-30T13:12:24.711 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2024-03-30T13:12:24.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:12:24.714 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-03-30T13:12:24.714 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:12:24.714 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-30T13:12:24.714 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:12:24.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.940+0000 7f979f200640 1 Processor -- start 2024-03-30T13:12:24.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.940+0000 7f979f200640 1 -- start start 2024-03-30T13:12:24.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.942+0000 7f979f200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f97a0071de0 0x7f97a00cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:24.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.942+0000 7f979f200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a00cda30 0x7f97a006d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:24.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.942+0000 7f979f200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97a00737d0 con 0x7f97a0145820 2024-03-30T13:12:24.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.942+0000 7f979f200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f97a0072280 con 0x7f97a0071de0 2024-03-30T13:12:24.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.942+0000 7f979f200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f97a0072560 con 0x7f97a00cda30 2024-03-30T13:12:24.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.942+0000 7f979de00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f97a0145820 0x7f97a015d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:44116/0 (socket says 172.21.15.44:44116) 2024-03-30T13:12:24.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.942+0000 7f979de00640 1 -- 172.21.15.44:0/717485804 learned_addr learned my addr 172.21.15.44:0/717485804 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:24.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.942+0000 7f979d400640 1 --2- 172.21.15.44:0/717485804 >> v2:172.21.15.44:3300/0 conn(0x7f97a0071de0 0x7f97a00cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.942+0000 7f979e800640 1 --2- 172.21.15.44:0/717485804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a00cda30 0x7f97a006d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.943+0000 7f979ca00640 1 -- 172.21.15.44:0/717485804 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965870195 0 0) 0x7f97a00737d0 con 0x7f97a0145820 2024-03-30T13:12:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.943+0000 7f979d400640 1 -- 172.21.15.44:0/717485804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a00cda30 msgr2=0x7f97a006d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.943+0000 7f979d400640 1 --2- 172.21.15.44:0/717485804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a00cda30 0x7f97a006d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.943+0000 7f979d400640 1 -- 172.21.15.44:0/717485804 >> v1:172.21.15.44:6789/0 conn(0x7f97a0145820 legacy=0x7f97a015d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.943+0000 7f979d400640 1 -- 172.21.15.44:0/717485804 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a0072840 con 0x7f97a0071de0 2024-03-30T13:12:24.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.943+0000 7f979e800640 1 --2- 172.21.15.44:0/717485804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a00cda30 0x7f97a006d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:24.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.944+0000 7f979d400640 1 --2- 172.21.15.44:0/717485804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a0071de0 0x7f97a00cd4f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f978c0097a0 tx=0x7f978c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9629509c8c33c84f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:24.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.944+0000 7f979ca00640 1 -- 172.21.15.44:0/717485804 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c035020 con 0x7f97a0071de0 2024-03-30T13:12:24.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.944+0000 7f979ca00640 1 -- 172.21.15.44:0/717485804 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c031810 con 0x7f97a0071de0 2024-03-30T13:12:24.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.944+0000 7f979ca00640 1 -- 172.21.15.44:0/717485804 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c031be0 con 0x7f97a0071de0 2024-03-30T13:12:24.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.945+0000 7f979f200640 1 -- 172.21.15.44:0/717485804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a0071de0 msgr2=0x7f97a00cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:24.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.945+0000 7f979f200640 1 --2- 172.21.15.44:0/717485804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a0071de0 0x7f97a00cd4f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f978c0097a0 tx=0x7f978c02b8b0 comp rx=0 tx=0).stop 2024-03-30T13:12:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.945+0000 7f979f200640 1 -- 172.21.15.44:0/717485804 shutdown_connections 2024-03-30T13:12:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.945+0000 7f979f200640 1 --2- 172.21.15.44:0/717485804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a00cda30 0x7f97a006d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.945+0000 7f979f200640 1 --2- 172.21.15.44:0/717485804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a0071de0 0x7f97a00cd4f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:24.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.945+0000 7f979f200640 1 -- 172.21.15.44:0/717485804 >> 172.21.15.44:0/717485804 conn(0x7f97a006b970 msgr2=0x7f97a006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:24.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.945+0000 7f979f200640 1 -- 172.21.15.44:0/717485804 shutdown_connections 2024-03-30T13:12:24.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.945+0000 7f979f200640 1 -- 172.21.15.44:0/717485804 wait complete. 2024-03-30T13:12:24.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.947+0000 7f979f200640 1 Processor -- start 2024-03-30T13:12:24.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.947+0000 7f979f200640 1 -- start start 2024-03-30T13:12:24.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.948+0000 7f979f200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a0071de0 0x7f97a01f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:24.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.948+0000 7f979f200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a00cda30 0x7f97a00b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.948+0000 7f979f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a0145820 0x7f97a00b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.948+0000 7f979f200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f97a0145c00 con 0x7f97a0145820 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.948+0000 7f979f200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97a0072e00 con 0x7f97a00cda30 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.948+0000 7f979f200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f97a006df30 con 0x7f97a0071de0 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.948+0000 7f979e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a0145820 0x7f97a00b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.948+0000 7f979e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a0145820 0x7f97a00b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38416/0 (socket says 172.21.15.44:38416) 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.948+0000 7f979e800640 1 -- 172.21.15.44:0/2890893400 learned_addr learned my addr 172.21.15.44:0/2890893400 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.949+0000 7f979de00640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a0071de0 0x7f97a01f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.949+0000 7f979d400640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a00cda30 0x7f97a00b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.949+0000 7f979e800640 1 -- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a0071de0 msgr2=0x7f97a01f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.949+0000 7f979e800640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a0071de0 0x7f97a01f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:24.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.949+0000 7f979e800640 1 -- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a00cda30 msgr2=0x7f97a00b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:24.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.949+0000 7f979e800640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a00cda30 0x7f97a00b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:24.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.949+0000 7f979e800640 1 -- 172.21.15.44:0/2890893400 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a00b20d0 con 0x7f97a0145820 2024-03-30T13:12:24.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.949+0000 7f979e800640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a0145820 0x7f97a00b4180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9798009fa0 tx=0x7f979800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:24.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.949+0000 7f9796000640 1 -- 172.21.15.44:0/2890893400 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979801a070 con 0x7f97a0145820 2024-03-30T13:12:24.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.949+0000 7f9796000640 1 -- 172.21.15.44:0/2890893400 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9798003bb0 con 0x7f97a0145820 2024-03-30T13:12:24.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.949+0000 7f979f200640 1 -- 172.21.15.44:0/2890893400 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a00b2370 con 0x7f97a0145820 2024-03-30T13:12:24.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.949+0000 7f9796000640 1 -- 172.21.15.44:0/2890893400 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798004030 con 0x7f97a0145820 2024-03-30T13:12:24.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.950+0000 7f979f200640 1 -- 172.21.15.44:0/2890893400 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a00b2930 con 0x7f97a0145820 2024-03-30T13:12:24.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.951+0000 7f979f200640 1 -- 172.21.15.44:0/2890893400 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a0075890 con 0x7f97a0145820 2024-03-30T13:12:24.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.952+0000 7f9796000640 1 -- 172.21.15.44:0/2890893400 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f979801d070 con 0x7f97a0145820 2024-03-30T13:12:24.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.952+0000 7f9796000640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f978006c530 0x7f978006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:24.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.953+0000 7f9796000640 1 -- 172.21.15.44:0/2890893400 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f979808bde0 con 0x7f97a0145820 2024-03-30T13:12:24.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.953+0000 7f979de00640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f978006c530 0x7f978006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:24.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.954+0000 7f979de00640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f978006c530 0x7f978006e9f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9790000f60 tx=0x7f9790007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:24.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:24.957+0000 7f9796000640 1 -- 172.21.15.44:0/2890893400 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9798010070 con 0x7f97a0145820 2024-03-30T13:12:25.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.210+0000 7f979f200640 1 -- 172.21.15.44:0/2890893400 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f97a006c560 con 0x7f97a0145820 2024-03-30T13:12:25.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.211+0000 7f9796000640 1 -- 172.21.15.44:0/2890893400 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f979805a020 con 0x7f97a0145820 2024-03-30T13:12:25.216 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-30T13:12:25.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.213+0000 7f979f200640 1 -- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f978006c530 msgr2=0x7f978006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.213+0000 7f979f200640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f978006c530 0x7f978006e9f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9790000f60 tx=0x7f9790007c00 comp rx=0 tx=0).stop 2024-03-30T13:12:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.213+0000 7f979f200640 1 -- 172.21.15.44:0/2890893400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a0145820 msgr2=0x7f97a00b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.213+0000 7f979f200640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a0145820 0x7f97a00b4180 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9798009fa0 tx=0x7f979800d560 comp rx=0 tx=0).stop 2024-03-30T13:12:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.214+0000 7f979f200640 1 -- 172.21.15.44:0/2890893400 shutdown_connections 2024-03-30T13:12:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.214+0000 7f979f200640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f97a0145820 0x7f97a00b4180 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.214+0000 7f979f200640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f978006c530 0x7f978006e9f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.214+0000 7f979f200640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97a00cda30 0x7f97a00b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.214+0000 7f979f200640 1 --2- 172.21.15.44:0/2890893400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f97a0071de0 0x7f97a01f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.214+0000 7f979f200640 1 -- 172.21.15.44:0/2890893400 >> 172.21.15.44:0/2890893400 conn(0x7f97a006b970 msgr2=0x7f97a006bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.214+0000 7f979f200640 1 -- 172.21.15.44:0/2890893400 shutdown_connections 2024-03-30T13:12:25.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25.214+0000 7f979f200640 1 -- 172.21.15.44:0/2890893400 wait complete. 2024-03-30T13:12:25.237 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:12:25.237 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:12:25.237 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-03-30T13:12:25.237 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-30T13:12:25.237 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-30T13:12:25.237 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:12:25.237 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:12:25.237 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:12:25.237 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:12:25.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:25.237 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-03-30T13:12:25.292 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:12:25.292 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:12:25.292 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:12:25.292 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:25.292 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-03-30T13:12:25.292 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:25.292 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:25.292 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:25.292 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-03-30T13:12:25.292 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42541sec preferred_lft 42541sec 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:25.293 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-03-30T13:12:25.294 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-30T13:12:25.294 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:25.294 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:12:25.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2024-03-30T13:12:25.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2024-03-30T13:12:25.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2024-03-30T13:12:25.295 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-30T13:12:25.295 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:12:25.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:25.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:25.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:25.602 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:12:25.682 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-03-30T13:12:25.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:25.687 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-03-30T13:12:25.742 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-03-30T13:12:25.742 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:12:25.743 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-30T13:12:25.743 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-30T13:12:25.743 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:12:25.743 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:25.743 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:12:25.743 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-30T13:12:25.743 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-30T13:12:25.743 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-30T13:12:25.743 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:12:25.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:25.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:26.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:26.009 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-03-30T13:12:26.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:26.060 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-03-30T13:12:26.113 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:26.113 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:12:26.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:12:26.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-30T13:12:26.113 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:12:26.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:26.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:26.332 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-30T13:12:26.332 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:26.332 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:12:26.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-30T13:12:26.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-30T13:12:26.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-30T13:12:26.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-30T13:12:26.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-30T13:12:26.332 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:12:26.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:26.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:26.646 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:26.646 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:12:26.647 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-03-30T13:12:26.647 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2024-03-30T13:12:26.647 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:12:26.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:26.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:26.883 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:12:26.883 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-30T13:12:26.935 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:12:26.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:12:26.935 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-30T13:12:26.984 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T13:12:26.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:26.984 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:12:27.127 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:12:27.127 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T13:12:27.127 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-03-30T13:12:27.796 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:12:27.796 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T13:12:27.796 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-03-30T13:12:27.796 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.151:3300,172.21.15.151:3301" 2024-03-30T13:12:27.797 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:12:27.832 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:12:27.832 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T13:12:27.832 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-03-30T13:12:27.832 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.151:3300,172.21.15.151:3301" 2024-03-30T13:12:27.833 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:12:27.833 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.151:6789,172.21.15.151:6790" 2024-03-30T13:12:27.833 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2024-03-30T13:12:27.833 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cf82a1f9-ad5a-4657-adf6-b77304ed0e9d" will pass to kernel 2024-03-30T13:12:27.838 INFO:teuthology.orchestra.run.smithi044.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-30T13:12:27.838 INFO:teuthology.orchestra.run.smithi044.stdout: You just mounted a file system that supports labels which does not 2024-03-30T13:12:27.838 INFO:teuthology.orchestra.run.smithi044.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T13:12:27.838 INFO:teuthology.orchestra.run.smithi044.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T13:12:27.838 INFO:teuthology.orchestra.run.smithi044.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T13:12:27.844 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T13:12:27.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:27.845 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-30T13:12:27.944 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:28.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:28.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:28.079 INFO:teuthology.orchestra.run.smithi044.stdout:client4729 2024-03-30T13:12:28.080 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:12:28.080 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:28.132 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:28.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:28.306 INFO:teuthology.orchestra.run.smithi044.stdout:client4729 2024-03-30T13:12:28.306 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:28.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:28.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:28.431 INFO:teuthology.orchestra.run.smithi044.stdout:client4729 2024-03-30T13:12:28.432 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/cf82a1f9-ad5a-4657-adf6-b77304ed0e9d.client4729/status') 2024-03-30T13:12:28.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:28.578 INFO:teuthology.orchestra.run.smithi044.stdout:instance: client.4729 (3)172.21.15.44:0/1328933340 2024-03-30T13:12:28.578 INFO:teuthology.orchestra.run.smithi044.stdout:blocklisted: false 2024-03-30T13:12:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:0+1 records in 2024-03-30T13:12:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:0+1 records out 2024-03-30T13:12:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:70 bytes copied, 6.8088e-05 s, 1.0 MB/s 2024-03-30T13:12:28.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:28.591 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-03-30T13:12:28.591 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:12:28.591 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-30T13:12:28.591 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:12:28.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.800+0000 7fcf30c00640 1 Processor -- start 2024-03-30T13:12:28.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.800+0000 7fcf30c00640 1 -- start start 2024-03-30T13:12:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.801+0000 7fcf30c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c0d1390 0x7fcf2c0d1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.801+0000 7fcf30c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcf2c0b39d0 0x7fcf2c0b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.801+0000 7fcf30c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf2c0ba3d0 con 0x7fcf2c0b3570 2024-03-30T13:12:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.801+0000 7fcf30c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fcf2c0d1cb0 con 0x7fcf2c0b39d0 2024-03-30T13:12:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.801+0000 7fcf30c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcf2c0cf6e0 con 0x7fcf2c0d1390 2024-03-30T13:12:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.802+0000 7fcf29400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcf2c0b3570 0x7fcf2c0b7530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49570/0 (socket says 172.21.15.44:49570) 2024-03-30T13:12:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.802+0000 7fcf29400640 1 -- 172.21.15.44:0/2167278671 learned_addr learned my addr 172.21.15.44:0/2167278671 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.802+0000 7fcf2a800640 1 --2- 172.21.15.44:0/2167278671 >> v2:172.21.15.151:3300/0 conn(0x7fcf2c0b39d0 0x7fcf2c0b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.802+0000 7fcf29e00640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c0d1390 0x7fcf2c0d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.802+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 930133935 0 0) 0x7fcf2c0ba3d0 con 0x7fcf2c0b3570 2024-03-30T13:12:28.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.802+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf10003520 con 0x7fcf2c0b3570 2024-03-30T13:12:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1635987653 0 0) 0x7fcf10003520 con 0x7fcf2c0b3570 2024-03-30T13:12:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c0d1390 msgr2=0x7fcf2c0d1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c0d1390 0x7fcf2c0d1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 >> v2:172.21.15.151:3300/0 conn(0x7fcf2c0b39d0 msgr2=0x7fcf2c0b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 --2- 172.21.15.44:0/2167278671 >> v2:172.21.15.151:3300/0 conn(0x7fcf2c0b39d0 0x7fcf2c0b7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2c0b9050 con 0x7fcf2c0b3570 2024-03-30T13:12:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fcf18001670 con 0x7fcf2c0b3570 2024-03-30T13:12:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 >> v1:172.21.15.44:6789/0 conn(0x7fcf2c0b3570 legacy=0x7fcf2c0b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c0d1390 0x7fcf100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf10003f80 0x7fcf10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf10004d40 0x7fcf100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:28.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c0d1cb0 con 0x7fcf10004d40 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c0cf6e0 con 0x7fcf10003f80 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcf1000ba40 con 0x7fcf2c0d1390 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.803+0000 7fcf2a800640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf10004d40 0x7fcf100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.804+0000 7fcf29e00640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c0d1390 0x7fcf100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.804+0000 7fcf29400640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf10003f80 0x7fcf10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.804+0000 7fcf2a800640 1 -- 172.21.15.44:0/2167278671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c0d1390 msgr2=0x7fcf100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.804+0000 7fcf2a800640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c0d1390 0x7fcf100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.804+0000 7fcf2a800640 1 -- 172.21.15.44:0/2167278671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf10003f80 msgr2=0x7fcf10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.804+0000 7fcf2a800640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf10003f80 0x7fcf10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.804+0000 7fcf2a800640 1 -- 172.21.15.44:0/2167278671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf10003520 con 0x7fcf10004d40 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.804+0000 7fcf29400640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf10003f80 0x7fcf10004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.805+0000 7fcf2a800640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf10004d40 0x7fcf100051c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009fc0 tx=0x7fcf10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a101d77a7f8b72 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.805+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24039070 con 0x7fcf10004d40 2024-03-30T13:12:28.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.805+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf2402cc60 con 0x7fcf10004d40 2024-03-30T13:12:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.805+0000 7fcf28a00640 1 -- 172.21.15.44:0/2167278671 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf24009c10 con 0x7fcf10004d40 2024-03-30T13:12:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.806+0000 7fcf30c00640 1 -- 172.21.15.44:0/2167278671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf10004d40 msgr2=0x7fcf100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.806+0000 7fcf30c00640 1 --2- 172.21.15.44:0/2167278671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf10004d40 0x7fcf100051c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009fc0 tx=0x7fcf10005830 comp rx=0 tx=0).stop 2024-03-30T13:12:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.806+0000 7fcf2a800640 1 -- 172.21.15.44:0/2167278671 reap_dead start 2024-03-30T13:12:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.806+0000 7fcf30c00640 1 -- 172.21.15.44:0/2167278671 shutdown_connections 2024-03-30T13:12:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.806+0000 7fcf30c00640 1 -- 172.21.15.44:0/2167278671 >> 172.21.15.44:0/2167278671 conn(0x7fcf2c0676e0 msgr2=0x7fcf2c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.806+0000 7fcf30c00640 1 -- 172.21.15.44:0/2167278671 shutdown_connections 2024-03-30T13:12:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.806+0000 7fcf30c00640 1 -- 172.21.15.44:0/2167278671 wait complete. 2024-03-30T13:12:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.808+0000 7fcf30c00640 1 Processor -- start 2024-03-30T13:12:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.808+0000 7fcf30c00640 1 -- start start 2024-03-30T13:12:28.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.809+0000 7fcf30c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf2c155e70 0x7fcf2c0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:28.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.809+0000 7fcf30c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c0cbe90 0x7fcf2c15f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:28.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.809+0000 7fcf30c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c15fe00 0x7fcf2c160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.809+0000 7fcf30c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c0b98f0 con 0x7fcf2c0cbe90 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.809+0000 7fcf30c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c0b9610 con 0x7fcf2c155e70 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.809+0000 7fcf30c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcf2c0b9bd0 con 0x7fcf2c15fe00 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.809+0000 7fcf29400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c0cbe90 0x7fcf2c15f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.809+0000 7fcf29400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c0cbe90 0x7fcf2c15f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46970/0 (socket says 172.21.15.44:46970) 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.809+0000 7fcf29400640 1 -- 172.21.15.44:0/2524839207 learned_addr learned my addr 172.21.15.44:0/2524839207 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.810+0000 7fcf29e00640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf2c155e70 0x7fcf2c0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.810+0000 7fcf2a800640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c15fe00 0x7fcf2c160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.810+0000 7fcf29400640 1 -- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c15fe00 msgr2=0x7fcf2c160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.810+0000 7fcf29400640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c15fe00 0x7fcf2c160240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.810+0000 7fcf29400640 1 -- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf2c155e70 msgr2=0x7fcf2c0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.810+0000 7fcf29400640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf2c155e70 0x7fcf2c0cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.810+0000 7fcf29400640 1 -- 172.21.15.44:0/2524839207 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2c0cc310 con 0x7fcf2c0cbe90 2024-03-30T13:12:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.810+0000 7fcf29e00640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf2c155e70 0x7fcf2c0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.810+0000 7fcf29400640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c0cbe90 0x7fcf2c15f8c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800db10 tx=0x7fcf18001740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.810+0000 7fcf22000640 1 -- 172.21.15.44:0/2524839207 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18019070 con 0x7fcf2c0cbe90 2024-03-30T13:12:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.811+0000 7fcf22000640 1 -- 172.21.15.44:0/2524839207 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf18004cb0 con 0x7fcf2c0cbe90 2024-03-30T13:12:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.811+0000 7fcf22000640 1 -- 172.21.15.44:0/2524839207 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf18004e60 con 0x7fcf2c0cbe90 2024-03-30T13:12:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.811+0000 7fcf30c00640 1 -- 172.21.15.44:0/2524839207 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf2c0cc5e0 con 0x7fcf2c0cbe90 2024-03-30T13:12:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.811+0000 7fcf30c00640 1 -- 172.21.15.44:0/2524839207 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf2c0ccba0 con 0x7fcf2c0cbe90 2024-03-30T13:12:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.812+0000 7fcf30c00640 1 -- 172.21.15.44:0/2524839207 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf2c075a10 con 0x7fcf2c0cbe90 2024-03-30T13:12:28.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.813+0000 7fcf22000640 1 -- 172.21.15.44:0/2524839207 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcf18007310 con 0x7fcf2c0cbe90 2024-03-30T13:12:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.814+0000 7fcf22000640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcf0c06c560 0x7fcf0c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.814+0000 7fcf22000640 1 -- 172.21.15.44:0/2524839207 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fcf1808b9d0 con 0x7fcf2c0cbe90 2024-03-30T13:12:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.815+0000 7fcf29e00640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcf0c06c560 0x7fcf0c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.816+0000 7fcf29e00640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcf0c06c560 0x7fcf0c06ea20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009a00 tx=0x7fcf1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:28.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:28.819+0000 7fcf22000640 1 -- 172.21.15.44:0/2524839207 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fcf18059520 con 0x7fcf2c0cbe90 2024-03-30T13:12:29.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.073+0000 7fcf30c00640 1 -- 172.21.15.44:0/2524839207 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcf2c06b580 con 0x7fcf2c0cbe90 2024-03-30T13:12:29.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.074+0000 7fcf22000640 1 -- 172.21.15.44:0/2524839207 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fcf1805d820 con 0x7fcf2c0cbe90 2024-03-30T13:12:29.079 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-30T13:12:29.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.077+0000 7fcf30c00640 1 -- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcf0c06c560 msgr2=0x7fcf0c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:29.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.077+0000 7fcf30c00640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcf0c06c560 0x7fcf0c06ea20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009a00 tx=0x7fcf1c008040 comp rx=0 tx=0).stop 2024-03-30T13:12:29.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.077+0000 7fcf30c00640 1 -- 172.21.15.44:0/2524839207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c0cbe90 msgr2=0x7fcf2c15f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:29.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.077+0000 7fcf30c00640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c0cbe90 0x7fcf2c15f8c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800db10 tx=0x7fcf18001740 comp rx=0 tx=0).stop 2024-03-30T13:12:29.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.077+0000 7fcf30c00640 1 -- 172.21.15.44:0/2524839207 shutdown_connections 2024-03-30T13:12:29.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.077+0000 7fcf30c00640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf2c15fe00 0x7fcf2c160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:29.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.077+0000 7fcf30c00640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf2c0cbe90 0x7fcf2c15f8c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:29.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.077+0000 7fcf30c00640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcf0c06c560 0x7fcf0c06ea20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:29.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.077+0000 7fcf30c00640 1 --2- 172.21.15.44:0/2524839207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf2c155e70 0x7fcf2c0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:29.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.077+0000 7fcf30c00640 1 -- 172.21.15.44:0/2524839207 >> 172.21.15.44:0/2524839207 conn(0x7fcf2c0676e0 msgr2=0x7fcf2c0b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:29.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.077+0000 7fcf30c00640 1 -- 172.21.15.44:0/2524839207 shutdown_connections 2024-03-30T13:12:29.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29.077+0000 7fcf30c00640 1 -- 172.21.15.44:0/2524839207 wait complete. 2024-03-30T13:12:29.101 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:12:29.101 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:12:29.101 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-03-30T13:12:29.102 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-30T13:12:29.102 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-30T13:12:29.102 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:12:29.102 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:12:29.102 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:12:29.102 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-30T13:12:29.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:29.102 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-03-30T13:12:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:12:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:12:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:12:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-03-30T13:12:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-03-30T13:12:29.155 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42537sec preferred_lft 42537sec 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether be:3f:aa:6f:f2:70 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T13:12:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9812:b6ff:fe91:f007/64 scope link 2024-03-30T13:12:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:29.157 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:12:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether be:3f:aa:6f:f2:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:12:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::bc3f:aaff:fe6f:f270/64 scope link 2024-03-30T13:12:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:29.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:29.158 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:12:29.253 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-03-30T13:12:29.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:29.258 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-03-30T13:12:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-03-30T13:12:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:12:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-30T13:12:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-30T13:12:29.311 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:12:29.312 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:29.312 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:12:29.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-30T13:12:29.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-30T13:12:29.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-30T13:12:29.312 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:12:29.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:29.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:29.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:29.560 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-03-30T13:12:29.611 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-30T13:12:29.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:29.611 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-03-30T13:12:29.663 INFO:teuthology.orchestra.run.smithi044.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-30T13:12:29.664 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:29.664 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:12:29.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:12:29.664 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-30T13:12:29.664 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:12:29.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:29.738 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:29.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:29.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:29.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:29.865 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-30T13:12:30.004 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:12:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:12:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:12:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-03-30T13:12:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:30.005 INFO:teuthology.orchestra.run.smithi044.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:12:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether fa:95:15:5e:d1:4b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T13:12:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T13:12:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::f895:15ff:fe5e:d14b/64 scope link 2024-03-30T13:12:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:30.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:30.010 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-30T13:12:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:12:30.109 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:12:30.109 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:12:30.109 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:30.109 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-03-30T13:12:30.109 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:30.109 INFO:teuthology.orchestra.run.smithi044.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:12:30.110 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether fa:95:15:5e:d1:4b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T13:12:30.110 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T13:12:30.110 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:30.110 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::f895:15ff:fe5e:d14b/64 scope link 2024-03-30T13:12:30.110 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:30.114 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-30T13:12:30.114 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:30.115 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:12:30.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-30T13:12:30.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-30T13:12:30.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-30T13:12:30.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-30T13:12:30.115 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-30T13:12:30.115 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:12:30.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:30.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:30.475 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:30.475 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:12:30.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.1 up 2024-03-30T13:12:30.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.1 master ceph-brx 2024-03-30T13:12:30.475 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:12:30.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:30.722 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:12:30.722 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-30T13:12:30.773 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-30T13:12:30.773 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:12:30.773 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-30T13:12:30.828 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T13:12:30.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:30.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-30T13:12:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-30T13:12:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-30T13:12:30.977 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-03-30T13:12:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-30T13:12:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-30T13:12:31.000 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-03-30T13:12:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.151:3300,172.21.15.151:3301" 2024-03-30T13:12:31.001 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:12:31.028 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-30T13:12:31.029 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-30T13:12:31.029 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-03-30T13:12:31.029 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.151:3300,172.21.15.151:3301" 2024-03-30T13:12:31.029 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:12:31.029 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.151:6789,172.21.15.151:6790" 2024-03-30T13:12:31.029 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2024-03-30T13:12:31.029 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=cf82a1f9-ad5a-4657-adf6-b77304ed0e9d" will pass to kernel 2024-03-30T13:12:31.032 INFO:teuthology.orchestra.run.smithi044.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-30T13:12:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: You just mounted a file system that supports labels which does not 2024-03-30T13:12:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T13:12:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T13:12:31.032 INFO:teuthology.orchestra.run.smithi044.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T13:12:31.038 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T13:12:31.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:31.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-30T13:12:31.132 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:31.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:31.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:31.249 INFO:teuthology.orchestra.run.smithi044.stdout:client4556 2024-03-30T13:12:31.250 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:12:31.250 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:31.304 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:31.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:31.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:31.430 INFO:teuthology.orchestra.run.smithi044.stdout:client4556 2024-03-30T13:12:31.430 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:31.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:31.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:31.556 INFO:teuthology.orchestra.run.smithi044.stdout:client4556 2024-03-30T13:12:31.556 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/cf82a1f9-ad5a-4657-adf6-b77304ed0e9d.client4556/status') 2024-03-30T13:12:31.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:instance: client.4556 (3)172.21.15.44:0/3084213222 2024-03-30T13:12:31.700 INFO:teuthology.orchestra.run.smithi044.stdout:blocklisted: false 2024-03-30T13:12:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:0+1 records in 2024-03-30T13:12:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:0+1 records out 2024-03-30T13:12:31.701 INFO:teuthology.orchestra.run.smithi044.stderr:70 bytes copied, 6.8437e-05 s, 1.0 MB/s 2024-03-30T13:12:31.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:31.713 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-03-30T13:12:31.713 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:12:31.713 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-30T13:12:31.714 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:12:31.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.929+0000 7f79a9600640 1 Processor -- start 2024-03-30T13:12:31.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.929+0000 7f79a9600640 1 -- start start 2024-03-30T13:12:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.931+0000 7f79a9600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a4071de0 0x7f79a40cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.931+0000 7f79a9600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a40737d0 con 0x7f79a4145820 2024-03-30T13:12:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.931+0000 7f79a9600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a4072280 con 0x7f79a40cda30 2024-03-30T13:12:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.931+0000 7f79a9600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f79a4072560 con 0x7f79a4071de0 2024-03-30T13:12:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.931+0000 7f79a3e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f79a4145820 0x7f79a415d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49574/0 (socket says 172.21.15.44:49574) 2024-03-30T13:12:31.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.931+0000 7f79a3e00640 1 -- 172.21.15.44:0/1974010992 learned_addr learned my addr 172.21.15.44:0/1974010992 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.932+0000 7f799b400640 1 --2- 172.21.15.44:0/1974010992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a4071de0 0x7f79a40cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.932+0000 7f79a3400640 1 -- 172.21.15.44:0/1974010992 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402028503 0 0) 0x7f79a40737d0 con 0x7f79a4145820 2024-03-30T13:12:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.932+0000 7f79a3400640 1 -- 172.21.15.44:0/1974010992 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7988003520 con 0x7f79a4145820 2024-03-30T13:12:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.932+0000 7f79a3400640 1 -- 172.21.15.44:0/1974010992 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283984684 0 0) 0x7f79a4072280 con 0x7f79a40cda30 2024-03-30T13:12:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.932+0000 7f79a3400640 1 -- 172.21.15.44:0/1974010992 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79a40737d0 con 0x7f79a40cda30 2024-03-30T13:12:31.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.932+0000 7f79a3400640 1 -- 172.21.15.44:0/1974010992 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3451057507 0 0) 0x7f7988003520 con 0x7f79a4145820 2024-03-30T13:12:31.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.932+0000 7f799b400640 1 -- 172.21.15.44:0/1974010992 >> v1:172.21.15.151:6789/0 conn(0x7f79a40cda30 legacy=0x7f79a406d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:31.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.932+0000 7f799b400640 1 -- 172.21.15.44:0/1974010992 >> v1:172.21.15.44:6789/0 conn(0x7f79a4145820 legacy=0x7f79a415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:31.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.932+0000 7f799b400640 1 -- 172.21.15.44:0/1974010992 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a4072840 con 0x7f79a4071de0 2024-03-30T13:12:31.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.934+0000 7f799b400640 1 --2- 172.21.15.44:0/1974010992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a4071de0 0x7f79a40cd4f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f798c0097d0 tx=0x7f798c02b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4673433558b6db2e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.934+0000 7f79a3400640 1 -- 172.21.15.44:0/1974010992 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c037070 con 0x7f79a4071de0 2024-03-30T13:12:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.934+0000 7f79a3400640 1 -- 172.21.15.44:0/1974010992 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c030510 con 0x7f79a4071de0 2024-03-30T13:12:31.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.934+0000 7f79a3400640 1 -- 172.21.15.44:0/1974010992 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79940019f0 con 0x7f79a4071de0 2024-03-30T13:12:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.935+0000 7f79a9600640 1 -- 172.21.15.44:0/1974010992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a4071de0 msgr2=0x7f79a40cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.935+0000 7f79a9600640 1 --2- 172.21.15.44:0/1974010992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a4071de0 0x7f79a40cd4f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f798c0097d0 tx=0x7f798c02b800 comp rx=0 tx=0).stop 2024-03-30T13:12:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.935+0000 7f79a9600640 1 -- 172.21.15.44:0/1974010992 shutdown_connections 2024-03-30T13:12:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.935+0000 7f79a9600640 1 --2- 172.21.15.44:0/1974010992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a4071de0 0x7f79a40cd4f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.935+0000 7f79a9600640 1 -- 172.21.15.44:0/1974010992 >> 172.21.15.44:0/1974010992 conn(0x7f79a406b970 msgr2=0x7f79a406bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.935+0000 7f79a9600640 1 -- 172.21.15.44:0/1974010992 shutdown_connections 2024-03-30T13:12:31.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.935+0000 7f79a9600640 1 -- 172.21.15.44:0/1974010992 wait complete. 2024-03-30T13:12:31.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.937+0000 7f79a9600640 1 Processor -- start 2024-03-30T13:12:31.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.937+0000 7f79a9600640 1 -- start start 2024-03-30T13:12:31.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.938+0000 7f79a9600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a4071de0 0x7f79a413f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:31.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.938+0000 7f79a9600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79a40cda30 0x7f79a414d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:31.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.938+0000 7f79a9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a4145820 0x7f79a40cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:31.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.938+0000 7f79a9600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f79a4145c00 con 0x7f79a4145820 2024-03-30T13:12:31.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.938+0000 7f79a9600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f79a4072e00 con 0x7f79a40cda30 2024-03-30T13:12:31.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.938+0000 7f79a9600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f79a406e100 con 0x7f79a4071de0 2024-03-30T13:12:31.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.939+0000 7f79a8c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a4145820 0x7f79a40cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:31.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.939+0000 7f79a8c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a4145820 0x7f79a40cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46980/0 (socket says 172.21.15.44:46980) 2024-03-30T13:12:31.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.939+0000 7f79a8c00640 1 -- 172.21.15.44:0/2824023929 learned_addr learned my addr 172.21.15.44:0/2824023929 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:31.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.939+0000 7f79a3e00640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a4071de0 0x7f79a413f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:31.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.939+0000 7f799b400640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79a40cda30 0x7f79a414d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:31.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.939+0000 7f79a8c00640 1 -- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a4071de0 msgr2=0x7f79a413f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:31.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.939+0000 7f79a8c00640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a4071de0 0x7f79a413f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:31.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.939+0000 7f79a8c00640 1 -- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79a40cda30 msgr2=0x7f79a414d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:31.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.939+0000 7f79a8c00640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79a40cda30 0x7f79a414d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:31.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.939+0000 7f79a8c00640 1 -- 172.21.15.44:0/2824023929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a413f650 con 0x7f79a4145820 2024-03-30T13:12:31.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.940+0000 7f79a8c00640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a4145820 0x7f79a40cbda0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f799c00c400 tx=0x7f799c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:31.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.940+0000 7f79a0c00640 1 -- 172.21.15.44:0/2824023929 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c017070 con 0x7f79a4145820 2024-03-30T13:12:31.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.940+0000 7f79a0c00640 1 -- 172.21.15.44:0/2824023929 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799c0052d0 con 0x7f79a4145820 2024-03-30T13:12:31.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.940+0000 7f79a9600640 1 -- 172.21.15.44:0/2824023929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a40b2e90 con 0x7f79a4145820 2024-03-30T13:12:31.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.940+0000 7f79a0c00640 1 -- 172.21.15.44:0/2824023929 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c0037f0 con 0x7f79a4145820 2024-03-30T13:12:31.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.940+0000 7f79a9600640 1 -- 172.21.15.44:0/2824023929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a40b3450 con 0x7f79a4145820 2024-03-30T13:12:31.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.941+0000 7f79a9600640 1 -- 172.21.15.44:0/2824023929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a4075890 con 0x7f79a4145820 2024-03-30T13:12:31.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.942+0000 7f79a0c00640 1 -- 172.21.15.44:0/2824023929 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f799c01a070 con 0x7f79a4145820 2024-03-30T13:12:31.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.943+0000 7f79a0c00640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f798006c530 0x7f798006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:31.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.943+0000 7f79a0c00640 1 -- 172.21.15.44:0/2824023929 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f799c08aeb0 con 0x7f79a4145820 2024-03-30T13:12:31.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.944+0000 7f79a3e00640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f798006c530 0x7f798006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:31.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.945+0000 7f79a3e00640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f798006c530 0x7f798006e9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7994001560 tx=0x7f7994009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:31.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:31.948+0000 7f79a0c00640 1 -- 172.21.15.44:0/2824023929 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f799c0589c0 con 0x7f79a4145820 2024-03-30T13:12:32.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.195+0000 7f79a9600640 1 -- 172.21.15.44:0/2824023929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f79a4074b10 con 0x7f79a4145820 2024-03-30T13:12:32.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.196+0000 7f79a0c00640 1 -- 172.21.15.44:0/2824023929 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f799c05ccc0 con 0x7f79a4145820 2024-03-30T13:12:32.201 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-30T13:12:32.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.199+0000 7f79a9600640 1 -- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f798006c530 msgr2=0x7f798006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:32.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.199+0000 7f79a9600640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f798006c530 0x7f798006e9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7994001560 tx=0x7f7994009040 comp rx=0 tx=0).stop 2024-03-30T13:12:32.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.199+0000 7f79a9600640 1 -- 172.21.15.44:0/2824023929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a4145820 msgr2=0x7f79a40cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:32.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.199+0000 7f79a9600640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a4145820 0x7f79a40cbda0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f799c00c400 tx=0x7f799c00c8c0 comp rx=0 tx=0).stop 2024-03-30T13:12:32.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.199+0000 7f79a9600640 1 -- 172.21.15.44:0/2824023929 shutdown_connections 2024-03-30T13:12:32.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.199+0000 7f79a9600640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f79a4145820 0x7f79a40cbda0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:32.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.199+0000 7f79a9600640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f798006c530 0x7f798006e9f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:32.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.199+0000 7f79a9600640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79a40cda30 0x7f79a414d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:32.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.199+0000 7f79a9600640 1 --2- 172.21.15.44:0/2824023929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79a4071de0 0x7f79a413f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:32.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.199+0000 7f79a9600640 1 -- 172.21.15.44:0/2824023929 >> 172.21.15.44:0/2824023929 conn(0x7f79a406b970 msgr2=0x7f79a41435d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:32.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.199+0000 7f79a9600640 1 -- 172.21.15.44:0/2824023929 shutdown_connections 2024-03-30T13:12:32.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:32.199+0000 7f79a9600640 1 -- 172.21.15.44:0/2824023929 wait complete. 2024-03-30T13:12:32.224 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:12:32.225 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:12:32.225 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2024-03-30T13:12:32.225 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-30T13:12:32.225 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-30T13:12:32.225 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:12:32.225 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:12:32.225 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:12:32.225 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:12:32.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:32.225 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2024-03-30T13:12:32.281 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:12:32.281 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:12:32.281 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:12:32.281 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:32.281 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2024-03-30T13:12:32.281 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:32.281 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42562sec preferred_lft 42562sec 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2024-03-30T13:12:32.282 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:32.283 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-30T13:12:32.284 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:32.284 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-03-30T13:12:32.284 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2024-03-30T13:12:32.284 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2024-03-30T13:12:32.284 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2024-03-30T13:12:32.284 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-30T13:12:32.284 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-03-30T13:12:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:32.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:32.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:32.780 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:12:32.855 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-03-30T13:12:32.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:32.858 DEBUG:teuthology.orchestra.run.smithi151:> route 2024-03-30T13:12:32.904 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2024-03-30T13:12:32.904 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:12:32.904 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:12:32.904 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:12:32.904 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:12:32.905 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:32.905 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-03-30T13:12:32.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:12:32.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:12:32.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:12:32.905 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-03-30T13:12:33.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:33.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:33.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:33.710 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2024-03-30T13:12:33.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:33.761 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2024-03-30T13:12:33.808 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:33.808 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-03-30T13:12:33.809 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:12:33.809 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-30T13:12:33.809 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-03-30T13:12:33.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:34.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:34.051 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-30T13:12:34.052 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:34.052 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-03-30T13:12:34.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-30T13:12:34.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-30T13:12:34.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-30T13:12:34.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-30T13:12:34.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-30T13:12:34.052 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-03-30T13:12:34.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:34.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:34.596 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:34.596 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-03-30T13:12:34.596 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2024-03-30T13:12:34.596 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2024-03-30T13:12:34.596 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-03-30T13:12:34.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:34.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:34.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:12:34.823 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-30T13:12:34.866 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:12:34.867 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:12:34.867 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-30T13:12:34.957 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T13:12:34.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:34.957 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:12:35.086 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:12:35.086 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T13:12:35.086 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2024-03-30T13:12:35.704 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:12:35.704 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T13:12:35.704 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2024-03-30T13:12:35.704 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.151:3300,172.21.15.151:3301" 2024-03-30T13:12:35.704 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:12:35.737 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:12:35.737 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T13:12:35.737 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2024-03-30T13:12:35.737 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.151:3300,172.21.15.151:3301" 2024-03-30T13:12:35.737 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:12:35.737 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.151:6789,172.21.15.151:6790" 2024-03-30T13:12:35.737 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2024-03-30T13:12:35.737 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=cf82a1f9-ad5a-4657-adf6-b77304ed0e9d" will pass to kernel 2024-03-30T13:12:35.740 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-30T13:12:35.740 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2024-03-30T13:12:35.740 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T13:12:35.741 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T13:12:35.741 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T13:12:35.748 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T13:12:35.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:35.748 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-30T13:12:35.833 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:35.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:35.946 INFO:teuthology.orchestra.run.smithi151.stdout:client4565 2024-03-30T13:12:35.946 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:12:35.946 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:35.991 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:36.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:36.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:36.190 INFO:teuthology.orchestra.run.smithi151.stdout:client4565 2024-03-30T13:12:36.190 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:36.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:36.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:36.307 INFO:teuthology.orchestra.run.smithi151.stdout:client4565 2024-03-30T13:12:36.308 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/cf82a1f9-ad5a-4657-adf6-b77304ed0e9d.client4565/status') 2024-03-30T13:12:36.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:36.443 INFO:teuthology.orchestra.run.smithi151.stdout:instance: client.4565 (3)192.168.0.1:0/1118134229 2024-03-30T13:12:36.443 INFO:teuthology.orchestra.run.smithi151.stdout:blocklisted: false 2024-03-30T13:12:36.443 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records in 2024-03-30T13:12:36.443 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records out 2024-03-30T13:12:36.443 INFO:teuthology.orchestra.run.smithi151.stderr:69 bytes copied, 6.2426e-05 s, 1.1 MB/s 2024-03-30T13:12:36.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:36.455 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-03-30T13:12:36.455 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-30T13:12:36.455 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-30T13:12:36.455 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:12:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.682+0000 7ffa05400640 1 Processor -- start 2024-03-30T13:12:36.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.682+0000 7ffa05400640 1 -- start start 2024-03-30T13:12:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.684+0000 7ffa05400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa00145850 0x7ffa00072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.684+0000 7ffa05400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa00148bb0 0x7ffa00072a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.684+0000 7ffa05400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa00163b70 con 0x7ffa00166210 2024-03-30T13:12:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.684+0000 7ffa05400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ffa00166f20 con 0x7ffa00148bb0 2024-03-30T13:12:36.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.684+0000 7ffa05400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ffa001480d0 con 0x7ffa00145850 2024-03-30T13:12:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.685+0000 7ff9f7400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ffa00148bb0 0x7ffa00072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.685+0000 7ffa04a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ffa00166210 0x7ffa00166680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49578/0 (socket says 172.21.15.44:49578) 2024-03-30T13:12:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.685+0000 7ffa04a00640 1 -- 172.21.15.44:0/2635212404 learned_addr learned my addr 172.21.15.44:0/2635212404 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.685+0000 7ff9ffe00640 1 --2- 172.21.15.44:0/2635212404 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa00145850 0x7ffa00072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.685+0000 7ff9f7400640 1 -- 172.21.15.44:0/2635212404 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa00145850 msgr2=0x7ffa00072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.685+0000 7ff9f7400640 1 --2- 172.21.15.44:0/2635212404 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa00145850 0x7ffa00072510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.685+0000 7ff9f7400640 1 -- 172.21.15.44:0/2635212404 >> v1:172.21.15.44:6789/0 conn(0x7ffa00166210 legacy=0x7ffa00166680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.685+0000 7ff9f7400640 1 -- 172.21.15.44:0/2635212404 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa001483b0 con 0x7ffa00148bb0 2024-03-30T13:12:36.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.685+0000 7ff9ffe00640 1 --2- 172.21.15.44:0/2635212404 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa00145850 0x7ffa00072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:36.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.686+0000 7ff9f7400640 1 --2- 172.21.15.44:0/2635212404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00148bb0 0x7ffa00072a50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80097a0 tx=0x7ff9e802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caee81753533ab77 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:36.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.687+0000 7ff9ff400640 1 -- 172.21.15.44:0/2635212404 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8035020 con 0x7ffa00148bb0 2024-03-30T13:12:36.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.687+0000 7ff9ff400640 1 -- 172.21.15.44:0/2635212404 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e8031810 con 0x7ffa00148bb0 2024-03-30T13:12:36.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.687+0000 7ff9ff400640 1 -- 172.21.15.44:0/2635212404 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8031be0 con 0x7ffa00148bb0 2024-03-30T13:12:36.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.687+0000 7ffa05400640 1 -- 172.21.15.44:0/2635212404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00148bb0 msgr2=0x7ffa00072a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:36.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.687+0000 7ffa05400640 1 --2- 172.21.15.44:0/2635212404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00148bb0 0x7ffa00072a50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80097a0 tx=0x7ff9e802b8b0 comp rx=0 tx=0).stop 2024-03-30T13:12:36.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.687+0000 7ffa05400640 1 -- 172.21.15.44:0/2635212404 shutdown_connections 2024-03-30T13:12:36.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.687+0000 7ffa05400640 1 --2- 172.21.15.44:0/2635212404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00148bb0 0x7ffa00072a50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.687+0000 7ffa05400640 1 --2- 172.21.15.44:0/2635212404 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa00145850 0x7ffa00072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.687+0000 7ffa05400640 1 -- 172.21.15.44:0/2635212404 >> 172.21.15.44:0/2635212404 conn(0x7ffa0006b970 msgr2=0x7ffa0006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.687+0000 7ffa05400640 1 -- 172.21.15.44:0/2635212404 shutdown_connections 2024-03-30T13:12:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.688+0000 7ffa05400640 1 -- 172.21.15.44:0/2635212404 wait complete. 2024-03-30T13:12:36.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.689+0000 7ffa05400640 1 Processor -- start 2024-03-30T13:12:36.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.689+0000 7ffa05400640 1 -- start start 2024-03-30T13:12:36.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.690+0000 7ffa05400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa00145850 0x7ffa00147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:36.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.690+0000 7ffa05400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00148bb0 0x7ffa0015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:36.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.690+0000 7ffa05400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa00166210 0x7ffa0015c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:36.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.690+0000 7ffa05400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0015f970 con 0x7ffa00148bb0 2024-03-30T13:12:36.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.690+0000 7ffa05400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0015f7f0 con 0x7ffa00166210 2024-03-30T13:12:36.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.690+0000 7ffa05400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ffa0015faf0 con 0x7ffa00145850 2024-03-30T13:12:36.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.691+0000 7ff9f7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00148bb0 0x7ffa0015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:36.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.691+0000 7ff9f7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00148bb0 0x7ffa0015bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:46996/0 (socket says 172.21.15.44:46996) 2024-03-30T13:12:36.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.691+0000 7ff9f7400640 1 -- 172.21.15.44:0/2143819102 learned_addr learned my addr 172.21.15.44:0/2143819102 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:36.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.691+0000 7ff9ffe00640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa00145850 0x7ffa00147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:36.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.691+0000 7ffa04a00640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa00166210 0x7ffa0015c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:36.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.691+0000 7ff9f7400640 1 -- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa00145850 msgr2=0x7ffa00147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:36.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.691+0000 7ff9f7400640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa00145850 0x7ffa00147840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:36.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.691+0000 7ff9f7400640 1 -- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa00166210 msgr2=0x7ffa0015c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:36.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.691+0000 7ff9f7400640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa00166210 0x7ffa0015c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:36.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.691+0000 7ff9f7400640 1 -- 172.21.15.44:0/2143819102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa000b0e50 con 0x7ffa00148bb0 2024-03-30T13:12:36.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.691+0000 7ff9ffe00640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa00145850 0x7ffa00147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:36.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.691+0000 7ffa04a00640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa00166210 0x7ffa0015c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:36.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.692+0000 7ff9f7400640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00148bb0 0x7ffa0015bd50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff9e802bec0 tx=0x7ff9e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:36.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.692+0000 7ff9fcc00640 1 -- 172.21.15.44:0/2143819102 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8041070 con 0x7ffa00148bb0 2024-03-30T13:12:36.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.692+0000 7ff9fcc00640 1 -- 172.21.15.44:0/2143819102 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e803ae20 con 0x7ffa00148bb0 2024-03-30T13:12:36.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.692+0000 7ffa05400640 1 -- 172.21.15.44:0/2143819102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa000b1130 con 0x7ffa00148bb0 2024-03-30T13:12:36.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.692+0000 7ff9fcc00640 1 -- 172.21.15.44:0/2143819102 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8035040 con 0x7ffa00148bb0 2024-03-30T13:12:36.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.692+0000 7ffa05400640 1 -- 172.21.15.44:0/2143819102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa000b16f0 con 0x7ffa00148bb0 2024-03-30T13:12:36.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.693+0000 7ffa05400640 1 -- 172.21.15.44:0/2143819102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa00075890 con 0x7ffa00148bb0 2024-03-30T13:12:36.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.694+0000 7ff9fcc00640 1 -- 172.21.15.44:0/2143819102 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff9e804c060 con 0x7ffa00148bb0 2024-03-30T13:12:36.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.695+0000 7ff9fcc00640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff9dc06c530 0x7ff9dc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:36.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.695+0000 7ff9fcc00640 1 -- 172.21.15.44:0/2143819102 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7ff9e80ad7d0 con 0x7ffa00148bb0 2024-03-30T13:12:36.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.696+0000 7ff9ffe00640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff9dc06c530 0x7ff9dc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:36.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.697+0000 7ff9ffe00640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff9dc06c530 0x7ff9dc06e9f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0006fd0 tx=0x7ff9f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:36.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.700+0000 7ff9fcc00640 1 -- 172.21.15.44:0/2143819102 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff9e807b930 con 0x7ffa00148bb0 2024-03-30T13:12:36.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.946+0000 7ffa05400640 1 -- 172.21.15.44:0/2143819102 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffa000b40f0 con 0x7ffa00148bb0 2024-03-30T13:12:36.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.946+0000 7ff9fcc00640 1 -- 172.21.15.44:0/2143819102 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7ff9e807b230 con 0x7ffa00148bb0 2024-03-30T13:12:36.951 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-30T13:12:36.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.949+0000 7ffa05400640 1 -- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff9dc06c530 msgr2=0x7ff9dc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:36.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.949+0000 7ffa05400640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff9dc06c530 0x7ff9dc06e9f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0006fd0 tx=0x7ff9f0008040 comp rx=0 tx=0).stop 2024-03-30T13:12:36.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.949+0000 7ffa05400640 1 -- 172.21.15.44:0/2143819102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00148bb0 msgr2=0x7ffa0015bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:36.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.949+0000 7ffa05400640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00148bb0 0x7ffa0015bd50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff9e802bec0 tx=0x7ff9e80046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:36.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.949+0000 7ffa05400640 1 -- 172.21.15.44:0/2143819102 shutdown_connections 2024-03-30T13:12:36.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.949+0000 7ffa05400640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff9dc06c530 0x7ff9dc06e9f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:36.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.949+0000 7ffa05400640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa00166210 0x7ffa0015c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:36.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.949+0000 7ffa05400640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ffa00148bb0 0x7ffa0015bd50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:36.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.949+0000 7ffa05400640 1 --2- 172.21.15.44:0/2143819102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa00145850 0x7ffa00147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:36.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.949+0000 7ffa05400640 1 -- 172.21.15.44:0/2143819102 >> 172.21.15.44:0/2143819102 conn(0x7ffa0006b970 msgr2=0x7ffa0006e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:36.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.949+0000 7ffa05400640 1 -- 172.21.15.44:0/2143819102 shutdown_connections 2024-03-30T13:12:36.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:36.949+0000 7ffa05400640 1 -- 172.21.15.44:0/2143819102 wait complete. 2024-03-30T13:12:36.974 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-30T13:12:36.974 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:12:36.974 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2024-03-30T13:12:36.974 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-30T13:12:36.974 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-30T13:12:36.974 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-30T13:12:36.974 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-30T13:12:36.975 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:12:36.975 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-30T13:12:36.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:36.975 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2024-03-30T13:12:37.029 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:12:37.029 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:12:37.029 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:12:37.029 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:37.030 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42557sec preferred_lft 42557sec 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 26:60:c6:bc:70:ef brd ff:ff:ff:ff:ff:ff 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::7437:83ff:feb4:94a/64 scope link 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 26:60:c6:bc:70:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::2460:c6ff:febc:70ef/64 scope link 2024-03-30T13:12:37.031 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:37.032 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:12:37.113 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-03-30T13:12:37.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:37.117 DEBUG:teuthology.orchestra.run.smithi151:> route 2024-03-30T13:12:37.165 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2024-03-30T13:12:37.165 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:12:37.165 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:12:37.165 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:12:37.166 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:12:37.167 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:37.167 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-03-30T13:12:37.167 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:12:37.167 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:12:37.167 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:12:37.167 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-03-30T13:12:37.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:37.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:37.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:37.402 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2024-03-30T13:12:37.448 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-30T13:12:37.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:37.449 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2024-03-30T13:12:37.541 INFO:teuthology.orchestra.run.smithi151.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-30T13:12:37.541 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:37.541 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-03-30T13:12:37.541 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:12:37.541 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-30T13:12:37.541 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-03-30T13:12:37.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:37.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:37.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:37.732 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-30T13:12:37.815 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:12:37.815 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:12:37.815 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:12:37.815 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.815 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2024-03-30T13:12:37.815 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.815 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:12:37.816 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 5e:c3:73:dd:cc:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T13:12:37.816 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T13:12:37.816 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.816 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::5cc3:73ff:fedd:cc07/64 scope link 2024-03-30T13:12:37.816 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:37.819 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-30T13:12:37.910 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:12:37.910 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:12:37.910 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:12:37.910 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.910 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2024-03-30T13:12:37.911 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.911 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:12:37.911 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 5e:c3:73:dd:cc:07 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-30T13:12:37.911 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-30T13:12:37.911 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.911 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::5cc3:73ff:fedd:cc07/64 scope link 2024-03-30T13:12:37.911 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:12:37.915 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-30T13:12:37.915 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:37.915 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-03-30T13:12:37.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-30T13:12:37.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-30T13:12:37.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-30T13:12:37.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-30T13:12:37.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-30T13:12:37.915 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-03-30T13:12:38.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:38.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:38.236 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:12:38.236 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-03-30T13:12:38.236 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.1 up 2024-03-30T13:12:38.236 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.1 master ceph-brx 2024-03-30T13:12:38.236 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-03-30T13:12:38.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:38.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:38.455 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:12:38.455 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-30T13:12:38.498 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-30T13:12:38.498 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:12:38.498 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-30T13:12:38.589 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T13:12:38.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:38.589 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-30T13:12:38.712 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-30T13:12:38.712 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-30T13:12:38.712 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2024-03-30T13:12:38.734 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-30T13:12:38.734 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-30T13:12:38.734 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2024-03-30T13:12:38.734 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.151:3300,172.21.15.151:3301" 2024-03-30T13:12:38.734 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:12:38.759 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-30T13:12:38.759 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-30T13:12:38.759 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2024-03-30T13:12:38.760 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.151:3300,172.21.15.151:3301" 2024-03-30T13:12:38.760 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:12:38.760 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.151:6789,172.21.15.151:6790" 2024-03-30T13:12:38.760 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2024-03-30T13:12:38.760 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=cf82a1f9-ad5a-4657-adf6-b77304ed0e9d" will pass to kernel 2024-03-30T13:12:38.762 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-30T13:12:38.762 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2024-03-30T13:12:38.762 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T13:12:38.763 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T13:12:38.763 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T13:12:38.766 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T13:12:38.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:38.766 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-30T13:12:38.843 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:38.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:38.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:38.987 INFO:teuthology.orchestra.run.smithi151.stdout:client4744 2024-03-30T13:12:38.987 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:12:38.987 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:39.035 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:39.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:39.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:39.189 INFO:teuthology.orchestra.run.smithi151.stdout:client4744 2024-03-30T13:12:39.190 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:12:39.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:12:39.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:39.297 INFO:teuthology.orchestra.run.smithi151.stdout:client4744 2024-03-30T13:12:39.298 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/cf82a1f9-ad5a-4657-adf6-b77304ed0e9d.client4744/status') 2024-03-30T13:12:39.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:12:39.436 INFO:teuthology.orchestra.run.smithi151.stdout:instance: client.4744 (3)192.168.0.2:0/463159612 2024-03-30T13:12:39.436 INFO:teuthology.orchestra.run.smithi151.stdout:blocklisted: false 2024-03-30T13:12:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records in 2024-03-30T13:12:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records out 2024-03-30T13:12:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:68 bytes copied, 7.2817e-05 s, 934 kB/s 2024-03-30T13:12:39.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:12:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:12:39.448 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-30T13:12:39.465 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:39.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.691+0000 7fc44e800640 1 Processor -- start 2024-03-30T13:12:39.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.691+0000 7fc44e800640 1 -- start start 2024-03-30T13:12:39.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.692+0000 7fc44e800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc4480b3250 0x7fc44806d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:39.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.692+0000 7fc44e800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4480d0ed0 con 0x7fc44815e4f0 2024-03-30T13:12:39.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.692+0000 7fc44e800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4480d11b0 con 0x7fc44815e8d0 2024-03-30T13:12:39.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.692+0000 7fc44e800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc4480cc650 con 0x7fc4480b3250 2024-03-30T13:12:39.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.692+0000 7fc44d400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc44815e4f0 0x7fc44806c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40206/0 (socket says 172.21.15.44:40206) 2024-03-30T13:12:39.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.692+0000 7fc44d400640 1 -- 172.21.15.44:0/396614961 learned_addr learned my addr 172.21.15.44:0/396614961 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:39.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.692+0000 7fc44ca00640 1 --2- 172.21.15.44:0/396614961 >> v2:172.21.15.44:3300/0 conn(0x7fc4480b3250 0x7fc44806d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:39.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.693+0000 7fc447e00640 1 -- 172.21.15.44:0/396614961 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3503005562 0 0) 0x7fc4480d0ed0 con 0x7fc44815e4f0 2024-03-30T13:12:39.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.693+0000 7fc447e00640 1 -- 172.21.15.44:0/396614961 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc42c003520 con 0x7fc44815e4f0 2024-03-30T13:12:39.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.693+0000 7fc44ca00640 1 -- 172.21.15.44:0/396614961 >> v1:172.21.15.151:6789/0 conn(0x7fc44815e8d0 legacy=0x7fc4480ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:39.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.693+0000 7fc44ca00640 1 -- 172.21.15.44:0/396614961 >> v1:172.21.15.44:6789/0 conn(0x7fc44815e4f0 legacy=0x7fc44806c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:39.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.693+0000 7fc44ca00640 1 -- 172.21.15.44:0/396614961 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4480d1490 con 0x7fc4480b3250 2024-03-30T13:12:39.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.694+0000 7fc44ca00640 1 --2- 172.21.15.44:0/396614961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4480b3250 0x7fc44806d040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc4340097a0 tx=0x7fc43402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb89eef4cb2a45f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:39.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.694+0000 7fc447e00640 1 -- 172.21.15.44:0/396614961 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434034070 con 0x7fc4480b3250 2024-03-30T13:12:39.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.695+0000 7fc447e00640 1 -- 172.21.15.44:0/396614961 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc434030610 con 0x7fc4480b3250 2024-03-30T13:12:39.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.695+0000 7fc447e00640 1 -- 172.21.15.44:0/396614961 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4340309e0 con 0x7fc4480b3250 2024-03-30T13:12:39.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.695+0000 7fc44e800640 1 -- 172.21.15.44:0/396614961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4480b3250 msgr2=0x7fc44806d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:39.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.695+0000 7fc44e800640 1 --2- 172.21.15.44:0/396614961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4480b3250 0x7fc44806d040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc4340097a0 tx=0x7fc43402b960 comp rx=0 tx=0).stop 2024-03-30T13:12:39.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.695+0000 7fc44e800640 1 -- 172.21.15.44:0/396614961 shutdown_connections 2024-03-30T13:12:39.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.695+0000 7fc44e800640 1 --2- 172.21.15.44:0/396614961 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4480b3250 0x7fc44806d040 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:39.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.695+0000 7fc44e800640 1 -- 172.21.15.44:0/396614961 >> 172.21.15.44:0/396614961 conn(0x7fc4480b3af0 msgr2=0x7fc4480b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:39.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.695+0000 7fc44e800640 1 -- 172.21.15.44:0/396614961 shutdown_connections 2024-03-30T13:12:39.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.695+0000 7fc44e800640 1 -- 172.21.15.44:0/396614961 wait complete. 2024-03-30T13:12:39.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.697+0000 7fc44e800640 1 Processor -- start 2024-03-30T13:12:39.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.697+0000 7fc44e800640 1 -- start start 2024-03-30T13:12:39.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.698+0000 7fc44e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4480b3250 0x7fc4480cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.698+0000 7fc44e800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc44815e4f0 0x7fc4480c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.698+0000 7fc44e800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc44815e8d0 0x7fc4480c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.698+0000 7fc44e800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc44806d580 con 0x7fc4480b3250 2024-03-30T13:12:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.698+0000 7fc44e800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc44809ba40 con 0x7fc44815e8d0 2024-03-30T13:12:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.698+0000 7fc44e800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc44806d700 con 0x7fc44815e4f0 2024-03-30T13:12:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.699+0000 7fc44d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4480b3250 0x7fc4480cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.699+0000 7fc44d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4480b3250 0x7fc4480cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40510/0 (socket says 172.21.15.44:40510) 2024-03-30T13:12:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.699+0000 7fc44d400640 1 -- 172.21.15.44:0/3373495703 learned_addr learned my addr 172.21.15.44:0/3373495703 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.699+0000 7fc44ca00640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc44815e4f0 0x7fc4480c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.699+0000 7fc44de00640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc44815e8d0 0x7fc4480c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:39.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.699+0000 7fc44d400640 1 -- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc44815e4f0 msgr2=0x7fc4480c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.699+0000 7fc44d400640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc44815e4f0 0x7fc4480c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.699+0000 7fc44d400640 1 -- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc44815e8d0 msgr2=0x7fc4480c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.699+0000 7fc44d400640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc44815e8d0 0x7fc4480c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:39.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.699+0000 7fc44d400640 1 -- 172.21.15.44:0/3373495703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44815cd40 con 0x7fc4480b3250 2024-03-30T13:12:39.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.699+0000 7fc44d400640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4480b3250 0x7fc4480cb360 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc43800c500 tx=0x7fc43800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:39.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.700+0000 7fc445600640 1 -- 172.21.15.44:0/3373495703 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438017070 con 0x7fc4480b3250 2024-03-30T13:12:39.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.700+0000 7fc445600640 1 -- 172.21.15.44:0/3373495703 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc438005ce0 con 0x7fc4480b3250 2024-03-30T13:12:39.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.700+0000 7fc445600640 1 -- 172.21.15.44:0/3373495703 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438007330 con 0x7fc4480b3250 2024-03-30T13:12:39.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.700+0000 7fc44e800640 1 -- 172.21.15.44:0/3373495703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4481f4600 con 0x7fc4480b3250 2024-03-30T13:12:39.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.700+0000 7fc44e800640 1 -- 172.21.15.44:0/3373495703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4481f4bc0 con 0x7fc4480b3250 2024-03-30T13:12:39.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.701+0000 7fc44e800640 1 -- 172.21.15.44:0/3373495703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44806ddb0 con 0x7fc4480b3250 2024-03-30T13:12:39.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.702+0000 7fc445600640 1 -- 172.21.15.44:0/3373495703 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc43801a070 con 0x7fc4480b3250 2024-03-30T13:12:39.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.703+0000 7fc445600640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc42806c560 0x7fc42806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:39.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.703+0000 7fc445600640 1 -- 172.21.15.44:0/3373495703 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fc43808af80 con 0x7fc4480b3250 2024-03-30T13:12:39.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.703+0000 7fc44ca00640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc42806c560 0x7fc42806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:39.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.705+0000 7fc44ca00640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc42806c560 0x7fc42806ea20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc434036000 tx=0x7fc43403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:39.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.707+0000 7fc445600640 1 -- 172.21.15.44:0/3373495703 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc438059230 con 0x7fc4480b3250 2024-03-30T13:12:39.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.913+0000 7fc44e800640 1 -- 172.21.15.44:0/3373495703 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4481f4e00 con 0x7fc4480b3250 2024-03-30T13:12:39.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.915+0000 7fc445600640 1 -- 172.21.15.44:0/3373495703 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18927 (secure 0 0 0) 0x7fc438058b30 con 0x7fc4480b3250 2024-03-30T13:12:39.919 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:39.920 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":29,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:12:27.323786+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:39.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.919+0000 7fc44e800640 1 -- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc42806c560 msgr2=0x7fc42806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:39.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.919+0000 7fc44e800640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc42806c560 0x7fc42806ea20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc434036000 tx=0x7fc43403b040 comp rx=0 tx=0).stop 2024-03-30T13:12:39.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.919+0000 7fc44e800640 1 -- 172.21.15.44:0/3373495703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4480b3250 msgr2=0x7fc4480cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:39.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.919+0000 7fc44e800640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4480b3250 0x7fc4480cb360 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc43800c500 tx=0x7fc43800c9c0 comp rx=0 tx=0).stop 2024-03-30T13:12:39.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.919+0000 7fc44e800640 1 -- 172.21.15.44:0/3373495703 shutdown_connections 2024-03-30T13:12:39.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.919+0000 7fc44e800640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc42806c560 0x7fc42806ea20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:39.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.919+0000 7fc44e800640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc44815e8d0 0x7fc4480c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:39.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.919+0000 7fc44e800640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc44815e4f0 0x7fc4480c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:39.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.919+0000 7fc44e800640 1 --2- 172.21.15.44:0/3373495703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc4480b3250 0x7fc4480cb360 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:39.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.919+0000 7fc44e800640 1 -- 172.21.15.44:0/3373495703 >> 172.21.15.44:0/3373495703 conn(0x7fc4480b3af0 msgr2=0x7fc4480700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:39.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.920+0000 7fc44e800640 1 -- 172.21.15.44:0/3373495703 shutdown_connections 2024-03-30T13:12:39.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:39.920+0000 7fc44e800640 1 -- 172.21.15.44:0/3373495703 wait complete. 2024-03-30T13:12:39.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:12:39.943 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:12:40.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.160+0000 7f1bcf200640 1 Processor -- start 2024-03-30T13:12:40.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.161+0000 7f1bcf200640 1 -- start start 2024-03-30T13:12:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.162+0000 7f1bcf200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1bd00af0e0 0x7f1bd0072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.162+0000 7f1bcf200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd00ad2e0 con 0x7f1bd00acd60 2024-03-30T13:12:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.162+0000 7f1bcf200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd00716a0 con 0x7f1bd006e980 2024-03-30T13:12:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.162+0000 7f1bcf200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd00ad5c0 con 0x7f1bd00af0e0 2024-03-30T13:12:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.163+0000 7f1bc7e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1bd00acd60 0x7f1bd00ae9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40218/0 (socket says 172.21.15.44:40218) 2024-03-30T13:12:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.163+0000 7f1bc7e00640 1 -- 172.21.15.44:0/1111454175 learned_addr learned my addr 172.21.15.44:0/1111454175 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.163+0000 7f1bce800640 1 --2- 172.21.15.44:0/1111454175 >> v2:172.21.15.151:3300/0 conn(0x7f1bd00af0e0 0x7f1bd0072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.163+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 932194049 0 0) 0x7f1bd00ad2e0 con 0x7f1bd00acd60 2024-03-30T13:12:40.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.163+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bb4003520 con 0x7f1bd00acd60 2024-03-30T13:12:40.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3197591682 0 0) 0x7f1bb4003520 con 0x7f1bd00acd60 2024-03-30T13:12:40.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 >> v2:172.21.15.151:3300/0 conn(0x7f1bd00af0e0 msgr2=0x7f1bd0072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 --2- 172.21.15.44:0/1111454175 >> v2:172.21.15.151:3300/0 conn(0x7f1bd00af0e0 0x7f1bd0072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 >> v1:172.21.15.151:6789/0 conn(0x7f1bd006e980 legacy=0x7f1bd015d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd0071980 con 0x7f1bd00acd60 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f1bb8001670 con 0x7f1bd00acd60 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 >> v1:172.21.15.44:6789/0 conn(0x7f1bd00acd60 legacy=0x7f1bd00ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 --2- 172.21.15.44:0/1111454175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4003a00 0x7f1bb4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 --2- 172.21.15.44:0/1111454175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb4004800 0x7f1bb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 --2- 172.21.15.44:0/1111454175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb4005210 0x7f1bb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb400c130 con 0x7f1bb4005210 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb400c2e0 con 0x7f1bb4003a00 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb400c4e0 con 0x7f1bb4004800 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.164+0000 7f1bce800640 1 --2- 172.21.15.44:0/1111454175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb4005210 0x7f1bb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.165+0000 7f1bc7e00640 1 --2- 172.21.15.44:0/1111454175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb4004800 0x7f1bb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.165+0000 7f1bcde00640 1 --2- 172.21.15.44:0/1111454175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4003a00 0x7f1bb4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.165+0000 7f1bce800640 1 -- 172.21.15.44:0/1111454175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb4004800 msgr2=0x7f1bb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.165+0000 7f1bce800640 1 --2- 172.21.15.44:0/1111454175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb4004800 0x7f1bb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.165+0000 7f1bce800640 1 -- 172.21.15.44:0/1111454175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4003a00 msgr2=0x7f1bb4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.165+0000 7f1bce800640 1 --2- 172.21.15.44:0/1111454175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4003a00 0x7f1bb4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.165+0000 7f1bce800640 1 -- 172.21.15.44:0/1111454175 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb4003520 con 0x7f1bb4005210 2024-03-30T13:12:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.165+0000 7f1bcde00640 1 --2- 172.21.15.44:0/1111454175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb4003a00 0x7f1bb4003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.166+0000 7f1bce800640 1 -- 172.21.15.44:0/1111454175 reap_dead start 2024-03-30T13:12:40.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.166+0000 7f1bce800640 1 --2- 172.21.15.44:0/1111454175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb4005210 0x7f1bb400b9c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009f90 tx=0x7f1bb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df54dc4cfb602fb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.166+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8009c10 con 0x7f1bb4005210 2024-03-30T13:12:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.166+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc802cbf0 con 0x7f1bb4005210 2024-03-30T13:12:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.166+0000 7f1bcd400640 1 -- 172.21.15.44:0/1111454175 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8003990 con 0x7f1bb4005210 2024-03-30T13:12:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.167+0000 7f1bcf200640 1 -- 172.21.15.44:0/1111454175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb4005210 msgr2=0x7f1bb400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.167+0000 7f1bcf200640 1 --2- 172.21.15.44:0/1111454175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb4005210 0x7f1bb400b9c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009f90 tx=0x7f1bb4005830 comp rx=0 tx=0).stop 2024-03-30T13:12:40.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.167+0000 7f1bcf200640 1 -- 172.21.15.44:0/1111454175 shutdown_connections 2024-03-30T13:12:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.167+0000 7f1bcf200640 1 --2- 172.21.15.44:0/1111454175 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb4005210 0x7f1bb400b9c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.167+0000 7f1bcf200640 1 -- 172.21.15.44:0/1111454175 >> 172.21.15.44:0/1111454175 conn(0x7f1bd00cfd90 msgr2=0x7f1bd00d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.167+0000 7f1bcf200640 1 -- 172.21.15.44:0/1111454175 shutdown_connections 2024-03-30T13:12:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.168+0000 7f1bcf200640 1 -- 172.21.15.44:0/1111454175 wait complete. 2024-03-30T13:12:40.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.170+0000 7f1bcf200640 1 Processor -- start 2024-03-30T13:12:40.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.170+0000 7f1bcf200640 1 -- start start 2024-03-30T13:12:40.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.171+0000 7f1bcf200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb4005210 0x7f1bd01519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.171+0000 7f1bcf200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bd0158a40 0x7f1bd00cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bcf200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd015b260 0x7f1bd015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bcf200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd0072180 con 0x7f1bd015b260 2024-03-30T13:12:40.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bcf200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd0071450 con 0x7f1bd0158a40 2024-03-30T13:12:40.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bcf200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd0072300 con 0x7f1bb4005210 2024-03-30T13:12:40.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bce800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd015b260 0x7f1bd015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bce800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd015b260 0x7f1bd015b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40528/0 (socket says 172.21.15.44:40528) 2024-03-30T13:12:40.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bce800640 1 -- 172.21.15.44:0/393033875 learned_addr learned my addr 172.21.15.44:0/393033875 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:40.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bcde00640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb4005210 0x7f1bd01519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bc7e00640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bd0158a40 0x7f1bd00cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bce800640 1 -- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb4005210 msgr2=0x7f1bd01519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bce800640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb4005210 0x7f1bd01519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bce800640 1 -- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bd0158a40 msgr2=0x7f1bd00cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bce800640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bd0158a40 0x7f1bd00cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bce800640 1 -- 172.21.15.44:0/393033875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd00ccf00 con 0x7f1bd015b260 2024-03-30T13:12:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.172+0000 7f1bc7e00640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bd0158a40 0x7f1bd00cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.173+0000 7f1bce800640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd015b260 0x7f1bd015b6e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1bc802c660 tx=0x7f1bc8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.173+0000 7f1bc6000640 1 -- 172.21.15.44:0/393033875 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8009c10 con 0x7f1bd015b260 2024-03-30T13:12:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.173+0000 7f1bc6000640 1 -- 172.21.15.44:0/393033875 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc8045070 con 0x7f1bd015b260 2024-03-30T13:12:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.173+0000 7f1bcf200640 1 -- 172.21.15.44:0/393033875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd00cb690 con 0x7f1bd015b260 2024-03-30T13:12:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.173+0000 7f1bc6000640 1 -- 172.21.15.44:0/393033875 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc803e870 con 0x7f1bd015b260 2024-03-30T13:12:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.173+0000 7f1bcf200640 1 -- 172.21.15.44:0/393033875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd01f77e0 con 0x7f1bd015b260 2024-03-30T13:12:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.175+0000 7f1bcf200640 1 -- 172.21.15.44:0/393033875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd0075890 con 0x7f1bd015b260 2024-03-30T13:12:40.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.175+0000 7f1bc6000640 1 -- 172.21.15.44:0/393033875 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1bc8005d10 con 0x7f1bd015b260 2024-03-30T13:12:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.176+0000 7f1bc6000640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1bac06c530 0x7f1bac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.176+0000 7f1bc6000640 1 -- 172.21.15.44:0/393033875 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f1bc80ae370 con 0x7f1bd015b260 2024-03-30T13:12:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.177+0000 7f1bcde00640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1bac06c530 0x7f1bac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.178+0000 7f1bcde00640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1bac06c530 0x7f1bac06e9f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0000f60 tx=0x7f1bc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.183+0000 7f1bc6000640 1 -- 172.21.15.44:0/393033875 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1bd00ccf00 con 0x7f1bd015b260 2024-03-30T13:12:40.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.389+0000 7f1bcf200640 1 -- 172.21.15.44:0/393033875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1bd00cc580 con 0x7f1bd015b260 2024-03-30T13:12:40.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.390+0000 7f1bc6000640 1 -- 172.21.15.44:0/393033875 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f1bc807c610 con 0x7f1bd015b260 2024-03-30T13:12:40.394 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:12:40.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.393+0000 7f1bcf200640 1 -- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1bac06c530 msgr2=0x7f1bac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.393+0000 7f1bcf200640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1bac06c530 0x7f1bac06e9f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0000f60 tx=0x7f1bc0009040 comp rx=0 tx=0).stop 2024-03-30T13:12:40.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.393+0000 7f1bcf200640 1 -- 172.21.15.44:0/393033875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd015b260 msgr2=0x7f1bd015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.393+0000 7f1bcf200640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd015b260 0x7f1bd015b6e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1bc802c660 tx=0x7f1bc8009750 comp rx=0 tx=0).stop 2024-03-30T13:12:40.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.393+0000 7f1bcf200640 1 -- 172.21.15.44:0/393033875 shutdown_connections 2024-03-30T13:12:40.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.393+0000 7f1bcf200640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bd015b260 0x7f1bd015b6e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.393+0000 7f1bcf200640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1bac06c530 0x7f1bac06e9f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.393+0000 7f1bcf200640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bd0158a40 0x7f1bd00cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.393+0000 7f1bcf200640 1 --2- 172.21.15.44:0/393033875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb4005210 0x7f1bd01519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.393+0000 7f1bcf200640 1 -- 172.21.15.44:0/393033875 >> 172.21.15.44:0/393033875 conn(0x7f1bd00cfd90 msgr2=0x7f1bd015ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.393+0000 7f1bcf200640 1 -- 172.21.15.44:0/393033875 shutdown_connections 2024-03-30T13:12:40.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.393+0000 7f1bcf200640 1 -- 172.21.15.44:0/393033875 wait complete. 2024-03-30T13:12:40.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:12:40.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.637+0000 7ff703e00640 1 Processor -- start 2024-03-30T13:12:40.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.638+0000 7ff703e00640 1 -- start start 2024-03-30T13:12:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.639+0000 7ff703e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7040b4d00 0x7ff7040d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.639+0000 7ff703e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff7040d0b90 0x7ff7040d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.639+0000 7ff703e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7040b54b0 con 0x7ff7040b4920 2024-03-30T13:12:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.639+0000 7ff703e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff7040d0260 con 0x7ff7040d0b90 2024-03-30T13:12:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.639+0000 7ff703e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff7040cfca0 con 0x7ff7040b4d00 2024-03-30T13:12:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.640+0000 7ff703400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff7040d0b90 0x7ff7040d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.640+0000 7ff703400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff7040d0b90 0x7ff7040d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40544/0 (socket says 172.21.15.44:40544) 2024-03-30T13:12:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.640+0000 7ff703400640 1 -- 172.21.15.44:0/1695634020 learned_addr learned my addr 172.21.15.44:0/1695634020 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.640+0000 7ff702000640 1 --2- 172.21.15.44:0/1695634020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7040b4d00 0x7ff7040d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.640+0000 7ff703400640 1 -- 172.21.15.44:0/1695634020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7040b4d00 msgr2=0x7ff7040d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.640+0000 7ff703400640 1 --2- 172.21.15.44:0/1695634020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7040b4d00 0x7ff7040d4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.640+0000 7ff703400640 1 -- 172.21.15.44:0/1695634020 >> v1:172.21.15.151:6789/0 conn(0x7ff7040b4920 legacy=0x7ff7040b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.640+0000 7ff703400640 1 -- 172.21.15.44:0/1695634020 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7040cff80 con 0x7ff7040d0b90 2024-03-30T13:12:40.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.641+0000 7ff703400640 1 --2- 172.21.15.44:0/1695634020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7040d0b90 0x7ff7040d1040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009e50 tx=0x7ff6fc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e486759cdd10d148 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.642+0000 7ff701600640 1 -- 172.21.15.44:0/1695634020 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc02ca70 con 0x7ff7040d0b90 2024-03-30T13:12:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.642+0000 7ff701600640 1 -- 172.21.15.44:0/1695634020 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc02cc10 con 0x7ff7040d0b90 2024-03-30T13:12:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.642+0000 7ff701600640 1 -- 172.21.15.44:0/1695634020 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc0343f0 con 0x7ff7040d0b90 2024-03-30T13:12:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.642+0000 7ff703e00640 1 -- 172.21.15.44:0/1695634020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7040d0b90 msgr2=0x7ff7040d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.643+0000 7ff703e00640 1 --2- 172.21.15.44:0/1695634020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7040d0b90 0x7ff7040d1040 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc009e50 tx=0x7ff6fc02bed0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.643+0000 7ff703e00640 1 -- 172.21.15.44:0/1695634020 shutdown_connections 2024-03-30T13:12:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.643+0000 7ff703e00640 1 --2- 172.21.15.44:0/1695634020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7040d0b90 0x7ff7040d1040 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.643+0000 7ff703e00640 1 --2- 172.21.15.44:0/1695634020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7040b4d00 0x7ff7040d4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.643+0000 7ff703e00640 1 -- 172.21.15.44:0/1695634020 >> 172.21.15.44:0/1695634020 conn(0x7ff70409d4e0 msgr2=0x7ff7040d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.643+0000 7ff703e00640 1 -- 172.21.15.44:0/1695634020 shutdown_connections 2024-03-30T13:12:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.643+0000 7ff703e00640 1 -- 172.21.15.44:0/1695634020 wait complete. 2024-03-30T13:12:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.645+0000 7ff703e00640 1 Processor -- start 2024-03-30T13:12:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.645+0000 7ff703e00640 1 -- start start 2024-03-30T13:12:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.646+0000 7ff703e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7040b4920 0x7ff7041568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.646+0000 7ff703e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7040b4d00 0x7ff704157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.646+0000 7ff703e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7040d0b90 0x7ff7040cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.646+0000 7ff703e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff7040d5000 con 0x7ff7040d0b90 2024-03-30T13:12:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.646+0000 7ff703e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff7040d2180 con 0x7ff7040b4920 2024-03-30T13:12:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.646+0000 7ff703e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff7040cf8c0 con 0x7ff7040b4d00 2024-03-30T13:12:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.646+0000 7ff703400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7040d0b90 0x7ff7040cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.646+0000 7ff703400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7040d0b90 0x7ff7040cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40558/0 (socket says 172.21.15.44:40558) 2024-03-30T13:12:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.646+0000 7ff703400640 1 -- 172.21.15.44:0/1444997902 learned_addr learned my addr 172.21.15.44:0/1444997902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.646+0000 7ff702a00640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7040b4920 0x7ff7041568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.647+0000 7ff702000640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7040b4d00 0x7ff704157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.647+0000 7ff703400640 1 -- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7040b4d00 msgr2=0x7ff704157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.647+0000 7ff703400640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7040b4d00 0x7ff704157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.647+0000 7ff703400640 1 -- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7040b4920 msgr2=0x7ff7041568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.647+0000 7ff703400640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7040b4920 0x7ff7041568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.647+0000 7ff703400640 1 -- 172.21.15.44:0/1444997902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7040b9820 con 0x7ff7040d0b90 2024-03-30T13:12:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.647+0000 7ff702000640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7040b4d00 0x7ff704157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:40.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.647+0000 7ff703400640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7040d0b90 0x7ff7040cbd30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc036040 tx=0x7ff6fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.647+0000 7ff6faa00640 1 -- 172.21.15.44:0/1444997902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc044020 con 0x7ff7040d0b90 2024-03-30T13:12:40.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.647+0000 7ff6faa00640 1 -- 172.21.15.44:0/1444997902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc040670 con 0x7ff7040d0b90 2024-03-30T13:12:40.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.647+0000 7ff703e00640 1 -- 172.21.15.44:0/1444997902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7040b6eb0 con 0x7ff7040d0b90 2024-03-30T13:12:40.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.648+0000 7ff6faa00640 1 -- 172.21.15.44:0/1444997902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc009510 con 0x7ff7040d0b90 2024-03-30T13:12:40.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.648+0000 7ff703e00640 1 -- 172.21.15.44:0/1444997902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7040b7150 con 0x7ff7040d0b90 2024-03-30T13:12:40.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.649+0000 7ff703e00640 1 -- 172.21.15.44:0/1444997902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff704075890 con 0x7ff7040d0b90 2024-03-30T13:12:40.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.650+0000 7ff6faa00640 1 -- 172.21.15.44:0/1444997902 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff6fc047020 con 0x7ff7040d0b90 2024-03-30T13:12:40.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.651+0000 7ff6faa00640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff6e406c530 0x7ff6e406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:40.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.651+0000 7ff6faa00640 1 -- 172.21.15.44:0/1444997902 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7ff6fc0ae610 con 0x7ff7040d0b90 2024-03-30T13:12:40.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.651+0000 7ff702a00640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff6e406c530 0x7ff6e406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:40.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.653+0000 7ff702a00640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff6e406c530 0x7ff6e406e9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4007fd0 tx=0x7ff6f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:40.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.655+0000 7ff6faa00640 1 -- 172.21.15.44:0/1444997902 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff6fc04e030 con 0x7ff7040d0b90 2024-03-30T13:12:40.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.857+0000 7ff703e00640 1 -- 172.21.15.44:0/1444997902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff7040d1420 con 0x7ff7040d0b90 2024-03-30T13:12:40.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.857+0000 7ff6faa00640 1 -- 172.21.15.44:0/1444997902 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7ff6fc07c800 con 0x7ff7040d0b90 2024-03-30T13:12:40.861 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.860+0000 7ff703e00640 1 -- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff6e406c530 msgr2=0x7ff6e406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.860+0000 7ff703e00640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff6e406c530 0x7ff6e406e9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4007fd0 tx=0x7ff6f4009040 comp rx=0 tx=0).stop 2024-03-30T13:12:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.860+0000 7ff703e00640 1 -- 172.21.15.44:0/1444997902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7040d0b90 msgr2=0x7ff7040cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.860+0000 7ff703e00640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7040d0b90 0x7ff7040cbd30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc036040 tx=0x7ff6fc004a40 comp rx=0 tx=0).stop 2024-03-30T13:12:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.860+0000 7ff703e00640 1 -- 172.21.15.44:0/1444997902 shutdown_connections 2024-03-30T13:12:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.860+0000 7ff703e00640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff7040d0b90 0x7ff7040cbd30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.860+0000 7ff703e00640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7040b4d00 0x7ff704157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.860+0000 7ff703e00640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff6e406c530 0x7ff6e406e9f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.860+0000 7ff703e00640 1 --2- 172.21.15.44:0/1444997902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7040b4920 0x7ff7041568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.860+0000 7ff703e00640 1 -- 172.21.15.44:0/1444997902 >> 172.21.15.44:0/1444997902 conn(0x7ff70409d4e0 msgr2=0x7ff7040749e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:40.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.860+0000 7ff703e00640 1 -- 172.21.15.44:0/1444997902 shutdown_connections 2024-03-30T13:12:40.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:40.860+0000 7ff703e00640 1 -- 172.21.15.44:0/1444997902 wait complete. 2024-03-30T13:12:40.884 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:12:41.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.104+0000 7fd79ea00640 1 Processor -- start 2024-03-30T13:12:41.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.104+0000 7fd79ea00640 1 -- start start 2024-03-30T13:12:41.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.106+0000 7fd79ea00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd7981605a0 0x7fd7980cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.106+0000 7fd79ea00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7980ce9c0 con 0x7fd79806d8f0 2024-03-30T13:12:41.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.106+0000 7fd79ea00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd798160b50 con 0x7fd79813f0c0 2024-03-30T13:12:41.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.106+0000 7fd79ea00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd798160e30 con 0x7fd7981605a0 2024-03-30T13:12:41.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.106+0000 7fd78fe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd79806d8f0 0x7fd79815fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40230/0 (socket says 172.21.15.44:40230) 2024-03-30T13:12:41.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.106+0000 7fd78fe00640 1 -- 172.21.15.44:0/288343196 learned_addr learned my addr 172.21.15.44:0/288343196 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:41.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.106+0000 7fd79ca00640 1 --2- 172.21.15.44:0/288343196 >> v2:172.21.15.44:3300/0 conn(0x7fd7981605a0 0x7fd7980cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:41.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.107+0000 7fd797400640 1 -- 172.21.15.44:0/288343196 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2629394270 0 0) 0x7fd780001110 con 0x7fd79806d8f0 2024-03-30T13:12:41.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.107+0000 7fd797400640 1 -- 172.21.15.44:0/288343196 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd77c003520 con 0x7fd79806d8f0 2024-03-30T13:12:41.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.107+0000 7fd797400640 1 -- 172.21.15.44:0/288343196 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921726980 0 0) 0x7fd798160b50 con 0x7fd79813f0c0 2024-03-30T13:12:41.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.107+0000 7fd79ca00640 1 -- 172.21.15.44:0/288343196 >> v1:172.21.15.151:6789/0 conn(0x7fd79813f0c0 legacy=0x7fd79806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.107+0000 7fd79ca00640 1 -- 172.21.15.44:0/288343196 >> v1:172.21.15.44:6789/0 conn(0x7fd79806d8f0 legacy=0x7fd79815fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.107+0000 7fd79ca00640 1 -- 172.21.15.44:0/288343196 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79813fa40 con 0x7fd7981605a0 2024-03-30T13:12:41.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.108+0000 7fd79ca00640 1 --2- 172.21.15.44:0/288343196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7981605a0 0x7fd7980cfbb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd790009d90 tx=0x7fd79002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aef08cdba9a633d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:41.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.108+0000 7fd797400640 1 -- 172.21.15.44:0/288343196 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790039070 con 0x7fd7981605a0 2024-03-30T13:12:41.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.109+0000 7fd797400640 1 -- 172.21.15.44:0/288343196 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79002cbd0 con 0x7fd7981605a0 2024-03-30T13:12:41.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.109+0000 7fd797400640 1 -- 172.21.15.44:0/288343196 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790034440 con 0x7fd7981605a0 2024-03-30T13:12:41.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.109+0000 7fd79ea00640 1 -- 172.21.15.44:0/288343196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7981605a0 msgr2=0x7fd7980cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.109+0000 7fd79ea00640 1 --2- 172.21.15.44:0/288343196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7981605a0 0x7fd7980cfbb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd790009d90 tx=0x7fd79002be20 comp rx=0 tx=0).stop 2024-03-30T13:12:41.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.109+0000 7fd79ea00640 1 -- 172.21.15.44:0/288343196 shutdown_connections 2024-03-30T13:12:41.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.109+0000 7fd79ea00640 1 --2- 172.21.15.44:0/288343196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd7981605a0 0x7fd7980cfbb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.109+0000 7fd79ea00640 1 -- 172.21.15.44:0/288343196 >> 172.21.15.44:0/288343196 conn(0x7fd7980b5b00 msgr2=0x7fd79806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:41.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.109+0000 7fd79ea00640 1 -- 172.21.15.44:0/288343196 shutdown_connections 2024-03-30T13:12:41.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.109+0000 7fd79ea00640 1 -- 172.21.15.44:0/288343196 wait complete. 2024-03-30T13:12:41.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.112+0000 7fd79ea00640 1 Processor -- start 2024-03-30T13:12:41.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.112+0000 7fd79ea00640 1 -- start start 2024-03-30T13:12:41.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.113+0000 7fd79ea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79806d8f0 0x7fd7981559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.113+0000 7fd79ea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd79813f0c0 0x7fd798143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.113+0000 7fd79ea00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7981605a0 0x7fd798143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.113+0000 7fd79ea00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd79813f4a0 con 0x7fd79806d8f0 2024-03-30T13:12:41.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.113+0000 7fd79ea00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd798140000 con 0x7fd79813f0c0 2024-03-30T13:12:41.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.113+0000 7fd79ea00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd79813f620 con 0x7fd7981605a0 2024-03-30T13:12:41.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.114+0000 7fd797e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79806d8f0 0x7fd7981559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:41.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.114+0000 7fd797e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79806d8f0 0x7fd7981559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40568/0 (socket says 172.21.15.44:40568) 2024-03-30T13:12:41.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.114+0000 7fd797e00640 1 -- 172.21.15.44:0/2110318624 learned_addr learned my addr 172.21.15.44:0/2110318624 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:41.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.114+0000 7fd79ca00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7981605a0 0x7fd798143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:41.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.114+0000 7fd78fe00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd79813f0c0 0x7fd798143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:41.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.114+0000 7fd797e00640 1 -- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7981605a0 msgr2=0x7fd798143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.114+0000 7fd797e00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7981605a0 0x7fd798143ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.114+0000 7fd797e00640 1 -- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd79813f0c0 msgr2=0x7fd798143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.114+0000 7fd797e00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd79813f0c0 0x7fd798143ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.114+0000 7fd797e00640 1 -- 172.21.15.44:0/2110318624 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7981315f0 con 0x7fd79806d8f0 2024-03-30T13:12:41.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.115+0000 7fd797e00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79806d8f0 0x7fd7981559a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd78800c460 tx=0x7fd78800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:41.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.115+0000 7fd794c00640 1 -- 172.21.15.44:0/2110318624 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788005480 con 0x7fd79806d8f0 2024-03-30T13:12:41.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.115+0000 7fd794c00640 1 -- 172.21.15.44:0/2110318624 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7880035f0 con 0x7fd79806d8f0 2024-03-30T13:12:41.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.115+0000 7fd79ea00640 1 -- 172.21.15.44:0/2110318624 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7981318d0 con 0x7fd79806d8f0 2024-03-30T13:12:41.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.115+0000 7fd794c00640 1 -- 172.21.15.44:0/2110318624 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788003a00 con 0x7fd79806d8f0 2024-03-30T13:12:41.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.115+0000 7fd79ea00640 1 -- 172.21.15.44:0/2110318624 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd798131e90 con 0x7fd79806d8f0 2024-03-30T13:12:41.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.117+0000 7fd79ea00640 1 -- 172.21.15.44:0/2110318624 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd798075890 con 0x7fd79806d8f0 2024-03-30T13:12:41.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.118+0000 7fd794c00640 1 -- 172.21.15.44:0/2110318624 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd788003ba0 con 0x7fd79806d8f0 2024-03-30T13:12:41.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.119+0000 7fd794c00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd77406c700 0x7fd77406ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.120+0000 7fd794c00640 1 -- 172.21.15.44:0/2110318624 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fd78808b800 con 0x7fd79806d8f0 2024-03-30T13:12:41.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.120+0000 7fd78fe00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd77406c700 0x7fd77406ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:41.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.121+0000 7fd78fe00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd77406c700 0x7fd77406ebc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd780007fd0 tx=0x7fd780009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:41.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.125+0000 7fd794c00640 1 -- 172.21.15.44:0/2110318624 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd788059960 con 0x7fd79806d8f0 2024-03-30T13:12:41.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.335+0000 7fd79ea00640 1 -- 172.21.15.44:0/2110318624 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd79806c2c0 con 0x7fd79806d8f0 2024-03-30T13:12:41.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.336+0000 7fd794c00640 1 -- 172.21.15.44:0/2110318624 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fd788059260 con 0x7fd79806d8f0 2024-03-30T13:12:41.340 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:12:41.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.339+0000 7fd79ea00640 1 -- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd77406c700 msgr2=0x7fd77406ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.339+0000 7fd79ea00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd77406c700 0x7fd77406ebc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd780007fd0 tx=0x7fd780009040 comp rx=0 tx=0).stop 2024-03-30T13:12:41.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.339+0000 7fd79ea00640 1 -- 172.21.15.44:0/2110318624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79806d8f0 msgr2=0x7fd7981559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.339+0000 7fd79ea00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79806d8f0 0x7fd7981559a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd78800c460 tx=0x7fd78800c920 comp rx=0 tx=0).stop 2024-03-30T13:12:41.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.339+0000 7fd79ea00640 1 -- 172.21.15.44:0/2110318624 shutdown_connections 2024-03-30T13:12:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.339+0000 7fd79ea00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7981605a0 0x7fd798143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.339+0000 7fd79ea00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd77406c700 0x7fd77406ebc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.339+0000 7fd79ea00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd79813f0c0 0x7fd798143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.339+0000 7fd79ea00640 1 --2- 172.21.15.44:0/2110318624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd79806d8f0 0x7fd7981559a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.339+0000 7fd79ea00640 1 -- 172.21.15.44:0/2110318624 >> 172.21.15.44:0/2110318624 conn(0x7fd7980b5b00 msgr2=0x7fd798141530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.339+0000 7fd79ea00640 1 -- 172.21.15.44:0/2110318624 shutdown_connections 2024-03-30T13:12:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.339+0000 7fd79ea00640 1 -- 172.21.15.44:0/2110318624 wait complete. 2024-03-30T13:12:41.361 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:12:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.583+0000 7f42ab200640 1 Processor -- start 2024-03-30T13:12:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.583+0000 7f42ab200640 1 -- start start 2024-03-30T13:12:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.585+0000 7f42ab200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f42a4072250 0x7f42a4072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.585+0000 7f42ab200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a415fb00 con 0x7f42a415b1c0 2024-03-30T13:12:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.585+0000 7f42ab200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a415c4c0 con 0x7f42a415c030 2024-03-30T13:12:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.585+0000 7f42ab200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f42a40ad950 con 0x7f42a4072250 2024-03-30T13:12:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.585+0000 7f42a9e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f42a415b1c0 0x7f42a40add80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40240/0 (socket says 172.21.15.44:40240) 2024-03-30T13:12:41.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.585+0000 7f42a9e00640 1 -- 172.21.15.44:0/3909114652 learned_addr learned my addr 172.21.15.44:0/3909114652 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42aa800640 1 --2- 172.21.15.44:0/3909114652 >> v2:172.21.15.151:3300/0 conn(0x7f42a4072250 0x7f42a4072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 670348839 0 0) 0x7f42a415fb00 con 0x7f42a415b1c0 2024-03-30T13:12:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f428c003520 con 0x7f42a415b1c0 2024-03-30T13:12:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 110241654 0 0) 0x7f428c003520 con 0x7f42a415b1c0 2024-03-30T13:12:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 >> v2:172.21.15.151:3300/0 conn(0x7f42a4072250 msgr2=0x7f42a4072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 --2- 172.21.15.44:0/3909114652 >> v2:172.21.15.151:3300/0 conn(0x7f42a4072250 0x7f42a4072660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 >> v1:172.21.15.151:6789/0 conn(0x7f42a415c030 legacy=0x7f42a40ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a4072ba0 con 0x7f42a415b1c0 2024-03-30T13:12:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f4298001670 con 0x7f42a415b1c0 2024-03-30T13:12:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 >> v1:172.21.15.44:6789/0 conn(0x7f42a415b1c0 legacy=0x7f42a40add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 --2- 172.21.15.44:0/3909114652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0039b0 0x7f428c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 --2- 172.21.15.44:0/3909114652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 0x7f428c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 --2- 172.21.15.44:0/3909114652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f428c0051c0 0x7f428c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f428c00e2f0 con 0x7f428c004800 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f428c00e4a0 con 0x7f428c0051c0 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f428c00e6a0 con 0x7f428c0039b0 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42aa800640 1 --2- 172.21.15.44:0/3909114652 >> v2:172.21.15.151:3300/0 conn(0x7f42a4072250 0x7f42a4072660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.586+0000 7f42a9400640 1 --2- 172.21.15.44:0/3909114652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 0x7f428c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.587+0000 7f42a9400640 1 -- 172.21.15.44:0/3909114652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0039b0 msgr2=0x7f428c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.587+0000 7f42a9400640 1 --2- 172.21.15.44:0/3909114652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0039b0 0x7f428c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.587+0000 7f42a9400640 1 -- 172.21.15.44:0/3909114652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f428c0051c0 msgr2=0x7f428c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.587+0000 7f42a9400640 1 --2- 172.21.15.44:0/3909114652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f428c0051c0 0x7f428c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.587+0000 7f42a9400640 1 -- 172.21.15.44:0/3909114652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c003520 con 0x7f428c004800 2024-03-30T13:12:41.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.587+0000 7f42aa800640 1 -- 172.21.15.44:0/3909114652 reap_dead start 2024-03-30T13:12:41.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.588+0000 7f42a9400640 1 --2- 172.21.15.44:0/3909114652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 0x7f428c004c80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4294001750 tx=0x7f428c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f8eb66e46c16c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:41.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.588+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294001370 con 0x7f428c004800 2024-03-30T13:12:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.588+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42940052d0 con 0x7f428c004800 2024-03-30T13:12:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.588+0000 7f42a8a00640 1 -- 172.21.15.44:0/3909114652 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294003830 con 0x7f428c004800 2024-03-30T13:12:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.589+0000 7f42ab200640 1 -- 172.21.15.44:0/3909114652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 msgr2=0x7f428c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.589+0000 7f42ab200640 1 --2- 172.21.15.44:0/3909114652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 0x7f428c004c80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4294001750 tx=0x7f428c005830 comp rx=0 tx=0).stop 2024-03-30T13:12:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.589+0000 7f42ab200640 1 -- 172.21.15.44:0/3909114652 shutdown_connections 2024-03-30T13:12:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.589+0000 7f42ab200640 1 --2- 172.21.15.44:0/3909114652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 0x7f428c004c80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.589+0000 7f42ab200640 1 -- 172.21.15.44:0/3909114652 >> 172.21.15.44:0/3909114652 conn(0x7f42a40cfd90 msgr2=0x7f42a40d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.589+0000 7f42ab200640 1 -- 172.21.15.44:0/3909114652 shutdown_connections 2024-03-30T13:12:41.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.589+0000 7f42ab200640 1 -- 172.21.15.44:0/3909114652 wait complete. 2024-03-30T13:12:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.591+0000 7f42ab200640 1 Processor -- start 2024-03-30T13:12:41.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.591+0000 7f42ab200640 1 -- start start 2024-03-30T13:12:41.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.592+0000 7f42ab200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 0x7f42a41f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.592+0000 7f42ab200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a4158c80 0x7f42a40714b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.592+0000 7f42ab200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a414af70 0x7f42a414b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.592+0000 7f42ab200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f42a415f540 con 0x7f428c004800 2024-03-30T13:12:41.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.592+0000 7f42ab200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f42a415f260 con 0x7f42a414af70 2024-03-30T13:12:41.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.592+0000 7f42ab200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f42a415f820 con 0x7f42a4158c80 2024-03-30T13:12:41.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.592+0000 7f42a9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 0x7f42a41f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:41.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.592+0000 7f42a9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 0x7f42a41f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40596/0 (socket says 172.21.15.44:40596) 2024-03-30T13:12:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.592+0000 7f42a9e00640 1 -- 172.21.15.44:0/3741784773 learned_addr learned my addr 172.21.15.44:0/3741784773 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.593+0000 7f42a9400640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a4158c80 0x7f42a40714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.593+0000 7f42aa800640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a414af70 0x7f42a414b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.593+0000 7f42a9e00640 1 -- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a4158c80 msgr2=0x7f42a40714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.593+0000 7f42a9e00640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a4158c80 0x7f42a40714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.593+0000 7f42a9e00640 1 -- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a414af70 msgr2=0x7f42a414b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.593+0000 7f42a9e00640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a414af70 0x7f42a414b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.593+0000 7f42a9e00640 1 -- 172.21.15.44:0/3741784773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a41f5590 con 0x7f428c004800 2024-03-30T13:12:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.593+0000 7f42a9e00640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 0x7f42a41f4410 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f429800c700 tx=0x7f429800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.593+0000 7f429e000640 1 -- 172.21.15.44:0/3741784773 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298018070 con 0x7f428c004800 2024-03-30T13:12:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.593+0000 7f429e000640 1 -- 172.21.15.44:0/3741784773 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4298007500 con 0x7f428c004800 2024-03-30T13:12:41.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.593+0000 7f42ab200640 1 -- 172.21.15.44:0/3741784773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a40af830 con 0x7f428c004800 2024-03-30T13:12:41.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.593+0000 7f429e000640 1 -- 172.21.15.44:0/3741784773 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298004a20 con 0x7f428c004800 2024-03-30T13:12:41.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.594+0000 7f42ab200640 1 -- 172.21.15.44:0/3741784773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a41f4fd0 con 0x7f428c004800 2024-03-30T13:12:41.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.595+0000 7f42ab200640 1 -- 172.21.15.44:0/3741784773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a40afa00 con 0x7f428c004800 2024-03-30T13:12:41.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.596+0000 7f429e000640 1 -- 172.21.15.44:0/3741784773 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f429801b070 con 0x7f428c004800 2024-03-30T13:12:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.597+0000 7f429e000640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f428806c530 0x7f428806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.597+0000 7f429e000640 1 -- 172.21.15.44:0/3741784773 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f429808aff0 con 0x7f428c004800 2024-03-30T13:12:41.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.597+0000 7f42a9400640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f428806c530 0x7f428806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:41.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.599+0000 7f42a9400640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f428806c530 0x7f428806e9f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4294033000 tx=0x7f4294009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.602+0000 7f429e000640 1 -- 172.21.15.44:0/3741784773 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f42980591e0 con 0x7f428c004800 2024-03-30T13:12:41.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.804+0000 7f42ab200640 1 -- 172.21.15.44:0/3741784773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f42a4075890 con 0x7f428c004800 2024-03-30T13:12:41.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.806+0000 7f429e000640 1 -- 172.21.15.44:0/3741784773 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f4298058ae0 con 0x7f428c004800 2024-03-30T13:12:41.810 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:41.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.808+0000 7f42ab200640 1 -- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f428806c530 msgr2=0x7f428806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.808+0000 7f42ab200640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f428806c530 0x7f428806e9f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4294033000 tx=0x7f4294009030 comp rx=0 tx=0).stop 2024-03-30T13:12:41.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.808+0000 7f42ab200640 1 -- 172.21.15.44:0/3741784773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 msgr2=0x7f42a41f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:41.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.808+0000 7f42ab200640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 0x7f42a41f4410 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f429800c700 tx=0x7f429800cbc0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.808+0000 7f42ab200640 1 -- 172.21.15.44:0/3741784773 shutdown_connections 2024-03-30T13:12:41.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.808+0000 7f42ab200640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f428806c530 0x7f428806e9f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.808+0000 7f42ab200640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42a414af70 0x7f42a414b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.808+0000 7f42ab200640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42a4158c80 0x7f42a40714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.808+0000 7f42ab200640 1 --2- 172.21.15.44:0/3741784773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f428c004800 0x7f42a41f4410 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:41.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.808+0000 7f42ab200640 1 -- 172.21.15.44:0/3741784773 >> 172.21.15.44:0/3741784773 conn(0x7f42a40cfd90 msgr2=0x7f42a40cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:41.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.809+0000 7f42ab200640 1 -- 172.21.15.44:0/3741784773 shutdown_connections 2024-03-30T13:12:41.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:41.809+0000 7f42ab200640 1 -- 172.21.15.44:0/3741784773 wait complete. 2024-03-30T13:12:41.833 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:42.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.048+0000 7fdd18800640 1 Processor -- start 2024-03-30T13:12:42.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.048+0000 7fdd18800640 1 -- start start 2024-03-30T13:12:42.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.049+0000 7fdd18800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdd10145c60 0x7fdd10071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.050+0000 7fdd18800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd10160830 0x7fdd100ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.050+0000 7fdd18800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd10146040 con 0x7fdd10071a60 2024-03-30T13:12:42.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.050+0000 7fdd18800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fdd10071ed0 con 0x7fdd10145c60 2024-03-30T13:12:42.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.050+0000 7fdd18800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fdd10160e50 con 0x7fdd10160830 2024-03-30T13:12:42.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.050+0000 7fdd15e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdd10145c60 0x7fdd10071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.050+0000 7fdd15e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdd10145c60 0x7fdd10071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40608/0 (socket says 172.21.15.44:40608) 2024-03-30T13:12:42.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.050+0000 7fdd15e00640 1 -- 172.21.15.44:0/2329118658 learned_addr learned my addr 172.21.15.44:0/2329118658 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:42.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.050+0000 7fdd16800640 1 --2- 172.21.15.44:0/2329118658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd10160830 0x7fdd100ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.051+0000 7fdd15e00640 1 -- 172.21.15.44:0/2329118658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd10160830 msgr2=0x7fdd100ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:42.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.051+0000 7fdd15e00640 1 --2- 172.21.15.44:0/2329118658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd10160830 0x7fdd100ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.051+0000 7fdd15e00640 1 -- 172.21.15.44:0/2329118658 >> v1:172.21.15.151:6789/0 conn(0x7fdd10071a60 legacy=0x7fdd10160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.051+0000 7fdd15e00640 1 -- 172.21.15.44:0/2329118658 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1015d8b0 con 0x7fdd10145c60 2024-03-30T13:12:42.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.052+0000 7fdd15e00640 1 --2- 172.21.15.44:0/2329118658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd10145c60 0x7fdd10071520 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009870 tx=0x7fdd0402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547895e69f91a55f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:42.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.052+0000 7fdd14a00640 1 -- 172.21.15.44:0/2329118658 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04035020 con 0x7fdd10145c60 2024-03-30T13:12:42.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.052+0000 7fdd14a00640 1 -- 172.21.15.44:0/2329118658 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd04031640 con 0x7fdd10145c60 2024-03-30T13:12:42.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.052+0000 7fdd14a00640 1 -- 172.21.15.44:0/2329118658 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0402d040 con 0x7fdd10145c60 2024-03-30T13:12:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.053+0000 7fdd18800640 1 -- 172.21.15.44:0/2329118658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd10145c60 msgr2=0x7fdd10071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.053+0000 7fdd18800640 1 --2- 172.21.15.44:0/2329118658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd10145c60 0x7fdd10071520 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdd04009870 tx=0x7fdd0402b8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.053+0000 7fdd18800640 1 -- 172.21.15.44:0/2329118658 shutdown_connections 2024-03-30T13:12:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.053+0000 7fdd18800640 1 --2- 172.21.15.44:0/2329118658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd10160830 0x7fdd100ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.053+0000 7fdd18800640 1 --2- 172.21.15.44:0/2329118658 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd10145c60 0x7fdd10071520 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.053+0000 7fdd18800640 1 -- 172.21.15.44:0/2329118658 >> 172.21.15.44:0/2329118658 conn(0x7fdd100b1c90 msgr2=0x7fdd100b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.053+0000 7fdd18800640 1 -- 172.21.15.44:0/2329118658 shutdown_connections 2024-03-30T13:12:42.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.053+0000 7fdd18800640 1 -- 172.21.15.44:0/2329118658 wait complete. 2024-03-30T13:12:42.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.055+0000 7fdd18800640 1 Processor -- start 2024-03-30T13:12:42.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.055+0000 7fdd18800640 1 -- start start 2024-03-30T13:12:42.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.056+0000 7fdd18800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd10071a60 0x7fdd1015bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.056+0000 7fdd18800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd10145c60 0x7fdd101441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.056+0000 7fdd18800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd10160830 0x7fdd101446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.056+0000 7fdd18800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1015d0b0 con 0x7fdd10145c60 2024-03-30T13:12:42.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.056+0000 7fdd18800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1015cdd0 con 0x7fdd10160830 2024-03-30T13:12:42.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.056+0000 7fdd18800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fdd100cad70 con 0x7fdd10071a60 2024-03-30T13:12:42.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.056+0000 7fdd15400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd10145c60 0x7fdd101441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.056+0000 7fdd15400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd10145c60 0x7fdd101441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40620/0 (socket says 172.21.15.44:40620) 2024-03-30T13:12:42.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.056+0000 7fdd15400640 1 -- 172.21.15.44:0/3644053975 learned_addr learned my addr 172.21.15.44:0/3644053975 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.057+0000 7fdd16800640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd10160830 0x7fdd101446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.057+0000 7fdd15e00640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd10071a60 0x7fdd1015bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.057+0000 7fdd15400640 1 -- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd10071a60 msgr2=0x7fdd1015bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.057+0000 7fdd15400640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd10071a60 0x7fdd1015bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.057+0000 7fdd15400640 1 -- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd10160830 msgr2=0x7fdd101446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.057+0000 7fdd15400640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd10160830 0x7fdd101446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.057+0000 7fdd15400640 1 -- 172.21.15.44:0/3644053975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd101f41b0 con 0x7fdd10145c60 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.057+0000 7fdd15400640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd10145c60 0x7fdd101441a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c400 tx=0x7fdd0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.058+0000 7fdd0a000640 1 -- 172.21.15.44:0/3644053975 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd000052d0 con 0x7fdd10145c60 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.058+0000 7fdd0a000640 1 -- 172.21.15.44:0/3644053975 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd00005490 con 0x7fdd10145c60 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.058+0000 7fdd0a000640 1 -- 172.21.15.44:0/3644053975 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd00007260 con 0x7fdd10145c60 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.058+0000 7fdd18800640 1 -- 172.21.15.44:0/3644053975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd101f5210 con 0x7fdd10145c60 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.058+0000 7fdd18800640 1 -- 172.21.15.44:0/3644053975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd101f4730 con 0x7fdd10145c60 2024-03-30T13:12:42.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.059+0000 7fdd18800640 1 -- 172.21.15.44:0/3644053975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd1015c330 con 0x7fdd10145c60 2024-03-30T13:12:42.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.060+0000 7fdd0a000640 1 -- 172.21.15.44:0/3644053975 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdd00007400 con 0x7fdd10145c60 2024-03-30T13:12:42.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.061+0000 7fdd0a000640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdcf406c530 0x7fdcf406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.061+0000 7fdd0a000640 1 -- 172.21.15.44:0/3644053975 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fdd0008b080 con 0x7fdd10145c60 2024-03-30T13:12:42.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.061+0000 7fdd15e00640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdcf406c530 0x7fdcf406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.063+0000 7fdd15e00640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdcf406c530 0x7fdcf406e9f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd04036000 tx=0x7fdd0403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:42.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.065+0000 7fdd0a000640 1 -- 172.21.15.44:0/3644053975 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fdd00059270 con 0x7fdd10145c60 2024-03-30T13:12:42.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.272+0000 7fdd18800640 1 -- 172.21.15.44:0/3644053975 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd100ca610 con 0x7fdd10145c60 2024-03-30T13:12:42.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.274+0000 7fdd0a000640 1 -- 172.21.15.44:0/3644053975 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18927 (secure 0 0 0) 0x7fdd00058b70 con 0x7fdd10145c60 2024-03-30T13:12:42.279 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:42.279 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":29,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:12:27.323786+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:42.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.277+0000 7fdd18800640 1 -- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdcf406c530 msgr2=0x7fdcf406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.277+0000 7fdd18800640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdcf406c530 0x7fdcf406e9f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd04036000 tx=0x7fdd0403c040 comp rx=0 tx=0).stop 2024-03-30T13:12:42.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.278+0000 7fdd18800640 1 -- 172.21.15.44:0/3644053975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd10145c60 msgr2=0x7fdd101441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.278+0000 7fdd18800640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd10145c60 0x7fdd101441a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c400 tx=0x7fdd0000c8c0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.278+0000 7fdd18800640 1 -- 172.21.15.44:0/3644053975 shutdown_connections 2024-03-30T13:12:42.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.278+0000 7fdd18800640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdcf406c530 0x7fdcf406e9f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.278+0000 7fdd18800640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd10160830 0x7fdd101446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.278+0000 7fdd18800640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdd10145c60 0x7fdd101441a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.278+0000 7fdd18800640 1 --2- 172.21.15.44:0/3644053975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd10071a60 0x7fdd1015bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.278+0000 7fdd18800640 1 -- 172.21.15.44:0/3644053975 >> 172.21.15.44:0/3644053975 conn(0x7fdd100b1c90 msgr2=0x7fdd100b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:42.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.278+0000 7fdd18800640 1 -- 172.21.15.44:0/3644053975 shutdown_connections 2024-03-30T13:12:42.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.278+0000 7fdd18800640 1 -- 172.21.15.44:0/3644053975 wait complete. 2024-03-30T13:12:42.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:12:42.302 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:12:42.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.529+0000 7ff3c9600640 1 Processor -- start 2024-03-30T13:12:42.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.529+0000 7ff3c9600640 1 -- start start 2024-03-30T13:12:42.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.530+0000 7ff3c9600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff3c40b2f20 0x7ff3c415f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.530+0000 7ff3c9600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c40b35e0 con 0x7ff3c4072d50 2024-03-30T13:12:42.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.530+0000 7ff3c9600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c40b38c0 con 0x7ff3c4144cb0 2024-03-30T13:12:42.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.530+0000 7ff3c9600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c40b3e80 con 0x7ff3c40b2f20 2024-03-30T13:12:42.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.531+0000 7ff3c3400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff3c40b2f20 0x7ff3c415f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.531+0000 7ff3c2000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff3c4072d50 0x7ff3c40ce050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40246/0 (socket says 172.21.15.44:40246) 2024-03-30T13:12:42.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.531+0000 7ff3c2000640 1 -- 172.21.15.44:0/1736687669 learned_addr learned my addr 172.21.15.44:0/1736687669 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:42.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.531+0000 7ff3c3400640 1 -- 172.21.15.44:0/1736687669 >> v1:172.21.15.151:6789/0 conn(0x7ff3c4144cb0 legacy=0x7ff3c4072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.531+0000 7ff3c3400640 1 -- 172.21.15.44:0/1736687669 >> v1:172.21.15.44:6789/0 conn(0x7ff3c4072d50 legacy=0x7ff3c40ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.531+0000 7ff3c3400640 1 -- 172.21.15.44:0/1736687669 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c40b3ba0 con 0x7ff3c40b2f20 2024-03-30T13:12:42.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.531+0000 7ff3c1600640 1 -- 172.21.15.44:0/1736687669 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177724492 0 0) 0x7ff3c40b35e0 con 0x7ff3c4072d50 2024-03-30T13:12:42.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.532+0000 7ff3c3400640 1 --2- 172.21.15.44:0/1736687669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3c40b2f20 0x7ff3c415f800 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009d90 tx=0x7ff3bc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2ca19e859da28d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:42.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.533+0000 7ff3c1600640 1 -- 172.21.15.44:0/1736687669 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc039070 con 0x7ff3c40b2f20 2024-03-30T13:12:42.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.533+0000 7ff3c1600640 1 -- 172.21.15.44:0/1736687669 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3bc02cd00 con 0x7ff3c40b2f20 2024-03-30T13:12:42.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.533+0000 7ff3c1600640 1 -- 172.21.15.44:0/1736687669 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc034660 con 0x7ff3c40b2f20 2024-03-30T13:12:42.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.533+0000 7ff3c9600640 1 -- 172.21.15.44:0/1736687669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3c40b2f20 msgr2=0x7ff3c415f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.533+0000 7ff3c9600640 1 --2- 172.21.15.44:0/1736687669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3c40b2f20 0x7ff3c415f800 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009d90 tx=0x7ff3bc02bf50 comp rx=0 tx=0).stop 2024-03-30T13:12:42.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.533+0000 7ff3c9600640 1 -- 172.21.15.44:0/1736687669 shutdown_connections 2024-03-30T13:12:42.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.533+0000 7ff3c9600640 1 --2- 172.21.15.44:0/1736687669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3c40b2f20 0x7ff3c415f800 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.533+0000 7ff3c9600640 1 -- 172.21.15.44:0/1736687669 >> 172.21.15.44:0/1736687669 conn(0x7ff3c40b5b00 msgr2=0x7ff3c406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:42.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.534+0000 7ff3c9600640 1 -- 172.21.15.44:0/1736687669 shutdown_connections 2024-03-30T13:12:42.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.534+0000 7ff3c9600640 1 -- 172.21.15.44:0/1736687669 wait complete. 2024-03-30T13:12:42.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.535+0000 7ff3c9600640 1 Processor -- start 2024-03-30T13:12:42.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.535+0000 7ff3c9600640 1 -- start start 2024-03-30T13:12:42.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.536+0000 7ff3c9600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3c4072d50 0x7ff3c415e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.536+0000 7ff3c9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3c40b2f20 0x7ff3c415c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.536+0000 7ff3c9600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3c4144cb0 0x7ff3c413dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c9600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c40ce760 con 0x7ff3c40b2f20 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c9600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c40b3390 con 0x7ff3c4072d50 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c9600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c40ce8e0 con 0x7ff3c4144cb0 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3c40b2f20 0x7ff3c415c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3c40b2f20 0x7ff3c415c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40638/0 (socket says 172.21.15.44:40638) 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c2000640 1 -- 172.21.15.44:0/2524744073 learned_addr learned my addr 172.21.15.44:0/2524744073 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c2a00640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3c4072d50 0x7ff3c415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c3400640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3c4144cb0 0x7ff3c413dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c2000640 1 -- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3c4144cb0 msgr2=0x7ff3c413dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c2000640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3c4144cb0 0x7ff3c413dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c2000640 1 -- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3c4072d50 msgr2=0x7ff3c415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c2000640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3c4072d50 0x7ff3c415e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c2000640 1 -- 172.21.15.44:0/2524744073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c415cdd0 con 0x7ff3c40b2f20 2024-03-30T13:12:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.537+0000 7ff3c2a00640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3c4072d50 0x7ff3c415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.538+0000 7ff3c2000640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3c40b2f20 0x7ff3c415c150 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00c4a0 tx=0x7ff3ac00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.538+0000 7ff3baa00640 1 -- 172.21.15.44:0/2524744073 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac018070 con 0x7ff3c40b2f20 2024-03-30T13:12:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.538+0000 7ff3baa00640 1 -- 172.21.15.44:0/2524744073 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ac0074e0 con 0x7ff3c40b2f20 2024-03-30T13:12:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.538+0000 7ff3baa00640 1 -- 172.21.15.44:0/2524744073 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac004a20 con 0x7ff3c40b2f20 2024-03-30T13:12:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.538+0000 7ff3c9600640 1 -- 172.21.15.44:0/2524744073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c41429d0 con 0x7ff3c40b2f20 2024-03-30T13:12:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.538+0000 7ff3c9600640 1 -- 172.21.15.44:0/2524744073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c4143ca0 con 0x7ff3c40b2f20 2024-03-30T13:12:42.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.539+0000 7ff3c9600640 1 -- 172.21.15.44:0/2524744073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c4075890 con 0x7ff3c40b2f20 2024-03-30T13:12:42.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.541+0000 7ff3baa00640 1 -- 172.21.15.44:0/2524744073 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff3ac004bc0 con 0x7ff3c40b2f20 2024-03-30T13:12:42.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.542+0000 7ff3baa00640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3a006c530 0x7ff3a006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.542+0000 7ff3baa00640 1 -- 172.21.15.44:0/2524744073 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7ff3ac08b2d0 con 0x7ff3c40b2f20 2024-03-30T13:12:42.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.542+0000 7ff3c2a00640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3a006c530 0x7ff3a006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.543+0000 7ff3c2a00640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3a006c530 0x7ff3a006e9f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4000f60 tx=0x7ff3b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:42.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.545+0000 7ff3baa00640 1 -- 172.21.15.44:0/2524744073 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff3ac021020 con 0x7ff3c40b2f20 2024-03-30T13:12:42.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.747+0000 7ff3c9600640 1 -- 172.21.15.44:0/2524744073 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff3c40b4030 con 0x7ff3c40b2f20 2024-03-30T13:12:42.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.748+0000 7ff3baa00640 1 -- 172.21.15.44:0/2524744073 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7ff3ac059540 con 0x7ff3c40b2f20 2024-03-30T13:12:42.752 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:12:42.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.750+0000 7ff3c9600640 1 -- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3a006c530 msgr2=0x7ff3a006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.750+0000 7ff3c9600640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3a006c530 0x7ff3a006e9f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4000f60 tx=0x7ff3b4009040 comp rx=0 tx=0).stop 2024-03-30T13:12:42.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.750+0000 7ff3c9600640 1 -- 172.21.15.44:0/2524744073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3c40b2f20 msgr2=0x7ff3c415c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.750+0000 7ff3c9600640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3c40b2f20 0x7ff3c415c150 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00c4a0 tx=0x7ff3ac00c960 comp rx=0 tx=0).stop 2024-03-30T13:12:42.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.751+0000 7ff3c9600640 1 -- 172.21.15.44:0/2524744073 shutdown_connections 2024-03-30T13:12:42.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.751+0000 7ff3c9600640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3c4144cb0 0x7ff3c413dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.751+0000 7ff3c9600640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3c40b2f20 0x7ff3c415c150 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.751+0000 7ff3c9600640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3a006c530 0x7ff3a006e9f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.751+0000 7ff3c9600640 1 --2- 172.21.15.44:0/2524744073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3c4072d50 0x7ff3c415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.751+0000 7ff3c9600640 1 -- 172.21.15.44:0/2524744073 >> 172.21.15.44:0/2524744073 conn(0x7ff3c40b5b00 msgr2=0x7ff3c4071e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:42.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.751+0000 7ff3c9600640 1 -- 172.21.15.44:0/2524744073 shutdown_connections 2024-03-30T13:12:42.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.751+0000 7ff3c9600640 1 -- 172.21.15.44:0/2524744073 wait complete. 2024-03-30T13:12:42.772 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:12:42.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.990+0000 7f9832a00640 1 Processor -- start 2024-03-30T13:12:42.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.991+0000 7f9832a00640 1 -- start start 2024-03-30T13:12:42.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.992+0000 7f9832a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f982c0b4d00 0x7f982c0d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.992+0000 7f9832a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c0b54b0 con 0x7f982c0b4920 2024-03-30T13:12:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.992+0000 7f9832a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c0cfca0 con 0x7f982c0d0b90 2024-03-30T13:12:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.992+0000 7f9832a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f982c0d0260 con 0x7f982c0b4d00 2024-03-30T13:12:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.992+0000 7f9831600640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f982c0b4920 0x7f982c0b3ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40262/0 (socket says 172.21.15.44:40262) 2024-03-30T13:12:42.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.992+0000 7f9831600640 1 -- 172.21.15.44:0/950554440 learned_addr learned my addr 172.21.15.44:0/950554440 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:42.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.992+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943864511 0 0) 0x7f9820001110 con 0x7f982c0b4920 2024-03-30T13:12:42.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.992+0000 7f9830c00640 1 --2- 172.21.15.44:0/950554440 >> v2:172.21.15.151:3300/0 conn(0x7f982c0b4d00 0x7f982c0d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.992+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9814003520 con 0x7f982c0b4920 2024-03-30T13:12:42.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1121796282 0 0) 0x7f9814003520 con 0x7f982c0b4920 2024-03-30T13:12:42.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 >> v2:172.21.15.151:3300/0 conn(0x7f982c0b4d00 msgr2=0x7f982c0d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:42.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 --2- 172.21.15.44:0/950554440 >> v2:172.21.15.151:3300/0 conn(0x7f982c0b4d00 0x7f982c0d4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 >> v1:172.21.15.151:6789/0 conn(0x7f982c0d0b90 legacy=0x7f982c0d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c0cff80 con 0x7f982c0b4920 2024-03-30T13:12:42.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f9820001840 con 0x7f982c0b4920 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 >> v1:172.21.15.44:6789/0 conn(0x7f982c0b4920 legacy=0x7f982c0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 --2- 172.21.15.44:0/950554440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814003a00 0x7f9814003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 --2- 172.21.15.44:0/950554440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9814004800 0x7f9814004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 --2- 172.21.15.44:0/950554440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9814005210 0x7f981400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0d0260 con 0x7f9814005210 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f981400c160 con 0x7f9814004800 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f981400c360 con 0x7f9814003a00 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.993+0000 7f9832000640 1 --2- 172.21.15.44:0/950554440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9814005210 0x7f981400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.994+0000 7f9832000640 1 -- 172.21.15.44:0/950554440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814003a00 msgr2=0x7f9814003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.994+0000 7f9831600640 1 --2- 172.21.15.44:0/950554440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814003a00 0x7f9814003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.994+0000 7f9830c00640 1 --2- 172.21.15.44:0/950554440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9814004800 0x7f9814004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.994+0000 7f9832000640 1 --2- 172.21.15.44:0/950554440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814003a00 0x7f9814003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.994+0000 7f9832000640 1 -- 172.21.15.44:0/950554440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9814004800 msgr2=0x7f9814004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.994+0000 7f9832000640 1 --2- 172.21.15.44:0/950554440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9814004800 0x7f9814004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:42.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.994+0000 7f9832000640 1 -- 172.21.15.44:0/950554440 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9814003520 con 0x7f9814005210 2024-03-30T13:12:43.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.995+0000 7f9832000640 1 -- 172.21.15.44:0/950554440 reap_dead start 2024-03-30T13:12:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.995+0000 7f9832000640 1 --2- 172.21.15.44:0/950554440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9814005210 0x7f981400b9c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9824001e20 tx=0x7f9814005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e20345bb038566 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.995+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9824001a70 con 0x7f9814005210 2024-03-30T13:12:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.995+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9824003b70 con 0x7f9814005210 2024-03-30T13:12:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.995+0000 7f982be00640 1 -- 172.21.15.44:0/950554440 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98240050d0 con 0x7f9814005210 2024-03-30T13:12:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.996+0000 7f9832a00640 1 -- 172.21.15.44:0/950554440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9814005210 msgr2=0x7f981400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.996+0000 7f9832a00640 1 --2- 172.21.15.44:0/950554440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9814005210 0x7f981400b9c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9824001e20 tx=0x7f9814005830 comp rx=0 tx=0).stop 2024-03-30T13:12:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.996+0000 7f9832a00640 1 -- 172.21.15.44:0/950554440 shutdown_connections 2024-03-30T13:12:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.996+0000 7f9832a00640 1 --2- 172.21.15.44:0/950554440 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9814005210 0x7f981400b9c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.996+0000 7f9832a00640 1 -- 172.21.15.44:0/950554440 >> 172.21.15.44:0/950554440 conn(0x7f982c09d4e0 msgr2=0x7f982c0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.996+0000 7f9832a00640 1 -- 172.21.15.44:0/950554440 shutdown_connections 2024-03-30T13:12:43.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.996+0000 7f9832a00640 1 -- 172.21.15.44:0/950554440 wait complete. 2024-03-30T13:12:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.998+0000 7f9832a00640 1 Processor -- start 2024-03-30T13:12:43.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.998+0000 7f9832a00640 1 -- start start 2024-03-30T13:12:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.999+0000 7f9832a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814005210 0x7f982c1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.999+0000 7f9832a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f982c1e7690 0x7f982c1f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.999+0000 7f9832a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c06d220 0x7f982c06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.999+0000 7f9832a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0cf8c0 con 0x7f982c06d220 2024-03-30T13:12:43.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.999+0000 7f9832a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0d2180 con 0x7f982c1e7690 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.999+0000 7f9832a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f982c0cfa40 con 0x7f9814005210 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.999+0000 7f9832000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c06d220 0x7f982c06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.999+0000 7f9832000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c06d220 0x7f982c06d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40666/0 (socket says 172.21.15.44:40666) 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.999+0000 7f9832000640 1 -- 172.21.15.44:0/3891386698 learned_addr learned my addr 172.21.15.44:0/3891386698 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.999+0000 7f9831600640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814005210 0x7f982c1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:42.999+0000 7f9830c00640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f982c1e7690 0x7f982c1f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.000+0000 7f9832000640 1 -- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814005210 msgr2=0x7f982c1511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.000+0000 7f9832000640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814005210 0x7f982c1511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.000+0000 7f9832000640 1 -- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f982c1e7690 msgr2=0x7f982c1f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.000+0000 7f9832000640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f982c1e7690 0x7f982c1f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.000+0000 7f9832000640 1 -- 172.21.15.44:0/3891386698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c151be0 con 0x7f982c06d220 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.000+0000 7f9831600640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814005210 0x7f982c1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.000+0000 7f9832000640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c06d220 0x7f982c06d6a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f982402c040 tx=0x7f98240014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.000+0000 7f9829600640 1 -- 172.21.15.44:0/3891386698 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982402f650 con 0x7f982c06d220 2024-03-30T13:12:43.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.000+0000 7f9829600640 1 -- 172.21.15.44:0/3891386698 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982402f7f0 con 0x7f982c06d220 2024-03-30T13:12:43.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.000+0000 7f9829600640 1 -- 172.21.15.44:0/3891386698 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982402fbe0 con 0x7f982c06d220 2024-03-30T13:12:43.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.000+0000 7f9832a00640 1 -- 172.21.15.44:0/3891386698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c1e7be0 con 0x7f982c06d220 2024-03-30T13:12:43.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.000+0000 7f9832a00640 1 -- 172.21.15.44:0/3891386698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c0cc800 con 0x7f982c06d220 2024-03-30T13:12:43.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.001+0000 7f9832a00640 1 -- 172.21.15.44:0/3891386698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982c075890 con 0x7f982c06d220 2024-03-30T13:12:43.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.002+0000 7f9829600640 1 -- 172.21.15.44:0/3891386698 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9824039480 con 0x7f982c06d220 2024-03-30T13:12:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.003+0000 7f9829600640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f981006c560 0x7f981006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.003+0000 7f9829600640 1 -- 172.21.15.44:0/3891386698 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f98240ad880 con 0x7f982c06d220 2024-03-30T13:12:43.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.004+0000 7f9831600640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f981006c560 0x7f981006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.005+0000 7f9831600640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f981006c560 0x7f981006ea20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9820001eb0 tx=0x7f9820009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:43.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.008+0000 7f9829600640 1 -- 172.21.15.44:0/3891386698 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f982c151be0 con 0x7f982c06d220 2024-03-30T13:12:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.205+0000 7f9832a00640 1 -- 172.21.15.44:0/3891386698 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f982c074fc0 con 0x7f982c06d220 2024-03-30T13:12:43.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.206+0000 7f9829600640 1 -- 172.21.15.44:0/3891386698 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f9824033030 con 0x7f982c06d220 2024-03-30T13:12:43.210 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:43.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.208+0000 7f9832a00640 1 -- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f981006c560 msgr2=0x7f981006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.208+0000 7f9832a00640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f981006c560 0x7f981006ea20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9820001eb0 tx=0x7f9820009040 comp rx=0 tx=0).stop 2024-03-30T13:12:43.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.208+0000 7f9832a00640 1 -- 172.21.15.44:0/3891386698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c06d220 msgr2=0x7f982c06d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.208+0000 7f9832a00640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c06d220 0x7f982c06d6a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f982402c040 tx=0x7f98240014a0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.208+0000 7f9832a00640 1 -- 172.21.15.44:0/3891386698 shutdown_connections 2024-03-30T13:12:43.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.208+0000 7f9832a00640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f982c06d220 0x7f982c06d6a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.208+0000 7f9832a00640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f981006c560 0x7f981006ea20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.208+0000 7f9832a00640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f982c1e7690 0x7f982c1f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.208+0000 7f9832a00640 1 --2- 172.21.15.44:0/3891386698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814005210 0x7f982c1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.208+0000 7f9832a00640 1 -- 172.21.15.44:0/3891386698 >> 172.21.15.44:0/3891386698 conn(0x7f982c09d4e0 msgr2=0x7f982c0d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:43.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.208+0000 7f9832a00640 1 -- 172.21.15.44:0/3891386698 shutdown_connections 2024-03-30T13:12:43.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.208+0000 7f9832a00640 1 -- 172.21.15.44:0/3891386698 wait complete. 2024-03-30T13:12:43.231 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:12:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.449+0000 7fd621a00640 1 Processor -- start 2024-03-30T13:12:43.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.450+0000 7fd621a00640 1 -- start start 2024-03-30T13:12:43.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.451+0000 7fd621a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd61c0b4920 0x7fd61c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.451+0000 7fd621a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd61c0d0b90 0x7fd61c0d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.452+0000 7fd621a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd61c0b54b0 con 0x7fd61c0b4d00 2024-03-30T13:12:43.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.452+0000 7fd621a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd61c0d0260 con 0x7fd61c0b4920 2024-03-30T13:12:43.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.452+0000 7fd621a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fd61c0cfca0 con 0x7fd61c0d0b90 2024-03-30T13:12:43.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.452+0000 7fd61be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd61c0b4920 0x7fd61c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.452+0000 7fd61b400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd61c0b4d00 0x7fd61c0d4ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40276/0 (socket says 172.21.15.44:40276) 2024-03-30T13:12:43.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.452+0000 7fd61b400640 1 -- 172.21.15.44:0/1448653689 learned_addr learned my addr 172.21.15.44:0/1448653689 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:43.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.452+0000 7fd621000640 1 --2- 172.21.15.44:0/1448653689 >> v2:172.21.15.151:3300/0 conn(0x7fd61c0d0b90 0x7fd61c0d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.452+0000 7fd61be00640 1 -- 172.21.15.44:0/1448653689 >> v2:172.21.15.151:3300/0 conn(0x7fd61c0d0b90 msgr2=0x7fd61c0d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:43.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.452+0000 7fd61be00640 1 --2- 172.21.15.44:0/1448653689 >> v2:172.21.15.151:3300/0 conn(0x7fd61c0d0b90 0x7fd61c0d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.452+0000 7fd61be00640 1 -- 172.21.15.44:0/1448653689 >> v1:172.21.15.44:6789/0 conn(0x7fd61c0b4d00 legacy=0x7fd61c0d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.452+0000 7fd61be00640 1 -- 172.21.15.44:0/1448653689 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c0cff80 con 0x7fd61c0b4920 2024-03-30T13:12:43.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.452+0000 7fd61aa00640 1 -- 172.21.15.44:0/1448653689 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866471266 0 0) 0x7fd60c001490 con 0x7fd61c0b4d00 2024-03-30T13:12:43.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.454+0000 7fd61be00640 1 --2- 172.21.15.44:0/1448653689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c0b4920 0x7fd61c0b3ab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0ce780 tx=0x7fd60402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c22fe1aca2605ca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:43.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.454+0000 7fd61aa00640 1 -- 172.21.15.44:0/1448653689 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6040315a0 con 0x7fd61c0b4920 2024-03-30T13:12:43.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.454+0000 7fd61aa00640 1 -- 172.21.15.44:0/1448653689 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd604037070 con 0x7fd61c0b4920 2024-03-30T13:12:43.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.454+0000 7fd61aa00640 1 -- 172.21.15.44:0/1448653689 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604031960 con 0x7fd61c0b4920 2024-03-30T13:12:43.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.455+0000 7fd621a00640 1 -- 172.21.15.44:0/1448653689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c0b4920 msgr2=0x7fd61c0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.455+0000 7fd621a00640 1 --2- 172.21.15.44:0/1448653689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c0b4920 0x7fd61c0b3ab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd61c0ce780 tx=0x7fd60402b840 comp rx=0 tx=0).stop 2024-03-30T13:12:43.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.455+0000 7fd621a00640 1 -- 172.21.15.44:0/1448653689 shutdown_connections 2024-03-30T13:12:43.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.455+0000 7fd621a00640 1 --2- 172.21.15.44:0/1448653689 >> v2:172.21.15.151:3300/0 conn(0x7fd61c0d0b90 0x7fd61c0d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.455+0000 7fd621a00640 1 --2- 172.21.15.44:0/1448653689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c0b4920 0x7fd61c0b3ab0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.455+0000 7fd621a00640 1 -- 172.21.15.44:0/1448653689 >> 172.21.15.44:0/1448653689 conn(0x7fd61c09d4e0 msgr2=0x7fd61c0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:43.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.455+0000 7fd621a00640 1 -- 172.21.15.44:0/1448653689 shutdown_connections 2024-03-30T13:12:43.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.455+0000 7fd621a00640 1 -- 172.21.15.44:0/1448653689 wait complete. 2024-03-30T13:12:43.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.457+0000 7fd621a00640 1 Processor -- start 2024-03-30T13:12:43.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.457+0000 7fd621a00640 1 -- start start 2024-03-30T13:12:43.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.458+0000 7fd621a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd61c0b4920 0x7fd61c159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.458+0000 7fd621a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd61c0b4d00 0x7fd61c0b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.458+0000 7fd621a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c0d0b90 0x7fd61c0b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.458+0000 7fd621a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c0b3ff0 con 0x7fd61c0d0b90 2024-03-30T13:12:43.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.458+0000 7fd621a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c0d2180 con 0x7fd61c0b4d00 2024-03-30T13:12:43.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.458+0000 7fd621a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd61c0cf8c0 con 0x7fd61c0b4920 2024-03-30T13:12:43.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.459+0000 7fd621000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c0d0b90 0x7fd61c0b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.459+0000 7fd621000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c0d0b90 0x7fd61c0b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40686/0 (socket says 172.21.15.44:40686) 2024-03-30T13:12:43.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.459+0000 7fd621000640 1 -- 172.21.15.44:0/3967248316 learned_addr learned my addr 172.21.15.44:0/3967248316 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:43.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.459+0000 7fd61be00640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd61c0b4920 0x7fd61c159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.459+0000 7fd61b400640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd61c0b4d00 0x7fd61c0b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.459+0000 7fd621000640 1 -- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd61c0b4920 msgr2=0x7fd61c159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.459+0000 7fd621000640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd61c0b4920 0x7fd61c159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.459+0000 7fd621000640 1 -- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd61c0b4d00 msgr2=0x7fd61c0b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.459+0000 7fd621000640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd61c0b4d00 0x7fd61c0b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.459+0000 7fd621000640 1 -- 172.21.15.44:0/3967248316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c0b78f0 con 0x7fd61c0d0b90 2024-03-30T13:12:43.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.459+0000 7fd621000640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c0d0b90 0x7fd61c0b72c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd61400d5d0 tx=0x7fd61400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:43.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.460+0000 7fd613e00640 1 -- 172.21.15.44:0/3967248316 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6140125f0 con 0x7fd61c0d0b90 2024-03-30T13:12:43.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.460+0000 7fd613e00640 1 -- 172.21.15.44:0/3967248316 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd614019070 con 0x7fd61c0d0b90 2024-03-30T13:12:43.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.460+0000 7fd613e00640 1 -- 172.21.15.44:0/3967248316 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6140129f0 con 0x7fd61c0d0b90 2024-03-30T13:12:43.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.460+0000 7fd621a00640 1 -- 172.21.15.44:0/3967248316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61c0b7bd0 con 0x7fd61c0d0b90 2024-03-30T13:12:43.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.460+0000 7fd621a00640 1 -- 172.21.15.44:0/3967248316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd61c0b8400 con 0x7fd61c0d0b90 2024-03-30T13:12:43.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.461+0000 7fd621a00640 1 -- 172.21.15.44:0/3967248316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd61c075890 con 0x7fd61c0d0b90 2024-03-30T13:12:43.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.462+0000 7fd613e00640 1 -- 172.21.15.44:0/3967248316 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd614012b90 con 0x7fd61c0d0b90 2024-03-30T13:12:43.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.463+0000 7fd613e00640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd5f806c530 0x7fd5f806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.464+0000 7fd613e00640 1 -- 172.21.15.44:0/3967248316 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fd61408bf10 con 0x7fd61c0d0b90 2024-03-30T13:12:43.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.464+0000 7fd61be00640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd5f806c530 0x7fd5f806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.465+0000 7fd61be00640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd5f806c530 0x7fd5f806e9f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd604036000 tx=0x7fd604008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:43.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.468+0000 7fd613e00640 1 -- 172.21.15.44:0/3967248316 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd61405a080 con 0x7fd61c0d0b90 2024-03-30T13:12:43.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.664+0000 7fd621a00640 1 -- 172.21.15.44:0/3967248316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd61c0d4e90 con 0x7fd61c0d0b90 2024-03-30T13:12:43.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.664+0000 7fd613e00640 1 -- 172.21.15.44:0/3967248316 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fd614059980 con 0x7fd61c0d0b90 2024-03-30T13:12:43.668 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:12:43.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.667+0000 7fd621a00640 1 -- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd5f806c530 msgr2=0x7fd5f806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.667+0000 7fd621a00640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd5f806c530 0x7fd5f806e9f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd604036000 tx=0x7fd604008030 comp rx=0 tx=0).stop 2024-03-30T13:12:43.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.667+0000 7fd621a00640 1 -- 172.21.15.44:0/3967248316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c0d0b90 msgr2=0x7fd61c0b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.667+0000 7fd621a00640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c0d0b90 0x7fd61c0b72c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd61400d5d0 tx=0x7fd61400da90 comp rx=0 tx=0).stop 2024-03-30T13:12:43.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.667+0000 7fd621a00640 1 -- 172.21.15.44:0/3967248316 shutdown_connections 2024-03-30T13:12:43.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.667+0000 7fd621a00640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd61c0d0b90 0x7fd61c0b72c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.667+0000 7fd621a00640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd5f806c530 0x7fd5f806e9f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.667+0000 7fd621a00640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd61c0b4d00 0x7fd61c0b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.667+0000 7fd621a00640 1 --2- 172.21.15.44:0/3967248316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd61c0b4920 0x7fd61c159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.667+0000 7fd621a00640 1 -- 172.21.15.44:0/3967248316 >> 172.21.15.44:0/3967248316 conn(0x7fd61c09d4e0 msgr2=0x7fd61c0d26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:43.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.667+0000 7fd621a00640 1 -- 172.21.15.44:0/3967248316 shutdown_connections 2024-03-30T13:12:43.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.667+0000 7fd621a00640 1 -- 172.21.15.44:0/3967248316 wait complete. 2024-03-30T13:12:43.689 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:12:43.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.904+0000 7fe2fd400640 1 Processor -- start 2024-03-30T13:12:43.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.904+0000 7fe2fd400640 1 -- start start 2024-03-30T13:12:43.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.905+0000 7fe2fd400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe2f815b1c0 0x7fe2f815c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.905+0000 7fe2fd400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe2f80add80 0x7fe2f80ae210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.905+0000 7fe2fd400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f815fb00 con 0x7fe2f80ae750 2024-03-30T13:12:43.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.905+0000 7fe2fd400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f80ad950 con 0x7fe2f815b1c0 2024-03-30T13:12:43.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.905+0000 7fe2fd400640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f815ef80 con 0x7fe2f80add80 2024-03-30T13:12:43.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.905+0000 7fe2f7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe2f815b1c0 0x7fe2f815c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.905+0000 7fe2f7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe2f815b1c0 0x7fe2f815c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40700/0 (socket says 172.21.15.44:40700) 2024-03-30T13:12:43.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.906+0000 7fe2f7e00640 1 -- 172.21.15.44:0/3261718608 learned_addr learned my addr 172.21.15.44:0/3261718608 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:43.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.906+0000 7fe2f7e00640 1 -- 172.21.15.44:0/3261718608 >> v2:172.21.15.151:3300/0 conn(0x7fe2f80add80 msgr2=0x7fe2f80ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:43.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.906+0000 7fe2f7e00640 1 --2- 172.21.15.44:0/3261718608 >> v2:172.21.15.151:3300/0 conn(0x7fe2f80add80 0x7fe2f80ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.906+0000 7fe2f7e00640 1 -- 172.21.15.44:0/3261718608 >> v1:172.21.15.151:6789/0 conn(0x7fe2f80ae750 legacy=0x7fe2f8071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:43.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.906+0000 7fe2f7e00640 1 -- 172.21.15.44:0/3261718608 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f815f260 con 0x7fe2f815b1c0 2024-03-30T13:12:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.907+0000 7fe2f7e00640 1 --2- 172.21.15.44:0/3261718608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2f815b1c0 0x7fe2f815c030 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80711d0 tx=0x7fe2e802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfac7e5becb4a8c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.907+0000 7fe2f6a00640 1 -- 172.21.15.44:0/3261718608 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e803b070 con 0x7fe2f815b1c0 2024-03-30T13:12:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.907+0000 7fe2f6a00640 1 -- 172.21.15.44:0/3261718608 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e8036440 con 0x7fe2f815b1c0 2024-03-30T13:12:43.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.907+0000 7fe2f6a00640 1 -- 172.21.15.44:0/3261718608 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e8036810 con 0x7fe2f815b1c0 2024-03-30T13:12:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.908+0000 7fe2fd400640 1 -- 172.21.15.44:0/3261718608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2f815b1c0 msgr2=0x7fe2f815c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.908+0000 7fe2fd400640 1 --2- 172.21.15.44:0/3261718608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2f815b1c0 0x7fe2f815c030 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80711d0 tx=0x7fe2e802e0e0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.908+0000 7fe2fd400640 1 -- 172.21.15.44:0/3261718608 shutdown_connections 2024-03-30T13:12:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.908+0000 7fe2fd400640 1 --2- 172.21.15.44:0/3261718608 >> v2:172.21.15.151:3300/0 conn(0x7fe2f80add80 0x7fe2f80ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.908+0000 7fe2fd400640 1 --2- 172.21.15.44:0/3261718608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2f815b1c0 0x7fe2f815c030 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.908+0000 7fe2fd400640 1 -- 172.21.15.44:0/3261718608 >> 172.21.15.44:0/3261718608 conn(0x7fe2f80cfd90 msgr2=0x7fe2f80d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:43.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.908+0000 7fe2fd400640 1 -- 172.21.15.44:0/3261718608 shutdown_connections 2024-03-30T13:12:43.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.908+0000 7fe2fd400640 1 -- 172.21.15.44:0/3261718608 wait complete. 2024-03-30T13:12:43.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.910+0000 7fe2fd400640 1 Processor -- start 2024-03-30T13:12:43.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.910+0000 7fe2fd400640 1 -- start start 2024-03-30T13:12:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.911+0000 7fe2fd400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2f80add80 0x7fe2f809b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.911+0000 7fe2fd400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f80ae750 0x7fe2f815da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.911+0000 7fe2fd400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2f809ba30 0x7fe2f809beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.911+0000 7fe2fd400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f806f080 con 0x7fe2f809ba30 2024-03-30T13:12:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.911+0000 7fe2fd400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f815f820 con 0x7fe2f80ae750 2024-03-30T13:12:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.911+0000 7fe2fd400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f80b2c80 con 0x7fe2f80add80 2024-03-30T13:12:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.911+0000 7fe2fca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2f809ba30 0x7fe2f809beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.911+0000 7fe2fca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2f809ba30 0x7fe2f809beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40710/0 (socket says 172.21.15.44:40710) 2024-03-30T13:12:43.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.911+0000 7fe2fca00640 1 -- 172.21.15.44:0/2568744006 learned_addr learned my addr 172.21.15.44:0/2568744006 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2f7400640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f80ae750 0x7fe2f815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2fca00640 1 -- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2f80add80 msgr2=0x7fe2f809b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2fca00640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2f80add80 0x7fe2f809b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2fca00640 1 -- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f80ae750 msgr2=0x7fe2f815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2fca00640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f80ae750 0x7fe2f815da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2fca00640 1 -- 172.21.15.44:0/2568744006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f81413b0 con 0x7fe2f809ba30 2024-03-30T13:12:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2f7400640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f80ae750 0x7fe2f815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2fca00640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2f809ba30 0x7fe2f809beb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000c780 tx=0x7fe2f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2efe00640 1 -- 172.21.15.44:0/2568744006 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0017070 con 0x7fe2f809ba30 2024-03-30T13:12:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2efe00640 1 -- 172.21.15.44:0/2568744006 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f0003da0 con 0x7fe2f809ba30 2024-03-30T13:12:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2fd400640 1 -- 172.21.15.44:0/2568744006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f8141690 con 0x7fe2f809ba30 2024-03-30T13:12:43.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2efe00640 1 -- 172.21.15.44:0/2568744006 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00052b0 con 0x7fe2f809ba30 2024-03-30T13:12:43.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.912+0000 7fe2fd400640 1 -- 172.21.15.44:0/2568744006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f8141c50 con 0x7fe2f809ba30 2024-03-30T13:12:43.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.914+0000 7fe2fd400640 1 -- 172.21.15.44:0/2568744006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f8075890 con 0x7fe2f809ba30 2024-03-30T13:12:43.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.915+0000 7fe2efe00640 1 -- 172.21.15.44:0/2568744006 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe2f001a070 con 0x7fe2f809ba30 2024-03-30T13:12:43.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.915+0000 7fe2efe00640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe2d806c530 0x7fe2d806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:43.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.916+0000 7fe2efe00640 1 -- 172.21.15.44:0/2568744006 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fe2f008b160 con 0x7fe2f809ba30 2024-03-30T13:12:43.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.916+0000 7fe2f7e00640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe2d806c530 0x7fe2d806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:43.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.917+0000 7fe2f7e00640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe2d806c530 0x7fe2d806e9f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8038000 tx=0x7fe2e8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:43.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:43.920+0000 7fe2efe00640 1 -- 172.21.15.44:0/2568744006 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe2f0059350 con 0x7fe2f809ba30 2024-03-30T13:12:44.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.124+0000 7fe2fd400640 1 -- 172.21.15.44:0/2568744006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe2f806ebc0 con 0x7fe2f809ba30 2024-03-30T13:12:44.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.124+0000 7fe2efe00640 1 -- 172.21.15.44:0/2568744006 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fe2f0058c50 con 0x7fe2f809ba30 2024-03-30T13:12:44.128 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.127+0000 7fe2fd400640 1 -- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe2d806c530 msgr2=0x7fe2d806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.127+0000 7fe2fd400640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe2d806c530 0x7fe2d806e9f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8038000 tx=0x7fe2e8030000 comp rx=0 tx=0).stop 2024-03-30T13:12:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.127+0000 7fe2fd400640 1 -- 172.21.15.44:0/2568744006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2f809ba30 msgr2=0x7fe2f809beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.127+0000 7fe2fd400640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2f809ba30 0x7fe2f809beb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe2f000c780 tx=0x7fe2f000cc40 comp rx=0 tx=0).stop 2024-03-30T13:12:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.127+0000 7fe2fd400640 1 -- 172.21.15.44:0/2568744006 shutdown_connections 2024-03-30T13:12:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.127+0000 7fe2fd400640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2f809ba30 0x7fe2f809beb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.127+0000 7fe2fd400640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe2d806c530 0x7fe2d806e9f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.127+0000 7fe2fd400640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f80ae750 0x7fe2f815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.127+0000 7fe2fd400640 1 --2- 172.21.15.44:0/2568744006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2f80add80 0x7fe2f809b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.127+0000 7fe2fd400640 1 -- 172.21.15.44:0/2568744006 >> 172.21.15.44:0/2568744006 conn(0x7fe2f80cfd90 msgr2=0x7fe2f80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.127+0000 7fe2fd400640 1 -- 172.21.15.44:0/2568744006 shutdown_connections 2024-03-30T13:12:44.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.127+0000 7fe2fd400640 1 -- 172.21.15.44:0/2568744006 wait complete. 2024-03-30T13:12:44.150 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:44.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.362+0000 7f6c08a00640 1 Processor -- start 2024-03-30T13:12:44.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.363+0000 7f6c08a00640 1 -- start start 2024-03-30T13:12:44.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.364+0000 7f6c08a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c040d0d30 0x7f6c040cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.364+0000 7f6c08a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6c04161e70 0x7f6c040b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.364+0000 7f6c08a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c040b5b60 con 0x7f6c040d4950 2024-03-30T13:12:44.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.364+0000 7f6c08a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f6c040c7b90 con 0x7f6c04161e70 2024-03-30T13:12:44.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.364+0000 7f6c08a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6c040d4fc0 con 0x7f6c040d0d30 2024-03-30T13:12:44.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.365+0000 7f6c02a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6c040d4950 0x7f6c04161760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40292/0 (socket says 172.21.15.44:40292) 2024-03-30T13:12:44.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.365+0000 7f6c02a00640 1 -- 172.21.15.44:0/1005874276 learned_addr learned my addr 172.21.15.44:0/1005874276 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:44.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.365+0000 7f6c03e00640 1 --2- 172.21.15.44:0/1005874276 >> v2:172.21.15.151:3300/0 conn(0x7f6c04161e70 0x7f6c040b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.365+0000 7f6c03400640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c040d0d30 0x7f6c040cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.365+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858364000 0 0) 0x7f6c040b5b60 con 0x7f6c040d4950 2024-03-30T13:12:44.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.365+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6be8003520 con 0x7f6c040d4950 2024-03-30T13:12:44.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.365+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2121217808 0 0) 0x7f6be8003520 con 0x7f6c040d4950 2024-03-30T13:12:44.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.365+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c040d0d30 msgr2=0x7f6c040cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:44.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.365+0000 7f6c02000640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c040d0d30 0x7f6c040cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 >> v2:172.21.15.151:3300/0 conn(0x7f6c04161e70 msgr2=0x7f6c040b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:44.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02000640 1 --2- 172.21.15.44:0/1005874276 >> v2:172.21.15.151:3300/0 conn(0x7f6c04161e70 0x7f6c040b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c040b57f0 con 0x7f6c040d4950 2024-03-30T13:12:44.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f6bec001670 con 0x7f6c040d4950 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 >> v1:172.21.15.44:6789/0 conn(0x7f6c040d4950 legacy=0x7f6c04161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02000640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be80039b0 0x7f6be8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02000640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6be80043a0 0x7f6be8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02000640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6be8004fa0 0x7f6be800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6c040c7b90 con 0x7f6be80043a0 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6c040d4fc0 con 0x7f6be8004fa0 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6be800bf30 con 0x7f6be80039b0 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c03400640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c040d0d30 0x7f6c040cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02a00640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6be80043a0 0x7f6be8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02a00640 1 -- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be80039b0 msgr2=0x7f6be8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c03e00640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6be8004fa0 0x7f6be800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c03400640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be80039b0 0x7f6be8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02a00640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be80039b0 0x7f6be8003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02a00640 1 -- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6be8004fa0 msgr2=0x7f6be800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:44.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02a00640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6be8004fa0 0x7f6be800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.366+0000 7f6c02a00640 1 -- 172.21.15.44:0/1005874276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be8003520 con 0x7f6be80043a0 2024-03-30T13:12:44.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.367+0000 7f6c03e00640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6be8004fa0 0x7f6be800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:44.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.368+0000 7f6c02a00640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6be80043a0 0x7f6be8004880 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6bec007fd0 tx=0x7f6be8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c566e05e34905025 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:44.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.368+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec007d50 con 0x7f6be80043a0 2024-03-30T13:12:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.368+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bec030070 con 0x7f6be80043a0 2024-03-30T13:12:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.368+0000 7f6c02000640 1 -- 172.21.15.44:0/1005874276 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec005db0 con 0x7f6be80043a0 2024-03-30T13:12:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.368+0000 7f6c08a00640 1 -- 172.21.15.44:0/1005874276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6be80043a0 msgr2=0x7f6be8004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.368+0000 7f6c08a00640 1 --2- 172.21.15.44:0/1005874276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6be80043a0 0x7f6be8004880 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6bec007fd0 tx=0x7f6be8005830 comp rx=0 tx=0).stop 2024-03-30T13:12:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.368+0000 7f6c03e00640 1 -- 172.21.15.44:0/1005874276 reap_dead start 2024-03-30T13:12:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.369+0000 7f6c08a00640 1 -- 172.21.15.44:0/1005874276 shutdown_connections 2024-03-30T13:12:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.369+0000 7f6c08a00640 1 -- 172.21.15.44:0/1005874276 >> 172.21.15.44:0/1005874276 conn(0x7f6c0409d570 msgr2=0x7f6c040d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.369+0000 7f6c08a00640 1 -- 172.21.15.44:0/1005874276 shutdown_connections 2024-03-30T13:12:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.369+0000 7f6c08a00640 1 -- 172.21.15.44:0/1005874276 wait complete. 2024-03-30T13:12:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.370+0000 7f6c08a00640 1 Processor -- start 2024-03-30T13:12:44.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.371+0000 7f6c08a00640 1 -- start start 2024-03-30T13:12:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.371+0000 7f6c08a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be80043a0 0x7f6c040b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.371+0000 7f6c08a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c041591c0 0x7f6c040ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.371+0000 7f6c08a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c040ca710 0x7f6c040cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.371+0000 7f6c08a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6c040d1290 con 0x7f6c041591c0 2024-03-30T13:12:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.371+0000 7f6c08a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6c040d1110 con 0x7f6c040ca710 2024-03-30T13:12:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.371+0000 7f6c08a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6c040d1410 con 0x7f6be80043a0 2024-03-30T13:12:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.372+0000 7f6c02a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c041591c0 0x7f6c040ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.372+0000 7f6c02a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c041591c0 0x7f6c040ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40716/0 (socket says 172.21.15.44:40716) 2024-03-30T13:12:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.372+0000 7f6c02a00640 1 -- 172.21.15.44:0/2347236643 learned_addr learned my addr 172.21.15.44:0/2347236643 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:44.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.372+0000 7f6c03400640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be80043a0 0x7f6c040b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.372+0000 7f6c03e00640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c040ca710 0x7f6c040cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.372+0000 7f6c02a00640 1 -- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be80043a0 msgr2=0x7f6c040b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.372+0000 7f6c02a00640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be80043a0 0x7f6c040b7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.372+0000 7f6c02a00640 1 -- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c040ca710 msgr2=0x7f6c040cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.372+0000 7f6c02a00640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c040ca710 0x7f6c040cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.372+0000 7f6c02a00640 1 -- 172.21.15.44:0/2347236643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c040cc040 con 0x7f6c041591c0 2024-03-30T13:12:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.373+0000 7f6c02a00640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c041591c0 0x7f6c040ca1d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6bec02c5a0 tx=0x7f6c040cef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.373+0000 7f6bfb400640 1 -- 172.21.15.44:0/2347236643 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec007d50 con 0x7f6c041591c0 2024-03-30T13:12:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.373+0000 7f6bfb400640 1 -- 172.21.15.44:0/2347236643 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bec004bf0 con 0x7f6c041591c0 2024-03-30T13:12:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.373+0000 7f6bfb400640 1 -- 172.21.15.44:0/2347236643 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec007070 con 0x7f6c041591c0 2024-03-30T13:12:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.373+0000 7f6c08a00640 1 -- 172.21.15.44:0/2347236643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c040cc320 con 0x7f6c041591c0 2024-03-30T13:12:44.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.373+0000 7f6c08a00640 1 -- 172.21.15.44:0/2347236643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c040c8090 con 0x7f6c041591c0 2024-03-30T13:12:44.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.374+0000 7f6c08a00640 1 -- 172.21.15.44:0/2347236643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c04075890 con 0x7f6c041591c0 2024-03-30T13:12:44.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.375+0000 7f6bfb400640 1 -- 172.21.15.44:0/2347236643 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6bec047020 con 0x7f6c041591c0 2024-03-30T13:12:44.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.376+0000 7f6bfb400640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6be006c530 0x7f6be006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.376+0000 7f6bfb400640 1 -- 172.21.15.44:0/2347236643 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f6bec0acef0 con 0x7f6c041591c0 2024-03-30T13:12:44.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.377+0000 7f6c03400640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6be006c530 0x7f6be006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.378+0000 7f6c03400640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6be006c530 0x7f6be006e9f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6c04069040 tx=0x7f6bf400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:44.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.381+0000 7f6bfb400640 1 -- 172.21.15.44:0/2347236643 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6bec07b0e0 con 0x7f6c041591c0 2024-03-30T13:12:44.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.580+0000 7f6c08a00640 1 -- 172.21.15.44:0/2347236643 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c040b6990 con 0x7f6c041591c0 2024-03-30T13:12:44.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.582+0000 7f6bfb400640 1 -- 172.21.15.44:0/2347236643 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18927 (secure 0 0 0) 0x7f6bec07a9e0 con 0x7f6c041591c0 2024-03-30T13:12:44.586 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:44.587 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":29,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:12:27.323786+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:44.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.584+0000 7f6c08a00640 1 -- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6be006c530 msgr2=0x7f6be006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:44.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.584+0000 7f6c08a00640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6be006c530 0x7f6be006e9f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6c04069040 tx=0x7f6bf400b040 comp rx=0 tx=0).stop 2024-03-30T13:12:44.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.584+0000 7f6c08a00640 1 -- 172.21.15.44:0/2347236643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c041591c0 msgr2=0x7f6c040ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:44.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.584+0000 7f6c08a00640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c041591c0 0x7f6c040ca1d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6bec02c5a0 tx=0x7f6c040cef80 comp rx=0 tx=0).stop 2024-03-30T13:12:44.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.585+0000 7f6c08a00640 1 -- 172.21.15.44:0/2347236643 shutdown_connections 2024-03-30T13:12:44.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.585+0000 7f6c08a00640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6be006c530 0x7f6be006e9f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.585+0000 7f6c08a00640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c040ca710 0x7f6c040cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.585+0000 7f6c08a00640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6c041591c0 0x7f6c040ca1d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.585+0000 7f6c08a00640 1 --2- 172.21.15.44:0/2347236643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6be80043a0 0x7f6c040b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.585+0000 7f6c08a00640 1 -- 172.21.15.44:0/2347236643 >> 172.21.15.44:0/2347236643 conn(0x7f6c0409d570 msgr2=0x7f6c040d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:44.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.585+0000 7f6c08a00640 1 -- 172.21.15.44:0/2347236643 shutdown_connections 2024-03-30T13:12:44.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.585+0000 7f6c08a00640 1 -- 172.21.15.44:0/2347236643 wait complete. 2024-03-30T13:12:44.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:12:44.608 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:12:44.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.811+0000 7f0192000640 1 Processor -- start 2024-03-30T13:12:44.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.811+0000 7f0192000640 1 -- start start 2024-03-30T13:12:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.813+0000 7f0192000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f018c0af0e0 0x7f018c072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.813+0000 7f0192000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f018c0ad2e0 con 0x7f018c0acd60 2024-03-30T13:12:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.813+0000 7f0192000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f018c0716a0 con 0x7f018c06e980 2024-03-30T13:12:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.813+0000 7f0192000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f018c0ad5c0 con 0x7f018c0af0e0 2024-03-30T13:12:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.813+0000 7f0191600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f018c0af0e0 0x7f018c072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.814+0000 7f0191600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f018c0af0e0 0x7f018c072180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40718/0 (socket says 172.21.15.44:40718) 2024-03-30T13:12:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.814+0000 7f0191600640 1 -- 172.21.15.44:0/648801614 learned_addr learned my addr 172.21.15.44:0/648801614 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.814+0000 7f0191600640 1 -- 172.21.15.44:0/648801614 >> v1:172.21.15.151:6789/0 conn(0x7f018c06e980 legacy=0x7f018c15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.814+0000 7f0191600640 1 -- 172.21.15.44:0/648801614 >> v1:172.21.15.44:6789/0 conn(0x7f018c0acd60 legacy=0x7f018c0ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.814+0000 7f0191600640 1 -- 172.21.15.44:0/648801614 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c071980 con 0x7f018c0af0e0 2024-03-30T13:12:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.815+0000 7f0191600640 1 --2- 172.21.15.44:0/648801614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f018c0af0e0 0x7f018c072180 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0184009e50 tx=0x7f018402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178f099f01457ec7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.815+0000 7f018b400640 1 -- 172.21.15.44:0/648801614 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018402ca80 con 0x7f018c0af0e0 2024-03-30T13:12:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.815+0000 7f018b400640 1 -- 172.21.15.44:0/648801614 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018402cc20 con 0x7f018c0af0e0 2024-03-30T13:12:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.815+0000 7f018b400640 1 -- 172.21.15.44:0/648801614 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01840343f0 con 0x7f018c0af0e0 2024-03-30T13:12:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.816+0000 7f0192000640 1 -- 172.21.15.44:0/648801614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f018c0af0e0 msgr2=0x7f018c072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.816+0000 7f0192000640 1 --2- 172.21.15.44:0/648801614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f018c0af0e0 0x7f018c072180 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0184009e50 tx=0x7f018402bee0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.816+0000 7f0192000640 1 -- 172.21.15.44:0/648801614 shutdown_connections 2024-03-30T13:12:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.816+0000 7f0192000640 1 --2- 172.21.15.44:0/648801614 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f018c0af0e0 0x7f018c072180 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.816+0000 7f0192000640 1 -- 172.21.15.44:0/648801614 >> 172.21.15.44:0/648801614 conn(0x7f018c0cfd90 msgr2=0x7f018c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.816+0000 7f0192000640 1 -- 172.21.15.44:0/648801614 shutdown_connections 2024-03-30T13:12:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.816+0000 7f0192000640 1 -- 172.21.15.44:0/648801614 wait complete. 2024-03-30T13:12:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.818+0000 7f0192000640 1 Processor -- start 2024-03-30T13:12:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.818+0000 7f0192000640 1 -- start start 2024-03-30T13:12:44.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.819+0000 7f0192000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c06e980 0x7f018c0c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.819+0000 7f0192000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f018c0acd60 0x7f018c1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.819+0000 7f0192000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c0af0e0 0x7f018c14a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.819+0000 7f0192000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f018c156020 con 0x7f018c0acd60 2024-03-30T13:12:44.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.819+0000 7f0192000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f018c071450 con 0x7f018c0af0e0 2024-03-30T13:12:44.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.819+0000 7f0192000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f018c1561a0 con 0x7f018c06e980 2024-03-30T13:12:44.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.819+0000 7f018be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f018c0acd60 0x7f018c1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.819+0000 7f018be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f018c0acd60 0x7f018c1573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40734/0 (socket says 172.21.15.44:40734) 2024-03-30T13:12:44.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.819+0000 7f018be00640 1 -- 172.21.15.44:0/1696438891 learned_addr learned my addr 172.21.15.44:0/1696438891 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:44.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.820+0000 7f0190c00640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c06e980 0x7f018c0c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.820+0000 7f018be00640 1 -- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c06e980 msgr2=0x7f018c0c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:44.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.820+0000 7f018be00640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c06e980 0x7f018c0c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.820+0000 7f018be00640 1 -- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c0af0e0 msgr2=0x7f018c14a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:44.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.820+0000 7f018be00640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c0af0e0 0x7f018c14a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:44.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.820+0000 7f018be00640 1 -- 172.21.15.44:0/1696438891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c0ca310 con 0x7f018c0acd60 2024-03-30T13:12:44.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.820+0000 7f018be00640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f018c0acd60 0x7f018c1573b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f017800c440 tx=0x7f017800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:44.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.820+0000 7f0188c00640 1 -- 172.21.15.44:0/1696438891 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01780052d0 con 0x7f018c0acd60 2024-03-30T13:12:44.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.820+0000 7f0188c00640 1 -- 172.21.15.44:0/1696438891 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0178005470 con 0x7f018c0acd60 2024-03-30T13:12:44.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.820+0000 7f0192000640 1 -- 172.21.15.44:0/1696438891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018c0ca5f0 con 0x7f018c0acd60 2024-03-30T13:12:44.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.820+0000 7f0188c00640 1 -- 172.21.15.44:0/1696438891 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178012870 con 0x7f018c0acd60 2024-03-30T13:12:44.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.820+0000 7f0192000640 1 -- 172.21.15.44:0/1696438891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f018c15dc40 con 0x7f018c0acd60 2024-03-30T13:12:44.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.821+0000 7f0192000640 1 -- 172.21.15.44:0/1696438891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f018c075890 con 0x7f018c0acd60 2024-03-30T13:12:44.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.823+0000 7f0188c00640 1 -- 172.21.15.44:0/1696438891 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0178012a10 con 0x7f018c0acd60 2024-03-30T13:12:44.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.824+0000 7f0188c00640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f016c06c530 0x7f016c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:44.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.824+0000 7f0188c00640 1 -- 172.21.15.44:0/1696438891 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f017808b740 con 0x7f018c0acd60 2024-03-30T13:12:44.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.825+0000 7f0190c00640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f016c06c530 0x7f016c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:44.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.826+0000 7f0190c00640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f016c06c530 0x7f016c06e9f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0180003d90 tx=0x7f0180009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:44.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:44.829+0000 7f0188c00640 1 -- 172.21.15.44:0/1696438891 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0178059930 con 0x7f018c0acd60 2024-03-30T13:12:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.027+0000 7f0192000640 1 -- 172.21.15.44:0/1696438891 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f018c0cfb70 con 0x7f018c0acd60 2024-03-30T13:12:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.028+0000 7f0188c00640 1 -- 172.21.15.44:0/1696438891 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f0178059230 con 0x7f018c0acd60 2024-03-30T13:12:45.031 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:12:45.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.030+0000 7f0192000640 1 -- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f016c06c530 msgr2=0x7f016c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.030+0000 7f0192000640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f016c06c530 0x7f016c06e9f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0180003d90 tx=0x7f0180009040 comp rx=0 tx=0).stop 2024-03-30T13:12:45.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.030+0000 7f0192000640 1 -- 172.21.15.44:0/1696438891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f018c0acd60 msgr2=0x7f018c1573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.030+0000 7f0192000640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f018c0acd60 0x7f018c1573b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f017800c440 tx=0x7f017800c900 comp rx=0 tx=0).stop 2024-03-30T13:12:45.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.030+0000 7f0192000640 1 -- 172.21.15.44:0/1696438891 shutdown_connections 2024-03-30T13:12:45.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.030+0000 7f0192000640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f016c06c530 0x7f016c06e9f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.030+0000 7f0192000640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c0af0e0 0x7f018c14a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.030+0000 7f0192000640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f018c0acd60 0x7f018c1573b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.030+0000 7f0192000640 1 --2- 172.21.15.44:0/1696438891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c06e980 0x7f018c0c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.030+0000 7f0192000640 1 -- 172.21.15.44:0/1696438891 >> 172.21.15.44:0/1696438891 conn(0x7f018c0cfd90 msgr2=0x7f018c06d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:45.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.031+0000 7f0192000640 1 -- 172.21.15.44:0/1696438891 shutdown_connections 2024-03-30T13:12:45.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.031+0000 7f0192000640 1 -- 172.21.15.44:0/1696438891 wait complete. 2024-03-30T13:12:45.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:12:45.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.269+0000 7efe4d000640 1 Processor -- start 2024-03-30T13:12:45.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.269+0000 7efe4d000640 1 -- start start 2024-03-30T13:12:45.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.271+0000 7efe4d000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efe48071630 0x7efe48071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.271+0000 7efe4d000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe48164010 con 0x7efe48164510 2024-03-30T13:12:45.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.271+0000 7efe4d000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe480b3ec0 con 0x7efe480d0700 2024-03-30T13:12:45.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.271+0000 7efe4d000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7efe48071fe0 con 0x7efe48071630 2024-03-30T13:12:45.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.271+0000 7efe45400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efe48071630 0x7efe48071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:45.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.271+0000 7efe46800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efe48164510 0x7efe48164960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40316/0 (socket says 172.21.15.44:40316) 2024-03-30T13:12:45.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.271+0000 7efe45400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efe48071630 0x7efe48071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40746/0 (socket says 172.21.15.44:40746) 2024-03-30T13:12:45.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.271+0000 7efe46800640 1 -- 172.21.15.44:0/586013671 learned_addr learned my addr 172.21.15.44:0/586013671 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.272+0000 7efe45400640 1 -- 172.21.15.44:0/586013671 >> v1:172.21.15.151:6789/0 conn(0x7efe480d0700 legacy=0x7efe480b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.272+0000 7efe45400640 1 -- 172.21.15.44:0/586013671 >> v1:172.21.15.44:6789/0 conn(0x7efe48164510 legacy=0x7efe48164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.272+0000 7efe45400640 1 -- 172.21.15.44:0/586013671 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe480b41a0 con 0x7efe48071630 2024-03-30T13:12:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.272+0000 7efe44a00640 1 -- 172.21.15.44:0/586013671 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823639906 0 0) 0x7efe48164010 con 0x7efe48164510 2024-03-30T13:12:45.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.273+0000 7efe45400640 1 --2- 172.21.15.44:0/586013671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe48071630 0x7efe48071aa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efe340097a0 tx=0x7efe3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63e88852df28f38 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:45.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.273+0000 7efe44a00640 1 -- 172.21.15.44:0/586013671 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34035020 con 0x7efe48071630 2024-03-30T13:12:45.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.273+0000 7efe44a00640 1 -- 172.21.15.44:0/586013671 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe34031830 con 0x7efe48071630 2024-03-30T13:12:45.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.273+0000 7efe44a00640 1 -- 172.21.15.44:0/586013671 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34031c00 con 0x7efe48071630 2024-03-30T13:12:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.274+0000 7efe4d000640 1 -- 172.21.15.44:0/586013671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe48071630 msgr2=0x7efe48071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.274+0000 7efe4d000640 1 --2- 172.21.15.44:0/586013671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe48071630 0x7efe48071aa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efe340097a0 tx=0x7efe3402b8d0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.274+0000 7efe4d000640 1 -- 172.21.15.44:0/586013671 shutdown_connections 2024-03-30T13:12:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.274+0000 7efe4d000640 1 --2- 172.21.15.44:0/586013671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe48071630 0x7efe48071aa0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.274+0000 7efe4d000640 1 -- 172.21.15.44:0/586013671 >> 172.21.15.44:0/586013671 conn(0x7efe480b5b00 msgr2=0x7efe4806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.274+0000 7efe4d000640 1 -- 172.21.15.44:0/586013671 shutdown_connections 2024-03-30T13:12:45.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.274+0000 7efe4d000640 1 -- 172.21.15.44:0/586013671 wait complete. 2024-03-30T13:12:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.276+0000 7efe4d000640 1 Processor -- start 2024-03-30T13:12:45.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.276+0000 7efe4d000640 1 -- start start 2024-03-30T13:12:45.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.277+0000 7efe4d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe48071630 0x7efe48150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.277+0000 7efe4d000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe480d0700 0x7efe4815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.277+0000 7efe4d000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe48164510 0x7efe4815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.277+0000 7efe4d000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efe480b3b80 con 0x7efe48071630 2024-03-30T13:12:45.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.277+0000 7efe4d000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efe480b4760 con 0x7efe48164510 2024-03-30T13:12:45.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.277+0000 7efe4d000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7efe48163080 con 0x7efe480d0700 2024-03-30T13:12:45.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.277+0000 7efe45e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe48071630 0x7efe48150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:45.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.277+0000 7efe45e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe48071630 0x7efe48150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40750/0 (socket says 172.21.15.44:40750) 2024-03-30T13:12:45.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.277+0000 7efe45e00640 1 -- 172.21.15.44:0/280452736 learned_addr learned my addr 172.21.15.44:0/280452736 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.278+0000 7efe46800640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe48164510 0x7efe4815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.278+0000 7efe45400640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe480d0700 0x7efe4815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.278+0000 7efe45e00640 1 -- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe480d0700 msgr2=0x7efe4815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.278+0000 7efe45e00640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe480d0700 0x7efe4815c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.278+0000 7efe45e00640 1 -- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe48164510 msgr2=0x7efe4815cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.278+0000 7efe45e00640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe48164510 0x7efe4815cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.278+0000 7efe45e00640 1 -- 172.21.15.44:0/280452736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe48151970 con 0x7efe48071630 2024-03-30T13:12:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.278+0000 7efe45e00640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe48071630 0x7efe48150700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efe3800c450 tx=0x7efe3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.278+0000 7efe3e000640 1 -- 172.21.15.44:0/280452736 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe380052d0 con 0x7efe48071630 2024-03-30T13:12:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.279+0000 7efe3e000640 1 -- 172.21.15.44:0/280452736 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe38005470 con 0x7efe48071630 2024-03-30T13:12:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.279+0000 7efe4d000640 1 -- 172.21.15.44:0/280452736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4815f510 con 0x7efe48071630 2024-03-30T13:12:45.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.279+0000 7efe3e000640 1 -- 172.21.15.44:0/280452736 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe38012870 con 0x7efe48071630 2024-03-30T13:12:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.279+0000 7efe4d000640 1 -- 172.21.15.44:0/280452736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe48151cc0 con 0x7efe48071630 2024-03-30T13:12:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.280+0000 7efe4d000640 1 -- 172.21.15.44:0/280452736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe48075890 con 0x7efe48071630 2024-03-30T13:12:45.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.281+0000 7efe3e000640 1 -- 172.21.15.44:0/280452736 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7efe38012a10 con 0x7efe48071630 2024-03-30T13:12:45.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.282+0000 7efe3e000640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efe2806c530 0x7efe2806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.282+0000 7efe3e000640 1 -- 172.21.15.44:0/280452736 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7efe3808b760 con 0x7efe48071630 2024-03-30T13:12:45.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.282+0000 7efe45400640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efe2806c530 0x7efe2806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:45.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.283+0000 7efe45400640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efe2806c530 0x7efe2806e9f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efe34036000 tx=0x7efe34008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:45.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.286+0000 7efe3e000640 1 -- 172.21.15.44:0/280452736 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7efe38059950 con 0x7efe48071630 2024-03-30T13:12:45.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.493+0000 7efe4d000640 1 -- 172.21.15.44:0/280452736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efe480b0e60 con 0x7efe48071630 2024-03-30T13:12:45.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.494+0000 7efe3e000640 1 -- 172.21.15.44:0/280452736 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7efe38059250 con 0x7efe48071630 2024-03-30T13:12:45.498 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:45.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.496+0000 7efe4d000640 1 -- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efe2806c530 msgr2=0x7efe2806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.496+0000 7efe4d000640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efe2806c530 0x7efe2806e9f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efe34036000 tx=0x7efe34008030 comp rx=0 tx=0).stop 2024-03-30T13:12:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.496+0000 7efe4d000640 1 -- 172.21.15.44:0/280452736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe48071630 msgr2=0x7efe48150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.496+0000 7efe4d000640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe48071630 0x7efe48150700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efe3800c450 tx=0x7efe3800c910 comp rx=0 tx=0).stop 2024-03-30T13:12:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.496+0000 7efe4d000640 1 -- 172.21.15.44:0/280452736 shutdown_connections 2024-03-30T13:12:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.496+0000 7efe4d000640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efe2806c530 0x7efe2806e9f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.496+0000 7efe4d000640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe48164510 0x7efe4815cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.496+0000 7efe4d000640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe480d0700 0x7efe4815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.496+0000 7efe4d000640 1 --2- 172.21.15.44:0/280452736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe48071630 0x7efe48150700 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.496+0000 7efe4d000640 1 -- 172.21.15.44:0/280452736 >> 172.21.15.44:0/280452736 conn(0x7efe480b5b00 msgr2=0x7efe48164960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.497+0000 7efe4d000640 1 -- 172.21.15.44:0/280452736 shutdown_connections 2024-03-30T13:12:45.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.497+0000 7efe4d000640 1 -- 172.21.15.44:0/280452736 wait complete. 2024-03-30T13:12:45.520 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:12:45.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.732+0000 7fcf83e00640 1 Processor -- start 2024-03-30T13:12:45.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.733+0000 7fcf83e00640 1 -- start start 2024-03-30T13:12:45.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.734+0000 7fcf83e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840af0e0 0x7fcf84072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.734+0000 7fcf83e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf840ad2e0 con 0x7fcf8406e980 2024-03-30T13:12:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.734+0000 7fcf83e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf840716a0 con 0x7fcf840acd60 2024-03-30T13:12:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.734+0000 7fcf83e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcf840ad5c0 con 0x7fcf840af0e0 2024-03-30T13:12:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.735+0000 7fcf82a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcf8406e980 0x7fcf8415d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40328/0 (socket says 172.21.15.44:40328) 2024-03-30T13:12:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.735+0000 7fcf82a00640 1 -- 172.21.15.44:0/690482065 learned_addr learned my addr 172.21.15.44:0/690482065 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.735+0000 7fcf83400640 1 --2- 172.21.15.44:0/690482065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840af0e0 0x7fcf84072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.735+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1718683857 0 0) 0x7fcf840ad2e0 con 0x7fcf8406e980 2024-03-30T13:12:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.735+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf68003520 con 0x7fcf8406e980 2024-03-30T13:12:45.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3323502897 0 0) 0x7fcf68003520 con 0x7fcf8406e980 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840af0e0 msgr2=0x7fcf84072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 --2- 172.21.15.44:0/690482065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840af0e0 0x7fcf84072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 >> v1:172.21.15.151:6789/0 conn(0x7fcf840acd60 legacy=0x7fcf840ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf84071980 con 0x7fcf8406e980 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fcf74001670 con 0x7fcf8406e980 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 >> v1:172.21.15.44:6789/0 conn(0x7fcf8406e980 legacy=0x7fcf8415d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 --2- 172.21.15.44:0/690482065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf680039e0 0x7fcf68003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 --2- 172.21.15.44:0/690482065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840af0e0 0x7fcf68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 --2- 172.21.15.44:0/690482065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf68004d40 0x7fcf680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6800bb50 con 0x7fcf68004d40 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6800bd00 con 0x7fcf680039e0 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6800bf00 con 0x7fcf840af0e0 2024-03-30T13:12:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf83400640 1 --2- 172.21.15.44:0/690482065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf68004d40 0x7fcf680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:45.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf82a00640 1 --2- 172.21.15.44:0/690482065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf680039e0 0x7fcf68003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:45.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf83400640 1 -- 172.21.15.44:0/690482065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840af0e0 msgr2=0x7fcf68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:45.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.736+0000 7fcf83400640 1 --2- 172.21.15.44:0/690482065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840af0e0 0x7fcf68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.737+0000 7fcf83400640 1 -- 172.21.15.44:0/690482065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf680039e0 msgr2=0x7fcf68003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:45.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.737+0000 7fcf83400640 1 --2- 172.21.15.44:0/690482065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf680039e0 0x7fcf68003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.737+0000 7fcf83400640 1 -- 172.21.15.44:0/690482065 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf68003520 con 0x7fcf68004d40 2024-03-30T13:12:45.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.738+0000 7fcf83400640 1 --2- 172.21.15.44:0/690482065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf68004d40 0x7fcf680051c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009fc0 tx=0x7fcf68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9e89038ff1bbba server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:45.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.738+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c039070 con 0x7fcf68004d40 2024-03-30T13:12:45.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.738+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7c02cc60 con 0x7fcf68004d40 2024-03-30T13:12:45.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.738+0000 7fcf82000640 1 -- 172.21.15.44:0/690482065 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c009c10 con 0x7fcf68004d40 2024-03-30T13:12:45.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.739+0000 7fcf83e00640 1 -- 172.21.15.44:0/690482065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf68004d40 msgr2=0x7fcf680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.739+0000 7fcf83e00640 1 --2- 172.21.15.44:0/690482065 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf68004d40 0x7fcf680051c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009fc0 tx=0x7fcf68005830 comp rx=0 tx=0).stop 2024-03-30T13:12:45.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.739+0000 7fcf83400640 1 -- 172.21.15.44:0/690482065 reap_dead start 2024-03-30T13:12:45.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.739+0000 7fcf83e00640 1 -- 172.21.15.44:0/690482065 shutdown_connections 2024-03-30T13:12:45.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.739+0000 7fcf83e00640 1 -- 172.21.15.44:0/690482065 >> 172.21.15.44:0/690482065 conn(0x7fcf840cfd90 msgr2=0x7fcf840d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:45.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.739+0000 7fcf83e00640 1 -- 172.21.15.44:0/690482065 shutdown_connections 2024-03-30T13:12:45.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.739+0000 7fcf83e00640 1 -- 172.21.15.44:0/690482065 wait complete. 2024-03-30T13:12:45.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.741+0000 7fcf83e00640 1 Processor -- start 2024-03-30T13:12:45.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.741+0000 7fcf83e00640 1 -- start start 2024-03-30T13:12:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.742+0000 7fcf83e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf68004d40 0x7fcf840cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.742+0000 7fcf83e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840b40b0 0x7fcf840b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.742+0000 7fcf83e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf840ce780 0x7fcf840cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.742+0000 7fcf83e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcf84072180 con 0x7fcf68004d40 2024-03-30T13:12:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.742+0000 7fcf83e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcf84071450 con 0x7fcf840ce780 2024-03-30T13:12:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.742+0000 7fcf83e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcf84072300 con 0x7fcf840b40b0 2024-03-30T13:12:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.742+0000 7fcf82a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf68004d40 0x7fcf840cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.742+0000 7fcf82a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf68004d40 0x7fcf840cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40762/0 (socket says 172.21.15.44:40762) 2024-03-30T13:12:45.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.742+0000 7fcf82a00640 1 -- 172.21.15.44:0/3469780313 learned_addr learned my addr 172.21.15.44:0/3469780313 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:45.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.742+0000 7fcf83400640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf840ce780 0x7fcf840cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:45.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.742+0000 7fcf7be00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840b40b0 0x7fcf840b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.742+0000 7fcf82a00640 1 -- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840b40b0 msgr2=0x7fcf840b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.743+0000 7fcf82a00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840b40b0 0x7fcf840b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.743+0000 7fcf82a00640 1 -- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf840ce780 msgr2=0x7fcf840cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.743+0000 7fcf82a00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf840ce780 0x7fcf840cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.743+0000 7fcf82a00640 1 -- 172.21.15.44:0/3469780313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf840c9180 con 0x7fcf68004d40 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.743+0000 7fcf83400640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf840ce780 0x7fcf840cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.743+0000 7fcf7be00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840b40b0 0x7fcf840b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.743+0000 7fcf82a00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf68004d40 0x7fcf840cab30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400d840 tx=0x7fcf7400dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.743+0000 7fcf7aa00640 1 -- 172.21.15.44:0/3469780313 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf74019070 con 0x7fcf68004d40 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.743+0000 7fcf7aa00640 1 -- 172.21.15.44:0/3469780313 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf74007560 con 0x7fcf68004d40 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.743+0000 7fcf7aa00640 1 -- 172.21.15.44:0/3469780313 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf74004a00 con 0x7fcf68004d40 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.743+0000 7fcf83e00640 1 -- 172.21.15.44:0/3469780313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf840c9460 con 0x7fcf68004d40 2024-03-30T13:12:45.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.743+0000 7fcf83e00640 1 -- 172.21.15.44:0/3469780313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf840c9a20 con 0x7fcf68004d40 2024-03-30T13:12:45.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.745+0000 7fcf83e00640 1 -- 172.21.15.44:0/3469780313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf8415ad90 con 0x7fcf68004d40 2024-03-30T13:12:45.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.746+0000 7fcf7aa00640 1 -- 172.21.15.44:0/3469780313 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcf7401c070 con 0x7fcf68004d40 2024-03-30T13:12:45.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.746+0000 7fcf7aa00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcf6006c560 0x7fcf6006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:45.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.747+0000 7fcf7aa00640 1 -- 172.21.15.44:0/3469780313 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fcf7408b500 con 0x7fcf68004d40 2024-03-30T13:12:45.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.747+0000 7fcf7be00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcf6006c560 0x7fcf6006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:45.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.748+0000 7fcf7be00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcf6006c560 0x7fcf6006ea20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcf8409e0b0 tx=0x7fcf6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:45.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.751+0000 7fcf7aa00640 1 -- 172.21.15.44:0/3469780313 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fcf740508e0 con 0x7fcf68004d40 2024-03-30T13:12:45.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.960+0000 7fcf83e00640 1 -- 172.21.15.44:0/3469780313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcf84075890 con 0x7fcf68004d40 2024-03-30T13:12:45.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.960+0000 7fcf7aa00640 1 -- 172.21.15.44:0/3469780313 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fcf8415ad90 con 0x7fcf68004d40 2024-03-30T13:12:45.964 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:12:45.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.963+0000 7fcf83e00640 1 -- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcf6006c560 msgr2=0x7fcf6006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.963+0000 7fcf83e00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcf6006c560 0x7fcf6006ea20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcf8409e0b0 tx=0x7fcf6c009040 comp rx=0 tx=0).stop 2024-03-30T13:12:45.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.963+0000 7fcf83e00640 1 -- 172.21.15.44:0/3469780313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf68004d40 msgr2=0x7fcf840cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:45.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.963+0000 7fcf83e00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf68004d40 0x7fcf840cab30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400d840 tx=0x7fcf7400dd00 comp rx=0 tx=0).stop 2024-03-30T13:12:45.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.963+0000 7fcf83e00640 1 -- 172.21.15.44:0/3469780313 shutdown_connections 2024-03-30T13:12:45.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.963+0000 7fcf83e00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcf6006c560 0x7fcf6006ea20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.963+0000 7fcf83e00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf840ce780 0x7fcf840cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.963+0000 7fcf83e00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf840b40b0 0x7fcf840b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.963+0000 7fcf83e00640 1 --2- 172.21.15.44:0/3469780313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf68004d40 0x7fcf840cab30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:45.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.963+0000 7fcf83e00640 1 -- 172.21.15.44:0/3469780313 >> 172.21.15.44:0/3469780313 conn(0x7fcf840cfd90 msgr2=0x7fcf840d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:45.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.963+0000 7fcf83e00640 1 -- 172.21.15.44:0/3469780313 shutdown_connections 2024-03-30T13:12:45.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:45.963+0000 7fcf83e00640 1 -- 172.21.15.44:0/3469780313 wait complete. 2024-03-30T13:12:45.986 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:12:46.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.204+0000 7fe2bbe00640 1 Processor -- start 2024-03-30T13:12:46.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.204+0000 7fe2bbe00640 1 -- start start 2024-03-30T13:12:46.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.206+0000 7fe2bbe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe2b413f0c0 0x7fe2b406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.206+0000 7fe2bbe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2b41605a0 0x7fe2b40cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.206+0000 7fe2bbe00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b40ce9c0 con 0x7fe2b406d720 2024-03-30T13:12:46.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.206+0000 7fe2bbe00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe2b4160e30 con 0x7fe2b413f0c0 2024-03-30T13:12:46.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.206+0000 7fe2bbe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b4160b50 con 0x7fe2b41605a0 2024-03-30T13:12:46.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.206+0000 7fe2b9400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe2b413f0c0 0x7fe2b406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:46.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.206+0000 7fe2b9400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe2b413f0c0 0x7fe2b406d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40774/0 (socket says 172.21.15.44:40774) 2024-03-30T13:12:46.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.206+0000 7fe2b9400640 1 -- 172.21.15.44:0/1020464887 learned_addr learned my addr 172.21.15.44:0/1020464887 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:46.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.207+0000 7fe2b9400640 1 -- 172.21.15.44:0/1020464887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2b41605a0 msgr2=0x7fe2b40cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:46.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.207+0000 7fe2b9400640 1 --2- 172.21.15.44:0/1020464887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2b41605a0 0x7fe2b40cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.207+0000 7fe2b9400640 1 -- 172.21.15.44:0/1020464887 >> v1:172.21.15.151:6789/0 conn(0x7fe2b406d720 legacy=0x7fe2b415fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:46.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.207+0000 7fe2b9400640 1 -- 172.21.15.44:0/1020464887 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b413fa40 con 0x7fe2b413f0c0 2024-03-30T13:12:46.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.208+0000 7fe2b9400640 1 --2- 172.21.15.44:0/1020464887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b413f0c0 0x7fe2b406d1e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe2b406e2b0 tx=0x7fe2a802b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da02eecf051064f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.208+0000 7fe2b3e00640 1 -- 172.21.15.44:0/1020464887 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8038070 con 0x7fe2b413f0c0 2024-03-30T13:12:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.208+0000 7fe2b3e00640 1 -- 172.21.15.44:0/1020464887 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a8033620 con 0x7fe2b413f0c0 2024-03-30T13:12:46.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.208+0000 7fe2b3e00640 1 -- 172.21.15.44:0/1020464887 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80339f0 con 0x7fe2b413f0c0 2024-03-30T13:12:46.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.209+0000 7fe2bbe00640 1 -- 172.21.15.44:0/1020464887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b413f0c0 msgr2=0x7fe2b406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:46.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.209+0000 7fe2bbe00640 1 --2- 172.21.15.44:0/1020464887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b413f0c0 0x7fe2b406d1e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe2b406e2b0 tx=0x7fe2a802b7d0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.209+0000 7fe2bbe00640 1 -- 172.21.15.44:0/1020464887 shutdown_connections 2024-03-30T13:12:46.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.209+0000 7fe2bbe00640 1 --2- 172.21.15.44:0/1020464887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2b41605a0 0x7fe2b40cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.209+0000 7fe2bbe00640 1 --2- 172.21.15.44:0/1020464887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b413f0c0 0x7fe2b406d1e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.209+0000 7fe2bbe00640 1 -- 172.21.15.44:0/1020464887 >> 172.21.15.44:0/1020464887 conn(0x7fe2b40b5b00 msgr2=0x7fe2b406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:46.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.209+0000 7fe2bbe00640 1 -- 172.21.15.44:0/1020464887 shutdown_connections 2024-03-30T13:12:46.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.209+0000 7fe2bbe00640 1 -- 172.21.15.44:0/1020464887 wait complete. 2024-03-30T13:12:46.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.211+0000 7fe2bbe00640 1 Processor -- start 2024-03-30T13:12:46.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.211+0000 7fe2bbe00640 1 -- start start 2024-03-30T13:12:46.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.212+0000 7fe2bbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b406d720 0x7fe2b40b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.212+0000 7fe2bbe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2b413f0c0 0x7fe2b4072a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.212+0000 7fe2bbe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2b41605a0 0x7fe2b4072f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.212+0000 7fe2bbe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b413f4a0 con 0x7fe2b406d720 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.212+0000 7fe2bbe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4140000 con 0x7fe2b41605a0 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.212+0000 7fe2bbe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b413f620 con 0x7fe2b413f0c0 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.212+0000 7fe2b9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b406d720 0x7fe2b40b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.212+0000 7fe2b9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b406d720 0x7fe2b40b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40788/0 (socket says 172.21.15.44:40788) 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.212+0000 7fe2b9400640 1 -- 172.21.15.44:0/995438579 learned_addr learned my addr 172.21.15.44:0/995438579 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.213+0000 7fe2b9400640 1 -- 172.21.15.44:0/995438579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2b413f0c0 msgr2=0x7fe2b4072a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.213+0000 7fe2b9400640 1 --2- 172.21.15.44:0/995438579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2b413f0c0 0x7fe2b4072a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.213+0000 7fe2b9400640 1 -- 172.21.15.44:0/995438579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2b41605a0 msgr2=0x7fe2b4072f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.213+0000 7fe2b9400640 1 --2- 172.21.15.44:0/995438579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2b41605a0 0x7fe2b4072f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.213+0000 7fe2b9400640 1 -- 172.21.15.44:0/995438579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b413e770 con 0x7fe2b406d720 2024-03-30T13:12:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.213+0000 7fe2b9400640 1 --2- 172.21.15.44:0/995438579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b406d720 0x7fe2b40b45f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009960 tx=0x7fe2a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:46.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.213+0000 7fe2b1600640 1 -- 172.21.15.44:0/995438579 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8043070 con 0x7fe2b406d720 2024-03-30T13:12:46.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.213+0000 7fe2b1600640 1 -- 172.21.15.44:0/995438579 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a803f950 con 0x7fe2b406d720 2024-03-30T13:12:46.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.213+0000 7fe2bbe00640 1 -- 172.21.15.44:0/995438579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b413d360 con 0x7fe2b406d720 2024-03-30T13:12:46.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.213+0000 7fe2b1600640 1 -- 172.21.15.44:0/995438579 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8038040 con 0x7fe2b406d720 2024-03-30T13:12:46.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.214+0000 7fe2bbe00640 1 -- 172.21.15.44:0/995438579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b413d920 con 0x7fe2b406d720 2024-03-30T13:12:46.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.215+0000 7fe2bbe00640 1 -- 172.21.15.44:0/995438579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b4075890 con 0x7fe2b406d720 2024-03-30T13:12:46.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.215+0000 7fe2b1600640 1 -- 172.21.15.44:0/995438579 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe2a8046070 con 0x7fe2b406d720 2024-03-30T13:12:46.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.216+0000 7fe2b1600640 1 --2- 172.21.15.44:0/995438579 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe29406c530 0x7fe29406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.216+0000 7fe2b1600640 1 -- 172.21.15.44:0/995438579 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fe2a80ad830 con 0x7fe2b406d720 2024-03-30T13:12:46.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.217+0000 7fe2b8a00640 1 --2- 172.21.15.44:0/995438579 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe29406c530 0x7fe29406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:46.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.218+0000 7fe2b8a00640 1 --2- 172.21.15.44:0/995438579 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe29406c530 0x7fe29406e9f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4155bc0 tx=0x7fe2a0006ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:46.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.221+0000 7fe2b1600640 1 -- 172.21.15.44:0/995438579 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe2b40ce9c0 con 0x7fe2b406d720 2024-03-30T13:12:46.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.421+0000 7fe2bbe00640 1 -- 172.21.15.44:0/995438579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe2b40b3f30 con 0x7fe2b406d720 2024-03-30T13:12:46.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.422+0000 7fe2b1600640 1 -- 172.21.15.44:0/995438579 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fe2a807b9a0 con 0x7fe2b406d720 2024-03-30T13:12:46.426 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:46.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.425+0000 7fe2bbe00640 1 -- 172.21.15.44:0/995438579 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe29406c530 msgr2=0x7fe29406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:46.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.425+0000 7fe2bbe00640 1 --2- 172.21.15.44:0/995438579 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe29406c530 0x7fe29406e9f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4155bc0 tx=0x7fe2a0006ba0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.425+0000 7fe2bbe00640 1 -- 172.21.15.44:0/995438579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b406d720 msgr2=0x7fe2b40b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:46.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.425+0000 7fe2bbe00640 1 --2- 172.21.15.44:0/995438579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b406d720 0x7fe2b40b45f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009960 tx=0x7fe2a80046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.425+0000 7fe2bbe00640 1 -- 172.21.15.44:0/995438579 shutdown_connections 2024-03-30T13:12:46.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.425+0000 7fe2bbe00640 1 --2- 172.21.15.44:0/995438579 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe29406c530 0x7fe29406e9f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.425+0000 7fe2bbe00640 1 --2- 172.21.15.44:0/995438579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2b41605a0 0x7fe2b4072f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.425+0000 7fe2bbe00640 1 --2- 172.21.15.44:0/995438579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2b413f0c0 0x7fe2b4072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.425+0000 7fe2bbe00640 1 --2- 172.21.15.44:0/995438579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2b406d720 0x7fe2b40b45f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.425+0000 7fe2bbe00640 1 -- 172.21.15.44:0/995438579 >> 172.21.15.44:0/995438579 conn(0x7fe2b40b5b00 msgr2=0x7fe2b40d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:46.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.425+0000 7fe2bbe00640 1 -- 172.21.15.44:0/995438579 shutdown_connections 2024-03-30T13:12:46.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.425+0000 7fe2bbe00640 1 -- 172.21.15.44:0/995438579 wait complete. 2024-03-30T13:12:46.450 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:46.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.668+0000 7f9d8f000640 1 Processor -- start 2024-03-30T13:12:46.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.669+0000 7f9d8f000640 1 -- start start 2024-03-30T13:12:46.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.670+0000 7f9d8f000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9d88161e70 0x7f9d880b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.670+0000 7f9d8f000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d880b5b60 con 0x7f9d880d0d30 2024-03-30T13:12:46.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.670+0000 7f9d8f000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d880d4fc0 con 0x7f9d880d4950 2024-03-30T13:12:46.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.670+0000 7f9d8f000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f9d880c7b90 con 0x7f9d88161e70 2024-03-30T13:12:46.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.671+0000 7f9d8dc00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f9d880d0d30 0x7f9d880cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40340/0 (socket says 172.21.15.44:40340) 2024-03-30T13:12:46.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.671+0000 7f9d8dc00640 1 -- 172.21.15.44:0/3842722774 learned_addr learned my addr 172.21.15.44:0/3842722774 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:46.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.671+0000 7f9d8e600640 1 --2- 172.21.15.44:0/3842722774 >> v2:172.21.15.151:3300/0 conn(0x7f9d88161e70 0x7f9d880b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:46.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.671+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 143907792 0 0) 0x7f9d880b5b60 con 0x7f9d880d0d30 2024-03-30T13:12:46.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.671+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d70003520 con 0x7f9d880d0d30 2024-03-30T13:12:46.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 931010515 0 0) 0x7f9d70003520 con 0x7f9d880d0d30 2024-03-30T13:12:46.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 >> v2:172.21.15.151:3300/0 conn(0x7f9d88161e70 msgr2=0x7f9d880b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:46.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 --2- 172.21.15.44:0/3842722774 >> v2:172.21.15.151:3300/0 conn(0x7f9d88161e70 0x7f9d880b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 >> v1:172.21.15.151:6789/0 conn(0x7f9d880d4950 legacy=0x7f9d88161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:46.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d880b57f0 con 0x7f9d880d0d30 2024-03-30T13:12:46.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f9d7c001670 con 0x7f9d880d0d30 2024-03-30T13:12:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 >> v1:172.21.15.44:6789/0 conn(0x7f9d880d0d30 legacy=0x7f9d880cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 --2- 172.21.15.44:0/3842722774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d70003a00 0x7f9d70003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 --2- 172.21.15.44:0/3842722774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d70004800 0x7f9d70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 --2- 172.21.15.44:0/3842722774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d700051c0 0x7f9d7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d880c7b90 con 0x7f9d70004800 2024-03-30T13:12:46.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7000c0c0 con 0x7f9d70003a00 2024-03-30T13:12:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7000c2c0 con 0x7f9d700051c0 2024-03-30T13:12:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d8d200640 1 --2- 172.21.15.44:0/3842722774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d70004800 0x7f9d70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:46.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.672+0000 7f9d8dc00640 1 --2- 172.21.15.44:0/3842722774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d70003a00 0x7f9d70003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.673+0000 7f9d8d200640 1 -- 172.21.15.44:0/3842722774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d700051c0 msgr2=0x7f9d7000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.673+0000 7f9d8e600640 1 --2- 172.21.15.44:0/3842722774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d700051c0 0x7f9d7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.673+0000 7f9d8d200640 1 --2- 172.21.15.44:0/3842722774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d700051c0 0x7f9d7000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.673+0000 7f9d8d200640 1 -- 172.21.15.44:0/3842722774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d70003a00 msgr2=0x7f9d70003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.673+0000 7f9d8d200640 1 --2- 172.21.15.44:0/3842722774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d70003a00 0x7f9d70003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.673+0000 7f9d8d200640 1 -- 172.21.15.44:0/3842722774 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d70003520 con 0x7f9d70004800 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.673+0000 7f9d8e600640 1 -- 172.21.15.44:0/3842722774 reap_dead start 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.674+0000 7f9d8d200640 1 --2- 172.21.15.44:0/3842722774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d70004800 0x7f9d70004c80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9d74001720 tx=0x7f9d70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfb3de9a75215c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.674+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74001370 con 0x7f9d70004800 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.674+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d740052d0 con 0x7f9d70004800 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.674+0000 7f9d87e00640 1 -- 172.21.15.44:0/3842722774 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74003830 con 0x7f9d70004800 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.675+0000 7f9d8f000640 1 -- 172.21.15.44:0/3842722774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d70004800 msgr2=0x7f9d70004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:46.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.675+0000 7f9d8f000640 1 --2- 172.21.15.44:0/3842722774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d70004800 0x7f9d70004c80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9d74001720 tx=0x7f9d70005830 comp rx=0 tx=0).stop 2024-03-30T13:12:46.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.675+0000 7f9d8f000640 1 -- 172.21.15.44:0/3842722774 shutdown_connections 2024-03-30T13:12:46.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.675+0000 7f9d8f000640 1 --2- 172.21.15.44:0/3842722774 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d70004800 0x7f9d70004c80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.675+0000 7f9d8f000640 1 -- 172.21.15.44:0/3842722774 >> 172.21.15.44:0/3842722774 conn(0x7f9d8809d570 msgr2=0x7f9d880d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:46.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.675+0000 7f9d8f000640 1 -- 172.21.15.44:0/3842722774 shutdown_connections 2024-03-30T13:12:46.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.675+0000 7f9d8f000640 1 -- 172.21.15.44:0/3842722774 wait complete. 2024-03-30T13:12:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.677+0000 7f9d8f000640 1 Processor -- start 2024-03-30T13:12:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.677+0000 7f9d8f000640 1 -- start start 2024-03-30T13:12:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8f000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d70004800 0x7f9d8814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8f000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d880cce20 0x7f9d880cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8f000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d880b15c0 0x7f9d880b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8f000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9d880d1290 con 0x7f9d880b15c0 2024-03-30T13:12:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8f000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9d880d1110 con 0x7f9d880cce20 2024-03-30T13:12:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8f000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f9d880d1410 con 0x7f9d70004800 2024-03-30T13:12:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8e600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d880b15c0 0x7f9d880b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8e600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d880b15c0 0x7f9d880b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40808/0 (socket says 172.21.15.44:40808) 2024-03-30T13:12:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8e600640 1 -- 172.21.15.44:0/3120935696 learned_addr learned my addr 172.21.15.44:0/3120935696 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8dc00640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d70004800 0x7f9d8814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8d200640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d880cce20 0x7f9d880cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8e600640 1 -- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d70004800 msgr2=0x7f9d8814f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8e600640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d70004800 0x7f9d8814f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8e600640 1 -- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d880cce20 msgr2=0x7f9d880cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8e600640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d880cce20 0x7f9d880cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.678+0000 7f9d8e600640 1 -- 172.21.15.44:0/3120935696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d881500e0 con 0x7f9d880b15c0 2024-03-30T13:12:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.679+0000 7f9d8e600640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d880b15c0 0x7f9d880b1a40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009fd0 tx=0x7f9d8000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.679+0000 7f9d85600640 1 -- 172.21.15.44:0/3120935696 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80016420 con 0x7f9d880b15c0 2024-03-30T13:12:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.679+0000 7f9d85600640 1 -- 172.21.15.44:0/3120935696 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d8001b070 con 0x7f9d880b15c0 2024-03-30T13:12:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.679+0000 7f9d85600640 1 -- 172.21.15.44:0/3120935696 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80016800 con 0x7f9d880b15c0 2024-03-30T13:12:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.679+0000 7f9d8f000640 1 -- 172.21.15.44:0/3120935696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d880cd8c0 con 0x7f9d880b15c0 2024-03-30T13:12:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.679+0000 7f9d8f000640 1 -- 172.21.15.44:0/3120935696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d880cde80 con 0x7f9d880b15c0 2024-03-30T13:12:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.680+0000 7f9d8f000640 1 -- 172.21.15.44:0/3120935696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d881502b0 con 0x7f9d880b15c0 2024-03-30T13:12:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.681+0000 7f9d85600640 1 -- 172.21.15.44:0/3120935696 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9d800169a0 con 0x7f9d880b15c0 2024-03-30T13:12:46.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.682+0000 7f9d85600640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9d6806c530 0x7f9d6806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.682+0000 7f9d85600640 1 -- 172.21.15.44:0/3120935696 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f9d8008c690 con 0x7f9d880b15c0 2024-03-30T13:12:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.683+0000 7f9d8dc00640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9d6806c530 0x7f9d6806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.684+0000 7f9d8dc00640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9d6806c530 0x7f9d6806e9f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c001050 tx=0x7f9d7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:46.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.687+0000 7f9d85600640 1 -- 172.21.15.44:0/3120935696 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9d80024020 con 0x7f9d880b15c0 2024-03-30T13:12:46.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.890+0000 7f9d8f000640 1 -- 172.21.15.44:0/3120935696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d88075890 con 0x7f9d880b15c0 2024-03-30T13:12:46.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.893+0000 7f9d85600640 1 -- 172.21.15.44:0/3120935696 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18927 (secure 0 0 0) 0x7f9d8005a880 con 0x7f9d880b15c0 2024-03-30T13:12:46.897 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:46.897 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":29,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:12:27.323786+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:46.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.895+0000 7f9d8f000640 1 -- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9d6806c530 msgr2=0x7f9d6806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:46.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.895+0000 7f9d8f000640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9d6806c530 0x7f9d6806e9f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c001050 tx=0x7f9d7c009040 comp rx=0 tx=0).stop 2024-03-30T13:12:46.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.895+0000 7f9d8f000640 1 -- 172.21.15.44:0/3120935696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d880b15c0 msgr2=0x7f9d880b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:46.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.895+0000 7f9d8f000640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d880b15c0 0x7f9d880b1a40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9d80009fd0 tx=0x7f9d8000f520 comp rx=0 tx=0).stop 2024-03-30T13:12:46.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.896+0000 7f9d8f000640 1 -- 172.21.15.44:0/3120935696 shutdown_connections 2024-03-30T13:12:46.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.896+0000 7f9d8f000640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9d880b15c0 0x7f9d880b1a40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.896+0000 7f9d8f000640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9d6806c530 0x7f9d6806e9f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.896+0000 7f9d8f000640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d880cce20 0x7f9d880cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.896+0000 7f9d8f000640 1 --2- 172.21.15.44:0/3120935696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d70004800 0x7f9d8814f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:46.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.896+0000 7f9d8f000640 1 -- 172.21.15.44:0/3120935696 >> 172.21.15.44:0/3120935696 conn(0x7f9d8809d570 msgr2=0x7f9d880b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:46.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.896+0000 7f9d8f000640 1 -- 172.21.15.44:0/3120935696 shutdown_connections 2024-03-30T13:12:46.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:46.896+0000 7f9d8f000640 1 -- 172.21.15.44:0/3120935696 wait complete. 2024-03-30T13:12:46.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:12:46.922 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:12:47.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.136+0000 7f6e21c00640 1 Processor -- start 2024-03-30T13:12:47.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.137+0000 7f6e21c00640 1 -- start start 2024-03-30T13:12:47.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.138+0000 7f6e21c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c1605a0 0x7f6e1c0cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.138+0000 7f6e21c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e1c0ce9c0 con 0x7f6e1c06d8f0 2024-03-30T13:12:47.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.138+0000 7f6e21c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e1c160b50 con 0x7f6e1c13f0c0 2024-03-30T13:12:47.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.138+0000 7f6e21c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1c160e30 con 0x7f6e1c1605a0 2024-03-30T13:12:47.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.139+0000 7f6e1a000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6e1c06d8f0 0x7f6e1c15fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40390/0 (socket says 172.21.15.44:40390) 2024-03-30T13:12:47.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.139+0000 7f6e1a000640 1 -- 172.21.15.44:0/1207342648 learned_addr learned my addr 172.21.15.44:0/1207342648 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:47.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.139+0000 7f6e1b400640 1 --2- 172.21.15.44:0/1207342648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c1605a0 0x7f6e1c0cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.139+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1846317383 0 0) 0x7f6e0c001490 con 0x7f6e1c06d8f0 2024-03-30T13:12:47.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.139+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e00003520 con 0x7f6e1c06d8f0 2024-03-30T13:12:47.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2043378110 0 0) 0x7f6e00003520 con 0x7f6e1c06d8f0 2024-03-30T13:12:47.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c1605a0 msgr2=0x7f6e1c0cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:47.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 --2- 172.21.15.44:0/1207342648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c1605a0 0x7f6e1c0cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 >> v1:172.21.15.151:6789/0 conn(0x7f6e1c13f0c0 legacy=0x7f6e1c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:47.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1c13fa40 con 0x7f6e1c06d8f0 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f6e0c001be0 con 0x7f6e1c06d8f0 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 >> v1:172.21.15.44:6789/0 conn(0x7f6e1c06d8f0 legacy=0x7f6e1c15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 --2- 172.21.15.44:0/1207342648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e000039e0 0x7f6e00003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 --2- 172.21.15.44:0/1207342648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e00004800 0x7f6e00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 --2- 172.21.15.44:0/1207342648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c1605a0 0x7f6e00005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c160e30 con 0x7f6e000039e0 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0000bbb0 con 0x7f6e00004800 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6e0000bdb0 con 0x7f6e1c1605a0 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e1aa00640 1 --2- 172.21.15.44:0/1207342648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e000039e0 0x7f6e00003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e1aa00640 1 -- 172.21.15.44:0/1207342648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c1605a0 msgr2=0x7f6e00005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e1aa00640 1 --2- 172.21.15.44:0/1207342648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c1605a0 0x7f6e00005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e1aa00640 1 -- 172.21.15.44:0/1207342648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e00004800 msgr2=0x7f6e00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e1a000640 1 --2- 172.21.15.44:0/1207342648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e00004800 0x7f6e00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e1aa00640 1 --2- 172.21.15.44:0/1207342648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e00004800 0x7f6e00004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.140+0000 7f6e1aa00640 1 -- 172.21.15.44:0/1207342648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e00003520 con 0x7f6e000039e0 2024-03-30T13:12:47.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.142+0000 7f6e1aa00640 1 --2- 172.21.15.44:0/1207342648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e000039e0 0x7f6e00003e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6e04001750 tx=0x7f6e00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b992d495ca968a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:47.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.142+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04001370 con 0x7f6e000039e0 2024-03-30T13:12:47.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.142+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e040052d0 con 0x7f6e000039e0 2024-03-30T13:12:47.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.142+0000 7f6e19600640 1 -- 172.21.15.44:0/1207342648 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e04003830 con 0x7f6e000039e0 2024-03-30T13:12:47.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.142+0000 7f6e21c00640 1 -- 172.21.15.44:0/1207342648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e000039e0 msgr2=0x7f6e00003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:47.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.142+0000 7f6e21c00640 1 --2- 172.21.15.44:0/1207342648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e000039e0 0x7f6e00003e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6e04001750 tx=0x7f6e00005830 comp rx=0 tx=0).stop 2024-03-30T13:12:47.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.142+0000 7f6e1b400640 1 -- 172.21.15.44:0/1207342648 reap_dead start 2024-03-30T13:12:47.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.142+0000 7f6e21c00640 1 -- 172.21.15.44:0/1207342648 shutdown_connections 2024-03-30T13:12:47.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.142+0000 7f6e21c00640 1 -- 172.21.15.44:0/1207342648 >> 172.21.15.44:0/1207342648 conn(0x7f6e1c0b5b00 msgr2=0x7f6e1c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:47.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.143+0000 7f6e21c00640 1 -- 172.21.15.44:0/1207342648 shutdown_connections 2024-03-30T13:12:47.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.143+0000 7f6e21c00640 1 -- 172.21.15.44:0/1207342648 wait complete. 2024-03-30T13:12:47.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.144+0000 7f6e21c00640 1 Processor -- start 2024-03-30T13:12:47.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.144+0000 7f6e21c00640 1 -- start start 2024-03-30T13:12:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.145+0000 7f6e21c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e000039e0 0x7f6e1c139020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.145+0000 7f6e21c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c0afa10 0x7f6e1c141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.145+0000 7f6e21c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c141590 0x7f6e1c13b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.145+0000 7f6e21c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c13f4a0 con 0x7f6e1c141590 2024-03-30T13:12:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.145+0000 7f6e21c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c140000 con 0x7f6e000039e0 2024-03-30T13:12:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.145+0000 7f6e21c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1c13f620 con 0x7f6e1c0afa10 2024-03-30T13:12:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.146+0000 7f6e1b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c141590 0x7f6e1c13b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.146+0000 7f6e1b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c141590 0x7f6e1c13b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37042/0 (socket says 172.21.15.44:37042) 2024-03-30T13:12:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.146+0000 7f6e1b400640 1 -- 172.21.15.44:0/65785909 learned_addr learned my addr 172.21.15.44:0/65785909 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.146+0000 7f6e1a000640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c0afa10 0x7f6e1c141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.146+0000 7f6e1aa00640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e000039e0 0x7f6e1c139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.146+0000 7f6e1b400640 1 -- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c0afa10 msgr2=0x7f6e1c141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:47.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.146+0000 7f6e1b400640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c0afa10 0x7f6e1c141050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.146+0000 7f6e1b400640 1 -- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e000039e0 msgr2=0x7f6e1c139020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:47.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.146+0000 7f6e1b400640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e000039e0 0x7f6e1c139020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.146+0000 7f6e1b400640 1 -- 172.21.15.44:0/65785909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1c0b0180 con 0x7f6e1c141590 2024-03-30T13:12:47.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.147+0000 7f6e1b400640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c141590 0x7f6e1c13b230 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c160980 tx=0x7f6e1400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:47.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.147+0000 7f6e12a00640 1 -- 172.21.15.44:0/65785909 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400c680 con 0x7f6e1c141590 2024-03-30T13:12:47.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.147+0000 7f6e12a00640 1 -- 172.21.15.44:0/65785909 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1401a070 con 0x7f6e1c141590 2024-03-30T13:12:47.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.147+0000 7f6e12a00640 1 -- 172.21.15.44:0/65785909 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400ca60 con 0x7f6e1c141590 2024-03-30T13:12:47.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.147+0000 7f6e21c00640 1 -- 172.21.15.44:0/65785909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1c0afea0 con 0x7f6e1c141590 2024-03-30T13:12:47.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.147+0000 7f6e21c00640 1 -- 172.21.15.44:0/65785909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e1c140850 con 0x7f6e1c141590 2024-03-30T13:12:47.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.149+0000 7f6e21c00640 1 -- 172.21.15.44:0/65785909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e1c075890 con 0x7f6e1c141590 2024-03-30T13:12:47.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.149+0000 7f6e12a00640 1 -- 172.21.15.44:0/65785909 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6e1400cc00 con 0x7f6e1c141590 2024-03-30T13:12:47.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.150+0000 7f6e12a00640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6df806c530 0x7f6df806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.150+0000 7f6e12a00640 1 -- 172.21.15.44:0/65785909 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f6e1408b730 con 0x7f6e1c141590 2024-03-30T13:12:47.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.151+0000 7f6e1aa00640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6df806c530 0x7f6df806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.152+0000 7f6e1aa00640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6df806c530 0x7f6df806e9f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6e04033000 tx=0x7f6e04009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:47.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.155+0000 7f6e12a00640 1 -- 172.21.15.44:0/65785909 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6e14024020 con 0x7f6e1c141590 2024-03-30T13:12:47.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.358+0000 7f6e21c00640 1 -- 172.21.15.44:0/65785909 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6e1c0b2a40 con 0x7f6e1c141590 2024-03-30T13:12:47.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.359+0000 7f6e12a00640 1 -- 172.21.15.44:0/65785909 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f6e14059890 con 0x7f6e1c141590 2024-03-30T13:12:47.363 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:12:47.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.362+0000 7f6e21c00640 1 -- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6df806c530 msgr2=0x7f6df806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:47.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.362+0000 7f6e21c00640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6df806c530 0x7f6df806e9f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6e04033000 tx=0x7f6e04009030 comp rx=0 tx=0).stop 2024-03-30T13:12:47.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.362+0000 7f6e21c00640 1 -- 172.21.15.44:0/65785909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c141590 msgr2=0x7f6e1c13b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:47.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.362+0000 7f6e21c00640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c141590 0x7f6e1c13b230 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c160980 tx=0x7f6e1400ec00 comp rx=0 tx=0).stop 2024-03-30T13:12:47.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.362+0000 7f6e21c00640 1 -- 172.21.15.44:0/65785909 shutdown_connections 2024-03-30T13:12:47.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.362+0000 7f6e21c00640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6e1c141590 0x7f6e1c13b230 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.362+0000 7f6e21c00640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e1c0afa10 0x7f6e1c141050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.362+0000 7f6e21c00640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6df806c530 0x7f6df806e9f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.362+0000 7f6e21c00640 1 --2- 172.21.15.44:0/65785909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e000039e0 0x7f6e1c139020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.362+0000 7f6e21c00640 1 -- 172.21.15.44:0/65785909 >> 172.21.15.44:0/65785909 conn(0x7f6e1c0b5b00 msgr2=0x7f6e1c15db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:47.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.362+0000 7f6e21c00640 1 -- 172.21.15.44:0/65785909 shutdown_connections 2024-03-30T13:12:47.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.362+0000 7f6e21c00640 1 -- 172.21.15.44:0/65785909 wait complete. 2024-03-30T13:12:47.386 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:12:47.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.608+0000 7fd1a5000640 1 Processor -- start 2024-03-30T13:12:47.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.608+0000 7fd1a5000640 1 -- start start 2024-03-30T13:12:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.609+0000 7fd1a5000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd1a013f0c0 0x7fd1a006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.609+0000 7fd1a5000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd1a006d720 0x7fd1a015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.609+0000 7fd1a5000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a01603d0 0x7fd1a00cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.609+0000 7fd1a5000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd1a0160e30 con 0x7fd1a006d720 2024-03-30T13:12:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.609+0000 7fd1a5000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fd1a00ce9c0 con 0x7fd1a013f0c0 2024-03-30T13:12:47.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.609+0000 7fd1a5000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a0160b50 con 0x7fd1a01603d0 2024-03-30T13:12:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.609+0000 7fd19d400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd1a006d720 0x7fd1a015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.609+0000 7fd19d400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd1a006d720 0x7fd1a015fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37046/0 (socket says 172.21.15.44:37046) 2024-03-30T13:12:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.610+0000 7fd19d400640 1 -- 172.21.15.44:0/2582356688 learned_addr learned my addr 172.21.15.44:0/2582356688 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.610+0000 7fd19de00640 1 --2- 172.21.15.44:0/2582356688 >> v2:172.21.15.151:3300/0 conn(0x7fd1a013f0c0 0x7fd1a006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.610+0000 7fd19e800640 1 --2- 172.21.15.44:0/2582356688 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a01603d0 0x7fd1a00cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.610+0000 7fd19d400640 1 -- 172.21.15.44:0/2582356688 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a01603d0 msgr2=0x7fd1a00cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.610+0000 7fd19d400640 1 --2- 172.21.15.44:0/2582356688 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a01603d0 0x7fd1a00cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.610+0000 7fd19d400640 1 -- 172.21.15.44:0/2582356688 >> v2:172.21.15.151:3300/0 conn(0x7fd1a013f0c0 msgr2=0x7fd1a006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.610+0000 7fd19d400640 1 --2- 172.21.15.44:0/2582356688 >> v2:172.21.15.151:3300/0 conn(0x7fd1a013f0c0 0x7fd1a006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.610+0000 7fd19d400640 1 -- 172.21.15.44:0/2582356688 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a013fa40 con 0x7fd1a006d720 2024-03-30T13:12:47.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.611+0000 7fd19d400640 1 --2- 172.21.15.44:0/2582356688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1a006d720 0x7fd1a015fe90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd1a006e2b0 tx=0x7fd18c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b306ec3e4ae70a65 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:47.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.612+0000 7fd19ca00640 1 -- 172.21.15.44:0/2582356688 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c038070 con 0x7fd1a006d720 2024-03-30T13:12:47.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.612+0000 7fd19ca00640 1 -- 172.21.15.44:0/2582356688 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd18c02f050 con 0x7fd1a006d720 2024-03-30T13:12:47.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.612+0000 7fd19ca00640 1 -- 172.21.15.44:0/2582356688 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c031970 con 0x7fd1a006d720 2024-03-30T13:12:47.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.612+0000 7fd1a5000640 1 -- 172.21.15.44:0/2582356688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1a006d720 msgr2=0x7fd1a015fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:47.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.612+0000 7fd1a5000640 1 --2- 172.21.15.44:0/2582356688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1a006d720 0x7fd1a015fe90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd1a006e2b0 tx=0x7fd18c02b7f0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.612+0000 7fd1a5000640 1 -- 172.21.15.44:0/2582356688 shutdown_connections 2024-03-30T13:12:47.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.612+0000 7fd1a5000640 1 --2- 172.21.15.44:0/2582356688 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a01603d0 0x7fd1a00cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.612+0000 7fd1a5000640 1 --2- 172.21.15.44:0/2582356688 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1a006d720 0x7fd1a015fe90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.612+0000 7fd1a5000640 1 --2- 172.21.15.44:0/2582356688 >> v2:172.21.15.151:3300/0 conn(0x7fd1a013f0c0 0x7fd1a006d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.612+0000 7fd1a5000640 1 -- 172.21.15.44:0/2582356688 >> 172.21.15.44:0/2582356688 conn(0x7fd1a00b5b00 msgr2=0x7fd1a006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:47.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.613+0000 7fd1a5000640 1 -- 172.21.15.44:0/2582356688 shutdown_connections 2024-03-30T13:12:47.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.613+0000 7fd1a5000640 1 -- 172.21.15.44:0/2582356688 wait complete. 2024-03-30T13:12:47.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.614+0000 7fd1a5000640 1 Processor -- start 2024-03-30T13:12:47.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.614+0000 7fd1a5000640 1 -- start start 2024-03-30T13:12:47.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.615+0000 7fd1a5000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1a006d720 0x7fd1a013c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.615+0000 7fd1a5000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1a013f0c0 0x7fd1a015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.615+0000 7fd1a5000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a01603d0 0x7fd1a013bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.615+0000 7fd1a5000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a0160800 con 0x7fd1a006d720 2024-03-30T13:12:47.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.615+0000 7fd1a5000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a0140000 con 0x7fd1a013f0c0 2024-03-30T13:12:47.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.615+0000 7fd1a5000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a013f4a0 con 0x7fd1a01603d0 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.616+0000 7fd19de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1a006d720 0x7fd1a013c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.616+0000 7fd19de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1a006d720 0x7fd1a013c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37050/0 (socket says 172.21.15.44:37050) 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.616+0000 7fd19de00640 1 -- 172.21.15.44:0/4181323223 learned_addr learned my addr 172.21.15.44:0/4181323223 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.616+0000 7fd19e800640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a01603d0 0x7fd1a013bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.616+0000 7fd19d400640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1a013f0c0 0x7fd1a015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.616+0000 7fd19de00640 1 -- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a01603d0 msgr2=0x7fd1a013bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.616+0000 7fd19de00640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a01603d0 0x7fd1a013bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.616+0000 7fd19de00640 1 -- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1a013f0c0 msgr2=0x7fd1a015da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.616+0000 7fd19de00640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1a013f0c0 0x7fd1a015da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.616+0000 7fd19de00640 1 -- 172.21.15.44:0/4181323223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a015e190 con 0x7fd1a006d720 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.617+0000 7fd19de00640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1a006d720 0x7fd1a013c420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd19000d800 tx=0x7fd19000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.617+0000 7fd196000640 1 -- 172.21.15.44:0/4181323223 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19000b6c0 con 0x7fd1a006d720 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.617+0000 7fd196000640 1 -- 172.21.15.44:0/4181323223 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd190019070 con 0x7fd1a006d720 2024-03-30T13:12:47.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.617+0000 7fd196000640 1 -- 172.21.15.44:0/4181323223 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19000ba80 con 0x7fd1a006d720 2024-03-30T13:12:47.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.617+0000 7fd1a5000640 1 -- 172.21.15.44:0/4181323223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a015e470 con 0x7fd1a006d720 2024-03-30T13:12:47.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.617+0000 7fd1a5000640 1 -- 172.21.15.44:0/4181323223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a015ea30 con 0x7fd1a006d720 2024-03-30T13:12:47.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.619+0000 7fd1a5000640 1 -- 172.21.15.44:0/4181323223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1a0075890 con 0x7fd1a006d720 2024-03-30T13:12:47.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.619+0000 7fd196000640 1 -- 172.21.15.44:0/4181323223 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd19000bc20 con 0x7fd1a006d720 2024-03-30T13:12:47.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.620+0000 7fd196000640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd18006c530 0x7fd18006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:47.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.620+0000 7fd196000640 1 -- 172.21.15.44:0/4181323223 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fd19008bea0 con 0x7fd1a006d720 2024-03-30T13:12:47.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.621+0000 7fd19d400640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd18006c530 0x7fd18006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:47.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.622+0000 7fd19d400640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd18006c530 0x7fd18006e9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd18c035000 tx=0x7fd18c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:47.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.625+0000 7fd196000640 1 -- 172.21.15.44:0/4181323223 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd19005a130 con 0x7fd1a006d720 2024-03-30T13:12:47.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.826+0000 7fd1a5000640 1 -- 172.21.15.44:0/4181323223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd1a006c2c0 con 0x7fd1a006d720 2024-03-30T13:12:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.828+0000 7fd196000640 1 -- 172.21.15.44:0/4181323223 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fd190059a30 con 0x7fd1a006d720 2024-03-30T13:12:47.831 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:47.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.830+0000 7fd1a5000640 1 -- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd18006c530 msgr2=0x7fd18006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:47.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.830+0000 7fd1a5000640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd18006c530 0x7fd18006e9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd18c035000 tx=0x7fd18c008030 comp rx=0 tx=0).stop 2024-03-30T13:12:47.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.830+0000 7fd1a5000640 1 -- 172.21.15.44:0/4181323223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1a006d720 msgr2=0x7fd1a013c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:47.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.830+0000 7fd1a5000640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1a006d720 0x7fd1a013c420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd19000d800 tx=0x7fd19000dcc0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.830+0000 7fd1a5000640 1 -- 172.21.15.44:0/4181323223 shutdown_connections 2024-03-30T13:12:47.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.830+0000 7fd1a5000640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1a01603d0 0x7fd1a013bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.830+0000 7fd1a5000640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd18006c530 0x7fd18006e9f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.830+0000 7fd1a5000640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1a013f0c0 0x7fd1a015da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.830+0000 7fd1a5000640 1 --2- 172.21.15.44:0/4181323223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1a006d720 0x7fd1a013c420 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:47.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.830+0000 7fd1a5000640 1 -- 172.21.15.44:0/4181323223 >> 172.21.15.44:0/4181323223 conn(0x7fd1a00b5b00 msgr2=0x7fd1a013e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:47.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.831+0000 7fd1a5000640 1 -- 172.21.15.44:0/4181323223 shutdown_connections 2024-03-30T13:12:47.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:47.831+0000 7fd1a5000640 1 -- 172.21.15.44:0/4181323223 wait complete. 2024-03-30T13:12:47.854 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:12:48.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.082+0000 7f6885a00640 1 Processor -- start 2024-03-30T13:12:48.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.082+0000 7f6885a00640 1 -- start start 2024-03-30T13:12:48.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.084+0000 7f6885a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6880071240 0x7f68800acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.084+0000 7f6885a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f688015e540 0x7f68800b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.084+0000 7f6885a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f68800b3970 0x7f6880071620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.084+0000 7f6885a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f68800b4a30 con 0x7f6880071240 2024-03-30T13:12:48.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.084+0000 7f6885a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f68800aef20 con 0x7f68800b3970 2024-03-30T13:12:48.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.084+0000 7f6885a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f688006d0e0 con 0x7f688015e540 2024-03-30T13:12:48.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.085+0000 7f687fe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6880071240 0x7f68800acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.085+0000 7f687fe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6880071240 0x7f68800acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37056/0 (socket says 172.21.15.44:37056) 2024-03-30T13:12:48.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.085+0000 7f687fe00640 1 -- 172.21.15.44:0/3965288504 learned_addr learned my addr 172.21.15.44:0/3965288504 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:48.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.085+0000 7f687f400640 1 --2- 172.21.15.44:0/3965288504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f688015e540 0x7f68800b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.085+0000 7f6885000640 1 --2- 172.21.15.44:0/3965288504 >> v2:172.21.15.151:3300/0 conn(0x7f68800b3970 0x7f6880071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.085+0000 7f687fe00640 1 -- 172.21.15.44:0/3965288504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f688015e540 msgr2=0x7f68800b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:48.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.085+0000 7f687fe00640 1 --2- 172.21.15.44:0/3965288504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f688015e540 0x7f68800b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.085+0000 7f687fe00640 1 -- 172.21.15.44:0/3965288504 >> v2:172.21.15.151:3300/0 conn(0x7f68800b3970 msgr2=0x7f6880071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:48.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.085+0000 7f687fe00640 1 --2- 172.21.15.44:0/3965288504 >> v2:172.21.15.151:3300/0 conn(0x7f68800b3970 0x7f6880071620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.085+0000 7f687fe00640 1 -- 172.21.15.44:0/3965288504 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68800b4ef0 con 0x7f6880071240 2024-03-30T13:12:48.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.087+0000 7f687fe00640 1 --2- 172.21.15.44:0/3965288504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6880071240 0x7f68800acd60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f68800b2d30 tx=0x7f687002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5489063b8dcd9d02 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:48.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.087+0000 7f687ea00640 1 -- 172.21.15.44:0/3965288504 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870035020 con 0x7f6880071240 2024-03-30T13:12:48.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.087+0000 7f687ea00640 1 -- 172.21.15.44:0/3965288504 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687002d040 con 0x7f6880071240 2024-03-30T13:12:48.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.087+0000 7f687ea00640 1 -- 172.21.15.44:0/3965288504 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870031a80 con 0x7f6880071240 2024-03-30T13:12:48.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.088+0000 7f6885a00640 1 -- 172.21.15.44:0/3965288504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6880071240 msgr2=0x7f68800acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:48.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.088+0000 7f6885a00640 1 --2- 172.21.15.44:0/3965288504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6880071240 0x7f68800acd60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f68800b2d30 tx=0x7f687002b900 comp rx=0 tx=0).stop 2024-03-30T13:12:48.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.088+0000 7f6885a00640 1 -- 172.21.15.44:0/3965288504 shutdown_connections 2024-03-30T13:12:48.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.088+0000 7f6885a00640 1 --2- 172.21.15.44:0/3965288504 >> v2:172.21.15.151:3300/0 conn(0x7f68800b3970 0x7f6880071620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.088+0000 7f6885a00640 1 --2- 172.21.15.44:0/3965288504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f688015e540 0x7f68800b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.088+0000 7f6885a00640 1 --2- 172.21.15.44:0/3965288504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6880071240 0x7f68800acd60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.088+0000 7f6885a00640 1 -- 172.21.15.44:0/3965288504 >> 172.21.15.44:0/3965288504 conn(0x7f68800cfd90 msgr2=0x7f68800d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:48.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.088+0000 7f6885a00640 1 -- 172.21.15.44:0/3965288504 shutdown_connections 2024-03-30T13:12:48.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.088+0000 7f6885a00640 1 -- 172.21.15.44:0/3965288504 wait complete. 2024-03-30T13:12:48.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.090+0000 7f6885a00640 1 Processor -- start 2024-03-30T13:12:48.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.090+0000 7f6885a00640 1 -- start start 2024-03-30T13:12:48.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f6885a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6880071240 0x7f68801526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f6885a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68800b3970 0x7f6880152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f6885a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f688015e540 0x7f688009ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f6885a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f68800b3f10 con 0x7f68800b3970 2024-03-30T13:12:48.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f6885a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f688006d980 con 0x7f688015e540 2024-03-30T13:12:48.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f6885a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f688006d330 con 0x7f6880071240 2024-03-30T13:12:48.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f687f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68800b3970 0x7f6880152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f687f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68800b3970 0x7f6880152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37068/0 (socket says 172.21.15.44:37068) 2024-03-30T13:12:48.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f687f400640 1 -- 172.21.15.44:0/225760845 learned_addr learned my addr 172.21.15.44:0/225760845 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:48.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f687fe00640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6880071240 0x7f68801526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f6885000640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f688015e540 0x7f688009ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f687f400640 1 -- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6880071240 msgr2=0x7f68801526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:48.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f687f400640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6880071240 0x7f68801526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f687f400640 1 -- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f688015e540 msgr2=0x7f688009ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:48.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f687f400640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f688015e540 0x7f688009ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f687f400640 1 -- 172.21.15.44:0/225760845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688009d970 con 0x7f68800b3970 2024-03-30T13:12:48.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.091+0000 7f687fe00640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6880071240 0x7f68801526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:48.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.092+0000 7f687f400640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68800b3970 0x7f6880152130 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f686c00d620 tx=0x7f686c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:48.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.092+0000 7f6877e00640 1 -- 172.21.15.44:0/225760845 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c00b620 con 0x7f68800b3970 2024-03-30T13:12:48.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.092+0000 7f6877e00640 1 -- 172.21.15.44:0/225760845 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f686c019070 con 0x7f68800b3970 2024-03-30T13:12:48.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.092+0000 7f6885a00640 1 -- 172.21.15.44:0/225760845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688009d0d0 con 0x7f68800b3970 2024-03-30T13:12:48.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.092+0000 7f6877e00640 1 -- 172.21.15.44:0/225760845 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c00ba00 con 0x7f68800b3970 2024-03-30T13:12:48.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.092+0000 7f6885a00640 1 -- 172.21.15.44:0/225760845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688009d690 con 0x7f68800b3970 2024-03-30T13:12:48.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.093+0000 7f6885a00640 1 -- 172.21.15.44:0/225760845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6880075890 con 0x7f68800b3970 2024-03-30T13:12:48.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.094+0000 7f6877e00640 1 -- 172.21.15.44:0/225760845 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f686c00bba0 con 0x7f68800b3970 2024-03-30T13:12:48.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.095+0000 7f6877e00640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f686006c530 0x7f686006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.095+0000 7f6877e00640 1 -- 172.21.15.44:0/225760845 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f686c08be90 con 0x7f68800b3970 2024-03-30T13:12:48.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.096+0000 7f687fe00640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f686006c530 0x7f686006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.097+0000 7f687fe00640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f686006c530 0x7f686006e9f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6870036000 tx=0x7f6870008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:48.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.100+0000 7f6877e00640 1 -- 172.21.15.44:0/225760845 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f686c05a080 con 0x7f68800b3970 2024-03-30T13:12:48.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.301+0000 7f6885a00640 1 -- 172.21.15.44:0/225760845 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f688006ed60 con 0x7f68800b3970 2024-03-30T13:12:48.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.302+0000 7f6877e00640 1 -- 172.21.15.44:0/225760845 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f686c059980 con 0x7f68800b3970 2024-03-30T13:12:48.306 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:12:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.305+0000 7f6885a00640 1 -- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f686006c530 msgr2=0x7f686006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.305+0000 7f6885a00640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f686006c530 0x7f686006e9f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6870036000 tx=0x7f6870008030 comp rx=0 tx=0).stop 2024-03-30T13:12:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.305+0000 7f6885a00640 1 -- 172.21.15.44:0/225760845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68800b3970 msgr2=0x7f6880152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.305+0000 7f6885a00640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68800b3970 0x7f6880152130 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f686c00d620 tx=0x7f686c00dae0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.305+0000 7f6885a00640 1 -- 172.21.15.44:0/225760845 shutdown_connections 2024-03-30T13:12:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.305+0000 7f6885a00640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f686006c530 0x7f686006e9f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.305+0000 7f6885a00640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f688015e540 0x7f688009ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.305+0000 7f6885a00640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f68800b3970 0x7f6880152130 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.305+0000 7f6885a00640 1 --2- 172.21.15.44:0/225760845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6880071240 0x7f68801526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.305+0000 7f6885a00640 1 -- 172.21.15.44:0/225760845 >> 172.21.15.44:0/225760845 conn(0x7f68800cfd90 msgr2=0x7f68800ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.305+0000 7f6885a00640 1 -- 172.21.15.44:0/225760845 shutdown_connections 2024-03-30T13:12:48.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.305+0000 7f6885a00640 1 -- 172.21.15.44:0/225760845 wait complete. 2024-03-30T13:12:48.329 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:12:48.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.551+0000 7ff665400640 1 Processor -- start 2024-03-30T13:12:48.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.551+0000 7ff665400640 1 -- start start 2024-03-30T13:12:48.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.553+0000 7ff665400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff66013f0c0 0x7ff66006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.553+0000 7ff665400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff66006d720 0x7ff66015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.553+0000 7ff665400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6600ce9c0 con 0x7ff6601603d0 2024-03-30T13:12:48.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.553+0000 7ff665400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff660160e30 con 0x7ff66006d720 2024-03-30T13:12:48.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.553+0000 7ff665400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff660160b50 con 0x7ff66013f0c0 2024-03-30T13:12:48.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.553+0000 7ff65f200640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff6601603d0 0x7ff6600cfbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40402/0 (socket says 172.21.15.44:40402) 2024-03-30T13:12:48.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.553+0000 7ff65f200640 1 -- 172.21.15.44:0/381660069 learned_addr learned my addr 172.21.15.44:0/381660069 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:48.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.553+0000 7ff65de00640 1 --2- 172.21.15.44:0/381660069 >> v2:172.21.15.44:3300/0 conn(0x7ff66006d720 0x7ff66015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.553+0000 7ff65e800640 1 --2- 172.21.15.44:0/381660069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff66013f0c0 0x7ff66006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.554+0000 7ff65d400640 1 -- 172.21.15.44:0/381660069 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3728568981 0 0) 0x7ff658001490 con 0x7ff6601603d0 2024-03-30T13:12:48.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.554+0000 7ff65d400640 1 -- 172.21.15.44:0/381660069 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff644003520 con 0x7ff6601603d0 2024-03-30T13:12:48.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.554+0000 7ff65de00640 1 -- 172.21.15.44:0/381660069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff66013f0c0 msgr2=0x7ff66006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:48.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.554+0000 7ff65de00640 1 --2- 172.21.15.44:0/381660069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff66013f0c0 0x7ff66006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.554+0000 7ff65de00640 1 -- 172.21.15.44:0/381660069 >> v1:172.21.15.44:6789/0 conn(0x7ff6601603d0 legacy=0x7ff6600cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:48.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.554+0000 7ff65de00640 1 -- 172.21.15.44:0/381660069 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66013fa40 con 0x7ff66006d720 2024-03-30T13:12:48.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.555+0000 7ff65de00640 1 --2- 172.21.15.44:0/381660069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66006d720 0x7ff66015fe90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0097a0 tx=0x7ff64c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd99e29d2d753bc4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:48.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.555+0000 7ff65d400640 1 -- 172.21.15.44:0/381660069 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c038070 con 0x7ff66006d720 2024-03-30T13:12:48.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.555+0000 7ff65d400640 1 -- 172.21.15.44:0/381660069 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff64c031700 con 0x7ff66006d720 2024-03-30T13:12:48.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.555+0000 7ff65d400640 1 -- 172.21.15.44:0/381660069 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c031ad0 con 0x7ff66006d720 2024-03-30T13:12:48.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.556+0000 7ff665400640 1 -- 172.21.15.44:0/381660069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66006d720 msgr2=0x7ff66015fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:48.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.556+0000 7ff665400640 1 --2- 172.21.15.44:0/381660069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66006d720 0x7ff66015fe90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0097a0 tx=0x7ff64c02b7a0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.556+0000 7ff665400640 1 -- 172.21.15.44:0/381660069 shutdown_connections 2024-03-30T13:12:48.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.556+0000 7ff665400640 1 --2- 172.21.15.44:0/381660069 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66006d720 0x7ff66015fe90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.556+0000 7ff665400640 1 --2- 172.21.15.44:0/381660069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff66013f0c0 0x7ff66006d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.556+0000 7ff665400640 1 -- 172.21.15.44:0/381660069 >> 172.21.15.44:0/381660069 conn(0x7ff6600b5b00 msgr2=0x7ff66006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:48.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.556+0000 7ff665400640 1 -- 172.21.15.44:0/381660069 shutdown_connections 2024-03-30T13:12:48.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.556+0000 7ff665400640 1 -- 172.21.15.44:0/381660069 wait complete. 2024-03-30T13:12:48.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.558+0000 7ff665400640 1 Processor -- start 2024-03-30T13:12:48.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.558+0000 7ff665400640 1 -- start start 2024-03-30T13:12:48.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.559+0000 7ff665400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff66006d720 0x7ff66013e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.559+0000 7ff665400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff66013f0c0 0x7ff6601419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.559+0000 7ff665400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6601603d0 0x7ff66015ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.559+0000 7ff665400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff660160820 con 0x7ff6601603d0 2024-03-30T13:12:48.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.559+0000 7ff665400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff660140000 con 0x7ff66006d720 2024-03-30T13:12:48.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.559+0000 7ff665400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff66013f4a0 con 0x7ff66013f0c0 2024-03-30T13:12:48.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.559+0000 7ff65f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6601603d0 0x7ff66015ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.559+0000 7ff65f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6601603d0 0x7ff66015ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37080/0 (socket says 172.21.15.44:37080) 2024-03-30T13:12:48.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.559+0000 7ff65f200640 1 -- 172.21.15.44:0/566926054 learned_addr learned my addr 172.21.15.44:0/566926054 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.560+0000 7ff65de00640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff66013f0c0 0x7ff6601419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.560+0000 7ff65e800640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff66006d720 0x7ff66013e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.560+0000 7ff65f200640 1 -- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff66013f0c0 msgr2=0x7ff6601419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.560+0000 7ff65f200640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff66013f0c0 0x7ff6601419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.560+0000 7ff65f200640 1 -- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff66006d720 msgr2=0x7ff66013e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.560+0000 7ff65f200640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff66006d720 0x7ff66013e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.560+0000 7ff65f200640 1 -- 172.21.15.44:0/566926054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6601424c0 con 0x7ff6601603d0 2024-03-30T13:12:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.560+0000 7ff65de00640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff66013f0c0 0x7ff6601419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.560+0000 7ff65e800640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff66006d720 0x7ff66013e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:48.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.560+0000 7ff65f200640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6601603d0 0x7ff66015ebc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff65800cb50 tx=0x7ff65800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.560+0000 7ff656a00640 1 -- 172.21.15.44:0/566926054 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658017070 con 0x7ff6601603d0 2024-03-30T13:12:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.561+0000 7ff656a00640 1 -- 172.21.15.44:0/566926054 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65800ad40 con 0x7ff6601603d0 2024-03-30T13:12:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.561+0000 7ff656a00640 1 -- 172.21.15.44:0/566926054 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658012620 con 0x7ff6601603d0 2024-03-30T13:12:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.561+0000 7ff665400640 1 -- 172.21.15.44:0/566926054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6600cefc0 con 0x7ff6601603d0 2024-03-30T13:12:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.561+0000 7ff665400640 1 -- 172.21.15.44:0/566926054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff66013e860 con 0x7ff6601603d0 2024-03-30T13:12:48.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.562+0000 7ff665400640 1 -- 172.21.15.44:0/566926054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6600cede0 con 0x7ff6601603d0 2024-03-30T13:12:48.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.563+0000 7ff656a00640 1 -- 172.21.15.44:0/566926054 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff65801a070 con 0x7ff6601603d0 2024-03-30T13:12:48.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.564+0000 7ff656a00640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff64006c530 0x7ff64006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:48.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.564+0000 7ff656a00640 1 -- 172.21.15.44:0/566926054 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7ff65808ba30 con 0x7ff6601603d0 2024-03-30T13:12:48.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.564+0000 7ff65e800640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff64006c530 0x7ff64006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:48.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.565+0000 7ff65e800640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff64006c530 0x7ff64006e9f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff650006fd0 tx=0x7ff650008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:48.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.568+0000 7ff656a00640 1 -- 172.21.15.44:0/566926054 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff6600cede0 con 0x7ff6601603d0 2024-03-30T13:12:48.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.769+0000 7ff665400640 1 -- 172.21.15.44:0/566926054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff660160190 con 0x7ff6601603d0 2024-03-30T13:12:48.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.770+0000 7ff656a00640 1 -- 172.21.15.44:0/566926054 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7ff660160190 con 0x7ff6601603d0 2024-03-30T13:12:48.773 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:48.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.772+0000 7ff665400640 1 -- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff64006c530 msgr2=0x7ff64006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:48.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.772+0000 7ff665400640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff64006c530 0x7ff64006e9f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff650006fd0 tx=0x7ff650008040 comp rx=0 tx=0).stop 2024-03-30T13:12:48.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.772+0000 7ff665400640 1 -- 172.21.15.44:0/566926054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6601603d0 msgr2=0x7ff66015ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:48.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.772+0000 7ff665400640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6601603d0 0x7ff66015ebc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff65800cb50 tx=0x7ff65800a430 comp rx=0 tx=0).stop 2024-03-30T13:12:48.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.772+0000 7ff665400640 1 -- 172.21.15.44:0/566926054 shutdown_connections 2024-03-30T13:12:48.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.772+0000 7ff665400640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff6601603d0 0x7ff66015ebc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.772+0000 7ff665400640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff66013f0c0 0x7ff6601419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.772+0000 7ff665400640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff64006c530 0x7ff64006e9f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.772+0000 7ff665400640 1 --2- 172.21.15.44:0/566926054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff66006d720 0x7ff66013e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:48.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.772+0000 7ff665400640 1 -- 172.21.15.44:0/566926054 >> 172.21.15.44:0/566926054 conn(0x7ff6600b5b00 msgr2=0x7ff6600b0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:48.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.773+0000 7ff665400640 1 -- 172.21.15.44:0/566926054 shutdown_connections 2024-03-30T13:12:48.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:48.773+0000 7ff665400640 1 -- 172.21.15.44:0/566926054 wait complete. 2024-03-30T13:12:48.801 INFO:tasks.cephfs_test_runner:Starting test: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:12:48.802 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:49.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.016+0000 7efdd7e00640 1 Processor -- start 2024-03-30T13:12:49.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.017+0000 7efdd7e00640 1 -- start start 2024-03-30T13:12:49.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.018+0000 7efdd7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7efdd8161e70 0x7efdd80b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.018+0000 7efdd7e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd80b5b60 con 0x7efdd80d0d30 2024-03-30T13:12:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.018+0000 7efdd7e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd80d4fc0 con 0x7efdd80d4950 2024-03-30T13:12:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.018+0000 7efdd7e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7efdd80c7b90 con 0x7efdd8161e70 2024-03-30T13:12:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.019+0000 7efdd6a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efdd80d0d30 0x7efdd80cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40404/0 (socket says 172.21.15.44:40404) 2024-03-30T13:12:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.019+0000 7efdd6a00640 1 -- 172.21.15.44:0/2465436575 learned_addr learned my addr 172.21.15.44:0/2465436575 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:49.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.019+0000 7efdd7400640 1 --2- 172.21.15.44:0/2465436575 >> v2:172.21.15.44:3300/0 conn(0x7efdd8161e70 0x7efdd80b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.019+0000 7efdd5600640 1 -- 172.21.15.44:0/2465436575 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182479943 0 0) 0x7efdd80b5b60 con 0x7efdd80d0d30 2024-03-30T13:12:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.019+0000 7efdd5600640 1 -- 172.21.15.44:0/2465436575 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdbc003520 con 0x7efdd80d0d30 2024-03-30T13:12:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.019+0000 7efdd7400640 1 -- 172.21.15.44:0/2465436575 >> v1:172.21.15.151:6789/0 conn(0x7efdd80d4950 legacy=0x7efdd8161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.019+0000 7efdd7400640 1 -- 172.21.15.44:0/2465436575 >> v1:172.21.15.44:6789/0 conn(0x7efdd80d0d30 legacy=0x7efdd80cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.019+0000 7efdd7400640 1 -- 172.21.15.44:0/2465436575 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd80b57f0 con 0x7efdd8161e70 2024-03-30T13:12:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.021+0000 7efdd7400640 1 --2- 172.21.15.44:0/2465436575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdd8161e70 0x7efdd80b3a50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009d90 tx=0x7efdd002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cfc4f8bddc1f25 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.021+0000 7efdd5600640 1 -- 172.21.15.44:0/2465436575 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0039070 con 0x7efdd8161e70 2024-03-30T13:12:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.021+0000 7efdd5600640 1 -- 172.21.15.44:0/2465436575 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd002cd00 con 0x7efdd8161e70 2024-03-30T13:12:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.021+0000 7efdd5600640 1 -- 172.21.15.44:0/2465436575 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd0034660 con 0x7efdd8161e70 2024-03-30T13:12:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.021+0000 7efdd7e00640 1 -- 172.21.15.44:0/2465436575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdd8161e70 msgr2=0x7efdd80b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.021+0000 7efdd7e00640 1 --2- 172.21.15.44:0/2465436575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdd8161e70 0x7efdd80b3a50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009d90 tx=0x7efdd002bf50 comp rx=0 tx=0).stop 2024-03-30T13:12:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.022+0000 7efdd7e00640 1 -- 172.21.15.44:0/2465436575 shutdown_connections 2024-03-30T13:12:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.022+0000 7efdd7e00640 1 --2- 172.21.15.44:0/2465436575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdd8161e70 0x7efdd80b3a50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.022+0000 7efdd7e00640 1 -- 172.21.15.44:0/2465436575 >> 172.21.15.44:0/2465436575 conn(0x7efdd809d570 msgr2=0x7efdd80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.022+0000 7efdd7e00640 1 -- 172.21.15.44:0/2465436575 shutdown_connections 2024-03-30T13:12:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.022+0000 7efdd7e00640 1 -- 172.21.15.44:0/2465436575 wait complete. 2024-03-30T13:12:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.023+0000 7efdd7e00640 1 Processor -- start 2024-03-30T13:12:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.024+0000 7efdd7e00640 1 -- start start 2024-03-30T13:12:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.024+0000 7efdd7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdd80d0d30 0x7efdd814c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.024+0000 7efdd7e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdd80d4950 0x7efdd815e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.024+0000 7efdd7e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdd8161e70 0x7efdd815e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.024+0000 7efdd7e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efdd80d1290 con 0x7efdd80d0d30 2024-03-30T13:12:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.024+0000 7efdd7e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efdd80d1110 con 0x7efdd80d4950 2024-03-30T13:12:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.024+0000 7efdd7e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7efdd80d1410 con 0x7efdd8161e70 2024-03-30T13:12:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.025+0000 7efdd6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdd80d0d30 0x7efdd814c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.025+0000 7efdd6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdd80d0d30 0x7efdd814c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37088/0 (socket says 172.21.15.44:37088) 2024-03-30T13:12:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.025+0000 7efdd6a00640 1 -- 172.21.15.44:0/3476623604 learned_addr learned my addr 172.21.15.44:0/3476623604 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.025+0000 7efdd6a00640 1 -- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdd8161e70 msgr2=0x7efdd815e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.025+0000 7efdd7400640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdd8161e70 0x7efdd815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.025+0000 7efdd6a00640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdd8161e70 0x7efdd815e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.025+0000 7efdd6a00640 1 -- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdd80d4950 msgr2=0x7efdd815e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.025+0000 7efdd6000640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdd80d4950 0x7efdd815e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.025+0000 7efdd6a00640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdd80d4950 0x7efdd815e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.025+0000 7efdd6a00640 1 -- 172.21.15.44:0/3476623604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd80b7dd0 con 0x7efdd80d0d30 2024-03-30T13:12:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.025+0000 7efdd6000640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdd80d4950 0x7efdd815e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.026+0000 7efdd6a00640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdd80d0d30 0x7efdd814c510 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efdc800c500 tx=0x7efdc800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.026+0000 7efdcea00640 1 -- 172.21.15.44:0/3476623604 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8017070 con 0x7efdd80d0d30 2024-03-30T13:12:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.026+0000 7efdcea00640 1 -- 172.21.15.44:0/3476623604 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8005ce0 con 0x7efdd80d0d30 2024-03-30T13:12:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.026+0000 7efdcea00640 1 -- 172.21.15.44:0/3476623604 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8007330 con 0x7efdd80d0d30 2024-03-30T13:12:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.026+0000 7efdd7e00640 1 -- 172.21.15.44:0/3476623604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd80b80b0 con 0x7efdd80d0d30 2024-03-30T13:12:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.026+0000 7efdd7e00640 1 -- 172.21.15.44:0/3476623604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd80b8670 con 0x7efdd80d0d30 2024-03-30T13:12:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.027+0000 7efdd7e00640 1 -- 172.21.15.44:0/3476623604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd80ce930 con 0x7efdd80d0d30 2024-03-30T13:12:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.028+0000 7efdcea00640 1 -- 172.21.15.44:0/3476623604 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7efdc801a070 con 0x7efdd80d0d30 2024-03-30T13:12:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.029+0000 7efdcea00640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efdb406c560 0x7efdb406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.029+0000 7efdcea00640 1 -- 172.21.15.44:0/3476623604 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7efdc808afc0 con 0x7efdd80d0d30 2024-03-30T13:12:49.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.030+0000 7efdd6000640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efdb406c560 0x7efdb406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.031+0000 7efdd6000640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efdb406c560 0x7efdb406ea20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efdd815f090 tx=0x7efdc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:49.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.034+0000 7efdcea00640 1 -- 172.21.15.44:0/3476623604 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7efdd80ce930 con 0x7efdd80d0d30 2024-03-30T13:12:49.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.245+0000 7efdd7e00640 1 -- 172.21.15.44:0/3476623604 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efdd80b2ee0 con 0x7efdd80d0d30 2024-03-30T13:12:49.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.248+0000 7efdcea00640 1 -- 172.21.15.44:0/3476623604 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18927 (secure 0 0 0) 0x7efdc8059270 con 0x7efdd80d0d30 2024-03-30T13:12:49.252 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:49.252 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":29,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:12:27.323786+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:49.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.251+0000 7efdd7e00640 1 -- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efdb406c560 msgr2=0x7efdb406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.251+0000 7efdd7e00640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efdb406c560 0x7efdb406ea20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efdd815f090 tx=0x7efdc0009040 comp rx=0 tx=0).stop 2024-03-30T13:12:49.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.251+0000 7efdd7e00640 1 -- 172.21.15.44:0/3476623604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdd80d0d30 msgr2=0x7efdd814c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.251+0000 7efdd7e00640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdd80d0d30 0x7efdd814c510 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efdc800c500 tx=0x7efdc800c9c0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.251+0000 7efdd7e00640 1 -- 172.21.15.44:0/3476623604 shutdown_connections 2024-03-30T13:12:49.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.251+0000 7efdd7e00640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdd8161e70 0x7efdd815e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.251+0000 7efdd7e00640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efdb406c560 0x7efdb406ea20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.251+0000 7efdd7e00640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdd80d4950 0x7efdd815e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.251+0000 7efdd7e00640 1 --2- 172.21.15.44:0/3476623604 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efdd80d0d30 0x7efdd814c510 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.251+0000 7efdd7e00640 1 -- 172.21.15.44:0/3476623604 >> 172.21.15.44:0/3476623604 conn(0x7efdd809d570 msgr2=0x7efdd80b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:49.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.251+0000 7efdd7e00640 1 -- 172.21.15.44:0/3476623604 shutdown_connections 2024-03-30T13:12:49.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.251+0000 7efdd7e00640 1 -- 172.21.15.44:0/3476623604 wait complete. 2024-03-30T13:12:49.274 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:12:49.275 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:12:49.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.497+0000 7f77b2c00640 1 Processor -- start 2024-03-30T13:12:49.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.498+0000 7f77b2c00640 1 -- start start 2024-03-30T13:12:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.499+0000 7f77b2c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77ac0b4920 0x7f77ac0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.499+0000 7f77b2c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f77ac0b4d00 0x7f77ac0d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.499+0000 7f77b2c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77ac0b54b0 con 0x7f77ac0d0b90 2024-03-30T13:12:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.499+0000 7f77b2c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f77ac0d0260 con 0x7f77ac0b4d00 2024-03-30T13:12:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.499+0000 7f77b2c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f77ac0cfca0 con 0x7f77ac0b4920 2024-03-30T13:12:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.500+0000 7f77b0e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f77ac0b4d00 0x7f77ac0d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.500+0000 7f77b2200640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f77ac0d0b90 0x7f77ac0d26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40406/0 (socket says 172.21.15.44:40406) 2024-03-30T13:12:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.500+0000 7f77b2200640 1 -- 172.21.15.44:0/1383083862 learned_addr learned my addr 172.21.15.44:0/1383083862 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.500+0000 7f77b1800640 1 --2- 172.21.15.44:0/1383083862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77ac0b4920 0x7f77ac0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.500+0000 7f77b0e00640 1 -- 172.21.15.44:0/1383083862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77ac0b4920 msgr2=0x7f77ac0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.500+0000 7f77b0e00640 1 --2- 172.21.15.44:0/1383083862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77ac0b4920 0x7f77ac0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.500+0000 7f77b0e00640 1 -- 172.21.15.44:0/1383083862 >> v1:172.21.15.44:6789/0 conn(0x7f77ac0d0b90 legacy=0x7f77ac0d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.500+0000 7f77b0e00640 1 -- 172.21.15.44:0/1383083862 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac0cff80 con 0x7f77ac0b4d00 2024-03-30T13:12:49.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.501+0000 7f77b0e00640 1 --2- 172.21.15.44:0/1383083862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77ac0b4d00 0x7f77ac0d4ac0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f77980097a0 tx=0x7f779802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873e925b9cfd7738 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:49.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.502+0000 7f77abe00640 1 -- 172.21.15.44:0/1383083862 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798031780 con 0x7f77ac0b4d00 2024-03-30T13:12:49.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.502+0000 7f77abe00640 1 -- 172.21.15.44:0/1383083862 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7798037070 con 0x7f77ac0b4d00 2024-03-30T13:12:49.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.502+0000 7f77abe00640 1 -- 172.21.15.44:0/1383083862 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798031b40 con 0x7f77ac0b4d00 2024-03-30T13:12:49.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.502+0000 7f77b2c00640 1 -- 172.21.15.44:0/1383083862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77ac0b4d00 msgr2=0x7f77ac0d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.502+0000 7f77b2c00640 1 --2- 172.21.15.44:0/1383083862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77ac0b4d00 0x7f77ac0d4ac0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f77980097a0 tx=0x7f779802b820 comp rx=0 tx=0).stop 2024-03-30T13:12:49.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.503+0000 7f77b2c00640 1 -- 172.21.15.44:0/1383083862 shutdown_connections 2024-03-30T13:12:49.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.503+0000 7f77b2c00640 1 --2- 172.21.15.44:0/1383083862 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77ac0b4d00 0x7f77ac0d4ac0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.503+0000 7f77b2c00640 1 --2- 172.21.15.44:0/1383083862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77ac0b4920 0x7f77ac0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.503+0000 7f77b2c00640 1 -- 172.21.15.44:0/1383083862 >> 172.21.15.44:0/1383083862 conn(0x7f77ac09d4e0 msgr2=0x7f77ac0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:49.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.503+0000 7f77b2c00640 1 -- 172.21.15.44:0/1383083862 shutdown_connections 2024-03-30T13:12:49.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.503+0000 7f77b2c00640 1 -- 172.21.15.44:0/1383083862 wait complete. 2024-03-30T13:12:49.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.505+0000 7f77b2c00640 1 Processor -- start 2024-03-30T13:12:49.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.505+0000 7f77b2c00640 1 -- start start 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.506+0000 7f77b2c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77ac0b4920 0x7f77ac1488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.506+0000 7f77b2c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77ac0b4d00 0x7f77ac0b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.506+0000 7f77b2c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77ac0d0b90 0x7f77ac0b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.506+0000 7f77b2c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac0b3ff0 con 0x7f77ac0b4d00 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.506+0000 7f77b2c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac0d2180 con 0x7f77ac0b4920 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.506+0000 7f77b2c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f77ac0d5000 con 0x7f77ac0d0b90 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.507+0000 7f77b0e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77ac0b4d00 0x7f77ac0b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.507+0000 7f77b0e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77ac0b4d00 0x7f77ac0b8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37106/0 (socket says 172.21.15.44:37106) 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.507+0000 7f77b0e00640 1 -- 172.21.15.44:0/3989170639 learned_addr learned my addr 172.21.15.44:0/3989170639 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.507+0000 7f77b0e00640 1 -- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77ac0d0b90 msgr2=0x7f77ac0b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.507+0000 7f77b1800640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77ac0b4920 0x7f77ac1488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.507+0000 7f77b0e00640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77ac0d0b90 0x7f77ac0b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.507+0000 7f77b0e00640 1 -- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77ac0b4920 msgr2=0x7f77ac1488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.507+0000 7f77b0e00640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77ac0b4920 0x7f77ac1488a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.507+0000 7f77b0e00640 1 -- 172.21.15.44:0/3989170639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac0b9730 con 0x7f77ac0b4d00 2024-03-30T13:12:49.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.508+0000 7f77b0e00640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77ac0b4d00 0x7f77ac0b8ce0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f77980098c0 tx=0x7f77980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:49.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.508+0000 7f77a9600640 1 -- 172.21.15.44:0/3989170639 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798032820 con 0x7f77ac0b4d00 2024-03-30T13:12:49.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.508+0000 7f77a9600640 1 -- 172.21.15.44:0/3989170639 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77980329e0 con 0x7f77ac0b4d00 2024-03-30T13:12:49.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.508+0000 7f77a9600640 1 -- 172.21.15.44:0/3989170639 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798032dd0 con 0x7f77ac0b4d00 2024-03-30T13:12:49.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.508+0000 7f77b2c00640 1 -- 172.21.15.44:0/3989170639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ac0b9a10 con 0x7f77ac0b4d00 2024-03-30T13:12:49.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.508+0000 7f77b2c00640 1 -- 172.21.15.44:0/3989170639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ac0b9fd0 con 0x7f77ac0b4d00 2024-03-30T13:12:49.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.509+0000 7f77b2c00640 1 -- 172.21.15.44:0/3989170639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ac075890 con 0x7f77ac0b4d00 2024-03-30T13:12:49.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.510+0000 7f77a9600640 1 -- 172.21.15.44:0/3989170639 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f779804e440 con 0x7f77ac0b4d00 2024-03-30T13:12:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.511+0000 7f77a9600640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f778c06c530 0x7f778c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.511+0000 7f77a9600640 1 -- 172.21.15.44:0/3989170639 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f77980ad920 con 0x7f77ac0b4d00 2024-03-30T13:12:49.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.512+0000 7f77b1800640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f778c06c530 0x7f778c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.513+0000 7f77b1800640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f778c06c530 0x7f778c06e9f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f779c009f30 tx=0x7f779c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:49.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.515+0000 7f77a9600640 1 -- 172.21.15.44:0/3989170639 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7798040070 con 0x7f77ac0b4d00 2024-03-30T13:12:49.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.716+0000 7f77b2c00640 1 -- 172.21.15.44:0/3989170639 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f77ac0b3b00 con 0x7f77ac0b4d00 2024-03-30T13:12:49.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.717+0000 7f77a9600640 1 -- 172.21.15.44:0/3989170639 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f779802f050 con 0x7f77ac0b4d00 2024-03-30T13:12:49.721 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:12:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.720+0000 7f77b2c00640 1 -- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f778c06c530 msgr2=0x7f778c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.720+0000 7f77b2c00640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f778c06c530 0x7f778c06e9f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f779c009f30 tx=0x7f779c00b040 comp rx=0 tx=0).stop 2024-03-30T13:12:49.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.720+0000 7f77b2c00640 1 -- 172.21.15.44:0/3989170639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77ac0b4d00 msgr2=0x7f77ac0b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.720+0000 7f77b2c00640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77ac0b4d00 0x7f77ac0b8ce0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f77980098c0 tx=0x7f77980046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.720+0000 7f77b2c00640 1 -- 172.21.15.44:0/3989170639 shutdown_connections 2024-03-30T13:12:49.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.720+0000 7f77b2c00640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77ac0d0b90 0x7f77ac0b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.720+0000 7f77b2c00640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f77ac0b4d00 0x7f77ac0b8ce0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.720+0000 7f77b2c00640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f778c06c530 0x7f778c06e9f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.720+0000 7f77b2c00640 1 --2- 172.21.15.44:0/3989170639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77ac0b4920 0x7f77ac1488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.720+0000 7f77b2c00640 1 -- 172.21.15.44:0/3989170639 >> 172.21.15.44:0/3989170639 conn(0x7f77ac09d4e0 msgr2=0x7f77ac06ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:49.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.720+0000 7f77b2c00640 1 -- 172.21.15.44:0/3989170639 shutdown_connections 2024-03-30T13:12:49.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.720+0000 7f77b2c00640 1 -- 172.21.15.44:0/3989170639 wait complete. 2024-03-30T13:12:49.743 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:12:49.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.967+0000 7fc148800640 1 Processor -- start 2024-03-30T13:12:49.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.967+0000 7fc148800640 1 -- start start 2024-03-30T13:12:49.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.969+0000 7fc148800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc14013f0c0 0x7fc14006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.969+0000 7fc148800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc14006d720 0x7fc14015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.969+0000 7fc148800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1400ce9c0 con 0x7fc1401603d0 2024-03-30T13:12:49.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.969+0000 7fc148800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc140160e30 con 0x7fc14006d720 2024-03-30T13:12:49.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.969+0000 7fc148800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fc140160b50 con 0x7fc14013f0c0 2024-03-30T13:12:49.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.970+0000 7fc145400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc14006d720 0x7fc14015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.970+0000 7fc145400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc14006d720 0x7fc14015fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37110/0 (socket says 172.21.15.44:37110) 2024-03-30T13:12:49.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.970+0000 7fc145400640 1 -- 172.21.15.44:0/3739021698 learned_addr learned my addr 172.21.15.44:0/3739021698 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:49.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.970+0000 7fc145e00640 1 --2- 172.21.15.44:0/3739021698 >> v2:172.21.15.151:3300/0 conn(0x7fc14013f0c0 0x7fc14006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.970+0000 7fc145400640 1 -- 172.21.15.44:0/3739021698 >> v2:172.21.15.151:3300/0 conn(0x7fc14013f0c0 msgr2=0x7fc14006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:49.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.970+0000 7fc145400640 1 --2- 172.21.15.44:0/3739021698 >> v2:172.21.15.151:3300/0 conn(0x7fc14013f0c0 0x7fc14006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.970+0000 7fc145400640 1 -- 172.21.15.44:0/3739021698 >> v1:172.21.15.151:6789/0 conn(0x7fc1401603d0 legacy=0x7fc1400cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.970+0000 7fc145400640 1 -- 172.21.15.44:0/3739021698 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14013fa40 con 0x7fc14006d720 2024-03-30T13:12:49.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.971+0000 7fc145400640 1 --2- 172.21.15.44:0/3739021698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc14006d720 0x7fc14015fe90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc14006e2b0 tx=0x7fc13002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3cf6e707f95967 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:49.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.972+0000 7fc144a00640 1 -- 172.21.15.44:0/3739021698 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13002e070 con 0x7fc14006d720 2024-03-30T13:12:49.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.972+0000 7fc144a00640 1 -- 172.21.15.44:0/3739021698 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc130037070 con 0x7fc14006d720 2024-03-30T13:12:49.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.972+0000 7fc144a00640 1 -- 172.21.15.44:0/3739021698 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130031a00 con 0x7fc14006d720 2024-03-30T13:12:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.972+0000 7fc148800640 1 -- 172.21.15.44:0/3739021698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc14006d720 msgr2=0x7fc14015fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.972+0000 7fc148800640 1 --2- 172.21.15.44:0/3739021698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc14006d720 0x7fc14015fe90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc14006e2b0 tx=0x7fc13002b880 comp rx=0 tx=0).stop 2024-03-30T13:12:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.972+0000 7fc148800640 1 -- 172.21.15.44:0/3739021698 shutdown_connections 2024-03-30T13:12:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.972+0000 7fc148800640 1 --2- 172.21.15.44:0/3739021698 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc14006d720 0x7fc14015fe90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.972+0000 7fc148800640 1 --2- 172.21.15.44:0/3739021698 >> v2:172.21.15.151:3300/0 conn(0x7fc14013f0c0 0x7fc14006d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.972+0000 7fc148800640 1 -- 172.21.15.44:0/3739021698 >> 172.21.15.44:0/3739021698 conn(0x7fc1400b5b00 msgr2=0x7fc14006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.972+0000 7fc148800640 1 -- 172.21.15.44:0/3739021698 shutdown_connections 2024-03-30T13:12:49.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.973+0000 7fc148800640 1 -- 172.21.15.44:0/3739021698 wait complete. 2024-03-30T13:12:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.974+0000 7fc148800640 1 Processor -- start 2024-03-30T13:12:49.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.974+0000 7fc148800640 1 -- start start 2024-03-30T13:12:49.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.975+0000 7fc148800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc14006d720 0x7fc14013ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.975+0000 7fc148800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc14013f0c0 0x7fc1401412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.975+0000 7fc148800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1401603d0 0x7fc1400ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.975+0000 7fc148800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc140160800 con 0x7fc1401603d0 2024-03-30T13:12:49.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.975+0000 7fc148800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc140140000 con 0x7fc14006d720 2024-03-30T13:12:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.975+0000 7fc148800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc14013f4a0 con 0x7fc14013f0c0 2024-03-30T13:12:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.976+0000 7fc146800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1401603d0 0x7fc1400ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.976+0000 7fc146800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1401603d0 0x7fc1400ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37118/0 (socket says 172.21.15.44:37118) 2024-03-30T13:12:49.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.976+0000 7fc146800640 1 -- 172.21.15.44:0/1073423312 learned_addr learned my addr 172.21.15.44:0/1073423312 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.976+0000 7fc145400640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc14013f0c0 0x7fc1401412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.976+0000 7fc146800640 1 -- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc14013f0c0 msgr2=0x7fc1401412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.976+0000 7fc145e00640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc14006d720 0x7fc14013ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.976+0000 7fc146800640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc14013f0c0 0x7fc1401412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.976+0000 7fc146800640 1 -- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc14006d720 msgr2=0x7fc14013ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.976+0000 7fc146800640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc14006d720 0x7fc14013ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.976+0000 7fc146800640 1 -- 172.21.15.44:0/1073423312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc140141d70 con 0x7fc1401603d0 2024-03-30T13:12:49.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.977+0000 7fc146800640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1401603d0 0x7fc1400ae910 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c710 tx=0x7fc13c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.977+0000 7fc13a000640 1 -- 172.21.15.44:0/1073423312 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13c016020 con 0x7fc1401603d0 2024-03-30T13:12:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.977+0000 7fc13a000640 1 -- 172.21.15.44:0/1073423312 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc13c006d50 con 0x7fc1401603d0 2024-03-30T13:12:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.977+0000 7fc13a000640 1 -- 172.21.15.44:0/1073423312 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13c003bb0 con 0x7fc1401603d0 2024-03-30T13:12:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.977+0000 7fc148800640 1 -- 172.21.15.44:0/1073423312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc140142050 con 0x7fc1401603d0 2024-03-30T13:12:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.977+0000 7fc148800640 1 -- 172.21.15.44:0/1073423312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1401575f0 con 0x7fc1401603d0 2024-03-30T13:12:49.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.979+0000 7fc148800640 1 -- 172.21.15.44:0/1073423312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc140075890 con 0x7fc1401603d0 2024-03-30T13:12:49.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.979+0000 7fc13a000640 1 -- 172.21.15.44:0/1073423312 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc13c00a850 con 0x7fc1401603d0 2024-03-30T13:12:49.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.980+0000 7fc13a000640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc12406c530 0x7fc12406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:49.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.980+0000 7fc13a000640 1 -- 172.21.15.44:0/1073423312 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fc13c08b7c0 con 0x7fc1401603d0 2024-03-30T13:12:49.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.981+0000 7fc145e00640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc12406c530 0x7fc12406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:49.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.982+0000 7fc145e00640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc12406c530 0x7fc12406e9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc134006fd0 tx=0x7fc134008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:49.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:49.985+0000 7fc13a000640 1 -- 172.21.15.44:0/1073423312 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc13c020020 con 0x7fc1401603d0 2024-03-30T13:12:50.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.187+0000 7fc148800640 1 -- 172.21.15.44:0/1073423312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc14006c2c0 con 0x7fc1401603d0 2024-03-30T13:12:50.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.188+0000 7fc13a000640 1 -- 172.21.15.44:0/1073423312 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fc1400ce9c0 con 0x7fc1401603d0 2024-03-30T13:12:50.192 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.191+0000 7fc148800640 1 -- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc12406c530 msgr2=0x7fc12406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.191+0000 7fc148800640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc12406c530 0x7fc12406e9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc134006fd0 tx=0x7fc134008040 comp rx=0 tx=0).stop 2024-03-30T13:12:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.191+0000 7fc148800640 1 -- 172.21.15.44:0/1073423312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1401603d0 msgr2=0x7fc1400ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.191+0000 7fc148800640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1401603d0 0x7fc1400ae910 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c710 tx=0x7fc13c00cbd0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.191+0000 7fc148800640 1 -- 172.21.15.44:0/1073423312 shutdown_connections 2024-03-30T13:12:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.191+0000 7fc148800640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1401603d0 0x7fc1400ae910 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.191+0000 7fc148800640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc14013f0c0 0x7fc1401412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.191+0000 7fc148800640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc12406c530 0x7fc12406e9f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.191+0000 7fc148800640 1 --2- 172.21.15.44:0/1073423312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc14006d720 0x7fc14013ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.191+0000 7fc148800640 1 -- 172.21.15.44:0/1073423312 >> 172.21.15.44:0/1073423312 conn(0x7fc1400b5b00 msgr2=0x7fc1400b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.191+0000 7fc148800640 1 -- 172.21.15.44:0/1073423312 shutdown_connections 2024-03-30T13:12:50.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.191+0000 7fc148800640 1 -- 172.21.15.44:0/1073423312 wait complete. 2024-03-30T13:12:50.216 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:12:50.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.436+0000 7f0f47e00640 1 Processor -- start 2024-03-30T13:12:50.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.436+0000 7f0f47e00640 1 -- start start 2024-03-30T13:12:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.438+0000 7f0f47e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f480acd60 0x7f0f48072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.438+0000 7f0f47e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0f480ae9d0 0x7f0f480aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.438+0000 7f0f47e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f480ad2e0 con 0x7f0f4806e980 2024-03-30T13:12:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.438+0000 7f0f47e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f0f480ad5c0 con 0x7f0f480ae9d0 2024-03-30T13:12:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.438+0000 7f0f47e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0f48071450 con 0x7f0f480acd60 2024-03-30T13:12:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.438+0000 7f0f46a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0f4806e980 0x7f0f4815d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40414/0 (socket says 172.21.15.44:40414) 2024-03-30T13:12:50.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.438+0000 7f0f46a00640 1 -- 172.21.15.44:0/1164726492 learned_addr learned my addr 172.21.15.44:0/1164726492 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.438+0000 7f0f3fe00640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f480acd60 0x7f0f48072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.438+0000 7f0f47400640 1 --2- 172.21.15.44:0/1164726492 >> v2:172.21.15.151:3300/0 conn(0x7f0f480ae9d0 0x7f0f480aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180443663 0 0) 0x7f0f480ad2e0 con 0x7f0f4806e980 2024-03-30T13:12:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f2c003520 con 0x7f0f4806e980 2024-03-30T13:12:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2683228457 0 0) 0x7f0f2c003520 con 0x7f0f4806e980 2024-03-30T13:12:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f480acd60 msgr2=0x7f0f48072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f480acd60 0x7f0f48072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 >> v2:172.21.15.151:3300/0 conn(0x7f0f480ae9d0 msgr2=0x7f0f480aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 --2- 172.21.15.44:0/1164726492 >> v2:172.21.15.151:3300/0 conn(0x7f0f480ae9d0 0x7f0f480aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f480716a0 con 0x7f0f4806e980 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f0f38001670 con 0x7f0f4806e980 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 >> v1:172.21.15.44:6789/0 conn(0x7f0f4806e980 legacy=0x7f0f4815d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f2c0039b0 0x7f0f2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f2c004800 0x7f0f2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f480acd60 0x7f0f2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48071450 con 0x7f0f2c0039b0 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c00b9c0 con 0x7f0f2c004800 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.439+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2c00bb40 con 0x7f0f480acd60 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.440+0000 7f0f46a00640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f2c0039b0 0x7f0f2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.440+0000 7f0f3fe00640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f2c004800 0x7f0f2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.440+0000 7f0f47400640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f480acd60 0x7f0f2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.440+0000 7f0f46a00640 1 -- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f480acd60 msgr2=0x7f0f2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.440+0000 7f0f46a00640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f480acd60 0x7f0f2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.440+0000 7f0f46a00640 1 -- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f2c004800 msgr2=0x7f0f2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.440+0000 7f0f46a00640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f2c004800 0x7f0f2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.440+0000 7f0f46a00640 1 -- 172.21.15.44:0/1164726492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2c003520 con 0x7f0f2c0039b0 2024-03-30T13:12:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.440+0000 7f0f47400640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f480acd60 0x7f0f2c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:50.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.440+0000 7f0f3fe00640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f2c004800 0x7f0f2c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.441+0000 7f0f46a00640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f2c0039b0 0x7f0f2c003dd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0f38007fd0 tx=0x7f0f2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a4626269dd9352 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.442+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38007d50 con 0x7f0f2c0039b0 2024-03-30T13:12:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.442+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f38030070 con 0x7f0f2c0039b0 2024-03-30T13:12:50.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.442+0000 7f0f46000640 1 -- 172.21.15.44:0/1164726492 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3802cd80 con 0x7f0f2c0039b0 2024-03-30T13:12:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.442+0000 7f0f47e00640 1 -- 172.21.15.44:0/1164726492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f2c0039b0 msgr2=0x7f0f2c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.442+0000 7f0f47e00640 1 --2- 172.21.15.44:0/1164726492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f2c0039b0 0x7f0f2c003dd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0f38007fd0 tx=0x7f0f2c005830 comp rx=0 tx=0).stop 2024-03-30T13:12:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.442+0000 7f0f47400640 1 -- 172.21.15.44:0/1164726492 reap_dead start 2024-03-30T13:12:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.443+0000 7f0f47e00640 1 -- 172.21.15.44:0/1164726492 shutdown_connections 2024-03-30T13:12:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.443+0000 7f0f47e00640 1 -- 172.21.15.44:0/1164726492 >> 172.21.15.44:0/1164726492 conn(0x7f0f480cfd90 msgr2=0x7f0f480d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.443+0000 7f0f47e00640 1 -- 172.21.15.44:0/1164726492 shutdown_connections 2024-03-30T13:12:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.443+0000 7f0f47e00640 1 -- 172.21.15.44:0/1164726492 wait complete. 2024-03-30T13:12:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.444+0000 7f0f47e00640 1 Processor -- start 2024-03-30T13:12:50.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.444+0000 7f0f47e00640 1 -- start start 2024-03-30T13:12:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.445+0000 7f0f47e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2c0039b0 0x7f0f480ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.445+0000 7f0f47e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f48151610 0x7f0f481567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.445+0000 7f0f47e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48156d00 0x7f0f4813f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.445+0000 7f0f47e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f480af3a0 con 0x7f0f48156d00 2024-03-30T13:12:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.445+0000 7f0f47e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48071c60 con 0x7f0f48151610 2024-03-30T13:12:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.445+0000 7f0f47e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0f48072180 con 0x7f0f2c0039b0 2024-03-30T13:12:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.446+0000 7f0f47400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48156d00 0x7f0f4813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.446+0000 7f0f47400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48156d00 0x7f0f4813f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37132/0 (socket says 172.21.15.44:37132) 2024-03-30T13:12:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.446+0000 7f0f47400640 1 -- 172.21.15.44:0/931753651 learned_addr learned my addr 172.21.15.44:0/931753651 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.446+0000 7f0f46a00640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2c0039b0 0x7f0f480ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.446+0000 7f0f3fe00640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f48151610 0x7f0f481567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.446+0000 7f0f47400640 1 -- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2c0039b0 msgr2=0x7f0f480ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.446+0000 7f0f47400640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2c0039b0 0x7f0f480ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.446+0000 7f0f47400640 1 -- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f48151610 msgr2=0x7f0f481567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.446+0000 7f0f47400640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f48151610 0x7f0f481567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.446+0000 7f0f47400640 1 -- 172.21.15.44:0/931753651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f48151eb0 con 0x7f0f48156d00 2024-03-30T13:12:50.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.447+0000 7f0f47400640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48156d00 0x7f0f4813f520 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f4806c960 tx=0x7f0f4000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:50.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.447+0000 7f0f3ea00640 1 -- 172.21.15.44:0/931753651 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40016420 con 0x7f0f48156d00 2024-03-30T13:12:50.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.447+0000 7f0f3ea00640 1 -- 172.21.15.44:0/931753651 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4001b070 con 0x7f0f48156d00 2024-03-30T13:12:50.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.447+0000 7f0f3ea00640 1 -- 172.21.15.44:0/931753651 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f400167e0 con 0x7f0f48156d00 2024-03-30T13:12:50.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.447+0000 7f0f47e00640 1 -- 172.21.15.44:0/931753651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f48155720 con 0x7f0f48156d00 2024-03-30T13:12:50.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.447+0000 7f0f47e00640 1 -- 172.21.15.44:0/931753651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f48155ce0 con 0x7f0f48156d00 2024-03-30T13:12:50.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.448+0000 7f0f47e00640 1 -- 172.21.15.44:0/931753651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f48075890 con 0x7f0f48156d00 2024-03-30T13:12:50.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.449+0000 7f0f3ea00640 1 -- 172.21.15.44:0/931753651 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0f40005d10 con 0x7f0f48156d00 2024-03-30T13:12:50.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.451+0000 7f0f3ea00640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2406c530 0x7f0f2406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.451+0000 7f0f3ea00640 1 -- 172.21.15.44:0/931753651 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f0f4008c570 con 0x7f0f48156d00 2024-03-30T13:12:50.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.451+0000 7f0f46a00640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2406c530 0x7f0f2406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.452+0000 7f0f46a00640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2406c530 0x7f0f2406e9f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f38034000 tx=0x7f0f38007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:50.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.455+0000 7f0f3ea00640 1 -- 172.21.15.44:0/931753651 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0f40025020 con 0x7f0f48156d00 2024-03-30T13:12:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.670+0000 7f0f47e00640 1 -- 172.21.15.44:0/931753651 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0f480cc580 con 0x7f0f48156d00 2024-03-30T13:12:50.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.671+0000 7f0f3ea00640 1 -- 172.21.15.44:0/931753651 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f0f48151eb0 con 0x7f0f48156d00 2024-03-30T13:12:50.675 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:12:50.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.673+0000 7f0f47e00640 1 -- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2406c530 msgr2=0x7f0f2406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.673+0000 7f0f47e00640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2406c530 0x7f0f2406e9f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f38034000 tx=0x7f0f38007000 comp rx=0 tx=0).stop 2024-03-30T13:12:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.673+0000 7f0f47e00640 1 -- 172.21.15.44:0/931753651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48156d00 msgr2=0x7f0f4813f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.673+0000 7f0f47e00640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48156d00 0x7f0f4813f520 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0f4806c960 tx=0x7f0f4000f520 comp rx=0 tx=0).stop 2024-03-30T13:12:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.673+0000 7f0f47e00640 1 -- 172.21.15.44:0/931753651 shutdown_connections 2024-03-30T13:12:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.673+0000 7f0f47e00640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f48156d00 0x7f0f4813f520 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.673+0000 7f0f47e00640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2406c530 0x7f0f2406e9f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.673+0000 7f0f47e00640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f48151610 0x7f0f481567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.673+0000 7f0f47e00640 1 --2- 172.21.15.44:0/931753651 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f2c0039b0 0x7f0f480ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.673+0000 7f0f47e00640 1 -- 172.21.15.44:0/931753651 >> 172.21.15.44:0/931753651 conn(0x7f0f480cfd90 msgr2=0x7f0f4806dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.674+0000 7f0f47e00640 1 -- 172.21.15.44:0/931753651 shutdown_connections 2024-03-30T13:12:50.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.674+0000 7f0f47e00640 1 -- 172.21.15.44:0/931753651 wait complete. 2024-03-30T13:12:50.698 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:12:50.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.916+0000 7fa96da00640 1 Processor -- start 2024-03-30T13:12:50.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.916+0000 7fa96da00640 1 -- start start 2024-03-30T13:12:50.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.918+0000 7fa96da00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa96815e540 0x7fa9680acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.918+0000 7fa96da00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9680b4ef0 con 0x7fa968071240 2024-03-30T13:12:50.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.918+0000 7fa96da00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9680b3f10 con 0x7fa9680b3970 2024-03-30T13:12:50.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.918+0000 7fa96da00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fa9680aef20 con 0x7fa96815e540 2024-03-30T13:12:50.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.918+0000 7fa967e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa968071240 0x7fa968071620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40426/0 (socket says 172.21.15.44:40426) 2024-03-30T13:12:50.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.918+0000 7fa967400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa96815e540 0x7fa9680acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.918+0000 7fa967e00640 1 -- 172.21.15.44:0/2139198654 learned_addr learned my addr 172.21.15.44:0/2139198654 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.919+0000 7fa967400640 1 -- 172.21.15.44:0/2139198654 >> v1:172.21.15.151:6789/0 conn(0x7fa9680b3970 legacy=0x7fa96806de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:50.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.919+0000 7fa967400640 1 -- 172.21.15.44:0/2139198654 >> v1:172.21.15.44:6789/0 conn(0x7fa968071240 legacy=0x7fa968071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.919+0000 7fa967400640 1 -- 172.21.15.44:0/2139198654 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96806d330 con 0x7fa96815e540 2024-03-30T13:12:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.920+0000 7fa967400640 1 --2- 172.21.15.44:0/2139198654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa96815e540 0x7fa9680acd60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa9500097a0 tx=0x7fa95002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdce4d93ef58ff42 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.920+0000 7fa966a00640 1 -- 172.21.15.44:0/2139198654 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa950035020 con 0x7fa96815e540 2024-03-30T13:12:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.920+0000 7fa966a00640 1 -- 172.21.15.44:0/2139198654 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa950031830 con 0x7fa96815e540 2024-03-30T13:12:50.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.920+0000 7fa966a00640 1 -- 172.21.15.44:0/2139198654 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa950031c00 con 0x7fa96815e540 2024-03-30T13:12:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.921+0000 7fa96da00640 1 -- 172.21.15.44:0/2139198654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa96815e540 msgr2=0x7fa9680acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.921+0000 7fa96da00640 1 --2- 172.21.15.44:0/2139198654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa96815e540 0x7fa9680acd60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa9500097a0 tx=0x7fa95002b8d0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.921+0000 7fa96da00640 1 -- 172.21.15.44:0/2139198654 shutdown_connections 2024-03-30T13:12:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.921+0000 7fa96da00640 1 --2- 172.21.15.44:0/2139198654 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa96815e540 0x7fa9680acd60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.921+0000 7fa96da00640 1 -- 172.21.15.44:0/2139198654 >> 172.21.15.44:0/2139198654 conn(0x7fa9680cfd90 msgr2=0x7fa9680d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.922+0000 7fa96da00640 1 -- 172.21.15.44:0/2139198654 shutdown_connections 2024-03-30T13:12:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.922+0000 7fa96da00640 1 -- 172.21.15.44:0/2139198654 wait complete. 2024-03-30T13:12:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.923+0000 7fa96da00640 1 Processor -- start 2024-03-30T13:12:50.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.924+0000 7fa96da00640 1 -- start start 2024-03-30T13:12:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.924+0000 7fa96da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa968071240 0x7fa9681527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.924+0000 7fa96da00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9680b3970 0x7fa9681520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.924+0000 7fa96da00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa96815e540 0x7fa968161270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa96da00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa96806d980 con 0x7fa968071240 2024-03-30T13:12:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa96da00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa96806d0e0 con 0x7fa96815e540 2024-03-30T13:12:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa96da00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa9680b44f0 con 0x7fa9680b3970 2024-03-30T13:12:50.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa967e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa968071240 0x7fa9681527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa967e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa968071240 0x7fa9681527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37140/0 (socket says 172.21.15.44:37140) 2024-03-30T13:12:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa967e00640 1 -- 172.21.15.44:0/1992940934 learned_addr learned my addr 172.21.15.44:0/1992940934 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa967400640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9680b3970 0x7fa9681520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa96d000640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa96815e540 0x7fa968161270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa967e00640 1 -- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9680b3970 msgr2=0x7fa9681520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa967e00640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9680b3970 0x7fa9681520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa967e00640 1 -- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa96815e540 msgr2=0x7fa968161270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa967e00640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa96815e540 0x7fa968161270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.925+0000 7fa967e00640 1 -- 172.21.15.44:0/1992940934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9681e7e00 con 0x7fa968071240 2024-03-30T13:12:50.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.926+0000 7fa967e00640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa968071240 0x7fa9681527c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c400 tx=0x7fa95800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.926+0000 7fa95fe00640 1 -- 172.21.15.44:0/1992940934 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa958017070 con 0x7fa968071240 2024-03-30T13:12:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.926+0000 7fa95fe00640 1 -- 172.21.15.44:0/1992940934 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa958005ce0 con 0x7fa968071240 2024-03-30T13:12:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.926+0000 7fa95fe00640 1 -- 172.21.15.44:0/1992940934 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9580072f0 con 0x7fa968071240 2024-03-30T13:12:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.926+0000 7fa96da00640 1 -- 172.21.15.44:0/1992940934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9681617b0 con 0x7fa968071240 2024-03-30T13:12:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.926+0000 7fa96da00640 1 -- 172.21.15.44:0/1992940934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9681e8380 con 0x7fa968071240 2024-03-30T13:12:50.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.927+0000 7fa96da00640 1 -- 172.21.15.44:0/1992940934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa968075890 con 0x7fa968071240 2024-03-30T13:12:50.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.928+0000 7fa95fe00640 1 -- 172.21.15.44:0/1992940934 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa95801a070 con 0x7fa968071240 2024-03-30T13:12:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.929+0000 7fa95fe00640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa94406c530 0x7fa94406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.929+0000 7fa95fe00640 1 -- 172.21.15.44:0/1992940934 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fa95808af20 con 0x7fa968071240 2024-03-30T13:12:50.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.930+0000 7fa967400640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa94406c530 0x7fa94406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:50.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.931+0000 7fa967400640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa94406c530 0x7fa94406e9f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa950036000 tx=0x7fa95003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:50.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:50.934+0000 7fa95fe00640 1 -- 172.21.15.44:0/1992940934 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa958059110 con 0x7fa968071240 2024-03-30T13:12:51.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.137+0000 7fa96da00640 1 -- 172.21.15.44:0/1992940934 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa96806ed60 con 0x7fa968071240 2024-03-30T13:12:51.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.138+0000 7fa95fe00640 1 -- 172.21.15.44:0/1992940934 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fa958058a10 con 0x7fa968071240 2024-03-30T13:12:51.142 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:51.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.140+0000 7fa96da00640 1 -- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa94406c530 msgr2=0x7fa94406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:51.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.140+0000 7fa96da00640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa94406c530 0x7fa94406e9f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa950036000 tx=0x7fa95003c040 comp rx=0 tx=0).stop 2024-03-30T13:12:51.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.140+0000 7fa96da00640 1 -- 172.21.15.44:0/1992940934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa968071240 msgr2=0x7fa9681527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:51.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.140+0000 7fa96da00640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa968071240 0x7fa9681527c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c400 tx=0x7fa95800c8c0 comp rx=0 tx=0).stop 2024-03-30T13:12:51.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.140+0000 7fa96da00640 1 -- 172.21.15.44:0/1992940934 shutdown_connections 2024-03-30T13:12:51.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.140+0000 7fa96da00640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa94406c530 0x7fa94406e9f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:51.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.140+0000 7fa96da00640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa96815e540 0x7fa968161270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:51.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.140+0000 7fa96da00640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9680b3970 0x7fa9681520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:51.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.140+0000 7fa96da00640 1 --2- 172.21.15.44:0/1992940934 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa968071240 0x7fa9681527c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:51.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.140+0000 7fa96da00640 1 -- 172.21.15.44:0/1992940934 >> 172.21.15.44:0/1992940934 conn(0x7fa9680cfd90 msgr2=0x7fa9680adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:51.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.141+0000 7fa96da00640 1 -- 172.21.15.44:0/1992940934 shutdown_connections 2024-03-30T13:12:51.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.141+0000 7fa96da00640 1 -- 172.21.15.44:0/1992940934 wait complete. 2024-03-30T13:12:51.164 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining' 2024-03-30T13:12:51.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.386+0000 7f9a12800640 1 Processor -- start 2024-03-30T13:12:51.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.387+0000 7f9a12800640 1 -- start start 2024-03-30T13:12:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.388+0000 7f9a12800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9a0c0d0d30 0x7f9a0c0cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.388+0000 7f9a12800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9a0c0d4950 0x7f9a0c161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.388+0000 7f9a12800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a0c0b5b60 con 0x7f9a0c0d1110 2024-03-30T13:12:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.388+0000 7f9a12800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9a0c0c7b90 con 0x7f9a0c0d4950 2024-03-30T13:12:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.388+0000 7f9a12800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f9a0c0d4fc0 con 0x7f9a0c0d0d30 2024-03-30T13:12:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.389+0000 7f9a10a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9a0c0d4950 0x7f9a0c161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.389+0000 7f9a10a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9a0c0d4950 0x7f9a0c161760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37156/0 (socket says 172.21.15.44:37156) 2024-03-30T13:12:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.389+0000 7f9a10a00640 1 -- 172.21.15.44:0/2958832105 learned_addr learned my addr 172.21.15.44:0/2958832105 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.389+0000 7f9a11e00640 1 --1- 172.21.15.44:0/2958832105 >> v1:172.21.15.44:6789/0 conn(0x7f9a0c0d1110 0x7f9a0c0b3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40436/0 (socket says 172.21.15.44:40436) 2024-03-30T13:12:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.389+0000 7f9a11400640 1 --2- 172.21.15.44:0/2958832105 >> v2:172.21.15.151:3300/0 conn(0x7f9a0c0d0d30 0x7f9a0c0cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:51.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.389+0000 7f9a10a00640 1 -- 172.21.15.44:0/2958832105 >> v2:172.21.15.151:3300/0 conn(0x7f9a0c0d0d30 msgr2=0x7f9a0c0cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:51.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.389+0000 7f9a10a00640 1 --2- 172.21.15.44:0/2958832105 >> v2:172.21.15.151:3300/0 conn(0x7f9a0c0d0d30 0x7f9a0c0cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:51.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.389+0000 7f9a10a00640 1 -- 172.21.15.44:0/2958832105 >> v1:172.21.15.44:6789/0 conn(0x7f9a0c0d1110 legacy=0x7f9a0c0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:51.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.389+0000 7f9a10a00640 1 -- 172.21.15.44:0/2958832105 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c0b57f0 con 0x7f9a0c0d4950 2024-03-30T13:12:51.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.389+0000 7f9a11400640 1 --2- 172.21.15.44:0/2958832105 >> v2:172.21.15.151:3300/0 conn(0x7f9a0c0d0d30 0x7f9a0c0cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:51.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.389+0000 7f9a0be00640 1 -- 172.21.15.44:0/2958832105 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3050667999 0 0) 0x7f9a0c0b5b60 con 0x7f9a0c0d1110 2024-03-30T13:12:51.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.390+0000 7f9a10a00640 1 --2- 172.21.15.44:0/2958832105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a0c0d4950 0x7f9a0c161760 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c069040 tx=0x7f9a0002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2769b8a2800420 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:51.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.391+0000 7f9a0be00640 1 -- 172.21.15.44:0/2958832105 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00034070 con 0x7f9a0c0d4950 2024-03-30T13:12:51.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.391+0000 7f9a0be00640 1 -- 172.21.15.44:0/2958832105 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a00030860 con 0x7f9a0c0d4950 2024-03-30T13:12:51.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.391+0000 7f9a0be00640 1 -- 172.21.15.44:0/2958832105 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00030c30 con 0x7f9a0c0d4950 2024-03-30T13:12:51.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.391+0000 7f9a12800640 1 -- 172.21.15.44:0/2958832105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a0c0d4950 msgr2=0x7f9a0c161760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:51.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.391+0000 7f9a12800640 1 --2- 172.21.15.44:0/2958832105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a0c0d4950 0x7f9a0c161760 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c069040 tx=0x7f9a0002b9a0 comp rx=0 tx=0).stop 2024-03-30T13:12:51.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.391+0000 7f9a12800640 1 -- 172.21.15.44:0/2958832105 shutdown_connections 2024-03-30T13:12:51.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.391+0000 7f9a12800640 1 --2- 172.21.15.44:0/2958832105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a0c0d4950 0x7f9a0c161760 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:51.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.391+0000 7f9a12800640 1 --2- 172.21.15.44:0/2958832105 >> v2:172.21.15.151:3300/0 conn(0x7f9a0c0d0d30 0x7f9a0c0cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:51.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.391+0000 7f9a12800640 1 -- 172.21.15.44:0/2958832105 >> 172.21.15.44:0/2958832105 conn(0x7f9a0c09d570 msgr2=0x7f9a0c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:51.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.391+0000 7f9a12800640 1 -- 172.21.15.44:0/2958832105 shutdown_connections 2024-03-30T13:12:51.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.391+0000 7f9a12800640 1 -- 172.21.15.44:0/2958832105 wait complete. 2024-03-30T13:12:51.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.393+0000 7f9a12800640 1 Processor -- start 2024-03-30T13:12:51.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.393+0000 7f9a12800640 1 -- start start 2024-03-30T13:12:51.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.394+0000 7f9a12800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a0c0d0d30 0x7f9a0c154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:51.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.394+0000 7f9a12800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a0c0d1110 0x7f9a0c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:51.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.394+0000 7f9a12800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a0c0d4950 0x7f9a0c0cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:51.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.394+0000 7f9a12800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c0b3300 con 0x7f9a0c0d4950 2024-03-30T13:12:51.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.394+0000 7f9a12800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c0b3180 con 0x7f9a0c0d1110 2024-03-30T13:12:51.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.394+0000 7f9a12800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f9a0c0d3150 con 0x7f9a0c0d0d30 2024-03-30T13:12:51.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.395+0000 7f9a11e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a0c0d4950 0x7f9a0c0cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:51.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.395+0000 7f9a11e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a0c0d4950 0x7f9a0c0cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37172/0 (socket says 172.21.15.44:37172) 2024-03-30T13:12:51.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.395+0000 7f9a11e00640 1 -- 172.21.15.44:0/3763932007 learned_addr learned my addr 172.21.15.44:0/3763932007 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:51.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.395+0000 7f9a11400640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a0c0d0d30 0x7f9a0c154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:51.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.395+0000 7f9a10a00640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a0c0d1110 0x7f9a0c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:51.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.395+0000 7f9a11e00640 1 -- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a0c0d0d30 msgr2=0x7f9a0c154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:51.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.395+0000 7f9a11e00640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a0c0d0d30 0x7f9a0c154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:51.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.395+0000 7f9a11e00640 1 -- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a0c0d1110 msgr2=0x7f9a0c0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:51.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.395+0000 7f9a11e00640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a0c0d1110 0x7f9a0c0cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:51.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.395+0000 7f9a11e00640 1 -- 172.21.15.44:0/3763932007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c15c630 con 0x7f9a0c0d4950 2024-03-30T13:12:51.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.395+0000 7f9a11e00640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a0c0d4950 0x7f9a0c0cdd20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400c7a0 tx=0x7f9a0400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:51.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.396+0000 7f9a09600640 1 -- 172.21.15.44:0/3763932007 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a04018070 con 0x7f9a0c0d4950 2024-03-30T13:12:51.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.396+0000 7f9a09600640 1 -- 172.21.15.44:0/3763932007 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0400a640 con 0x7f9a0c0d4950 2024-03-30T13:12:51.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.396+0000 7f9a09600640 1 -- 172.21.15.44:0/3763932007 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400aa70 con 0x7f9a0c0d4950 2024-03-30T13:12:51.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.396+0000 7f9a12800640 1 -- 172.21.15.44:0/3763932007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0c15c910 con 0x7f9a0c0d4950 2024-03-30T13:12:51.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.396+0000 7f9a12800640 1 -- 172.21.15.44:0/3763932007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0c155040 con 0x7f9a0c0d4950 2024-03-30T13:12:51.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.397+0000 7f9a12800640 1 -- 172.21.15.44:0/3763932007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a0c075890 con 0x7f9a0c0d4950 2024-03-30T13:12:51.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.398+0000 7f9a09600640 1 -- 172.21.15.44:0/3763932007 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9a0400ac10 con 0x7f9a0c0d4950 2024-03-30T13:12:51.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.399+0000 7f9a09600640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f99f006c530 0x7f99f006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:51.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.399+0000 7f9a09600640 1 -- 172.21.15.44:0/3763932007 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f9a0408b210 con 0x7f9a0c0d4950 2024-03-30T13:12:51.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.400+0000 7f9a11400640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f99f006c530 0x7f99f006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:51.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.401+0000 7f9a11400640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f99f006c530 0x7f99f006e9f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00a990 tx=0x7f99fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:51.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.403+0000 7f9a09600640 1 -- 172.21.15.44:0/3763932007 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9a04059370 con 0x7f9a0c0d4950 2024-03-30T13:12:51.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:51.686+0000 7f9a12800640 1 -- 172.21.15.44:0/3763932007 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]} v 0) -- 0x7f9a0c0b4260 con 0x7f9a0c0d4950 2024-03-30T13:12:52.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.479+0000 7f9a09600640 1 -- 172.21.15.44:0/3763932007 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]}]=0 v84) ==== 150+0+0 (secure 0 0 0) 0x7f9a0405f020 con 0x7f9a0c0d4950 2024-03-30T13:12:52.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.483+0000 7f9a12800640 1 -- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f99f006c530 msgr2=0x7f99f006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:52.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.483+0000 7f9a12800640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f99f006c530 0x7f99f006e9f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00a990 tx=0x7f99fc008040 comp rx=0 tx=0).stop 2024-03-30T13:12:52.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.483+0000 7f9a12800640 1 -- 172.21.15.44:0/3763932007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a0c0d4950 msgr2=0x7f9a0c0cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:52.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.483+0000 7f9a12800640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a0c0d4950 0x7f9a0c0cdd20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400c7a0 tx=0x7f9a0400cc60 comp rx=0 tx=0).stop 2024-03-30T13:12:52.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.484+0000 7f9a12800640 1 -- 172.21.15.44:0/3763932007 shutdown_connections 2024-03-30T13:12:52.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.484+0000 7f9a12800640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a0c0d4950 0x7f9a0c0cdd20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.484+0000 7f9a12800640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f99f006c530 0x7f99f006e9f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.484+0000 7f9a12800640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a0c0d1110 0x7f9a0c0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.484+0000 7f9a12800640 1 --2- 172.21.15.44:0/3763932007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a0c0d0d30 0x7f9a0c154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.484+0000 7f9a12800640 1 -- 172.21.15.44:0/3763932007 >> 172.21.15.44:0/3763932007 conn(0x7f9a0c09d570 msgr2=0x7f9a0c159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.484+0000 7f9a12800640 1 -- 172.21.15.44:0/3763932007 shutdown_connections 2024-03-30T13:12:52.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.484+0000 7f9a12800640 1 -- 172.21.15.44:0/3763932007 wait complete. 2024-03-30T13:12:52.509 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-30T13:12:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.719+0000 7f2519800640 1 Processor -- start 2024-03-30T13:12:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.720+0000 7f2519800640 1 -- start start 2024-03-30T13:12:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.721+0000 7f2519800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f251415e540 0x7f25140acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.721+0000 7f2519800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f25140b3970 0x7f25140b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.721+0000 7f2519800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25140b4ef0 con 0x7f2514071240 2024-03-30T13:12:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.721+0000 7f2519800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f25140b4a30 con 0x7f25140b3970 2024-03-30T13:12:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.721+0000 7f2519800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f25140aef20 con 0x7f251415e540 2024-03-30T13:12:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.722+0000 7f2513e00640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f2514071240 0x7f2514071620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:46214/0 (socket says 172.21.15.44:46214) 2024-03-30T13:12:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.722+0000 7f2513e00640 1 -- 172.21.15.44:0/2339961942 learned_addr learned my addr 172.21.15.44:0/2339961942 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.722+0000 7f250be00640 1 --2- 172.21.15.44:0/2339961942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f251415e540 0x7f25140acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.722+0000 7f2518e00640 1 --2- 172.21.15.44:0/2339961942 >> v2:172.21.15.151:3300/0 conn(0x7f25140b3970 0x7f25140b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.723+0000 7f2513400640 1 -- 172.21.15.44:0/2339961942 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1701101097 0 0) 0x7f25140b4ef0 con 0x7f2514071240 2024-03-30T13:12:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.723+0000 7f2513400640 1 -- 172.21.15.44:0/2339961942 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24f8003520 con 0x7f2514071240 2024-03-30T13:12:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.723+0000 7f250be00640 1 -- 172.21.15.44:0/2339961942 >> v2:172.21.15.151:3300/0 conn(0x7f25140b3970 msgr2=0x7f25140b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.723+0000 7f250be00640 1 --2- 172.21.15.44:0/2339961942 >> v2:172.21.15.151:3300/0 conn(0x7f25140b3970 0x7f25140b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.723+0000 7f250be00640 1 -- 172.21.15.44:0/2339961942 >> v1:172.21.15.151:6789/0 conn(0x7f2514071240 legacy=0x7f2514071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.723+0000 7f250be00640 1 -- 172.21.15.44:0/2339961942 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25140b3f10 con 0x7f251415e540 2024-03-30T13:12:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.723+0000 7f2518e00640 1 --2- 172.21.15.44:0/2339961942 >> v2:172.21.15.151:3300/0 conn(0x7f25140b3970 0x7f25140b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:12:52.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.725+0000 7f250be00640 1 --2- 172.21.15.44:0/2339961942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f251415e540 0x7f25140acd60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0097a0 tx=0x7f24fc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0f913d73d2a1794 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:52.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.726+0000 7f2513400640 1 -- 172.21.15.44:0/2339961942 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc035020 con 0x7f251415e540 2024-03-30T13:12:52.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.726+0000 7f2513400640 1 -- 172.21.15.44:0/2339961942 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc031810 con 0x7f251415e540 2024-03-30T13:12:52.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.726+0000 7f2513400640 1 -- 172.21.15.44:0/2339961942 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc031be0 con 0x7f251415e540 2024-03-30T13:12:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.726+0000 7f2519800640 1 -- 172.21.15.44:0/2339961942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f251415e540 msgr2=0x7f25140acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.726+0000 7f2519800640 1 --2- 172.21.15.44:0/2339961942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f251415e540 0x7f25140acd60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0097a0 tx=0x7f24fc02b8b0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.726+0000 7f2519800640 1 -- 172.21.15.44:0/2339961942 shutdown_connections 2024-03-30T13:12:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.726+0000 7f2519800640 1 --2- 172.21.15.44:0/2339961942 >> v2:172.21.15.151:3300/0 conn(0x7f25140b3970 0x7f25140b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.726+0000 7f2519800640 1 --2- 172.21.15.44:0/2339961942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f251415e540 0x7f25140acd60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.726+0000 7f2519800640 1 -- 172.21.15.44:0/2339961942 >> 172.21.15.44:0/2339961942 conn(0x7f25140cfd90 msgr2=0x7f25140d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:52.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.726+0000 7f2519800640 1 -- 172.21.15.44:0/2339961942 shutdown_connections 2024-03-30T13:12:52.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.726+0000 7f2519800640 1 -- 172.21.15.44:0/2339961942 wait complete. 2024-03-30T13:12:52.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.728+0000 7f2519800640 1 Processor -- start 2024-03-30T13:12:52.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.728+0000 7f2519800640 1 -- start start 2024-03-30T13:12:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.729+0000 7f2519800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2514071240 0x7f251409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.729+0000 7f2519800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25140b3970 0x7f25141563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.729+0000 7f2519800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f251415e540 0x7f251406b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.729+0000 7f2519800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f251406d980 con 0x7f25140b3970 2024-03-30T13:12:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.729+0000 7f2519800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f251406d0e0 con 0x7f2514071240 2024-03-30T13:12:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.729+0000 7f2519800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f251406d610 con 0x7f251415e540 2024-03-30T13:12:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.729+0000 7f250be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25140b3970 0x7f25141563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.729+0000 7f250be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25140b3970 0x7f25141563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37188/0 (socket says 172.21.15.44:37188) 2024-03-30T13:12:52.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.729+0000 7f250be00640 1 -- 172.21.15.44:0/3811667126 learned_addr learned my addr 172.21.15.44:0/3811667126 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.730+0000 7f250be00640 1 -- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f251415e540 msgr2=0x7f251406b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.730+0000 7f2518e00640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f251415e540 0x7f251406b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.730+0000 7f250be00640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f251415e540 0x7f251406b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.730+0000 7f250be00640 1 -- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2514071240 msgr2=0x7f251409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.730+0000 7f2513e00640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2514071240 0x7f251409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.730+0000 7f250be00640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2514071240 0x7f251409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.730+0000 7f250be00640 1 -- 172.21.15.44:0/3811667126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251409b330 con 0x7f25140b3970 2024-03-30T13:12:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.730+0000 7f250be00640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25140b3970 0x7f25141563a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f24fc02bec0 tx=0x7f24fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.730+0000 7f2510c00640 1 -- 172.21.15.44:0/3811667126 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc035040 con 0x7f25140b3970 2024-03-30T13:12:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.730+0000 7f2510c00640 1 -- 172.21.15.44:0/3811667126 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc03ad00 con 0x7f25140b3970 2024-03-30T13:12:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.730+0000 7f2510c00640 1 -- 172.21.15.44:0/3811667126 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc045650 con 0x7f25140b3970 2024-03-30T13:12:52.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.731+0000 7f2519800640 1 -- 172.21.15.44:0/3811667126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f251409b610 con 0x7f25140b3970 2024-03-30T13:12:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.731+0000 7f2519800640 1 -- 172.21.15.44:0/3811667126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f251409bbd0 con 0x7f25140b3970 2024-03-30T13:12:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.732+0000 7f2519800640 1 -- 172.21.15.44:0/3811667126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2514075890 con 0x7f25140b3970 2024-03-30T13:12:52.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.733+0000 7f2510c00640 1 -- 172.21.15.44:0/3811667126 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f24fc038020 con 0x7f25140b3970 2024-03-30T13:12:52.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.734+0000 7f2510c00640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f24f006c530 0x7f24f006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:52.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.734+0000 7f2510c00640 1 -- 172.21.15.44:0/3811667126 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f24fc0ad950 con 0x7f25140b3970 2024-03-30T13:12:52.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.735+0000 7f2513e00640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f24f006c530 0x7f24f006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:52.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.736+0000 7f2513e00640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f24f006c530 0x7f24f006e9f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2514161980 tx=0x7f2504009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:52.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.738+0000 7f2510c00640 1 -- 172.21.15.44:0/3811667126 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f24fc07bab0 con 0x7f25140b3970 2024-03-30T13:12:52.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.943+0000 7f2519800640 1 -- 172.21.15.44:0/3811667126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f25140d0210 con 0x7f25140b3970 2024-03-30T13:12:52.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.950+0000 7f2510c00640 1 -- 172.21.15.44:0/3811667126 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f24fc07b3b0 con 0x7f25140b3970 2024-03-30T13:12:52.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.952+0000 7f2519800640 1 -- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f24f006c530 msgr2=0x7f24f006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:52.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.953+0000 7f2519800640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f24f006c530 0x7f24f006e9f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2514161980 tx=0x7f2504009040 comp rx=0 tx=0).stop 2024-03-30T13:12:52.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.953+0000 7f2519800640 1 -- 172.21.15.44:0/3811667126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25140b3970 msgr2=0x7f25141563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:52.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.953+0000 7f2519800640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25140b3970 0x7f25141563a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f24fc02bec0 tx=0x7f24fc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.953+0000 7f2519800640 1 -- 172.21.15.44:0/3811667126 shutdown_connections 2024-03-30T13:12:52.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.953+0000 7f2519800640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f251415e540 0x7f251406b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.953+0000 7f2519800640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25140b3970 0x7f25141563a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.953+0000 7f2519800640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f24f006c530 0x7f24f006e9f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.953+0000 7f2519800640 1 --2- 172.21.15.44:0/3811667126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2514071240 0x7f251409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:52.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.953+0000 7f2519800640 1 -- 172.21.15.44:0/3811667126 >> 172.21.15.44:0/3811667126 conn(0x7f25140cfd90 msgr2=0x7f25140b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:52.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.953+0000 7f2519800640 1 -- 172.21.15.44:0/3811667126 shutdown_connections 2024-03-30T13:12:52.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:52.953+0000 7f2519800640 1 -- 172.21.15.44:0/3811667126 wait complete. 2024-03-30T13:12:52.976 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-30T13:12:52.976 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T13:12:53.099 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T13:12:53.227 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-30T13:12:53.227 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:12:53.227 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:53.288 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:12:53.289 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:53.348 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:12:53.348 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:53.406 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:53.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.627+0000 7efd63c00640 1 Processor -- start 2024-03-30T13:12:53.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.627+0000 7efd63c00640 1 -- start start 2024-03-30T13:12:53.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.629+0000 7efd63c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efd5c0ced60 0x7efd5c162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:53.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.629+0000 7efd63c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5c163030 con 0x7efd5c0cf140 2024-03-30T13:12:53.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.629+0000 7efd63c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd5c0c9760 con 0x7efd5c0735e0 2024-03-30T13:12:53.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.629+0000 7efd63c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7efd5c1480c0 con 0x7efd5c0ced60 2024-03-30T13:12:53.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.629+0000 7efd5be00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7efd5c0cf140 0x7efd5c072ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40446/0 (socket says 172.21.15.44:40446) 2024-03-30T13:12:53.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.629+0000 7efd5be00640 1 -- 172.21.15.44:0/4279647846 learned_addr learned my addr 172.21.15.44:0/4279647846 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:53.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.630+0000 7efd61200640 1 --2- 172.21.15.44:0/4279647846 >> v2:172.21.15.151:3300/0 conn(0x7efd5c0ced60 0x7efd5c162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:53.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.630+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222130476 0 0) 0x7efd48001110 con 0x7efd5c0cf140 2024-03-30T13:12:53.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.630+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd44003520 con 0x7efd5c0cf140 2024-03-30T13:12:53.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.630+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3252746794 0 0) 0x7efd44003520 con 0x7efd5c0cf140 2024-03-30T13:12:53.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.630+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 >> v2:172.21.15.151:3300/0 conn(0x7efd5c0ced60 msgr2=0x7efd5c162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:53.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.630+0000 7efd5b400640 1 --2- 172.21.15.44:0/4279647846 >> v2:172.21.15.151:3300/0 conn(0x7efd5c0ced60 0x7efd5c162af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:53.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.630+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 >> v1:172.21.15.151:6789/0 conn(0x7efd5c0735e0 legacy=0x7efd5c071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.630+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c0c9a40 con 0x7efd5c0cf140 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.630+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7efd48001840 con 0x7efd5c0cf140 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.630+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 >> v1:172.21.15.44:6789/0 conn(0x7efd5c0cf140 legacy=0x7efd5c072ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd5b400640 1 --2- 172.21.15.44:0/4279647846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd440039b0 0x7efd44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd5b400640 1 --2- 172.21.15.44:0/4279647846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd44004800 0x7efd44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd5b400640 1 --2- 172.21.15.44:0/4279647846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 0x7efd4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd4400c030 con 0x7efd440051c0 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efd4400c1e0 con 0x7efd440039b0 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7efd4400c3e0 con 0x7efd44004800 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd61c00640 1 --2- 172.21.15.44:0/4279647846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 0x7efd4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd5be00640 1 --2- 172.21.15.44:0/4279647846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd44004800 0x7efd44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd61c00640 1 -- 172.21.15.44:0/4279647846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd44004800 msgr2=0x7efd44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd61c00640 1 --2- 172.21.15.44:0/4279647846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd44004800 0x7efd44004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:53.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd61c00640 1 -- 172.21.15.44:0/4279647846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd440039b0 msgr2=0x7efd44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:53.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd61c00640 1 --2- 172.21.15.44:0/4279647846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd440039b0 0x7efd44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:53.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.631+0000 7efd61c00640 1 -- 172.21.15.44:0/4279647846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd44003520 con 0x7efd440051c0 2024-03-30T13:12:53.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.632+0000 7efd61c00640 1 -- 172.21.15.44:0/4279647846 reap_dead start 2024-03-30T13:12:53.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.632+0000 7efd61c00640 1 --2- 172.21.15.44:0/4279647846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 0x7efd4400b9c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efd54001e20 tx=0x7efd44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf806ff3b46d5c38 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:53.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.633+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54001a70 con 0x7efd440051c0 2024-03-30T13:12:53.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.633+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd54003b70 con 0x7efd440051c0 2024-03-30T13:12:53.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.633+0000 7efd5b400640 1 -- 172.21.15.44:0/4279647846 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540050d0 con 0x7efd440051c0 2024-03-30T13:12:53.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.633+0000 7efd63c00640 1 -- 172.21.15.44:0/4279647846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 msgr2=0x7efd4400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:53.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.633+0000 7efd63c00640 1 --2- 172.21.15.44:0/4279647846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 0x7efd4400b9c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efd54001e20 tx=0x7efd44005830 comp rx=0 tx=0).stop 2024-03-30T13:12:53.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.633+0000 7efd63c00640 1 -- 172.21.15.44:0/4279647846 shutdown_connections 2024-03-30T13:12:53.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.633+0000 7efd63c00640 1 --2- 172.21.15.44:0/4279647846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 0x7efd4400b9c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:53.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.633+0000 7efd63c00640 1 -- 172.21.15.44:0/4279647846 >> 172.21.15.44:0/4279647846 conn(0x7efd5c0b1c90 msgr2=0x7efd5c0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:53.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.633+0000 7efd63c00640 1 -- 172.21.15.44:0/4279647846 shutdown_connections 2024-03-30T13:12:53.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.633+0000 7efd63c00640 1 -- 172.21.15.44:0/4279647846 wait complete. 2024-03-30T13:12:53.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.635+0000 7efd63c00640 1 Processor -- start 2024-03-30T13:12:53.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.635+0000 7efd63c00640 1 -- start start 2024-03-30T13:12:53.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.636+0000 7efd63c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 0x7efd5c1f7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:53.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.636+0000 7efd63c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5c13f8d0 0x7efd5c0cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:53.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.636+0000 7efd63c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd5c15d8c0 0x7efd5c160b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:53.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.636+0000 7efd63c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c0ca2e0 con 0x7efd440051c0 2024-03-30T13:12:53.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.636+0000 7efd63c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c0ca000 con 0x7efd5c13f8d0 2024-03-30T13:12:53.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.636+0000 7efd63c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7efd5c0c9310 con 0x7efd5c15d8c0 2024-03-30T13:12:53.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.636+0000 7efd61200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 0x7efd5c1f7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:53.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.637+0000 7efd61200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 0x7efd5c1f7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37192/0 (socket says 172.21.15.44:37192) 2024-03-30T13:12:53.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.637+0000 7efd61200640 1 -- 172.21.15.44:0/2724883348 learned_addr learned my addr 172.21.15.44:0/2724883348 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:53.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.637+0000 7efd61c00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd5c15d8c0 0x7efd5c160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:53.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.637+0000 7efd61200640 1 -- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd5c15d8c0 msgr2=0x7efd5c160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:53.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.637+0000 7efd5be00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5c13f8d0 0x7efd5c0cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:53.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.637+0000 7efd61200640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd5c15d8c0 0x7efd5c160b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:53.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.637+0000 7efd61200640 1 -- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5c13f8d0 msgr2=0x7efd5c0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:53.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.637+0000 7efd61200640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5c13f8d0 0x7efd5c0cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:53.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.637+0000 7efd61200640 1 -- 172.21.15.44:0/2724883348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c1f8470 con 0x7efd440051c0 2024-03-30T13:12:53.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.637+0000 7efd61c00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd5c15d8c0 0x7efd5c160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:53.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.637+0000 7efd5be00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5c13f8d0 0x7efd5c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:53.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.637+0000 7efd61200640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 0x7efd5c1f7b20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd5000e7a0 tx=0x7efd5000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:53.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.638+0000 7efd58c00640 1 -- 172.21.15.44:0/2724883348 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50017070 con 0x7efd440051c0 2024-03-30T13:12:53.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.638+0000 7efd58c00640 1 -- 172.21.15.44:0/2724883348 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5000c940 con 0x7efd440051c0 2024-03-30T13:12:53.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.638+0000 7efd58c00640 1 -- 172.21.15.44:0/2724883348 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5000cd10 con 0x7efd440051c0 2024-03-30T13:12:53.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.638+0000 7efd63c00640 1 -- 172.21.15.44:0/2724883348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c1f8750 con 0x7efd440051c0 2024-03-30T13:12:53.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.638+0000 7efd63c00640 1 -- 172.21.15.44:0/2724883348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c1f8060 con 0x7efd440051c0 2024-03-30T13:12:53.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.639+0000 7efd63c00640 1 -- 172.21.15.44:0/2724883348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd5c0759f0 con 0x7efd440051c0 2024-03-30T13:12:53.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.640+0000 7efd58c00640 1 -- 172.21.15.44:0/2724883348 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7efd5001a070 con 0x7efd440051c0 2024-03-30T13:12:53.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.641+0000 7efd58c00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efd3c06c560 0x7efd3c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:53.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.641+0000 7efd58c00640 1 -- 172.21.15.44:0/2724883348 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7efd5008bd30 con 0x7efd440051c0 2024-03-30T13:12:53.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.641+0000 7efd5be00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efd3c06c560 0x7efd3c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:53.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.643+0000 7efd5be00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efd3c06c560 0x7efd3c06ea20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efd48001eb0 tx=0x7efd48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:53.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.645+0000 7efd58c00640 1 -- 172.21.15.44:0/2724883348 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7efd50059f20 con 0x7efd440051c0 2024-03-30T13:12:53.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.883+0000 7efd63c00640 1 -- 172.21.15.44:0/2724883348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd5c072db0 con 0x7efd440051c0 2024-03-30T13:12:53.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.887+0000 7efd58c00640 1 -- 172.21.15.44:0/2724883348 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18927 (secure 0 0 0) 0x7efd50059820 con 0x7efd440051c0 2024-03-30T13:12:53.891 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:53.891 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":29,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:12:27.323786+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:53.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.890+0000 7efd63c00640 1 -- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efd3c06c560 msgr2=0x7efd3c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:53.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.890+0000 7efd63c00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efd3c06c560 0x7efd3c06ea20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efd48001eb0 tx=0x7efd48009040 comp rx=0 tx=0).stop 2024-03-30T13:12:53.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.890+0000 7efd63c00640 1 -- 172.21.15.44:0/2724883348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 msgr2=0x7efd5c1f7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:53.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.890+0000 7efd63c00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 0x7efd5c1f7b20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efd5000e7a0 tx=0x7efd5000ec60 comp rx=0 tx=0).stop 2024-03-30T13:12:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.890+0000 7efd63c00640 1 -- 172.21.15.44:0/2724883348 shutdown_connections 2024-03-30T13:12:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.890+0000 7efd63c00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd5c15d8c0 0x7efd5c160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.890+0000 7efd63c00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efd3c06c560 0x7efd3c06ea20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.890+0000 7efd63c00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd5c13f8d0 0x7efd5c0cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.890+0000 7efd63c00640 1 --2- 172.21.15.44:0/2724883348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efd440051c0 0x7efd5c1f7b20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.890+0000 7efd63c00640 1 -- 172.21.15.44:0/2724883348 >> 172.21.15.44:0/2724883348 conn(0x7efd5c0b1c90 msgr2=0x7efd5c071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.890+0000 7efd63c00640 1 -- 172.21.15.44:0/2724883348 shutdown_connections 2024-03-30T13:12:53.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:53.890+0000 7efd63c00640 1 -- 172.21.15.44:0/2724883348 wait complete. 2024-03-30T13:12:53.914 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:12:53.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:12:54.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.122+0000 7f44c7000640 1 Processor -- start 2024-03-30T13:12:54.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.122+0000 7f44c7000640 1 -- start start 2024-03-30T13:12:54.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.123+0000 7f44c7000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f44c015c040 0x7f44c015f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.123+0000 7f44c7000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d18f0 0x7f44c00d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.123+0000 7f44c7000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c00d32b0 con 0x7f44c00d46b0 2024-03-30T13:12:54.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.123+0000 7f44c7000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f44c00d2210 con 0x7f44c015c040 2024-03-30T13:12:54.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.123+0000 7f44c7000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f44c00d24f0 con 0x7f44c00d18f0 2024-03-30T13:12:54.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.124+0000 7f44c5200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d18f0 0x7f44c00d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.124+0000 7f44c5200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d18f0 0x7f44c00d4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:54248/0 (socket says 172.21.15.44:54248) 2024-03-30T13:12:54.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.124+0000 7f44c5200640 1 -- 172.21.15.44:0/94007164 learned_addr learned my addr 172.21.15.44:0/94007164 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:54.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.124+0000 7f44c5c00640 1 --2- 172.21.15.44:0/94007164 >> v2:172.21.15.151:3300/0 conn(0x7f44c015c040 0x7f44c015f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.125+0000 7f44bfe00640 1 -- 172.21.15.44:0/94007164 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1816669600 0 0) 0x7f44c00d32b0 con 0x7f44c00d46b0 2024-03-30T13:12:54.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.125+0000 7f44bfe00640 1 -- 172.21.15.44:0/94007164 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44a8003520 con 0x7f44c00d46b0 2024-03-30T13:12:54.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.125+0000 7f44c5200640 1 -- 172.21.15.44:0/94007164 >> v2:172.21.15.151:3300/0 conn(0x7f44c015c040 msgr2=0x7f44c015f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:54.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.125+0000 7f44c5200640 1 --2- 172.21.15.44:0/94007164 >> v2:172.21.15.151:3300/0 conn(0x7f44c015c040 0x7f44c015f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.125+0000 7f44c5200640 1 -- 172.21.15.44:0/94007164 >> v1:172.21.15.151:6789/0 conn(0x7f44c00d46b0 legacy=0x7f44c00b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:54.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.125+0000 7f44c5200640 1 -- 172.21.15.44:0/94007164 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c00d27d0 con 0x7f44c00d18f0 2024-03-30T13:12:54.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.127+0000 7f44c5200640 1 --2- 172.21.15.44:0/94007164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d18f0 0x7f44c00d4170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f44ac009870 tx=0x7f44ac02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=426ab088cb2e2bae server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.127+0000 7f44bfe00640 1 -- 172.21.15.44:0/94007164 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac035020 con 0x7f44c00d18f0 2024-03-30T13:12:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.128+0000 7f44bfe00640 1 -- 172.21.15.44:0/94007164 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ac031640 con 0x7f44c00d18f0 2024-03-30T13:12:54.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.128+0000 7f44bfe00640 1 -- 172.21.15.44:0/94007164 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac02d040 con 0x7f44c00d18f0 2024-03-30T13:12:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.128+0000 7f44c7000640 1 -- 172.21.15.44:0/94007164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d18f0 msgr2=0x7f44c00d4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.128+0000 7f44c7000640 1 --2- 172.21.15.44:0/94007164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d18f0 0x7f44c00d4170 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f44ac009870 tx=0x7f44ac02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.128+0000 7f44c7000640 1 -- 172.21.15.44:0/94007164 shutdown_connections 2024-03-30T13:12:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.128+0000 7f44c7000640 1 --2- 172.21.15.44:0/94007164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d18f0 0x7f44c00d4170 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.128+0000 7f44c7000640 1 --2- 172.21.15.44:0/94007164 >> v2:172.21.15.151:3300/0 conn(0x7f44c015c040 0x7f44c015f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.128+0000 7f44c7000640 1 -- 172.21.15.44:0/94007164 >> 172.21.15.44:0/94007164 conn(0x7f44c008dbf0 msgr2=0x7f44c009d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:54.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.128+0000 7f44c7000640 1 -- 172.21.15.44:0/94007164 shutdown_connections 2024-03-30T13:12:54.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.128+0000 7f44c7000640 1 -- 172.21.15.44:0/94007164 wait complete. 2024-03-30T13:12:54.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.130+0000 7f44c7000640 1 Processor -- start 2024-03-30T13:12:54.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.130+0000 7f44c7000640 1 -- start start 2024-03-30T13:12:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.131+0000 7f44c7000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44c00d18f0 0x7f44c00b8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.131+0000 7f44c7000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d46b0 0x7f44c00b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.131+0000 7f44c7000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44c015c040 0x7f44c00b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.131+0000 7f44c7000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f44c015c420 con 0x7f44c015c040 2024-03-30T13:12:54.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.131+0000 7f44c7000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f44c00d2d90 con 0x7f44c00d18f0 2024-03-30T13:12:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.131+0000 7f44c7000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f44c015f8a0 con 0x7f44c00d46b0 2024-03-30T13:12:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.132+0000 7f44c6600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44c015c040 0x7f44c00b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.132+0000 7f44c6600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44c015c040 0x7f44c00b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37206/0 (socket says 172.21.15.44:37206) 2024-03-30T13:12:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.132+0000 7f44c6600640 1 -- 172.21.15.44:0/3478906631 learned_addr learned my addr 172.21.15.44:0/3478906631 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:54.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.132+0000 7f44c5c00640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44c00d18f0 0x7f44c00b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.132+0000 7f44c5200640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d46b0 0x7f44c00b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.132+0000 7f44c6600640 1 -- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d46b0 msgr2=0x7f44c00b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.132+0000 7f44c6600640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d46b0 0x7f44c00b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.132+0000 7f44c6600640 1 -- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44c00d18f0 msgr2=0x7f44c00b8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.132+0000 7f44c6600640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44c00d18f0 0x7f44c00b8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.132+0000 7f44c6600640 1 -- 172.21.15.44:0/3478906631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c00cd4e0 con 0x7f44c015c040 2024-03-30T13:12:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.132+0000 7f44c5200640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d46b0 0x7f44c00b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.132+0000 7f44c6600640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44c015c040 0x7f44c00b56c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f44b800c790 tx=0x7f44b800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.133+0000 7f44bd600640 1 -- 172.21.15.44:0/3478906631 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8003b70 con 0x7f44c015c040 2024-03-30T13:12:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.133+0000 7f44bd600640 1 -- 172.21.15.44:0/3478906631 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b8003d10 con 0x7f44c015c040 2024-03-30T13:12:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.133+0000 7f44bd600640 1 -- 172.21.15.44:0/3478906631 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b800aa50 con 0x7f44c015c040 2024-03-30T13:12:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.133+0000 7f44c7000640 1 -- 172.21.15.44:0/3478906631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c00cd7c0 con 0x7f44c015c040 2024-03-30T13:12:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.133+0000 7f44c7000640 1 -- 172.21.15.44:0/3478906631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c00cdd80 con 0x7f44c015c040 2024-03-30T13:12:54.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.134+0000 7f44c7000640 1 -- 172.21.15.44:0/3478906631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c00c75a0 con 0x7f44c015c040 2024-03-30T13:12:54.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.135+0000 7f44bd600640 1 -- 172.21.15.44:0/3478906631 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f44b800abf0 con 0x7f44c015c040 2024-03-30T13:12:54.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.136+0000 7f44bd600640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f44a006c530 0x7f44a006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.136+0000 7f44bd600640 1 -- 172.21.15.44:0/3478906631 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f44b808bb40 con 0x7f44c015c040 2024-03-30T13:12:54.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.137+0000 7f44c5c00640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f44a006c530 0x7f44a006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.138+0000 7f44c5c00640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f44a006c530 0x7f44a006e9f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009ad0 tx=0x7f44b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:54.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.141+0000 7f44bd600640 1 -- 172.21.15.44:0/3478906631 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f44c00c75a0 con 0x7f44c015c040 2024-03-30T13:12:54.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.347+0000 7f44c7000640 1 -- 172.21.15.44:0/3478906631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f44c01f43e0 con 0x7f44c015c040 2024-03-30T13:12:54.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.348+0000 7f44bd600640 1 -- 172.21.15.44:0/3478906631 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f44b8059ca0 con 0x7f44c015c040 2024-03-30T13:12:54.351 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:12:54.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.351+0000 7f44c7000640 1 -- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f44a006c530 msgr2=0x7f44a006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:54.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.351+0000 7f44c7000640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f44a006c530 0x7f44a006e9f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009ad0 tx=0x7f44b4008040 comp rx=0 tx=0).stop 2024-03-30T13:12:54.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.351+0000 7f44c7000640 1 -- 172.21.15.44:0/3478906631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44c015c040 msgr2=0x7f44c00b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:54.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.351+0000 7f44c7000640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44c015c040 0x7f44c00b56c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f44b800c790 tx=0x7f44b800cc50 comp rx=0 tx=0).stop 2024-03-30T13:12:54.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.351+0000 7f44c7000640 1 -- 172.21.15.44:0/3478906631 shutdown_connections 2024-03-30T13:12:54.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.351+0000 7f44c7000640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44c015c040 0x7f44c00b56c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.351+0000 7f44c7000640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44c00d46b0 0x7f44c00b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.351+0000 7f44c7000640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f44a006c530 0x7f44a006e9f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.351+0000 7f44c7000640 1 --2- 172.21.15.44:0/3478906631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44c00d18f0 0x7f44c00b8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.351+0000 7f44c7000640 1 -- 172.21.15.44:0/3478906631 >> 172.21.15.44:0/3478906631 conn(0x7f44c008dbf0 msgr2=0x7f44c015d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:54.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.351+0000 7f44c7000640 1 -- 172.21.15.44:0/3478906631 shutdown_connections 2024-03-30T13:12:54.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.351+0000 7f44c7000640 1 -- 172.21.15.44:0/3478906631 wait complete. 2024-03-30T13:12:54.377 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:12:54.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.588+0000 7f5594800640 1 Processor -- start 2024-03-30T13:12:54.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.589+0000 7f5594800640 1 -- start start 2024-03-30T13:12:54.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.590+0000 7f5594800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c0ba090 0x7f558c0d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.590+0000 7f5594800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f558c0b73d0 0x7f558c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.590+0000 7f5594800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f558c0d2ff0 con 0x7f558c0b5dc0 2024-03-30T13:12:54.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.590+0000 7f5594800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f558c0d32d0 con 0x7f558c0b73d0 2024-03-30T13:12:54.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.590+0000 7f5594800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f558c0d35b0 con 0x7f558c0ba090 2024-03-30T13:12:54.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.590+0000 7f5591e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f558c0b5dc0 0x7f558c0b61a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40448/0 (socket says 172.21.15.44:40448) 2024-03-30T13:12:54.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.590+0000 7f5591e00640 1 -- 172.21.15.44:0/1071911390 learned_addr learned my addr 172.21.15.44:0/1071911390 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:54.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.591+0000 7f5591400640 1 --2- 172.21.15.44:0/1071911390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c0ba090 0x7f558c0d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.591+0000 7f5592800640 1 --2- 172.21.15.44:0/1071911390 >> v2:172.21.15.151:3300/0 conn(0x7f558c0b73d0 0x7f558c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.591+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 873171172 0 0) 0x7f558c0d2ff0 con 0x7f558c0b5dc0 2024-03-30T13:12:54.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.591+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5574003520 con 0x7f558c0b5dc0 2024-03-30T13:12:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.591+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 290536812 0 0) 0x7f5574003520 con 0x7f558c0b5dc0 2024-03-30T13:12:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.591+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c0ba090 msgr2=0x7f558c0d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.591+0000 7f5590a00640 1 --2- 172.21.15.44:0/1071911390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c0ba090 0x7f558c0d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.591+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 >> v2:172.21.15.151:3300/0 conn(0x7f558c0b73d0 msgr2=0x7f558c0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.591+0000 7f5590a00640 1 --2- 172.21.15.44:0/1071911390 >> v2:172.21.15.151:3300/0 conn(0x7f558c0b73d0 0x7f558c0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.591+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558c0d3890 con 0x7f558c0b5dc0 2024-03-30T13:12:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.591+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f557c001670 con 0x7f558c0b5dc0 2024-03-30T13:12:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.591+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 >> v1:172.21.15.44:6789/0 conn(0x7f558c0b5dc0 legacy=0x7f558c0b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:54.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5590a00640 1 --2- 172.21.15.44:0/1071911390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55740039b0 0x7f5574003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5590a00640 1 --2- 172.21.15.44:0/1071911390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5574004800 0x7f5574004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5590a00640 1 --2- 172.21.15.44:0/1071911390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c0ba090 0x7f55740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f558c0d32d0 con 0x7f5574004800 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f558c0d35b0 con 0x7f55740039b0 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f557400b9c0 con 0x7f558c0ba090 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5591400640 1 --2- 172.21.15.44:0/1071911390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5574004800 0x7f5574004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5592800640 1 --2- 172.21.15.44:0/1071911390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c0ba090 0x7f55740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5591400640 1 -- 172.21.15.44:0/1071911390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c0ba090 msgr2=0x7f55740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5591400640 1 --2- 172.21.15.44:0/1071911390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c0ba090 0x7f55740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5591400640 1 -- 172.21.15.44:0/1071911390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55740039b0 msgr2=0x7f5574003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5591400640 1 --2- 172.21.15.44:0/1071911390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55740039b0 0x7f5574003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.592+0000 7f5591400640 1 -- 172.21.15.44:0/1071911390 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5574003520 con 0x7f5574004800 2024-03-30T13:12:54.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.594+0000 7f5591400640 1 --2- 172.21.15.44:0/1071911390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5574004800 0x7f5574004c80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5580009a90 tx=0x7f5574005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7bde82dcaec02f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:54.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.594+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580039070 con 0x7f5574004800 2024-03-30T13:12:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.594+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f558002c680 con 0x7f5574004800 2024-03-30T13:12:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.594+0000 7f5590a00640 1 -- 172.21.15.44:0/1071911390 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580009690 con 0x7f5574004800 2024-03-30T13:12:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.595+0000 7f5594800640 1 -- 172.21.15.44:0/1071911390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5574004800 msgr2=0x7f5574004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.595+0000 7f5594800640 1 --2- 172.21.15.44:0/1071911390 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5574004800 0x7f5574004c80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5580009a90 tx=0x7f5574005830 comp rx=0 tx=0).stop 2024-03-30T13:12:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.595+0000 7f5592800640 1 -- 172.21.15.44:0/1071911390 reap_dead start 2024-03-30T13:12:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.595+0000 7f5594800640 1 -- 172.21.15.44:0/1071911390 shutdown_connections 2024-03-30T13:12:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.595+0000 7f5594800640 1 -- 172.21.15.44:0/1071911390 >> 172.21.15.44:0/1071911390 conn(0x7f558c0678f0 msgr2=0x7f558c0d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.595+0000 7f5594800640 1 -- 172.21.15.44:0/1071911390 shutdown_connections 2024-03-30T13:12:54.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.595+0000 7f5594800640 1 -- 172.21.15.44:0/1071911390 wait complete. 2024-03-30T13:12:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.597+0000 7f5594800640 1 Processor -- start 2024-03-30T13:12:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.597+0000 7f5594800640 1 -- start start 2024-03-30T13:12:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.598+0000 7f5594800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5574004800 0x7f558c158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.598+0000 7f5594800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c15b640 0x7f558c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.598+0000 7f5594800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f558c15f590 0x7f558c15fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.598+0000 7f5594800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f558c15e880 con 0x7f5574004800 2024-03-30T13:12:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.598+0000 7f5594800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f558c0d4090 con 0x7f558c15f590 2024-03-30T13:12:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.598+0000 7f5594800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f558c15ea00 con 0x7f558c15b640 2024-03-30T13:12:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.598+0000 7f5591e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5574004800 0x7f558c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.598+0000 7f5591e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5574004800 0x7f558c158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37228/0 (socket says 172.21.15.44:37228) 2024-03-30T13:12:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.598+0000 7f5591e00640 1 -- 172.21.15.44:0/3590257628 learned_addr learned my addr 172.21.15.44:0/3590257628 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.598+0000 7f5592800640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f558c15f590 0x7f558c15fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.598+0000 7f5591400640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c15b640 0x7f558c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.599+0000 7f5591e00640 1 -- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c15b640 msgr2=0x7f558c15bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.599+0000 7f5591e00640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c15b640 0x7f558c15bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.599+0000 7f5591e00640 1 -- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f558c15f590 msgr2=0x7f558c15fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.599+0000 7f5591e00640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f558c15f590 0x7f558c15fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.599+0000 7f5591e00640 1 -- 172.21.15.44:0/3590257628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558c160280 con 0x7f5574004800 2024-03-30T13:12:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.599+0000 7f5591e00640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5574004800 0x7f558c158320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c7d0 tx=0x7f557c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.599+0000 7f5586000640 1 -- 172.21.15.44:0/3590257628 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c018070 con 0x7f5574004800 2024-03-30T13:12:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.599+0000 7f5586000640 1 -- 172.21.15.44:0/3590257628 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f557c0074e0 con 0x7f5574004800 2024-03-30T13:12:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.599+0000 7f5594800640 1 -- 172.21.15.44:0/3590257628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558c147610 con 0x7f5574004800 2024-03-30T13:12:54.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.599+0000 7f5586000640 1 -- 172.21.15.44:0/3590257628 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c004a20 con 0x7f5574004800 2024-03-30T13:12:54.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.599+0000 7f5594800640 1 -- 172.21.15.44:0/3590257628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f558c147bd0 con 0x7f5574004800 2024-03-30T13:12:54.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.601+0000 7f5594800640 1 -- 172.21.15.44:0/3590257628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f558c147dd0 con 0x7f5574004800 2024-03-30T13:12:54.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.602+0000 7f5586000640 1 -- 172.21.15.44:0/3590257628 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f557c01b070 con 0x7f5574004800 2024-03-30T13:12:54.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.603+0000 7f5586000640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f557006c560 0x7f557006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:54.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.603+0000 7f5586000640 1 -- 172.21.15.44:0/3590257628 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f557c08b170 con 0x7f5574004800 2024-03-30T13:12:54.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.604+0000 7f5591400640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f557006c560 0x7f557006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:54.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.605+0000 7f5591400640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f557006c560 0x7f557006ea20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5580036000 tx=0x7f5580030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:54.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.607+0000 7f5586000640 1 -- 172.21.15.44:0/3590257628 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f558c147dd0 con 0x7f5574004800 2024-03-30T13:12:54.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.818+0000 7f5594800640 1 -- 172.21.15.44:0/3590257628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f558c075890 con 0x7f5574004800 2024-03-30T13:12:54.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.819+0000 7f5586000640 1 -- 172.21.15.44:0/3590257628 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f557c0592d0 con 0x7f5574004800 2024-03-30T13:12:54.823 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.822+0000 7f5594800640 1 -- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f557006c560 msgr2=0x7f557006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.822+0000 7f5594800640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f557006c560 0x7f557006ea20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5580036000 tx=0x7f5580030000 comp rx=0 tx=0).stop 2024-03-30T13:12:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.822+0000 7f5594800640 1 -- 172.21.15.44:0/3590257628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5574004800 msgr2=0x7f558c158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.822+0000 7f5594800640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5574004800 0x7f558c158320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c7d0 tx=0x7f557c00cc90 comp rx=0 tx=0).stop 2024-03-30T13:12:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.822+0000 7f5594800640 1 -- 172.21.15.44:0/3590257628 shutdown_connections 2024-03-30T13:12:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.822+0000 7f5594800640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f557006c560 0x7f557006ea20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.822+0000 7f5594800640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f558c15f590 0x7f558c15fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.822+0000 7f5594800640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558c15b640 0x7f558c15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.822+0000 7f5594800640 1 --2- 172.21.15.44:0/3590257628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5574004800 0x7f558c158320 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.822+0000 7f5594800640 1 -- 172.21.15.44:0/3590257628 >> 172.21.15.44:0/3590257628 conn(0x7f558c0678f0 msgr2=0x7f558c0b7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.822+0000 7f5594800640 1 -- 172.21.15.44:0/3590257628 shutdown_connections 2024-03-30T13:12:54.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:54.822+0000 7f5594800640 1 -- 172.21.15.44:0/3590257628 wait complete. 2024-03-30T13:12:54.844 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:12:55.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.047+0000 7f0ca9800640 1 Processor -- start 2024-03-30T13:12:55.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.047+0000 7f0ca9800640 1 -- start start 2024-03-30T13:12:55.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.049+0000 7f0ca9800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ca406d8f0 0x7f0ca415fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.049+0000 7f0ca9800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca41603d0 0x7f0ca40cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.049+0000 7f0ca9800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ca40ce9c0 con 0x7f0ca413f0c0 2024-03-30T13:12:55.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.049+0000 7f0ca9800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f0ca4160e30 con 0x7f0ca406d8f0 2024-03-30T13:12:55.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.049+0000 7f0ca9800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca4160b50 con 0x7f0ca41603d0 2024-03-30T13:12:55.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.049+0000 7f0ca2a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0ca413f0c0 0x7f0ca406d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40450/0 (socket says 172.21.15.44:40450) 2024-03-30T13:12:55.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.049+0000 7f0ca2a00640 1 -- 172.21.15.44:0/521189860 learned_addr learned my addr 172.21.15.44:0/521189860 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:55.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0c9be00640 1 --2- 172.21.15.44:0/521189860 >> v2:172.21.15.151:3300/0 conn(0x7f0ca406d8f0 0x7f0ca415fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca3400640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca41603d0 0x7f0ca40cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2773784057 0 0) 0x7f0c94001110 con 0x7f0ca413f0c0 2024-03-30T13:12:55.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c88003520 con 0x7f0ca413f0c0 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3335135971 0 0) 0x7f0c88003520 con 0x7f0ca413f0c0 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca41603d0 msgr2=0x7f0ca40cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca2000640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca41603d0 0x7f0ca40cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 >> v2:172.21.15.151:3300/0 conn(0x7f0ca406d8f0 msgr2=0x7f0ca415fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca2000640 1 --2- 172.21.15.44:0/521189860 >> v2:172.21.15.151:3300/0 conn(0x7f0ca406d8f0 0x7f0ca415fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca413fa40 con 0x7f0ca413f0c0 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f0c94001860 con 0x7f0ca413f0c0 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca3400640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca41603d0 0x7f0ca40cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 >> v1:172.21.15.44:6789/0 conn(0x7f0ca413f0c0 legacy=0x7f0ca406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.050+0000 7f0ca2000640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca41603d0 0x7f0c880039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0ca2000640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c88003f40 0x7f0c88004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0ca2000640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c88004d40 0x7f0c880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca4160e30 con 0x7f0c88003f40 2024-03-30T13:12:55.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca4160b50 con 0x7f0c88004d40 2024-03-30T13:12:55.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0c8800bb80 con 0x7f0ca41603d0 2024-03-30T13:12:55.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0c9be00640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c88003f40 0x7f0c88004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0ca3400640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c88004d40 0x7f0c880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0ca2a00640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca41603d0 0x7f0c880039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0c9be00640 1 -- 172.21.15.44:0/521189860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca41603d0 msgr2=0x7f0c880039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:55.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0c9be00640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca41603d0 0x7f0c880039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0c9be00640 1 -- 172.21.15.44:0/521189860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c88004d40 msgr2=0x7f0c880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:55.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0c9be00640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c88004d40 0x7f0c880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.051+0000 7f0c9be00640 1 -- 172.21.15.44:0/521189860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c88003520 con 0x7f0c88003f40 2024-03-30T13:12:55.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.053+0000 7f0c9be00640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c88003f40 0x7f0c88004800 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009a90 tx=0x7f0c88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0388b805ffc68d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.053+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c039070 con 0x7f0c88003f40 2024-03-30T13:12:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.053+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c8c02c6b0 con 0x7f0c88003f40 2024-03-30T13:12:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.053+0000 7f0ca2000640 1 -- 172.21.15.44:0/521189860 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c009690 con 0x7f0c88003f40 2024-03-30T13:12:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.054+0000 7f0ca9800640 1 -- 172.21.15.44:0/521189860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c88003f40 msgr2=0x7f0c88004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.054+0000 7f0ca9800640 1 --2- 172.21.15.44:0/521189860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c88003f40 0x7f0c88004800 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009a90 tx=0x7f0c88005830 comp rx=0 tx=0).stop 2024-03-30T13:12:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.054+0000 7f0ca3400640 1 -- 172.21.15.44:0/521189860 reap_dead start 2024-03-30T13:12:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.054+0000 7f0ca9800640 1 -- 172.21.15.44:0/521189860 shutdown_connections 2024-03-30T13:12:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.054+0000 7f0ca9800640 1 -- 172.21.15.44:0/521189860 >> 172.21.15.44:0/521189860 conn(0x7f0ca40b5b00 msgr2=0x7f0ca406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.054+0000 7f0ca9800640 1 -- 172.21.15.44:0/521189860 shutdown_connections 2024-03-30T13:12:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.054+0000 7f0ca9800640 1 -- 172.21.15.44:0/521189860 wait complete. 2024-03-30T13:12:55.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.057+0000 7f0ca9800640 1 Processor -- start 2024-03-30T13:12:55.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.057+0000 7f0ca9800640 1 -- start start 2024-03-30T13:12:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.059+0000 7f0ca9800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c88003f40 0x7f0ca41363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.059+0000 7f0ca9800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca40d00a0 0x7f0ca41f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.059+0000 7f0ca9800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4144e70 0x7f0ca415b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.059+0000 7f0ca9800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca4160840 con 0x7f0c88003f40 2024-03-30T13:12:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.059+0000 7f0ca9800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca4140000 con 0x7f0ca4144e70 2024-03-30T13:12:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.059+0000 7f0ca9800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0ca413f4a0 con 0x7f0ca40d00a0 2024-03-30T13:12:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.059+0000 7f0ca2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c88003f40 0x7f0ca41363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.059+0000 7f0ca2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c88003f40 0x7f0ca41363d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37240/0 (socket says 172.21.15.44:37240) 2024-03-30T13:12:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.059+0000 7f0ca2a00640 1 -- 172.21.15.44:0/670138705 learned_addr learned my addr 172.21.15.44:0/670138705 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.059+0000 7f0c9be00640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca40d00a0 0x7f0ca41f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.059+0000 7f0ca3400640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4144e70 0x7f0ca415b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.060+0000 7f0ca2a00640 1 -- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca40d00a0 msgr2=0x7f0ca41f7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.060+0000 7f0ca2a00640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca40d00a0 0x7f0ca41f7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.060+0000 7f0ca2a00640 1 -- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4144e70 msgr2=0x7f0ca415b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.060+0000 7f0ca2a00640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4144e70 0x7f0ca415b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.060+0000 7f0ca2a00640 1 -- 172.21.15.44:0/670138705 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca41f8030 con 0x7f0c88003f40 2024-03-30T13:12:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.060+0000 7f0ca2a00640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c88003f40 0x7f0ca41363d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400e730 tx=0x7f0c9400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.060+0000 7f0c9aa00640 1 -- 172.21.15.44:0/670138705 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9400c660 con 0x7f0c88003f40 2024-03-30T13:12:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.060+0000 7f0c9aa00640 1 -- 172.21.15.44:0/670138705 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c94018070 con 0x7f0c88003f40 2024-03-30T13:12:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.060+0000 7f0c9aa00640 1 -- 172.21.15.44:0/670138705 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9400ca40 con 0x7f0c88003f40 2024-03-30T13:12:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.060+0000 7f0ca9800640 1 -- 172.21.15.44:0/670138705 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca4136a40 con 0x7f0c88003f40 2024-03-30T13:12:55.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.061+0000 7f0ca9800640 1 -- 172.21.15.44:0/670138705 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca41f85b0 con 0x7f0c88003f40 2024-03-30T13:12:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.062+0000 7f0ca9800640 1 -- 172.21.15.44:0/670138705 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ca4075890 con 0x7f0c88003f40 2024-03-30T13:12:55.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.064+0000 7f0c9aa00640 1 -- 172.21.15.44:0/670138705 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0c9400cbe0 con 0x7f0c88003f40 2024-03-30T13:12:55.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.065+0000 7f0c9aa00640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0c8006c530 0x7f0c8006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.065+0000 7f0c9aa00640 1 -- 172.21.15.44:0/670138705 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f0c9408b7f0 con 0x7f0c88003f40 2024-03-30T13:12:55.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.065+0000 7f0c9be00640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0c8006c530 0x7f0c8006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.067+0000 7f0c9be00640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0c8006c530 0x7f0c8006e9f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c036000 tx=0x7f0c8c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:55.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.069+0000 7f0c9aa00640 1 -- 172.21.15.44:0/670138705 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0ca40ce9c0 con 0x7f0c88003f40 2024-03-30T13:12:55.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.274+0000 7f0ca9800640 1 -- 172.21.15.44:0/670138705 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0ca406c2c0 con 0x7f0c88003f40 2024-03-30T13:12:55.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.275+0000 7f0c9aa00640 1 -- 172.21.15.44:0/670138705 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f0c940599e0 con 0x7f0c88003f40 2024-03-30T13:12:55.279 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:12:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.279+0000 7f0ca9800640 1 -- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0c8006c530 msgr2=0x7f0c8006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.279+0000 7f0ca9800640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0c8006c530 0x7f0c8006e9f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c036000 tx=0x7f0c8c030000 comp rx=0 tx=0).stop 2024-03-30T13:12:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.279+0000 7f0ca9800640 1 -- 172.21.15.44:0/670138705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c88003f40 msgr2=0x7f0ca41363d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.279+0000 7f0ca9800640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c88003f40 0x7f0ca41363d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400e730 tx=0x7f0c9400ebf0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.279+0000 7f0ca9800640 1 -- 172.21.15.44:0/670138705 shutdown_connections 2024-03-30T13:12:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.279+0000 7f0ca9800640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0c8006c530 0x7f0c8006e9f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.279+0000 7f0ca9800640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4144e70 0x7f0ca415b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.279+0000 7f0ca9800640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca40d00a0 0x7f0ca41f7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.279+0000 7f0ca9800640 1 --2- 172.21.15.44:0/670138705 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0c88003f40 0x7f0ca41363d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.279+0000 7f0ca9800640 1 -- 172.21.15.44:0/670138705 >> 172.21.15.44:0/670138705 conn(0x7f0ca40b5b00 msgr2=0x7f0ca4072c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:55.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.279+0000 7f0ca9800640 1 -- 172.21.15.44:0/670138705 shutdown_connections 2024-03-30T13:12:55.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.279+0000 7f0ca9800640 1 -- 172.21.15.44:0/670138705 wait complete. 2024-03-30T13:12:55.302 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:12:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.498+0000 7f2b1b000640 1 Processor -- start 2024-03-30T13:12:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.498+0000 7f2b1b000640 1 -- start start 2024-03-30T13:12:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.500+0000 7f2b1b000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2b1406db00 0x7f2b140cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.500+0000 7f2b1b000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2b1406c690 0x7f2b14162110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.500+0000 7f2b1b000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b141476b0 con 0x7f2b141472d0 2024-03-30T13:12:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.500+0000 7f2b1b000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2b14148140 con 0x7f2b1406db00 2024-03-30T13:12:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.500+0000 7f2b1b000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f2b14071040 con 0x7f2b1406c690 2024-03-30T13:12:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.500+0000 7f2b0be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2b1406db00 0x7f2b140cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.500+0000 7f2b13e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2b141472d0 0x7f2b1406d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40456/0 (socket says 172.21.15.44:40456) 2024-03-30T13:12:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.500+0000 7f2b13e00640 1 -- 172.21.15.44:0/1044734214 learned_addr learned my addr 172.21.15.44:0/1044734214 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:55.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.501+0000 7f2b19000640 1 --2- 172.21.15.44:0/1044734214 >> v2:172.21.15.151:3300/0 conn(0x7f2b1406c690 0x7f2b14162110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.501+0000 7f2b0be00640 1 -- 172.21.15.44:0/1044734214 >> v2:172.21.15.151:3300/0 conn(0x7f2b1406c690 msgr2=0x7f2b14162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:55.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.501+0000 7f2b0be00640 1 --2- 172.21.15.44:0/1044734214 >> v2:172.21.15.151:3300/0 conn(0x7f2b1406c690 0x7f2b14162110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.501+0000 7f2b0be00640 1 -- 172.21.15.44:0/1044734214 >> v1:172.21.15.44:6789/0 conn(0x7f2b141472d0 legacy=0x7f2b1406d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.501+0000 7f2b0be00640 1 -- 172.21.15.44:0/1044734214 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b14071290 con 0x7f2b1406db00 2024-03-30T13:12:55.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.501+0000 7f2b13400640 1 -- 172.21.15.44:0/1044734214 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627762112 0 0) 0x7f2b141476b0 con 0x7f2b141472d0 2024-03-30T13:12:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.502+0000 7f2b0be00640 1 --2- 172.21.15.44:0/1044734214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b1406db00 0x7f2b140cf410 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2b14070dd0 tx=0x7f2afc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfb4c05ee8dd9bf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.503+0000 7f2b13400640 1 -- 172.21.15.44:0/1044734214 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0315a0 con 0x7f2b1406db00 2024-03-30T13:12:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.503+0000 7f2b13400640 1 -- 172.21.15.44:0/1044734214 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2afc037070 con 0x7f2b1406db00 2024-03-30T13:12:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.503+0000 7f2b13400640 1 -- 172.21.15.44:0/1044734214 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc031960 con 0x7f2b1406db00 2024-03-30T13:12:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.503+0000 7f2b1b000640 1 -- 172.21.15.44:0/1044734214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b1406db00 msgr2=0x7f2b140cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.503+0000 7f2b1b000640 1 --2- 172.21.15.44:0/1044734214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b1406db00 0x7f2b140cf410 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2b14070dd0 tx=0x7f2afc02b840 comp rx=0 tx=0).stop 2024-03-30T13:12:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.503+0000 7f2b1b000640 1 -- 172.21.15.44:0/1044734214 shutdown_connections 2024-03-30T13:12:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.503+0000 7f2b1b000640 1 --2- 172.21.15.44:0/1044734214 >> v2:172.21.15.151:3300/0 conn(0x7f2b1406c690 0x7f2b14162110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.503+0000 7f2b1b000640 1 --2- 172.21.15.44:0/1044734214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b1406db00 0x7f2b140cf410 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.503+0000 7f2b1b000640 1 -- 172.21.15.44:0/1044734214 >> 172.21.15.44:0/1044734214 conn(0x7f2b140b3e70 msgr2=0x7f2b140b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.503+0000 7f2b1b000640 1 -- 172.21.15.44:0/1044734214 shutdown_connections 2024-03-30T13:12:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.504+0000 7f2b1b000640 1 -- 172.21.15.44:0/1044734214 wait complete. 2024-03-30T13:12:55.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.505+0000 7f2b1b000640 1 Processor -- start 2024-03-30T13:12:55.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.505+0000 7f2b1b000640 1 -- start start 2024-03-30T13:12:55.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.506+0000 7f2b1b000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b1406c690 0x7f2b141f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.506+0000 7f2b1b000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b1406db00 0x7f2b14140540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.506+0000 7f2b1b000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b141472d0 0x7f2b140b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.506+0000 7f2b1b000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2b14071b30 con 0x7f2b1406c690 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.506+0000 7f2b1b000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2b14071850 con 0x7f2b141472d0 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.506+0000 7f2b1b000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f2b1406ca90 con 0x7f2b1406db00 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.507+0000 7f2b13e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b1406c690 0x7f2b141f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.507+0000 7f2b13e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b1406c690 0x7f2b141f14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37252/0 (socket says 172.21.15.44:37252) 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.507+0000 7f2b13e00640 1 -- 172.21.15.44:0/1191371553 learned_addr learned my addr 172.21.15.44:0/1191371553 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.507+0000 7f2b0be00640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b1406db00 0x7f2b14140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.507+0000 7f2b19000640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b141472d0 0x7f2b140b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.507+0000 7f2b13e00640 1 -- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b1406db00 msgr2=0x7f2b14140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.507+0000 7f2b13e00640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b1406db00 0x7f2b14140540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.507+0000 7f2b13e00640 1 -- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b141472d0 msgr2=0x7f2b140b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.507+0000 7f2b13e00640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b141472d0 0x7f2b140b7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.507+0000 7f2b13e00640 1 -- 172.21.15.44:0/1191371553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b141f44c0 con 0x7f2b1406c690 2024-03-30T13:12:55.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.507+0000 7f2b13e00640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b1406c690 0x7f2b141f14a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c430 tx=0x7f2b0400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:55.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.508+0000 7f2b10c00640 1 -- 172.21.15.44:0/1191371553 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b040074e0 con 0x7f2b1406c690 2024-03-30T13:12:55.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.508+0000 7f2b10c00640 1 -- 172.21.15.44:0/1191371553 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b040047e0 con 0x7f2b1406c690 2024-03-30T13:12:55.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.508+0000 7f2b10c00640 1 -- 172.21.15.44:0/1191371553 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b04004bd0 con 0x7f2b1406c690 2024-03-30T13:12:55.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.508+0000 7f2b1b000640 1 -- 172.21.15.44:0/1191371553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b141f47a0 con 0x7f2b1406c690 2024-03-30T13:12:55.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.508+0000 7f2b1b000640 1 -- 172.21.15.44:0/1191371553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b141f4d60 con 0x7f2b1406c690 2024-03-30T13:12:55.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.509+0000 7f2b1b000640 1 -- 172.21.15.44:0/1191371553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b14075890 con 0x7f2b1406c690 2024-03-30T13:12:55.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.511+0000 7f2b10c00640 1 -- 172.21.15.44:0/1191371553 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2b04011070 con 0x7f2b1406c690 2024-03-30T13:12:55.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.512+0000 7f2b10c00640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2af006c560 0x7f2af006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.512+0000 7f2b10c00640 1 -- 172.21.15.44:0/1191371553 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f2b0408b760 con 0x7f2b1406c690 2024-03-30T13:12:55.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.513+0000 7f2b0be00640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2af006c560 0x7f2af006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.514+0000 7f2b0be00640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2af006c560 0x7f2af006ea20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2afc036000 tx=0x7f2afc03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:55.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.517+0000 7f2b10c00640 1 -- 172.21.15.44:0/1191371553 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2b04059950 con 0x7f2b1406c690 2024-03-30T13:12:55.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.717+0000 7f2b1b000640 1 -- 172.21.15.44:0/1191371553 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2b14147740 con 0x7f2b1406c690 2024-03-30T13:12:55.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.718+0000 7f2b10c00640 1 -- 172.21.15.44:0/1191371553 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f2b04059250 con 0x7f2b1406c690 2024-03-30T13:12:55.722 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:55.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.721+0000 7f2b1b000640 1 -- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2af006c560 msgr2=0x7f2af006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.721+0000 7f2b1b000640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2af006c560 0x7f2af006ea20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2afc036000 tx=0x7f2afc03d040 comp rx=0 tx=0).stop 2024-03-30T13:12:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.721+0000 7f2b1b000640 1 -- 172.21.15.44:0/1191371553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b1406c690 msgr2=0x7f2b141f14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.721+0000 7f2b1b000640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b1406c690 0x7f2b141f14a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400c430 tx=0x7f2b0400c8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.721+0000 7f2b1b000640 1 -- 172.21.15.44:0/1191371553 shutdown_connections 2024-03-30T13:12:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.721+0000 7f2b1b000640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2af006c560 0x7f2af006ea20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.721+0000 7f2b1b000640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b141472d0 0x7f2b140b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.721+0000 7f2b1b000640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b1406db00 0x7f2b14140540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.721+0000 7f2b1b000640 1 --2- 172.21.15.44:0/1191371553 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2b1406c690 0x7f2b141f14a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.721+0000 7f2b1b000640 1 -- 172.21.15.44:0/1191371553 >> 172.21.15.44:0/1191371553 conn(0x7f2b140b3e70 msgr2=0x7f2b141448c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.721+0000 7f2b1b000640 1 -- 172.21.15.44:0/1191371553 shutdown_connections 2024-03-30T13:12:55.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.721+0000 7f2b1b000640 1 -- 172.21.15.44:0/1191371553 wait complete. 2024-03-30T13:12:55.742 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:12:55.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.941+0000 7f33e3e00640 1 Processor -- start 2024-03-30T13:12:55.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.942+0000 7f33e3e00640 1 -- start start 2024-03-30T13:12:55.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.943+0000 7f33e3e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f33e40b64a0 0x7f33e40d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.943+0000 7f33e3e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f33e40d3cf0 0x7f33e40b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.943+0000 7f33e3e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33e40d4110 con 0x7f33e415e470 2024-03-30T13:12:55.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.943+0000 7f33e3e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f33e40ba2c0 con 0x7f33e40d3cf0 2024-03-30T13:12:55.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.943+0000 7f33e3e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f33e40d3860 con 0x7f33e40b64a0 2024-03-30T13:12:55.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.943+0000 7f33e3400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f33e40d3cf0 0x7f33e40b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.943+0000 7f33e3400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f33e40d3cf0 0x7f33e40b9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37264/0 (socket says 172.21.15.44:37264) 2024-03-30T13:12:55.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.943+0000 7f33e3400640 1 -- 172.21.15.44:0/969093737 learned_addr learned my addr 172.21.15.44:0/969093737 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:55.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.944+0000 7f33dbe00640 1 --2- 172.21.15.44:0/969093737 >> v2:172.21.15.151:3300/0 conn(0x7f33e40b64a0 0x7f33e40d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.944+0000 7f33e3400640 1 -- 172.21.15.44:0/969093737 >> v2:172.21.15.151:3300/0 conn(0x7f33e40b64a0 msgr2=0x7f33e40d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:55.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.944+0000 7f33e3400640 1 --2- 172.21.15.44:0/969093737 >> v2:172.21.15.151:3300/0 conn(0x7f33e40b64a0 0x7f33e40d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.944+0000 7f33e3400640 1 -- 172.21.15.44:0/969093737 >> v1:172.21.15.151:6789/0 conn(0x7f33e415e470 legacy=0x7f33e40b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:55.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.944+0000 7f33e3400640 1 -- 172.21.15.44:0/969093737 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e40d2c50 con 0x7f33e40d3cf0 2024-03-30T13:12:55.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.945+0000 7f33e3400640 1 --2- 172.21.15.44:0/969093737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e40d3cf0 0x7f33e40b9d80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f33e406d6e0 tx=0x7f33dc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb5242331de221b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:55.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.945+0000 7f33e2000640 1 -- 172.21.15.44:0/969093737 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc02cb20 con 0x7f33e40d3cf0 2024-03-30T13:12:55.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.945+0000 7f33e2000640 1 -- 172.21.15.44:0/969093737 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33dc02ccc0 con 0x7f33e40d3cf0 2024-03-30T13:12:55.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.945+0000 7f33e2000640 1 -- 172.21.15.44:0/969093737 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc034610 con 0x7f33e40d3cf0 2024-03-30T13:12:55.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.946+0000 7f33e3e00640 1 -- 172.21.15.44:0/969093737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e40d3cf0 msgr2=0x7f33e40b9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.946+0000 7f33e3e00640 1 --2- 172.21.15.44:0/969093737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e40d3cf0 0x7f33e40b9d80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f33e406d6e0 tx=0x7f33dc02bf80 comp rx=0 tx=0).stop 2024-03-30T13:12:55.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.946+0000 7f33e3e00640 1 -- 172.21.15.44:0/969093737 shutdown_connections 2024-03-30T13:12:55.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.946+0000 7f33e3e00640 1 --2- 172.21.15.44:0/969093737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e40d3cf0 0x7f33e40b9d80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.946+0000 7f33e3e00640 1 --2- 172.21.15.44:0/969093737 >> v2:172.21.15.151:3300/0 conn(0x7f33e40b64a0 0x7f33e40d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.946+0000 7f33e3e00640 1 -- 172.21.15.44:0/969093737 >> 172.21.15.44:0/969093737 conn(0x7f33e40678f0 msgr2=0x7f33e40d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:55.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.946+0000 7f33e3e00640 1 -- 172.21.15.44:0/969093737 shutdown_connections 2024-03-30T13:12:55.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.946+0000 7f33e3e00640 1 -- 172.21.15.44:0/969093737 wait complete. 2024-03-30T13:12:55.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.948+0000 7f33e3e00640 1 Processor -- start 2024-03-30T13:12:55.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.948+0000 7f33e3e00640 1 -- start start 2024-03-30T13:12:55.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.949+0000 7f33e3e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33e40b64a0 0x7f33e41f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.949+0000 7f33e3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e40d3cf0 0x7f33e415fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.949+0000 7f33e3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33e415e470 0x7f33e4160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.949+0000 7f33e3e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f33e40d34f0 con 0x7f33e40d3cf0 2024-03-30T13:12:55.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.949+0000 7f33e3e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f33e40d3210 con 0x7f33e415e470 2024-03-30T13:12:55.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.949+0000 7f33e3e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f33e415e850 con 0x7f33e40b64a0 2024-03-30T13:12:55.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.949+0000 7f33dbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e40d3cf0 0x7f33e415fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.949+0000 7f33dbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e40d3cf0 0x7f33e415fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37266/0 (socket says 172.21.15.44:37266) 2024-03-30T13:12:55.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.950+0000 7f33dbe00640 1 -- 172.21.15.44:0/839857432 learned_addr learned my addr 172.21.15.44:0/839857432 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:55.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.950+0000 7f33e3400640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33e415e470 0x7f33e4160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.950+0000 7f33e2a00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33e40b64a0 0x7f33e41f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.950+0000 7f33dbe00640 1 -- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33e40b64a0 msgr2=0x7f33e41f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.950+0000 7f33dbe00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33e40b64a0 0x7f33e41f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.950+0000 7f33dbe00640 1 -- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33e415e470 msgr2=0x7f33e4160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.950+0000 7f33dbe00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33e415e470 0x7f33e4160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.950+0000 7f33dbe00640 1 -- 172.21.15.44:0/839857432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33e41f3ed0 con 0x7f33e40d3cf0 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.950+0000 7f33e3400640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33e415e470 0x7f33e4160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.950+0000 7f33dbe00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e40d3cf0 0x7f33e415fb10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00c7f0 tx=0x7f33cc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.951+0000 7f33daa00640 1 -- 172.21.15.44:0/839857432 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc015070 con 0x7f33e40d3cf0 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.951+0000 7f33daa00640 1 -- 172.21.15.44:0/839857432 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33cc004240 con 0x7f33e40d3cf0 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.951+0000 7f33daa00640 1 -- 172.21.15.44:0/839857432 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc007620 con 0x7f33e40d3cf0 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.951+0000 7f33e3e00640 1 -- 172.21.15.44:0/839857432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33e41f4140 con 0x7f33e40d3cf0 2024-03-30T13:12:55.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.951+0000 7f33e3e00640 1 -- 172.21.15.44:0/839857432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33e41f4700 con 0x7f33e40d3cf0 2024-03-30T13:12:55.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.952+0000 7f33e3e00640 1 -- 172.21.15.44:0/839857432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33e4075890 con 0x7f33e40d3cf0 2024-03-30T13:12:55.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.954+0000 7f33daa00640 1 -- 172.21.15.44:0/839857432 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f33cc0079d0 con 0x7f33e40d3cf0 2024-03-30T13:12:55.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.955+0000 7f33daa00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f33c006c530 0x7f33c006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:55.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.955+0000 7f33daa00640 1 -- 172.21.15.44:0/839857432 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f33cc08bfe0 con 0x7f33e40d3cf0 2024-03-30T13:12:55.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.955+0000 7f33e2a00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f33c006c530 0x7f33c006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:55.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.957+0000 7f33e2a00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f33c006c530 0x7f33c006e9f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f33d4006fd0 tx=0x7f33d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:55.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:55.960+0000 7f33daa00640 1 -- 172.21.15.44:0/839857432 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f33cc05a140 con 0x7f33e40d3cf0 2024-03-30T13:12:56.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.173+0000 7f33e3e00640 1 -- 172.21.15.44:0/839857432 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f33e4158ab0 con 0x7f33e40d3cf0 2024-03-30T13:12:56.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.174+0000 7f33daa00640 1 -- 172.21.15.44:0/839857432 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f33cc059a40 con 0x7f33e40d3cf0 2024-03-30T13:12:56.177 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-03-30T13:12:56.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.177+0000 7f33e3e00640 1 -- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f33c006c530 msgr2=0x7f33c006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:56.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.177+0000 7f33e3e00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f33c006c530 0x7f33c006e9f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f33d4006fd0 tx=0x7f33d4008040 comp rx=0 tx=0).stop 2024-03-30T13:12:56.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.177+0000 7f33e3e00640 1 -- 172.21.15.44:0/839857432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e40d3cf0 msgr2=0x7f33e415fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:56.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.177+0000 7f33e3e00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e40d3cf0 0x7f33e415fb10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f33cc00c7f0 tx=0x7f33cc00ccb0 comp rx=0 tx=0).stop 2024-03-30T13:12:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.177+0000 7f33e3e00640 1 -- 172.21.15.44:0/839857432 shutdown_connections 2024-03-30T13:12:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.177+0000 7f33e3e00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f33c006c530 0x7f33c006e9f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.177+0000 7f33e3e00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33e415e470 0x7f33e4160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.177+0000 7f33e3e00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33e40d3cf0 0x7f33e415fb10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.177+0000 7f33e3e00640 1 --2- 172.21.15.44:0/839857432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33e40b64a0 0x7f33e41f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.177+0000 7f33e3e00640 1 -- 172.21.15.44:0/839857432 >> 172.21.15.44:0/839857432 conn(0x7f33e40678f0 msgr2=0x7f33e415d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:56.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.177+0000 7f33e3e00640 1 -- 172.21.15.44:0/839857432 shutdown_connections 2024-03-30T13:12:56.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.177+0000 7f33e3e00640 1 -- 172.21.15.44:0/839857432 wait complete. 2024-03-30T13:12:56.199 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-30T13:12:56.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:56.199 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-30T13:12:56.302 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:12:56.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:56.303 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-30T13:12:56.353 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:12:56.353 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:56.408 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:12:56.409 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:56.453 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:12:56.453 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:56.550 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.775+0000 7f30fd600640 1 Processor -- start 2024-03-30T13:12:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.776+0000 7f30fd600640 1 -- start start 2024-03-30T13:12:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.777+0000 7f30fd600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f30f806b580 0x7f30f806ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.777+0000 7f30fd600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f80b4f90 con 0x7f30f81470d0 2024-03-30T13:12:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.777+0000 7f30fd600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f8162110 con 0x7f30f806fb10 2024-03-30T13:12:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.777+0000 7f30fd600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f30f81623f0 con 0x7f30f806b580 2024-03-30T13:12:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.778+0000 7f30f6a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f30f81470d0 0x7f30f80b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:40458/0 (socket says 172.21.15.44:40458) 2024-03-30T13:12:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.778+0000 7f30f6a00640 1 -- 172.21.15.44:0/1408445804 learned_addr learned my addr 172.21.15.44:0/1408445804 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.778+0000 7f30f6000640 1 --2- 172.21.15.44:0/1408445804 >> v2:172.21.15.151:3300/0 conn(0x7f30f806b580 0x7f30f806ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.778+0000 7f30f5600640 1 -- 172.21.15.44:0/1408445804 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237343685 0 0) 0x7f30f80b4f90 con 0x7f30f81470d0 2024-03-30T13:12:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.778+0000 7f30f5600640 1 -- 172.21.15.44:0/1408445804 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30dc003520 con 0x7f30f81470d0 2024-03-30T13:12:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.779+0000 7f30f6000640 1 -- 172.21.15.44:0/1408445804 >> v1:172.21.15.151:6789/0 conn(0x7f30f806fb10 legacy=0x7f30f806ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.779+0000 7f30f6000640 1 -- 172.21.15.44:0/1408445804 >> v1:172.21.15.44:6789/0 conn(0x7f30f81470d0 legacy=0x7f30f80b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.779+0000 7f30f6000640 1 -- 172.21.15.44:0/1408445804 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f81626d0 con 0x7f30f806b580 2024-03-30T13:12:56.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.780+0000 7f30f6000640 1 --2- 172.21.15.44:0/1408445804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30f806b580 0x7f30f806ba10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f30e40097a0 tx=0x7f30e402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49b1fb59e1130835 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:56.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.780+0000 7f30f5600640 1 -- 172.21.15.44:0/1408445804 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4034070 con 0x7f30f806b580 2024-03-30T13:12:56.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.781+0000 7f30f5600640 1 -- 172.21.15.44:0/1408445804 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e4030610 con 0x7f30f806b580 2024-03-30T13:12:56.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.781+0000 7f30f5600640 1 -- 172.21.15.44:0/1408445804 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e40309e0 con 0x7f30f806b580 2024-03-30T13:12:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.781+0000 7f30fd600640 1 -- 172.21.15.44:0/1408445804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30f806b580 msgr2=0x7f30f806ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.781+0000 7f30fd600640 1 --2- 172.21.15.44:0/1408445804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30f806b580 0x7f30f806ba10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f30e40097a0 tx=0x7f30e402b960 comp rx=0 tx=0).stop 2024-03-30T13:12:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.781+0000 7f30fd600640 1 -- 172.21.15.44:0/1408445804 shutdown_connections 2024-03-30T13:12:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.781+0000 7f30fd600640 1 --2- 172.21.15.44:0/1408445804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30f806b580 0x7f30f806ba10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:56.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.781+0000 7f30fd600640 1 -- 172.21.15.44:0/1408445804 >> 172.21.15.44:0/1408445804 conn(0x7f30f80b2e10 msgr2=0x7f30f80b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.781+0000 7f30fd600640 1 -- 172.21.15.44:0/1408445804 shutdown_connections 2024-03-30T13:12:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.781+0000 7f30fd600640 1 -- 172.21.15.44:0/1408445804 wait complete. 2024-03-30T13:12:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.783+0000 7f30fd600640 1 Processor -- start 2024-03-30T13:12:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.783+0000 7f30fd600640 1 -- start start 2024-03-30T13:12:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.784+0000 7f30fd600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f806b580 0x7f30f81e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.784+0000 7f30fd600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30f806fb10 0x7f30f81e9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.784+0000 7f30fd600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30f81470d0 0x7f30f80cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.784+0000 7f30fd600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f30f81474b0 con 0x7f30f806b580 2024-03-30T13:12:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.784+0000 7f30fd600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f30f8073700 con 0x7f30f81470d0 2024-03-30T13:12:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.784+0000 7f30fd600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f30f80ceb40 con 0x7f30f806fb10 2024-03-30T13:12:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.784+0000 7f30f6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f806b580 0x7f30f81e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.784+0000 7f30f6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f806b580 0x7f30f81e7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37274/0 (socket says 172.21.15.44:37274) 2024-03-30T13:12:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.784+0000 7f30f6a00640 1 -- 172.21.15.44:0/1509237409 learned_addr learned my addr 172.21.15.44:0/1509237409 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.785+0000 7f30f6000640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30f806fb10 0x7f30f81e9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.785+0000 7f30f7400640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30f81470d0 0x7f30f80cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.785+0000 7f30f6a00640 1 -- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30f806fb10 msgr2=0x7f30f81e9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.785+0000 7f30f6a00640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30f806fb10 0x7f30f81e9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.785+0000 7f30f6a00640 1 -- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30f81470d0 msgr2=0x7f30f80cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.785+0000 7f30f6a00640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30f81470d0 0x7f30f80cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.785+0000 7f30f6a00640 1 -- 172.21.15.44:0/1509237409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f80cede0 con 0x7f30f806b580 2024-03-30T13:12:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.785+0000 7f30f6a00640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f806b580 0x7f30f81e7f70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f30e800c390 tx=0x7f30e800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.785+0000 7f30eea00640 1 -- 172.21.15.44:0/1509237409 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8017070 con 0x7f30f806b580 2024-03-30T13:12:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.786+0000 7f30eea00640 1 -- 172.21.15.44:0/1509237409 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e8005ce0 con 0x7f30f806b580 2024-03-30T13:12:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.786+0000 7f30eea00640 1 -- 172.21.15.44:0/1509237409 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e80072f0 con 0x7f30f806b580 2024-03-30T13:12:56.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.786+0000 7f30fd600640 1 -- 172.21.15.44:0/1509237409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f80cf0c0 con 0x7f30f806b580 2024-03-30T13:12:56.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.786+0000 7f30fd600640 1 -- 172.21.15.44:0/1509237409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f80cf680 con 0x7f30f806b580 2024-03-30T13:12:56.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.787+0000 7f30fd600640 1 -- 172.21.15.44:0/1509237409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f8161a80 con 0x7f30f806b580 2024-03-30T13:12:56.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.788+0000 7f30eea00640 1 -- 172.21.15.44:0/1509237409 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f30e801a070 con 0x7f30f806b580 2024-03-30T13:12:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.789+0000 7f30eea00640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f30d806c580 0x7f30d806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.789+0000 7f30eea00640 1 -- 172.21.15.44:0/1509237409 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f30e808aff0 con 0x7f30f806b580 2024-03-30T13:12:56.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.790+0000 7f30f6000640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f30d806c580 0x7f30d806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:56.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.791+0000 7f30f6000640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f30d806c580 0x7f30d806ea40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f30e4036000 tx=0x7f30e403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:56.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.793+0000 7f30eea00640 1 -- 172.21.15.44:0/1509237409 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f30e80591d0 con 0x7f30f806b580 2024-03-30T13:12:57.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:56.999+0000 7f30fd600640 1 -- 172.21.15.44:0/1509237409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30f8075a10 con 0x7f30f806b580 2024-03-30T13:12:57.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.002+0000 7f30eea00640 1 -- 172.21.15.44:0/1509237409 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18927 (secure 0 0 0) 0x7f30e8058ad0 con 0x7f30f806b580 2024-03-30T13:12:57.006 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:12:57.006 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":29,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:12:27.323786+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:12:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.005+0000 7f30fd600640 1 -- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f30d806c580 msgr2=0x7f30d806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.005+0000 7f30fd600640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f30d806c580 0x7f30d806ea40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f30e4036000 tx=0x7f30e403b040 comp rx=0 tx=0).stop 2024-03-30T13:12:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.005+0000 7f30fd600640 1 -- 172.21.15.44:0/1509237409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f806b580 msgr2=0x7f30f81e7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.005+0000 7f30fd600640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f806b580 0x7f30f81e7f70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f30e800c390 tx=0x7f30e800c850 comp rx=0 tx=0).stop 2024-03-30T13:12:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.005+0000 7f30fd600640 1 -- 172.21.15.44:0/1509237409 shutdown_connections 2024-03-30T13:12:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.005+0000 7f30fd600640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f30d806c580 0x7f30d806ea40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.005+0000 7f30fd600640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30f81470d0 0x7f30f80cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.005+0000 7f30fd600640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30f806fb10 0x7f30f81e9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.005+0000 7f30fd600640 1 --2- 172.21.15.44:0/1509237409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f30f806b580 0x7f30f81e7f70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.005+0000 7f30fd600640 1 -- 172.21.15.44:0/1509237409 >> 172.21.15.44:0/1509237409 conn(0x7f30f80b2e10 msgr2=0x7f30f8144810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:57.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.005+0000 7f30fd600640 1 -- 172.21.15.44:0/1509237409 shutdown_connections 2024-03-30T13:12:57.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.005+0000 7f30fd600640 1 -- 172.21.15.44:0/1509237409 wait complete. 2024-03-30T13:12:57.028 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:12:57.029 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:12:57.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.241+0000 7f6fafe00640 1 Processor -- start 2024-03-30T13:12:57.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.242+0000 7f6fafe00640 1 -- start start 2024-03-30T13:12:57.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.243+0000 7f6fafe00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6fb00b4920 0x7f6fb00b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:57.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.243+0000 7f6fafe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6fb00d0b90 0x7f6fb00d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:57.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.243+0000 7f6fafe00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb00b54b0 con 0x7f6fb00b4d00 2024-03-30T13:12:57.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.243+0000 7f6fafe00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb00d0260 con 0x7f6fb00d0b90 2024-03-30T13:12:57.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.243+0000 7f6fafe00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb00cfca0 con 0x7f6fb00b4920 2024-03-30T13:12:57.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.243+0000 7f6faf400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6fb00d0b90 0x7f6fb00d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:57.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.244+0000 7f6faf400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6fb00d0b90 0x7f6fb00d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39972/0 (socket says 172.21.15.44:39972) 2024-03-30T13:12:57.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.244+0000 7f6faf400640 1 -- 172.21.15.44:0/4144649458 learned_addr learned my addr 172.21.15.44:0/4144649458 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:57.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.244+0000 7f6faea00640 1 --2- 172.21.15.44:0/4144649458 >> v2:172.21.15.151:3300/0 conn(0x7f6fb00b4920 0x7f6fb00b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:57.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.244+0000 7f6faf400640 1 -- 172.21.15.44:0/4144649458 >> v2:172.21.15.151:3300/0 conn(0x7f6fb00b4920 msgr2=0x7f6fb00b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:57.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.244+0000 7f6faf400640 1 --2- 172.21.15.44:0/4144649458 >> v2:172.21.15.151:3300/0 conn(0x7f6fb00b4920 0x7f6fb00b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.244+0000 7f6faf400640 1 -- 172.21.15.44:0/4144649458 >> v1:172.21.15.151:6789/0 conn(0x7f6fb00b4d00 legacy=0x7f6fb00d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:57.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.244+0000 7f6faf400640 1 -- 172.21.15.44:0/4144649458 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb00cff80 con 0x7f6fb00d0b90 2024-03-30T13:12:57.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.245+0000 7f6faf400640 1 --2- 172.21.15.44:0/4144649458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb00d0b90 0x7f6fb00d1040 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6fb009dc10 tx=0x7f6fa802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ffeb50bb66ef42 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:57.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.246+0000 7f6fad600640 1 -- 172.21.15.44:0/4144649458 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa802e070 con 0x7f6fb00d0b90 2024-03-30T13:12:57.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.246+0000 7f6fad600640 1 -- 172.21.15.44:0/4144649458 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa8037070 con 0x7f6fb00d0b90 2024-03-30T13:12:57.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.246+0000 7f6fad600640 1 -- 172.21.15.44:0/4144649458 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8031a00 con 0x7f6fb00d0b90 2024-03-30T13:12:57.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.246+0000 7f6fafe00640 1 -- 172.21.15.44:0/4144649458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb00d0b90 msgr2=0x7f6fb00d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.246+0000 7f6fafe00640 1 --2- 172.21.15.44:0/4144649458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb00d0b90 0x7f6fb00d1040 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6fb009dc10 tx=0x7f6fa802b880 comp rx=0 tx=0).stop 2024-03-30T13:12:57.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.246+0000 7f6fafe00640 1 -- 172.21.15.44:0/4144649458 shutdown_connections 2024-03-30T13:12:57.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.246+0000 7f6fafe00640 1 --2- 172.21.15.44:0/4144649458 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb00d0b90 0x7f6fb00d1040 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.246+0000 7f6fafe00640 1 --2- 172.21.15.44:0/4144649458 >> v2:172.21.15.151:3300/0 conn(0x7f6fb00b4920 0x7f6fb00b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.246+0000 7f6fafe00640 1 -- 172.21.15.44:0/4144649458 >> 172.21.15.44:0/4144649458 conn(0x7f6fb009d4e0 msgr2=0x7f6fb00d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:57.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.247+0000 7f6fafe00640 1 -- 172.21.15.44:0/4144649458 shutdown_connections 2024-03-30T13:12:57.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.247+0000 7f6fafe00640 1 -- 172.21.15.44:0/4144649458 wait complete. 2024-03-30T13:12:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.248+0000 7f6fafe00640 1 Processor -- start 2024-03-30T13:12:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.249+0000 7f6fafe00640 1 -- start start 2024-03-30T13:12:57.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.249+0000 7f6fafe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb00b4920 0x7f6fb0159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:57.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.249+0000 7f6fafe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb00b4d00 0x7f6fb00cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:57.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.249+0000 7f6fafe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fb00d0b90 0x7f6fb00cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:57.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6fafe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb00b3ff0 con 0x7f6fb00b4d00 2024-03-30T13:12:57.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6fafe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb00d2180 con 0x7f6fb00b4920 2024-03-30T13:12:57.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6fafe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb00cf8c0 con 0x7f6fb00d0b90 2024-03-30T13:12:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6fae000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb00b4d00 0x7f6fb00cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6fae000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb00b4d00 0x7f6fb00cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39978/0 (socket says 172.21.15.44:39978) 2024-03-30T13:12:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6fae000640 1 -- 172.21.15.44:0/2979198992 learned_addr learned my addr 172.21.15.44:0/2979198992 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6faf400640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fb00d0b90 0x7f6fb00cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6faea00640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb00b4920 0x7f6fb0159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6fae000640 1 -- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fb00d0b90 msgr2=0x7f6fb00cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6fae000640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fb00d0b90 0x7f6fb00cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6fae000640 1 -- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb00b4920 msgr2=0x7f6fb0159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6fae000640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb00b4920 0x7f6fb0159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.250+0000 7f6fae000640 1 -- 172.21.15.44:0/2979198992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb0158380 con 0x7f6fb00b4d00 2024-03-30T13:12:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.251+0000 7f6fae000640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb00b4d00 0x7f6fb00cd1d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800c430 tx=0x7f6f9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.251+0000 7f6fa6a00640 1 -- 172.21.15.44:0/2979198992 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f98011790 con 0x7f6fb00b4d00 2024-03-30T13:12:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.251+0000 7f6fa6a00640 1 -- 172.21.15.44:0/2979198992 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f98017070 con 0x7f6fb00b4d00 2024-03-30T13:12:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.251+0000 7f6fa6a00640 1 -- 172.21.15.44:0/2979198992 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f98011bb0 con 0x7f6fb00b4d00 2024-03-30T13:12:57.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.251+0000 7f6fafe00640 1 -- 172.21.15.44:0/2979198992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb0158660 con 0x7f6fb00b4d00 2024-03-30T13:12:57.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.251+0000 7f6fafe00640 1 -- 172.21.15.44:0/2979198992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb0158c20 con 0x7f6fb00b4d00 2024-03-30T13:12:57.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.253+0000 7f6fafe00640 1 -- 172.21.15.44:0/2979198992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb0075890 con 0x7f6fb00b4d00 2024-03-30T13:12:57.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.253+0000 7f6fa6a00640 1 -- 172.21.15.44:0/2979198992 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6f9801c460 con 0x7f6fb00b4d00 2024-03-30T13:12:57.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.255+0000 7f6fa6a00640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6f8c06c530 0x7f6f8c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:57.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.255+0000 7f6fa6a00640 1 -- 172.21.15.44:0/2979198992 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f6f9808baa0 con 0x7f6fb00b4d00 2024-03-30T13:12:57.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.255+0000 7f6faea00640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6f8c06c530 0x7f6f8c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:57.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.257+0000 7f6faea00640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6f8c06c530 0x7f6f8c06e9f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009a60 tx=0x7f6fa0003990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:57.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.259+0000 7f6fa6a00640 1 -- 172.21.15.44:0/2979198992 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6f98059c00 con 0x7f6fb00b4d00 2024-03-30T13:12:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.462+0000 7f6fafe00640 1 -- 172.21.15.44:0/2979198992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6fb015eb10 con 0x7f6fb00b4d00 2024-03-30T13:12:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.463+0000 7f6fa6a00640 1 -- 172.21.15.44:0/2979198992 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f6f98059500 con 0x7f6fb00b4d00 2024-03-30T13:12:57.466 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:12:57.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.465+0000 7f6fafe00640 1 -- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6f8c06c530 msgr2=0x7f6f8c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.465+0000 7f6fafe00640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6f8c06c530 0x7f6f8c06e9f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009a60 tx=0x7f6fa0003990 comp rx=0 tx=0).stop 2024-03-30T13:12:57.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.465+0000 7f6fafe00640 1 -- 172.21.15.44:0/2979198992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb00b4d00 msgr2=0x7f6fb00cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.465+0000 7f6fafe00640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb00b4d00 0x7f6fb00cd1d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800c430 tx=0x7f6f9800c8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.465+0000 7f6fafe00640 1 -- 172.21.15.44:0/2979198992 shutdown_connections 2024-03-30T13:12:57.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.465+0000 7f6fafe00640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fb00d0b90 0x7f6fb00cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.465+0000 7f6fafe00640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6fb00b4d00 0x7f6fb00cd1d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.465+0000 7f6fafe00640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6f8c06c530 0x7f6f8c06e9f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.465+0000 7f6fafe00640 1 --2- 172.21.15.44:0/2979198992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb00b4920 0x7f6fb0159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.465+0000 7f6fafe00640 1 -- 172.21.15.44:0/2979198992 >> 172.21.15.44:0/2979198992 conn(0x7f6fb009d4e0 msgr2=0x7f6fb00b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:57.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.465+0000 7f6fafe00640 1 -- 172.21.15.44:0/2979198992 shutdown_connections 2024-03-30T13:12:57.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.466+0000 7f6fafe00640 1 -- 172.21.15.44:0/2979198992 wait complete. 2024-03-30T13:12:57.489 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:12:57.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.713+0000 7f22bee00640 1 Processor -- start 2024-03-30T13:12:57.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.714+0000 7f22bee00640 1 -- start start 2024-03-30T13:12:57.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.715+0000 7f22bee00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f22b806e980 0x7f22b8072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:57.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.715+0000 7f22bee00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80ae9d0 0x7f22b80aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:57.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.715+0000 7f22bee00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22b80ad2e0 con 0x7f22b80acd60 2024-03-30T13:12:57.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.715+0000 7f22bee00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f22b80ad5c0 con 0x7f22b806e980 2024-03-30T13:12:57.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.715+0000 7f22bee00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f22b8071450 con 0x7f22b80ae9d0 2024-03-30T13:12:57.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.716+0000 7f22bd000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f22b80acd60 0x7f22b815d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45168/0 (socket says 172.21.15.44:45168) 2024-03-30T13:12:57.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.716+0000 7f22bd000640 1 -- 172.21.15.44:0/2322353413 learned_addr learned my addr 172.21.15.44:0/2322353413 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:57.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.716+0000 7f22be400640 1 --2- 172.21.15.44:0/2322353413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80ae9d0 0x7f22b80aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:57.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.716+0000 7f22bda00640 1 --2- 172.21.15.44:0/2322353413 >> v2:172.21.15.151:3300/0 conn(0x7f22b806e980 0x7f22b8072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:57.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.716+0000 7f22b7e00640 1 -- 172.21.15.44:0/2322353413 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 872336225 0 0) 0x7f22b80ad2e0 con 0x7f22b80acd60 2024-03-30T13:12:57.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.716+0000 7f22b7e00640 1 -- 172.21.15.44:0/2322353413 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22a0003520 con 0x7f22b80acd60 2024-03-30T13:12:57.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.717+0000 7f22b7e00640 1 -- 172.21.15.44:0/2322353413 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2757910910 0 0) 0x7f22a0003520 con 0x7f22b80acd60 2024-03-30T13:12:57.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.717+0000 7f22be400640 1 -- 172.21.15.44:0/2322353413 >> v2:172.21.15.151:3300/0 conn(0x7f22b806e980 msgr2=0x7f22b8072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:57.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.717+0000 7f22be400640 1 --2- 172.21.15.44:0/2322353413 >> v2:172.21.15.151:3300/0 conn(0x7f22b806e980 0x7f22b8072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.717+0000 7f22be400640 1 -- 172.21.15.44:0/2322353413 >> v1:172.21.15.44:6789/0 conn(0x7f22b80acd60 legacy=0x7f22b815d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.717+0000 7f22be400640 1 -- 172.21.15.44:0/2322353413 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b80716a0 con 0x7f22b80ae9d0 2024-03-30T13:12:57.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.718+0000 7f22be400640 1 --2- 172.21.15.44:0/2322353413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80ae9d0 0x7f22b80aee60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009d90 tx=0x7f22b002bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe87885cee123c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:57.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.719+0000 7f22b7e00640 1 -- 172.21.15.44:0/2322353413 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b0039070 con 0x7f22b80ae9d0 2024-03-30T13:12:57.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.719+0000 7f22b7e00640 1 -- 172.21.15.44:0/2322353413 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b002c8a0 con 0x7f22b80ae9d0 2024-03-30T13:12:57.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.719+0000 7f22b7e00640 1 -- 172.21.15.44:0/2322353413 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4001670 con 0x7f22b80ae9d0 2024-03-30T13:12:57.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.719+0000 7f22bee00640 1 -- 172.21.15.44:0/2322353413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80ae9d0 msgr2=0x7f22b80aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.719+0000 7f22bee00640 1 --2- 172.21.15.44:0/2322353413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80ae9d0 0x7f22b80aee60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009d90 tx=0x7f22b002bd70 comp rx=0 tx=0).stop 2024-03-30T13:12:57.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.719+0000 7f22bee00640 1 -- 172.21.15.44:0/2322353413 shutdown_connections 2024-03-30T13:12:57.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.719+0000 7f22bee00640 1 --2- 172.21.15.44:0/2322353413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80ae9d0 0x7f22b80aee60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.719+0000 7f22bee00640 1 --2- 172.21.15.44:0/2322353413 >> v2:172.21.15.151:3300/0 conn(0x7f22b806e980 0x7f22b8072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.719+0000 7f22bee00640 1 -- 172.21.15.44:0/2322353413 >> 172.21.15.44:0/2322353413 conn(0x7f22b80cfd90 msgr2=0x7f22b80d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:57.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.719+0000 7f22bee00640 1 -- 172.21.15.44:0/2322353413 shutdown_connections 2024-03-30T13:12:57.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.719+0000 7f22bee00640 1 -- 172.21.15.44:0/2322353413 wait complete. 2024-03-30T13:12:57.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.721+0000 7f22bee00640 1 Processor -- start 2024-03-30T13:12:57.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.721+0000 7f22bee00640 1 -- start start 2024-03-30T13:12:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.722+0000 7f22bee00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b806e980 0x7f22b8155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.722+0000 7f22bee00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22b80acd60 0x7f22b80ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.722+0000 7f22bee00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80ae9d0 0x7f22b80b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.722+0000 7f22bee00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f22b80af3a0 con 0x7f22b806e980 2024-03-30T13:12:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.722+0000 7f22bee00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f22b8071c60 con 0x7f22b80acd60 2024-03-30T13:12:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.722+0000 7f22bee00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f22b8156020 con 0x7f22b80ae9d0 2024-03-30T13:12:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.723+0000 7f22bda00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b806e980 0x7f22b8155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.723+0000 7f22bda00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b806e980 0x7f22b8155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39986/0 (socket says 172.21.15.44:39986) 2024-03-30T13:12:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.723+0000 7f22bda00640 1 -- 172.21.15.44:0/3990408555 learned_addr learned my addr 172.21.15.44:0/3990408555 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.723+0000 7f22bd000640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22b80acd60 0x7f22b80ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:57.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.723+0000 7f22be400640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80ae9d0 0x7f22b80b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:57.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.723+0000 7f22bda00640 1 -- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80ae9d0 msgr2=0x7f22b80b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.723+0000 7f22bda00640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80ae9d0 0x7f22b80b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.723+0000 7f22bda00640 1 -- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22b80acd60 msgr2=0x7f22b80ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.723+0000 7f22bda00640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22b80acd60 0x7f22b80ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.723+0000 7f22bda00640 1 -- 172.21.15.44:0/3990408555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b81573d0 con 0x7f22b806e980 2024-03-30T13:12:57.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.723+0000 7f22bda00640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b806e980 0x7f22b8155660 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00e9b0 tx=0x7f22ac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.724+0000 7f22b5600640 1 -- 172.21.15.44:0/3990408555 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac017070 con 0x7f22b806e980 2024-03-30T13:12:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.724+0000 7f22b5600640 1 -- 172.21.15.44:0/3990408555 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ac00c9a0 con 0x7f22b806e980 2024-03-30T13:12:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.724+0000 7f22bee00640 1 -- 172.21.15.44:0/3990408555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b81576b0 con 0x7f22b806e980 2024-03-30T13:12:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.724+0000 7f22b5600640 1 -- 172.21.15.44:0/3990408555 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac00cd90 con 0x7f22b806e980 2024-03-30T13:12:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.724+0000 7f22bee00640 1 -- 172.21.15.44:0/3990408555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b80ce590 con 0x7f22b806e980 2024-03-30T13:12:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.725+0000 7f22bee00640 1 -- 172.21.15.44:0/3990408555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b8075890 con 0x7f22b806e980 2024-03-30T13:12:57.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.726+0000 7f22b5600640 1 -- 172.21.15.44:0/3990408555 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f22ac01a070 con 0x7f22b806e980 2024-03-30T13:12:57.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.727+0000 7f22b5600640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f229806c530 0x7f229806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:57.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.727+0000 7f22b5600640 1 -- 172.21.15.44:0/3990408555 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f22ac08bf00 con 0x7f22b806e980 2024-03-30T13:12:57.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.728+0000 7f22bd000640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f229806c530 0x7f229806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:57.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.729+0000 7f22bd000640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f229806c530 0x7f229806e9f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f22b8156a90 tx=0x7f22a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:57.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.731+0000 7f22b5600640 1 -- 172.21.15.44:0/3990408555 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f22ac05a0f0 con 0x7f22b806e980 2024-03-30T13:12:57.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.936+0000 7f22bee00640 1 -- 172.21.15.44:0/3990408555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f22b8159680 con 0x7f22b806e980 2024-03-30T13:12:57.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.937+0000 7f22b5600640 1 -- 172.21.15.44:0/3990408555 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f22ac0599f0 con 0x7f22b806e980 2024-03-30T13:12:57.940 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:57.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.939+0000 7f22bee00640 1 -- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f229806c530 msgr2=0x7f229806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.939+0000 7f22bee00640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f229806c530 0x7f229806e9f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f22b8156a90 tx=0x7f22a4009040 comp rx=0 tx=0).stop 2024-03-30T13:12:57.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.939+0000 7f22bee00640 1 -- 172.21.15.44:0/3990408555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b806e980 msgr2=0x7f22b8155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:57.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.939+0000 7f22bee00640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b806e980 0x7f22b8155660 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00e9b0 tx=0x7f22ac00ee70 comp rx=0 tx=0).stop 2024-03-30T13:12:57.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.940+0000 7f22bee00640 1 -- 172.21.15.44:0/3990408555 shutdown_connections 2024-03-30T13:12:57.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.940+0000 7f22bee00640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80ae9d0 0x7f22b80b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.940+0000 7f22bee00640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f229806c530 0x7f229806e9f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.940+0000 7f22bee00640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22b80acd60 0x7f22b80ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.940+0000 7f22bee00640 1 --2- 172.21.15.44:0/3990408555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22b806e980 0x7f22b8155660 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:57.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.940+0000 7f22bee00640 1 -- 172.21.15.44:0/3990408555 >> 172.21.15.44:0/3990408555 conn(0x7f22b80cfd90 msgr2=0x7f22b806d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:57.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.940+0000 7f22bee00640 1 -- 172.21.15.44:0/3990408555 shutdown_connections 2024-03-30T13:12:57.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:57.940+0000 7f22bee00640 1 -- 172.21.15.44:0/3990408555 wait complete. 2024-03-30T13:12:57.962 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:12:58.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.184+0000 7f5bf3000640 1 Processor -- start 2024-03-30T13:12:58.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.185+0000 7f5bf3000640 1 -- start start 2024-03-30T13:12:58.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.186+0000 7f5bf3000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5bec0b4920 0x7f5bec0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:58.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.186+0000 7f5bf3000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec0d0b90 0x7f5bec0d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:58.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.186+0000 7f5bf3000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bec0b54b0 con 0x7f5bec0b4d00 2024-03-30T13:12:58.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.186+0000 7f5bf3000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f5bec0d0260 con 0x7f5bec0b4920 2024-03-30T13:12:58.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.186+0000 7f5bf3000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5bec0cfca0 con 0x7f5bec0d0b90 2024-03-30T13:12:58.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.187+0000 7f5bf1200640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5bec0b4d00 0x7f5bec0d4ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45184/0 (socket says 172.21.15.44:45184) 2024-03-30T13:12:58.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.187+0000 7f5bf1200640 1 -- 172.21.15.44:0/656611110 learned_addr learned my addr 172.21.15.44:0/656611110 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:58.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.187+0000 7f5bf1c00640 1 --2- 172.21.15.44:0/656611110 >> v2:172.21.15.44:3300/0 conn(0x7f5bec0b4920 0x7f5bec0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:58.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.187+0000 7f5bf2600640 1 --2- 172.21.15.44:0/656611110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec0d0b90 0x7f5bec0d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:58.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.187+0000 7f5bf1c00640 1 -- 172.21.15.44:0/656611110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec0d0b90 msgr2=0x7f5bec0d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:58.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.187+0000 7f5bf1c00640 1 --2- 172.21.15.44:0/656611110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec0d0b90 0x7f5bec0d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.187+0000 7f5bf1c00640 1 -- 172.21.15.44:0/656611110 >> v1:172.21.15.44:6789/0 conn(0x7f5bec0b4d00 legacy=0x7f5bec0d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:58.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.187+0000 7f5bf1c00640 1 -- 172.21.15.44:0/656611110 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bec0cff80 con 0x7f5bec0b4920 2024-03-30T13:12:58.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.188+0000 7f5bf1c00640 1 --2- 172.21.15.44:0/656611110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec0b4920 0x7f5bec0b3ab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5be00097a0 tx=0x7f5be002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ed593a1545d887 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:58.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.189+0000 7f5bebe00640 1 -- 172.21.15.44:0/656611110 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0031780 con 0x7f5bec0b4920 2024-03-30T13:12:58.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.189+0000 7f5bebe00640 1 -- 172.21.15.44:0/656611110 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be0037070 con 0x7f5bec0b4920 2024-03-30T13:12:58.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.189+0000 7f5bebe00640 1 -- 172.21.15.44:0/656611110 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0031b40 con 0x7f5bec0b4920 2024-03-30T13:12:58.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.189+0000 7f5bf3000640 1 -- 172.21.15.44:0/656611110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec0b4920 msgr2=0x7f5bec0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:58.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.189+0000 7f5bf3000640 1 --2- 172.21.15.44:0/656611110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec0b4920 0x7f5bec0b3ab0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5be00097a0 tx=0x7f5be002b820 comp rx=0 tx=0).stop 2024-03-30T13:12:58.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.190+0000 7f5bf3000640 1 -- 172.21.15.44:0/656611110 shutdown_connections 2024-03-30T13:12:58.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.190+0000 7f5bf3000640 1 --2- 172.21.15.44:0/656611110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec0d0b90 0x7f5bec0d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.190+0000 7f5bf3000640 1 --2- 172.21.15.44:0/656611110 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec0b4920 0x7f5bec0b3ab0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.190+0000 7f5bf3000640 1 -- 172.21.15.44:0/656611110 >> 172.21.15.44:0/656611110 conn(0x7f5bec09d4e0 msgr2=0x7f5bec0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:58.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.190+0000 7f5bf3000640 1 -- 172.21.15.44:0/656611110 shutdown_connections 2024-03-30T13:12:58.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.190+0000 7f5bf3000640 1 -- 172.21.15.44:0/656611110 wait complete. 2024-03-30T13:12:58.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.191+0000 7f5bf3000640 1 Processor -- start 2024-03-30T13:12:58.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.192+0000 7f5bf3000640 1 -- start start 2024-03-30T13:12:58.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.192+0000 7f5bf3000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec0b4920 0x7f5bec0c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:58.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.192+0000 7f5bf3000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec0b4d00 0x7f5bec156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:58.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf3000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec0d0b90 0x7f5bec0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:58.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf3000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec0b3ff0 con 0x7f5bec0b4920 2024-03-30T13:12:58.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf3000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5bec0d2180 con 0x7f5bec0b4d00 2024-03-30T13:12:58.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf3000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5bec0cf8c0 con 0x7f5bec0d0b90 2024-03-30T13:12:58.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf1c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec0b4920 0x7f5bec0c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:58.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf1c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec0b4920 0x7f5bec0c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40006/0 (socket says 172.21.15.44:40006) 2024-03-30T13:12:58.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf1c00640 1 -- 172.21.15.44:0/1706726539 learned_addr learned my addr 172.21.15.44:0/1706726539 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:58.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf2600640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec0d0b90 0x7f5bec0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:58.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf1200640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec0b4d00 0x7f5bec156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:58.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf1c00640 1 -- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec0d0b90 msgr2=0x7f5bec0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:58.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf1c00640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec0d0b90 0x7f5bec0b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf1c00640 1 -- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec0b4d00 msgr2=0x7f5bec156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:58.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf1c00640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec0b4d00 0x7f5bec156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.193+0000 7f5bf1c00640 1 -- 172.21.15.44:0/1706726539 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bec0c9830 con 0x7f5bec0b4920 2024-03-30T13:12:58.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.194+0000 7f5bf1c00640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec0b4920 0x7f5bec0c92f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5be0034040 tx=0x7f5be00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:58.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.194+0000 7f5be9600640 1 -- 172.21.15.44:0/1706726539 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0032820 con 0x7f5bec0b4920 2024-03-30T13:12:58.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.194+0000 7f5be9600640 1 -- 172.21.15.44:0/1706726539 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be00329e0 con 0x7f5bec0b4920 2024-03-30T13:12:58.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.194+0000 7f5be9600640 1 -- 172.21.15.44:0/1706726539 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be0032dd0 con 0x7f5bec0b4920 2024-03-30T13:12:58.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.194+0000 7f5bf3000640 1 -- 172.21.15.44:0/1706726539 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bec156950 con 0x7f5bec0b4920 2024-03-30T13:12:58.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.194+0000 7f5bf3000640 1 -- 172.21.15.44:0/1706726539 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bec0cb450 con 0x7f5bec0b4920 2024-03-30T13:12:58.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.195+0000 7f5bf3000640 1 -- 172.21.15.44:0/1706726539 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bec0cb250 con 0x7f5bec0b4920 2024-03-30T13:12:58.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.196+0000 7f5be9600640 1 -- 172.21.15.44:0/1706726539 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5be004e440 con 0x7f5bec0b4920 2024-03-30T13:12:58.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.198+0000 7f5be9600640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5bd006c560 0x7f5bd006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:58.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.198+0000 7f5be9600640 1 -- 172.21.15.44:0/1706726539 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f5be00ad9c0 con 0x7f5bec0b4920 2024-03-30T13:12:58.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.198+0000 7f5bf1200640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5bd006c560 0x7f5bd006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:58.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.199+0000 7f5bf1200640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5bd006c560 0x7f5bd006ea20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5bec160e40 tx=0x7f5bdc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:58.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.202+0000 7f5be9600640 1 -- 172.21.15.44:0/1706726539 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5be0040070 con 0x7f5bec0b4920 2024-03-30T13:12:58.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.404+0000 7f5bf3000640 1 -- 172.21.15.44:0/1706726539 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5bec075890 con 0x7f5bec0b4920 2024-03-30T13:12:58.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.405+0000 7f5be9600640 1 -- 172.21.15.44:0/1706726539 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f5be002f050 con 0x7f5bec0b4920 2024-03-30T13:12:58.409 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:12:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.407+0000 7f5bf3000640 1 -- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5bd006c560 msgr2=0x7f5bd006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.407+0000 7f5bf3000640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5bd006c560 0x7f5bd006ea20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5bec160e40 tx=0x7f5bdc009040 comp rx=0 tx=0).stop 2024-03-30T13:12:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.407+0000 7f5bf3000640 1 -- 172.21.15.44:0/1706726539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec0b4920 msgr2=0x7f5bec0c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.407+0000 7f5bf3000640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec0b4920 0x7f5bec0c92f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5be0034040 tx=0x7f5be00046c0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.408+0000 7f5bf3000640 1 -- 172.21.15.44:0/1706726539 shutdown_connections 2024-03-30T13:12:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.408+0000 7f5bf3000640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec0d0b90 0x7f5bec0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.408+0000 7f5bf3000640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5bd006c560 0x7f5bd006ea20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.408+0000 7f5bf3000640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec0b4d00 0x7f5bec156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.408+0000 7f5bf3000640 1 --2- 172.21.15.44:0/1706726539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bec0b4920 0x7f5bec0c92f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.408+0000 7f5bf3000640 1 -- 172.21.15.44:0/1706726539 >> 172.21.15.44:0/1706726539 conn(0x7f5bec09d4e0 msgr2=0x7f5bec0d4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.408+0000 7f5bf3000640 1 -- 172.21.15.44:0/1706726539 shutdown_connections 2024-03-30T13:12:58.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.408+0000 7f5bf3000640 1 -- 172.21.15.44:0/1706726539 wait complete. 2024-03-30T13:12:58.432 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:12:58.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.654+0000 7f627b600640 1 Processor -- start 2024-03-30T13:12:58.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.655+0000 7f627b600640 1 -- start start 2024-03-30T13:12:58.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.656+0000 7f627b600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627406d8f0 0x7f627415fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:58.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.656+0000 7f627b600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f62741603d0 0x7f62740cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:58.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.656+0000 7f627b600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62740ce9c0 con 0x7f627413f0c0 2024-03-30T13:12:58.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.656+0000 7f627b600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6274160e30 con 0x7f62741603d0 2024-03-30T13:12:58.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.656+0000 7f627b600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6274160b50 con 0x7f627406d8f0 2024-03-30T13:12:58.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.657+0000 7f6278c00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f627413f0c0 0x7f627406d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45194/0 (socket says 172.21.15.44:45194) 2024-03-30T13:12:58.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.657+0000 7f6278c00640 1 -- 172.21.15.44:0/2830274034 learned_addr learned my addr 172.21.15.44:0/2830274034 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:12:58.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.657+0000 7f6279600640 1 --2- 172.21.15.44:0/2830274034 >> v2:172.21.15.44:3300/0 conn(0x7f62741603d0 0x7f62740cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:58.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.657+0000 7f6273400640 1 -- 172.21.15.44:0/2830274034 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236881913 0 0) 0x7f6264001490 con 0x7f627413f0c0 2024-03-30T13:12:58.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.657+0000 7f6273e00640 1 --2- 172.21.15.44:0/2830274034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627406d8f0 0x7f627415fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:58.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.657+0000 7f6273400640 1 -- 172.21.15.44:0/2830274034 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6258003520 con 0x7f627413f0c0 2024-03-30T13:12:58.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.657+0000 7f6279600640 1 -- 172.21.15.44:0/2830274034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627406d8f0 msgr2=0x7f627415fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:58.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.657+0000 7f6279600640 1 --2- 172.21.15.44:0/2830274034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627406d8f0 0x7f627415fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.657+0000 7f6279600640 1 -- 172.21.15.44:0/2830274034 >> v1:172.21.15.44:6789/0 conn(0x7f627413f0c0 legacy=0x7f627406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:58.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.658+0000 7f6279600640 1 -- 172.21.15.44:0/2830274034 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627413fa40 con 0x7f62741603d0 2024-03-30T13:12:58.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.659+0000 7f6279600640 1 --2- 172.21.15.44:0/2830274034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62741603d0 0x7f62740cfbb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f626c0097a0 tx=0x7f626c02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f806dc0d34ae559 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:58.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.659+0000 7f6273400640 1 -- 172.21.15.44:0/2830274034 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c039070 con 0x7f62741603d0 2024-03-30T13:12:58.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.659+0000 7f6273400640 1 -- 172.21.15.44:0/2830274034 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f626c0316f0 con 0x7f62741603d0 2024-03-30T13:12:58.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.659+0000 7f6273400640 1 -- 172.21.15.44:0/2830274034 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c031ac0 con 0x7f62741603d0 2024-03-30T13:12:58.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.659+0000 7f627b600640 1 -- 172.21.15.44:0/2830274034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62741603d0 msgr2=0x7f62740cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:58.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.659+0000 7f627b600640 1 --2- 172.21.15.44:0/2830274034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62741603d0 0x7f62740cfbb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f626c0097a0 tx=0x7f626c02b790 comp rx=0 tx=0).stop 2024-03-30T13:12:58.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.660+0000 7f627b600640 1 -- 172.21.15.44:0/2830274034 shutdown_connections 2024-03-30T13:12:58.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.660+0000 7f627b600640 1 --2- 172.21.15.44:0/2830274034 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62741603d0 0x7f62740cfbb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.660+0000 7f627b600640 1 --2- 172.21.15.44:0/2830274034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f627406d8f0 0x7f627415fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.660+0000 7f627b600640 1 -- 172.21.15.44:0/2830274034 >> 172.21.15.44:0/2830274034 conn(0x7f62740b5b00 msgr2=0x7f627406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:58.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.660+0000 7f627b600640 1 -- 172.21.15.44:0/2830274034 shutdown_connections 2024-03-30T13:12:58.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.660+0000 7f627b600640 1 -- 172.21.15.44:0/2830274034 wait complete. 2024-03-30T13:12:58.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.661+0000 7f627b600640 1 Processor -- start 2024-03-30T13:12:58.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.662+0000 7f627b600640 1 -- start start 2024-03-30T13:12:58.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f627b600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f627406d8f0 0x7f62741f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:58.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f627b600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627413f0c0 0x7f62741447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:58.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f627b600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62741603d0 0x7f62740b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:58.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f627b600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6274160820 con 0x7f627413f0c0 2024-03-30T13:12:58.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f627b600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6274140000 con 0x7f627406d8f0 2024-03-30T13:12:58.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f627b600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f627413f4a0 con 0x7f62741603d0 2024-03-30T13:12:58.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f6273e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627413f0c0 0x7f62741447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:58.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f6273e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627413f0c0 0x7f62741447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40024/0 (socket says 172.21.15.44:40024) 2024-03-30T13:12:58.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f6273e00640 1 -- 172.21.15.44:0/2204878573 learned_addr learned my addr 172.21.15.44:0/2204878573 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:58.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f6278c00640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f627406d8f0 0x7f62741f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:58.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f6279600640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62741603d0 0x7f62740b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:58.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f6273e00640 1 -- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62741603d0 msgr2=0x7f62740b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:58.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f6273e00640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62741603d0 0x7f62740b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f6273e00640 1 -- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f627406d8f0 msgr2=0x7f62741f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:58.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f6273e00640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f627406d8f0 0x7f62741f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.663+0000 7f6273e00640 1 -- 172.21.15.44:0/2204878573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6274142e20 con 0x7f627413f0c0 2024-03-30T13:12:58.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.664+0000 7f6273e00640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627413f0c0 0x7f62741447a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f625c00d5f0 tx=0x7f625c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:58.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.664+0000 7f6270c00640 1 -- 172.21.15.44:0/2204878573 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c0125f0 con 0x7f627413f0c0 2024-03-30T13:12:58.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.664+0000 7f6270c00640 1 -- 172.21.15.44:0/2204878573 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625c019070 con 0x7f627413f0c0 2024-03-30T13:12:58.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.664+0000 7f6270c00640 1 -- 172.21.15.44:0/2204878573 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625c0129d0 con 0x7f627413f0c0 2024-03-30T13:12:58.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.664+0000 7f627b600640 1 -- 172.21.15.44:0/2204878573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6274143100 con 0x7f627413f0c0 2024-03-30T13:12:58.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.664+0000 7f627b600640 1 -- 172.21.15.44:0/2204878573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62741436c0 con 0x7f627413f0c0 2024-03-30T13:12:58.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.665+0000 7f627b600640 1 -- 172.21.15.44:0/2204878573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f627415c310 con 0x7f627413f0c0 2024-03-30T13:12:58.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.666+0000 7f6270c00640 1 -- 172.21.15.44:0/2204878573 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f625c012b70 con 0x7f627413f0c0 2024-03-30T13:12:58.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.668+0000 7f6270c00640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f625006c530 0x7f625006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:58.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.668+0000 7f6270c00640 1 -- 172.21.15.44:0/2204878573 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f625c08bef0 con 0x7f627413f0c0 2024-03-30T13:12:58.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.669+0000 7f6278c00640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f625006c530 0x7f625006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:58.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.670+0000 7f6278c00640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f625006c530 0x7f625006e9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6264005c00 tx=0x7f6264009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:58.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.673+0000 7f6270c00640 1 -- 172.21.15.44:0/2204878573 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f625c05a050 con 0x7f627413f0c0 2024-03-30T13:12:58.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.880+0000 7f627b600640 1 -- 172.21.15.44:0/2204878573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6274075890 con 0x7f627413f0c0 2024-03-30T13:12:58.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.881+0000 7f6270c00640 1 -- 172.21.15.44:0/2204878573 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f625c059950 con 0x7f627413f0c0 2024-03-30T13:12:58.884 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:12:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.883+0000 7f627b600640 1 -- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f625006c530 msgr2=0x7f625006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.884+0000 7f627b600640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f625006c530 0x7f625006e9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6264005c00 tx=0x7f6264009040 comp rx=0 tx=0).stop 2024-03-30T13:12:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.884+0000 7f627b600640 1 -- 172.21.15.44:0/2204878573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627413f0c0 msgr2=0x7f62741447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.884+0000 7f627b600640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627413f0c0 0x7f62741447a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f625c00d5f0 tx=0x7f625c00dab0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.884+0000 7f627b600640 1 -- 172.21.15.44:0/2204878573 shutdown_connections 2024-03-30T13:12:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.884+0000 7f627b600640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62741603d0 0x7f62740b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.884+0000 7f627b600640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f627413f0c0 0x7f62741447a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.884+0000 7f627b600640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f625006c530 0x7f625006e9f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.884+0000 7f627b600640 1 --2- 172.21.15.44:0/2204878573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f627406d8f0 0x7f62741f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.884+0000 7f627b600640 1 -- 172.21.15.44:0/2204878573 >> 172.21.15.44:0/2204878573 conn(0x7f62740b5b00 msgr2=0x7f627415bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.884+0000 7f627b600640 1 -- 172.21.15.44:0/2204878573 shutdown_connections 2024-03-30T13:12:58.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:58.884+0000 7f627b600640 1 -- 172.21.15.44:0/2204878573 wait complete. 2024-03-30T13:12:58.908 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:12:59.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.131+0000 7f21d3e00640 1 Processor -- start 2024-03-30T13:12:59.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.131+0000 7f21d3e00640 1 -- start start 2024-03-30T13:12:59.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.133+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21d4145820 0x7f21d415d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.133+0000 7f21d3e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f21d4071de0 0x7f21d40cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.133+0000 7f21d3e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d415d5c0 con 0x7f21d40cda30 2024-03-30T13:12:59.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.133+0000 7f21d3e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f21d40737d0 con 0x7f21d4071de0 2024-03-30T13:12:59.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.133+0000 7f21d3e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f21d4072280 con 0x7f21d4145820 2024-03-30T13:12:59.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.133+0000 7f21d2000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f21d4071de0 0x7f21d40cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:59.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.134+0000 7f21d2a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21d4145820 0x7f21d415d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:59.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.134+0000 7f21d2000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f21d4071de0 0x7f21d40cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:45140/0 (socket says 172.21.15.44:45140) 2024-03-30T13:12:59.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.134+0000 7f21d2000640 1 -- 172.21.15.44:0/1618704244 learned_addr learned my addr 172.21.15.44:0/1618704244 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:59.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.134+0000 7f21d2000640 1 -- 172.21.15.44:0/1618704244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21d4145820 msgr2=0x7f21d415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:59.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.134+0000 7f21d2000640 1 --2- 172.21.15.44:0/1618704244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21d4145820 0x7f21d415d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.134+0000 7f21d2000640 1 -- 172.21.15.44:0/1618704244 >> v1:172.21.15.151:6789/0 conn(0x7f21d40cda30 legacy=0x7f21d415fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:59.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.134+0000 7f21d2000640 1 -- 172.21.15.44:0/1618704244 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d4072560 con 0x7f21d4071de0 2024-03-30T13:12:59.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.136+0000 7f21d2000640 1 --2- 172.21.15.44:0/1618704244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21d4071de0 0x7f21d40cd4f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009870 tx=0x7f21c002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8bee5ea56d8e41a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:59.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.136+0000 7f21d1600640 1 -- 172.21.15.44:0/1618704244 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0034070 con 0x7f21d4071de0 2024-03-30T13:12:59.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.136+0000 7f21d1600640 1 -- 172.21.15.44:0/1618704244 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c0030840 con 0x7f21d4071de0 2024-03-30T13:12:59.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.136+0000 7f21d1600640 1 -- 172.21.15.44:0/1618704244 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0030c10 con 0x7f21d4071de0 2024-03-30T13:12:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.137+0000 7f21d3e00640 1 -- 172.21.15.44:0/1618704244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21d4071de0 msgr2=0x7f21d40cd4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.137+0000 7f21d3e00640 1 --2- 172.21.15.44:0/1618704244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21d4071de0 0x7f21d40cd4f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f21c0009870 tx=0x7f21c002b980 comp rx=0 tx=0).stop 2024-03-30T13:12:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.137+0000 7f21d3e00640 1 -- 172.21.15.44:0/1618704244 shutdown_connections 2024-03-30T13:12:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.137+0000 7f21d3e00640 1 --2- 172.21.15.44:0/1618704244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21d4071de0 0x7f21d40cd4f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.137+0000 7f21d3e00640 1 --2- 172.21.15.44:0/1618704244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21d4145820 0x7f21d415d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.137+0000 7f21d3e00640 1 -- 172.21.15.44:0/1618704244 >> 172.21.15.44:0/1618704244 conn(0x7f21d406b970 msgr2=0x7f21d406bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.137+0000 7f21d3e00640 1 -- 172.21.15.44:0/1618704244 shutdown_connections 2024-03-30T13:12:59.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.137+0000 7f21d3e00640 1 -- 172.21.15.44:0/1618704244 wait complete. 2024-03-30T13:12:59.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.139+0000 7f21d3e00640 1 Processor -- start 2024-03-30T13:12:59.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.139+0000 7f21d3e00640 1 -- start start 2024-03-30T13:12:59.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.140+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4071de0 0x7f21d415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.140+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21d40cda30 0x7f21d40b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.140+0000 7f21d3e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21d4145820 0x7f21d40caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.140+0000 7f21d3e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f21d4072e00 con 0x7f21d4071de0 2024-03-30T13:12:59.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.140+0000 7f21d3e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f21d4072b20 con 0x7f21d40cda30 2024-03-30T13:12:59.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.140+0000 7f21d3e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f21d4145c00 con 0x7f21d4145820 2024-03-30T13:12:59.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.141+0000 7f21d2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4071de0 0x7f21d415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:59.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.141+0000 7f21d2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4071de0 0x7f21d415b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40036/0 (socket says 172.21.15.44:40036) 2024-03-30T13:12:59.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.141+0000 7f21d2a00640 1 -- 172.21.15.44:0/3348510521 learned_addr learned my addr 172.21.15.44:0/3348510521 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:59.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.141+0000 7f21d2000640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21d40cda30 0x7f21d40b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.141+0000 7f21d2a00640 1 -- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21d4145820 msgr2=0x7f21d40caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.141+0000 7f21d3400640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21d4145820 0x7f21d40caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.141+0000 7f21d2a00640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21d4145820 0x7f21d40caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.141+0000 7f21d2a00640 1 -- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21d40cda30 msgr2=0x7f21d40b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.141+0000 7f21d2a00640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21d40cda30 0x7f21d40b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.141+0000 7f21d2a00640 1 -- 172.21.15.44:0/3348510521 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d40b2ef0 con 0x7f21d4071de0 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.141+0000 7f21d2000640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21d40cda30 0x7f21d40b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.141+0000 7f21d3400640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21d4145820 0x7f21d40caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.142+0000 7f21d2a00640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4071de0 0x7f21d415b7c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e870 tx=0x7f21c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.142+0000 7f21caa00640 1 -- 172.21.15.44:0/3348510521 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4017070 con 0x7f21d4071de0 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.142+0000 7f21caa00640 1 -- 172.21.15.44:0/3348510521 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c400c8e0 con 0x7f21d4071de0 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.142+0000 7f21caa00640 1 -- 172.21.15.44:0/3348510521 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c400ccd0 con 0x7f21d4071de0 2024-03-30T13:12:59.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.142+0000 7f21d3e00640 1 -- 172.21.15.44:0/3348510521 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d40b31d0 con 0x7f21d4071de0 2024-03-30T13:12:59.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.142+0000 7f21d3e00640 1 -- 172.21.15.44:0/3348510521 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d40b3790 con 0x7f21d4071de0 2024-03-30T13:12:59.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.143+0000 7f21d3e00640 1 -- 172.21.15.44:0/3348510521 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d4075890 con 0x7f21d4071de0 2024-03-30T13:12:59.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.144+0000 7f21caa00640 1 -- 172.21.15.44:0/3348510521 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f21c401a070 con 0x7f21d4071de0 2024-03-30T13:12:59.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.145+0000 7f21caa00640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f21b406c530 0x7f21b406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.145+0000 7f21caa00640 1 -- 172.21.15.44:0/3348510521 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f21c408bd10 con 0x7f21d4071de0 2024-03-30T13:12:59.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.146+0000 7f21d2000640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f21b406c530 0x7f21b406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:59.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.147+0000 7f21d2000640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f21b406c530 0x7f21b406e9f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f21c0036000 tx=0x7f21c003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:59.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.151+0000 7f21caa00640 1 -- 172.21.15.44:0/3348510521 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f21c4091020 con 0x7f21d4071de0 2024-03-30T13:12:59.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.367+0000 7f21d3e00640 1 -- 172.21.15.44:0/3348510521 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f21d415e780 con 0x7f21d4071de0 2024-03-30T13:12:59.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.368+0000 7f21caa00640 1 -- 172.21.15.44:0/3348510521 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f21c4059f00 con 0x7f21d4071de0 2024-03-30T13:12:59.372 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-03-30T13:12:59.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.371+0000 7f21d3e00640 1 -- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f21b406c530 msgr2=0x7f21b406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:59.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.371+0000 7f21d3e00640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f21b406c530 0x7f21b406e9f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f21c0036000 tx=0x7f21c003b040 comp rx=0 tx=0).stop 2024-03-30T13:12:59.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.371+0000 7f21d3e00640 1 -- 172.21.15.44:0/3348510521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4071de0 msgr2=0x7f21d415b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:59.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.371+0000 7f21d3e00640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4071de0 0x7f21d415b7c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e870 tx=0x7f21c400ed30 comp rx=0 tx=0).stop 2024-03-30T13:12:59.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.371+0000 7f21d3e00640 1 -- 172.21.15.44:0/3348510521 shutdown_connections 2024-03-30T13:12:59.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.371+0000 7f21d3e00640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21d4145820 0x7f21d40caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.371+0000 7f21d3e00640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f21b406c530 0x7f21b406e9f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.371+0000 7f21d3e00640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21d40cda30 0x7f21d40b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.371+0000 7f21d3e00640 1 --2- 172.21.15.44:0/3348510521 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f21d4071de0 0x7f21d415b7c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.371+0000 7f21d3e00640 1 -- 172.21.15.44:0/3348510521 >> 172.21.15.44:0/3348510521 conn(0x7f21d406b970 msgr2=0x7f21d415e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:59.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.371+0000 7f21d3e00640 1 -- 172.21.15.44:0/3348510521 shutdown_connections 2024-03-30T13:12:59.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.371+0000 7f21d3e00640 1 -- 172.21.15.44:0/3348510521 wait complete. 2024-03-30T13:12:59.396 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-30T13:12:59.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:59.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-30T13:12:59.494 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:12:59.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:12:59.495 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-30T13:12:59.562 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:12:59.562 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:59.621 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:12:59.621 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:59.679 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:12:59.679 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:12:59.733 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:12:59.868 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:59.876 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:12:59.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.950+0000 7ff8ce000640 1 Processor -- start 2024-03-30T13:12:59.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.951+0000 7ff8ce000640 1 -- start start 2024-03-30T13:12:59.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.952+0000 7ff8ce000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff8c81562f0 0x7ff8c81566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.952+0000 7ff8ce000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff8c8142300 0x7ff8c80d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.952+0000 7ff8ce000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8c80d07d0 0x7ff8c815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.952+0000 7ff8ce000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff8c8156c10 con 0x7ff8c81562f0 2024-03-30T13:12:59.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.952+0000 7ff8ce000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7ff8c8160c20 con 0x7ff8c8142300 2024-03-30T13:12:59.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.952+0000 7ff8ce000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c81600a0 con 0x7ff8c80d07d0 2024-03-30T13:12:59.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.952+0000 7ff8ccc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff8c81562f0 0x7ff8c81566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:59.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.952+0000 7ff8ccc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff8c81562f0 0x7ff8c81566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40042/0 (socket says 172.21.15.44:40042) 2024-03-30T13:12:59.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.952+0000 7ff8ccc00640 1 -- 172.21.15.44:0/1139241465 learned_addr learned my addr 172.21.15.44:0/1139241465 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:59.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.953+0000 7ff8c7e00640 1 --2- 172.21.15.44:0/1139241465 >> v2:172.21.15.151:3300/0 conn(0x7ff8c8142300 0x7ff8c80d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:59.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.953+0000 7ff8cd600640 1 --2- 172.21.15.44:0/1139241465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8c80d07d0 0x7ff8c815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:59.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.953+0000 7ff8ccc00640 1 -- 172.21.15.44:0/1139241465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8c80d07d0 msgr2=0x7ff8c815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:59.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.953+0000 7ff8ccc00640 1 --2- 172.21.15.44:0/1139241465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8c80d07d0 0x7ff8c815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.953+0000 7ff8ccc00640 1 -- 172.21.15.44:0/1139241465 >> v2:172.21.15.151:3300/0 conn(0x7ff8c8142300 msgr2=0x7ff8c80d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:12:59.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.953+0000 7ff8ccc00640 1 --2- 172.21.15.44:0/1139241465 >> v2:172.21.15.151:3300/0 conn(0x7ff8c8142300 0x7ff8c80d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.953+0000 7ff8ccc00640 1 -- 172.21.15.44:0/1139241465 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c8160380 con 0x7ff8c81562f0 2024-03-30T13:12:59.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.953+0000 7ff8c7e00640 1 --2- 172.21.15.44:0/1139241465 >> v2:172.21.15.151:3300/0 conn(0x7ff8c8142300 0x7ff8c80d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:12:59.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.954+0000 7ff8ccc00640 1 --2- 172.21.15.44:0/1139241465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c81562f0 0x7ff8c81566d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80afa50 tx=0x7ff8bc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3033cdb6716aec3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:59.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.954+0000 7ff8c7400640 1 -- 172.21.15.44:0/1139241465 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc035020 con 0x7ff8c81562f0 2024-03-30T13:12:59.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.954+0000 7ff8c7400640 1 -- 172.21.15.44:0/1139241465 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8bc031640 con 0x7ff8c81562f0 2024-03-30T13:12:59.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.954+0000 7ff8c7400640 1 -- 172.21.15.44:0/1139241465 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc02d040 con 0x7ff8c81562f0 2024-03-30T13:12:59.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.955+0000 7ff8ce000640 1 -- 172.21.15.44:0/1139241465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c81562f0 msgr2=0x7ff8c81566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:59.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.955+0000 7ff8ce000640 1 --2- 172.21.15.44:0/1139241465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c81562f0 0x7ff8c81566d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80afa50 tx=0x7ff8bc02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.955+0000 7ff8ce000640 1 -- 172.21.15.44:0/1139241465 shutdown_connections 2024-03-30T13:12:59.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.955+0000 7ff8ce000640 1 --2- 172.21.15.44:0/1139241465 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8c80d07d0 0x7ff8c815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.955+0000 7ff8ce000640 1 --2- 172.21.15.44:0/1139241465 >> v2:172.21.15.151:3300/0 conn(0x7ff8c8142300 0x7ff8c80d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.955+0000 7ff8ce000640 1 --2- 172.21.15.44:0/1139241465 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c81562f0 0x7ff8c81566d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.955+0000 7ff8ce000640 1 -- 172.21.15.44:0/1139241465 >> 172.21.15.44:0/1139241465 conn(0x7ff8c806b9a0 msgr2=0x7ff8c806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:12:59.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.955+0000 7ff8ce000640 1 -- 172.21.15.44:0/1139241465 shutdown_connections 2024-03-30T13:12:59.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.955+0000 7ff8ce000640 1 -- 172.21.15.44:0/1139241465 wait complete. 2024-03-30T13:12:59.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.957+0000 7ff8ce000640 1 Processor -- start 2024-03-30T13:12:59.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.957+0000 7ff8ce000640 1 -- start start 2024-03-30T13:12:59.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.958+0000 7ff8ce000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c80d07d0 0x7ff8c812c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.958+0000 7ff8ce000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8c8142300 0x7ff8c81e7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.958+0000 7ff8ce000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8c81562f0 0x7ff8c81e82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.958+0000 7ff8ce000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c8142780 con 0x7ff8c80d07d0 2024-03-30T13:12:59.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.958+0000 7ff8ce000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c8160940 con 0x7ff8c8142300 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.958+0000 7ff8ce000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c80cca20 con 0x7ff8c81562f0 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.959+0000 7ff8ccc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c80d07d0 0x7ff8c812c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.959+0000 7ff8ccc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c80d07d0 0x7ff8c812c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40048/0 (socket says 172.21.15.44:40048) 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.959+0000 7ff8ccc00640 1 -- 172.21.15.44:0/1997222971 learned_addr learned my addr 172.21.15.44:0/1997222971 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.959+0000 7ff8c7e00640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8c8142300 0x7ff8c81e7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.959+0000 7ff8ccc00640 1 -- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8c81562f0 msgr2=0x7ff8c81e82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.959+0000 7ff8ccc00640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8c81562f0 0x7ff8c81e82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.959+0000 7ff8ccc00640 1 -- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8c8142300 msgr2=0x7ff8c81e7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.959+0000 7ff8ccc00640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8c8142300 0x7ff8c81e7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.959+0000 7ff8ccc00640 1 -- 172.21.15.44:0/1997222971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c81301d0 con 0x7ff8c80d07d0 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.959+0000 7ff8ccc00640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c80d07d0 0x7ff8c812c8a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc02b930 tx=0x7ff8bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.960+0000 7ff8c4c00640 1 -- 172.21.15.44:0/1997222971 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc040070 con 0x7ff8c80d07d0 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.960+0000 7ff8c4c00640 1 -- 172.21.15.44:0/1997222971 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8bc03e070 con 0x7ff8c80d07d0 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.960+0000 7ff8c4c00640 1 -- 172.21.15.44:0/1997222971 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc035040 con 0x7ff8c80d07d0 2024-03-30T13:12:59.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.960+0000 7ff8ce000640 1 -- 172.21.15.44:0/1997222971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c812cde0 con 0x7ff8c80d07d0 2024-03-30T13:12:59.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.960+0000 7ff8ce000640 1 -- 172.21.15.44:0/1997222971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c815cb30 con 0x7ff8c80d07d0 2024-03-30T13:12:59.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.961+0000 7ff8ce000640 1 -- 172.21.15.44:0/1997222971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c813faf0 con 0x7ff8c80d07d0 2024-03-30T13:12:59.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.962+0000 7ff8c4c00640 1 -- 172.21.15.44:0/1997222971 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff8bc038020 con 0x7ff8c80d07d0 2024-03-30T13:12:59.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.963+0000 7ff8c4c00640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff8a806c530 0x7ff8a806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:12:59.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.963+0000 7ff8c4c00640 1 -- 172.21.15.44:0/1997222971 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7ff8bc0ad5f0 con 0x7ff8c80d07d0 2024-03-30T13:12:59.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.963+0000 7ff8c7e00640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff8a806c530 0x7ff8a806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:12:59.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.965+0000 7ff8c7e00640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff8a806c530 0x7ff8a806e9f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80cc2e0 tx=0x7ff8b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:12:59.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:12:59.967+0000 7ff8c4c00640 1 -- 172.21.15.44:0/1997222971 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff8c813faf0 con 0x7ff8c80d07d0 2024-03-30T13:13:00.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.177+0000 7ff8ce000640 1 -- 172.21.15.44:0/1997222971 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8c80d05f0 con 0x7ff8c80d07d0 2024-03-30T13:13:00.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.180+0000 7ff8c4c00640 1 -- 172.21.15.44:0/1997222971 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18927 (secure 0 0 0) 0x7ff8c80d05f0 con 0x7ff8c80d07d0 2024-03-30T13:13:00.184 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:00.184 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":29,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:12:27.323786+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:13:00.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.182+0000 7ff8ce000640 1 -- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff8a806c530 msgr2=0x7ff8a806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.182+0000 7ff8ce000640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff8a806c530 0x7ff8a806e9f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff8c80cc2e0 tx=0x7ff8b4008040 comp rx=0 tx=0).stop 2024-03-30T13:13:00.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.182+0000 7ff8ce000640 1 -- 172.21.15.44:0/1997222971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c80d07d0 msgr2=0x7ff8c812c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.182+0000 7ff8ce000640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c80d07d0 0x7ff8c812c8a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc02b930 tx=0x7ff8bc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.182+0000 7ff8ce000640 1 -- 172.21.15.44:0/1997222971 shutdown_connections 2024-03-30T13:13:00.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.182+0000 7ff8ce000640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8c81562f0 0x7ff8c81e82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.182+0000 7ff8ce000640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff8a806c530 0x7ff8a806e9f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.182+0000 7ff8ce000640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8c8142300 0x7ff8c81e7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.183+0000 7ff8ce000640 1 --2- 172.21.15.44:0/1997222971 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff8c80d07d0 0x7ff8c812c8a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.183+0000 7ff8ce000640 1 -- 172.21.15.44:0/1997222971 >> 172.21.15.44:0/1997222971 conn(0x7ff8c806b9a0 msgr2=0x7ff8c8071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:00.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.183+0000 7ff8ce000640 1 -- 172.21.15.44:0/1997222971 shutdown_connections 2024-03-30T13:13:00.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.183+0000 7ff8ce000640 1 -- 172.21.15.44:0/1997222971 wait complete. 2024-03-30T13:13:00.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:13:00.208 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:13:00.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.432+0000 7f75f7c00640 1 Processor -- start 2024-03-30T13:13:00.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.432+0000 7f75f7c00640 1 -- start start 2024-03-30T13:13:00.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.434+0000 7f75f7c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75f013f0c0 0x7f75f006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.434+0000 7f75f7c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f00ce9c0 con 0x7f75f01605a0 2024-03-30T13:13:00.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.434+0000 7f75f7c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f0160b50 con 0x7f75f006d720 2024-03-30T13:13:00.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.434+0000 7f75f7c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f75f0160e30 con 0x7f75f013f0c0 2024-03-30T13:13:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.434+0000 7f75f5c00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f75f01605a0 0x7f75f00cfbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45202/0 (socket says 172.21.15.44:45202) 2024-03-30T13:13:00.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.434+0000 7f75f5c00640 1 -- 172.21.15.44:0/3209319121 learned_addr learned my addr 172.21.15.44:0/3209319121 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.434+0000 7f75f5200640 1 --2- 172.21.15.44:0/3209319121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75f013f0c0 0x7f75f006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150415567 0 0) 0x7f75e8001490 con 0x7f75f01605a0 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75d8003520 con 0x7f75f01605a0 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4268553929 0 0) 0x7f75d8003520 con 0x7f75f01605a0 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75f013f0c0 msgr2=0x7f75f006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 --2- 172.21.15.44:0/3209319121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75f013f0c0 0x7f75f006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 >> v1:172.21.15.151:6789/0 conn(0x7f75f006d720 legacy=0x7f75f015fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f013fa40 con 0x7f75f01605a0 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f75e8001bc0 con 0x7f75f01605a0 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 >> v1:172.21.15.44:6789/0 conn(0x7f75f01605a0 legacy=0x7f75f00cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 --2- 172.21.15.44:0/3209319121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75d80039e0 0x7f75d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 --2- 172.21.15.44:0/3209319121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75f013f0c0 0x7f75d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 --2- 172.21.15.44:0/3209319121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75d8004d40 0x7f75d80051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f75f0160e30 con 0x7f75d8004d40 2024-03-30T13:13:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f75d800bbd0 con 0x7f75d80039e0 2024-03-30T13:13:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.435+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f75d800bdd0 con 0x7f75f013f0c0 2024-03-30T13:13:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.436+0000 7f75f5c00640 1 --2- 172.21.15.44:0/3209319121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75d8004d40 0x7f75d80051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.436+0000 7f75f5200640 1 --2- 172.21.15.44:0/3209319121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75d80039e0 0x7f75d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.436+0000 7f75efe00640 1 --2- 172.21.15.44:0/3209319121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75f013f0c0 0x7f75d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.436+0000 7f75f5c00640 1 -- 172.21.15.44:0/3209319121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75f013f0c0 msgr2=0x7f75d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.436+0000 7f75f5c00640 1 --2- 172.21.15.44:0/3209319121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75f013f0c0 0x7f75d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.436+0000 7f75f5c00640 1 -- 172.21.15.44:0/3209319121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75d80039e0 msgr2=0x7f75d8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.436+0000 7f75f5c00640 1 --2- 172.21.15.44:0/3209319121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75d80039e0 0x7f75d8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.436+0000 7f75f5c00640 1 -- 172.21.15.44:0/3209319121 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d8003520 con 0x7f75d8004d40 2024-03-30T13:13:00.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.437+0000 7f75f5c00640 1 --2- 172.21.15.44:0/3209319121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75d8004d40 0x7f75d80051a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f75e800a960 tx=0x7f75d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852df93a05d50ceb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:00.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.438+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e800a580 con 0x7f75d8004d40 2024-03-30T13:13:00.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.438+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e8007270 con 0x7f75d8004d40 2024-03-30T13:13:00.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.438+0000 7f75ef400640 1 -- 172.21.15.44:0/3209319121 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e80076a0 con 0x7f75d8004d40 2024-03-30T13:13:00.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.438+0000 7f75f7c00640 1 -- 172.21.15.44:0/3209319121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75d8004d40 msgr2=0x7f75d80051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.438+0000 7f75f7c00640 1 --2- 172.21.15.44:0/3209319121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75d8004d40 0x7f75d80051a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f75e800a960 tx=0x7f75d8005830 comp rx=0 tx=0).stop 2024-03-30T13:13:00.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.438+0000 7f75f5c00640 1 -- 172.21.15.44:0/3209319121 reap_dead start 2024-03-30T13:13:00.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.438+0000 7f75f7c00640 1 -- 172.21.15.44:0/3209319121 shutdown_connections 2024-03-30T13:13:00.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.438+0000 7f75f7c00640 1 -- 172.21.15.44:0/3209319121 >> 172.21.15.44:0/3209319121 conn(0x7f75f00b5b00 msgr2=0x7f75f006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:00.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.439+0000 7f75f7c00640 1 -- 172.21.15.44:0/3209319121 shutdown_connections 2024-03-30T13:13:00.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.439+0000 7f75f7c00640 1 -- 172.21.15.44:0/3209319121 wait complete. 2024-03-30T13:13:00.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.440+0000 7f75f7c00640 1 Processor -- start 2024-03-30T13:13:00.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.441+0000 7f75f7c00640 1 -- start start 2024-03-30T13:13:00.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.441+0000 7f75f7c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75d8004d40 0x7f75f015ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.441+0000 7f75f7c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f015da40 0x7f75f01557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.441+0000 7f75f7c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75f0145480 0x7f75f01429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.441+0000 7f75f7c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f75f013f4a0 con 0x7f75f0145480 2024-03-30T13:13:00.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.442+0000 7f75f7c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f75f0140000 con 0x7f75f015da40 2024-03-30T13:13:00.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.442+0000 7f75f7c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f75f013f620 con 0x7f75d8004d40 2024-03-30T13:13:00.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.442+0000 7f75f5c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75f0145480 0x7f75f01429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.442+0000 7f75f5c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75f0145480 0x7f75f01429b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40062/0 (socket says 172.21.15.44:40062) 2024-03-30T13:13:00.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.442+0000 7f75f5c00640 1 -- 172.21.15.44:0/2595838778 learned_addr learned my addr 172.21.15.44:0/2595838778 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:00.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.442+0000 7f75efe00640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f015da40 0x7f75f01557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.442+0000 7f75f5200640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75d8004d40 0x7f75f015ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.442+0000 7f75f5c00640 1 -- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75d8004d40 msgr2=0x7f75f015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.442+0000 7f75f5c00640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75d8004d40 0x7f75f015ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.443+0000 7f75f5c00640 1 -- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f015da40 msgr2=0x7f75f01557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.443+0000 7f75f5c00640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f015da40 0x7f75f01557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.443+0000 7f75f5c00640 1 -- 172.21.15.44:0/2595838778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f015ded0 con 0x7f75f0145480 2024-03-30T13:13:00.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.443+0000 7f75f5c00640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75f0145480 0x7f75f01429b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f75e8000f80 tx=0x7f75f0160d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:00.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.443+0000 7f75ecc00640 1 -- 172.21.15.44:0/2595838778 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e800a580 con 0x7f75f0145480 2024-03-30T13:13:00.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.443+0000 7f75ecc00640 1 -- 172.21.15.44:0/2595838778 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e8045070 con 0x7f75f0145480 2024-03-30T13:13:00.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.443+0000 7f75f7c00640 1 -- 172.21.15.44:0/2595838778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f015e1b0 con 0x7f75f0145480 2024-03-30T13:13:00.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.443+0000 7f75ecc00640 1 -- 172.21.15.44:0/2595838778 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e8001250 con 0x7f75f0145480 2024-03-30T13:13:00.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.443+0000 7f75f7c00640 1 -- 172.21.15.44:0/2595838778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f015e770 con 0x7f75f0145480 2024-03-30T13:13:00.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.445+0000 7f75f7c00640 1 -- 172.21.15.44:0/2595838778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f0075890 con 0x7f75f0145480 2024-03-30T13:13:00.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.446+0000 7f75ecc00640 1 -- 172.21.15.44:0/2595838778 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f75e8007630 con 0x7f75f0145480 2024-03-30T13:13:00.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.447+0000 7f75ecc00640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f75d006c6d0 0x7f75d006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.447+0000 7f75ecc00640 1 -- 172.21.15.44:0/2595838778 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f75e80add30 con 0x7f75f0145480 2024-03-30T13:13:00.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.447+0000 7f75f5200640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f75d006c6d0 0x7f75d006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.449+0000 7f75f5200640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f75d006c6d0 0x7f75d006eb90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009a10 tx=0x7f75e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:00.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.451+0000 7f75ecc00640 1 -- 172.21.15.44:0/2595838778 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f75f00ce9c0 con 0x7f75f0145480 2024-03-30T13:13:00.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.657+0000 7f75f7c00640 1 -- 172.21.15.44:0/2595838778 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f75f006c2c0 con 0x7f75f0145480 2024-03-30T13:13:00.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.658+0000 7f75ecc00640 1 -- 172.21.15.44:0/2595838778 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f75e807bf20 con 0x7f75f0145480 2024-03-30T13:13:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:13:00.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.661+0000 7f75f7c00640 1 -- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f75d006c6d0 msgr2=0x7f75d006eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.661+0000 7f75f7c00640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f75d006c6d0 0x7f75d006eb90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009a10 tx=0x7f75e4008040 comp rx=0 tx=0).stop 2024-03-30T13:13:00.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.661+0000 7f75f7c00640 1 -- 172.21.15.44:0/2595838778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75f0145480 msgr2=0x7f75f01429b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.661+0000 7f75f7c00640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75f0145480 0x7f75f01429b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f75e8000f80 tx=0x7f75f0160d20 comp rx=0 tx=0).stop 2024-03-30T13:13:00.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.661+0000 7f75f7c00640 1 -- 172.21.15.44:0/2595838778 shutdown_connections 2024-03-30T13:13:00.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.661+0000 7f75f7c00640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75f0145480 0x7f75f01429b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.661+0000 7f75f7c00640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f75d006c6d0 0x7f75d006eb90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.661+0000 7f75f7c00640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75f015da40 0x7f75f01557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.661+0000 7f75f7c00640 1 --2- 172.21.15.44:0/2595838778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75d8004d40 0x7f75f015ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.661+0000 7f75f7c00640 1 -- 172.21.15.44:0/2595838778 >> 172.21.15.44:0/2595838778 conn(0x7f75f00b5b00 msgr2=0x7f75f006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:00.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.662+0000 7f75f7c00640 1 -- 172.21.15.44:0/2595838778 shutdown_connections 2024-03-30T13:13:00.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.662+0000 7f75f7c00640 1 -- 172.21.15.44:0/2595838778 wait complete. 2024-03-30T13:13:00.684 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:13:00.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.894+0000 7f2cb8c00640 1 Processor -- start 2024-03-30T13:13:00.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.894+0000 7f2cb8c00640 1 -- start start 2024-03-30T13:13:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.895+0000 7f2cb8c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2cb40b3fa0 0x7f2cb40cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.896+0000 7f2cb8c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb40d0190 0x7f2cb4071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.896+0000 7f2cb8c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb40b2f20 con 0x7f2cb415e5a0 2024-03-30T13:13:00.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.896+0000 7f2cb8c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb40d05e0 con 0x7f2cb40b3fa0 2024-03-30T13:13:00.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.896+0000 7f2cb8c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb40b3b10 con 0x7f2cb40d0190 2024-03-30T13:13:00.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.896+0000 7f2cb1400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2cb40b3fa0 0x7f2cb40cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.896+0000 7f2cb2800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb40d0190 0x7f2cb4071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.897+0000 7f2cb2800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb40d0190 0x7f2cb4071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:59414/0 (socket says 172.21.15.44:59414) 2024-03-30T13:13:00.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.897+0000 7f2cb1e00640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f2cb415e5a0 0x7f2cb4072f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:37088/0 (socket says 172.21.15.44:37088) 2024-03-30T13:13:00.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.897+0000 7f2cb2800640 1 -- 172.21.15.44:0/678585055 learned_addr learned my addr 172.21.15.44:0/678585055 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:00.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.897+0000 7f2cb0a00640 1 -- 172.21.15.44:0/678585055 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 107460642 0 0) 0x7f2cb40b2f20 con 0x7f2cb415e5a0 2024-03-30T13:13:00.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.897+0000 7f2cb0a00640 1 -- 172.21.15.44:0/678585055 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c94003520 con 0x7f2cb415e5a0 2024-03-30T13:13:00.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.897+0000 7f2cb2800640 1 -- 172.21.15.44:0/678585055 >> v2:172.21.15.151:3300/0 conn(0x7f2cb40b3fa0 msgr2=0x7f2cb40cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:00.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.897+0000 7f2cb2800640 1 --2- 172.21.15.44:0/678585055 >> v2:172.21.15.151:3300/0 conn(0x7f2cb40b3fa0 0x7f2cb40cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.897+0000 7f2cb2800640 1 -- 172.21.15.44:0/678585055 >> v1:172.21.15.151:6789/0 conn(0x7f2cb415e5a0 legacy=0x7f2cb4072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.897+0000 7f2cb2800640 1 -- 172.21.15.44:0/678585055 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb40b31e0 con 0x7f2cb40d0190 2024-03-30T13:13:00.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.898+0000 7f2cb1400640 1 --2- 172.21.15.44:0/678585055 >> v2:172.21.15.151:3300/0 conn(0x7f2cb40b3fa0 0x7f2cb40cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:13:00.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.899+0000 7f2cb2800640 1 --2- 172.21.15.44:0/678585055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb40d0190 0x7f2cb4071690 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009e50 tx=0x7f2cac02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e86bc60a55a3322 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:00.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.899+0000 7f2cb0a00640 1 -- 172.21.15.44:0/678585055 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac02cb00 con 0x7f2cb40d0190 2024-03-30T13:13:00.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.899+0000 7f2cb0a00640 1 -- 172.21.15.44:0/678585055 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cac02cca0 con 0x7f2cb40d0190 2024-03-30T13:13:00.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.899+0000 7f2cb0a00640 1 -- 172.21.15.44:0/678585055 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac034610 con 0x7f2cb40d0190 2024-03-30T13:13:00.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.900+0000 7f2cb8c00640 1 -- 172.21.15.44:0/678585055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb40d0190 msgr2=0x7f2cb4071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.900+0000 7f2cb8c00640 1 --2- 172.21.15.44:0/678585055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb40d0190 0x7f2cb4071690 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009e50 tx=0x7f2cac02bf60 comp rx=0 tx=0).stop 2024-03-30T13:13:00.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.900+0000 7f2cb8c00640 1 -- 172.21.15.44:0/678585055 shutdown_connections 2024-03-30T13:13:00.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.900+0000 7f2cb8c00640 1 --2- 172.21.15.44:0/678585055 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb40d0190 0x7f2cb4071690 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.900+0000 7f2cb8c00640 1 --2- 172.21.15.44:0/678585055 >> v2:172.21.15.151:3300/0 conn(0x7f2cb40b3fa0 0x7f2cb40cfc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.900+0000 7f2cb8c00640 1 -- 172.21.15.44:0/678585055 >> 172.21.15.44:0/678585055 conn(0x7f2cb40b5b00 msgr2=0x7f2cb406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:00.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.900+0000 7f2cb8c00640 1 -- 172.21.15.44:0/678585055 shutdown_connections 2024-03-30T13:13:00.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.900+0000 7f2cb8c00640 1 -- 172.21.15.44:0/678585055 wait complete. 2024-03-30T13:13:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.902+0000 7f2cb8c00640 1 Processor -- start 2024-03-30T13:13:00.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.902+0000 7f2cb8c00640 1 -- start start 2024-03-30T13:13:00.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.903+0000 7f2cb8c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb40b3fa0 0x7f2cb414bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.903+0000 7f2cb8c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb40d0190 0x7f2cb4157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.903+0000 7f2cb8c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb415e5a0 0x7f2cb4160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.903+0000 7f2cb8c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb40b37a0 con 0x7f2cb415e5a0 2024-03-30T13:13:00.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.903+0000 7f2cb8c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb415e980 con 0x7f2cb40b3fa0 2024-03-30T13:13:00.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.903+0000 7f2cb8c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb4073610 con 0x7f2cb40d0190 2024-03-30T13:13:00.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.904+0000 7f2cb2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb415e5a0 0x7f2cb4160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.904+0000 7f2cb2800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb415e5a0 0x7f2cb4160bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40078/0 (socket says 172.21.15.44:40078) 2024-03-30T13:13:00.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.904+0000 7f2cb2800640 1 -- 172.21.15.44:0/1661857142 learned_addr learned my addr 172.21.15.44:0/1661857142 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:00.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.904+0000 7f2cb1e00640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb40b3fa0 0x7f2cb414bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.904+0000 7f2cb1400640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb40d0190 0x7f2cb4157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.904+0000 7f2cb2800640 1 -- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb40d0190 msgr2=0x7f2cb4157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.904+0000 7f2cb2800640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb40d0190 0x7f2cb4157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.904+0000 7f2cb2800640 1 -- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb40b3fa0 msgr2=0x7f2cb414bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:00.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.904+0000 7f2cb2800640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb40b3fa0 0x7f2cb414bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:00.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.904+0000 7f2cb2800640 1 -- 172.21.15.44:0/1661857142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb40cea20 con 0x7f2cb415e5a0 2024-03-30T13:13:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.905+0000 7f2cb2800640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb415e5a0 0x7f2cb4160bb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2cac036040 tx=0x7f2cac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.905+0000 7f2caa000640 1 -- 172.21.15.44:0/1661857142 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac043020 con 0x7f2cb415e5a0 2024-03-30T13:13:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.905+0000 7f2caa000640 1 -- 172.21.15.44:0/1661857142 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cac02ce50 con 0x7f2cb415e5a0 2024-03-30T13:13:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.905+0000 7f2caa000640 1 -- 172.21.15.44:0/1661857142 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac03e690 con 0x7f2cb415e5a0 2024-03-30T13:13:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.905+0000 7f2cb8c00640 1 -- 172.21.15.44:0/1661857142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb40ced00 con 0x7f2cb415e5a0 2024-03-30T13:13:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.905+0000 7f2cb8c00640 1 -- 172.21.15.44:0/1661857142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb40cf2c0 con 0x7f2cb415e5a0 2024-03-30T13:13:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.906+0000 7f2cb8c00640 1 -- 172.21.15.44:0/1661857142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb4075890 con 0x7f2cb415e5a0 2024-03-30T13:13:00.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.907+0000 7f2caa000640 1 -- 172.21.15.44:0/1661857142 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2cac046020 con 0x7f2cb415e5a0 2024-03-30T13:13:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.908+0000 7f2caa000640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2c9006c530 0x7f2c9006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.908+0000 7f2caa000640 1 -- 172.21.15.44:0/1661857142 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f2cac0ae070 con 0x7f2cb415e5a0 2024-03-30T13:13:00.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.909+0000 7f2cb1e00640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2c9006c530 0x7f2c9006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:00.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.910+0000 7f2cb1e00640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2c9006c530 0x7f2c9006e9f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40011e0 tx=0x7f2ca4007b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:00.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:00.913+0000 7f2caa000640 1 -- 172.21.15.44:0/1661857142 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2cac04d030 con 0x7f2cb415e5a0 2024-03-30T13:13:01.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.122+0000 7f2cb8c00640 1 -- 172.21.15.44:0/1661857142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2cb4072190 con 0x7f2cb415e5a0 2024-03-30T13:13:01.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.123+0000 7f2caa000640 1 -- 172.21.15.44:0/1661857142 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f2cac07c1d0 con 0x7f2cb415e5a0 2024-03-30T13:13:01.126 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:13:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.126+0000 7f2cb8c00640 1 -- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2c9006c530 msgr2=0x7f2c9006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.126+0000 7f2cb8c00640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2c9006c530 0x7f2c9006e9f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40011e0 tx=0x7f2ca4007b70 comp rx=0 tx=0).stop 2024-03-30T13:13:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.126+0000 7f2cb8c00640 1 -- 172.21.15.44:0/1661857142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb415e5a0 msgr2=0x7f2cb4160bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.126+0000 7f2cb8c00640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb415e5a0 0x7f2cb4160bb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2cac036040 tx=0x7f2cac004a40 comp rx=0 tx=0).stop 2024-03-30T13:13:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.126+0000 7f2cb8c00640 1 -- 172.21.15.44:0/1661857142 shutdown_connections 2024-03-30T13:13:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.126+0000 7f2cb8c00640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb415e5a0 0x7f2cb4160bb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.126+0000 7f2cb8c00640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb40d0190 0x7f2cb4157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.126+0000 7f2cb8c00640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2c9006c530 0x7f2c9006e9f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.126+0000 7f2cb8c00640 1 --2- 172.21.15.44:0/1661857142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb40b3fa0 0x7f2cb414bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.126+0000 7f2cb8c00640 1 -- 172.21.15.44:0/1661857142 >> 172.21.15.44:0/1661857142 conn(0x7f2cb40b5b00 msgr2=0x7f2cb40afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.126+0000 7f2cb8c00640 1 -- 172.21.15.44:0/1661857142 shutdown_connections 2024-03-30T13:13:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.126+0000 7f2cb8c00640 1 -- 172.21.15.44:0/1661857142 wait complete. 2024-03-30T13:13:01.148 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:13:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.360+0000 7f8b63200640 1 Processor -- start 2024-03-30T13:13:01.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.361+0000 7f8b63200640 1 -- start start 2024-03-30T13:13:01.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.362+0000 7f8b63200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8b5c0b4920 0x7f8b5c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.362+0000 7f8b63200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8b5c0b4d00 0x7f8b5c0d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.362+0000 7f8b63200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b5c0b54b0 con 0x7f8b5c0d0b90 2024-03-30T13:13:01.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.362+0000 7f8b63200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8b5c0d0260 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.362+0000 7f8b63200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f8b5c0cfca0 con 0x7f8b5c0b4920 2024-03-30T13:13:01.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.363+0000 7f8b61400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8b5c0b4d00 0x7f8b5c0d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.363+0000 7f8b62800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8b5c0d0b90 0x7f8b5c0d26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45218/0 (socket says 172.21.15.44:45218) 2024-03-30T13:13:01.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.363+0000 7f8b61400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8b5c0b4d00 0x7f8b5c0d4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40094/0 (socket says 172.21.15.44:40094) 2024-03-30T13:13:01.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.363+0000 7f8b62800640 1 -- 172.21.15.44:0/20037657 learned_addr learned my addr 172.21.15.44:0/20037657 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:01.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.363+0000 7f8b61e00640 1 --2- 172.21.15.44:0/20037657 >> v2:172.21.15.151:3300/0 conn(0x7f8b5c0b4920 0x7f8b5c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.364+0000 7f8b61400640 1 -- 172.21.15.44:0/20037657 >> v2:172.21.15.151:3300/0 conn(0x7f8b5c0b4920 msgr2=0x7f8b5c0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:01.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.364+0000 7f8b61400640 1 --2- 172.21.15.44:0/20037657 >> v2:172.21.15.151:3300/0 conn(0x7f8b5c0b4920 0x7f8b5c0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.364+0000 7f8b61400640 1 -- 172.21.15.44:0/20037657 >> v1:172.21.15.44:6789/0 conn(0x7f8b5c0d0b90 legacy=0x7f8b5c0d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.364+0000 7f8b61400640 1 -- 172.21.15.44:0/20037657 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c0cff80 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.365+0000 7f8b61400640 1 --2- 172.21.15.44:0/20037657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b5c0b4d00 0x7f8b5c0d4ac0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c09dc10 tx=0x7f8b4c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330e706725b1ea8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:01.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.365+0000 7f8b60a00640 1 -- 172.21.15.44:0/20037657 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c0315a0 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.365+0000 7f8b60a00640 1 -- 172.21.15.44:0/20037657 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b4c037070 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.365+0000 7f8b60a00640 1 -- 172.21.15.44:0/20037657 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c031960 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.366+0000 7f8b63200640 1 -- 172.21.15.44:0/20037657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b5c0b4d00 msgr2=0x7f8b5c0d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.366+0000 7f8b63200640 1 --2- 172.21.15.44:0/20037657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b5c0b4d00 0x7f8b5c0d4ac0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c09dc10 tx=0x7f8b4c02b840 comp rx=0 tx=0).stop 2024-03-30T13:13:01.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.366+0000 7f8b63200640 1 -- 172.21.15.44:0/20037657 shutdown_connections 2024-03-30T13:13:01.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.366+0000 7f8b63200640 1 --2- 172.21.15.44:0/20037657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b5c0b4d00 0x7f8b5c0d4ac0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.366+0000 7f8b63200640 1 --2- 172.21.15.44:0/20037657 >> v2:172.21.15.151:3300/0 conn(0x7f8b5c0b4920 0x7f8b5c0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.366+0000 7f8b63200640 1 -- 172.21.15.44:0/20037657 >> 172.21.15.44:0/20037657 conn(0x7f8b5c09d4e0 msgr2=0x7f8b5c0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:01.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.366+0000 7f8b63200640 1 -- 172.21.15.44:0/20037657 shutdown_connections 2024-03-30T13:13:01.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.366+0000 7f8b63200640 1 -- 172.21.15.44:0/20037657 wait complete. 2024-03-30T13:13:01.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.368+0000 7f8b63200640 1 Processor -- start 2024-03-30T13:13:01.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.368+0000 7f8b63200640 1 -- start start 2024-03-30T13:13:01.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.369+0000 7f8b63200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b5c0b4920 0x7f8b5c072620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.369+0000 7f8b63200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b5c0b4d00 0x7f8b5c160670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.369+0000 7f8b63200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b5c0d0b90 0x7f8b5c0cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.369+0000 7f8b63200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c0b3ff0 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.369+0000 7f8b63200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c0d2180 con 0x7f8b5c0d0b90 2024-03-30T13:13:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.369+0000 7f8b63200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5c0d5000 con 0x7f8b5c0b4920 2024-03-30T13:13:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.369+0000 7f8b61400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b5c0b4d00 0x7f8b5c160670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.369+0000 7f8b61400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b5c0b4d00 0x7f8b5c160670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40106/0 (socket says 172.21.15.44:40106) 2024-03-30T13:13:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.369+0000 7f8b61400640 1 -- 172.21.15.44:0/1064060873 learned_addr learned my addr 172.21.15.44:0/1064060873 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.369+0000 7f8b61e00640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b5c0b4920 0x7f8b5c072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.370+0000 7f8b62800640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b5c0d0b90 0x7f8b5c0cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.370+0000 7f8b61400640 1 -- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b5c0b4920 msgr2=0x7f8b5c072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.370+0000 7f8b61400640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b5c0b4920 0x7f8b5c072620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.370+0000 7f8b61400640 1 -- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b5c0d0b90 msgr2=0x7f8b5c0cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.370+0000 7f8b61400640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b5c0d0b90 0x7f8b5c0cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.370+0000 7f8b61400640 1 -- 172.21.15.44:0/1064060873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c06fca0 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.370+0000 7f8b61400640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b5c0b4d00 0x7f8b5c160670 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c009890 tx=0x7f8b4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:01.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.370+0000 7f8b56000640 1 -- 172.21.15.44:0/1064060873 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c032840 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.370+0000 7f8b56000640 1 -- 172.21.15.44:0/1064060873 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b4c032a00 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.370+0000 7f8b56000640 1 -- 172.21.15.44:0/1064060873 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c032df0 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.370+0000 7f8b63200640 1 -- 172.21.15.44:0/1064060873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5c06ff80 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.371+0000 7f8b63200640 1 -- 172.21.15.44:0/1064060873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5c070540 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.372+0000 7f8b63200640 1 -- 172.21.15.44:0/1064060873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5c075890 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.373+0000 7f8b56000640 1 -- 172.21.15.44:0/1064060873 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8b4c04c020 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.374+0000 7f8b56000640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8b4006c530 0x7f8b4006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.374+0000 7f8b56000640 1 -- 172.21.15.44:0/1064060873 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f8b4c02f020 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.374+0000 7f8b61e00640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8b4006c530 0x7f8b4006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.376+0000 7f8b61e00640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8b4006c530 0x7f8b4006e9f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8b50006fd0 tx=0x7f8b50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:01.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.378+0000 7f8b56000640 1 -- 172.21.15.44:0/1064060873 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8b4c040070 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.580+0000 7f8b63200640 1 -- 172.21.15.44:0/1064060873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8b5c0d34f0 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.581+0000 7f8b56000640 1 -- 172.21.15.44:0/1064060873 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f8b4c07b390 con 0x7f8b5c0b4d00 2024-03-30T13:13:01.585 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:13:01.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.584+0000 7f8b63200640 1 -- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8b4006c530 msgr2=0x7f8b4006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.584+0000 7f8b63200640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8b4006c530 0x7f8b4006e9f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8b50006fd0 tx=0x7f8b50008040 comp rx=0 tx=0).stop 2024-03-30T13:13:01.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.584+0000 7f8b63200640 1 -- 172.21.15.44:0/1064060873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b5c0b4d00 msgr2=0x7f8b5c160670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.584+0000 7f8b63200640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b5c0b4d00 0x7f8b5c160670 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c009890 tx=0x7f8b4c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.584+0000 7f8b63200640 1 -- 172.21.15.44:0/1064060873 shutdown_connections 2024-03-30T13:13:01.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.584+0000 7f8b63200640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8b4006c530 0x7f8b4006e9f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.584+0000 7f8b63200640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b5c0d0b90 0x7f8b5c0cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.584+0000 7f8b63200640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b5c0b4d00 0x7f8b5c160670 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.584+0000 7f8b63200640 1 --2- 172.21.15.44:0/1064060873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b5c0b4920 0x7f8b5c072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.584+0000 7f8b63200640 1 -- 172.21.15.44:0/1064060873 >> 172.21.15.44:0/1064060873 conn(0x7f8b5c09d4e0 msgr2=0x7f8b5c0b8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:01.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.584+0000 7f8b63200640 1 -- 172.21.15.44:0/1064060873 shutdown_connections 2024-03-30T13:13:01.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.584+0000 7f8b63200640 1 -- 172.21.15.44:0/1064060873 wait complete. 2024-03-30T13:13:01.608 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:13:01.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.828+0000 7f842be00640 1 Processor -- start 2024-03-30T13:13:01.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.828+0000 7f842be00640 1 -- start start 2024-03-30T13:13:01.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.829+0000 7f842be00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f842c0af0e0 0x7f842c072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.829+0000 7f842be00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f842c0ad2e0 con 0x7f842c06e980 2024-03-30T13:13:01.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.829+0000 7f842be00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f842c0716a0 con 0x7f842c0acd60 2024-03-30T13:13:01.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.829+0000 7f842be00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f842c0ad5c0 con 0x7f842c0af0e0 2024-03-30T13:13:01.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.830+0000 7f842aa00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f842c06e980 0x7f842c15d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45226/0 (socket says 172.21.15.44:45226) 2024-03-30T13:13:01.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.830+0000 7f842aa00640 1 -- 172.21.15.44:0/4256769850 learned_addr learned my addr 172.21.15.44:0/4256769850 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:01.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.830+0000 7f842b400640 1 --2- 172.21.15.44:0/4256769850 >> v2:172.21.15.151:3300/0 conn(0x7f842c0af0e0 0x7f842c072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.830+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 306043485 0 0) 0x7f842c0ad2e0 con 0x7f842c06e980 2024-03-30T13:13:01.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.830+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8410003520 con 0x7f842c06e980 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1474774186 0 0) 0x7f8410003520 con 0x7f842c06e980 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 >> v2:172.21.15.151:3300/0 conn(0x7f842c0af0e0 msgr2=0x7f842c072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 --2- 172.21.15.44:0/4256769850 >> v2:172.21.15.151:3300/0 conn(0x7f842c0af0e0 0x7f842c072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 >> v1:172.21.15.151:6789/0 conn(0x7f842c0acd60 legacy=0x7f842c0ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c071980 con 0x7f842c06e980 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f8414001670 con 0x7f842c06e980 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 >> v1:172.21.15.44:6789/0 conn(0x7f842c06e980 legacy=0x7f842c15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 --2- 172.21.15.44:0/4256769850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84100039b0 0x7f8410003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 --2- 172.21.15.44:0/4256769850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8410004800 0x7f8410004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 --2- 172.21.15.44:0/4256769850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84100051c0 0x7f841000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f841000c130 con 0x7f84100039b0 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f841000c2e0 con 0x7f84100051c0 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f841000c4e0 con 0x7f8410004800 2024-03-30T13:13:01.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f842aa00640 1 --2- 172.21.15.44:0/4256769850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84100039b0 0x7f8410003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f842b400640 1 --2- 172.21.15.44:0/4256769850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84100051c0 0x7f841000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f842a000640 1 --2- 172.21.15.44:0/4256769850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8410004800 0x7f8410004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f842aa00640 1 -- 172.21.15.44:0/4256769850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8410004800 msgr2=0x7f8410004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:01.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.831+0000 7f842aa00640 1 --2- 172.21.15.44:0/4256769850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8410004800 0x7f8410004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.832+0000 7f842aa00640 1 -- 172.21.15.44:0/4256769850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84100051c0 msgr2=0x7f841000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:01.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.832+0000 7f842aa00640 1 --2- 172.21.15.44:0/4256769850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84100051c0 0x7f841000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.832+0000 7f842aa00640 1 -- 172.21.15.44:0/4256769850 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8410003520 con 0x7f84100039b0 2024-03-30T13:13:01.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.832+0000 7f842b400640 1 -- 172.21.15.44:0/4256769850 reap_dead start 2024-03-30T13:13:01.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.832+0000 7f842a000640 1 --2- 172.21.15.44:0/4256769850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8410004800 0x7f8410004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:01.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.833+0000 7f842aa00640 1 --2- 172.21.15.44:0/4256769850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84100039b0 0x7f8410003dd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f841400c240 tx=0x7f8410005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f51377dbce0fd34 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:01.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.833+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414007d10 con 0x7f84100039b0 2024-03-30T13:13:01.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.833+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8414030070 con 0x7f84100039b0 2024-03-30T13:13:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.833+0000 7f8429600640 1 -- 172.21.15.44:0/4256769850 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8414005d70 con 0x7f84100039b0 2024-03-30T13:13:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.833+0000 7f842be00640 1 -- 172.21.15.44:0/4256769850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84100039b0 msgr2=0x7f8410003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.833+0000 7f842be00640 1 --2- 172.21.15.44:0/4256769850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84100039b0 0x7f8410003dd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f841400c240 tx=0x7f8410005830 comp rx=0 tx=0).stop 2024-03-30T13:13:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.834+0000 7f842be00640 1 -- 172.21.15.44:0/4256769850 shutdown_connections 2024-03-30T13:13:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.834+0000 7f842be00640 1 --2- 172.21.15.44:0/4256769850 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84100039b0 0x7f8410003dd0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.834+0000 7f842be00640 1 -- 172.21.15.44:0/4256769850 >> 172.21.15.44:0/4256769850 conn(0x7f842c0cfd90 msgr2=0x7f842c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.834+0000 7f842be00640 1 -- 172.21.15.44:0/4256769850 shutdown_connections 2024-03-30T13:13:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.834+0000 7f842be00640 1 -- 172.21.15.44:0/4256769850 wait complete. 2024-03-30T13:13:01.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.835+0000 7f842be00640 1 Processor -- start 2024-03-30T13:13:01.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.836+0000 7f842be00640 1 -- start start 2024-03-30T13:13:01.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842be00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84100039b0 0x7f842c14b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f842c09aa30 0x7f842c09aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f842c0cea60 0x7f842c0ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f842c072180 con 0x7f842c0cea60 2024-03-30T13:13:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842be00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f842c071450 con 0x7f842c09aa30 2024-03-30T13:13:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842be00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f842c072300 con 0x7f84100039b0 2024-03-30T13:13:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f842c0cea60 0x7f842c0ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f842c0cea60 0x7f842c0ceee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40128/0 (socket says 172.21.15.44:40128) 2024-03-30T13:13:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842b400640 1 -- 172.21.15.44:0/1567912194 learned_addr learned my addr 172.21.15.44:0/1567912194 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842aa00640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84100039b0 0x7f842c14b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842a000640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f842c09aa30 0x7f842c09aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842b400640 1 -- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84100039b0 msgr2=0x7f842c14b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842b400640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84100039b0 0x7f842c14b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842b400640 1 -- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f842c09aa30 msgr2=0x7f842c09aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842b400640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f842c09aa30 0x7f842c09aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:01.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842b400640 1 -- 172.21.15.44:0/1567912194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c09b4f0 con 0x7f842c0cea60 2024-03-30T13:13:01.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.837+0000 7f842a000640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f842c09aa30 0x7f842c09aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:01.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.838+0000 7f842b400640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f842c0cea60 0x7f842c0ceee0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f842c069060 tx=0x7f8424011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:01.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.838+0000 7f8422a00640 1 -- 172.21.15.44:0/1567912194 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424019020 con 0x7f842c0cea60 2024-03-30T13:13:01.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.838+0000 7f8422a00640 1 -- 172.21.15.44:0/1567912194 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8424003610 con 0x7f842c0cea60 2024-03-30T13:13:01.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.838+0000 7f8422a00640 1 -- 172.21.15.44:0/1567912194 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424003a00 con 0x7f842c0cea60 2024-03-30T13:13:01.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.838+0000 7f842be00640 1 -- 172.21.15.44:0/1567912194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842c09b7d0 con 0x7f842c0cea60 2024-03-30T13:13:01.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.838+0000 7f842be00640 1 -- 172.21.15.44:0/1567912194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842c156c40 con 0x7f842c0cea60 2024-03-30T13:13:01.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.839+0000 7f842be00640 1 -- 172.21.15.44:0/1567912194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f842c075890 con 0x7f842c0cea60 2024-03-30T13:13:01.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.840+0000 7f8422a00640 1 -- 172.21.15.44:0/1567912194 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f842401c020 con 0x7f842c0cea60 2024-03-30T13:13:01.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.841+0000 7f8422a00640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f840806c560 0x7f840806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:01.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.841+0000 7f8422a00640 1 -- 172.21.15.44:0/1567912194 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f842408bcf0 con 0x7f842c0cea60 2024-03-30T13:13:01.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.842+0000 7f842aa00640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f840806c560 0x7f840806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:01.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.843+0000 7f842aa00640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f840806c560 0x7f840806ea20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8414034000 tx=0x7f8414009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:01.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:01.846+0000 7f8422a00640 1 -- 172.21.15.44:0/1567912194 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8424023030 con 0x7f842c0cea60 2024-03-30T13:13:02.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.045+0000 7f842be00640 1 -- 172.21.15.44:0/1567912194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f842c0cc580 con 0x7f842c0cea60 2024-03-30T13:13:02.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.046+0000 7f8422a00640 1 -- 172.21.15.44:0/1567912194 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f8424059ee0 con 0x7f842c0cea60 2024-03-30T13:13:02.050 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:13:02.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.048+0000 7f842be00640 1 -- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f840806c560 msgr2=0x7f840806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:02.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.048+0000 7f842be00640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f840806c560 0x7f840806ea20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8414034000 tx=0x7f8414009030 comp rx=0 tx=0).stop 2024-03-30T13:13:02.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.048+0000 7f842be00640 1 -- 172.21.15.44:0/1567912194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f842c0cea60 msgr2=0x7f842c0ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:02.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.048+0000 7f842be00640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f842c0cea60 0x7f842c0ceee0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f842c069060 tx=0x7f8424011920 comp rx=0 tx=0).stop 2024-03-30T13:13:02.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.048+0000 7f842be00640 1 -- 172.21.15.44:0/1567912194 shutdown_connections 2024-03-30T13:13:02.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.048+0000 7f842be00640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f842c0cea60 0x7f842c0ceee0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.048+0000 7f842be00640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f840806c560 0x7f840806ea20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.048+0000 7f842be00640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f842c09aa30 0x7f842c09aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.048+0000 7f842be00640 1 --2- 172.21.15.44:0/1567912194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84100039b0 0x7f842c14b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.049+0000 7f842be00640 1 -- 172.21.15.44:0/1567912194 >> 172.21.15.44:0/1567912194 conn(0x7f842c0cfd90 msgr2=0x7f842c0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:02.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.049+0000 7f842be00640 1 -- 172.21.15.44:0/1567912194 shutdown_connections 2024-03-30T13:13:02.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.049+0000 7f842be00640 1 -- 172.21.15.44:0/1567912194 wait complete. 2024-03-30T13:13:02.071 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:13:02.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.289+0000 7f1baca00640 1 Processor -- start 2024-03-30T13:13:02.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.289+0000 7f1baca00640 1 -- start start 2024-03-30T13:13:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.291+0000 7f1baca00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ba8145820 0x7f1ba815d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.291+0000 7f1baca00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cdc00 0x7f1ba806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.291+0000 7f1baca00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ba815d5c0 con 0x7f1ba8071de0 2024-03-30T13:13:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.291+0000 7f1baca00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1ba80737d0 con 0x7f1ba8145820 2024-03-30T13:13:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.291+0000 7f1baca00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba8072280 con 0x7f1ba80cdc00 2024-03-30T13:13:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.291+0000 7f1ba6800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ba8145820 0x7f1ba815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:02.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.291+0000 7f1ba6800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ba8145820 0x7f1ba815d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40140/0 (socket says 172.21.15.44:40140) 2024-03-30T13:13:02.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.292+0000 7f1ba6800640 1 -- 172.21.15.44:0/3282278013 learned_addr learned my addr 172.21.15.44:0/3282278013 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:02.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.292+0000 7f1ba6800640 1 -- 172.21.15.44:0/3282278013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cdc00 msgr2=0x7f1ba806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:02.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.292+0000 7f1ba7200640 1 --2- 172.21.15.44:0/3282278013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cdc00 0x7f1ba806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:02.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.292+0000 7f1ba6800640 1 --2- 172.21.15.44:0/3282278013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cdc00 0x7f1ba806d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.292+0000 7f1ba6800640 1 -- 172.21.15.44:0/3282278013 >> v1:172.21.15.151:6789/0 conn(0x7f1ba8071de0 legacy=0x7f1ba80cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:02.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.292+0000 7f1ba6800640 1 -- 172.21.15.44:0/3282278013 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba8072560 con 0x7f1ba8145820 2024-03-30T13:13:02.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.293+0000 7f1ba6800640 1 --2- 172.21.15.44:0/3282278013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba8145820 0x7f1ba815d080 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009870 tx=0x7f1b9802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd90e995736dd55a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:02.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.293+0000 7f1ba5e00640 1 -- 172.21.15.44:0/3282278013 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b98035020 con 0x7f1ba8145820 2024-03-30T13:13:02.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.294+0000 7f1ba5e00640 1 -- 172.21.15.44:0/3282278013 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b98031640 con 0x7f1ba8145820 2024-03-30T13:13:02.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.294+0000 7f1ba5e00640 1 -- 172.21.15.44:0/3282278013 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9802d040 con 0x7f1ba8145820 2024-03-30T13:13:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.294+0000 7f1baca00640 1 -- 172.21.15.44:0/3282278013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba8145820 msgr2=0x7f1ba815d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.294+0000 7f1baca00640 1 --2- 172.21.15.44:0/3282278013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba8145820 0x7f1ba815d080 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009870 tx=0x7f1b9802b8f0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.294+0000 7f1baca00640 1 -- 172.21.15.44:0/3282278013 shutdown_connections 2024-03-30T13:13:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.294+0000 7f1baca00640 1 --2- 172.21.15.44:0/3282278013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cdc00 0x7f1ba806d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.294+0000 7f1baca00640 1 --2- 172.21.15.44:0/3282278013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba8145820 0x7f1ba815d080 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.294+0000 7f1baca00640 1 -- 172.21.15.44:0/3282278013 >> 172.21.15.44:0/3282278013 conn(0x7f1ba806b970 msgr2=0x7f1ba806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.294+0000 7f1baca00640 1 -- 172.21.15.44:0/3282278013 shutdown_connections 2024-03-30T13:13:02.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.294+0000 7f1baca00640 1 -- 172.21.15.44:0/3282278013 wait complete. 2024-03-30T13:13:02.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.296+0000 7f1baca00640 1 Processor -- start 2024-03-30T13:13:02.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.296+0000 7f1baca00640 1 -- start start 2024-03-30T13:13:02.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.297+0000 7f1baca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba8071de0 0x7f1ba815e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:02.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.297+0000 7f1baca00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ba80cdc00 0x7f1ba80cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:02.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.297+0000 7f1baca00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba8145820 0x7f1ba80cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:02.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.297+0000 7f1baca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba8072e00 con 0x7f1ba8071de0 2024-03-30T13:13:02.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.297+0000 7f1baca00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba8072b20 con 0x7f1ba80cdc00 2024-03-30T13:13:02.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.297+0000 7f1baca00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba8145c00 con 0x7f1ba8145820 2024-03-30T13:13:02.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.297+0000 7f1ba6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba8071de0 0x7f1ba815e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:02.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.298+0000 7f1ba6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba8071de0 0x7f1ba815e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40146/0 (socket says 172.21.15.44:40146) 2024-03-30T13:13:02.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.298+0000 7f1ba6800640 1 -- 172.21.15.44:0/2748183129 learned_addr learned my addr 172.21.15.44:0/2748183129 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:02.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.298+0000 7f1ba6800640 1 -- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba8145820 msgr2=0x7f1ba80cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:02.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.298+0000 7f1ba7200640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba8145820 0x7f1ba80cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:02.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.298+0000 7f1b9fe00640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ba80cdc00 0x7f1ba80cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:02.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.298+0000 7f1ba6800640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba8145820 0x7f1ba80cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.298+0000 7f1ba6800640 1 -- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ba80cdc00 msgr2=0x7f1ba80cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.298+0000 7f1ba6800640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ba80cdc00 0x7f1ba80cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.298+0000 7f1ba6800640 1 -- 172.21.15.44:0/2748183129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba80b0500 con 0x7f1ba8071de0 2024-03-30T13:13:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.298+0000 7f1ba7200640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba8145820 0x7f1ba80cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.298+0000 7f1b9fe00640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ba80cdc00 0x7f1ba80cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.298+0000 7f1ba6800640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba8071de0 0x7f1ba815e7a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1b9802b930 tx=0x7f1b980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.299+0000 7f1b9ea00640 1 -- 172.21.15.44:0/2748183129 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9803ac60 con 0x7f1ba8071de0 2024-03-30T13:13:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.299+0000 7f1b9ea00640 1 -- 172.21.15.44:0/2748183129 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b9803ae20 con 0x7f1ba8071de0 2024-03-30T13:13:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.299+0000 7f1b9ea00640 1 -- 172.21.15.44:0/2748183129 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b98044630 con 0x7f1ba8071de0 2024-03-30T13:13:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.299+0000 7f1baca00640 1 -- 172.21.15.44:0/2748183129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba80b0840 con 0x7f1ba8071de0 2024-03-30T13:13:02.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.299+0000 7f1baca00640 1 -- 172.21.15.44:0/2748183129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba80b1080 con 0x7f1ba8071de0 2024-03-30T13:13:02.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.300+0000 7f1baca00640 1 -- 172.21.15.44:0/2748183129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba8075890 con 0x7f1ba8071de0 2024-03-30T13:13:02.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.301+0000 7f1b9ea00640 1 -- 172.21.15.44:0/2748183129 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1b9804b060 con 0x7f1ba8071de0 2024-03-30T13:13:02.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.302+0000 7f1b9ea00640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b8406c530 0x7f1b8406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:02.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.302+0000 7f1b9ea00640 1 -- 172.21.15.44:0/2748183129 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f1b980ad940 con 0x7f1ba8071de0 2024-03-30T13:13:02.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.303+0000 7f1b9fe00640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b8406c530 0x7f1b8406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:02.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.303+0000 7f1b9fe00640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b8406c530 0x7f1b8406e9f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8159fb0 tx=0x7f1b90009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:02.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.306+0000 7f1b9ea00640 1 -- 172.21.15.44:0/2748183129 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1ba80b0840 con 0x7f1ba8071de0 2024-03-30T13:13:02.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.529+0000 7f1baca00640 1 -- 172.21.15.44:0/2748183129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1ba80b0a20 con 0x7f1ba8071de0 2024-03-30T13:13:02.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.529+0000 7f1b9ea00640 1 -- 172.21.15.44:0/2748183129 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f1b9803f070 con 0x7f1ba8071de0 2024-03-30T13:13:02.533 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-03-30T13:13:02.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.532+0000 7f1baca00640 1 -- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b8406c530 msgr2=0x7f1b8406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:02.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.532+0000 7f1baca00640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b8406c530 0x7f1b8406e9f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8159fb0 tx=0x7f1b90009040 comp rx=0 tx=0).stop 2024-03-30T13:13:02.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.532+0000 7f1baca00640 1 -- 172.21.15.44:0/2748183129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba8071de0 msgr2=0x7f1ba815e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:02.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.532+0000 7f1baca00640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba8071de0 0x7f1ba815e7a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1b9802b930 tx=0x7f1b980046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.532+0000 7f1baca00640 1 -- 172.21.15.44:0/2748183129 shutdown_connections 2024-03-30T13:13:02.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.532+0000 7f1baca00640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba8145820 0x7f1ba80cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.532+0000 7f1baca00640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b8406c530 0x7f1b8406e9f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.532+0000 7f1baca00640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ba80cdc00 0x7f1ba80cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.532+0000 7f1baca00640 1 --2- 172.21.15.44:0/2748183129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ba8071de0 0x7f1ba815e7a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:02.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.532+0000 7f1baca00640 1 -- 172.21.15.44:0/2748183129 >> 172.21.15.44:0/2748183129 conn(0x7f1ba806b970 msgr2=0x7f1ba815b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:02.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.532+0000 7f1baca00640 1 -- 172.21.15.44:0/2748183129 shutdown_connections 2024-03-30T13:13:02.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:02.532+0000 7f1baca00640 1 -- 172.21.15.44:0/2748183129 wait complete. 2024-03-30T13:13:02.558 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-30T13:13:02.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:02.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-30T13:13:02.663 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:13:02.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:02.664 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-30T13:13:02.719 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:13:02.719 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:13:02.768 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:13:02.768 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:13:02.863 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:13:02.863 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:13:02.906 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:13:03.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.134+0000 7f1df7c00640 1 Processor -- start 2024-03-30T13:13:03.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.134+0000 7f1df7c00640 1 -- start start 2024-03-30T13:13:03.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.136+0000 7f1df7c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1df0071c30 0x7f1df0160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.136+0000 7f1df7c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1df0160660 0x7f1df00ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.136+0000 7f1df7c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1df0146040 con 0x7f1df0145c60 2024-03-30T13:13:03.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.136+0000 7f1df7c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1df0160e50 con 0x7f1df0071c30 2024-03-30T13:13:03.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.136+0000 7f1df7c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f1df015d8b0 con 0x7f1df0160660 2024-03-30T13:13:03.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.136+0000 7f1de7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1df0071c30 0x7f1df0160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.137+0000 7f1de7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1df0071c30 0x7f1df0160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40158/0 (socket says 172.21.15.44:40158) 2024-03-30T13:13:03.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.137+0000 7f1de7e00640 1 -- 172.21.15.44:0/1183615411 learned_addr learned my addr 172.21.15.44:0/1183615411 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:03.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.137+0000 7f1df5c00640 1 --2- 172.21.15.44:0/1183615411 >> v2:172.21.15.151:3300/0 conn(0x7f1df0160660 0x7f1df00ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.137+0000 7f1de7e00640 1 -- 172.21.15.44:0/1183615411 >> v2:172.21.15.151:3300/0 conn(0x7f1df0160660 msgr2=0x7f1df00ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:03.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.137+0000 7f1de7e00640 1 --2- 172.21.15.44:0/1183615411 >> v2:172.21.15.151:3300/0 conn(0x7f1df0160660 0x7f1df00ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.137+0000 7f1de7e00640 1 -- 172.21.15.44:0/1183615411 >> v1:172.21.15.151:6789/0 conn(0x7f1df0145c60 legacy=0x7f1df0071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:03.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.137+0000 7f1de7e00640 1 -- 172.21.15.44:0/1183615411 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df015caf0 con 0x7f1df0071c30 2024-03-30T13:13:03.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.139+0000 7f1de7e00640 1 --2- 172.21.15.44:0/1183615411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0071c30 0x7f1df0160120 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1df00cc4d0 tx=0x7f1dd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176ab23dde0d9998 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.139+0000 7f1defe00640 1 -- 172.21.15.44:0/1183615411 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8035020 con 0x7f1df0071c30 2024-03-30T13:13:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.139+0000 7f1defe00640 1 -- 172.21.15.44:0/1183615411 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd8031870 con 0x7f1df0071c30 2024-03-30T13:13:03.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.139+0000 7f1defe00640 1 -- 172.21.15.44:0/1183615411 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8031c40 con 0x7f1df0071c30 2024-03-30T13:13:03.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.140+0000 7f1df7c00640 1 -- 172.21.15.44:0/1183615411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0071c30 msgr2=0x7f1df0160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:03.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.140+0000 7f1df7c00640 1 --2- 172.21.15.44:0/1183615411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0071c30 0x7f1df0160120 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1df00cc4d0 tx=0x7f1dd802b910 comp rx=0 tx=0).stop 2024-03-30T13:13:03.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.140+0000 7f1df7c00640 1 -- 172.21.15.44:0/1183615411 shutdown_connections 2024-03-30T13:13:03.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.140+0000 7f1df7c00640 1 --2- 172.21.15.44:0/1183615411 >> v2:172.21.15.151:3300/0 conn(0x7f1df0160660 0x7f1df00ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.140+0000 7f1df7c00640 1 --2- 172.21.15.44:0/1183615411 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0071c30 0x7f1df0160120 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.140+0000 7f1df7c00640 1 -- 172.21.15.44:0/1183615411 >> 172.21.15.44:0/1183615411 conn(0x7f1df00b1c90 msgr2=0x7f1df00b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:03.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.140+0000 7f1df7c00640 1 -- 172.21.15.44:0/1183615411 shutdown_connections 2024-03-30T13:13:03.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.140+0000 7f1df7c00640 1 -- 172.21.15.44:0/1183615411 wait complete. 2024-03-30T13:13:03.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.142+0000 7f1df7c00640 1 Processor -- start 2024-03-30T13:13:03.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.142+0000 7f1df7c00640 1 -- start start 2024-03-30T13:13:03.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.143+0000 7f1df7c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1df0071c30 0x7f1df01333f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.143+0000 7f1df7c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df0145c60 0x7f1df00b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.143+0000 7f1df7c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0160660 0x7f1df01319b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.143+0000 7f1df7c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1df0160a90 con 0x7f1df0160660 2024-03-30T13:13:03.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.143+0000 7f1df7c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1df015d0b0 con 0x7f1df0071c30 2024-03-30T13:13:03.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.143+0000 7f1df7c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1df0160c10 con 0x7f1df0145c60 2024-03-30T13:13:03.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.143+0000 7f1df5c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0160660 0x7f1df01319b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.144+0000 7f1df5c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0160660 0x7f1df01319b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40174/0 (socket says 172.21.15.44:40174) 2024-03-30T13:13:03.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.144+0000 7f1df5c00640 1 -- 172.21.15.44:0/3113915162 learned_addr learned my addr 172.21.15.44:0/3113915162 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:03.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.144+0000 7f1df5200640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1df0071c30 0x7f1df01333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.144+0000 7f1de7e00640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df0145c60 0x7f1df00b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.144+0000 7f1df5c00640 1 -- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df0145c60 msgr2=0x7f1df00b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:03.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.144+0000 7f1df5c00640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df0145c60 0x7f1df00b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.144+0000 7f1df5c00640 1 -- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1df0071c30 msgr2=0x7f1df01333f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:03.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.144+0000 7f1df5c00640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1df0071c30 0x7f1df01333f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.144+0000 7f1df5c00640 1 -- 172.21.15.44:0/3113915162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1df0132350 con 0x7f1df0160660 2024-03-30T13:13:03.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.144+0000 7f1df5c00640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0160660 0x7f1df01319b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1de8007e60 tx=0x7f1de800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.145+0000 7f1ded600640 1 -- 172.21.15.44:0/3113915162 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de8014420 con 0x7f1df0160660 2024-03-30T13:13:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.145+0000 7f1ded600640 1 -- 172.21.15.44:0/3113915162 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1de8019070 con 0x7f1df0160660 2024-03-30T13:13:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.145+0000 7f1df7c00640 1 -- 172.21.15.44:0/3113915162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1df0132630 con 0x7f1df0160660 2024-03-30T13:13:03.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.145+0000 7f1ded600640 1 -- 172.21.15.44:0/3113915162 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1de8014820 con 0x7f1df0160660 2024-03-30T13:13:03.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.145+0000 7f1df7c00640 1 -- 172.21.15.44:0/3113915162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1df0132bf0 con 0x7f1df0160660 2024-03-30T13:13:03.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.146+0000 7f1df7c00640 1 -- 172.21.15.44:0/3113915162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1df0075a10 con 0x7f1df0160660 2024-03-30T13:13:03.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.147+0000 7f1ded600640 1 -- 172.21.15.44:0/3113915162 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1de80149c0 con 0x7f1df0160660 2024-03-30T13:13:03.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.148+0000 7f1ded600640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1dcc06c530 0x7f1dcc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.148+0000 7f1ded600640 1 -- 172.21.15.44:0/3113915162 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f1de808c3f0 con 0x7f1df0160660 2024-03-30T13:13:03.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.148+0000 7f1df5200640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1dcc06c530 0x7f1dcc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.149+0000 7f1df5200640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1dcc06c530 0x7f1dcc06e9f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1de0001640 tx=0x7f1de0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:03.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.152+0000 7f1ded600640 1 -- 172.21.15.44:0/3113915162 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1de805a550 con 0x7f1df0160660 2024-03-30T13:13:03.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.359+0000 7f1df7c00640 1 -- 172.21.15.44:0/3113915162 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1df00d0db0 con 0x7f1df0160660 2024-03-30T13:13:03.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.361+0000 7f1ded600640 1 -- 172.21.15.44:0/3113915162 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18927 (secure 0 0 0) 0x7f1de8059e50 con 0x7f1df0160660 2024-03-30T13:13:03.365 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:03.366 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":29,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:12:27.323786+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:13:03.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.364+0000 7f1df7c00640 1 -- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1dcc06c530 msgr2=0x7f1dcc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:03.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.364+0000 7f1df7c00640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1dcc06c530 0x7f1dcc06e9f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1de0001640 tx=0x7f1de0009040 comp rx=0 tx=0).stop 2024-03-30T13:13:03.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.364+0000 7f1df7c00640 1 -- 172.21.15.44:0/3113915162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0160660 msgr2=0x7f1df01319b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:03.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.364+0000 7f1df7c00640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0160660 0x7f1df01319b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1de8007e60 tx=0x7f1de800e4b0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.364+0000 7f1df7c00640 1 -- 172.21.15.44:0/3113915162 shutdown_connections 2024-03-30T13:13:03.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.364+0000 7f1df7c00640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1df0160660 0x7f1df01319b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.364+0000 7f1df7c00640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1df0145c60 0x7f1df00b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.364+0000 7f1df7c00640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1dcc06c530 0x7f1dcc06e9f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.364+0000 7f1df7c00640 1 --2- 172.21.15.44:0/3113915162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1df0071c30 0x7f1df01333f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.365+0000 7f1df7c00640 1 -- 172.21.15.44:0/3113915162 >> 172.21.15.44:0/3113915162 conn(0x7f1df00b1c90 msgr2=0x7f1df00cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:03.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.365+0000 7f1df7c00640 1 -- 172.21.15.44:0/3113915162 shutdown_connections 2024-03-30T13:13:03.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.365+0000 7f1df7c00640 1 -- 172.21.15.44:0/3113915162 wait complete. 2024-03-30T13:13:03.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:13:03.389 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:13:03.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.610+0000 7fe8cea00640 1 Processor -- start 2024-03-30T13:13:03.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.610+0000 7fe8cea00640 1 -- start start 2024-03-30T13:13:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.611+0000 7fe8cea00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80d18f0 0x7fe8c80d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.611+0000 7fe8cea00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe8c80d46b0 0x7fe8c80b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.611+0000 7fe8cea00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c80d32b0 con 0x7fe8c815c040 2024-03-30T13:13:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.611+0000 7fe8cea00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c815fa70 con 0x7fe8c80d46b0 2024-03-30T13:13:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.611+0000 7fe8cea00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c80d2210 con 0x7fe8c80d18f0 2024-03-30T13:13:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.611+0000 7fe8cd600640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe8c815c040 0x7fe8c815f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45242/0 (socket says 172.21.15.44:45242) 2024-03-30T13:13:03.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.611+0000 7fe8cd600640 1 -- 172.21.15.44:0/1243566405 learned_addr learned my addr 172.21.15.44:0/1243566405 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8ce000640 1 --2- 172.21.15.44:0/1243566405 >> v2:172.21.15.151:3300/0 conn(0x7fe8c80d46b0 0x7fe8c80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2673124077 0 0) 0x7fe8c80d32b0 con 0x7fe8c815c040 2024-03-30T13:13:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8b0003520 con 0x7fe8c815c040 2024-03-30T13:13:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8ccc00640 1 --2- 172.21.15.44:0/1243566405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80d18f0 0x7fe8c80d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1608416565 0 0) 0x7fe8b0003520 con 0x7fe8c815c040 2024-03-30T13:13:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80d18f0 msgr2=0x7fe8c80d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:03.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 --2- 172.21.15.44:0/1243566405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80d18f0 0x7fe8c80d4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 >> v2:172.21.15.151:3300/0 conn(0x7fe8c80d46b0 msgr2=0x7fe8c80b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 --2- 172.21.15.44:0/1243566405 >> v2:172.21.15.151:3300/0 conn(0x7fe8c80d46b0 0x7fe8c80b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c80d24f0 con 0x7fe8c815c040 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fe8bc001670 con 0x7fe8c815c040 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 >> v1:172.21.15.44:6789/0 conn(0x7fe8c815c040 legacy=0x7fe8c815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 --2- 172.21.15.44:0/1243566405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8b00039b0 0x7fe8b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 --2- 172.21.15.44:0/1243566405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80d18f0 0x7fe8b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 --2- 172.21.15.44:0/1243566405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b0004d40 0x7fe8b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c815fa70 con 0x7fe8b0004d40 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c80d2210 con 0x7fe8b00039b0 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.612+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe8b000baa0 con 0x7fe8c80d18f0 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.613+0000 7fe8ce000640 1 --2- 172.21.15.44:0/1243566405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b0004d40 0x7fe8b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.613+0000 7fe8cd600640 1 --2- 172.21.15.44:0/1243566405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8b00039b0 0x7fe8b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.613+0000 7fe8ccc00640 1 --2- 172.21.15.44:0/1243566405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80d18f0 0x7fe8b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.613+0000 7fe8ce000640 1 -- 172.21.15.44:0/1243566405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80d18f0 msgr2=0x7fe8b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:03.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.613+0000 7fe8ce000640 1 --2- 172.21.15.44:0/1243566405 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80d18f0 0x7fe8b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.613+0000 7fe8ce000640 1 -- 172.21.15.44:0/1243566405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8b00039b0 msgr2=0x7fe8b0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:03.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.613+0000 7fe8ce000640 1 --2- 172.21.15.44:0/1243566405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8b00039b0 0x7fe8b0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.613+0000 7fe8ce000640 1 -- 172.21.15.44:0/1243566405 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b0003520 con 0x7fe8b0004d40 2024-03-30T13:13:03.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.614+0000 7fe8ce000640 1 --2- 172.21.15.44:0/1243566405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b0004d40 0x7fe8b00051c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009fc0 tx=0x7fe8b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40d0bc358cd88f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:03.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.615+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0039070 con 0x7fe8b0004d40 2024-03-30T13:13:03.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.615+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c002cc60 con 0x7fe8b0004d40 2024-03-30T13:13:03.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.615+0000 7fe8c7e00640 1 -- 172.21.15.44:0/1243566405 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0009c10 con 0x7fe8b0004d40 2024-03-30T13:13:03.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.615+0000 7fe8cea00640 1 -- 172.21.15.44:0/1243566405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b0004d40 msgr2=0x7fe8b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:03.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.615+0000 7fe8cea00640 1 --2- 172.21.15.44:0/1243566405 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8b0004d40 0x7fe8b00051c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009fc0 tx=0x7fe8b0005830 comp rx=0 tx=0).stop 2024-03-30T13:13:03.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.615+0000 7fe8ce000640 1 -- 172.21.15.44:0/1243566405 reap_dead start 2024-03-30T13:13:03.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.615+0000 7fe8cea00640 1 -- 172.21.15.44:0/1243566405 shutdown_connections 2024-03-30T13:13:03.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.615+0000 7fe8cea00640 1 -- 172.21.15.44:0/1243566405 >> 172.21.15.44:0/1243566405 conn(0x7fe8c808dbf0 msgr2=0x7fe8c809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:03.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.615+0000 7fe8cea00640 1 -- 172.21.15.44:0/1243566405 shutdown_connections 2024-03-30T13:13:03.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.615+0000 7fe8cea00640 1 -- 172.21.15.44:0/1243566405 wait complete. 2024-03-30T13:13:03.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.617+0000 7fe8cea00640 1 Processor -- start 2024-03-30T13:13:03.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.617+0000 7fe8cea00640 1 -- start start 2024-03-30T13:13:03.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.618+0000 7fe8cea00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8b0004d40 0x7fe8c80cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.618+0000 7fe8cea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8c81607e0 0x7fe8c8156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.618+0000 7fe8cea00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c8160c60 0x7fe8c8156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8cea00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c80d2d90 con 0x7fe8c81607e0 2024-03-30T13:13:03.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8cea00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c80d2ab0 con 0x7fe8b0004d40 2024-03-30T13:13:03.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8cea00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c815c420 con 0x7fe8c8160c60 2024-03-30T13:13:03.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8ccc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8c81607e0 0x7fe8c8156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8ccc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8c81607e0 0x7fe8c8156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40194/0 (socket says 172.21.15.44:40194) 2024-03-30T13:13:03.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8ccc00640 1 -- 172.21.15.44:0/1309392809 learned_addr learned my addr 172.21.15.44:0/1309392809 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:03.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8cd600640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8b0004d40 0x7fe8c80cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8ce000640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c8160c60 0x7fe8c8156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8ccc00640 1 -- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c8160c60 msgr2=0x7fe8c8156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:03.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8ccc00640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c8160c60 0x7fe8c8156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8ccc00640 1 -- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8b0004d40 msgr2=0x7fe8c80cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:03.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8ccc00640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8b0004d40 0x7fe8c80cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8ccc00640 1 -- 172.21.15.44:0/1309392809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c80cc400 con 0x7fe8c81607e0 2024-03-30T13:13:03.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.619+0000 7fe8cd600640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8b0004d40 0x7fe8c80cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:03.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.620+0000 7fe8ccc00640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8c81607e0 0x7fe8c8156530 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800f550 tx=0x7fe8b800fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:03.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.620+0000 7fe8c5600640 1 -- 172.21.15.44:0/1309392809 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8019020 con 0x7fe8c81607e0 2024-03-30T13:13:03.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.620+0000 7fe8c5600640 1 -- 172.21.15.44:0/1309392809 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b8014870 con 0x7fe8c81607e0 2024-03-30T13:13:03.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.620+0000 7fe8cea00640 1 -- 172.21.15.44:0/1309392809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c80b4b80 con 0x7fe8c81607e0 2024-03-30T13:13:03.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.620+0000 7fe8c5600640 1 -- 172.21.15.44:0/1309392809 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8014c60 con 0x7fe8c81607e0 2024-03-30T13:13:03.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.620+0000 7fe8cea00640 1 -- 172.21.15.44:0/1309392809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c80cb6c0 con 0x7fe8c81607e0 2024-03-30T13:13:03.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.621+0000 7fe8cea00640 1 -- 172.21.15.44:0/1309392809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c80cbb00 con 0x7fe8c81607e0 2024-03-30T13:13:03.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.622+0000 7fe8c5600640 1 -- 172.21.15.44:0/1309392809 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe8b801c020 con 0x7fe8c81607e0 2024-03-30T13:13:03.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.623+0000 7fe8c5600640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe8ac06c560 0x7fe8ac06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:03.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.623+0000 7fe8c5600640 1 -- 172.21.15.44:0/1309392809 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fe8b808c200 con 0x7fe8c81607e0 2024-03-30T13:13:03.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.624+0000 7fe8cd600640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe8ac06c560 0x7fe8ac06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:03.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.625+0000 7fe8cd600640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe8ac06c560 0x7fe8ac06ea20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc001eb0 tx=0x7fe8bc0014c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:03.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.627+0000 7fe8c5600640 1 -- 172.21.15.44:0/1309392809 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe8b8023020 con 0x7fe8c81607e0 2024-03-30T13:13:03.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.833+0000 7fe8cea00640 1 -- 172.21.15.44:0/1309392809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe8c8075890 con 0x7fe8c81607e0 2024-03-30T13:13:03.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.834+0000 7fe8c5600640 1 -- 172.21.15.44:0/1309392809 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fe8b8026350 con 0x7fe8c81607e0 2024-03-30T13:13:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:13:03.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.837+0000 7fe8cea00640 1 -- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe8ac06c560 msgr2=0x7fe8ac06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.837+0000 7fe8cea00640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe8ac06c560 0x7fe8ac06ea20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc001eb0 tx=0x7fe8bc0014c0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.837+0000 7fe8cea00640 1 -- 172.21.15.44:0/1309392809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8c81607e0 msgr2=0x7fe8c8156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.837+0000 7fe8cea00640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8c81607e0 0x7fe8c8156530 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800f550 tx=0x7fe8b800fa10 comp rx=0 tx=0).stop 2024-03-30T13:13:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.837+0000 7fe8cea00640 1 -- 172.21.15.44:0/1309392809 shutdown_connections 2024-03-30T13:13:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.837+0000 7fe8cea00640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c8160c60 0x7fe8c8156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.837+0000 7fe8cea00640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8c81607e0 0x7fe8c8156530 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.837+0000 7fe8cea00640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe8ac06c560 0x7fe8ac06ea20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.837+0000 7fe8cea00640 1 --2- 172.21.15.44:0/1309392809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8b0004d40 0x7fe8c80cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.837+0000 7fe8cea00640 1 -- 172.21.15.44:0/1309392809 >> 172.21.15.44:0/1309392809 conn(0x7fe8c808dbf0 msgr2=0x7fe8c815c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.837+0000 7fe8cea00640 1 -- 172.21.15.44:0/1309392809 shutdown_connections 2024-03-30T13:13:03.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:03.837+0000 7fe8cea00640 1 -- 172.21.15.44:0/1309392809 wait complete. 2024-03-30T13:13:03.860 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:13:04.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.074+0000 7f2367200640 1 Processor -- start 2024-03-30T13:13:04.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.075+0000 7f2367200640 1 -- start start 2024-03-30T13:13:04.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.076+0000 7f2367200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23680b4920 0x7f23680b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.076+0000 7f2367200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23680b54b0 con 0x7f23680b4d00 2024-03-30T13:13:04.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.076+0000 7f2367200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23680cfca0 con 0x7f23680d0b90 2024-03-30T13:13:04.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.076+0000 7f2367200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f23680d0260 con 0x7f23680b4920 2024-03-30T13:13:04.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.077+0000 7f2365400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f23680b4d00 0x7f23680d4ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45248/0 (socket says 172.21.15.44:45248) 2024-03-30T13:13:04.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.077+0000 7f2365400640 1 -- 172.21.15.44:0/449302930 learned_addr learned my addr 172.21.15.44:0/449302930 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:04.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.077+0000 7f2365e00640 1 --2- 172.21.15.44:0/449302930 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23680b4920 0x7f23680b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.077+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3712639207 0 0) 0x7f2354001110 con 0x7f23680b4d00 2024-03-30T13:13:04.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.077+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f234c003520 con 0x7f23680b4d00 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4133538121 0 0) 0x7f234c003520 con 0x7f23680b4d00 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23680b4920 msgr2=0x7f23680b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 --2- 172.21.15.44:0/449302930 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23680b4920 0x7f23680b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 >> v1:172.21.15.151:6789/0 conn(0x7f23680d0b90 legacy=0x7f23680d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23680cff80 con 0x7f23680b4d00 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f2354001840 con 0x7f23680b4d00 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 >> v1:172.21.15.44:6789/0 conn(0x7f23680b4d00 legacy=0x7f23680d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 --2- 172.21.15.44:0/449302930 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23680b4920 0x7f234c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 --2- 172.21.15.44:0/449302930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f234c003f80 0x7f234c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 --2- 172.21.15.44:0/449302930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234c004d40 0x7f234c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23680d0260 con 0x7f234c003f80 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f234c00bb80 con 0x7f234c004d40 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f234c00bd80 con 0x7f23680b4920 2024-03-30T13:13:04.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2365400640 1 --2- 172.21.15.44:0/449302930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f234c003f80 0x7f234c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2365e00640 1 --2- 172.21.15.44:0/449302930 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23680b4920 0x7f234c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.078+0000 7f2366800640 1 --2- 172.21.15.44:0/449302930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234c004d40 0x7f234c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.079+0000 7f2365400640 1 -- 172.21.15.44:0/449302930 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23680b4920 msgr2=0x7f234c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:04.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.079+0000 7f2365400640 1 --2- 172.21.15.44:0/449302930 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23680b4920 0x7f234c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.079+0000 7f2365400640 1 -- 172.21.15.44:0/449302930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234c004d40 msgr2=0x7f234c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:04.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.079+0000 7f2365400640 1 --2- 172.21.15.44:0/449302930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234c004d40 0x7f234c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.079+0000 7f2365400640 1 -- 172.21.15.44:0/449302930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f234c003520 con 0x7f234c003f80 2024-03-30T13:13:04.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.080+0000 7f2365400640 1 --2- 172.21.15.44:0/449302930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f234c003f80 0x7f234c004800 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f235400c4c0 tx=0x7f234c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a93bce1c87747b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:04.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.080+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235400c0e0 con 0x7f234c003f80 2024-03-30T13:13:04.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.080+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2354030070 con 0x7f234c003f80 2024-03-30T13:13:04.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.080+0000 7f2364a00640 1 -- 172.21.15.44:0/449302930 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23540058d0 con 0x7f234c003f80 2024-03-30T13:13:04.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.081+0000 7f2367200640 1 -- 172.21.15.44:0/449302930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f234c003f80 msgr2=0x7f234c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.081+0000 7f2367200640 1 --2- 172.21.15.44:0/449302930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f234c003f80 0x7f234c004800 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f235400c4c0 tx=0x7f234c005830 comp rx=0 tx=0).stop 2024-03-30T13:13:04.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.081+0000 7f2366800640 1 -- 172.21.15.44:0/449302930 reap_dead start 2024-03-30T13:13:04.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.081+0000 7f2367200640 1 -- 172.21.15.44:0/449302930 shutdown_connections 2024-03-30T13:13:04.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.081+0000 7f2367200640 1 -- 172.21.15.44:0/449302930 >> 172.21.15.44:0/449302930 conn(0x7f236809d4e0 msgr2=0x7f23680d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:04.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.081+0000 7f2367200640 1 -- 172.21.15.44:0/449302930 shutdown_connections 2024-03-30T13:13:04.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.081+0000 7f2367200640 1 -- 172.21.15.44:0/449302930 wait complete. 2024-03-30T13:13:04.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.083+0000 7f2367200640 1 Processor -- start 2024-03-30T13:13:04.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.083+0000 7f2367200640 1 -- start start 2024-03-30T13:13:04.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2367200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234c003f80 0x7f23681f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2367200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236806d600 0x7f23680c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2367200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f236806da40 0x7f23680c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2367200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f23680cf8c0 con 0x7f236806d600 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2367200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f23680d2180 con 0x7f234c003f80 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2367200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f23680cfa40 con 0x7f236806da40 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2365400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236806d600 0x7f23680c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2365400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236806d600 0x7f23680c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40210/0 (socket says 172.21.15.44:40210) 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2365400640 1 -- 172.21.15.44:0/3451753449 learned_addr learned my addr 172.21.15.44:0/3451753449 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2365e00640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234c003f80 0x7f23681f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2366800640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f236806da40 0x7f23680c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2365400640 1 -- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f236806da40 msgr2=0x7f23680c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2365400640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f236806da40 0x7f23680c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2365400640 1 -- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234c003f80 msgr2=0x7f23681f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2365400640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234c003f80 0x7f23681f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.084+0000 7f2365400640 1 -- 172.21.15.44:0/3451753449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23680c9560 con 0x7f236806d600 2024-03-30T13:13:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.085+0000 7f2365400640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236806d600 0x7f23680c8ae0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2354001b40 tx=0x7f23680b5a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:04.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.085+0000 7f235e000640 1 -- 172.21.15.44:0/3451753449 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354045070 con 0x7f236806d600 2024-03-30T13:13:04.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.085+0000 7f235e000640 1 -- 172.21.15.44:0/3451753449 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2354001110 con 0x7f236806d600 2024-03-30T13:13:04.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.085+0000 7f235e000640 1 -- 172.21.15.44:0/3451753449 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354007270 con 0x7f236806d600 2024-03-30T13:13:04.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.085+0000 7f2367200640 1 -- 172.21.15.44:0/3451753449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23680c9ad0 con 0x7f236806d600 2024-03-30T13:13:04.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.085+0000 7f2367200640 1 -- 172.21.15.44:0/3451753449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2368158990 con 0x7f236806d600 2024-03-30T13:13:04.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.086+0000 7f2367200640 1 -- 172.21.15.44:0/3451753449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23681f5870 con 0x7f236806d600 2024-03-30T13:13:04.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.088+0000 7f235e000640 1 -- 172.21.15.44:0/3451753449 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2354007410 con 0x7f236806d600 2024-03-30T13:13:04.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.088+0000 7f235e000640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f234806c560 0x7f234806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.088+0000 7f235e000640 1 -- 172.21.15.44:0/3451753449 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f23540ad120 con 0x7f236806d600 2024-03-30T13:13:04.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.089+0000 7f2365e00640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f234806c560 0x7f234806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.090+0000 7f2365e00640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f234806c560 0x7f234806ea20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2358009a10 tx=0x7f2358008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:04.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.093+0000 7f235e000640 1 -- 172.21.15.44:0/3451753449 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f23680b54b0 con 0x7f236806d600 2024-03-30T13:13:04.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.297+0000 7f2367200640 1 -- 172.21.15.44:0/3451753449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2368075890 con 0x7f236806d600 2024-03-30T13:13:04.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.298+0000 7f235e000640 1 -- 172.21.15.44:0/3451753449 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f235407aba0 con 0x7f236806d600 2024-03-30T13:13:04.302 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:13:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.301+0000 7f2367200640 1 -- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f234806c560 msgr2=0x7f234806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.301+0000 7f2367200640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f234806c560 0x7f234806ea20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2358009a10 tx=0x7f2358008040 comp rx=0 tx=0).stop 2024-03-30T13:13:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.301+0000 7f2367200640 1 -- 172.21.15.44:0/3451753449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236806d600 msgr2=0x7f23680c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.301+0000 7f2367200640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236806d600 0x7f23680c8ae0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2354001b40 tx=0x7f23680b5a70 comp rx=0 tx=0).stop 2024-03-30T13:13:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.301+0000 7f2367200640 1 -- 172.21.15.44:0/3451753449 shutdown_connections 2024-03-30T13:13:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.301+0000 7f2367200640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f236806da40 0x7f23680c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.301+0000 7f2367200640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f236806d600 0x7f23680c8ae0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.301+0000 7f2367200640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f234806c560 0x7f234806ea20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.301+0000 7f2367200640 1 --2- 172.21.15.44:0/3451753449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234c003f80 0x7f23681f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.301+0000 7f2367200640 1 -- 172.21.15.44:0/3451753449 >> 172.21.15.44:0/3451753449 conn(0x7f236809d4e0 msgr2=0x7f2368160970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.301+0000 7f2367200640 1 -- 172.21.15.44:0/3451753449 shutdown_connections 2024-03-30T13:13:04.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.301+0000 7f2367200640 1 -- 172.21.15.44:0/3451753449 wait complete. 2024-03-30T13:13:04.325 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:13:04.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.550+0000 7ff681a00640 1 Processor -- start 2024-03-30T13:13:04.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.550+0000 7ff681a00640 1 -- start start 2024-03-30T13:13:04.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.552+0000 7ff681a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff67c13f0c0 0x7ff67c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.552+0000 7ff681a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff67c1605a0 0x7ff67c0cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.552+0000 7ff681a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff67c0ce9c0 con 0x7ff67c06d720 2024-03-30T13:13:04.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.552+0000 7ff681a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7ff67c160e30 con 0x7ff67c1605a0 2024-03-30T13:13:04.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.552+0000 7ff681a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff67c160b50 con 0x7ff67c13f0c0 2024-03-30T13:13:04.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.553+0000 7ff67b400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff67c1605a0 0x7ff67c0cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.553+0000 7ff67aa00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff67c13f0c0 0x7ff67c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.553+0000 7ff67b400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff67c1605a0 0x7ff67c0cfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:45332/0 (socket says 172.21.15.44:45332) 2024-03-30T13:13:04.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.553+0000 7ff67b400640 1 -- 172.21.15.44:0/2868748559 learned_addr learned my addr 172.21.15.44:0/2868748559 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:04.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.553+0000 7ff67aa00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff67c13f0c0 0x7ff67c06d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:59570/0 (socket says 172.21.15.44:59570) 2024-03-30T13:13:04.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.553+0000 7ff67aa00640 1 -- 172.21.15.44:0/2868748559 >> v2:172.21.15.151:3300/0 conn(0x7ff67c1605a0 msgr2=0x7ff67c0cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:04.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.553+0000 7ff67aa00640 1 --2- 172.21.15.44:0/2868748559 >> v2:172.21.15.151:3300/0 conn(0x7ff67c1605a0 0x7ff67c0cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.554+0000 7ff67aa00640 1 -- 172.21.15.44:0/2868748559 >> v1:172.21.15.151:6789/0 conn(0x7ff67c06d720 legacy=0x7ff67c15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.554+0000 7ff67aa00640 1 -- 172.21.15.44:0/2868748559 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c13fa40 con 0x7ff67c13f0c0 2024-03-30T13:13:04.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.555+0000 7ff67aa00640 1 --2- 172.21.15.44:0/2868748559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff67c13f0c0 0x7ff67c06d1e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0097a0 tx=0x7ff66c02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51b2c4371816374c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:04.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.557+0000 7ff679600640 1 -- 172.21.15.44:0/2868748559 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c039070 con 0x7ff67c13f0c0 2024-03-30T13:13:04.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.557+0000 7ff679600640 1 -- 172.21.15.44:0/2868748559 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff66c0316f0 con 0x7ff67c13f0c0 2024-03-30T13:13:04.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.557+0000 7ff679600640 1 -- 172.21.15.44:0/2868748559 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c031ac0 con 0x7ff67c13f0c0 2024-03-30T13:13:04.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.558+0000 7ff681a00640 1 -- 172.21.15.44:0/2868748559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff67c13f0c0 msgr2=0x7ff67c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.558+0000 7ff681a00640 1 --2- 172.21.15.44:0/2868748559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff67c13f0c0 0x7ff67c06d1e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0097a0 tx=0x7ff66c02b790 comp rx=0 tx=0).stop 2024-03-30T13:13:04.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.558+0000 7ff681a00640 1 -- 172.21.15.44:0/2868748559 shutdown_connections 2024-03-30T13:13:04.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.558+0000 7ff681a00640 1 --2- 172.21.15.44:0/2868748559 >> v2:172.21.15.151:3300/0 conn(0x7ff67c1605a0 0x7ff67c0cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.558+0000 7ff681a00640 1 --2- 172.21.15.44:0/2868748559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff67c13f0c0 0x7ff67c06d1e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.558+0000 7ff681a00640 1 -- 172.21.15.44:0/2868748559 >> 172.21.15.44:0/2868748559 conn(0x7ff67c0b5b00 msgr2=0x7ff67c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:04.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.558+0000 7ff681a00640 1 -- 172.21.15.44:0/2868748559 shutdown_connections 2024-03-30T13:13:04.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.558+0000 7ff681a00640 1 -- 172.21.15.44:0/2868748559 wait complete. 2024-03-30T13:13:04.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.559+0000 7ff681a00640 1 Processor -- start 2024-03-30T13:13:04.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.560+0000 7ff681a00640 1 -- start start 2024-03-30T13:13:04.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.560+0000 7ff681a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff67c06d720 0x7ff67c1416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.560+0000 7ff681a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff67c13f0c0 0x7ff67c142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.560+0000 7ff681a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff67c1605a0 0x7ff67c15ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff681a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c13f4a0 con 0x7ff67c06d720 2024-03-30T13:13:04.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff681a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c140000 con 0x7ff67c13f0c0 2024-03-30T13:13:04.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff681a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff67c13f620 con 0x7ff67c1605a0 2024-03-30T13:13:04.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff67aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff67c06d720 0x7ff67c1416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff67aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff67c06d720 0x7ff67c1416a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40216/0 (socket says 172.21.15.44:40216) 2024-03-30T13:13:04.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff67aa00640 1 -- 172.21.15.44:0/3669022293 learned_addr learned my addr 172.21.15.44:0/3669022293 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:04.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff67a000640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff67c13f0c0 0x7ff67c142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff67aa00640 1 -- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff67c1605a0 msgr2=0x7ff67c15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff67aa00640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff67c1605a0 0x7ff67c15ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff67aa00640 1 -- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff67c13f0c0 msgr2=0x7ff67c142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff67aa00640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff67c13f0c0 0x7ff67c142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff67aa00640 1 -- 172.21.15.44:0/3669022293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c144bc0 con 0x7ff67c06d720 2024-03-30T13:13:04.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.561+0000 7ff67a000640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff67c13f0c0 0x7ff67c142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:04.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.562+0000 7ff67aa00640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff67c06d720 0x7ff67c1416a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff66c000c00 tx=0x7ff66c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:04.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.562+0000 7ff672a00640 1 -- 172.21.15.44:0/3669022293 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c043070 con 0x7ff67c06d720 2024-03-30T13:13:04.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.562+0000 7ff672a00640 1 -- 172.21.15.44:0/3669022293 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff66c034480 con 0x7ff67c06d720 2024-03-30T13:13:04.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.562+0000 7ff672a00640 1 -- 172.21.15.44:0/3669022293 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c039040 con 0x7ff67c06d720 2024-03-30T13:13:04.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.562+0000 7ff681a00640 1 -- 172.21.15.44:0/3669022293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c144ea0 con 0x7ff67c06d720 2024-03-30T13:13:04.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.562+0000 7ff681a00640 1 -- 172.21.15.44:0/3669022293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c145460 con 0x7ff67c06d720 2024-03-30T13:13:04.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.563+0000 7ff681a00640 1 -- 172.21.15.44:0/3669022293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67c075890 con 0x7ff67c06d720 2024-03-30T13:13:04.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.564+0000 7ff672a00640 1 -- 172.21.15.44:0/3669022293 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff66c046070 con 0x7ff67c06d720 2024-03-30T13:13:04.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.565+0000 7ff672a00640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff65c06c530 0x7ff65c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:04.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.565+0000 7ff672a00640 1 -- 172.21.15.44:0/3669022293 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7ff66c0ad6c0 con 0x7ff67c06d720 2024-03-30T13:13:04.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.566+0000 7ff67a000640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff65c06c530 0x7ff65c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:04.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.567+0000 7ff67a000640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff65c06c530 0x7ff65c06e9f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0b1880 tx=0x7ff668009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:04.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.569+0000 7ff672a00640 1 -- 172.21.15.44:0/3669022293 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff66c07b820 con 0x7ff67c06d720 2024-03-30T13:13:04.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.774+0000 7ff681a00640 1 -- 172.21.15.44:0/3669022293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff67c06c2c0 con 0x7ff67c06d720 2024-03-30T13:13:04.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.775+0000 7ff672a00640 1 -- 172.21.15.44:0/3669022293 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7ff66c0316c0 con 0x7ff67c06d720 2024-03-30T13:13:04.778 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:13:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.777+0000 7ff681a00640 1 -- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff65c06c530 msgr2=0x7ff65c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.777+0000 7ff681a00640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff65c06c530 0x7ff65c06e9f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0b1880 tx=0x7ff668009040 comp rx=0 tx=0).stop 2024-03-30T13:13:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.777+0000 7ff681a00640 1 -- 172.21.15.44:0/3669022293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff67c06d720 msgr2=0x7ff67c1416a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:04.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.777+0000 7ff681a00640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff67c06d720 0x7ff67c1416a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff66c000c00 tx=0x7ff66c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.777+0000 7ff681a00640 1 -- 172.21.15.44:0/3669022293 shutdown_connections 2024-03-30T13:13:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.777+0000 7ff681a00640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff67c1605a0 0x7ff67c15ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.777+0000 7ff681a00640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff65c06c530 0x7ff65c06e9f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.777+0000 7ff681a00640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff67c13f0c0 0x7ff67c142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.777+0000 7ff681a00640 1 --2- 172.21.15.44:0/3669022293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff67c06d720 0x7ff67c1416a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.777+0000 7ff681a00640 1 -- 172.21.15.44:0/3669022293 >> 172.21.15.44:0/3669022293 conn(0x7ff67c0b5b00 msgr2=0x7ff67c0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.778+0000 7ff681a00640 1 -- 172.21.15.44:0/3669022293 shutdown_connections 2024-03-30T13:13:04.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:04.778+0000 7ff681a00640 1 -- 172.21.15.44:0/3669022293 wait complete. 2024-03-30T13:13:04.801 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:13:05.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.021+0000 7f3e2de00640 1 Processor -- start 2024-03-30T13:13:05.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.022+0000 7f3e2de00640 1 -- start start 2024-03-30T13:13:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.023+0000 7f3e2de00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3e280b4920 0x7f3e280b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.023+0000 7f3e2de00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e280b4d00 0x7f3e280d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.023+0000 7f3e2de00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3e280d0b90 0x7f3e280d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.023+0000 7f3e2de00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3e280d0260 con 0x7f3e280b4920 2024-03-30T13:13:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.023+0000 7f3e2de00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f3e280b54b0 con 0x7f3e280d0b90 2024-03-30T13:13:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.023+0000 7f3e2de00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3e280cfca0 con 0x7f3e280b4d00 2024-03-30T13:13:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.023+0000 7f3e2ca00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3e280b4920 0x7f3e280b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.023+0000 7f3e2ca00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3e280b4920 0x7f3e280b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40224/0 (socket says 172.21.15.44:40224) 2024-03-30T13:13:05.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.023+0000 7f3e2ca00640 1 -- 172.21.15.44:0/1587912640 learned_addr learned my addr 172.21.15.44:0/1587912640 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:05.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.024+0000 7f3e2ca00640 1 -- 172.21.15.44:0/1587912640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e280b4d00 msgr2=0x7f3e280d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:05.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.024+0000 7f3e2ca00640 1 --2- 172.21.15.44:0/1587912640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e280b4d00 0x7f3e280d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.024+0000 7f3e2ca00640 1 -- 172.21.15.44:0/1587912640 >> v2:172.21.15.151:3300/0 conn(0x7f3e280d0b90 msgr2=0x7f3e280d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:05.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.024+0000 7f3e2ca00640 1 --2- 172.21.15.44:0/1587912640 >> v2:172.21.15.151:3300/0 conn(0x7f3e280d0b90 0x7f3e280d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.024+0000 7f3e2ca00640 1 -- 172.21.15.44:0/1587912640 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e280cff80 con 0x7f3e280b4920 2024-03-30T13:13:05.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.025+0000 7f3e2ca00640 1 --2- 172.21.15.44:0/1587912640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e280b4920 0x7f3e280b3ab0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3e2808c940 tx=0x7f3e1802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ca7fa0b5d9a72a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:05.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.025+0000 7f3e27400640 1 -- 172.21.15.44:0/1587912640 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1802c9f0 con 0x7f3e280b4920 2024-03-30T13:13:05.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.025+0000 7f3e27400640 1 -- 172.21.15.44:0/1587912640 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1802cb90 con 0x7f3e280b4920 2024-03-30T13:13:05.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.025+0000 7f3e27400640 1 -- 172.21.15.44:0/1587912640 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e180343f0 con 0x7f3e280b4920 2024-03-30T13:13:05.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.026+0000 7f3e2de00640 1 -- 172.21.15.44:0/1587912640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e280b4920 msgr2=0x7f3e280b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:05.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.026+0000 7f3e2de00640 1 --2- 172.21.15.44:0/1587912640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e280b4920 0x7f3e280b3ab0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3e2808c940 tx=0x7f3e1802be50 comp rx=0 tx=0).stop 2024-03-30T13:13:05.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.026+0000 7f3e2de00640 1 -- 172.21.15.44:0/1587912640 shutdown_connections 2024-03-30T13:13:05.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.026+0000 7f3e2de00640 1 --2- 172.21.15.44:0/1587912640 >> v2:172.21.15.151:3300/0 conn(0x7f3e280d0b90 0x7f3e280d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.026+0000 7f3e2de00640 1 --2- 172.21.15.44:0/1587912640 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e280b4d00 0x7f3e280d4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.026+0000 7f3e2de00640 1 --2- 172.21.15.44:0/1587912640 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e280b4920 0x7f3e280b3ab0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.026+0000 7f3e2de00640 1 -- 172.21.15.44:0/1587912640 >> 172.21.15.44:0/1587912640 conn(0x7f3e2809d4e0 msgr2=0x7f3e280d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:05.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.026+0000 7f3e2de00640 1 -- 172.21.15.44:0/1587912640 shutdown_connections 2024-03-30T13:13:05.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.026+0000 7f3e2de00640 1 -- 172.21.15.44:0/1587912640 wait complete. 2024-03-30T13:13:05.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.028+0000 7f3e2de00640 1 Processor -- start 2024-03-30T13:13:05.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.028+0000 7f3e2de00640 1 -- start start 2024-03-30T13:13:05.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.029+0000 7f3e2de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e280b4920 0x7f3e2815e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.029+0000 7f3e2de00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e280b4d00 0x7f3e280cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.029+0000 7f3e2de00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e280d0b90 0x7f3e280c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.029+0000 7f3e2de00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3e280b3ff0 con 0x7f3e280b4920 2024-03-30T13:13:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.029+0000 7f3e2de00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3e280d2180 con 0x7f3e280b4d00 2024-03-30T13:13:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.029+0000 7f3e2de00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3e280d5000 con 0x7f3e280d0b90 2024-03-30T13:13:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.029+0000 7f3e2ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e280b4920 0x7f3e2815e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.029+0000 7f3e2ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e280b4920 0x7f3e2815e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40236/0 (socket says 172.21.15.44:40236) 2024-03-30T13:13:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.029+0000 7f3e2ca00640 1 -- 172.21.15.44:0/155277773 learned_addr learned my addr 172.21.15.44:0/155277773 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.030+0000 7f3e2d400640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e280d0b90 0x7f3e280c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.030+0000 7f3e27e00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e280b4d00 0x7f3e280cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.030+0000 7f3e2ca00640 1 -- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e280d0b90 msgr2=0x7f3e280c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.030+0000 7f3e2ca00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e280d0b90 0x7f3e280c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.030+0000 7f3e2ca00640 1 -- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e280b4d00 msgr2=0x7f3e280cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:05.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.030+0000 7f3e2ca00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e280b4d00 0x7f3e280cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.030+0000 7f3e2ca00640 1 -- 172.21.15.44:0/155277773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e280c7fe0 con 0x7f3e280b4920 2024-03-30T13:13:05.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.030+0000 7f3e2ca00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e280b4920 0x7f3e2815e900 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3e180093e0 tx=0x7f3e18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:05.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.030+0000 7f3e24c00640 1 -- 172.21.15.44:0/155277773 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e18043020 con 0x7f3e280b4920 2024-03-30T13:13:05.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.030+0000 7f3e24c00640 1 -- 172.21.15.44:0/155277773 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1803e450 con 0x7f3e280b4920 2024-03-30T13:13:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.030+0000 7f3e24c00640 1 -- 172.21.15.44:0/155277773 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1803e840 con 0x7f3e280b4920 2024-03-30T13:13:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.030+0000 7f3e2de00640 1 -- 172.21.15.44:0/155277773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e280c82c0 con 0x7f3e280b4920 2024-03-30T13:13:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.031+0000 7f3e2de00640 1 -- 172.21.15.44:0/155277773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e280c8880 con 0x7f3e280b4920 2024-03-30T13:13:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.032+0000 7f3e2de00640 1 -- 172.21.15.44:0/155277773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e28075890 con 0x7f3e280b4920 2024-03-30T13:13:05.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.032+0000 7f3e24c00640 1 -- 172.21.15.44:0/155277773 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3e18046020 con 0x7f3e280b4920 2024-03-30T13:13:05.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.033+0000 7f3e24c00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3e0406c530 0x7f3e0406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.033+0000 7f3e24c00640 1 -- 172.21.15.44:0/155277773 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f3e180ae5c0 con 0x7f3e280b4920 2024-03-30T13:13:05.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.034+0000 7f3e27e00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3e0406c530 0x7f3e0406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:05.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.035+0000 7f3e27e00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3e0406c530 0x7f3e0406e9f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3e280a1130 tx=0x7f3e10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:05.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.038+0000 7f3e24c00640 1 -- 172.21.15.44:0/155277773 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3e1804d030 con 0x7f3e280b4920 2024-03-30T13:13:05.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.248+0000 7f3e2de00640 1 -- 172.21.15.44:0/155277773 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3e2806ccc0 con 0x7f3e280b4920 2024-03-30T13:13:05.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.249+0000 7f3e24c00640 1 -- 172.21.15.44:0/155277773 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f3e1807c720 con 0x7f3e280b4920 2024-03-30T13:13:05.253 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:13:05.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.252+0000 7f3e2de00640 1 -- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3e0406c530 msgr2=0x7f3e0406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:05.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.252+0000 7f3e2de00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3e0406c530 0x7f3e0406e9f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3e280a1130 tx=0x7f3e10008040 comp rx=0 tx=0).stop 2024-03-30T13:13:05.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.252+0000 7f3e2de00640 1 -- 172.21.15.44:0/155277773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e280b4920 msgr2=0x7f3e2815e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:05.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.252+0000 7f3e2de00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e280b4920 0x7f3e2815e900 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3e180093e0 tx=0x7f3e18004a40 comp rx=0 tx=0).stop 2024-03-30T13:13:05.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.252+0000 7f3e2de00640 1 -- 172.21.15.44:0/155277773 shutdown_connections 2024-03-30T13:13:05.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.252+0000 7f3e2de00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e280d0b90 0x7f3e280c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.252+0000 7f3e2de00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3e0406c530 0x7f3e0406e9f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.252+0000 7f3e2de00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e280b4d00 0x7f3e280cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.252+0000 7f3e2de00640 1 --2- 172.21.15.44:0/155277773 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3e280b4920 0x7f3e2815e900 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.252+0000 7f3e2de00640 1 -- 172.21.15.44:0/155277773 >> 172.21.15.44:0/155277773 conn(0x7f3e2809d4e0 msgr2=0x7f3e2806c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:05.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.252+0000 7f3e2de00640 1 -- 172.21.15.44:0/155277773 shutdown_connections 2024-03-30T13:13:05.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.252+0000 7f3e2de00640 1 -- 172.21.15.44:0/155277773 wait complete. 2024-03-30T13:13:05.277 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:13:05.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.493+0000 7fd931800640 1 Processor -- start 2024-03-30T13:13:05.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.493+0000 7fd931800640 1 -- start start 2024-03-30T13:13:05.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.495+0000 7fd931800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd92c145820 0x7fd92c15d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.495+0000 7fd931800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd92c0cdc00 0x7fd92c06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.495+0000 7fd931800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd92c15d5c0 con 0x7fd92c071de0 2024-03-30T13:13:05.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.495+0000 7fd931800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd92c0737d0 con 0x7fd92c145820 2024-03-30T13:13:05.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.495+0000 7fd931800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fd92c072280 con 0x7fd92c0cdc00 2024-03-30T13:13:05.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.496+0000 7fd92be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd92c145820 0x7fd92c15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:05.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.496+0000 7fd923e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd92c071de0 0x7fd92c0cd4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45252/0 (socket says 172.21.15.44:45252) 2024-03-30T13:13:05.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.496+0000 7fd923e00640 1 -- 172.21.15.44:0/3114680877 learned_addr learned my addr 172.21.15.44:0/3114680877 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:05.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.496+0000 7fd930e00640 1 --2- 172.21.15.44:0/3114680877 >> v2:172.21.15.151:3300/0 conn(0x7fd92c0cdc00 0x7fd92c06d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:05.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.496+0000 7fd92be00640 1 -- 172.21.15.44:0/3114680877 >> v2:172.21.15.151:3300/0 conn(0x7fd92c0cdc00 msgr2=0x7fd92c06d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:05.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.496+0000 7fd92be00640 1 --2- 172.21.15.44:0/3114680877 >> v2:172.21.15.151:3300/0 conn(0x7fd92c0cdc00 0x7fd92c06d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.496+0000 7fd92be00640 1 -- 172.21.15.44:0/3114680877 >> v1:172.21.15.44:6789/0 conn(0x7fd92c071de0 legacy=0x7fd92c0cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:05.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.496+0000 7fd92be00640 1 -- 172.21.15.44:0/3114680877 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c072560 con 0x7fd92c145820 2024-03-30T13:13:05.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.496+0000 7fd92b400640 1 -- 172.21.15.44:0/3114680877 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992909282 0 0) 0x7fd914001110 con 0x7fd92c071de0 2024-03-30T13:13:05.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.497+0000 7fd92be00640 1 --2- 172.21.15.44:0/3114680877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd92c145820 0x7fd92c15d080 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd92c160c90 tx=0x7fd91c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f40f3c905919ae server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:05.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.498+0000 7fd92b400640 1 -- 172.21.15.44:0/3114680877 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c035020 con 0x7fd92c145820 2024-03-30T13:13:05.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.498+0000 7fd92b400640 1 -- 172.21.15.44:0/3114680877 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd91c031830 con 0x7fd92c145820 2024-03-30T13:13:05.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.498+0000 7fd92b400640 1 -- 172.21.15.44:0/3114680877 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c031c00 con 0x7fd92c145820 2024-03-30T13:13:05.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.498+0000 7fd931800640 1 -- 172.21.15.44:0/3114680877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd92c145820 msgr2=0x7fd92c15d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:05.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.498+0000 7fd931800640 1 --2- 172.21.15.44:0/3114680877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd92c145820 0x7fd92c15d080 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd92c160c90 tx=0x7fd91c02b8d0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.499+0000 7fd931800640 1 -- 172.21.15.44:0/3114680877 shutdown_connections 2024-03-30T13:13:05.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.499+0000 7fd931800640 1 --2- 172.21.15.44:0/3114680877 >> v2:172.21.15.151:3300/0 conn(0x7fd92c0cdc00 0x7fd92c06d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.499+0000 7fd931800640 1 --2- 172.21.15.44:0/3114680877 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd92c145820 0x7fd92c15d080 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.499+0000 7fd931800640 1 -- 172.21.15.44:0/3114680877 >> 172.21.15.44:0/3114680877 conn(0x7fd92c06b970 msgr2=0x7fd92c06bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:05.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.499+0000 7fd931800640 1 -- 172.21.15.44:0/3114680877 shutdown_connections 2024-03-30T13:13:05.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.499+0000 7fd931800640 1 -- 172.21.15.44:0/3114680877 wait complete. 2024-03-30T13:13:05.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.500+0000 7fd931800640 1 Processor -- start 2024-03-30T13:13:05.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.500+0000 7fd931800640 1 -- start start 2024-03-30T13:13:05.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.501+0000 7fd931800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd92c071de0 0x7fd92c1f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.501+0000 7fd931800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd92c0cdc00 0x7fd92c13adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.501+0000 7fd931800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd92c145820 0x7fd92c0af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.501+0000 7fd931800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c072e00 con 0x7fd92c071de0 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.501+0000 7fd931800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c072b20 con 0x7fd92c145820 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.501+0000 7fd931800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd92c145c00 con 0x7fd92c0cdc00 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.502+0000 7fd92be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd92c071de0 0x7fd92c1f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.502+0000 7fd92be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd92c071de0 0x7fd92c1f2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40252/0 (socket says 172.21.15.44:40252) 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.502+0000 7fd92be00640 1 -- 172.21.15.44:0/3244007070 learned_addr learned my addr 172.21.15.44:0/3244007070 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.502+0000 7fd930e00640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd92c145820 0x7fd92c0af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.502+0000 7fd92be00640 1 -- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd92c0cdc00 msgr2=0x7fd92c13adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.502+0000 7fd92be00640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd92c0cdc00 0x7fd92c13adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.502+0000 7fd92be00640 1 -- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd92c145820 msgr2=0x7fd92c0af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:05.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.502+0000 7fd92be00640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd92c145820 0x7fd92c0af9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.502+0000 7fd92be00640 1 -- 172.21.15.44:0/3244007070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c0af340 con 0x7fd92c071de0 2024-03-30T13:13:05.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.502+0000 7fd92be00640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd92c071de0 0x7fd92c1f2800 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009890 tx=0x7fd91c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:05.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.503+0000 7fd928c00640 1 -- 172.21.15.44:0/3244007070 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c041070 con 0x7fd92c071de0 2024-03-30T13:13:05.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.503+0000 7fd928c00640 1 -- 172.21.15.44:0/3244007070 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd91c03a950 con 0x7fd92c071de0 2024-03-30T13:13:05.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.503+0000 7fd928c00640 1 -- 172.21.15.44:0/3244007070 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c035040 con 0x7fd92c071de0 2024-03-30T13:13:05.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.503+0000 7fd931800640 1 -- 172.21.15.44:0/3244007070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92c1f2d40 con 0x7fd92c071de0 2024-03-30T13:13:05.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.503+0000 7fd931800640 1 -- 172.21.15.44:0/3244007070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd92c0ad7d0 con 0x7fd92c071de0 2024-03-30T13:13:05.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.504+0000 7fd931800640 1 -- 172.21.15.44:0/3244007070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd92c075890 con 0x7fd92c071de0 2024-03-30T13:13:05.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.505+0000 7fd928c00640 1 -- 172.21.15.44:0/3244007070 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd91c038020 con 0x7fd92c071de0 2024-03-30T13:13:05.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.506+0000 7fd928c00640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd90806c530 0x7fd90806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:05.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.506+0000 7fd928c00640 1 -- 172.21.15.44:0/3244007070 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fd91c0ad5f0 con 0x7fd92c071de0 2024-03-30T13:13:05.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.507+0000 7fd923e00640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd90806c530 0x7fd90806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:05.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.508+0000 7fd923e00640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd90806c530 0x7fd90806e9f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd914007fd0 tx=0x7fd914007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:05.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.510+0000 7fd928c00640 1 -- 172.21.15.44:0/3244007070 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd92c1f2d40 con 0x7fd92c071de0 2024-03-30T13:13:05.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.727+0000 7fd931800640 1 -- 172.21.15.44:0/3244007070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd92c13bc30 con 0x7fd92c071de0 2024-03-30T13:13:05.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.728+0000 7fd928c00640 1 -- 172.21.15.44:0/3244007070 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fd91c07b750 con 0x7fd92c071de0 2024-03-30T13:13:05.732 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-03-30T13:13:05.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.731+0000 7fd931800640 1 -- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd90806c530 msgr2=0x7fd90806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:05.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.731+0000 7fd931800640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd90806c530 0x7fd90806e9f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd914007fd0 tx=0x7fd914007960 comp rx=0 tx=0).stop 2024-03-30T13:13:05.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.731+0000 7fd931800640 1 -- 172.21.15.44:0/3244007070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd92c071de0 msgr2=0x7fd92c1f2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:05.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.731+0000 7fd931800640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd92c071de0 0x7fd92c1f2800 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009890 tx=0x7fd91c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.731+0000 7fd931800640 1 -- 172.21.15.44:0/3244007070 shutdown_connections 2024-03-30T13:13:05.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.731+0000 7fd931800640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd90806c530 0x7fd90806e9f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.731+0000 7fd931800640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd92c145820 0x7fd92c0af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.731+0000 7fd931800640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd92c0cdc00 0x7fd92c13adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.731+0000 7fd931800640 1 --2- 172.21.15.44:0/3244007070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd92c071de0 0x7fd92c1f2800 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.731+0000 7fd931800640 1 -- 172.21.15.44:0/3244007070 >> 172.21.15.44:0/3244007070 conn(0x7fd92c06b970 msgr2=0x7fd92c15a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.731+0000 7fd931800640 1 -- 172.21.15.44:0/3244007070 shutdown_connections 2024-03-30T13:13:05.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:05.731+0000 7fd931800640 1 -- 172.21.15.44:0/3244007070 wait complete. 2024-03-30T13:13:05.753 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-30T13:13:05.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:05.753 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-30T13:13:05.854 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:13:05.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:05.855 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-30T13:13:05.901 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-30T13:13:05.901 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:13:06.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.126+0000 7fecfa600640 1 Processor -- start 2024-03-30T13:13:06.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.127+0000 7fecfa600640 1 -- start start 2024-03-30T13:13:06.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.128+0000 7fecfa600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecf4071c30 0x7fecf4160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.128+0000 7fecfa600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fecf4160660 0x7fecf40ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.128+0000 7fecfa600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf4146040 con 0x7fecf4145c60 2024-03-30T13:13:06.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.128+0000 7fecfa600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fecf4160e50 con 0x7fecf4160660 2024-03-30T13:13:06.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.128+0000 7fecfa600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fecf415d8b0 con 0x7fecf4071c30 2024-03-30T13:13:06.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.129+0000 7fecf3400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fecf4145c60 0x7fecf4071520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45260/0 (socket says 172.21.15.44:45260) 2024-03-30T13:13:06.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.129+0000 7fecf3400640 1 -- 172.21.15.44:0/3758177965 learned_addr learned my addr 172.21.15.44:0/3758177965 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.129+0000 7feceaa00640 1 --2- 172.21.15.44:0/3758177965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecf4071c30 0x7fecf4160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.129+0000 7fecf3e00640 1 --2- 172.21.15.44:0/3758177965 >> v2:172.21.15.151:3300/0 conn(0x7fecf4160660 0x7fecf40ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.129+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216262142 0 0) 0x7fecf4146040 con 0x7fecf4145c60 2024-03-30T13:13:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.129+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecd8003520 con 0x7fecf4145c60 2024-03-30T13:13:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.129+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1119565447 0 0) 0x7fecd8003520 con 0x7fecf4145c60 2024-03-30T13:13:06.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.129+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecf4071c30 msgr2=0x7fecf4160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.129+0000 7fecf2a00640 1 --2- 172.21.15.44:0/3758177965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecf4071c30 0x7fecf4160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.129+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 >> v2:172.21.15.151:3300/0 conn(0x7fecf4160660 msgr2=0x7fecf40ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.129+0000 7fecf2a00640 1 --2- 172.21.15.44:0/3758177965 >> v2:172.21.15.151:3300/0 conn(0x7fecf4160660 0x7fecf40ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.129+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf415caf0 con 0x7fecf4145c60 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fece4001670 con 0x7fecf4145c60 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 >> v1:172.21.15.44:6789/0 conn(0x7fecf4145c60 legacy=0x7fecf4071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf2a00640 1 --2- 172.21.15.44:0/3758177965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd80039b0 0x7fecd8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf2a00640 1 --2- 172.21.15.44:0/3758177965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecf4071c30 0x7fecd8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf2a00640 1 --2- 172.21.15.44:0/3758177965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecd8004d40 0x7fecd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4160e50 con 0x7fecd80039b0 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fecf415d8b0 con 0x7fecd8004d40 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fecd800b9f0 con 0x7fecf4071c30 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf3400640 1 --2- 172.21.15.44:0/3758177965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd80039b0 0x7fecd8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf3400640 1 -- 172.21.15.44:0/3758177965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecf4071c30 msgr2=0x7fecd8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:06.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf3400640 1 --2- 172.21.15.44:0/3758177965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecf4071c30 0x7fecd8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf3400640 1 -- 172.21.15.44:0/3758177965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecd8004d40 msgr2=0x7fecd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf3400640 1 --2- 172.21.15.44:0/3758177965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecd8004d40 0x7fecd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.130+0000 7fecf3400640 1 -- 172.21.15.44:0/3758177965 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd8003520 con 0x7fecd80039b0 2024-03-30T13:13:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.131+0000 7fecf3400640 1 --2- 172.21.15.44:0/3758177965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd80039b0 0x7fecd8003dd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fece400c290 tx=0x7fecd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f51d3714d0599a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.132+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4007d50 con 0x7fecd80039b0 2024-03-30T13:13:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.132+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece4030070 con 0x7fecd80039b0 2024-03-30T13:13:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.132+0000 7fecf2a00640 1 -- 172.21.15.44:0/3758177965 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece402cd80 con 0x7fecd80039b0 2024-03-30T13:13:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.132+0000 7fecfa600640 1 -- 172.21.15.44:0/3758177965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd80039b0 msgr2=0x7fecd8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.132+0000 7fecfa600640 1 --2- 172.21.15.44:0/3758177965 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd80039b0 0x7fecd8003dd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fece400c290 tx=0x7fecd8005830 comp rx=0 tx=0).stop 2024-03-30T13:13:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.132+0000 7fecf3e00640 1 -- 172.21.15.44:0/3758177965 reap_dead start 2024-03-30T13:13:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.132+0000 7fecfa600640 1 -- 172.21.15.44:0/3758177965 shutdown_connections 2024-03-30T13:13:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.132+0000 7fecfa600640 1 -- 172.21.15.44:0/3758177965 >> 172.21.15.44:0/3758177965 conn(0x7fecf40b1c90 msgr2=0x7fecf40b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.132+0000 7fecfa600640 1 -- 172.21.15.44:0/3758177965 shutdown_connections 2024-03-30T13:13:06.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.132+0000 7fecfa600640 1 -- 172.21.15.44:0/3758177965 wait complete. 2024-03-30T13:13:06.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.134+0000 7fecfa600640 1 Processor -- start 2024-03-30T13:13:06.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.134+0000 7fecfa600640 1 -- start start 2024-03-30T13:13:06.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.135+0000 7fecfa600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd80039b0 0x7fecf4143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.135+0000 7fecfa600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecf413fab0 0x7fecf41f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.135+0000 7fecfa600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecf41f7e80 0x7fecf415b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.135+0000 7fecfa600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4160b10 con 0x7fecd80039b0 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.135+0000 7fecfa600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fecf415d0b0 con 0x7fecf41f7e80 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.135+0000 7fecfa600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fecf4160120 con 0x7fecf413fab0 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.136+0000 7fecf3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd80039b0 0x7fecf4143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.136+0000 7fecf3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd80039b0 0x7fecf4143a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40284/0 (socket says 172.21.15.44:40284) 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.136+0000 7fecf3400640 1 -- 172.21.15.44:0/2287621413 learned_addr learned my addr 172.21.15.44:0/2287621413 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.136+0000 7fecf3e00640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecf41f7e80 0x7fecf415b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.136+0000 7fecf3400640 1 -- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecf413fab0 msgr2=0x7fecf41f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.136+0000 7fecf3400640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecf413fab0 0x7fecf41f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.136+0000 7fecf3400640 1 -- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecf41f7e80 msgr2=0x7fecf415b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:06.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.136+0000 7fecf3400640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecf41f7e80 0x7fecf415b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.136+0000 7fecf3400640 1 -- 172.21.15.44:0/2287621413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf4142fc0 con 0x7fecd80039b0 2024-03-30T13:13:06.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.136+0000 7fecf3400640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd80039b0 0x7fecf4143a40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fece4001970 tx=0x7fecf415ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.137+0000 7fecebe00640 1 -- 172.21.15.44:0/2287621413 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4004bf0 con 0x7fecd80039b0 2024-03-30T13:13:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.137+0000 7fecebe00640 1 -- 172.21.15.44:0/2287621413 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece4004d90 con 0x7fecd80039b0 2024-03-30T13:13:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.137+0000 7fecebe00640 1 -- 172.21.15.44:0/2287621413 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece4007270 con 0x7fecd80039b0 2024-03-30T13:13:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.137+0000 7fecfa600640 1 -- 172.21.15.44:0/2287621413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf41402c0 con 0x7fecd80039b0 2024-03-30T13:13:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.137+0000 7fecfa600640 1 -- 172.21.15.44:0/2287621413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf40b3f40 con 0x7fecd80039b0 2024-03-30T13:13:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.138+0000 7fecfa600640 1 -- 172.21.15.44:0/2287621413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf41407e0 con 0x7fecd80039b0 2024-03-30T13:13:06.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.139+0000 7fecebe00640 1 -- 172.21.15.44:0/2287621413 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fece4007410 con 0x7fecd80039b0 2024-03-30T13:13:06.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.140+0000 7fecebe00640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fecd006c580 0x7fecd006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.140+0000 7fecebe00640 1 -- 172.21.15.44:0/2287621413 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fece40ad080 con 0x7fecd80039b0 2024-03-30T13:13:06.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.140+0000 7feceaa00640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fecd006c580 0x7fecd006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:06.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.142+0000 7feceaa00640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fecd006c580 0x7fecd006ea40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fecdc006a90 tx=0x7fecdc006a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:06.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.146+0000 7fecebe00640 1 -- 172.21.15.44:0/2287621413 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fecf41407e0 con 0x7fecd80039b0 2024-03-30T13:13:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.395+0000 7fecfa600640 1 -- 172.21.15.44:0/2287621413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecf41f8290 con 0x7fecd80039b0 2024-03-30T13:13:06.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.396+0000 7fecebe00640 1 -- 172.21.15.44:0/2287621413 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7fecf41f8290 con 0x7fecd80039b0 2024-03-30T13:13:06.400 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:06.401 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1458748329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1458748329},{"type":"v1","addr":"172.21.15.44:6834","nonce":1458748329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3921281718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3921281718},{"type":"v1","addr":"172.21.15.151:6837","nonce":3921281718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2065829800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2065829800},{"type":"v1","addr":"172.21.15.44:6835","nonce":2065829800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:11:40.531273+0000","modified":"2024-03-30T13:12:07.711287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/456394190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":456394190},{"type":"v1","addr":"172.21.15.151:6835","nonce":456394190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276]},"id":1}]} 2024-03-30T13:13:06.401 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-03-30T13:13:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.399+0000 7fecfa600640 1 -- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fecd006c580 msgr2=0x7fecd006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.399+0000 7fecfa600640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fecd006c580 0x7fecd006ea40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fecdc006a90 tx=0x7fecdc006a20 comp rx=0 tx=0).stop 2024-03-30T13:13:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.399+0000 7fecfa600640 1 -- 172.21.15.44:0/2287621413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd80039b0 msgr2=0x7fecf4143a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.399+0000 7fecfa600640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd80039b0 0x7fecf4143a40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fece4001970 tx=0x7fecf415ccc0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.399+0000 7fecfa600640 1 -- 172.21.15.44:0/2287621413 shutdown_connections 2024-03-30T13:13:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.399+0000 7fecfa600640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fecd006c580 0x7fecd006ea40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.399+0000 7fecfa600640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecf41f7e80 0x7fecf415b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.399+0000 7fecfa600640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fecf413fab0 0x7fecf41f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.399+0000 7fecfa600640 1 --2- 172.21.15.44:0/2287621413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fecd80039b0 0x7fecf4143a40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.399+0000 7fecfa600640 1 -- 172.21.15.44:0/2287621413 >> 172.21.15.44:0/2287621413 conn(0x7fecf40b1c90 msgr2=0x7fecf40cdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.400+0000 7fecfa600640 1 -- 172.21.15.44:0/2287621413 shutdown_connections 2024-03-30T13:13:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.400+0000 7fecfa600640 1 -- 172.21.15.44:0/2287621413 wait complete. 2024-03-30T13:13:06.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:13:06.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.638+0000 7f35aee00640 1 Processor -- start 2024-03-30T13:13:06.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.639+0000 7f35aee00640 1 -- start start 2024-03-30T13:13:06.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.640+0000 7f35aee00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f35a80d0480 0x7f35a8162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.640+0000 7f35aee00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f35a80b3cb0 0x7f35a80b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.640+0000 7f35aee00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35a80d0860 con 0x7f35a80cf8e0 2024-03-30T13:13:06.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.640+0000 7f35aee00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f35a80d21e0 con 0x7f35a80b3cb0 2024-03-30T13:13:06.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.640+0000 7f35aee00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f35a80b4620 con 0x7f35a80d0480 2024-03-30T13:13:06.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.641+0000 7f35a7400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f35a80cf8e0 0x7f35a8141da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:45264/0 (socket says 172.21.15.44:45264) 2024-03-30T13:13:06.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.641+0000 7f35a7400640 1 -- 172.21.15.44:0/1092273920 learned_addr learned my addr 172.21.15.44:0/1092273920 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:06.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.641+0000 7f35ace00640 1 --2- 172.21.15.44:0/1092273920 >> v2:172.21.15.44:3300/0 conn(0x7f35a80b3cb0 0x7f35a80b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:06.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.641+0000 7f35a7e00640 1 --2- 172.21.15.44:0/1092273920 >> v2:172.21.15.151:3300/0 conn(0x7f35a80d0480 0x7f35a8162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:06.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.641+0000 7f35a6a00640 1 -- 172.21.15.44:0/1092273920 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2454967131 0 0) 0x7f35a80d0860 con 0x7f35a80cf8e0 2024-03-30T13:13:06.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.641+0000 7f35a6a00640 1 -- 172.21.15.44:0/1092273920 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3588003520 con 0x7f35a80cf8e0 2024-03-30T13:13:06.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.641+0000 7f35ace00640 1 -- 172.21.15.44:0/1092273920 >> v2:172.21.15.151:3300/0 conn(0x7f35a80d0480 msgr2=0x7f35a8162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:06.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.641+0000 7f35ace00640 1 --2- 172.21.15.44:0/1092273920 >> v2:172.21.15.151:3300/0 conn(0x7f35a80d0480 0x7f35a8162230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.641+0000 7f35ace00640 1 -- 172.21.15.44:0/1092273920 >> v1:172.21.15.44:6789/0 conn(0x7f35a80cf8e0 legacy=0x7f35a8141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:06.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.641+0000 7f35ace00640 1 -- 172.21.15.44:0/1092273920 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a8162b80 con 0x7f35a80b3cb0 2024-03-30T13:13:06.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.642+0000 7f35ace00640 1 --2- 172.21.15.44:0/1092273920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35a80b3cb0 0x7f35a80b40e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f35a806f150 tx=0x7f35a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673ad172f0301660 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:06.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.643+0000 7f35a6a00640 1 -- 172.21.15.44:0/1092273920 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0035020 con 0x7f35a80b3cb0 2024-03-30T13:13:06.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.643+0000 7f35a6a00640 1 -- 172.21.15.44:0/1092273920 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a0031830 con 0x7f35a80b3cb0 2024-03-30T13:13:06.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.643+0000 7f35a6a00640 1 -- 172.21.15.44:0/1092273920 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0031c00 con 0x7f35a80b3cb0 2024-03-30T13:13:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.643+0000 7f35aee00640 1 -- 172.21.15.44:0/1092273920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35a80b3cb0 msgr2=0x7f35a80b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.643+0000 7f35aee00640 1 --2- 172.21.15.44:0/1092273920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35a80b3cb0 0x7f35a80b40e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f35a806f150 tx=0x7f35a002b8d0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.643+0000 7f35aee00640 1 -- 172.21.15.44:0/1092273920 shutdown_connections 2024-03-30T13:13:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.643+0000 7f35aee00640 1 --2- 172.21.15.44:0/1092273920 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35a80b3cb0 0x7f35a80b40e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.643+0000 7f35aee00640 1 --2- 172.21.15.44:0/1092273920 >> v2:172.21.15.151:3300/0 conn(0x7f35a80d0480 0x7f35a8162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.643+0000 7f35aee00640 1 -- 172.21.15.44:0/1092273920 >> 172.21.15.44:0/1092273920 conn(0x7f35a80672c0 msgr2=0x7f35a80676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.644+0000 7f35aee00640 1 -- 172.21.15.44:0/1092273920 shutdown_connections 2024-03-30T13:13:06.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.644+0000 7f35aee00640 1 -- 172.21.15.44:0/1092273920 wait complete. 2024-03-30T13:13:06.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.645+0000 7f35aee00640 1 Processor -- start 2024-03-30T13:13:06.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.645+0000 7f35aee00640 1 -- start start 2024-03-30T13:13:06.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.646+0000 7f35aee00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a80b3cb0 0x7f35a8161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.646+0000 7f35aee00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35a80d0480 0x7f35a8144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.646+0000 7f35aee00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35a80cd870 0x7f35a80cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.646+0000 7f35aee00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f35a80d1e70 con 0x7f35a80cd870 2024-03-30T13:13:06.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.646+0000 7f35aee00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f35a8163140 con 0x7f35a80d0480 2024-03-30T13:13:06.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.646+0000 7f35aee00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f35a81424b0 con 0x7f35a80b3cb0 2024-03-30T13:13:06.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.647+0000 7f35ace00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35a80cd870 0x7f35a80cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:06.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.647+0000 7f35ace00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35a80cd870 0x7f35a80cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40300/0 (socket says 172.21.15.44:40300) 2024-03-30T13:13:06.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.647+0000 7f35ace00640 1 -- 172.21.15.44:0/3154235443 learned_addr learned my addr 172.21.15.44:0/3154235443 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:06.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.647+0000 7f35a7400640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35a80d0480 0x7f35a8144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:06.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.647+0000 7f35a7e00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a80b3cb0 0x7f35a8161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:06.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.647+0000 7f35ace00640 1 -- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a80b3cb0 msgr2=0x7f35a8161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:06.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.647+0000 7f35ace00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a80b3cb0 0x7f35a8161080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.647+0000 7f35ace00640 1 -- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35a80d0480 msgr2=0x7f35a8144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:06.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.647+0000 7f35ace00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35a80d0480 0x7f35a8144320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.647+0000 7f35ace00640 1 -- 172.21.15.44:0/3154235443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a80b5960 con 0x7f35a80cd870 2024-03-30T13:13:06.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.647+0000 7f35ace00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35a80cd870 0x7f35a80cdd00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009890 tx=0x7f35a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:06.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.648+0000 7f359fe00640 1 -- 172.21.15.44:0/3154235443 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0035040 con 0x7f35a80cd870 2024-03-30T13:13:06.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.648+0000 7f359fe00640 1 -- 172.21.15.44:0/3154235443 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a003b840 con 0x7f35a80cd870 2024-03-30T13:13:06.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.648+0000 7f359fe00640 1 -- 172.21.15.44:0/3154235443 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a003bc30 con 0x7f35a80cd870 2024-03-30T13:13:06.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.648+0000 7f35aee00640 1 -- 172.21.15.44:0/3154235443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a80b5c40 con 0x7f35a80cd870 2024-03-30T13:13:06.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.648+0000 7f35aee00640 1 -- 172.21.15.44:0/3154235443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a80b6200 con 0x7f35a80cd870 2024-03-30T13:13:06.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.649+0000 7f35aee00640 1 -- 172.21.15.44:0/3154235443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a8068fd0 con 0x7f35a80cd870 2024-03-30T13:13:06.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.650+0000 7f359fe00640 1 -- 172.21.15.44:0/3154235443 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f35a0038020 con 0x7f35a80cd870 2024-03-30T13:13:06.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.651+0000 7f359fe00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f358406c560 0x7f358406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:06.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.651+0000 7f359fe00640 1 -- 172.21.15.44:0/3154235443 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f35a00adc80 con 0x7f35a80cd870 2024-03-30T13:13:06.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.652+0000 7f35a7e00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f358406c560 0x7f358406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:06.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.653+0000 7f35a7e00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f358406c560 0x7f358406ea20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3598009970 tx=0x7f3598008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:06.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.656+0000 7f359fe00640 1 -- 172.21.15.44:0/3154235443 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f35a8068fd0 con 0x7f35a80cd870 2024-03-30T13:13:06.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.860+0000 7f35aee00640 1 -- 172.21.15.44:0/3154235443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35a8075a10 con 0x7f35a80cd870 2024-03-30T13:13:06.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.863+0000 7f359fe00640 1 -- 172.21.15.44:0/3154235443 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18927 (secure 0 0 0) 0x7f35a007bde0 con 0x7f35a80cd870 2024-03-30T13:13:06.904 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:06.904 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":29,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:12:27.323786+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:13:06.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.866+0000 7f35aee00640 1 -- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f358406c560 msgr2=0x7f358406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:06.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.866+0000 7f35aee00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f358406c560 0x7f358406ea20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3598009970 tx=0x7f3598008040 comp rx=0 tx=0).stop 2024-03-30T13:13:06.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.866+0000 7f35aee00640 1 -- 172.21.15.44:0/3154235443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35a80cd870 msgr2=0x7f35a80cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:06.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.866+0000 7f35aee00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35a80cd870 0x7f35a80cdd00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009890 tx=0x7f35a00046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.866+0000 7f35aee00640 1 -- 172.21.15.44:0/3154235443 shutdown_connections 2024-03-30T13:13:06.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.866+0000 7f35aee00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35a80cd870 0x7f35a80cdd00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.866+0000 7f35aee00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f358406c560 0x7f358406ea20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.866+0000 7f35aee00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35a80d0480 0x7f35a8144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.866+0000 7f35aee00640 1 --2- 172.21.15.44:0/3154235443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35a80b3cb0 0x7f35a8161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:06.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.866+0000 7f35aee00640 1 -- 172.21.15.44:0/3154235443 >> 172.21.15.44:0/3154235443 conn(0x7f35a80672c0 msgr2=0x7f35a80b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:06.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.867+0000 7f35aee00640 1 -- 172.21.15.44:0/3154235443 shutdown_connections 2024-03-30T13:13:06.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:06.867+0000 7f35aee00640 1 -- 172.21.15.44:0/3154235443 wait complete. 2024-03-30T13:13:06.907 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:11:38.219283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:11:39.485395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-30T13:11:43.072897+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-30T13:13:06.907 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:13:07.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.133+0000 7f418f200640 1 Processor -- start 2024-03-30T13:13:07.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.133+0000 7f418f200640 1 -- start start 2024-03-30T13:13:07.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.134+0000 7f418f200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f419006e980 0x7f4190072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.134+0000 7f418f200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41900ad2e0 con 0x7f41900acd60 2024-03-30T13:13:07.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.135+0000 7f418f200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41900716a0 con 0x7f41900ae9d0 2024-03-30T13:13:07.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.135+0000 7f418f200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f41900ad5c0 con 0x7f419006e980 2024-03-30T13:13:07.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.135+0000 7f418d400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f41900acd60 0x7f419015d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43046/0 (socket says 172.21.15.44:43046) 2024-03-30T13:13:07.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.135+0000 7f418d400640 1 -- 172.21.15.44:0/3606990116 learned_addr learned my addr 172.21.15.44:0/3606990116 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:07.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.135+0000 7f418de00640 1 --2- 172.21.15.44:0/3606990116 >> v2:172.21.15.151:3300/0 conn(0x7f419006e980 0x7f4190072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.135+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2547158466 0 0) 0x7f41900ad2e0 con 0x7f41900acd60 2024-03-30T13:13:07.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.135+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4174003520 con 0x7f41900acd60 2024-03-30T13:13:07.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1664733833 0 0) 0x7f4174003520 con 0x7f41900acd60 2024-03-30T13:13:07.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 >> v2:172.21.15.151:3300/0 conn(0x7f419006e980 msgr2=0x7f4190072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:07.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 --2- 172.21.15.44:0/3606990116 >> v2:172.21.15.151:3300/0 conn(0x7f419006e980 0x7f4190072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 >> v1:172.21.15.151:6789/0 conn(0x7f41900ae9d0 legacy=0x7f41900aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:07.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4190071980 con 0x7f41900acd60 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f417c001670 con 0x7f41900acd60 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 >> v1:172.21.15.44:6789/0 conn(0x7f41900acd60 legacy=0x7f419015d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 --2- 172.21.15.44:0/3606990116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41740039b0 0x7f4174003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 --2- 172.21.15.44:0/3606990116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4174004800 0x7f4174004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 --2- 172.21.15.44:0/3606990116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41740051c0 0x7f417400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f417400c130 con 0x7f4174004800 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f417400c2e0 con 0x7f41740039b0 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f417400c4e0 con 0x7f41740051c0 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418d400640 1 --2- 172.21.15.44:0/3606990116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4174004800 0x7f4174004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.136+0000 7f418de00640 1 --2- 172.21.15.44:0/3606990116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41740039b0 0x7f4174003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.137+0000 7f418e800640 1 --2- 172.21.15.44:0/3606990116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41740051c0 0x7f417400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.137+0000 7f418d400640 1 -- 172.21.15.44:0/3606990116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41740051c0 msgr2=0x7f417400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.137+0000 7f418d400640 1 --2- 172.21.15.44:0/3606990116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41740051c0 0x7f417400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.137+0000 7f418d400640 1 -- 172.21.15.44:0/3606990116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41740039b0 msgr2=0x7f4174003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:07.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.137+0000 7f418d400640 1 --2- 172.21.15.44:0/3606990116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41740039b0 0x7f4174003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.137+0000 7f418d400640 1 -- 172.21.15.44:0/3606990116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4174003520 con 0x7f4174004800 2024-03-30T13:13:07.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.137+0000 7f418de00640 1 --2- 172.21.15.44:0/3606990116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41740039b0 0x7f4174003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:07.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.137+0000 7f418e800640 1 -- 172.21.15.44:0/3606990116 reap_dead start 2024-03-30T13:13:07.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.138+0000 7f418d400640 1 --2- 172.21.15.44:0/3606990116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4174004800 0x7f4174004c80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f417c00c240 tx=0x7f4174005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccffc91c2612b31 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:07.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.138+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c007d10 con 0x7f4174004800 2024-03-30T13:13:07.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.138+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c030070 con 0x7f4174004800 2024-03-30T13:13:07.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.138+0000 7f418ca00640 1 -- 172.21.15.44:0/3606990116 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c02cda0 con 0x7f4174004800 2024-03-30T13:13:07.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.139+0000 7f418f200640 1 -- 172.21.15.44:0/3606990116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4174004800 msgr2=0x7f4174004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:07.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.139+0000 7f418f200640 1 --2- 172.21.15.44:0/3606990116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4174004800 0x7f4174004c80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f417c00c240 tx=0x7f4174005830 comp rx=0 tx=0).stop 2024-03-30T13:13:07.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.139+0000 7f418f200640 1 -- 172.21.15.44:0/3606990116 shutdown_connections 2024-03-30T13:13:07.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.139+0000 7f418f200640 1 --2- 172.21.15.44:0/3606990116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4174004800 0x7f4174004c80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.139+0000 7f418f200640 1 -- 172.21.15.44:0/3606990116 >> 172.21.15.44:0/3606990116 conn(0x7f41900cfd90 msgr2=0x7f41900d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:07.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.139+0000 7f418f200640 1 -- 172.21.15.44:0/3606990116 shutdown_connections 2024-03-30T13:13:07.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.139+0000 7f418f200640 1 -- 172.21.15.44:0/3606990116 wait complete. 2024-03-30T13:13:07.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.141+0000 7f418f200640 1 Processor -- start 2024-03-30T13:13:07.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.141+0000 7f418f200640 1 -- start start 2024-03-30T13:13:07.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418f200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4174004800 0x7f41901f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4190155d90 0x7f41901f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418f200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4190156210 0x7f41901f5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418f200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4190072180 con 0x7f4190155d90 2024-03-30T13:13:07.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418f200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4190071450 con 0x7f4190156210 2024-03-30T13:13:07.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418f200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4190072300 con 0x7f4174004800 2024-03-30T13:13:07.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4190155d90 0x7f41901f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4190155d90 0x7f41901f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56976/0 (socket says 172.21.15.44:56976) 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418d400640 1 -- 172.21.15.44:0/1881234522 learned_addr learned my addr 172.21.15.44:0/1881234522 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418de00640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4174004800 0x7f41901f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418e800640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4190156210 0x7f41901f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418d400640 1 -- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4174004800 msgr2=0x7f41901f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418d400640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4174004800 0x7f41901f22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418d400640 1 -- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4190156210 msgr2=0x7f41901f5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418d400640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4190156210 0x7f41901f5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418d400640 1 -- 172.21.15.44:0/1881234522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419009be50 con 0x7f4190155d90 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.142+0000 7f418e800640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4190156210 0x7f41901f5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.143+0000 7f418d400640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4190155d90 0x7f41901f4c50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f417c001970 tx=0x7f417c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.143+0000 7f4186000640 1 -- 172.21.15.44:0/1881234522 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c007d10 con 0x7f4190155d90 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.143+0000 7f4186000640 1 -- 172.21.15.44:0/1881234522 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f417c004bf0 con 0x7f4190155d90 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.143+0000 7f4186000640 1 -- 172.21.15.44:0/1881234522 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c007070 con 0x7f4190155d90 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.143+0000 7f418f200640 1 -- 172.21.15.44:0/1881234522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419009c130 con 0x7f4190155d90 2024-03-30T13:13:07.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.143+0000 7f418f200640 1 -- 172.21.15.44:0/1881234522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f419009c6f0 con 0x7f4190155d90 2024-03-30T13:13:07.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.144+0000 7f418f200640 1 -- 172.21.15.44:0/1881234522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4190075890 con 0x7f4190155d90 2024-03-30T13:13:07.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.145+0000 7f4186000640 1 -- 172.21.15.44:0/1881234522 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f417c007210 con 0x7f4190155d90 2024-03-30T13:13:07.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.147+0000 7f4186000640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f417006c530 0x7f417006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.147+0000 7f4186000640 1 -- 172.21.15.44:0/1881234522 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f417c0ace40 con 0x7f4190155d90 2024-03-30T13:13:07.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.147+0000 7f418de00640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f417006c530 0x7f417006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.148+0000 7f418de00640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f417006c530 0x7f417006e9f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f419006abd0 tx=0x7f4180008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:07.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.151+0000 7f4186000640 1 -- 172.21.15.44:0/1881234522 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f417c07afa0 con 0x7f4190155d90 2024-03-30T13:13:07.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.348+0000 7f418f200640 1 -- 172.21.15.44:0/1881234522 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f419015ea40 con 0x7f4190155d90 2024-03-30T13:13:07.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.349+0000 7f4186000640 1 -- 172.21.15.44:0/1881234522 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f417c07a8a0 con 0x7f4190155d90 2024-03-30T13:13:07.353 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:13:07.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.352+0000 7f418f200640 1 -- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f417006c530 msgr2=0x7f417006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:07.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.352+0000 7f418f200640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f417006c530 0x7f417006e9f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f419006abd0 tx=0x7f4180008040 comp rx=0 tx=0).stop 2024-03-30T13:13:07.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.352+0000 7f418f200640 1 -- 172.21.15.44:0/1881234522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4190155d90 msgr2=0x7f41901f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:07.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.352+0000 7f418f200640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4190155d90 0x7f41901f4c50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f417c001970 tx=0x7f417c02e070 comp rx=0 tx=0).stop 2024-03-30T13:13:07.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.352+0000 7f418f200640 1 -- 172.21.15.44:0/1881234522 shutdown_connections 2024-03-30T13:13:07.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.352+0000 7f418f200640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f417006c530 0x7f417006e9f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.352+0000 7f418f200640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4190156210 0x7f41901f5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.352+0000 7f418f200640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4190155d90 0x7f41901f4c50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.352+0000 7f418f200640 1 --2- 172.21.15.44:0/1881234522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4174004800 0x7f41901f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.352+0000 7f418f200640 1 -- 172.21.15.44:0/1881234522 >> 172.21.15.44:0/1881234522 conn(0x7f41900cfd90 msgr2=0x7f419006d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:07.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.352+0000 7f418f200640 1 -- 172.21.15.44:0/1881234522 shutdown_connections 2024-03-30T13:13:07.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.352+0000 7f418f200640 1 -- 172.21.15.44:0/1881234522 wait complete. 2024-03-30T13:13:07.374 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:13:07.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.595+0000 7f09f4400640 1 Processor -- start 2024-03-30T13:13:07.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.595+0000 7f09f4400640 1 -- start start 2024-03-30T13:13:07.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.597+0000 7f09f4400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f09ec15e7c0 0x7f09ec06c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.597+0000 7f09f4400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09ec15eba0 0x7f09ec06cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.597+0000 7f09f4400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09ec0d1170 con 0x7f09ec0b4800 2024-03-30T13:13:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.597+0000 7f09f4400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f09ec0cc840 con 0x7f09ec15e7c0 2024-03-30T13:13:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.597+0000 7f09f4400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f09ec0d1450 con 0x7f09ec15eba0 2024-03-30T13:13:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.597+0000 7f09f1a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f09ec15e7c0 0x7f09ec06c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.597+0000 7f09f1a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f09ec15e7c0 0x7f09ec06c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56982/0 (socket says 172.21.15.44:56982) 2024-03-30T13:13:07.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.597+0000 7f09f1a00640 1 -- 172.21.15.44:0/2056414283 learned_addr learned my addr 172.21.15.44:0/2056414283 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.597+0000 7f09f1a00640 1 -- 172.21.15.44:0/2056414283 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09ec15eba0 msgr2=0x7f09ec06cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.597+0000 7f09f1000640 1 --2- 172.21.15.44:0/2056414283 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09ec15eba0 0x7f09ec06cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.597+0000 7f09f1a00640 1 --2- 172.21.15.44:0/2056414283 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09ec15eba0 0x7f09ec06cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.598+0000 7f09f1a00640 1 -- 172.21.15.44:0/2056414283 >> v1:172.21.15.151:6789/0 conn(0x7f09ec0b4800 legacy=0x7f09ec09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.598+0000 7f09f1a00640 1 -- 172.21.15.44:0/2056414283 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec0d1730 con 0x7f09ec15e7c0 2024-03-30T13:13:07.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.598+0000 7f09f1000640 1 --2- 172.21.15.44:0/2056414283 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09ec15eba0 0x7f09ec06cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.599+0000 7f09f1a00640 1 --2- 172.21.15.44:0/2056414283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09ec15e7c0 0x7f09ec06c860 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009870 tx=0x7f09dc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c4d08d8da06d2c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.599+0000 7f09ebe00640 1 -- 172.21.15.44:0/2056414283 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc035020 con 0x7f09ec15e7c0 2024-03-30T13:13:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.599+0000 7f09ebe00640 1 -- 172.21.15.44:0/2056414283 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09dc031640 con 0x7f09ec15e7c0 2024-03-30T13:13:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.599+0000 7f09ebe00640 1 -- 172.21.15.44:0/2056414283 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc02d040 con 0x7f09ec15e7c0 2024-03-30T13:13:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.600+0000 7f09f4400640 1 -- 172.21.15.44:0/2056414283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09ec15e7c0 msgr2=0x7f09ec06c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.600+0000 7f09f4400640 1 --2- 172.21.15.44:0/2056414283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09ec15e7c0 0x7f09ec06c860 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f09dc009870 tx=0x7f09dc02b8f0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.600+0000 7f09f4400640 1 -- 172.21.15.44:0/2056414283 shutdown_connections 2024-03-30T13:13:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.600+0000 7f09f4400640 1 --2- 172.21.15.44:0/2056414283 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09ec15eba0 0x7f09ec06cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.600+0000 7f09f4400640 1 --2- 172.21.15.44:0/2056414283 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09ec15e7c0 0x7f09ec06c860 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.600+0000 7f09f4400640 1 -- 172.21.15.44:0/2056414283 >> 172.21.15.44:0/2056414283 conn(0x7f09ec0b3ce0 msgr2=0x7f09ec0b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.600+0000 7f09f4400640 1 -- 172.21.15.44:0/2056414283 shutdown_connections 2024-03-30T13:13:07.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.600+0000 7f09f4400640 1 -- 172.21.15.44:0/2056414283 wait complete. 2024-03-30T13:13:07.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.602+0000 7f09f4400640 1 Processor -- start 2024-03-30T13:13:07.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.602+0000 7f09f4400640 1 -- start start 2024-03-30T13:13:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f4400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09ec0b4800 0x7f09ec1f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f4400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09ec15e7c0 0x7f09ec157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f4400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09ec15eba0 0x7f09ec0cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f4400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec0cde60 con 0x7f09ec0b4800 2024-03-30T13:13:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f4400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f09ec0cdce0 con 0x7f09ec15eba0 2024-03-30T13:13:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f4400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f09ec0cdfe0 con 0x7f09ec15e7c0 2024-03-30T13:13:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f1a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09ec0b4800 0x7f09ec1f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f1a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09ec0b4800 0x7f09ec1f4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56990/0 (socket says 172.21.15.44:56990) 2024-03-30T13:13:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f1a00640 1 -- 172.21.15.44:0/2923740142 learned_addr learned my addr 172.21.15.44:0/2923740142 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f1000640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09ec15e7c0 0x7f09ec157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f1a00640 1 -- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09ec15e7c0 msgr2=0x7f09ec157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f2400640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09ec15eba0 0x7f09ec0cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f1a00640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09ec15e7c0 0x7f09ec157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f1a00640 1 -- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09ec15eba0 msgr2=0x7f09ec0cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f1a00640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09ec15eba0 0x7f09ec0cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f1a00640 1 -- 172.21.15.44:0/2923740142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ec0aee60 con 0x7f09ec0b4800 2024-03-30T13:13:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.603+0000 7f09f1000640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09ec15e7c0 0x7f09ec157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.604+0000 7f09f1a00640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09ec0b4800 0x7f09ec1f4640 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f09dc000c00 tx=0x7f09dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.604+0000 7f09e9600640 1 -- 172.21.15.44:0/2923740142 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc03ac60 con 0x7f09ec0b4800 2024-03-30T13:13:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.604+0000 7f09e9600640 1 -- 172.21.15.44:0/2923740142 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09dc03ae20 con 0x7f09ec0b4800 2024-03-30T13:13:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.604+0000 7f09e9600640 1 -- 172.21.15.44:0/2923740142 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09dc044630 con 0x7f09ec0b4800 2024-03-30T13:13:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.604+0000 7f09f4400640 1 -- 172.21.15.44:0/2923740142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ec0af140 con 0x7f09ec0b4800 2024-03-30T13:13:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.604+0000 7f09f4400640 1 -- 172.21.15.44:0/2923740142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ec0af700 con 0x7f09ec0b4800 2024-03-30T13:13:07.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.605+0000 7f09f4400640 1 -- 172.21.15.44:0/2923740142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09ec075890 con 0x7f09ec0b4800 2024-03-30T13:13:07.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.606+0000 7f09e9600640 1 -- 172.21.15.44:0/2923740142 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f09dc038020 con 0x7f09ec0b4800 2024-03-30T13:13:07.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.607+0000 7f09e9600640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f09cc06c530 0x7f09cc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:07.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.608+0000 7f09e9600640 1 -- 172.21.15.44:0/2923740142 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f09dc0ad9d0 con 0x7f09ec0b4800 2024-03-30T13:13:07.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.608+0000 7f09f1000640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f09cc06c530 0x7f09cc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:07.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.609+0000 7f09f1000640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f09cc06c530 0x7f09cc06e9f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f09d8006fd0 tx=0x7f09d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:07.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.612+0000 7f09e9600640 1 -- 172.21.15.44:0/2923740142 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f09dc03f070 con 0x7f09ec0b4800 2024-03-30T13:13:07.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.816+0000 7f09f4400640 1 -- 172.21.15.44:0/2923740142 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f09ec06d0c0 con 0x7f09ec0b4800 2024-03-30T13:13:07.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.817+0000 7f09e9600640 1 -- 172.21.15.44:0/2923740142 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f09dc07bb30 con 0x7f09ec0b4800 2024-03-30T13:13:07.821 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:13:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.820+0000 7f09f4400640 1 -- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f09cc06c530 msgr2=0x7f09cc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.820+0000 7f09f4400640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f09cc06c530 0x7f09cc06e9f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f09d8006fd0 tx=0x7f09d8008040 comp rx=0 tx=0).stop 2024-03-30T13:13:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.820+0000 7f09f4400640 1 -- 172.21.15.44:0/2923740142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09ec0b4800 msgr2=0x7f09ec1f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.820+0000 7f09f4400640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09ec0b4800 0x7f09ec1f4640 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f09dc000c00 tx=0x7f09dc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.820+0000 7f09f4400640 1 -- 172.21.15.44:0/2923740142 shutdown_connections 2024-03-30T13:13:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.820+0000 7f09f4400640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f09cc06c530 0x7f09cc06e9f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.820+0000 7f09f4400640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09ec15eba0 0x7f09ec0cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.820+0000 7f09f4400640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09ec15e7c0 0x7f09ec157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.820+0000 7f09f4400640 1 --2- 172.21.15.44:0/2923740142 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f09ec0b4800 0x7f09ec1f4640 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:07.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.820+0000 7f09f4400640 1 -- 172.21.15.44:0/2923740142 >> 172.21.15.44:0/2923740142 conn(0x7f09ec0b3ce0 msgr2=0x7f09ec06c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:07.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.820+0000 7f09f4400640 1 -- 172.21.15.44:0/2923740142 shutdown_connections 2024-03-30T13:13:07.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:07.820+0000 7f09f4400640 1 -- 172.21.15.44:0/2923740142 wait complete. 2024-03-30T13:13:07.844 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:13:08.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.065+0000 7fef35600640 1 Processor -- start 2024-03-30T13:13:08.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.065+0000 7fef35600640 1 -- start start 2024-03-30T13:13:08.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.067+0000 7fef35600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fef300d12c0 0x7fef300d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:08.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.067+0000 7fef35600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fef3006ce70 0x7fef3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:08.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.067+0000 7fef35600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef30068070 con 0x7fef3015e6c0 2024-03-30T13:13:08.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.067+0000 7fef35600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fef300ccd30 con 0x7fef3006ce70 2024-03-30T13:13:08.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.067+0000 7fef35600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fef3015eaa0 con 0x7fef300d12c0 2024-03-30T13:13:08.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.067+0000 7fef34c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fef3006ce70 0x7fef3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:08.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.067+0000 7fef34c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fef3006ce70 0x7fef3006d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56998/0 (socket says 172.21.15.44:56998) 2024-03-30T13:13:08.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.067+0000 7fef34c00640 1 -- 172.21.15.44:0/1818871956 learned_addr learned my addr 172.21.15.44:0/1818871956 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:08.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.067+0000 7fef2f400640 1 --2- 172.21.15.44:0/1818871956 >> v2:172.21.15.151:3300/0 conn(0x7fef300d12c0 0x7fef300d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:08.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.068+0000 7fef34c00640 1 -- 172.21.15.44:0/1818871956 >> v2:172.21.15.151:3300/0 conn(0x7fef300d12c0 msgr2=0x7fef300d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:08.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.068+0000 7fef34c00640 1 --2- 172.21.15.44:0/1818871956 >> v2:172.21.15.151:3300/0 conn(0x7fef300d12c0 0x7fef300d16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.068+0000 7fef34c00640 1 -- 172.21.15.44:0/1818871956 >> v1:172.21.15.151:6789/0 conn(0x7fef3015e6c0 legacy=0x7fef300cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:08.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.068+0000 7fef34c00640 1 -- 172.21.15.44:0/1818871956 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3006c9c0 con 0x7fef3006ce70 2024-03-30T13:13:08.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.069+0000 7fef34c00640 1 --2- 172.21.15.44:0/1818871956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef3006ce70 0x7fef3006d300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fef30072000 tx=0x7fef2802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f830b29aad3989 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:08.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.069+0000 7fef2ea00640 1 -- 172.21.15.44:0/1818871956 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2802f850 con 0x7fef3006ce70 2024-03-30T13:13:08.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.070+0000 7fef2ea00640 1 -- 172.21.15.44:0/1818871956 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2802f9f0 con 0x7fef3006ce70 2024-03-30T13:13:08.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.070+0000 7fef2ea00640 1 -- 172.21.15.44:0/1818871956 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2802fdc0 con 0x7fef3006ce70 2024-03-30T13:13:08.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.070+0000 7fef35600640 1 -- 172.21.15.44:0/1818871956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef3006ce70 msgr2=0x7fef3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:08.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.070+0000 7fef35600640 1 --2- 172.21.15.44:0/1818871956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef3006ce70 0x7fef3006d300 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fef30072000 tx=0x7fef2802ba30 comp rx=0 tx=0).stop 2024-03-30T13:13:08.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.070+0000 7fef35600640 1 -- 172.21.15.44:0/1818871956 shutdown_connections 2024-03-30T13:13:08.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.070+0000 7fef35600640 1 --2- 172.21.15.44:0/1818871956 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef3006ce70 0x7fef3006d300 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.070+0000 7fef35600640 1 --2- 172.21.15.44:0/1818871956 >> v2:172.21.15.151:3300/0 conn(0x7fef300d12c0 0x7fef300d16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.070+0000 7fef35600640 1 -- 172.21.15.44:0/1818871956 >> 172.21.15.44:0/1818871956 conn(0x7fef300cea50 msgr2=0x7fef300cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.071+0000 7fef35600640 1 -- 172.21.15.44:0/1818871956 shutdown_connections 2024-03-30T13:13:08.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.071+0000 7fef35600640 1 -- 172.21.15.44:0/1818871956 wait complete. 2024-03-30T13:13:08.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.072+0000 7fef35600640 1 Processor -- start 2024-03-30T13:13:08.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.073+0000 7fef35600640 1 -- start start 2024-03-30T13:13:08.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.073+0000 7fef35600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef3006ce70 0x7fef300ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:08.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef35600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef300d12c0 0x7fef301503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:08.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef35600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef3015e6c0 0x7fef300c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:08.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef35600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fef300d2d40 con 0x7fef3006ce70 2024-03-30T13:13:08.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef35600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fef300d1c20 con 0x7fef300d12c0 2024-03-30T13:13:08.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef35600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fef3006dbf0 con 0x7fef3015e6c0 2024-03-30T13:13:08.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef2fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef3006ce70 0x7fef300ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:08.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef2fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef3006ce70 0x7fef300ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57000/0 (socket says 172.21.15.44:57000) 2024-03-30T13:13:08.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef2fe00640 1 -- 172.21.15.44:0/1742164085 learned_addr learned my addr 172.21.15.44:0/1742164085 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef2f400640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef300d12c0 0x7fef301503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef34c00640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef3015e6c0 0x7fef300c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef2fe00640 1 -- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef3015e6c0 msgr2=0x7fef300c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef2fe00640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef3015e6c0 0x7fef300c76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef2fe00640 1 -- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef300d12c0 msgr2=0x7fef301503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef2fe00640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef300d12c0 0x7fef301503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.074+0000 7fef2fe00640 1 -- 172.21.15.44:0/1742164085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef300c9480 con 0x7fef3006ce70 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.075+0000 7fef2fe00640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef3006ce70 0x7fef300ca520 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fef2000c730 tx=0x7fef2000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.075+0000 7fef27e00640 1 -- 172.21.15.44:0/1742164085 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20016020 con 0x7fef3006ce70 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.075+0000 7fef27e00640 1 -- 172.21.15.44:0/1742164085 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef20006d50 con 0x7fef3006ce70 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.075+0000 7fef27e00640 1 -- 172.21.15.44:0/1742164085 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20003bb0 con 0x7fef3006ce70 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.075+0000 7fef35600640 1 -- 172.21.15.44:0/1742164085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef300c9760 con 0x7fef3006ce70 2024-03-30T13:13:08.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.075+0000 7fef35600640 1 -- 172.21.15.44:0/1742164085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef300c9d20 con 0x7fef3006ce70 2024-03-30T13:13:08.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.076+0000 7fef35600640 1 -- 172.21.15.44:0/1742164085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef30075890 con 0x7fef3006ce70 2024-03-30T13:13:08.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.077+0000 7fef27e00640 1 -- 172.21.15.44:0/1742164085 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fef2000a850 con 0x7fef3006ce70 2024-03-30T13:13:08.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.078+0000 7fef27e00640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fef0c06c530 0x7fef0c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:08.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.078+0000 7fef27e00640 1 -- 172.21.15.44:0/1742164085 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fef2008b7e0 con 0x7fef3006ce70 2024-03-30T13:13:08.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.079+0000 7fef2f400640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fef0c06c530 0x7fef0c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:08.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.080+0000 7fef2f400640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fef0c06c530 0x7fef0c06e9f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef300c5a60 tx=0x7fef18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:08.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.082+0000 7fef27e00640 1 -- 172.21.15.44:0/1742164085 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fef20020020 con 0x7fef3006ce70 2024-03-30T13:13:08.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.283+0000 7fef35600640 1 -- 172.21.15.44:0/1742164085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fef300b7f50 con 0x7fef3006ce70 2024-03-30T13:13:08.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.285+0000 7fef27e00640 1 -- 172.21.15.44:0/1742164085 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fef30068070 con 0x7fef3006ce70 2024-03-30T13:13:08.288 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:13:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.288+0000 7fef35600640 1 -- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fef0c06c530 msgr2=0x7fef0c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.288+0000 7fef35600640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fef0c06c530 0x7fef0c06e9f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef300c5a60 tx=0x7fef18008040 comp rx=0 tx=0).stop 2024-03-30T13:13:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.288+0000 7fef35600640 1 -- 172.21.15.44:0/1742164085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef3006ce70 msgr2=0x7fef300ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.288+0000 7fef35600640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef3006ce70 0x7fef300ca520 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fef2000c730 tx=0x7fef2000cbf0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.288+0000 7fef35600640 1 -- 172.21.15.44:0/1742164085 shutdown_connections 2024-03-30T13:13:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.288+0000 7fef35600640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef3015e6c0 0x7fef300c76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.288+0000 7fef35600640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fef0c06c530 0x7fef0c06e9f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.288+0000 7fef35600640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef300d12c0 0x7fef301503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.288+0000 7fef35600640 1 --2- 172.21.15.44:0/1742164085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef3006ce70 0x7fef300ca520 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.288+0000 7fef35600640 1 -- 172.21.15.44:0/1742164085 >> 172.21.15.44:0/1742164085 conn(0x7fef300cea50 msgr2=0x7fef300cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:08.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.288+0000 7fef35600640 1 -- 172.21.15.44:0/1742164085 shutdown_connections 2024-03-30T13:13:08.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.288+0000 7fef35600640 1 -- 172.21.15.44:0/1742164085 wait complete. 2024-03-30T13:13:08.312 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-30T13:13:08.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.528+0000 7f7ad4a00640 1 Processor -- start 2024-03-30T13:13:08.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.528+0000 7f7ad4a00640 1 -- start start 2024-03-30T13:13:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.530+0000 7f7ad4a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7ad015e6c0 0x7f7ad00cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.530+0000 7f7ad4a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ad006ce70 0x7f7ad006d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.530+0000 7f7ad4a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad0068070 con 0x7f7ad00d12c0 2024-03-30T13:13:08.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.530+0000 7f7ad4a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad015eaa0 con 0x7f7ad015e6c0 2024-03-30T13:13:08.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.530+0000 7f7ad4a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad006c9c0 con 0x7f7ad006ce70 2024-03-30T13:13:08.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.530+0000 7f7ace800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7ad015e6c0 0x7f7ad00cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:08.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.530+0000 7f7ace800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7ad015e6c0 0x7f7ad00cc620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:40668/0 (socket says 172.21.15.44:40668) 2024-03-30T13:13:08.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.530+0000 7f7ace800640 1 -- 172.21.15.44:0/3399846004 learned_addr learned my addr 172.21.15.44:0/3399846004 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.530+0000 7f7acde00640 1 --1- 172.21.15.44:0/3399846004 >> v1:172.21.15.151:6789/0 conn(0x7f7ad00d12c0 0x7f7ad00d16e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:46610/0 (socket says 172.21.15.44:46610) 2024-03-30T13:13:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.530+0000 7f7acf200640 1 --2- 172.21.15.44:0/3399846004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ad006ce70 0x7f7ad006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.531+0000 7f7ace800640 1 -- 172.21.15.44:0/3399846004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ad006ce70 msgr2=0x7f7ad006d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.531+0000 7f7ace800640 1 --2- 172.21.15.44:0/3399846004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ad006ce70 0x7f7ad006d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.531+0000 7f7ace800640 1 -- 172.21.15.44:0/3399846004 >> v1:172.21.15.151:6789/0 conn(0x7f7ad00d12c0 legacy=0x7f7ad00d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:08.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.531+0000 7f7ace800640 1 -- 172.21.15.44:0/3399846004 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad00cf710 con 0x7f7ad015e6c0 2024-03-30T13:13:08.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.532+0000 7f7ace800640 1 --2- 172.21.15.44:0/3399846004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad015e6c0 0x7f7ad00cc620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0009e50 tx=0x7f7ac002bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65f1992c19397b88 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:08.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.533+0000 7f7acd400640 1 -- 172.21.15.44:0/3399846004 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac002cb90 con 0x7f7ad015e6c0 2024-03-30T13:13:08.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.533+0000 7f7acd400640 1 -- 172.21.15.44:0/3399846004 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac002cd30 con 0x7f7ad015e6c0 2024-03-30T13:13:08.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.533+0000 7f7acd400640 1 -- 172.21.15.44:0/3399846004 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0034610 con 0x7f7ad015e6c0 2024-03-30T13:13:08.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.533+0000 7f7ad4a00640 1 -- 172.21.15.44:0/3399846004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad015e6c0 msgr2=0x7f7ad00cc620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:08.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.533+0000 7f7ad4a00640 1 --2- 172.21.15.44:0/3399846004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad015e6c0 0x7f7ad00cc620 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0009e50 tx=0x7f7ac002bff0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.534+0000 7f7ad4a00640 1 -- 172.21.15.44:0/3399846004 shutdown_connections 2024-03-30T13:13:08.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.534+0000 7f7ad4a00640 1 --2- 172.21.15.44:0/3399846004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ad006ce70 0x7f7ad006d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.534+0000 7f7ad4a00640 1 --2- 172.21.15.44:0/3399846004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad015e6c0 0x7f7ad00cc620 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.534+0000 7f7ad4a00640 1 -- 172.21.15.44:0/3399846004 >> 172.21.15.44:0/3399846004 conn(0x7f7ad00cea50 msgr2=0x7f7ad00cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:08.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.534+0000 7f7ad4a00640 1 -- 172.21.15.44:0/3399846004 shutdown_connections 2024-03-30T13:13:08.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.534+0000 7f7ad4a00640 1 -- 172.21.15.44:0/3399846004 wait complete. 2024-03-30T13:13:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.535+0000 7f7ad4a00640 1 Processor -- start 2024-03-30T13:13:08.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.536+0000 7f7ad4a00640 1 -- start start 2024-03-30T13:13:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.537+0000 7f7ad4a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad006ce70 0x7f7ad00b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.537+0000 7f7ad4a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ad00d12c0 0x7f7ad01f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.537+0000 7f7ad4a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ad015e6c0 0x7f7ad0159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.537+0000 7f7ad4a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad006d840 con 0x7f7ad015e6c0 2024-03-30T13:13:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.537+0000 7f7ad4a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad006dbf0 con 0x7f7ad006ce70 2024-03-30T13:13:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.537+0000 7f7ad4a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad00b0330 con 0x7f7ad00d12c0 2024-03-30T13:13:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.537+0000 7f7acf200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ad015e6c0 0x7f7ad0159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.537+0000 7f7ace800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad006ce70 0x7f7ad00b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.537+0000 7f7acf200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ad015e6c0 0x7f7ad0159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57016/0 (socket says 172.21.15.44:57016) 2024-03-30T13:13:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.537+0000 7f7acf200640 1 -- 172.21.15.44:0/378453357 learned_addr learned my addr 172.21.15.44:0/378453357 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:08.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.537+0000 7f7acde00640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ad00d12c0 0x7f7ad01f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:08.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.538+0000 7f7acf200640 1 -- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ad00d12c0 msgr2=0x7f7ad01f82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:08.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.538+0000 7f7acf200640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ad00d12c0 0x7f7ad01f82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.538+0000 7f7acf200640 1 -- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad006ce70 msgr2=0x7f7ad00b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:08.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.538+0000 7f7acf200640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad006ce70 0x7f7ad00b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.538+0000 7f7acf200640 1 -- 172.21.15.44:0/378453357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad015ed20 con 0x7f7ad015e6c0 2024-03-30T13:13:08.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.538+0000 7f7acf200640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ad015e6c0 0x7f7ad0159cf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800e960 tx=0x7f7ac800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:08.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.539+0000 7f7ac6a00640 1 -- 172.21.15.44:0/378453357 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8017070 con 0x7f7ad015e6c0 2024-03-30T13:13:08.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.539+0000 7f7ac6a00640 1 -- 172.21.15.44:0/378453357 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac800c980 con 0x7f7ad015e6c0 2024-03-30T13:13:08.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.539+0000 7f7ad4a00640 1 -- 172.21.15.44:0/378453357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad01f8800 con 0x7f7ad015e6c0 2024-03-30T13:13:08.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.539+0000 7f7ac6a00640 1 -- 172.21.15.44:0/378453357 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac800cd70 con 0x7f7ad015e6c0 2024-03-30T13:13:08.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.539+0000 7f7ad4a00640 1 -- 172.21.15.44:0/378453357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad015f2c0 con 0x7f7ad015e6c0 2024-03-30T13:13:08.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.540+0000 7f7ad4a00640 1 -- 172.21.15.44:0/378453357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad0075890 con 0x7f7ad015e6c0 2024-03-30T13:13:08.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.542+0000 7f7ac6a00640 1 -- 172.21.15.44:0/378453357 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7ac801a070 con 0x7f7ad015e6c0 2024-03-30T13:13:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.542+0000 7f7ac6a00640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7aac06c530 0x7f7aac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.543+0000 7f7ac6a00640 1 -- 172.21.15.44:0/378453357 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f7ac808bad0 con 0x7f7ad015e6c0 2024-03-30T13:13:08.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.543+0000 7f7ace800640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7aac06c530 0x7f7aac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:08.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.544+0000 7f7ace800640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7aac06c530 0x7f7aac06e9f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0035000 tx=0x7f7ac0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:08.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.548+0000 7f7ac6a00640 1 -- 172.21.15.44:0/378453357 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7ad01f8800 con 0x7f7ad015e6c0 2024-03-30T13:13:08.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.751+0000 7f7ad4a00640 1 -- 172.21.15.44:0/378453357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7ad00b0080 con 0x7f7ad015e6c0 2024-03-30T13:13:08.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.752+0000 7f7ac6a00640 1 -- 172.21.15.44:0/378453357 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f7ac80595e0 con 0x7f7ad015e6c0 2024-03-30T13:13:08.756 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:13:08.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.755+0000 7f7ad4a00640 1 -- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7aac06c530 msgr2=0x7f7aac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:08.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.755+0000 7f7ad4a00640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7aac06c530 0x7f7aac06e9f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0035000 tx=0x7f7ac0030000 comp rx=0 tx=0).stop 2024-03-30T13:13:08.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.755+0000 7f7ad4a00640 1 -- 172.21.15.44:0/378453357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ad015e6c0 msgr2=0x7f7ad0159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:08.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.755+0000 7f7ad4a00640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ad015e6c0 0x7f7ad0159cf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800e960 tx=0x7f7ac800ee20 comp rx=0 tx=0).stop 2024-03-30T13:13:08.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.755+0000 7f7ad4a00640 1 -- 172.21.15.44:0/378453357 shutdown_connections 2024-03-30T13:13:08.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.755+0000 7f7ad4a00640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ad015e6c0 0x7f7ad0159cf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.755+0000 7f7ad4a00640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ad00d12c0 0x7f7ad01f82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.755+0000 7f7ad4a00640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7aac06c530 0x7f7aac06e9f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.755+0000 7f7ad4a00640 1 --2- 172.21.15.44:0/378453357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad006ce70 0x7f7ad00b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:08.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.755+0000 7f7ad4a00640 1 -- 172.21.15.44:0/378453357 >> 172.21.15.44:0/378453357 conn(0x7f7ad00cea50 msgr2=0x7f7ad006fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:08.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.755+0000 7f7ad4a00640 1 -- 172.21.15.44:0/378453357 shutdown_connections 2024-03-30T13:13:08.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.755+0000 7f7ad4a00640 1 -- 172.21.15.44:0/378453357 wait complete. 2024-03-30T13:13:08.780 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:13:08.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.996+0000 7fafd5800640 1 Processor -- start 2024-03-30T13:13:09.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.996+0000 7fafd5800640 1 -- start start 2024-03-30T13:13:09.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.997+0000 7fafd5800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafd015f7e0 0x7fafd00cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.997+0000 7fafd5800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fafd00ccf10 0x7fafd00ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.997+0000 7fafd5800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd015b650 con 0x7fafd015b270 2024-03-30T13:13:09.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.997+0000 7fafd5800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fafd015fc40 con 0x7fafd00ccf10 2024-03-30T13:13:09.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.997+0000 7fafd5800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fafd0072ab0 con 0x7fafd015f7e0 2024-03-30T13:13:09.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.998+0000 7fafcea00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fafd015b270 0x7fafd0072280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43052/0 (socket says 172.21.15.44:43052) 2024-03-30T13:13:09.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.998+0000 7fafcea00640 1 -- 172.21.15.44:0/3676305895 learned_addr learned my addr 172.21.15.44:0/3676305895 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:09.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.998+0000 7fafcf400640 1 --2- 172.21.15.44:0/3676305895 >> v2:172.21.15.44:3300/0 conn(0x7fafd00ccf10 0x7fafd00ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.998+0000 7fafcf400640 1 -- 172.21.15.44:0/3676305895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafd015f7e0 msgr2=0x7fafd00cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:09.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.998+0000 7fafcf400640 1 --2- 172.21.15.44:0/3676305895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafd015f7e0 0x7fafd00cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.998+0000 7fafcf400640 1 -- 172.21.15.44:0/3676305895 >> v1:172.21.15.44:6789/0 conn(0x7fafd015b270 legacy=0x7fafd0072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.998+0000 7fafcf400640 1 -- 172.21.15.44:0/3676305895 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd0072d90 con 0x7fafd00ccf10 2024-03-30T13:13:09.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:08.999+0000 7fafcf400640 1 --2- 172.21.15.44:0/3676305895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd00ccf10 0x7fafd00ca9d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009d90 tx=0x7fafc802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e82d0bda2a3ad00 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:09.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.000+0000 7fafce000640 1 -- 172.21.15.44:0/3676305895 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc8039070 con 0x7fafd00ccf10 2024-03-30T13:13:09.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.000+0000 7fafce000640 1 -- 172.21.15.44:0/3676305895 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc802cc60 con 0x7fafd00ccf10 2024-03-30T13:13:09.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.000+0000 7fafce000640 1 -- 172.21.15.44:0/3676305895 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc8034660 con 0x7fafd00ccf10 2024-03-30T13:13:09.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.000+0000 7fafd5800640 1 -- 172.21.15.44:0/3676305895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd00ccf10 msgr2=0x7fafd00ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.000+0000 7fafd5800640 1 --2- 172.21.15.44:0/3676305895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd00ccf10 0x7fafd00ca9d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fafc8009d90 tx=0x7fafc802beb0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.001+0000 7fafd5800640 1 -- 172.21.15.44:0/3676305895 shutdown_connections 2024-03-30T13:13:09.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.001+0000 7fafd5800640 1 --2- 172.21.15.44:0/3676305895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd00ccf10 0x7fafd00ca9d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.001+0000 7fafd5800640 1 --2- 172.21.15.44:0/3676305895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafd015f7e0 0x7fafd00cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.001+0000 7fafd5800640 1 -- 172.21.15.44:0/3676305895 >> 172.21.15.44:0/3676305895 conn(0x7fafd00b1c90 msgr2=0x7fafd00b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:09.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.001+0000 7fafd5800640 1 -- 172.21.15.44:0/3676305895 shutdown_connections 2024-03-30T13:13:09.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.001+0000 7fafd5800640 1 -- 172.21.15.44:0/3676305895 wait complete. 2024-03-30T13:13:09.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.002+0000 7fafd5800640 1 Processor -- start 2024-03-30T13:13:09.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.003+0000 7fafd5800640 1 -- start start 2024-03-30T13:13:09.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafd5800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd00ccf10 0x7fafd0146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafd5800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafd015b270 0x7fafd0159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafd5800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafd015f7e0 0x7fafd01f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafd5800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0073630 con 0x7fafd00ccf10 2024-03-30T13:13:09.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafd5800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0073350 con 0x7fafd015f7e0 2024-03-30T13:13:09.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafd5800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fafd00caf10 con 0x7fafd015b270 2024-03-30T13:13:09.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafcea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd00ccf10 0x7fafd0146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafcea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd00ccf10 0x7fafd0146c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57036/0 (socket says 172.21.15.44:57036) 2024-03-30T13:13:09.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafcea00640 1 -- 172.21.15.44:0/2602129839 learned_addr learned my addr 172.21.15.44:0/2602129839 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafcf400640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafd015f7e0 0x7fafd01f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafcea00640 1 -- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafd015b270 msgr2=0x7fafd0159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafcea00640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafd015b270 0x7fafd0159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafcea00640 1 -- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafd015f7e0 msgr2=0x7fafd01f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafcea00640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafd015f7e0 0x7fafd01f7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.004+0000 7fafcea00640 1 -- 172.21.15.44:0/2602129839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd01f83f0 con 0x7fafd00ccf10 2024-03-30T13:13:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.005+0000 7fafcea00640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd00ccf10 0x7fafd0146c70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fafc000c400 tx=0x7fafc000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.005+0000 7fafc7400640 1 -- 172.21.15.44:0/2602129839 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0017070 con 0x7fafd00ccf10 2024-03-30T13:13:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.005+0000 7fafc7400640 1 -- 172.21.15.44:0/2602129839 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc0005ce0 con 0x7fafd00ccf10 2024-03-30T13:13:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.005+0000 7fafc7400640 1 -- 172.21.15.44:0/2602129839 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc00072f0 con 0x7fafd00ccf10 2024-03-30T13:13:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.005+0000 7fafd5800640 1 -- 172.21.15.44:0/2602129839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd01f86d0 con 0x7fafd00ccf10 2024-03-30T13:13:09.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.005+0000 7fafd5800640 1 -- 172.21.15.44:0/2602129839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd01471b0 con 0x7fafd00ccf10 2024-03-30T13:13:09.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.007+0000 7fafd5800640 1 -- 172.21.15.44:0/2602129839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd015ecf0 con 0x7fafd00ccf10 2024-03-30T13:13:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.007+0000 7fafc7400640 1 -- 172.21.15.44:0/2602129839 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fafc001a070 con 0x7fafd00ccf10 2024-03-30T13:13:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.008+0000 7fafc7400640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fafac06c530 0x7fafac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.008+0000 7fafc7400640 1 -- 172.21.15.44:0/2602129839 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fafc008afb0 con 0x7fafd00ccf10 2024-03-30T13:13:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.009+0000 7fafc6000640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fafac06c530 0x7fafac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.010+0000 7fafc6000640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fafac06c530 0x7fafac06e9f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fafd00afa80 tx=0x7fafb8006bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:09.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.013+0000 7fafc7400640 1 -- 172.21.15.44:0/2602129839 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fafd015ecf0 con 0x7fafd00ccf10 2024-03-30T13:13:09.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.262+0000 7fafd5800640 1 -- 172.21.15.44:0/2602129839 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafd01595d0 con 0x7fafd00ccf10 2024-03-30T13:13:09.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.263+0000 7fafc7400640 1 -- 172.21.15.44:0/2602129839 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7fafc0059110 con 0x7fafd00ccf10 2024-03-30T13:13:09.267 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:09.267 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1458748329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1458748329},{"type":"v1","addr":"172.21.15.44:6834","nonce":1458748329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3921281718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3921281718},{"type":"v1","addr":"172.21.15.151:6837","nonce":3921281718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2065829800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2065829800},{"type":"v1","addr":"172.21.15.44:6835","nonce":2065829800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:11:40.531273+0000","modified":"2024-03-30T13:12:07.711287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/456394190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":456394190},{"type":"v1","addr":"172.21.15.151:6835","nonce":456394190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276]},"id":1}]} 2024-03-30T13:13:09.267 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-03-30T13:13:09.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.266+0000 7fafd5800640 1 -- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fafac06c530 msgr2=0x7fafac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.266+0000 7fafd5800640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fafac06c530 0x7fafac06e9f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fafd00afa80 tx=0x7fafb8006bf0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.266+0000 7fafd5800640 1 -- 172.21.15.44:0/2602129839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd00ccf10 msgr2=0x7fafd0146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.266+0000 7fafd5800640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd00ccf10 0x7fafd0146c70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fafc000c400 tx=0x7fafc000c8c0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.266+0000 7fafd5800640 1 -- 172.21.15.44:0/2602129839 shutdown_connections 2024-03-30T13:13:09.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.266+0000 7fafd5800640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fafac06c530 0x7fafac06e9f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.266+0000 7fafd5800640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafd015f7e0 0x7fafd01f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.266+0000 7fafd5800640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafd015b270 0x7fafd0159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.266+0000 7fafd5800640 1 --2- 172.21.15.44:0/2602129839 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fafd00ccf10 0x7fafd0146c70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.266+0000 7fafd5800640 1 -- 172.21.15.44:0/2602129839 >> 172.21.15.44:0/2602129839 conn(0x7fafd00b1c90 msgr2=0x7fafd00715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:09.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.266+0000 7fafd5800640 1 -- 172.21.15.44:0/2602129839 shutdown_connections 2024-03-30T13:13:09.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.266+0000 7fafd5800640 1 -- 172.21.15.44:0/2602129839 wait complete. 2024-03-30T13:13:09.289 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:13:09.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.501+0000 7f1295200640 1 Processor -- start 2024-03-30T13:13:09.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.501+0000 7f1295200640 1 -- start start 2024-03-30T13:13:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.502+0000 7f1295200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f12900cd0e0 0x7f12901660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.502+0000 7f1295200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129015b650 con 0x7f129015f7e0 2024-03-30T13:13:09.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.502+0000 7f1295200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1290072ab0 con 0x7f129015b270 2024-03-30T13:13:09.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.502+0000 7f1295200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f129015fc40 con 0x7f12900cd0e0 2024-03-30T13:13:09.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.503+0000 7f128d400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f129015f7e0 0x7f12900cc9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43058/0 (socket says 172.21.15.44:43058) 2024-03-30T13:13:09.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.503+0000 7f128d400640 1 -- 172.21.15.44:0/1389607318 learned_addr learned my addr 172.21.15.44:0/1389607318 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:09.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.503+0000 7f128e800640 1 --2- 172.21.15.44:0/1389607318 >> v2:172.21.15.151:3300/0 conn(0x7f12900cd0e0 0x7f12901660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3272833906 0 0) 0x7f129015b650 con 0x7f129015f7e0 2024-03-30T13:13:09.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1274005730 con 0x7f129015f7e0 2024-03-30T13:13:09.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3072903168 0 0) 0x7f1290072ab0 con 0x7f129015b270 2024-03-30T13:13:09.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f129015b650 con 0x7f129015b270 2024-03-30T13:13:09.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 492621878 0 0) 0x7f1274005730 con 0x7f129015f7e0 2024-03-30T13:13:09.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 >> v2:172.21.15.151:3300/0 conn(0x7f12900cd0e0 msgr2=0x7f12901660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 --2- 172.21.15.44:0/1389607318 >> v2:172.21.15.151:3300/0 conn(0x7f12900cd0e0 0x7f12901660d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 >> v1:172.21.15.151:6789/0 conn(0x7f129015b270 legacy=0x7f1290072280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1290072d90 con 0x7f129015f7e0 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f1278001670 con 0x7f129015f7e0 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 >> v1:172.21.15.44:6789/0 conn(0x7f129015f7e0 legacy=0x7f12900cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 --2- 172.21.15.44:0/1389607318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1274005da0 0x7f12740061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 --2- 172.21.15.44:0/1389607318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1274006a10 0x7f1274006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 --2- 172.21.15.44:0/1389607318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12740073d0 0x7f127400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f129015fc40 con 0x7f1274005da0 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f127400e2a0 con 0x7f1274006a10 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f127400e4a0 con 0x7f12740073d0 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.504+0000 7f128de00640 1 --2- 172.21.15.44:0/1389607318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1274005da0 0x7f12740061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.505+0000 7f128e800640 1 --2- 172.21.15.44:0/1389607318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12740073d0 0x7f127400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.505+0000 7f128d400640 1 --2- 172.21.15.44:0/1389607318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1274006a10 0x7f1274006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.505+0000 7f128de00640 1 -- 172.21.15.44:0/1389607318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12740073d0 msgr2=0x7f127400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.505+0000 7f128de00640 1 --2- 172.21.15.44:0/1389607318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f12740073d0 0x7f127400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.505+0000 7f128de00640 1 -- 172.21.15.44:0/1389607318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1274006a10 msgr2=0x7f1274006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.505+0000 7f128de00640 1 --2- 172.21.15.44:0/1389607318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1274006a10 0x7f1274006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.505+0000 7f128de00640 1 -- 172.21.15.44:0/1389607318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1274005730 con 0x7f1274005da0 2024-03-30T13:13:09.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.505+0000 7f128e800640 1 -- 172.21.15.44:0/1389607318 reap_dead start 2024-03-30T13:13:09.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.506+0000 7f128de00640 1 --2- 172.21.15.44:0/1389607318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1274005da0 0x7f12740061a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f12800018d0 tx=0x7f1274007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5cc3ee4b173161 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:09.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.506+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12800014f0 con 0x7f1274005da0 2024-03-30T13:13:09.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.506+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f128002f050 con 0x7f1274005da0 2024-03-30T13:13:09.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.506+0000 7f128ca00640 1 -- 172.21.15.44:0/1389607318 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12800035f0 con 0x7f1274005da0 2024-03-30T13:13:09.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.507+0000 7f1295200640 1 -- 172.21.15.44:0/1389607318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1274005da0 msgr2=0x7f12740061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.507+0000 7f1295200640 1 --2- 172.21.15.44:0/1389607318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1274005da0 0x7f12740061a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f12800018d0 tx=0x7f1274007a40 comp rx=0 tx=0).stop 2024-03-30T13:13:09.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.507+0000 7f1295200640 1 -- 172.21.15.44:0/1389607318 shutdown_connections 2024-03-30T13:13:09.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.507+0000 7f1295200640 1 --2- 172.21.15.44:0/1389607318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1274005da0 0x7f12740061a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.507+0000 7f1295200640 1 -- 172.21.15.44:0/1389607318 >> 172.21.15.44:0/1389607318 conn(0x7f12900b1c90 msgr2=0x7f12900b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:09.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.507+0000 7f1295200640 1 -- 172.21.15.44:0/1389607318 shutdown_connections 2024-03-30T13:13:09.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.507+0000 7f1295200640 1 -- 172.21.15.44:0/1389607318 wait complete. 2024-03-30T13:13:09.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.509+0000 7f1295200640 1 Processor -- start 2024-03-30T13:13:09.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.509+0000 7f1295200640 1 -- start start 2024-03-30T13:13:09.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.510+0000 7f1295200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1274005da0 0x7f129014bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.510+0000 7f1295200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12900b2bd0 0x7f12900b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.510+0000 7f1295200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1290159850 0x7f1290159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.510+0000 7f1295200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1290073630 con 0x7f12900b2bd0 2024-03-30T13:13:09.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.510+0000 7f1295200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1290073350 con 0x7f1274005da0 2024-03-30T13:13:09.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.510+0000 7f1295200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1290072280 con 0x7f1290159850 2024-03-30T13:13:09.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.510+0000 7f128d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12900b2bd0 0x7f12900b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.510+0000 7f128d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12900b2bd0 0x7f12900b4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57052/0 (socket says 172.21.15.44:57052) 2024-03-30T13:13:09.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.510+0000 7f128d400640 1 -- 172.21.15.44:0/3143785892 learned_addr learned my addr 172.21.15.44:0/3143785892 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.510+0000 7f128de00640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1274005da0 0x7f129014bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.511+0000 7f128e800640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1290159850 0x7f1290159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.511+0000 7f128d400640 1 -- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1290159850 msgr2=0x7f1290159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.511+0000 7f128d400640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1290159850 0x7f1290159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.511+0000 7f128d400640 1 -- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1274005da0 msgr2=0x7f129014bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.511+0000 7f128d400640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1274005da0 0x7f129014bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.511+0000 7f128d400640 1 -- 172.21.15.44:0/3143785892 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12900b4700 con 0x7f12900b2bd0 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.511+0000 7f128d400640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12900b2bd0 0x7f12900b4c60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f127800e730 tx=0x7f127800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.511+0000 7f1286000640 1 -- 172.21.15.44:0/3143785892 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127800c6c0 con 0x7f12900b2bd0 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.511+0000 7f1286000640 1 -- 172.21.15.44:0/3143785892 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1278018070 con 0x7f12900b2bd0 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.511+0000 7f1286000640 1 -- 172.21.15.44:0/3143785892 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127800caa0 con 0x7f12900b2bd0 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.511+0000 7f1295200640 1 -- 172.21.15.44:0/3143785892 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12900b3120 con 0x7f12900b2bd0 2024-03-30T13:13:09.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.511+0000 7f1295200640 1 -- 172.21.15.44:0/3143785892 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12900b36e0 con 0x7f12900b2bd0 2024-03-30T13:13:09.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.512+0000 7f1295200640 1 -- 172.21.15.44:0/3143785892 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1290071e60 con 0x7f12900b2bd0 2024-03-30T13:13:09.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.513+0000 7f1286000640 1 -- 172.21.15.44:0/3143785892 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f127800cc40 con 0x7f12900b2bd0 2024-03-30T13:13:09.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.514+0000 7f1286000640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f126c06c560 0x7f126c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.514+0000 7f1286000640 1 -- 172.21.15.44:0/3143785892 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f127808b7d0 con 0x7f12900b2bd0 2024-03-30T13:13:09.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.515+0000 7f128de00640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f126c06c560 0x7f126c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.516+0000 7f128de00640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f126c06c560 0x7f126c06ea20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1280034000 tx=0x7f1280031000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:09.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.519+0000 7f1286000640 1 -- 172.21.15.44:0/3143785892 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1290071e60 con 0x7f12900b2bd0 2024-03-30T13:13:09.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.720+0000 7f1295200640 1 -- 172.21.15.44:0/3143785892 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1290075a10 con 0x7f12900b2bd0 2024-03-30T13:13:09.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.722+0000 7f1286000640 1 -- 172.21.15.44:0/3143785892 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18927 (secure 0 0 0) 0x7f12780599c0 con 0x7f12900b2bd0 2024-03-30T13:13:09.726 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:09.726 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":29,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:12:27.323786+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:13:09.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.725+0000 7f1295200640 1 -- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f126c06c560 msgr2=0x7f126c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.725+0000 7f1295200640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f126c06c560 0x7f126c06ea20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1280034000 tx=0x7f1280031000 comp rx=0 tx=0).stop 2024-03-30T13:13:09.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.725+0000 7f1295200640 1 -- 172.21.15.44:0/3143785892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12900b2bd0 msgr2=0x7f12900b4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.725+0000 7f1295200640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12900b2bd0 0x7f12900b4c60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f127800e730 tx=0x7f127800ebf0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.725+0000 7f1295200640 1 -- 172.21.15.44:0/3143785892 shutdown_connections 2024-03-30T13:13:09.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.725+0000 7f1295200640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1290159850 0x7f1290159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.725+0000 7f1295200640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f12900b2bd0 0x7f12900b4c60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.725+0000 7f1295200640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f126c06c560 0x7f126c06ea20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.725+0000 7f1295200640 1 --2- 172.21.15.44:0/3143785892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1274005da0 0x7f129014bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.725+0000 7f1295200640 1 -- 172.21.15.44:0/3143785892 >> 172.21.15.44:0/3143785892 conn(0x7f12900b1c90 msgr2=0x7f12900b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:09.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.725+0000 7f1295200640 1 -- 172.21.15.44:0/3143785892 shutdown_connections 2024-03-30T13:13:09.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.725+0000 7f1295200640 1 -- 172.21.15.44:0/3143785892 wait complete. 2024-03-30T13:13:09.748 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T13:13:09.748 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:13:09.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.954+0000 7fda1ce00640 1 Processor -- start 2024-03-30T13:13:09.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.954+0000 7fda1ce00640 1 -- start start 2024-03-30T13:13:09.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.955+0000 7fda1ce00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fda1815e950 0x7fda180d4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.955+0000 7fda1ce00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fda180d48c0 0x7fda180d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.955+0000 7fda1ce00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda180d36f0 con 0x7fda180d2f00 2024-03-30T13:13:09.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.955+0000 7fda1ce00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fda180d3cb0 con 0x7fda180d48c0 2024-03-30T13:13:09.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.955+0000 7fda1ce00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fda180d4d00 con 0x7fda1815e950 2024-03-30T13:13:09.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.956+0000 7fda15400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fda180d48c0 0x7fda180d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.956+0000 7fda15400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fda180d48c0 0x7fda180d29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57066/0 (socket says 172.21.15.44:57066) 2024-03-30T13:13:09.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.956+0000 7fda15400640 1 -- 172.21.15.44:0/2614472392 learned_addr learned my addr 172.21.15.44:0/2614472392 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:09.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.956+0000 7fda15e00640 1 --2- 172.21.15.44:0/2614472392 >> v2:172.21.15.151:3300/0 conn(0x7fda1815e950 0x7fda180d4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.956+0000 7fda15400640 1 -- 172.21.15.44:0/2614472392 >> v2:172.21.15.151:3300/0 conn(0x7fda1815e950 msgr2=0x7fda180d4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:09.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.956+0000 7fda15400640 1 --2- 172.21.15.44:0/2614472392 >> v2:172.21.15.151:3300/0 conn(0x7fda1815e950 0x7fda180d4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.956+0000 7fda15400640 1 -- 172.21.15.44:0/2614472392 >> v1:172.21.15.44:6789/0 conn(0x7fda180d2f00 legacy=0x7fda180cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.956+0000 7fda15400640 1 -- 172.21.15.44:0/2614472392 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda180d39d0 con 0x7fda180d48c0 2024-03-30T13:13:09.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.956+0000 7fda14a00640 1 -- 172.21.15.44:0/2614472392 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502506444 0 0) 0x7fda180d36f0 con 0x7fda180d2f00 2024-03-30T13:13:09.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.958+0000 7fda15400640 1 --2- 172.21.15.44:0/2614472392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda180d48c0 0x7fda180d29c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fda180d3e30 tx=0x7fda0002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a13c5fa4841d1e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:09.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.958+0000 7fda14a00640 1 -- 172.21.15.44:0/2614472392 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0002f840 con 0x7fda180d48c0 2024-03-30T13:13:09.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.958+0000 7fda14a00640 1 -- 172.21.15.44:0/2614472392 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0002f9e0 con 0x7fda180d48c0 2024-03-30T13:13:09.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.958+0000 7fda14a00640 1 -- 172.21.15.44:0/2614472392 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0002fdb0 con 0x7fda180d48c0 2024-03-30T13:13:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.959+0000 7fda1ce00640 1 -- 172.21.15.44:0/2614472392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda180d48c0 msgr2=0x7fda180d29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.959+0000 7fda1ce00640 1 --2- 172.21.15.44:0/2614472392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda180d48c0 0x7fda180d29c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fda180d3e30 tx=0x7fda0002ba20 comp rx=0 tx=0).stop 2024-03-30T13:13:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.959+0000 7fda1ce00640 1 -- 172.21.15.44:0/2614472392 shutdown_connections 2024-03-30T13:13:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.959+0000 7fda1ce00640 1 --2- 172.21.15.44:0/2614472392 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda180d48c0 0x7fda180d29c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.959+0000 7fda1ce00640 1 --2- 172.21.15.44:0/2614472392 >> v2:172.21.15.151:3300/0 conn(0x7fda1815e950 0x7fda180d4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.959+0000 7fda1ce00640 1 -- 172.21.15.44:0/2614472392 >> 172.21.15.44:0/2614472392 conn(0x7fda180676e0 msgr2=0x7fda18067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.959+0000 7fda1ce00640 1 -- 172.21.15.44:0/2614472392 shutdown_connections 2024-03-30T13:13:09.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.959+0000 7fda1ce00640 1 -- 172.21.15.44:0/2614472392 wait complete. 2024-03-30T13:13:09.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.961+0000 7fda1ce00640 1 Processor -- start 2024-03-30T13:13:09.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.961+0000 7fda1ce00640 1 -- start start 2024-03-30T13:13:09.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.962+0000 7fda1ce00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda180d2f00 0x7fda18155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.962+0000 7fda1ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda180d48c0 0x7fda180c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.962+0000 7fda1ce00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda1815e950 0x7fda181566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.962+0000 7fda1ce00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fda180d3390 con 0x7fda180d48c0 2024-03-30T13:13:09.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.962+0000 7fda1ce00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fda180b7da0 con 0x7fda1815e950 2024-03-30T13:13:09.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.962+0000 7fda1ce00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fda1815ed30 con 0x7fda180d2f00 2024-03-30T13:13:09.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.963+0000 7fda15400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda180d48c0 0x7fda180c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.963+0000 7fda15400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda180d48c0 0x7fda180c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57082/0 (socket says 172.21.15.44:57082) 2024-03-30T13:13:09.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.963+0000 7fda15400640 1 -- 172.21.15.44:0/3946950311 learned_addr learned my addr 172.21.15.44:0/3946950311 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:09.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.963+0000 7fda15e00640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda180d2f00 0x7fda18155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.963+0000 7fda15400640 1 -- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda180d2f00 msgr2=0x7fda18155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.963+0000 7fda15400640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda180d2f00 0x7fda18155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.963+0000 7fda15400640 1 -- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda1815e950 msgr2=0x7fda181566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:09.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.963+0000 7fda16800640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda1815e950 0x7fda181566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.963+0000 7fda15400640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda1815e950 0x7fda181566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:09.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.963+0000 7fda15400640 1 -- 172.21.15.44:0/3946950311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda18155e70 con 0x7fda180d48c0 2024-03-30T13:13:09.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.963+0000 7fda16800640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda1815e950 0x7fda181566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:09.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.963+0000 7fda15400640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda180d48c0 0x7fda180c8930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fda00000c00 tx=0x7fda00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:09.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.964+0000 7fda0e000640 1 -- 172.21.15.44:0/3946950311 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda00047070 con 0x7fda180d48c0 2024-03-30T13:13:09.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.964+0000 7fda0e000640 1 -- 172.21.15.44:0/3946950311 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda00037d40 con 0x7fda180d48c0 2024-03-30T13:13:09.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.964+0000 7fda0e000640 1 -- 172.21.15.44:0/3946950311 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda000426c0 con 0x7fda180d48c0 2024-03-30T13:13:09.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.964+0000 7fda1ce00640 1 -- 172.21.15.44:0/3946950311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda180c9160 con 0x7fda180d48c0 2024-03-30T13:13:09.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.964+0000 7fda1ce00640 1 -- 172.21.15.44:0/3946950311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda180c9720 con 0x7fda180d48c0 2024-03-30T13:13:09.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.965+0000 7fda1ce00640 1 -- 172.21.15.44:0/3946950311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda18075a10 con 0x7fda180d48c0 2024-03-30T13:13:09.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.966+0000 7fda0e000640 1 -- 172.21.15.44:0/3946950311 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fda0004a070 con 0x7fda180d48c0 2024-03-30T13:13:09.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.968+0000 7fda0e000640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd9f406c560 0x7fd9f406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:09.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.968+0000 7fda0e000640 1 -- 172.21.15.44:0/3946950311 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7fda000adf10 con 0x7fda180d48c0 2024-03-30T13:13:09.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.968+0000 7fda15e00640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd9f406c560 0x7fd9f406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:09.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.969+0000 7fda15e00640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd9f406c560 0x7fd9f406ea20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fda08006fd0 tx=0x7fda08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:09.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:09.972+0000 7fda0e000640 1 -- 172.21.15.44:0/3946950311 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fda18155e70 con 0x7fda180d48c0 2024-03-30T13:13:10.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.207+0000 7fda1ce00640 1 -- 172.21.15.44:0/3946950311 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda180c9d70 con 0x7fda180d48c0 2024-03-30T13:13:10.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.208+0000 7fda0e000640 1 -- 172.21.15.44:0/3946950311 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7fda00033030 con 0x7fda180d48c0 2024-03-30T13:13:10.212 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:10.212 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1458748329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1458748329},{"type":"v1","addr":"172.21.15.44:6834","nonce":1458748329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3921281718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3921281718},{"type":"v1","addr":"172.21.15.151:6837","nonce":3921281718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2065829800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2065829800},{"type":"v1","addr":"172.21.15.44:6835","nonce":2065829800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:11:40.531273+0000","modified":"2024-03-30T13:12:07.711287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/456394190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":456394190},{"type":"v1","addr":"172.21.15.151:6835","nonce":456394190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276]},"id":1}]} 2024-03-30T13:13:10.212 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-03-30T13:13:10.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.210+0000 7fda1ce00640 1 -- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd9f406c560 msgr2=0x7fd9f406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.210+0000 7fda1ce00640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd9f406c560 0x7fd9f406ea20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fda08006fd0 tx=0x7fda08008040 comp rx=0 tx=0).stop 2024-03-30T13:13:10.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.211+0000 7fda1ce00640 1 -- 172.21.15.44:0/3946950311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda180d48c0 msgr2=0x7fda180c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.211+0000 7fda1ce00640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda180d48c0 0x7fda180c8930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fda00000c00 tx=0x7fda00004730 comp rx=0 tx=0).stop 2024-03-30T13:13:10.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.211+0000 7fda1ce00640 1 -- 172.21.15.44:0/3946950311 shutdown_connections 2024-03-30T13:13:10.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.211+0000 7fda1ce00640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd9f406c560 0x7fd9f406ea20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.211+0000 7fda1ce00640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda1815e950 0x7fda181566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.211+0000 7fda1ce00640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fda180d48c0 0x7fda180c8930 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.211+0000 7fda1ce00640 1 --2- 172.21.15.44:0/3946950311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda180d2f00 0x7fda18155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.211+0000 7fda1ce00640 1 -- 172.21.15.44:0/3946950311 >> 172.21.15.44:0/3946950311 conn(0x7fda180676e0 msgr2=0x7fda1815dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:10.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.211+0000 7fda1ce00640 1 -- 172.21.15.44:0/3946950311 shutdown_connections 2024-03-30T13:13:10.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.211+0000 7fda1ce00640 1 -- 172.21.15.44:0/3946950311 wait complete. 2024-03-30T13:13:10.234 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:13:10.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.441+0000 7f4686600640 1 Processor -- start 2024-03-30T13:13:10.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.441+0000 7f4686600640 1 -- start start 2024-03-30T13:13:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.442+0000 7f4686600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4680144970 0x7f46800b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.443+0000 7f4686600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f46800d0360 0x7f46800d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.443+0000 7f4686600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46800716a0 con 0x7f46800b3d50 2024-03-30T13:13:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.443+0000 7f4686600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f46800d0d10 con 0x7f46800d0360 2024-03-30T13:13:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.443+0000 7f4686600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4680071980 con 0x7f4680144970 2024-03-30T13:13:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.443+0000 7f467fe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f46800b3d50 0x7f46800cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43068/0 (socket says 172.21.15.44:43068) 2024-03-30T13:13:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.443+0000 7f467fe00640 1 -- 172.21.15.44:0/1340901826 learned_addr learned my addr 172.21.15.44:0/1340901826 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:10.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.443+0000 7f4685200640 1 --2- 172.21.15.44:0/1340901826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4680144970 0x7f46800b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.443+0000 7f4685c00640 1 --2- 172.21.15.44:0/1340901826 >> v2:172.21.15.151:3300/0 conn(0x7f46800d0360 0x7f46800d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.444+0000 7f467f400640 1 -- 172.21.15.44:0/1340901826 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421893148 0 0) 0x7f46800716a0 con 0x7f46800b3d50 2024-03-30T13:13:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.444+0000 7f467f400640 1 -- 172.21.15.44:0/1340901826 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4668003520 con 0x7f46800b3d50 2024-03-30T13:13:10.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.444+0000 7f4685c00640 1 -- 172.21.15.44:0/1340901826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4680144970 msgr2=0x7f46800b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.444+0000 7f4685c00640 1 --2- 172.21.15.44:0/1340901826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4680144970 0x7f46800b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.444+0000 7f4685c00640 1 -- 172.21.15.44:0/1340901826 >> v1:172.21.15.44:6789/0 conn(0x7f46800b3d50 legacy=0x7f46800cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.444+0000 7f4685c00640 1 -- 172.21.15.44:0/1340901826 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4680071c60 con 0x7f46800d0360 2024-03-30T13:13:10.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.445+0000 7f4685c00640 1 --2- 172.21.15.44:0/1340901826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46800d0360 0x7f46800d07d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4678009d90 tx=0x7f467802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c533eda393a0b688 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.446+0000 7f467f400640 1 -- 172.21.15.44:0/1340901826 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678039070 con 0x7f46800d0360 2024-03-30T13:13:10.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.446+0000 7f467f400640 1 -- 172.21.15.44:0/1340901826 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467802cbc0 con 0x7f46800d0360 2024-03-30T13:13:10.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.446+0000 7f467f400640 1 -- 172.21.15.44:0/1340901826 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678034440 con 0x7f46800d0360 2024-03-30T13:13:10.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.447+0000 7f4686600640 1 -- 172.21.15.44:0/1340901826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46800d0360 msgr2=0x7f46800d07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.447+0000 7f4686600640 1 --2- 172.21.15.44:0/1340901826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46800d0360 0x7f46800d07d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4678009d90 tx=0x7f467802be10 comp rx=0 tx=0).stop 2024-03-30T13:13:10.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.447+0000 7f4686600640 1 -- 172.21.15.44:0/1340901826 shutdown_connections 2024-03-30T13:13:10.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.447+0000 7f4686600640 1 --2- 172.21.15.44:0/1340901826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46800d0360 0x7f46800d07d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.447+0000 7f4686600640 1 --2- 172.21.15.44:0/1340901826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4680144970 0x7f46800b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.447+0000 7f4686600640 1 -- 172.21.15.44:0/1340901826 >> 172.21.15.44:0/1340901826 conn(0x7f468006b9a0 msgr2=0x7f468006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.447+0000 7f4686600640 1 -- 172.21.15.44:0/1340901826 shutdown_connections 2024-03-30T13:13:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.447+0000 7f4686600640 1 -- 172.21.15.44:0/1340901826 wait complete. 2024-03-30T13:13:10.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.449+0000 7f4686600640 1 Processor -- start 2024-03-30T13:13:10.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.449+0000 7f4686600640 1 -- start start 2024-03-30T13:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.450+0000 7f4686600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46800b3d50 0x7f4680141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.450+0000 7f4686600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46800d0360 0x7f468015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.450+0000 7f4686600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4680144970 0x7f46801f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.450+0000 7f4686600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4680144d50 con 0x7f4680144970 2024-03-30T13:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.450+0000 7f4686600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4680072220 con 0x7f46800b3d50 2024-03-30T13:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.450+0000 7f4686600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f46800cde10 con 0x7f46800d0360 2024-03-30T13:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.450+0000 7f4685c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4680144970 0x7f46801f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.450+0000 7f4685c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4680144970 0x7f46801f40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57094/0 (socket says 172.21.15.44:57094) 2024-03-30T13:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.450+0000 7f4685c00640 1 -- 172.21.15.44:0/3625304319 learned_addr learned my addr 172.21.15.44:0/3625304319 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:10.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.451+0000 7f467fe00640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46800d0360 0x7f468015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.451+0000 7f4685200640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46800b3d50 0x7f4680141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.451+0000 7f4685c00640 1 -- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46800d0360 msgr2=0x7f468015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.451+0000 7f4685c00640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46800d0360 0x7f468015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.451+0000 7f4685c00640 1 -- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46800b3d50 msgr2=0x7f4680141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.451+0000 7f4685c00640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46800b3d50 0x7f4680141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.451+0000 7f4685c00640 1 -- 172.21.15.44:0/3625304319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46800c9260 con 0x7f4680144970 2024-03-30T13:13:10.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.451+0000 7f4685c00640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4680144970 0x7f46801f40a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f467802c420 tx=0x7f4678004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.452+0000 7f467cc00640 1 -- 172.21.15.44:0/3625304319 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678044020 con 0x7f4680144970 2024-03-30T13:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.452+0000 7f467cc00640 1 -- 172.21.15.44:0/3625304319 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4678035e50 con 0x7f4680144970 2024-03-30T13:13:10.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.452+0000 7f467cc00640 1 -- 172.21.15.44:0/3625304319 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4678039040 con 0x7f4680144970 2024-03-30T13:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.452+0000 7f4686600640 1 -- 172.21.15.44:0/3625304319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46800c9540 con 0x7f4680144970 2024-03-30T13:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.452+0000 7f4686600640 1 -- 172.21.15.44:0/3625304319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46800c9b00 con 0x7f4680144970 2024-03-30T13:13:10.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.453+0000 7f4686600640 1 -- 172.21.15.44:0/3625304319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4680075890 con 0x7f4680144970 2024-03-30T13:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.454+0000 7f467cc00640 1 -- 172.21.15.44:0/3625304319 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4678047020 con 0x7f4680144970 2024-03-30T13:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.455+0000 7f467cc00640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f466006c530 0x7f466006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.455+0000 7f467cc00640 1 -- 172.21.15.44:0/3625304319 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f46780ae4b0 con 0x7f4680144970 2024-03-30T13:13:10.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.455+0000 7f4685200640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f466006c530 0x7f466006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.457+0000 7f4685200640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f466006c530 0x7f466006e9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4674009ad0 tx=0x7f4674008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.460+0000 7f467cc00640 1 -- 172.21.15.44:0/3625304319 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f467804e030 con 0x7f4680144970 2024-03-30T13:13:10.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.706+0000 7f4686600640 1 -- 172.21.15.44:0/3625304319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f468015f6f0 con 0x7f4680144970 2024-03-30T13:13:10.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.707+0000 7f467cc00640 1 -- 172.21.15.44:0/3625304319 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f467807c6b0 con 0x7f4680144970 2024-03-30T13:13:10.711 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:10.712 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6834/1458748329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":1458748329},{"type":"v1","addr":"172.21.15.44:6834","nonce":1458748329}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3921281718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":3921281718},{"type":"v1","addr":"172.21.15.151:6837","nonce":3921281718}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2065829800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6833","nonce":2065829800},{"type":"v1","addr":"172.21.15.44:6835","nonce":2065829800}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:11:40.531273+0000","modified":"2024-03-30T13:12:07.711287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/456394190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":456394190},{"type":"v1","addr":"172.21.15.151:6835","nonce":456394190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276]},"id":1}]} 2024-03-30T13:13:10.712 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 9 2024-03-30T13:13:10.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.710+0000 7f4686600640 1 -- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f466006c530 msgr2=0x7f466006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.710+0000 7f4686600640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f466006c530 0x7f466006e9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4674009ad0 tx=0x7f4674008040 comp rx=0 tx=0).stop 2024-03-30T13:13:10.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.710+0000 7f4686600640 1 -- 172.21.15.44:0/3625304319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4680144970 msgr2=0x7f46801f40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.710+0000 7f4686600640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4680144970 0x7f46801f40a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f467802c420 tx=0x7f4678004a40 comp rx=0 tx=0).stop 2024-03-30T13:13:10.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.710+0000 7f4686600640 1 -- 172.21.15.44:0/3625304319 shutdown_connections 2024-03-30T13:13:10.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.710+0000 7f4686600640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4680144970 0x7f46801f40a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.710+0000 7f4686600640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46800d0360 0x7f468015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.710+0000 7f4686600640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f466006c530 0x7f466006e9f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.710+0000 7f4686600640 1 --2- 172.21.15.44:0/3625304319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46800b3d50 0x7f4680141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.710+0000 7f4686600640 1 -- 172.21.15.44:0/3625304319 >> 172.21.15.44:0/3625304319 conn(0x7f468006b9a0 msgr2=0x7f468006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:10.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.711+0000 7f4686600640 1 -- 172.21.15.44:0/3625304319 shutdown_connections 2024-03-30T13:13:10.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.711+0000 7f4686600640 1 -- 172.21.15.44:0/3625304319 wait complete. 2024-03-30T13:13:10.735 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:13:10.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.953+0000 7f4948200640 1 Processor -- start 2024-03-30T13:13:10.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.954+0000 7f4948200640 1 -- start start 2024-03-30T13:13:10.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.955+0000 7f4948200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4940145c60 0x7f4940071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.955+0000 7f4948200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4940160830 0x7f49400ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.955+0000 7f4948200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4940146040 con 0x7f4940071a60 2024-03-30T13:13:10.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.955+0000 7f4948200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4940071ed0 con 0x7f4940160830 2024-03-30T13:13:10.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.955+0000 7f4948200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f4940160e50 con 0x7f4940145c60 2024-03-30T13:13:10.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.956+0000 7f4946200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4940160830 0x7f49400ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.956+0000 7f4946200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4940160830 0x7f49400ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57102/0 (socket says 172.21.15.44:57102) 2024-03-30T13:13:10.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.956+0000 7f4946200640 1 -- 172.21.15.44:0/3197882691 learned_addr learned my addr 172.21.15.44:0/3197882691 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:10.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.956+0000 7f4945800640 1 --2- 172.21.15.44:0/3197882691 >> v2:172.21.15.151:3300/0 conn(0x7f4940145c60 0x7f4940071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.956+0000 7f4946200640 1 -- 172.21.15.44:0/3197882691 >> v2:172.21.15.151:3300/0 conn(0x7f4940145c60 msgr2=0x7f4940071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.956+0000 7f4946200640 1 --2- 172.21.15.44:0/3197882691 >> v2:172.21.15.151:3300/0 conn(0x7f4940145c60 0x7f4940071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.956+0000 7f4946200640 1 -- 172.21.15.44:0/3197882691 >> v1:172.21.15.151:6789/0 conn(0x7f4940071a60 legacy=0x7f4940160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.956+0000 7f4946200640 1 -- 172.21.15.44:0/3197882691 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494015d8b0 con 0x7f4940160830 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.957+0000 7f4946200640 1 --2- 172.21.15.44:0/3197882691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4940160830 0x7f49400ca830 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f494006e580 tx=0x7f493802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a0154aa92bf401 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.958+0000 7f493fe00640 1 -- 172.21.15.44:0/3197882691 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493802c9f0 con 0x7f4940160830 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.958+0000 7f493fe00640 1 -- 172.21.15.44:0/3197882691 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493802cb90 con 0x7f4940160830 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.958+0000 7f493fe00640 1 -- 172.21.15.44:0/3197882691 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49380343f0 con 0x7f4940160830 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.958+0000 7f4948200640 1 -- 172.21.15.44:0/3197882691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4940160830 msgr2=0x7f49400ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.958+0000 7f4948200640 1 --2- 172.21.15.44:0/3197882691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4940160830 0x7f49400ca830 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f494006e580 tx=0x7f493802be50 comp rx=0 tx=0).stop 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.958+0000 7f4948200640 1 -- 172.21.15.44:0/3197882691 shutdown_connections 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.958+0000 7f4948200640 1 --2- 172.21.15.44:0/3197882691 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4940160830 0x7f49400ca830 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.958+0000 7f4948200640 1 --2- 172.21.15.44:0/3197882691 >> v2:172.21.15.151:3300/0 conn(0x7f4940145c60 0x7f4940071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.958+0000 7f4948200640 1 -- 172.21.15.44:0/3197882691 >> 172.21.15.44:0/3197882691 conn(0x7f49400b1c90 msgr2=0x7f49400b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:10.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.959+0000 7f4948200640 1 -- 172.21.15.44:0/3197882691 shutdown_connections 2024-03-30T13:13:10.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.959+0000 7f4948200640 1 -- 172.21.15.44:0/3197882691 wait complete. 2024-03-30T13:13:10.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.960+0000 7f4948200640 1 Processor -- start 2024-03-30T13:13:10.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.960+0000 7f4948200640 1 -- start start 2024-03-30T13:13:10.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.961+0000 7f4948200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4940071a60 0x7f49400b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.961+0000 7f4948200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4940145c60 0x7f49400b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.961+0000 7f4948200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4940160830 0x7f49400cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.961+0000 7f4948200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f494015d0b0 con 0x7f4940160830 2024-03-30T13:13:10.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.961+0000 7f4948200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f494015cdd0 con 0x7f4940071a60 2024-03-30T13:13:10.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.961+0000 7f4948200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f49400cad70 con 0x7f4940145c60 2024-03-30T13:13:10.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.962+0000 7f4946200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4940160830 0x7f49400cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.962+0000 7f4946200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4940160830 0x7f49400cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57118/0 (socket says 172.21.15.44:57118) 2024-03-30T13:13:10.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.962+0000 7f4946200640 1 -- 172.21.15.44:0/1066226445 learned_addr learned my addr 172.21.15.44:0/1066226445 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:10.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.962+0000 7f4944e00640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4940145c60 0x7f49400b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.962+0000 7f4945800640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4940071a60 0x7f49400b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.962+0000 7f4946200640 1 -- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4940145c60 msgr2=0x7f49400b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.962+0000 7f4946200640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4940145c60 0x7f49400b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.962+0000 7f4946200640 1 -- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4940071a60 msgr2=0x7f49400b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.962+0000 7f4946200640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4940071a60 0x7f49400b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.962+0000 7f4946200640 1 -- 172.21.15.44:0/1066226445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49400b3df0 con 0x7f4940160830 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.963+0000 7f4946200640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4940160830 0x7f49400cb370 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4938036040 tx=0x7f4938004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.963+0000 7f493d600640 1 -- 172.21.15.44:0/1066226445 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938043020 con 0x7f4940160830 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.963+0000 7f493d600640 1 -- 172.21.15.44:0/1066226445 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493803e450 con 0x7f4940160830 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.963+0000 7f4948200640 1 -- 172.21.15.44:0/1066226445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49400b40d0 con 0x7f4940160830 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.963+0000 7f493d600640 1 -- 172.21.15.44:0/1066226445 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4938009510 con 0x7f4940160830 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.963+0000 7f4948200640 1 -- 172.21.15.44:0/1066226445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49400b4690 con 0x7f4940160830 2024-03-30T13:13:10.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.964+0000 7f4948200640 1 -- 172.21.15.44:0/1066226445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f494006fdd0 con 0x7f4940160830 2024-03-30T13:13:10.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.965+0000 7f493d600640 1 -- 172.21.15.44:0/1066226445 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4938046020 con 0x7f4940160830 2024-03-30T13:13:10.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.966+0000 7f493d600640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f492006c560 0x7f492006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:10.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.966+0000 7f493d600640 1 -- 172.21.15.44:0/1066226445 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f49380ae0e0 con 0x7f4940160830 2024-03-30T13:13:10.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.967+0000 7f4945800640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f492006c560 0x7f492006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:10.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.968+0000 7f4945800640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f492006c560 0x7f492006ea20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4930006fd0 tx=0x7f4930008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:10.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:10.971+0000 7f493d600640 1 -- 172.21.15.44:0/1066226445 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f494006fdd0 con 0x7f4940160830 2024-03-30T13:13:11.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.175+0000 7f4948200640 1 -- 172.21.15.44:0/1066226445 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49400ca610 con 0x7f4940160830 2024-03-30T13:13:11.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.178+0000 7f493d600640 1 -- 172.21.15.44:0/1066226445 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18927 (secure 0 0 0) 0x7f493804d070 con 0x7f4940160830 2024-03-30T13:13:11.182 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:11.182 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":29,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:12:27.323786+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:11:38.219283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-30T13:11:39.485395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-30T13:11:43.072897+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:13:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.180+0000 7f4948200640 1 -- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f492006c560 msgr2=0x7f492006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.180+0000 7f4948200640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f492006c560 0x7f492006ea20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4930006fd0 tx=0x7f4930008040 comp rx=0 tx=0).stop 2024-03-30T13:13:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.180+0000 7f4948200640 1 -- 172.21.15.44:0/1066226445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4940160830 msgr2=0x7f49400cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.180+0000 7f4948200640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4940160830 0x7f49400cb370 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4938036040 tx=0x7f4938004a40 comp rx=0 tx=0).stop 2024-03-30T13:13:11.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.180+0000 7f4948200640 1 -- 172.21.15.44:0/1066226445 shutdown_connections 2024-03-30T13:13:11.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.180+0000 7f4948200640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4940160830 0x7f49400cb370 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.180+0000 7f4948200640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4940145c60 0x7f49400b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.180+0000 7f4948200640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f492006c560 0x7f492006ea20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.180+0000 7f4948200640 1 --2- 172.21.15.44:0/1066226445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4940071a60 0x7f49400b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.181+0000 7f4948200640 1 -- 172.21.15.44:0/1066226445 >> 172.21.15.44:0/1066226445 conn(0x7f49400b1c90 msgr2=0x7f4940074b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:11.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.181+0000 7f4948200640 1 -- 172.21.15.44:0/1066226445 shutdown_connections 2024-03-30T13:13:11.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.181+0000 7f4948200640 1 -- 172.21.15.44:0/1066226445 wait complete. 2024-03-30T13:13:11.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-30T13:13:11.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.417+0000 7f57afe00640 1 Processor -- start 2024-03-30T13:13:11.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.417+0000 7f57afe00640 1 -- start start 2024-03-30T13:13:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.419+0000 7f57afe00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f57b0145850 0x7f57b0072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.419+0000 7f57afe00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b0163b70 con 0x7f57b0166920 2024-03-30T13:13:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.419+0000 7f57afe00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b0166f20 con 0x7f57b0148bb0 2024-03-30T13:13:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.419+0000 7f57afe00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f57b01480d0 con 0x7f57b0145850 2024-03-30T13:13:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.419+0000 7f57af400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f57b0166920 0x7f57b015f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43082/0 (socket says 172.21.15.44:43082) 2024-03-30T13:13:11.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.419+0000 7f57af400640 1 -- 172.21.15.44:0/2944275046 learned_addr learned my addr 172.21.15.44:0/2944275046 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:11.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.420+0000 7f57aea00640 1 --2- 172.21.15.44:0/2944275046 >> v2:172.21.15.151:3300/0 conn(0x7f57b0145850 0x7f57b0072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.420+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020379418 0 0) 0x7f57a8001490 con 0x7f57b0166920 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.420+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5794003520 con 0x7f57b0166920 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.420+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2226816122 0 0) 0x7f5794003520 con 0x7f57b0166920 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.420+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 >> v2:172.21.15.151:3300/0 conn(0x7f57b0145850 msgr2=0x7f57b0072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.420+0000 7f57ae000640 1 --2- 172.21.15.44:0/2944275046 >> v2:172.21.15.151:3300/0 conn(0x7f57b0145850 0x7f57b0072510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.420+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 >> v1:172.21.15.151:6789/0 conn(0x7f57b0148bb0 legacy=0x7f57b0166210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.420+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b01483b0 con 0x7f57b0166920 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.420+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f57a8001bc0 con 0x7f57b0166920 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.420+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 >> v1:172.21.15.44:6789/0 conn(0x7f57b0166920 legacy=0x7f57b015f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.420+0000 7f57ae000640 1 --2- 172.21.15.44:0/2944275046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 0x7f5794003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57ae000640 1 --2- 172.21.15.44:0/2944275046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5794004800 0x7f5794004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57ae000640 1 --2- 172.21.15.44:0/2944275046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57940051c0 0x7f579400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f57b01480d0 con 0x7f57940039b0 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f579400c060 con 0x7f5794004800 2024-03-30T13:13:11.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f579400c260 con 0x7f57940051c0 2024-03-30T13:13:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57aea00640 1 --2- 172.21.15.44:0/2944275046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 0x7f5794003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57a6000640 1 --2- 172.21.15.44:0/2944275046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5794004800 0x7f5794004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57af400640 1 --2- 172.21.15.44:0/2944275046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57940051c0 0x7f579400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57aea00640 1 -- 172.21.15.44:0/2944275046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57940051c0 msgr2=0x7f579400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57aea00640 1 --2- 172.21.15.44:0/2944275046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57940051c0 0x7f579400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57aea00640 1 -- 172.21.15.44:0/2944275046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5794004800 msgr2=0x7f5794004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57aea00640 1 --2- 172.21.15.44:0/2944275046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5794004800 0x7f5794004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57aea00640 1 -- 172.21.15.44:0/2944275046 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5794003520 con 0x7f57940039b0 2024-03-30T13:13:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57af400640 1 --2- 172.21.15.44:0/2944275046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57940051c0 0x7f579400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:11.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.421+0000 7f57af400640 1 -- 172.21.15.44:0/2944275046 reap_dead start 2024-03-30T13:13:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.422+0000 7f57aea00640 1 --2- 172.21.15.44:0/2944275046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 0x7f5794003dd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009ac0 tx=0x7f5794005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16417881efcbc2c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.423+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0039070 con 0x7f57940039b0 2024-03-30T13:13:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.423+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a002c6b0 con 0x7f57940039b0 2024-03-30T13:13:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.423+0000 7f57ae000640 1 -- 172.21.15.44:0/2944275046 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0009690 con 0x7f57940039b0 2024-03-30T13:13:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.423+0000 7f57afe00640 1 -- 172.21.15.44:0/2944275046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 msgr2=0x7f5794003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.423+0000 7f57afe00640 1 --2- 172.21.15.44:0/2944275046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 0x7f5794003dd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009ac0 tx=0x7f5794005830 comp rx=0 tx=0).stop 2024-03-30T13:13:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.423+0000 7f57afe00640 1 -- 172.21.15.44:0/2944275046 shutdown_connections 2024-03-30T13:13:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.423+0000 7f57afe00640 1 --2- 172.21.15.44:0/2944275046 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 0x7f5794003dd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.423+0000 7f57afe00640 1 -- 172.21.15.44:0/2944275046 >> 172.21.15.44:0/2944275046 conn(0x7f57b006b970 msgr2=0x7f57b006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.424+0000 7f57afe00640 1 -- 172.21.15.44:0/2944275046 shutdown_connections 2024-03-30T13:13:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.424+0000 7f57afe00640 1 -- 172.21.15.44:0/2944275046 wait complete. 2024-03-30T13:13:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.425+0000 7f57afe00640 1 Processor -- start 2024-03-30T13:13:11.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.426+0000 7f57afe00640 1 -- start start 2024-03-30T13:13:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.426+0000 7f57afe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 0x7f57b0146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57afe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b015abd0 0x7f57b0146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57afe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57b0146aa0 0x7f57b00cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57afe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f57b0166390 con 0x7f57940039b0 2024-03-30T13:13:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57afe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f57b0166210 con 0x7f57b015abd0 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57afe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f57b0166510 con 0x7f57b0146aa0 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57aea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 0x7f57b0146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57aea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 0x7f57b0146ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57130/0 (socket says 172.21.15.44:57130) 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57aea00640 1 -- 172.21.15.44:0/802027123 learned_addr learned my addr 172.21.15.44:0/802027123 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57a6000640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b015abd0 0x7f57b0146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57af400640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57b0146aa0 0x7f57b00cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57aea00640 1 -- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57b0146aa0 msgr2=0x7f57b00cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57aea00640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57b0146aa0 0x7f57b00cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57aea00640 1 -- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b015abd0 msgr2=0x7f57b0146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57aea00640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b015abd0 0x7f57b0146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57aea00640 1 -- 172.21.15.44:0/802027123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b00b12f0 con 0x7f57940039b0 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.427+0000 7f57af400640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57b0146aa0 0x7f57b00cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:11.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.428+0000 7f57aea00640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 0x7f57b0146ff0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f57a0000c00 tx=0x7f57a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.428+0000 7f57a7400640 1 -- 172.21.15.44:0/802027123 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0042020 con 0x7f57940039b0 2024-03-30T13:13:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.428+0000 7f57a7400640 1 -- 172.21.15.44:0/802027123 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57a003a040 con 0x7f57940039b0 2024-03-30T13:13:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.428+0000 7f57a7400640 1 -- 172.21.15.44:0/802027123 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0039070 con 0x7f57940039b0 2024-03-30T13:13:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.428+0000 7f57afe00640 1 -- 172.21.15.44:0/802027123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b00b15d0 con 0x7f57940039b0 2024-03-30T13:13:11.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.428+0000 7f57afe00640 1 -- 172.21.15.44:0/802027123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b0143030 con 0x7f57940039b0 2024-03-30T13:13:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.429+0000 7f57afe00640 1 -- 172.21.15.44:0/802027123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b0075890 con 0x7f57940039b0 2024-03-30T13:13:11.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.430+0000 7f57a7400640 1 -- 172.21.15.44:0/802027123 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f57a0045020 con 0x7f57940039b0 2024-03-30T13:13:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.431+0000 7f57a7400640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f578c06c560 0x7f578c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.431+0000 7f57a7400640 1 -- 172.21.15.44:0/802027123 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6764+0+0 (secure 0 0 0) 0x7f57a00acb60 con 0x7f57940039b0 2024-03-30T13:13:11.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.432+0000 7f57a6000640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f578c06c560 0x7f578c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.433+0000 7f57a6000640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f578c06c560 0x7f578c06ea20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5798007fd0 tx=0x7f5798009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:11.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.435+0000 7f57a7400640 1 -- 172.21.15.44:0/802027123 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f57a004c020 con 0x7f57940039b0 2024-03-30T13:13:11.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.678+0000 7f57afe00640 1 -- 172.21.15.44:0/802027123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f57b00b40f0 con 0x7f57940039b0 2024-03-30T13:13:11.682 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-03-30T13:13:11.679+0000 7fc347800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T13:13:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.682+0000 7f57a7400640 1 -- 172.21.15.44:0/802027123 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f57a007ad50 con 0x7f57940039b0 2024-03-30T13:13:11.686 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-30T13:13:11.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.685+0000 7f57afe00640 1 -- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f578c06c560 msgr2=0x7f578c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.685+0000 7f57afe00640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f578c06c560 0x7f578c06ea20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5798007fd0 tx=0x7f5798009040 comp rx=0 tx=0).stop 2024-03-30T13:13:11.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.685+0000 7f57afe00640 1 -- 172.21.15.44:0/802027123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 msgr2=0x7f57b0146ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.685+0000 7f57afe00640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 0x7f57b0146ff0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f57a0000c00 tx=0x7f57a0004730 comp rx=0 tx=0).stop 2024-03-30T13:13:11.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.685+0000 7f57afe00640 1 -- 172.21.15.44:0/802027123 shutdown_connections 2024-03-30T13:13:11.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.685+0000 7f57afe00640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57b0146aa0 0x7f57b00cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.685+0000 7f57afe00640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f578c06c560 0x7f578c06ea20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.685+0000 7f57afe00640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57b015abd0 0x7f57b0146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.685+0000 7f57afe00640 1 --2- 172.21.15.44:0/802027123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f57940039b0 0x7f57b0146ff0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.685+0000 7f57afe00640 1 -- 172.21.15.44:0/802027123 >> 172.21.15.44:0/802027123 conn(0x7f57b006b970 msgr2=0x7f57b00b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:11.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.685+0000 7f57afe00640 1 -- 172.21.15.44:0/802027123 shutdown_connections 2024-03-30T13:13:11.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.685+0000 7f57afe00640 1 -- 172.21.15.44:0/802027123 wait complete. 2024-03-30T13:13:11.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-30T13:13:11.730 INFO:tasks.ceph.mds.b.smithi151.stderr: -6909> 2024-03-30T13:11:44.120+0000 7fd048c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T13:13:11.804 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2024-03-30T13:13:11.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.930+0000 7f6bc1000640 1 Processor -- start 2024-03-30T13:13:11.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.930+0000 7f6bc1000640 1 -- start start 2024-03-30T13:13:11.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.932+0000 7f6bc1000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6bbc0b5dc0 0x7f6bbc0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.932+0000 7f6bc1000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc0b73d0 0x7f6bbc0b7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.932+0000 7f6bc1000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bbc0b66e0 con 0x7f6bbc0ba090 2024-03-30T13:13:11.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.932+0000 7f6bc1000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6bbc0d2d90 con 0x7f6bbc0b5dc0 2024-03-30T13:13:11.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.932+0000 7f6bc1000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6bbc0d2ff0 con 0x7f6bbc0b73d0 2024-03-30T13:13:11.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.932+0000 7f6bb9e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6bbc0b5dc0 0x7f6bbc0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.932+0000 7f6bb9e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f6bbc0b5dc0 0x7f6bbc0b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57142/0 (socket says 172.21.15.44:57142) 2024-03-30T13:13:11.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.932+0000 7f6bb9400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6bbc0ba090 0x7f6bbc0d2680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43088/0 (socket says 172.21.15.44:43088) 2024-03-30T13:13:11.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.932+0000 7f6bb9e00640 1 -- 172.21.15.44:0/2882783574 learned_addr learned my addr 172.21.15.44:0/2882783574 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:11.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.933+0000 7f6bba800640 1 --2- 172.21.15.44:0/2882783574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc0b73d0 0x7f6bbc0b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.933+0000 7f6bb9e00640 1 -- 172.21.15.44:0/2882783574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc0b73d0 msgr2=0x7f6bbc0b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:11.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.933+0000 7f6bb9e00640 1 --2- 172.21.15.44:0/2882783574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc0b73d0 0x7f6bbc0b7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.933+0000 7f6bb9e00640 1 -- 172.21.15.44:0/2882783574 >> v1:172.21.15.44:6789/0 conn(0x7f6bbc0ba090 legacy=0x7f6bbc0d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.933+0000 7f6bb9e00640 1 -- 172.21.15.44:0/2882783574 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bbc0d32d0 con 0x7f6bbc0b5dc0 2024-03-30T13:13:11.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.934+0000 7f6bb9e00640 1 --2- 172.21.15.44:0/2882783574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bbc0b5dc0 0x7f6bbc0b61a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009e50 tx=0x7f6bac02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ecc01abcbf1a03 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:11.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.934+0000 7f6bb8a00640 1 -- 172.21.15.44:0/2882783574 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac02cb00 con 0x7f6bbc0b5dc0 2024-03-30T13:13:11.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.934+0000 7f6bb8a00640 1 -- 172.21.15.44:0/2882783574 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac02cca0 con 0x7f6bbc0b5dc0 2024-03-30T13:13:11.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.934+0000 7f6bb8a00640 1 -- 172.21.15.44:0/2882783574 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac034610 con 0x7f6bbc0b5dc0 2024-03-30T13:13:11.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.935+0000 7f6bc1000640 1 -- 172.21.15.44:0/2882783574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bbc0b5dc0 msgr2=0x7f6bbc0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.935+0000 7f6bc1000640 1 --2- 172.21.15.44:0/2882783574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bbc0b5dc0 0x7f6bbc0b61a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009e50 tx=0x7f6bac02bf60 comp rx=0 tx=0).stop 2024-03-30T13:13:11.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.935+0000 7f6bc1000640 1 -- 172.21.15.44:0/2882783574 shutdown_connections 2024-03-30T13:13:11.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.935+0000 7f6bc1000640 1 --2- 172.21.15.44:0/2882783574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc0b73d0 0x7f6bbc0b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.935+0000 7f6bc1000640 1 --2- 172.21.15.44:0/2882783574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bbc0b5dc0 0x7f6bbc0b61a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.935+0000 7f6bc1000640 1 -- 172.21.15.44:0/2882783574 >> 172.21.15.44:0/2882783574 conn(0x7f6bbc0678f0 msgr2=0x7f6bbc0d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:11.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.935+0000 7f6bc1000640 1 -- 172.21.15.44:0/2882783574 shutdown_connections 2024-03-30T13:13:11.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.935+0000 7f6bc1000640 1 -- 172.21.15.44:0/2882783574 wait complete. 2024-03-30T13:13:11.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.937+0000 7f6bc1000640 1 Processor -- start 2024-03-30T13:13:11.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.937+0000 7f6bc1000640 1 -- start start 2024-03-30T13:13:11.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.938+0000 7f6bc1000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bbc0b5dc0 0x7f6bbc1e7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.938+0000 7f6bc1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bbc0b73d0 0x7f6bbc0b8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.938+0000 7f6bc1000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc0ba090 0x7f6bbc0b9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.938+0000 7f6bc1000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc0d3b70 con 0x7f6bbc0b73d0 2024-03-30T13:13:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.938+0000 7f6bc1000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc0d3890 con 0x7f6bbc0b5dc0 2024-03-30T13:13:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.938+0000 7f6bc1000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6bbc0d4090 con 0x7f6bbc0ba090 2024-03-30T13:13:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.938+0000 7f6bb9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bbc0b73d0 0x7f6bbc0b8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.938+0000 7f6bb9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bbc0b73d0 0x7f6bbc0b8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57144/0 (socket says 172.21.15.44:57144) 2024-03-30T13:13:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.938+0000 7f6bb9400640 1 -- 172.21.15.44:0/4212465610 learned_addr learned my addr 172.21.15.44:0/4212465610 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.938+0000 7f6bba800640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc0ba090 0x7f6bbc0b9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.938+0000 7f6bb9e00640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bbc0b5dc0 0x7f6bbc1e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.938+0000 7f6bb9400640 1 -- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc0ba090 msgr2=0x7f6bbc0b9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.939+0000 7f6bb9400640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc0ba090 0x7f6bbc0b9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.939+0000 7f6bb9400640 1 -- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bbc0b5dc0 msgr2=0x7f6bbc1e7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.939+0000 7f6bb9400640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bbc0b5dc0 0x7f6bbc1e7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:11.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.939+0000 7f6bb9400640 1 -- 172.21.15.44:0/4212465610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bbc1e8010 con 0x7f6bbc0b73d0 2024-03-30T13:13:11.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.939+0000 7f6bb9e00640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bbc0b5dc0 0x7f6bbc1e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:11.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.939+0000 7f6bb9400640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bbc0b73d0 0x7f6bbc0b8f40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400c3c0 tx=0x7f6ba400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:11.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.939+0000 7f6bb2000640 1 -- 172.21.15.44:0/4212465610 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40074e0 con 0x7f6bbc0b73d0 2024-03-30T13:13:11.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.939+0000 7f6bb2000640 1 -- 172.21.15.44:0/4212465610 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba4007680 con 0x7f6bbc0b73d0 2024-03-30T13:13:11.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.939+0000 7f6bb2000640 1 -- 172.21.15.44:0/4212465610 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4004a00 con 0x7f6bbc0b73d0 2024-03-30T13:13:11.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.939+0000 7f6bc1000640 1 -- 172.21.15.44:0/4212465610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bbc1e82f0 con 0x7f6bbc0b73d0 2024-03-30T13:13:11.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.939+0000 7f6bc1000640 1 -- 172.21.15.44:0/4212465610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bbc1e88b0 con 0x7f6bbc0b73d0 2024-03-30T13:13:11.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.941+0000 7f6bc1000640 1 -- 172.21.15.44:0/4212465610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bbc160dd0 con 0x7f6bbc0b73d0 2024-03-30T13:13:11.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.942+0000 7f6bb2000640 1 -- 172.21.15.44:0/4212465610 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6ba401a020 con 0x7f6bbc0b73d0 2024-03-30T13:13:11.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.942+0000 7f6bb2000640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6b9806c580 0x7f6b9806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:11.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.942+0000 7f6bb2000640 1 -- 172.21.15.44:0/4212465610 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6850+0+0 (secure 0 0 0) 0x7f6ba408b310 con 0x7f6bbc0b73d0 2024-03-30T13:13:11.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.943+0000 7f6bb9e00640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6b9806c580 0x7f6b9806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:11.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.944+0000 7f6bb9e00640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6b9806c580 0x7f6b9806ea40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6bac035000 tx=0x7f6bac030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:11.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:11.947+0000 7f6bb2000640 1 -- 172.21.15.44:0/4212465610 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6bbc160dd0 con 0x7f6bbc0b73d0 2024-03-30T13:13:12.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.185+0000 7f6bc1000640 1 -- 172.21.15.44:0/4212465610 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6bbc0cfe10 con 0x7f6bbc0b73d0 2024-03-30T13:13:12.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.694+0000 7f6bb2000640 1 -- 172.21.15.44:0/4212465610 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f6ba4059490 con 0x7f6bbc0b73d0 2024-03-30T13:13:12.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.698+0000 7f6bc1000640 1 -- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6b9806c580 msgr2=0x7f6b9806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.698+0000 7f6bc1000640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6b9806c580 0x7f6b9806ea40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6bac035000 tx=0x7f6bac030000 comp rx=0 tx=0).stop 2024-03-30T13:13:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.698+0000 7f6bc1000640 1 -- 172.21.15.44:0/4212465610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bbc0b73d0 msgr2=0x7f6bbc0b8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.698+0000 7f6bc1000640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bbc0b73d0 0x7f6bbc0b8f40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400c3c0 tx=0x7f6ba400c880 comp rx=0 tx=0).stop 2024-03-30T13:13:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.698+0000 7f6bc1000640 1 -- 172.21.15.44:0/4212465610 shutdown_connections 2024-03-30T13:13:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.698+0000 7f6bc1000640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc0ba090 0x7f6bbc0b9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.698+0000 7f6bc1000640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6bbc0b73d0 0x7f6bbc0b8f40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.698+0000 7f6bc1000640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f6b9806c580 0x7f6b9806ea40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.698+0000 7f6bc1000640 1 --2- 172.21.15.44:0/4212465610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bbc0b5dc0 0x7f6bbc1e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.698+0000 7f6bc1000640 1 -- 172.21.15.44:0/4212465610 >> 172.21.15.44:0/4212465610 conn(0x7f6bbc0678f0 msgr2=0x7f6bbc0ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.699+0000 7f6bc1000640 1 -- 172.21.15.44:0/4212465610 shutdown_connections 2024-03-30T13:13:12.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.699+0000 7f6bc1000640 1 -- 172.21.15.44:0/4212465610 wait complete. 2024-03-30T13:13:12.725 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-30T13:13:12.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.948+0000 7ff433200640 1 Processor -- start 2024-03-30T13:13:12.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.949+0000 7ff433200640 1 -- start start 2024-03-30T13:13:12.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.950+0000 7ff433200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff434161c30 0x7ff4340d2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.950+0000 7ff433200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4340d1100 0x7ff4340cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.950+0000 7ff433200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff434162010 con 0x7ff4340b5870 2024-03-30T13:13:12.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.950+0000 7ff433200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff4340b31c0 con 0x7ff434161c30 2024-03-30T13:13:12.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.950+0000 7ff433200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff4340d22f0 con 0x7ff4340d1100 2024-03-30T13:13:12.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.950+0000 7ff431e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff434161c30 0x7ff4340d2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.950+0000 7ff431e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff434161c30 0x7ff4340d2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57156/0 (socket says 172.21.15.44:57156) 2024-03-30T13:13:12.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.950+0000 7ff429400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff4340b5870 0x7ff4340d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43092/0 (socket says 172.21.15.44:43092) 2024-03-30T13:13:12.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.951+0000 7ff431e00640 1 -- 172.21.15.44:0/308436581 learned_addr learned my addr 172.21.15.44:0/308436581 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:12.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.951+0000 7ff432800640 1 --2- 172.21.15.44:0/308436581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4340d1100 0x7ff4340cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.951+0000 7ff431e00640 1 -- 172.21.15.44:0/308436581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4340d1100 msgr2=0x7ff4340cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:12.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.951+0000 7ff431e00640 1 --2- 172.21.15.44:0/308436581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4340d1100 0x7ff4340cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.951+0000 7ff431e00640 1 -- 172.21.15.44:0/308436581 >> v1:172.21.15.44:6789/0 conn(0x7ff4340b5870 legacy=0x7ff4340d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.951+0000 7ff431e00640 1 -- 172.21.15.44:0/308436581 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4340d25d0 con 0x7ff434161c30 2024-03-30T13:13:12.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.951+0000 7ff431400640 1 -- 172.21.15.44:0/308436581 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741317967 0 0) 0x7ff41c001110 con 0x7ff4340b5870 2024-03-30T13:13:12.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.952+0000 7ff431e00640 1 --2- 172.21.15.44:0/308436581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff434161c30 0x7ff4340d2dd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff424009870 tx=0x7ff42402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd116f919325cbed server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.952+0000 7ff431400640 1 -- 172.21.15.44:0/308436581 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424034070 con 0x7ff434161c30 2024-03-30T13:13:12.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.953+0000 7ff431400640 1 -- 172.21.15.44:0/308436581 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff424030840 con 0x7ff434161c30 2024-03-30T13:13:12.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.953+0000 7ff431400640 1 -- 172.21.15.44:0/308436581 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424030c10 con 0x7ff434161c30 2024-03-30T13:13:12.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.953+0000 7ff433200640 1 -- 172.21.15.44:0/308436581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff434161c30 msgr2=0x7ff4340d2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.953+0000 7ff433200640 1 --2- 172.21.15.44:0/308436581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff434161c30 0x7ff4340d2dd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff424009870 tx=0x7ff42402b980 comp rx=0 tx=0).stop 2024-03-30T13:13:12.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.953+0000 7ff433200640 1 -- 172.21.15.44:0/308436581 shutdown_connections 2024-03-30T13:13:12.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.953+0000 7ff433200640 1 --2- 172.21.15.44:0/308436581 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4340d1100 0x7ff4340cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.953+0000 7ff433200640 1 --2- 172.21.15.44:0/308436581 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff434161c30 0x7ff4340d2dd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.954+0000 7ff433200640 1 -- 172.21.15.44:0/308436581 >> 172.21.15.44:0/308436581 conn(0x7ff43409d510 msgr2=0x7ff4340d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:12.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.954+0000 7ff433200640 1 -- 172.21.15.44:0/308436581 shutdown_connections 2024-03-30T13:13:12.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.954+0000 7ff433200640 1 -- 172.21.15.44:0/308436581 wait complete. 2024-03-30T13:13:12.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.955+0000 7ff433200640 1 Processor -- start 2024-03-30T13:13:12.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.955+0000 7ff433200640 1 -- start start 2024-03-30T13:13:12.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.956+0000 7ff433200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4340b5870 0x7ff434157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.956+0000 7ff433200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4340d1100 0x7ff4340b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.956+0000 7ff433200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff434161c30 0x7ff43415cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.956+0000 7ff433200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff4340b3600 con 0x7ff434161c30 2024-03-30T13:13:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.956+0000 7ff433200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff4340d3310 con 0x7ff4340b5870 2024-03-30T13:13:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.956+0000 7ff433200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff4340b3780 con 0x7ff4340d1100 2024-03-30T13:13:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.957+0000 7ff432800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff434161c30 0x7ff43415cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.957+0000 7ff432800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff434161c30 0x7ff43415cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57158/0 (socket says 172.21.15.44:57158) 2024-03-30T13:13:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.957+0000 7ff432800640 1 -- 172.21.15.44:0/827238313 learned_addr learned my addr 172.21.15.44:0/827238313 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.957+0000 7ff429400640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4340d1100 0x7ff4340b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.957+0000 7ff431e00640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4340b5870 0x7ff434157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.957+0000 7ff432800640 1 -- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4340d1100 msgr2=0x7ff4340b93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.957+0000 7ff432800640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4340d1100 0x7ff4340b93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.957+0000 7ff432800640 1 -- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4340b5870 msgr2=0x7ff434157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:12.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.957+0000 7ff432800640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4340b5870 0x7ff434157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:12.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.957+0000 7ff432800640 1 -- 172.21.15.44:0/827238313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43415e210 con 0x7ff434161c30 2024-03-30T13:13:12.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.957+0000 7ff431e00640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4340b5870 0x7ff434157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:12.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.958+0000 7ff432800640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff434161c30 0x7ff43415cb00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff42c007e60 tx=0x7ff42c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.958+0000 7ff42aa00640 1 -- 172.21.15.44:0/827238313 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c014420 con 0x7ff434161c30 2024-03-30T13:13:12.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.958+0000 7ff42aa00640 1 -- 172.21.15.44:0/827238313 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff42c019070 con 0x7ff434161c30 2024-03-30T13:13:12.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.958+0000 7ff42aa00640 1 -- 172.21.15.44:0/827238313 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c014820 con 0x7ff434161c30 2024-03-30T13:13:12.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.958+0000 7ff433200640 1 -- 172.21.15.44:0/827238313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43415e4f0 con 0x7ff434161c30 2024-03-30T13:13:12.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.958+0000 7ff433200640 1 -- 172.21.15.44:0/827238313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43415eab0 con 0x7ff434161c30 2024-03-30T13:13:12.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.959+0000 7ff433200640 1 -- 172.21.15.44:0/827238313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff43415ecb0 con 0x7ff434161c30 2024-03-30T13:13:12.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.960+0000 7ff42aa00640 1 -- 172.21.15.44:0/827238313 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff42c0149c0 con 0x7ff434161c30 2024-03-30T13:13:12.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.961+0000 7ff42aa00640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff41006c530 0x7ff41006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:12.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.961+0000 7ff42aa00640 1 -- 172.21.15.44:0/827238313 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6850+0+0 (secure 0 0 0) 0x7ff42c08c400 con 0x7ff434161c30 2024-03-30T13:13:12.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.962+0000 7ff431e00640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff41006c530 0x7ff41006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:12.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.963+0000 7ff431e00640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff41006c530 0x7ff41006e9f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff424036000 tx=0x7ff42403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:12.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:12.966+0000 7ff42aa00640 1 -- 172.21.15.44:0/827238313 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff43415ecb0 con 0x7ff434161c30 2024-03-30T13:13:13.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.180+0000 7ff433200640 1 -- 172.21.15.44:0/827238313 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff434075890 con 0x7ff434161c30 2024-03-30T13:13:13.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.698+0000 7ff42aa00640 1 -- 172.21.15.44:0/827238313 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7ff42c05a500 con 0x7ff434161c30 2024-03-30T13:13:13.702 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-03-30T13:13:13.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.702+0000 7ff433200640 1 -- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff41006c530 msgr2=0x7ff41006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.702+0000 7ff433200640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff41006c530 0x7ff41006e9f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff424036000 tx=0x7ff42403b040 comp rx=0 tx=0).stop 2024-03-30T13:13:13.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.702+0000 7ff433200640 1 -- 172.21.15.44:0/827238313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff434161c30 msgr2=0x7ff43415cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.702+0000 7ff433200640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff434161c30 0x7ff43415cb00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff42c007e60 tx=0x7ff42c00e4b0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.702+0000 7ff433200640 1 -- 172.21.15.44:0/827238313 shutdown_connections 2024-03-30T13:13:13.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.702+0000 7ff433200640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff434161c30 0x7ff43415cb00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.702+0000 7ff433200640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4340d1100 0x7ff4340b93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.702+0000 7ff433200640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff41006c530 0x7ff41006e9f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.702+0000 7ff433200640 1 --2- 172.21.15.44:0/827238313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4340b5870 0x7ff434157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.702+0000 7ff433200640 1 -- 172.21.15.44:0/827238313 >> 172.21.15.44:0/827238313 conn(0x7ff43409d510 msgr2=0x7ff4340d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.703+0000 7ff433200640 1 -- 172.21.15.44:0/827238313 shutdown_connections 2024-03-30T13:13:13.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.703+0000 7ff433200640 1 -- 172.21.15.44:0/827238313 wait complete. 2024-03-30T13:13:13.729 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-30T13:13:13.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.948+0000 7f1b45200640 1 Processor -- start 2024-03-30T13:13:13.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.948+0000 7f1b45200640 1 -- start start 2024-03-30T13:13:13.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.949+0000 7f1b45200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1b4015e440 0x7f1b400b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.949+0000 7f1b45200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b400d40c0 con 0x7f1b400cf040 2024-03-30T13:13:13.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.949+0000 7f1b45200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b400d2910 con 0x7f1b4006d4a0 2024-03-30T13:13:13.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.949+0000 7f1b45200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f1b400d3520 con 0x7f1b4015e440 2024-03-30T13:13:13.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.950+0000 7f1b3e800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1b400cf040 0x7f1b400b7460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43100/0 (socket says 172.21.15.44:43100) 2024-03-30T13:13:13.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.950+0000 7f1b3e800640 1 -- 172.21.15.44:0/2178347898 learned_addr learned my addr 172.21.15.44:0/2178347898 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:13.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.950+0000 7f1b3de00640 1 --2- 172.21.15.44:0/2178347898 >> v2:172.21.15.151:3300/0 conn(0x7f1b4015e440 0x7f1b400b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.950+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173854342 0 0) 0x7f1b400d40c0 con 0x7f1b400cf040 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.950+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b24003520 con 0x7f1b400cf040 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1576164103 0 0) 0x7f1b24003520 con 0x7f1b400cf040 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 >> v2:172.21.15.151:3300/0 conn(0x7f1b4015e440 msgr2=0x7f1b400b9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 --2- 172.21.15.44:0/2178347898 >> v2:172.21.15.151:3300/0 conn(0x7f1b4015e440 0x7f1b400b9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 >> v1:172.21.15.151:6789/0 conn(0x7f1b4006d4a0 legacy=0x7f1b400d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b400d2bf0 con 0x7f1b400cf040 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f1b380019f0 con 0x7f1b400cf040 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 >> v1:172.21.15.44:6789/0 conn(0x7f1b400cf040 legacy=0x7f1b400b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 --2- 172.21.15.44:0/2178347898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b240039b0 0x7f1b24003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 --2- 172.21.15.44:0/2178347898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 0x7f1b24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 --2- 172.21.15.44:0/2178347898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b240051c0 0x7f1b2400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b400d3520 con 0x7f1b24004800 2024-03-30T13:13:13.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2400c070 con 0x7f1b240051c0 2024-03-30T13:13:13.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1b2400c270 con 0x7f1b240039b0 2024-03-30T13:13:13.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3d400640 1 --2- 172.21.15.44:0/2178347898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 0x7f1b24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3e800640 1 --2- 172.21.15.44:0/2178347898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b240051c0 0x7f1b2400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.951+0000 7f1b3de00640 1 --2- 172.21.15.44:0/2178347898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b240039b0 0x7f1b24003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.952+0000 7f1b3d400640 1 -- 172.21.15.44:0/2178347898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b240039b0 msgr2=0x7f1b24003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.952+0000 7f1b3d400640 1 --2- 172.21.15.44:0/2178347898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b240039b0 0x7f1b24003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.952+0000 7f1b3d400640 1 -- 172.21.15.44:0/2178347898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b240051c0 msgr2=0x7f1b2400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:13.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.952+0000 7f1b3d400640 1 --2- 172.21.15.44:0/2178347898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b240051c0 0x7f1b2400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.952+0000 7f1b3d400640 1 -- 172.21.15.44:0/2178347898 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b24003520 con 0x7f1b24004800 2024-03-30T13:13:13.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.952+0000 7f1b3e800640 1 -- 172.21.15.44:0/2178347898 reap_dead start 2024-03-30T13:13:13.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.953+0000 7f1b3d400640 1 --2- 172.21.15.44:0/2178347898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 0x7f1b24004c80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1b28001750 tx=0x7f1b24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4319090834dcffbc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.953+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28001370 con 0x7f1b24004800 2024-03-30T13:13:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.953+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b280052d0 con 0x7f1b24004800 2024-03-30T13:13:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.953+0000 7f1b3ca00640 1 -- 172.21.15.44:0/2178347898 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b28003830 con 0x7f1b24004800 2024-03-30T13:13:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.954+0000 7f1b45200640 1 -- 172.21.15.44:0/2178347898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 msgr2=0x7f1b24004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.954+0000 7f1b45200640 1 --2- 172.21.15.44:0/2178347898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 0x7f1b24004c80 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1b28001750 tx=0x7f1b24005830 comp rx=0 tx=0).stop 2024-03-30T13:13:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.954+0000 7f1b45200640 1 -- 172.21.15.44:0/2178347898 shutdown_connections 2024-03-30T13:13:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.954+0000 7f1b45200640 1 --2- 172.21.15.44:0/2178347898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 0x7f1b24004c80 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.954+0000 7f1b45200640 1 -- 172.21.15.44:0/2178347898 >> 172.21.15.44:0/2178347898 conn(0x7f1b400676b0 msgr2=0x7f1b40067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.954+0000 7f1b45200640 1 -- 172.21.15.44:0/2178347898 shutdown_connections 2024-03-30T13:13:13.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.954+0000 7f1b45200640 1 -- 172.21.15.44:0/2178347898 wait complete. 2024-03-30T13:13:13.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.956+0000 7f1b45200640 1 Processor -- start 2024-03-30T13:13:13.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.956+0000 7f1b45200640 1 -- start start 2024-03-30T13:13:13.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.957+0000 7f1b45200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 0x7f1b4014b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.957+0000 7f1b45200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b40155360 0x7f1b401557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.957+0000 7f1b45200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b40160b70 0x7f1b40160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.957+0000 7f1b45200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4015e820 con 0x7f1b24004800 2024-03-30T13:13:13.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.957+0000 7f1b45200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1b400d31b0 con 0x7f1b40155360 2024-03-30T13:13:13.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.957+0000 7f1b45200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4015e9a0 con 0x7f1b40160b70 2024-03-30T13:13:13.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.957+0000 7f1b3de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 0x7f1b4014b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.957+0000 7f1b3de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 0x7f1b4014b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57166/0 (socket says 172.21.15.44:57166) 2024-03-30T13:13:13.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.957+0000 7f1b3de00640 1 -- 172.21.15.44:0/68560832 learned_addr learned my addr 172.21.15.44:0/68560832 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:13.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.958+0000 7f1b3d400640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b40155360 0x7f1b401557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.958+0000 7f1b3de00640 1 -- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b40160b70 msgr2=0x7f1b40160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.958+0000 7f1b3de00640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b40160b70 0x7f1b40160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.958+0000 7f1b3de00640 1 -- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b40155360 msgr2=0x7f1b401557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:13.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.958+0000 7f1b3de00640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b40155360 0x7f1b401557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:13.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.958+0000 7f1b3de00640 1 -- 172.21.15.44:0/68560832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b40156ec0 con 0x7f1b24004800 2024-03-30T13:13:13.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.958+0000 7f1b3de00640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 0x7f1b4014b650 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1b30011650 tx=0x7f1b30011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.958+0000 7f1b36000640 1 -- 172.21.15.44:0/68560832 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000f9c0 con 0x7f1b24004800 2024-03-30T13:13:13.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.958+0000 7f1b36000640 1 -- 172.21.15.44:0/68560832 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3000fb60 con 0x7f1b24004800 2024-03-30T13:13:13.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.958+0000 7f1b36000640 1 -- 172.21.15.44:0/68560832 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b30015460 con 0x7f1b24004800 2024-03-30T13:13:13.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.958+0000 7f1b45200640 1 -- 172.21.15.44:0/68560832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b40155e20 con 0x7f1b24004800 2024-03-30T13:13:13.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.958+0000 7f1b45200640 1 -- 172.21.15.44:0/68560832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b401563e0 con 0x7f1b24004800 2024-03-30T13:13:13.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.960+0000 7f1b45200640 1 -- 172.21.15.44:0/68560832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b40156b00 con 0x7f1b24004800 2024-03-30T13:13:13.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.961+0000 7f1b36000640 1 -- 172.21.15.44:0/68560832 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1b30015600 con 0x7f1b24004800 2024-03-30T13:13:13.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.962+0000 7f1b36000640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b1c06c530 0x7f1b1c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:13.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.962+0000 7f1b36000640 1 -- 172.21.15.44:0/68560832 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6412+0+0 (secure 0 0 0) 0x7f1b3008c3b0 con 0x7f1b24004800 2024-03-30T13:13:13.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.962+0000 7f1b3d400640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b1c06c530 0x7f1b1c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:13.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.963+0000 7f1b3d400640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b1c06c530 0x7f1b1c06e9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1b28033000 tx=0x7f1b28009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:13.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:13.966+0000 7f1b36000640 1 -- 172.21.15.44:0/68560832 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1b30019030 con 0x7f1b24004800 2024-03-30T13:13:14.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.169+0000 7f1b45200640 1 -- 172.21.15.44:0/68560832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1b40075900 con 0x7f1b24004800 2024-03-30T13:13:14.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.710+0000 7f1b36000640 1 -- 172.21.15.44:0/68560832 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7f1b3005a710 con 0x7f1b24004800 2024-03-30T13:13:14.715 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-03-30T13:13:14.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.715+0000 7f1b45200640 1 -- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b1c06c530 msgr2=0x7f1b1c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.715+0000 7f1b45200640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b1c06c530 0x7f1b1c06e9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1b28033000 tx=0x7f1b28009030 comp rx=0 tx=0).stop 2024-03-30T13:13:14.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.715+0000 7f1b45200640 1 -- 172.21.15.44:0/68560832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 msgr2=0x7f1b4014b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.715+0000 7f1b45200640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 0x7f1b4014b650 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1b30011650 tx=0x7f1b30011b10 comp rx=0 tx=0).stop 2024-03-30T13:13:14.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.716+0000 7f1b45200640 1 -- 172.21.15.44:0/68560832 shutdown_connections 2024-03-30T13:13:14.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.716+0000 7f1b45200640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b40160b70 0x7f1b40160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.716+0000 7f1b45200640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b1c06c530 0x7f1b1c06e9f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.716+0000 7f1b45200640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b40155360 0x7f1b401557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.716+0000 7f1b45200640 1 --2- 172.21.15.44:0/68560832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1b24004800 0x7f1b4014b650 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.716+0000 7f1b45200640 1 -- 172.21.15.44:0/68560832 >> 172.21.15.44:0/68560832 conn(0x7f1b400676b0 msgr2=0x7f1b400b7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.717+0000 7f1b45200640 1 -- 172.21.15.44:0/68560832 shutdown_connections 2024-03-30T13:13:14.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.717+0000 7f1b45200640 1 -- 172.21.15.44:0/68560832 wait complete. 2024-03-30T13:13:14.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-03-30T13:13:14.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.954+0000 7f4e03e00640 1 Processor -- start 2024-03-30T13:13:14.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.955+0000 7f4e03e00640 1 -- start start 2024-03-30T13:13:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.956+0000 7f4e03e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e040d01c0 0x7f4e040d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.956+0000 7f4e03e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e040ce690 0x7f4e040cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.956+0000 7f4e03e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e0415c780 con 0x7f4e0413f000 2024-03-30T13:13:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.956+0000 7f4e03e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f4e040d0b70 con 0x7f4e040d01c0 2024-03-30T13:13:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.956+0000 7f4e03e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0415ca60 con 0x7f4e040ce690 2024-03-30T13:13:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.956+0000 7f4e02a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4e0413f000 0x7f4e04141fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43112/0 (socket says 172.21.15.44:43112) 2024-03-30T13:13:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.956+0000 7f4e02a00640 1 -- 172.21.15.44:0/2301854851 learned_addr learned my addr 172.21.15.44:0/2301854851 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.957+0000 7f4e02000640 1 --2- 172.21.15.44:0/2301854851 >> v2:172.21.15.151:3300/0 conn(0x7f4e040d01c0 0x7f4e040d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.957+0000 7f4e03400640 1 --2- 172.21.15.44:0/2301854851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e040ce690 0x7f4e040cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.957+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 678388898 0 0) 0x7f4e0415c780 con 0x7f4e0413f000 2024-03-30T13:13:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.957+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4de8003520 con 0x7f4e0413f000 2024-03-30T13:13:14.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1500437410 0 0) 0x7f4de8003520 con 0x7f4e0413f000 2024-03-30T13:13:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e040ce690 msgr2=0x7f4e040cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 --2- 172.21.15.44:0/2301854851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e040ce690 0x7f4e040cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 >> v2:172.21.15.151:3300/0 conn(0x7f4e040d01c0 msgr2=0x7f4e040d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 --2- 172.21.15.44:0/2301854851 >> v2:172.21.15.151:3300/0 conn(0x7f4e040d01c0 0x7f4e040d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0415cd40 con 0x7f4e0413f000 2024-03-30T13:13:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f4df4001690 con 0x7f4e0413f000 2024-03-30T13:13:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 >> v1:172.21.15.44:6789/0 conn(0x7f4e0413f000 legacy=0x7f4e04141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 --2- 172.21.15.44:0/2301854851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e040ce690 0x7f4de80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 --2- 172.21.15.44:0/2301854851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8003f30 0x7f4de8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 --2- 172.21.15.44:0/2301854851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4de8004d40 0x7f4de80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e040d0b70 con 0x7f4de8004d40 2024-03-30T13:13:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0415ca60 con 0x7f4de8003f30 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4de800b9c0 con 0x7f4e040ce690 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e03400640 1 --2- 172.21.15.44:0/2301854851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4de8004d40 0x7f4de80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.958+0000 7f4e02a00640 1 --2- 172.21.15.44:0/2301854851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e040ce690 0x7f4de80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.959+0000 7f4e03400640 1 -- 172.21.15.44:0/2301854851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e040ce690 msgr2=0x7f4de80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.959+0000 7f4e03400640 1 --2- 172.21.15.44:0/2301854851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e040ce690 0x7f4de80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.959+0000 7f4e02000640 1 --2- 172.21.15.44:0/2301854851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8003f30 0x7f4de8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.959+0000 7f4e03400640 1 -- 172.21.15.44:0/2301854851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8003f30 msgr2=0x7f4de8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.959+0000 7f4e03400640 1 --2- 172.21.15.44:0/2301854851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8003f30 0x7f4de8004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.959+0000 7f4e03400640 1 -- 172.21.15.44:0/2301854851 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de8003520 con 0x7f4de8004d40 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.960+0000 7f4e03400640 1 --2- 172.21.15.44:0/2301854851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4de8004d40 0x7f4de80051c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009fc0 tx=0x7f4de8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f084cce47b3ff066 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.960+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc039070 con 0x7f4de8004d40 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.960+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dfc02cc00 con 0x7f4de8004d40 2024-03-30T13:13:14.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.960+0000 7f4e01600640 1 -- 172.21.15.44:0/2301854851 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc009c10 con 0x7f4de8004d40 2024-03-30T13:13:14.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.961+0000 7f4e03e00640 1 -- 172.21.15.44:0/2301854851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4de8004d40 msgr2=0x7f4de80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.961+0000 7f4e03e00640 1 --2- 172.21.15.44:0/2301854851 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4de8004d40 0x7f4de80051c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009fc0 tx=0x7f4de8005830 comp rx=0 tx=0).stop 2024-03-30T13:13:14.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.961+0000 7f4e03400640 1 -- 172.21.15.44:0/2301854851 reap_dead start 2024-03-30T13:13:14.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.961+0000 7f4e03e00640 1 -- 172.21.15.44:0/2301854851 shutdown_connections 2024-03-30T13:13:14.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.961+0000 7f4e03e00640 1 -- 172.21.15.44:0/2301854851 >> 172.21.15.44:0/2301854851 conn(0x7f4e0406b9a0 msgr2=0x7f4e0406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:14.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.961+0000 7f4e03e00640 1 -- 172.21.15.44:0/2301854851 shutdown_connections 2024-03-30T13:13:14.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.961+0000 7f4e03e00640 1 -- 172.21.15.44:0/2301854851 wait complete. 2024-03-30T13:13:14.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.963+0000 7f4e03e00640 1 Processor -- start 2024-03-30T13:13:14.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.963+0000 7f4e03e00640 1 -- start start 2024-03-30T13:13:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4de8004d40 0x7f4e041363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e03e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e0414b2f0 0x7f4e0415d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e03e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e0413d410 0x7f4e0413d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e03e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0413f3e0 con 0x7f4de8004d40 2024-03-30T13:13:14.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e03e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4e041426d0 con 0x7f4e0413d410 2024-03-30T13:13:14.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e03e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0413f560 con 0x7f4e0414b2f0 2024-03-30T13:13:14.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e02a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4de8004d40 0x7f4e041363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e02a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4de8004d40 0x7f4e041363e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57190/0 (socket says 172.21.15.44:57190) 2024-03-30T13:13:14.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e02a00640 1 -- 172.21.15.44:0/1675041507 learned_addr learned my addr 172.21.15.44:0/1675041507 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:14.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e02000640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e0414b2f0 0x7f4e0415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e03400640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e0413d410 0x7f4e0413d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e02a00640 1 -- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e0414b2f0 msgr2=0x7f4e0415d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e02a00640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e0414b2f0 0x7f4e0415d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e02a00640 1 -- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e0413d410 msgr2=0x7f4e0413d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:14.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e02a00640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e0413d410 0x7f4e0413d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:14.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e02a00640 1 -- 172.21.15.44:0/1675041507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e041490a0 con 0x7f4de8004d40 2024-03-30T13:13:14.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.964+0000 7f4e03400640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e0413d410 0x7f4e0413d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:14.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.965+0000 7f4e02a00640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4de8004d40 0x7f4e041363e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4df400e8a0 tx=0x7f4df400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.965+0000 7f4dfaa00640 1 -- 172.21.15.44:0/1675041507 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df400c850 con 0x7f4de8004d40 2024-03-30T13:13:14.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.965+0000 7f4dfaa00640 1 -- 172.21.15.44:0/1675041507 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df4018070 con 0x7f4de8004d40 2024-03-30T13:13:14.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.965+0000 7f4dfaa00640 1 -- 172.21.15.44:0/1675041507 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df400cc30 con 0x7f4de8004d40 2024-03-30T13:13:14.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.965+0000 7f4e03e00640 1 -- 172.21.15.44:0/1675041507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e04149380 con 0x7f4de8004d40 2024-03-30T13:13:14.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.965+0000 7f4e03e00640 1 -- 172.21.15.44:0/1675041507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e04149940 con 0x7f4de8004d40 2024-03-30T13:13:14.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.966+0000 7f4e03e00640 1 -- 172.21.15.44:0/1675041507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e04075890 con 0x7f4de8004d40 2024-03-30T13:13:14.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.967+0000 7f4dfaa00640 1 -- 172.21.15.44:0/1675041507 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4df4013420 con 0x7f4de8004d40 2024-03-30T13:13:14.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.968+0000 7f4dfaa00640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4de406c560 0x7f4de406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:14.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.968+0000 7f4dfaa00640 1 -- 172.21.15.44:0/1675041507 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5853+0+0 (secure 0 0 0) 0x7f4df408b4b0 con 0x7f4de8004d40 2024-03-30T13:13:14.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.969+0000 7f4e02000640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4de406c560 0x7f4de406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:14.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.970+0000 7f4e02000640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4de406c560 0x7f4de406ea20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4e0414e960 tx=0x7f4df0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:14.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:14.973+0000 7f4dfaa00640 1 -- 172.21.15.44:0/1675041507 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4df40599a0 con 0x7f4de8004d40 2024-03-30T13:13:15.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.191+0000 7f4e03e00640 1 -- 172.21.15.44:0/1675041507 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4e040736c0 con 0x7f4de8004d40 2024-03-30T13:13:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.713+0000 7f4dfaa00640 1 -- 172.21.15.44:0/1675041507 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7f4df40592a0 con 0x7f4de8004d40 2024-03-30T13:13:15.718 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data_ec' removed 2024-03-30T13:13:15.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.719+0000 7f4e03e00640 1 -- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4de406c560 msgr2=0x7f4de406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.719+0000 7f4e03e00640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4de406c560 0x7f4de406ea20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4e0414e960 tx=0x7f4df0008040 comp rx=0 tx=0).stop 2024-03-30T13:13:15.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.719+0000 7f4e03e00640 1 -- 172.21.15.44:0/1675041507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4de8004d40 msgr2=0x7f4e041363e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:15.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.719+0000 7f4e03e00640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4de8004d40 0x7f4e041363e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4df400e8a0 tx=0x7f4df400ed60 comp rx=0 tx=0).stop 2024-03-30T13:13:15.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.719+0000 7f4e03e00640 1 -- 172.21.15.44:0/1675041507 shutdown_connections 2024-03-30T13:13:15.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.719+0000 7f4e03e00640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4de406c560 0x7f4de406ea20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.719+0000 7f4e03e00640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e0413d410 0x7f4e0413d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.719+0000 7f4e03e00640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4e0414b2f0 0x7f4e0415d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.719+0000 7f4e03e00640 1 --2- 172.21.15.44:0/1675041507 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4de8004d40 0x7f4e041363e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.719+0000 7f4e03e00640 1 -- 172.21.15.44:0/1675041507 >> 172.21.15.44:0/1675041507 conn(0x7f4e0406b9a0 msgr2=0x7f4e04151680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:15.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.720+0000 7f4e03e00640 1 -- 172.21.15.44:0/1675041507 shutdown_connections 2024-03-30T13:13:15.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:15.721+0000 7f4e03e00640 1 -- 172.21.15.44:0/1675041507 wait complete. 2024-03-30T13:13:15.747 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-30T13:13:15.747 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-30T13:13:15.748 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-30T13:13:15.748 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:13:15.748 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-30T13:13:15.748 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-30T13:13:15.748 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-30T13:13:15.748 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:13:15.749 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-30T13:13:15.749 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-30T13:13:15.749 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-30T13:13:15.749 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:13:15.749 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-30T13:13:15.749 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-30T13:13:15.749 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-30T13:13:15.749 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:13:15.771 INFO:tasks.ceph.mds.b:Stopped 2024-03-30T13:13:15.771 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-30T13:13:15.772 INFO:tasks.ceph.mds.c:Stopped 2024-03-30T13:13:15.772 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-30T13:13:15.774 INFO:tasks.ceph.mds.d:Stopped 2024-03-30T13:13:15.774 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-30T13:13:15.775 INFO:tasks.ceph.mds.a:Stopped 2024-03-30T13:13:15.776 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-30T13:13:15.820 INFO:tasks.ceph.mds.b:Started 2024-03-30T13:13:15.821 DEBUG:teuthology.parallel:result is None 2024-03-30T13:13:15.821 INFO:tasks.ceph.mds.c:Started 2024-03-30T13:13:15.822 DEBUG:teuthology.parallel:result is None 2024-03-30T13:13:15.826 INFO:tasks.ceph.mds.d:Started 2024-03-30T13:13:15.827 DEBUG:teuthology.parallel:result is None 2024-03-30T13:13:15.828 INFO:tasks.ceph.mds.a:Started 2024-03-30T13:13:15.828 DEBUG:teuthology.parallel:result is None 2024-03-30T13:13:15.828 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-30T13:13:15.980 INFO:tasks.ceph.mds.c.smithi044.stdout:starting mds.c at 2024-03-30T13:13:15.984 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2024-03-30T13:13:15.986 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2024-03-30T13:13:15.987 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-03-30T13:13:16.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.017+0000 7fb0bfa00640 1 Processor -- start 2024-03-30T13:13:16.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.017+0000 7fb0bfa00640 1 -- start start 2024-03-30T13:13:16.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.018+0000 7fb0bfa00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b815e4f0 0x7fb0b80cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.018+0000 7fb0bfa00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b80b9d20 con 0x7fb0b80b7530 2024-03-30T13:13:16.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.019+0000 7fb0bfa00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b80ba000 con 0x7fb0b80d30c0 2024-03-30T13:13:16.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.019+0000 7fb0bfa00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b80ba2e0 con 0x7fb0b815e4f0 2024-03-30T13:13:16.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.019+0000 7fb0b7e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb0b80b7530 0x7fb0b80d29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43120/0 (socket says 172.21.15.44:43120) 2024-03-30T13:13:16.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.019+0000 7fb0b7e00640 1 -- 172.21.15.44:0/2431355036 learned_addr learned my addr 172.21.15.44:0/2431355036 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:16.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.019+0000 7fb0bd000640 1 --2- 172.21.15.44:0/2431355036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b815e4f0 0x7fb0b80cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.019+0000 7fb0b7400640 1 -- 172.21.15.44:0/2431355036 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581116200 0 0) 0x7fb0b80b9d20 con 0x7fb0b80b7530 2024-03-30T13:13:16.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.019+0000 7fb0b7400640 1 -- 172.21.15.44:0/2431355036 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0a0003520 con 0x7fb0b80b7530 2024-03-30T13:13:16.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.019+0000 7fb0bd000640 1 -- 172.21.15.44:0/2431355036 >> v1:172.21.15.151:6789/0 conn(0x7fb0b80d30c0 legacy=0x7fb0b80d3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.019+0000 7fb0bd000640 1 -- 172.21.15.44:0/2431355036 >> v1:172.21.15.44:6789/0 conn(0x7fb0b80b7530 legacy=0x7fb0b80d29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.019+0000 7fb0bd000640 1 -- 172.21.15.44:0/2431355036 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b80ceaf0 con 0x7fb0b815e4f0 2024-03-30T13:13:16.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.021+0000 7fb0bd000640 1 --2- 172.21.15.44:0/2431355036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b815e4f0 0x7fb0b80cf460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0097d0 tx=0x7fb0ac02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31f7cf9bc0df8da6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.021+0000 7fb0b7400640 1 -- 172.21.15.44:0/2431355036 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac035020 con 0x7fb0b815e4f0 2024-03-30T13:13:16.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.021+0000 7fb0b7400640 1 -- 172.21.15.44:0/2431355036 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0ac031800 con 0x7fb0b815e4f0 2024-03-30T13:13:16.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.021+0000 7fb0b7400640 1 -- 172.21.15.44:0/2431355036 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac031bb0 con 0x7fb0b815e4f0 2024-03-30T13:13:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.022+0000 7fb0bfa00640 1 -- 172.21.15.44:0/2431355036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b815e4f0 msgr2=0x7fb0b80cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.022+0000 7fb0bfa00640 1 --2- 172.21.15.44:0/2431355036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b815e4f0 0x7fb0b80cf460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0097d0 tx=0x7fb0ac02b8a0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.022+0000 7fb0bfa00640 1 -- 172.21.15.44:0/2431355036 shutdown_connections 2024-03-30T13:13:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.022+0000 7fb0bfa00640 1 --2- 172.21.15.44:0/2431355036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b815e4f0 0x7fb0b80cf460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.022+0000 7fb0bfa00640 1 -- 172.21.15.44:0/2431355036 >> 172.21.15.44:0/2431355036 conn(0x7fb0b80676e0 msgr2=0x7fb0b8067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.022+0000 7fb0bfa00640 1 -- 172.21.15.44:0/2431355036 shutdown_connections 2024-03-30T13:13:16.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.022+0000 7fb0bfa00640 1 -- 172.21.15.44:0/2431355036 wait complete. 2024-03-30T13:13:16.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.024+0000 7fb0bfa00640 1 Processor -- start 2024-03-30T13:13:16.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.024+0000 7fb0bfa00640 1 -- start start 2024-03-30T13:13:16.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.025+0000 7fb0bfa00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b80b7530 0x7fb0b80b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.025+0000 7fb0bfa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0b80d30c0 0x7fb0b81f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.025+0000 7fb0bfa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b815e4f0 0x7fb0b80c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.025+0000 7fb0bfa00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b815ea50 con 0x7fb0b80d30c0 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.025+0000 7fb0bfa00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b815e8d0 con 0x7fb0b815e4f0 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.025+0000 7fb0bfa00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b80b7990 con 0x7fb0b80b7530 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.025+0000 7fb0b7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0b80d30c0 0x7fb0b81f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.025+0000 7fb0b7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0b80d30c0 0x7fb0b81f8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57208/0 (socket says 172.21.15.44:57208) 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.025+0000 7fb0b7e00640 1 -- 172.21.15.44:0/172830874 learned_addr learned my addr 172.21.15.44:0/172830874 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.025+0000 7fb0bd000640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b80b7530 0x7fb0b80b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.025+0000 7fb0bda00640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b815e4f0 0x7fb0b80c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.026+0000 7fb0b7e00640 1 -- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b80b7530 msgr2=0x7fb0b80b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.026+0000 7fb0b7e00640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b80b7530 0x7fb0b80b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.026+0000 7fb0b7e00640 1 -- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b815e4f0 msgr2=0x7fb0b80c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.026+0000 7fb0b7e00640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b815e4f0 0x7fb0b80c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.026+0000 7fb0b7e00640 1 -- 172.21.15.44:0/172830874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b81f86a0 con 0x7fb0b80d30c0 2024-03-30T13:13:16.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.026+0000 7fb0b7e00640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0b80d30c0 0x7fb0b81f8010 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400c500 tx=0x7fb0a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.026+0000 7fb0b4c00640 1 -- 172.21.15.44:0/172830874 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4017070 con 0x7fb0b80d30c0 2024-03-30T13:13:16.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.026+0000 7fb0b4c00640 1 -- 172.21.15.44:0/172830874 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a4005ce0 con 0x7fb0b80d30c0 2024-03-30T13:13:16.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.026+0000 7fb0b4c00640 1 -- 172.21.15.44:0/172830874 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4007330 con 0x7fb0b80d30c0 2024-03-30T13:13:16.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.026+0000 7fb0bfa00640 1 -- 172.21.15.44:0/172830874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b81f8980 con 0x7fb0b80d30c0 2024-03-30T13:13:16.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.027+0000 7fb0bfa00640 1 -- 172.21.15.44:0/172830874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b81f78c0 con 0x7fb0b80d30c0 2024-03-30T13:13:16.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.028+0000 7fb0bfa00640 1 -- 172.21.15.44:0/172830874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b8075a10 con 0x7fb0b80d30c0 2024-03-30T13:13:16.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.029+0000 7fb0b4c00640 1 -- 172.21.15.44:0/172830874 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb0a401a070 con 0x7fb0b80d30c0 2024-03-30T13:13:16.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.030+0000 7fb0b4c00640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb09806c530 0x7fb09806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.030+0000 7fb0b4c00640 1 -- 172.21.15.44:0/172830874 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5335+0+0 (secure 0 0 0) 0x7fb0a408a8b0 con 0x7fb0b80d30c0 2024-03-30T13:13:16.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.030+0000 7fb0bd000640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb09806c530 0x7fb09806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.031+0000 7fb0bd000640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb09806c530 0x7fb09806e9f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac036000 tx=0x7fb0ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.035+0000 7fb0b4c00640 1 -- 172.21.15.44:0/172830874 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb0a4058b40 con 0x7fb0b80d30c0 2024-03-30T13:13:16.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.261+0000 7fb0bfa00640 1 -- 172.21.15.44:0/172830874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb0b80b6ce0 con 0x7fb0b80d30c0 2024-03-30T13:13:16.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.750+0000 7fb0b4c00640 1 -- 172.21.15.44:0/172830874 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) ==== 97+0+0 (secure 0 0 0) 0x7fb0a405ce40 con 0x7fb0b80d30c0 2024-03-30T13:13:16.755 INFO:teuthology.orchestra.run.smithi044.stderr: removed all blocklist entries 2024-03-30T13:13:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.755+0000 7fb0bfa00640 1 -- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb09806c530 msgr2=0x7fb09806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.755+0000 7fb0bfa00640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb09806c530 0x7fb09806e9f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac036000 tx=0x7fb0ac008030 comp rx=0 tx=0).stop 2024-03-30T13:13:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.755+0000 7fb0bfa00640 1 -- 172.21.15.44:0/172830874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0b80d30c0 msgr2=0x7fb0b81f8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.755+0000 7fb0bfa00640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0b80d30c0 0x7fb0b81f8010 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400c500 tx=0x7fb0a400c9c0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.755+0000 7fb0bfa00640 1 -- 172.21.15.44:0/172830874 shutdown_connections 2024-03-30T13:13:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.755+0000 7fb0bfa00640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb09806c530 0x7fb09806e9f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.755+0000 7fb0bfa00640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b815e4f0 0x7fb0b80c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.755+0000 7fb0bfa00640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0b80d30c0 0x7fb0b81f8010 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.755+0000 7fb0bfa00640 1 --2- 172.21.15.44:0/172830874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b80b7530 0x7fb0b80b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.755+0000 7fb0bfa00640 1 -- 172.21.15.44:0/172830874 >> 172.21.15.44:0/172830874 conn(0x7fb0b80676e0 msgr2=0x7fb0b80d3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.756+0000 7fb0bfa00640 1 -- 172.21.15.44:0/172830874 shutdown_connections 2024-03-30T13:13:16.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.756+0000 7fb0bfa00640 1 -- 172.21.15.44:0/172830874 wait complete. 2024-03-30T13:13:16.782 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-30T13:13:16.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.981+0000 7f2af2200640 1 Processor -- start 2024-03-30T13:13:16.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.981+0000 7f2af2200640 1 -- start start 2024-03-30T13:13:16.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.983+0000 7f2af2200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2aec1562f0 0x7f2aec1566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.983+0000 7f2af2200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2aec142300 0x7f2aec0d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.983+0000 7f2af2200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2aec0d07d0 0x7f2aec15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.983+0000 7f2af2200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2aec156c10 con 0x7f2aec0d07d0 2024-03-30T13:13:16.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.983+0000 7f2af2200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f2aec0d0c40 con 0x7f2aec1562f0 2024-03-30T13:13:16.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.983+0000 7f2af2200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f2aec160c20 con 0x7f2aec142300 2024-03-30T13:13:16.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.983+0000 7f2af1800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2aec0d07d0 0x7f2aec15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.983+0000 7f2af1800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2aec0d07d0 0x7f2aec15ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60276/0 (socket says 172.21.15.44:60276) 2024-03-30T13:13:16.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.983+0000 7f2af1800640 1 -- 172.21.15.44:0/1150216609 learned_addr learned my addr 172.21.15.44:0/1150216609 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:16.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.984+0000 7f2aebe00640 1 --2- 172.21.15.44:0/1150216609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2aec142300 0x7f2aec0d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.984+0000 7f2af0e00640 1 --2- 172.21.15.44:0/1150216609 >> v2:172.21.15.151:3300/0 conn(0x7f2aec1562f0 0x7f2aec1566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.984+0000 7f2af1800640 1 -- 172.21.15.44:0/1150216609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2aec142300 msgr2=0x7f2aec0d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.984+0000 7f2af1800640 1 --2- 172.21.15.44:0/1150216609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2aec142300 0x7f2aec0d0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.984+0000 7f2af1800640 1 -- 172.21.15.44:0/1150216609 >> v2:172.21.15.151:3300/0 conn(0x7f2aec1562f0 msgr2=0x7f2aec1566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:16.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.984+0000 7f2af1800640 1 --2- 172.21.15.44:0/1150216609 >> v2:172.21.15.151:3300/0 conn(0x7f2aec1562f0 0x7f2aec1566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.984+0000 7f2af1800640 1 -- 172.21.15.44:0/1150216609 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec1427b0 con 0x7f2aec0d07d0 2024-03-30T13:13:16.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.984+0000 7f2af0e00640 1 --2- 172.21.15.44:0/1150216609 >> v2:172.21.15.151:3300/0 conn(0x7f2aec1562f0 0x7f2aec1566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:16.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.985+0000 7f2af1800640 1 --2- 172.21.15.44:0/1150216609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d07d0 0x7f2aec15ca90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2aec06f2c0 tx=0x7f2ae402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa43f0d2fbe251d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.986+0000 7f2aeb400640 1 -- 172.21.15.44:0/1150216609 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae402ca70 con 0x7f2aec0d07d0 2024-03-30T13:13:16.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.986+0000 7f2aeb400640 1 -- 172.21.15.44:0/1150216609 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae402cc10 con 0x7f2aec0d07d0 2024-03-30T13:13:16.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.986+0000 7f2aeb400640 1 -- 172.21.15.44:0/1150216609 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40343f0 con 0x7f2aec0d07d0 2024-03-30T13:13:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.986+0000 7f2af2200640 1 -- 172.21.15.44:0/1150216609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d07d0 msgr2=0x7f2aec15ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.986+0000 7f2af2200640 1 --2- 172.21.15.44:0/1150216609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d07d0 0x7f2aec15ca90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2aec06f2c0 tx=0x7f2ae402bed0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.987+0000 7f2af2200640 1 -- 172.21.15.44:0/1150216609 shutdown_connections 2024-03-30T13:13:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.987+0000 7f2af2200640 1 --2- 172.21.15.44:0/1150216609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec0d07d0 0x7f2aec15ca90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.987+0000 7f2af2200640 1 --2- 172.21.15.44:0/1150216609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2aec142300 0x7f2aec0d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.987+0000 7f2af2200640 1 --2- 172.21.15.44:0/1150216609 >> v2:172.21.15.151:3300/0 conn(0x7f2aec1562f0 0x7f2aec1566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.987+0000 7f2af2200640 1 -- 172.21.15.44:0/1150216609 >> 172.21.15.44:0/1150216609 conn(0x7f2aec06b9a0 msgr2=0x7f2aec06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.987+0000 7f2af2200640 1 -- 172.21.15.44:0/1150216609 shutdown_connections 2024-03-30T13:13:16.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.987+0000 7f2af2200640 1 -- 172.21.15.44:0/1150216609 wait complete. 2024-03-30T13:13:16.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.988+0000 7f2af2200640 1 Processor -- start 2024-03-30T13:13:16.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.989+0000 7f2af2200640 1 -- start start 2024-03-30T13:13:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.990+0000 7f2af2200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2aec0d07d0 0x7f2aec13c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.990+0000 7f2af2200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2aec142300 0x7f2aec0b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.990+0000 7f2af2200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1562f0 0x7f2aec15b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.990+0000 7f2af2200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec160660 con 0x7f2aec1562f0 2024-03-30T13:13:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.990+0000 7f2af2200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec160380 con 0x7f2aec0d07d0 2024-03-30T13:13:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.990+0000 7f2af2200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f2aec160940 con 0x7f2aec142300 2024-03-30T13:13:16.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.990+0000 7f2af1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1562f0 0x7f2aec15b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.990+0000 7f2af1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1562f0 0x7f2aec15b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60284/0 (socket says 172.21.15.44:60284) 2024-03-30T13:13:16.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.990+0000 7f2af1800640 1 -- 172.21.15.44:0/1844793788 learned_addr learned my addr 172.21.15.44:0/1844793788 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:16.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.990+0000 7f2af0e00640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2aec0d07d0 0x7f2aec13c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.990+0000 7f2aebe00640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2aec142300 0x7f2aec0b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:16.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.991+0000 7f2af1800640 1 -- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2aec142300 msgr2=0x7f2aec0b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.991+0000 7f2af1800640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2aec142300 0x7f2aec0b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.991+0000 7f2af1800640 1 -- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2aec0d07d0 msgr2=0x7f2aec13c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:16.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.991+0000 7f2af1800640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2aec0d07d0 0x7f2aec13c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:16.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.991+0000 7f2af1800640 1 -- 172.21.15.44:0/1844793788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec0b4ef0 con 0x7f2aec1562f0 2024-03-30T13:13:16.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.991+0000 7f2af1800640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1562f0 0x7f2aec15b1a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4036040 tx=0x7f2ae4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:16.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.991+0000 7f2ae8c00640 1 -- 172.21.15.44:0/1844793788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4043020 con 0x7f2aec1562f0 2024-03-30T13:13:16.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.991+0000 7f2ae8c00640 1 -- 172.21.15.44:0/1844793788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae403e450 con 0x7f2aec1562f0 2024-03-30T13:13:16.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.991+0000 7f2ae8c00640 1 -- 172.21.15.44:0/1844793788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4009510 con 0x7f2aec1562f0 2024-03-30T13:13:16.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.991+0000 7f2af2200640 1 -- 172.21.15.44:0/1844793788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aec0b3f10 con 0x7f2aec1562f0 2024-03-30T13:13:16.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.992+0000 7f2af2200640 1 -- 172.21.15.44:0/1844793788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aec15cda0 con 0x7f2aec1562f0 2024-03-30T13:13:16.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.993+0000 7f2af2200640 1 -- 172.21.15.44:0/1844793788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aec075890 con 0x7f2aec1562f0 2024-03-30T13:13:16.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.994+0000 7f2ae8c00640 1 -- 172.21.15.44:0/1844793788 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2ae4046020 con 0x7f2aec1562f0 2024-03-30T13:13:16.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.994+0000 7f2ae8c00640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2ac806c530 0x7f2ac806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:16.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.994+0000 7f2ae8c00640 1 -- 172.21.15.44:0/1844793788 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f2ae40ade60 con 0x7f2aec1562f0 2024-03-30T13:13:17.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.995+0000 7f2af0e00640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2ac806c530 0x7f2ac806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.996+0000 7f2af0e00640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2ac806c530 0x7f2ac806e9f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2aec141260 tx=0x7f2adc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:16.999+0000 7f2ae8c00640 1 -- 172.21.15.44:0/1844793788 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2ae404d030 con 0x7f2aec1562f0 2024-03-30T13:13:17.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.280+0000 7f2af2200640 1 -- 172.21.15.44:0/1844793788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f2aec06ef60 con 0x7f2aec1562f0 2024-03-30T13:13:17.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.281+0000 7f2ae8c00640 1 -- 172.21.15.44:0/1844793788 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f2ae407c630 con 0x7f2aec1562f0 2024-03-30T13:13:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:17.286 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:13:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_dump": [ 2024-03-30T13:13:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.a", 2024-03-30T13:13:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBJDwhmsO/RHRAA4BKmSytiyQ/wu5TjZH+g9Q==", 2024-03-30T13:13:17.286 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.b", 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBKDwhmlMyVBRAAnsiOGIMLKztsB6GsCUOD8g==", 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-03-30T13:13:17.287 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.c", 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBJDwhmYCuVLxAAsEk/EJeDxb9jQUzQUkZj7Q==", 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.288 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mds.d", 2024-03-30T13:13:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBKDwhmkdwsFhAAu5gTZsaCCfXk9I+TJkw2yA==", 2024-03-30T13:13:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-03-30T13:13:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-03-30T13:13:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-03-30T13:13:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.0", 2024-03-30T13:13:17.289 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBPDwhmEKvHEhAAdueNOQAKRcQYDEPD+l8igA==", 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.1", 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBSDwhmYwKPLhAAhdKfz1MusyAbTC4/njth0w==", 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-03-30T13:13:17.290 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.2", 2024-03-30T13:13:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBWDwhmrI5xDBAAQK4JjvNpLRAs3FZAOKajWQ==", 2024-03-30T13:13:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-03-30T13:13:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-03-30T13:13:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.291 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.3", 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBZDwhmAbCSJhAAaIfF/vKvPpZhUQidEbnESQ==", 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.4", 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBgDwhmZzmmKRAAnSeWY9Hrlp/Jkn01wNBOYw==", 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-03-30T13:13:17.292 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.5", 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBkDwhmVV9JBxAA6L8zG27q3ECaddq0284Wzg==", 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.6", 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBnDwhm/NhEIBAARHcV2Jg/q9SmvDVc8u+bdQ==", 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.293 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "osd.7", 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBqDwhm3p71KhAAXlXxNPOIHgVtZJAUgWKO2A==", 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow profile osd", 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile osd", 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.294 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.0", 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBKDwhmQIprJBAAmTYCUPcFur+aT859aD7+jQ==", 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.1", 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBKDwhmKpPWOhAAkHjzBEZJrsB6qa6LThgMJw==", 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-03-30T13:13:17.295 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.2", 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBKDwhmwj8GMBAAxmghTPYKPD+59J1RMq9MvA==", 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.3", 2024-03-30T13:13:17.296 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBLDwhmA2WzCRAAX5J+afnSm4E2XjI256PLBA==", 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow", 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow r", 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow rw", 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow rwx" 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.admin", 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBIDwhm2i3KDxAAswDuFIOm3tZhSGDQxo4mzA==", 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: "mgr": "allow *", 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow *", 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.297 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-mds", 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQB4DwhmCivXJRAAfJbXVg+B3kVbjT7qfqCaaQ==", 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-mds" 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-mgr", 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQB4Dwhmsj/XJRAAmOjL0a5UqPYaaYjRr9tLMg==", 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-30T13:13:17.298 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-osd", 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQB4DwhmKlLXJRAA2enzJrmF2wxcf3pYi4o7FQ==", 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-osd" 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rbd", 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQB4Dwhm2GTXJRAAReO0q/DU+g1XUuWuc1zTxQ==", 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQB4DwhmHXfXJRAABiv5E/OALMTRfzDq+8YJqg==", 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "client.bootstrap-rgw", 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQB4DwhmF4rXJRAAUn5fFY5P7YKv/SNKUTtj4w==", 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.300 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.x", 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBJDwhmigdHERAAzZDywQSje3Jpak4h9qiEdA==", 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: "entity": "mgr.y", 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "AQBJDwhmjyVdBRAAGrsoIJmc1xKgpPh234615w==", 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": { 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: "mds": "allow *", 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: "mon": "allow profile mgr", 2024-03-30T13:13:17.301 INFO:teuthology.orchestra.run.smithi044.stdout: "osd": "allow *" 2024-03-30T13:13:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:17.302 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-03-30T13:13:17.302 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:13:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.284+0000 7f2af2200640 1 -- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2ac806c530 msgr2=0x7f2ac806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.284+0000 7f2af2200640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2ac806c530 0x7f2ac806e9f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2aec141260 tx=0x7f2adc008040 comp rx=0 tx=0).stop 2024-03-30T13:13:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.284+0000 7f2af2200640 1 -- 172.21.15.44:0/1844793788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1562f0 msgr2=0x7f2aec15b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.284+0000 7f2af2200640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1562f0 0x7f2aec15b1a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4036040 tx=0x7f2ae4004a40 comp rx=0 tx=0).stop 2024-03-30T13:13:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.284+0000 7f2af2200640 1 -- 172.21.15.44:0/1844793788 shutdown_connections 2024-03-30T13:13:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.284+0000 7f2af2200640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2aec1562f0 0x7f2aec15b1a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.284+0000 7f2af2200640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2aec142300 0x7f2aec0b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.284+0000 7f2af2200640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2ac806c530 0x7f2ac806e9f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.284+0000 7f2af2200640 1 --2- 172.21.15.44:0/1844793788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2aec0d07d0 0x7f2aec13c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.284+0000 7f2af2200640 1 -- 172.21.15.44:0/1844793788 >> 172.21.15.44:0/1844793788 conn(0x7f2aec06b9a0 msgr2=0x7f2aec0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.284+0000 7f2af2200640 1 -- 172.21.15.44:0/1844793788 shutdown_connections 2024-03-30T13:13:17.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.284+0000 7f2af2200640 1 -- 172.21.15.44:0/1844793788 wait complete. 2024-03-30T13:13:17.308 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-30T13:13:17.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.525+0000 7ff1d1800640 1 Processor -- start 2024-03-30T13:13:17.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.525+0000 7ff1d1800640 1 -- start start 2024-03-30T13:13:17.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.526+0000 7ff1d1800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1cc0cce10 0x7ff1cc166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.526+0000 7ff1d1800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff1cc0ca340 0x7ff1cc0ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.526+0000 7ff1d1800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1cc162b50 con 0x7ff1cc162770 2024-03-30T13:13:17.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.526+0000 7ff1d1800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff1cc0ce290 con 0x7ff1cc0ca340 2024-03-30T13:13:17.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.526+0000 7ff1d1800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff1cc0caab0 con 0x7ff1cc0cce10 2024-03-30T13:13:17.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.527+0000 7ff1d0e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff1cc0ca340 0x7ff1cc0ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.527+0000 7ff1c3e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1cc0cce10 0x7ff1cc166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.527+0000 7ff1d0e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff1cc0ca340 0x7ff1cc0ce720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60292/0 (socket says 172.21.15.44:60292) 2024-03-30T13:13:17.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.527+0000 7ff1d0e00640 1 -- 172.21.15.44:0/1275960218 learned_addr learned my addr 172.21.15.44:0/1275960218 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:17.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.528+0000 7ff1d0e00640 1 -- 172.21.15.44:0/1275960218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1cc0cce10 msgr2=0x7ff1cc166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:17.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.528+0000 7ff1d0e00640 1 --2- 172.21.15.44:0/1275960218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1cc0cce10 0x7ff1cc166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.528+0000 7ff1d0e00640 1 -- 172.21.15.44:0/1275960218 >> v1:172.21.15.151:6789/0 conn(0x7ff1cc162770 legacy=0x7ff1cc0cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.528+0000 7ff1d0e00640 1 -- 172.21.15.44:0/1275960218 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1cc0cd960 con 0x7ff1cc0ca340 2024-03-30T13:13:17.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.529+0000 7ff1d0e00640 1 --2- 172.21.15.44:0/1275960218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1cc0ca340 0x7ff1cc0ce720 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009e50 tx=0x7ff1c402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfcd55f784a883 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.529+0000 7ff1cb400640 1 -- 172.21.15.44:0/1275960218 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c402cb00 con 0x7ff1cc0ca340 2024-03-30T13:13:17.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.529+0000 7ff1cb400640 1 -- 172.21.15.44:0/1275960218 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c402cca0 con 0x7ff1cc0ca340 2024-03-30T13:13:17.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.529+0000 7ff1cb400640 1 -- 172.21.15.44:0/1275960218 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4034610 con 0x7ff1cc0ca340 2024-03-30T13:13:17.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.530+0000 7ff1d1800640 1 -- 172.21.15.44:0/1275960218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1cc0ca340 msgr2=0x7ff1cc0ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.530+0000 7ff1d1800640 1 --2- 172.21.15.44:0/1275960218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1cc0ca340 0x7ff1cc0ce720 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009e50 tx=0x7ff1c402bf60 comp rx=0 tx=0).stop 2024-03-30T13:13:17.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.530+0000 7ff1d1800640 1 -- 172.21.15.44:0/1275960218 shutdown_connections 2024-03-30T13:13:17.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.530+0000 7ff1d1800640 1 --2- 172.21.15.44:0/1275960218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1cc0ca340 0x7ff1cc0ce720 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.530+0000 7ff1d1800640 1 --2- 172.21.15.44:0/1275960218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1cc0cce10 0x7ff1cc166dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.530+0000 7ff1d1800640 1 -- 172.21.15.44:0/1275960218 >> 172.21.15.44:0/1275960218 conn(0x7ff1cc0b1800 msgr2=0x7ff1cc0b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.530+0000 7ff1d1800640 1 -- 172.21.15.44:0/1275960218 shutdown_connections 2024-03-30T13:13:17.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.530+0000 7ff1d1800640 1 -- 172.21.15.44:0/1275960218 wait complete. 2024-03-30T13:13:17.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.532+0000 7ff1d1800640 1 Processor -- start 2024-03-30T13:13:17.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.532+0000 7ff1d1800640 1 -- start start 2024-03-30T13:13:17.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.533+0000 7ff1d1800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1cc0ca340 0x7ff1cc1656a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.533+0000 7ff1d1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1cc0cce10 0x7ff1cc163730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.533+0000 7ff1d1800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1cc162770 0x7ff1cc152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.533+0000 7ff1d1800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc0ca7d0 con 0x7ff1cc0cce10 2024-03-30T13:13:17.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.533+0000 7ff1d1800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc0cdf20 con 0x7ff1cc162770 2024-03-30T13:13:17.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.533+0000 7ff1d1800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff1cc0cec60 con 0x7ff1cc0ca340 2024-03-30T13:13:17.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.533+0000 7ff1c3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1cc0cce10 0x7ff1cc163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.533+0000 7ff1c3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1cc0cce10 0x7ff1cc163730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60296/0 (socket says 172.21.15.44:60296) 2024-03-30T13:13:17.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.533+0000 7ff1c3e00640 1 -- 172.21.15.44:0/2306143219 learned_addr learned my addr 172.21.15.44:0/2306143219 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:17.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.534+0000 7ff1cbe00640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1cc0ca340 0x7ff1cc1656a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.534+0000 7ff1d0e00640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1cc162770 0x7ff1cc152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.534+0000 7ff1c3e00640 1 -- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1cc0ca340 msgr2=0x7ff1cc1656a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.534+0000 7ff1c3e00640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1cc0ca340 0x7ff1cc1656a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.534+0000 7ff1c3e00640 1 -- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1cc162770 msgr2=0x7ff1cc152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.534+0000 7ff1c3e00640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1cc162770 0x7ff1cc152390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.534+0000 7ff1c3e00640 1 -- 172.21.15.44:0/2306143219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1cc0c4690 con 0x7ff1cc0cce10 2024-03-30T13:13:17.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.534+0000 7ff1c3e00640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1cc0cce10 0x7ff1cc163730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400e9b0 tx=0x7ff1b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.534+0000 7ff1c8c00640 1 -- 172.21.15.44:0/2306143219 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4017070 con 0x7ff1cc0cce10 2024-03-30T13:13:17.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.534+0000 7ff1c8c00640 1 -- 172.21.15.44:0/2306143219 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b400c9a0 con 0x7ff1cc0cce10 2024-03-30T13:13:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.534+0000 7ff1c8c00640 1 -- 172.21.15.44:0/2306143219 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400cd90 con 0x7ff1cc0cce10 2024-03-30T13:13:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.534+0000 7ff1d1800640 1 -- 172.21.15.44:0/2306143219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1cc0c4970 con 0x7ff1cc0cce10 2024-03-30T13:13:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.535+0000 7ff1d1800640 1 -- 172.21.15.44:0/2306143219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1cc0c4f30 con 0x7ff1cc0cce10 2024-03-30T13:13:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.536+0000 7ff1d1800640 1 -- 172.21.15.44:0/2306143219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1cc075890 con 0x7ff1cc0cce10 2024-03-30T13:13:17.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.537+0000 7ff1c8c00640 1 -- 172.21.15.44:0/2306143219 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff1b401a070 con 0x7ff1cc0cce10 2024-03-30T13:13:17.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.537+0000 7ff1c8c00640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff1a806c530 0x7ff1a806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:17.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.538+0000 7ff1c8c00640 1 -- 172.21.15.44:0/2306143219 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7ff1b408b8d0 con 0x7ff1cc0cce10 2024-03-30T13:13:17.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.538+0000 7ff1cbe00640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff1a806c530 0x7ff1a806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:17.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.540+0000 7ff1cbe00640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff1a806c530 0x7ff1a806e9f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc001500 tx=0x7ff1bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:17.547 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.542+0000 7ff1c8c00640 1 -- 172.21.15.44:0/2306143219 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff1b405a0a0 con 0x7ff1cc0cce10 2024-03-30T13:13:17.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.828+0000 7ff1d1800640 1 -- 172.21.15.44:0/2306143219 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7ff1cc0b5c70 con 0x7ff1cc0cce10 2024-03-30T13:13:17.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.833+0000 7ff1c8c00640 1 -- 172.21.15.44:0/2306143219 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7ff1b40599a0 con 0x7ff1cc0cce10 2024-03-30T13:13:17.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.836+0000 7ff1d1800640 1 -- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff1a806c530 msgr2=0x7ff1a806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.836+0000 7ff1d1800640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff1a806c530 0x7ff1a806e9f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc001500 tx=0x7ff1bc009040 comp rx=0 tx=0).stop 2024-03-30T13:13:17.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.836+0000 7ff1d1800640 1 -- 172.21.15.44:0/2306143219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1cc0cce10 msgr2=0x7ff1cc163730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:17.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.836+0000 7ff1d1800640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1cc0cce10 0x7ff1cc163730 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff1b400e9b0 tx=0x7ff1b400ee70 comp rx=0 tx=0).stop 2024-03-30T13:13:17.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.836+0000 7ff1d1800640 1 -- 172.21.15.44:0/2306143219 shutdown_connections 2024-03-30T13:13:17.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.836+0000 7ff1d1800640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff1a806c530 0x7ff1a806e9f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.836+0000 7ff1d1800640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1cc162770 0x7ff1cc152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.836+0000 7ff1d1800640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1cc0cce10 0x7ff1cc163730 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.836+0000 7ff1d1800640 1 --2- 172.21.15.44:0/2306143219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1cc0ca340 0x7ff1cc1656a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:17.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.836+0000 7ff1d1800640 1 -- 172.21.15.44:0/2306143219 >> 172.21.15.44:0/2306143219 conn(0x7ff1cc0b1800 msgr2=0x7ff1cc0cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:17.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.836+0000 7ff1d1800640 1 -- 172.21.15.44:0/2306143219 shutdown_connections 2024-03-30T13:13:17.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:17.836+0000 7ff1d1800640 1 -- 172.21.15.44:0/2306143219 wait complete. 2024-03-30T13:13:17.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-30T13:13:18.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.078+0000 7f816e800640 1 Processor -- start 2024-03-30T13:13:18.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.078+0000 7f816e800640 1 -- start start 2024-03-30T13:13:18.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.080+0000 7f816e800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8168151e80 0x7f81680cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.080+0000 7f816e800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816806e960 0x7f816815b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.080+0000 7f816e800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f816815c340 con 0x7f8168152260 2024-03-30T13:13:18.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.080+0000 7f816e800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f81680cc470 con 0x7f8168151e80 2024-03-30T13:13:18.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.080+0000 7f816e800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f81680cc6b0 con 0x7f816806e960 2024-03-30T13:13:18.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.080+0000 7f816ca00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8168152260 0x7f816806e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48096/0 (socket says 172.21.15.44:48096) 2024-03-30T13:13:18.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.080+0000 7f816d400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8168151e80 0x7f81680cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.080+0000 7f816ca00640 1 -- 172.21.15.44:0/3978877686 learned_addr learned my addr 172.21.15.44:0/3978877686 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:18.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.081+0000 7f816de00640 1 --2- 172.21.15.44:0/3978877686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816806e960 0x7f816815b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.081+0000 7f8167e00640 1 -- 172.21.15.44:0/3978877686 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 12996924 0 0) 0x7f816815c340 con 0x7f8168152260 2024-03-30T13:13:18.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.081+0000 7f816d400640 1 -- 172.21.15.44:0/3978877686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816806e960 msgr2=0x7f816815b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.081+0000 7f816d400640 1 --2- 172.21.15.44:0/3978877686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816806e960 0x7f816815b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.081+0000 7f816d400640 1 -- 172.21.15.44:0/3978877686 >> v1:172.21.15.44:6789/0 conn(0x7f8168152260 legacy=0x7f816806e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.081+0000 7f816d400640 1 -- 172.21.15.44:0/3978877686 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81680cc990 con 0x7f8168151e80 2024-03-30T13:13:18.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.081+0000 7f816de00640 1 --2- 172.21.15.44:0/3978877686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816806e960 0x7f816815b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:18.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.082+0000 7f816d400640 1 --2- 172.21.15.44:0/3978877686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8168151e80 0x7f81680cd190 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f815c0097a0 tx=0x7f815c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d35e7e3075148a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.083+0000 7f8167e00640 1 -- 172.21.15.44:0/3978877686 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c035020 con 0x7f8168151e80 2024-03-30T13:13:18.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.083+0000 7f8167e00640 1 -- 172.21.15.44:0/3978877686 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815c031810 con 0x7f8168151e80 2024-03-30T13:13:18.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.083+0000 7f8167e00640 1 -- 172.21.15.44:0/3978877686 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c031be0 con 0x7f8168151e80 2024-03-30T13:13:18.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.083+0000 7f816e800640 1 -- 172.21.15.44:0/3978877686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8168151e80 msgr2=0x7f81680cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.083+0000 7f816e800640 1 --2- 172.21.15.44:0/3978877686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8168151e80 0x7f81680cd190 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f815c0097a0 tx=0x7f815c02b8b0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.083+0000 7f816e800640 1 -- 172.21.15.44:0/3978877686 shutdown_connections 2024-03-30T13:13:18.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.083+0000 7f816e800640 1 --2- 172.21.15.44:0/3978877686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816806e960 0x7f816815b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.083+0000 7f816e800640 1 --2- 172.21.15.44:0/3978877686 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8168151e80 0x7f81680cd190 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.083+0000 7f816e800640 1 -- 172.21.15.44:0/3978877686 >> 172.21.15.44:0/3978877686 conn(0x7f81680b1800 msgr2=0x7f81680b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.083+0000 7f816e800640 1 -- 172.21.15.44:0/3978877686 shutdown_connections 2024-03-30T13:13:18.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.084+0000 7f816e800640 1 -- 172.21.15.44:0/3978877686 wait complete. 2024-03-30T13:13:18.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.085+0000 7f816e800640 1 Processor -- start 2024-03-30T13:13:18.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.085+0000 7f816e800640 1 -- start start 2024-03-30T13:13:18.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.086+0000 7f816e800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f816806e960 0x7f816815a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.086+0000 7f816e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8168151e80 0x7f8168148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.086+0000 7f816e800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8168152260 0x7f81681491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.086+0000 7f816e800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f816815bf20 con 0x7f8168151e80 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.086+0000 7f816e800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f816815bda0 con 0x7f816806e960 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.086+0000 7f816e800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f816815c0a0 con 0x7f8168152260 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.087+0000 7f816ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8168151e80 0x7f8168148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.087+0000 7f816ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8168151e80 0x7f8168148c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60316/0 (socket says 172.21.15.44:60316) 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.087+0000 7f816ca00640 1 -- 172.21.15.44:0/3420940819 learned_addr learned my addr 172.21.15.44:0/3420940819 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.087+0000 7f816ca00640 1 -- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8168152260 msgr2=0x7f81681491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.087+0000 7f816d400640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f816806e960 0x7f816815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.087+0000 7f816de00640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8168152260 0x7f81681491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.087+0000 7f816ca00640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8168152260 0x7f81681491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.087+0000 7f816ca00640 1 -- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f816806e960 msgr2=0x7f816815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.087+0000 7f816ca00640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f816806e960 0x7f816815a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.087+0000 7f816ca00640 1 -- 172.21.15.44:0/3420940819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81681f7b00 con 0x7f8168151e80 2024-03-30T13:13:18.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.087+0000 7f816ca00640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8168151e80 0x7f8168148c80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f815400c430 tx=0x7f815400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.088+0000 7f8165600640 1 -- 172.21.15.44:0/3420940819 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81540074e0 con 0x7f8168151e80 2024-03-30T13:13:18.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.088+0000 7f8165600640 1 -- 172.21.15.44:0/3420940819 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81540047e0 con 0x7f8168151e80 2024-03-30T13:13:18.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.088+0000 7f8165600640 1 -- 172.21.15.44:0/3420940819 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154004bd0 con 0x7f8168151e80 2024-03-30T13:13:18.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.088+0000 7f816e800640 1 -- 172.21.15.44:0/3420940819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81681f7de0 con 0x7f8168151e80 2024-03-30T13:13:18.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.088+0000 7f816e800640 1 -- 172.21.15.44:0/3420940819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81681f83a0 con 0x7f8168151e80 2024-03-30T13:13:18.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.089+0000 7f816e800640 1 -- 172.21.15.44:0/3420940819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8168075890 con 0x7f8168151e80 2024-03-30T13:13:18.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.090+0000 7f8165600640 1 -- 172.21.15.44:0/3420940819 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8154011070 con 0x7f8168151e80 2024-03-30T13:13:18.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.091+0000 7f8165600640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f814806c530 0x7f814806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.091+0000 7f8165600640 1 -- 172.21.15.44:0/3420940819 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f815408b100 con 0x7f8168151e80 2024-03-30T13:13:18.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.092+0000 7f816d400640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f814806c530 0x7f814806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.093+0000 7f816d400640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f814806c530 0x7f814806e9f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f815c036000 tx=0x7f815c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.099+0000 7f8165600640 1 -- 172.21.15.44:0/3420940819 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f81540598d0 con 0x7f8168151e80 2024-03-30T13:13:18.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.383+0000 7f816e800640 1 -- 172.21.15.44:0/3420940819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f81680b5c70 con 0x7f8168151e80 2024-03-30T13:13:18.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.388+0000 7f8165600640 1 -- 172.21.15.44:0/3420940819 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f81540591d0 con 0x7f8168151e80 2024-03-30T13:13:18.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.390+0000 7f816e800640 1 -- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f814806c530 msgr2=0x7f814806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.390+0000 7f816e800640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f814806c530 0x7f814806e9f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f815c036000 tx=0x7f815c008030 comp rx=0 tx=0).stop 2024-03-30T13:13:18.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.390+0000 7f816e800640 1 -- 172.21.15.44:0/3420940819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8168151e80 msgr2=0x7f8168148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.390+0000 7f816e800640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8168151e80 0x7f8168148c80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f815400c430 tx=0x7f815400c8f0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.390+0000 7f816e800640 1 -- 172.21.15.44:0/3420940819 shutdown_connections 2024-03-30T13:13:18.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.390+0000 7f816e800640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8168152260 0x7f81681491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.390+0000 7f816e800640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8168151e80 0x7f8168148c80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.390+0000 7f816e800640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f814806c530 0x7f814806e9f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.390+0000 7f816e800640 1 --2- 172.21.15.44:0/3420940819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f816806e960 0x7f816815a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.390+0000 7f816e800640 1 -- 172.21.15.44:0/3420940819 >> 172.21.15.44:0/3420940819 conn(0x7f81680b1800 msgr2=0x7f81680cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.390+0000 7f816e800640 1 -- 172.21.15.44:0/3420940819 shutdown_connections 2024-03-30T13:13:18.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.390+0000 7f816e800640 1 -- 172.21.15.44:0/3420940819 wait complete. 2024-03-30T13:13:18.416 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-30T13:13:18.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.636+0000 7f2cb5800640 1 Processor -- start 2024-03-30T13:13:18.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.636+0000 7f2cb5800640 1 -- start start 2024-03-30T13:13:18.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.638+0000 7f2cb5800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2cb015fba0 0x7f2cb0071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.638+0000 7f2cb5800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb0160a80 0x7f2cb00cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.638+0000 7f2cb5800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb0071fe0 con 0x7f2cb00cca60 2024-03-30T13:13:18.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.638+0000 7f2cb5800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb0071a20 con 0x7f2cb015fba0 2024-03-30T13:13:18.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.638+0000 7f2cb5800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb0071d00 con 0x7f2cb0160a80 2024-03-30T13:13:18.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.638+0000 7f2caf400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2cb00cca60 0x7f2cb00b2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48102/0 (socket says 172.21.15.44:48102) 2024-03-30T13:13:18.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.638+0000 7f2caf400640 1 -- 172.21.15.44:0/1944910436 learned_addr learned my addr 172.21.15.44:0/1944910436 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:18.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.638+0000 7f2caea00640 1 --2- 172.21.15.44:0/1944910436 >> v2:172.21.15.151:3300/0 conn(0x7f2cb015fba0 0x7f2cb0071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.638+0000 7f2cae000640 1 --2- 172.21.15.44:0/1944910436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb0160a80 0x7f2cb00cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.639+0000 7f2cad600640 1 -- 172.21.15.44:0/1944910436 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1876029168 0 0) 0x7f2cb0071fe0 con 0x7f2cb00cca60 2024-03-30T13:13:18.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.639+0000 7f2cad600640 1 -- 172.21.15.44:0/1944910436 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c94003520 con 0x7f2cb00cca60 2024-03-30T13:13:18.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.639+0000 7f2caea00640 1 -- 172.21.15.44:0/1944910436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb0160a80 msgr2=0x7f2cb00cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:18.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.639+0000 7f2caea00640 1 --2- 172.21.15.44:0/1944910436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb0160a80 0x7f2cb00cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.639+0000 7f2caea00640 1 -- 172.21.15.44:0/1944910436 >> v1:172.21.15.44:6789/0 conn(0x7f2cb00cca60 legacy=0x7f2cb00b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.639+0000 7f2caea00640 1 -- 172.21.15.44:0/1944910436 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb00cabf0 con 0x7f2cb015fba0 2024-03-30T13:13:18.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.641+0000 7f2caea00640 1 --2- 172.21.15.44:0/1944910436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb015fba0 0x7f2cb0071440 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00097a0 tx=0x7f2ca002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6860b6ff299b1605 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.641+0000 7f2cad600640 1 -- 172.21.15.44:0/1944910436 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0035020 con 0x7f2cb015fba0 2024-03-30T13:13:18.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.641+0000 7f2cad600640 1 -- 172.21.15.44:0/1944910436 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca0031810 con 0x7f2cb015fba0 2024-03-30T13:13:18.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.642+0000 7f2cad600640 1 -- 172.21.15.44:0/1944910436 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0031be0 con 0x7f2cb015fba0 2024-03-30T13:13:18.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.642+0000 7f2cb5800640 1 -- 172.21.15.44:0/1944910436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb015fba0 msgr2=0x7f2cb0071440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.642+0000 7f2cb5800640 1 --2- 172.21.15.44:0/1944910436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb015fba0 0x7f2cb0071440 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00097a0 tx=0x7f2ca002b8b0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.642+0000 7f2cb5800640 1 -- 172.21.15.44:0/1944910436 shutdown_connections 2024-03-30T13:13:18.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.642+0000 7f2cb5800640 1 --2- 172.21.15.44:0/1944910436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb0160a80 0x7f2cb00cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.642+0000 7f2cb5800640 1 --2- 172.21.15.44:0/1944910436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb015fba0 0x7f2cb0071440 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.642+0000 7f2cb5800640 1 -- 172.21.15.44:0/1944910436 >> 172.21.15.44:0/1944910436 conn(0x7f2cb006d610 msgr2=0x7f2cb006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.642+0000 7f2cb5800640 1 -- 172.21.15.44:0/1944910436 shutdown_connections 2024-03-30T13:13:18.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.642+0000 7f2cb5800640 1 -- 172.21.15.44:0/1944910436 wait complete. 2024-03-30T13:13:18.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.644+0000 7f2cb5800640 1 Processor -- start 2024-03-30T13:13:18.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.644+0000 7f2cb5800640 1 -- start start 2024-03-30T13:13:18.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.645+0000 7f2cb5800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb00cca60 0x7f2cb01f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.645+0000 7f2cb5800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb015fba0 0x7f2cb015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.645+0000 7f2cb5800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb0160a80 0x7f2cb00cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.645+0000 7f2cb5800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb0160ee0 con 0x7f2cb00cca60 2024-03-30T13:13:18.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.645+0000 7f2cb5800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb00cb930 con 0x7f2cb015fba0 2024-03-30T13:13:18.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.645+0000 7f2cb5800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb0161060 con 0x7f2cb0160a80 2024-03-30T13:13:18.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.646+0000 7f2caea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb00cca60 0x7f2cb01f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.646+0000 7f2caea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb00cca60 0x7f2cb01f70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60328/0 (socket says 172.21.15.44:60328) 2024-03-30T13:13:18.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.646+0000 7f2caea00640 1 -- 172.21.15.44:0/2936569194 learned_addr learned my addr 172.21.15.44:0/2936569194 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:18.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.646+0000 7f2caea00640 1 -- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb0160a80 msgr2=0x7f2cb00cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.646+0000 7f2caf400640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb0160a80 0x7f2cb00cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.646+0000 7f2cae000640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb015fba0 0x7f2cb015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.646+0000 7f2caea00640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb0160a80 0x7f2cb00cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.646+0000 7f2caea00640 1 -- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb015fba0 msgr2=0x7f2cb015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.646+0000 7f2caea00640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb015fba0 0x7f2cb015ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.646+0000 7f2caea00640 1 -- 172.21.15.44:0/2936569194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb01f42b0 con 0x7f2cb00cca60 2024-03-30T13:13:18.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.646+0000 7f2cae000640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb015fba0 0x7f2cb015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:18.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.647+0000 7f2caea00640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb00cca60 0x7f2cb01f70e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009890 tx=0x7f2ca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.647+0000 7f2ca6a00640 1 -- 172.21.15.44:0/2936569194 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0035040 con 0x7f2cb00cca60 2024-03-30T13:13:18.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.647+0000 7f2ca6a00640 1 -- 172.21.15.44:0/2936569194 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca0046480 con 0x7f2cb00cca60 2024-03-30T13:13:18.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.647+0000 7f2ca6a00640 1 -- 172.21.15.44:0/2936569194 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0046870 con 0x7f2cb00cca60 2024-03-30T13:13:18.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.647+0000 7f2cb5800640 1 -- 172.21.15.44:0/2936569194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb01f4590 con 0x7f2cb00cca60 2024-03-30T13:13:18.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.647+0000 7f2cb5800640 1 -- 172.21.15.44:0/2936569194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb00b1510 con 0x7f2cb00cca60 2024-03-30T13:13:18.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.648+0000 7f2cb5800640 1 -- 172.21.15.44:0/2936569194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb0075900 con 0x7f2cb00cca60 2024-03-30T13:13:18.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.649+0000 7f2ca6a00640 1 -- 172.21.15.44:0/2936569194 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2ca0038020 con 0x7f2cb00cca60 2024-03-30T13:13:18.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.650+0000 7f2ca6a00640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2c9006c530 0x7f2c9006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:18.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.650+0000 7f2ca6a00640 1 -- 172.21.15.44:0/2936569194 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f2ca00ad7b0 con 0x7f2cb00cca60 2024-03-30T13:13:18.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.651+0000 7f2cae000640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2c9006c530 0x7f2c9006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:18.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.652+0000 7f2cae000640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2c9006c530 0x7f2c9006e9f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00ae920 tx=0x7f2c9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:18.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.655+0000 7f2ca6a00640 1 -- 172.21.15.44:0/2936569194 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2ca0031e20 con 0x7f2cb00cca60 2024-03-30T13:13:18.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.936+0000 7f2cb5800640 1 -- 172.21.15.44:0/2936569194 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f2cb00afcf0 con 0x7f2cb00cca60 2024-03-30T13:13:18.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.940+0000 7f2ca6a00640 1 -- 172.21.15.44:0/2936569194 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f2ca007be70 con 0x7f2cb00cca60 2024-03-30T13:13:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.942+0000 7f2cb5800640 1 -- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2c9006c530 msgr2=0x7f2c9006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.943+0000 7f2cb5800640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2c9006c530 0x7f2c9006e9f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00ae920 tx=0x7f2c9c008040 comp rx=0 tx=0).stop 2024-03-30T13:13:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.943+0000 7f2cb5800640 1 -- 172.21.15.44:0/2936569194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb00cca60 msgr2=0x7f2cb01f70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.943+0000 7f2cb5800640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb00cca60 0x7f2cb01f70e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009890 tx=0x7f2ca00046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.943+0000 7f2cb5800640 1 -- 172.21.15.44:0/2936569194 shutdown_connections 2024-03-30T13:13:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.943+0000 7f2cb5800640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2cb0160a80 0x7f2cb00cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.943+0000 7f2cb5800640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2c9006c530 0x7f2c9006e9f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.943+0000 7f2cb5800640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb015fba0 0x7f2cb015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.943+0000 7f2cb5800640 1 --2- 172.21.15.44:0/2936569194 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2cb00cca60 0x7f2cb01f70e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:18.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.943+0000 7f2cb5800640 1 -- 172.21.15.44:0/2936569194 >> 172.21.15.44:0/2936569194 conn(0x7f2cb006d610 msgr2=0x7f2cb00b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.943+0000 7f2cb5800640 1 -- 172.21.15.44:0/2936569194 shutdown_connections 2024-03-30T13:13:18.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:18.943+0000 7f2cb5800640 1 -- 172.21.15.44:0/2936569194 wait complete. 2024-03-30T13:13:18.968 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-30T13:13:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.182+0000 7ff0a2000640 1 Processor -- start 2024-03-30T13:13:19.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.183+0000 7ff0a2000640 1 -- start start 2024-03-30T13:13:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.184+0000 7ff0a2000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff09c0ccd50 0x7ff09c161f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.184+0000 7ff0a2000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff09c0ce160 0x7ff09c071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.184+0000 7ff0a2000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c162550 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.184+0000 7ff0a2000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff09c0712e0 con 0x7ff09c0ccd50 2024-03-30T13:13:19.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.184+0000 7ff0a2000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c0cd130 con 0x7ff09c0ce160 2024-03-30T13:13:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.185+0000 7ff0a0c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff09c0ccd50 0x7ff09c161f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.185+0000 7ff09be00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff09c0ad8b0 0x7ff09c0cda50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48112/0 (socket says 172.21.15.44:48112) 2024-03-30T13:13:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.185+0000 7ff09be00640 1 -- 172.21.15.44:0/1172781229 learned_addr learned my addr 172.21.15.44:0/1172781229 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.185+0000 7ff0a1600640 1 --2- 172.21.15.44:0/1172781229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff09c0ce160 0x7ff09c071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.186+0000 7ff09b400640 1 -- 172.21.15.44:0/1172781229 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755658832 0 0) 0x7ff09c162550 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.186+0000 7ff09b400640 1 -- 172.21.15.44:0/1172781229 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff084003520 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.186+0000 7ff0a0c00640 1 -- 172.21.15.44:0/1172781229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff09c0ce160 msgr2=0x7ff09c071770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:19.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.186+0000 7ff0a0c00640 1 --2- 172.21.15.44:0/1172781229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff09c0ce160 0x7ff09c071770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.186+0000 7ff0a0c00640 1 -- 172.21.15.44:0/1172781229 >> v1:172.21.15.44:6789/0 conn(0x7ff09c0ad8b0 legacy=0x7ff09c0cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.186+0000 7ff0a0c00640 1 -- 172.21.15.44:0/1172781229 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c162830 con 0x7ff09c0ccd50 2024-03-30T13:13:19.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.187+0000 7ff0a0c00640 1 --2- 172.21.15.44:0/1172781229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0ccd50 0x7ff09c161f70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff0900097a0 tx=0x7ff09002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6488f932a71e8f77 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:19.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.187+0000 7ff09b400640 1 -- 172.21.15.44:0/1172781229 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090031780 con 0x7ff09c0ccd50 2024-03-30T13:13:19.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.187+0000 7ff09b400640 1 -- 172.21.15.44:0/1172781229 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff090037070 con 0x7ff09c0ccd50 2024-03-30T13:13:19.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.187+0000 7ff09b400640 1 -- 172.21.15.44:0/1172781229 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090031b40 con 0x7ff09c0ccd50 2024-03-30T13:13:19.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.188+0000 7ff0a2000640 1 -- 172.21.15.44:0/1172781229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0ccd50 msgr2=0x7ff09c161f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.188+0000 7ff0a2000640 1 --2- 172.21.15.44:0/1172781229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0ccd50 0x7ff09c161f70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff0900097a0 tx=0x7ff09002b820 comp rx=0 tx=0).stop 2024-03-30T13:13:19.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.188+0000 7ff0a2000640 1 -- 172.21.15.44:0/1172781229 shutdown_connections 2024-03-30T13:13:19.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.188+0000 7ff0a2000640 1 --2- 172.21.15.44:0/1172781229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff09c0ce160 0x7ff09c071770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.188+0000 7ff0a2000640 1 --2- 172.21.15.44:0/1172781229 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0ccd50 0x7ff09c161f70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.188+0000 7ff0a2000640 1 -- 172.21.15.44:0/1172781229 >> 172.21.15.44:0/1172781229 conn(0x7ff09c0b1800 msgr2=0x7ff09c0b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:19.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.188+0000 7ff0a2000640 1 -- 172.21.15.44:0/1172781229 shutdown_connections 2024-03-30T13:13:19.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.188+0000 7ff0a2000640 1 -- 172.21.15.44:0/1172781229 wait complete. 2024-03-30T13:13:19.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.190+0000 7ff0a2000640 1 Processor -- start 2024-03-30T13:13:19.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.190+0000 7ff0a2000640 1 -- start start 2024-03-30T13:13:19.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.191+0000 7ff0a2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0ad8b0 0x7ff09c14e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.191+0000 7ff0a2000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff09c0ccd50 0x7ff09c159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.191+0000 7ff0a2000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff09c0ce160 0x7ff09c15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.191+0000 7ff0a2000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c06ef00 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.191+0000 7ff0a2000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c162df0 con 0x7ff09c0ccd50 2024-03-30T13:13:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.191+0000 7ff0a2000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c06f080 con 0x7ff09c0ce160 2024-03-30T13:13:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.192+0000 7ff0a0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0ad8b0 0x7ff09c14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.192+0000 7ff0a0c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0ad8b0 0x7ff09c14e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60344/0 (socket says 172.21.15.44:60344) 2024-03-30T13:13:19.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.192+0000 7ff0a0c00640 1 -- 172.21.15.44:0/3965927328 learned_addr learned my addr 172.21.15.44:0/3965927328 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.192+0000 7ff09be00640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff09c0ccd50 0x7ff09c159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.192+0000 7ff0a0c00640 1 -- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff09c0ce160 msgr2=0x7ff09c15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.192+0000 7ff0a0c00640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff09c0ce160 0x7ff09c15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.192+0000 7ff0a0c00640 1 -- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff09c0ccd50 msgr2=0x7ff09c159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.192+0000 7ff0a0c00640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff09c0ccd50 0x7ff09c159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.192+0000 7ff0a0c00640 1 -- 172.21.15.44:0/3965927328 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c15c310 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.192+0000 7ff09be00640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff09c0ccd50 0x7ff09c159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:19.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.193+0000 7ff0a0c00640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0ad8b0 0x7ff09c14e040 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff090034040 tx=0x7ff0900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:19.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.193+0000 7ff098c00640 1 -- 172.21.15.44:0/3965927328 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090032610 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.193+0000 7ff098c00640 1 -- 172.21.15.44:0/3965927328 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0900327d0 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.193+0000 7ff098c00640 1 -- 172.21.15.44:0/3965927328 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff090032bc0 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.193+0000 7ff0a2000640 1 -- 172.21.15.44:0/3965927328 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c159fc0 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.193+0000 7ff0a2000640 1 -- 172.21.15.44:0/3965927328 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09c15c5b0 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.194+0000 7ff0a2000640 1 -- 172.21.15.44:0/3965927328 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff09c075890 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.196+0000 7ff098c00640 1 -- 172.21.15.44:0/3965927328 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff09004e440 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.197+0000 7ff098c00640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff07c06c560 0x7ff07c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.197+0000 7ff098c00640 1 -- 172.21.15.44:0/3965927328 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7ff0900ad1a0 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.197+0000 7ff09be00640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff07c06c560 0x7ff07c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.198+0000 7ff09be00640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff07c06c560 0x7ff07c06ea20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0b0840 tx=0x7ff088009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:19.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.202+0000 7ff098c00640 1 -- 172.21.15.44:0/3965927328 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff090040070 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.483+0000 7ff0a2000640 1 -- 172.21.15.44:0/3965927328 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ff09c0b0590 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.487+0000 7ff098c00640 1 -- 172.21.15.44:0/3965927328 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7ff09002f050 con 0x7ff09c0ad8b0 2024-03-30T13:13:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.489+0000 7ff0a2000640 1 -- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff07c06c560 msgr2=0x7ff07c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.489+0000 7ff0a2000640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff07c06c560 0x7ff07c06ea20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0b0840 tx=0x7ff088009040 comp rx=0 tx=0).stop 2024-03-30T13:13:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.489+0000 7ff0a2000640 1 -- 172.21.15.44:0/3965927328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0ad8b0 msgr2=0x7ff09c14e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.489+0000 7ff0a2000640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0ad8b0 0x7ff09c14e040 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff090034040 tx=0x7ff0900046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.490+0000 7ff0a2000640 1 -- 172.21.15.44:0/3965927328 shutdown_connections 2024-03-30T13:13:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.490+0000 7ff0a2000640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff09c0ce160 0x7ff09c15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.490+0000 7ff0a2000640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff07c06c560 0x7ff07c06ea20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.490+0000 7ff0a2000640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff09c0ccd50 0x7ff09c159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.490+0000 7ff0a2000640 1 --2- 172.21.15.44:0/3965927328 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff09c0ad8b0 0x7ff09c14e040 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.490+0000 7ff0a2000640 1 -- 172.21.15.44:0/3965927328 >> 172.21.15.44:0/3965927328 conn(0x7ff09c0b1800 msgr2=0x7ff09c0cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.490+0000 7ff0a2000640 1 -- 172.21.15.44:0/3965927328 shutdown_connections 2024-03-30T13:13:19.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.490+0000 7ff0a2000640 1 -- 172.21.15.44:0/3965927328 wait complete. 2024-03-30T13:13:19.512 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-30T13:13:19.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.726+0000 7f4be0400640 1 Processor -- start 2024-03-30T13:13:19.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.727+0000 7f4be0400640 1 -- start start 2024-03-30T13:13:19.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.728+0000 7f4be0400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4bd80b38f0 0x7f4bd8169250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.728+0000 7f4be0400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd80cfc00 con 0x7f4bd80d1300 2024-03-30T13:13:19.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.728+0000 7f4be0400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd80d3120 con 0x7f4bd80d3ee0 2024-03-30T13:13:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.728+0000 7f4be0400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd80d3400 con 0x7f4bd80b38f0 2024-03-30T13:13:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.729+0000 7f4bdda00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4bd80d1300 0x7f4bd80d16e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48114/0 (socket says 172.21.15.44:48114) 2024-03-30T13:13:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.729+0000 7f4bdda00640 1 -- 172.21.15.44:0/957270158 learned_addr learned my addr 172.21.15.44:0/957270158 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.729+0000 7f4bde400640 1 --2- 172.21.15.44:0/957270158 >> v2:172.21.15.44:3300/0 conn(0x7f4bd80b38f0 0x7f4bd8169250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.729+0000 7f4bd7e00640 1 -- 172.21.15.44:0/957270158 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250973847 0 0) 0x7f4bcc001110 con 0x7f4bd80d1300 2024-03-30T13:13:19.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.729+0000 7f4bd7e00640 1 -- 172.21.15.44:0/957270158 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bc0003520 con 0x7f4bd80d1300 2024-03-30T13:13:19.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.730+0000 7f4bde400640 1 -- 172.21.15.44:0/957270158 >> v1:172.21.15.151:6789/0 conn(0x7f4bd80d3ee0 legacy=0x7f4bd80cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.730+0000 7f4bde400640 1 -- 172.21.15.44:0/957270158 >> v1:172.21.15.44:6789/0 conn(0x7f4bd80d1300 legacy=0x7f4bd80d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.730+0000 7f4bde400640 1 -- 172.21.15.44:0/957270158 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd80d36e0 con 0x7f4bd80b38f0 2024-03-30T13:13:19.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.731+0000 7f4bde400640 1 --2- 172.21.15.44:0/957270158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd80b38f0 0x7f4bd8169250 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009d90 tx=0x7f4bd002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4528ca39dd77a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:19.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.732+0000 7f4bd7e00640 1 -- 172.21.15.44:0/957270158 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0039070 con 0x7f4bd80b38f0 2024-03-30T13:13:19.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.732+0000 7f4bd7e00640 1 -- 172.21.15.44:0/957270158 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd002cd00 con 0x7f4bd80b38f0 2024-03-30T13:13:19.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.732+0000 7f4bd7e00640 1 -- 172.21.15.44:0/957270158 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0034640 con 0x7f4bd80b38f0 2024-03-30T13:13:19.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.732+0000 7f4be0400640 1 -- 172.21.15.44:0/957270158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd80b38f0 msgr2=0x7f4bd8169250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.732+0000 7f4be0400640 1 --2- 172.21.15.44:0/957270158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd80b38f0 0x7f4bd8169250 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0009d90 tx=0x7f4bd002bf50 comp rx=0 tx=0).stop 2024-03-30T13:13:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.732+0000 7f4be0400640 1 -- 172.21.15.44:0/957270158 shutdown_connections 2024-03-30T13:13:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.732+0000 7f4be0400640 1 --2- 172.21.15.44:0/957270158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd80b38f0 0x7f4bd8169250 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.732+0000 7f4be0400640 1 -- 172.21.15.44:0/957270158 >> 172.21.15.44:0/957270158 conn(0x7f4bd80676e0 msgr2=0x7f4bd8067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.733+0000 7f4be0400640 1 -- 172.21.15.44:0/957270158 shutdown_connections 2024-03-30T13:13:19.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.733+0000 7f4be0400640 1 -- 172.21.15.44:0/957270158 wait complete. 2024-03-30T13:13:19.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.735+0000 7f4be0400640 1 Processor -- start 2024-03-30T13:13:19.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.735+0000 7f4be0400640 1 -- start start 2024-03-30T13:13:19.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.737+0000 7f4be0400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd80b38f0 0x7f4bd814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.737+0000 7f4be0400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd80d1300 0x7f4bd81577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.737+0000 7f4be0400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bd80d3ee0 0x7f4bd8157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.737+0000 7f4be0400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd815eae0 con 0x7f4bd80b38f0 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.737+0000 7f4be0400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd815e960 con 0x7f4bd80d3ee0 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.737+0000 7f4be0400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd8169790 con 0x7f4bd80d1300 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.737+0000 7f4bdda00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd80b38f0 0x7f4bd814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.737+0000 7f4bdda00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd80b38f0 0x7f4bd814c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60362/0 (socket says 172.21.15.44:60362) 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.737+0000 7f4bdda00640 1 -- 172.21.15.44:0/3499643367 learned_addr learned my addr 172.21.15.44:0/3499643367 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.737+0000 7f4bde400640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bd80d3ee0 0x7f4bd8157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.737+0000 7f4bdd000640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd80d1300 0x7f4bd81577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.737+0000 7f4bdda00640 1 -- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd80d1300 msgr2=0x7f4bd81577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.738+0000 7f4bdda00640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd80d1300 0x7f4bd81577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.738+0000 7f4bdda00640 1 -- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bd80d3ee0 msgr2=0x7f4bd8157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.738+0000 7f4bdda00640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bd80d3ee0 0x7f4bd8157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:19.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.738+0000 7f4bdda00640 1 -- 172.21.15.44:0/3499643367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd81508a0 con 0x7f4bd80b38f0 2024-03-30T13:13:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.738+0000 7f4bdd000640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd80d1300 0x7f4bd81577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.738+0000 7f4bde400640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bd80d3ee0 0x7f4bd8157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:19.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.738+0000 7f4bdda00640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd80b38f0 0x7f4bd814c8b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00c730 tx=0x7f4bcc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.738+0000 7f4bd5600640 1 -- 172.21.15.44:0/3499643367 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc017070 con 0x7f4bd80b38f0 2024-03-30T13:13:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.738+0000 7f4bd5600640 1 -- 172.21.15.44:0/3499643367 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bcc005ab0 con 0x7f4bd80b38f0 2024-03-30T13:13:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.738+0000 7f4bd5600640 1 -- 172.21.15.44:0/3499643367 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc007070 con 0x7f4bd80b38f0 2024-03-30T13:13:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.738+0000 7f4be0400640 1 -- 172.21.15.44:0/3499643367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd8150b80 con 0x7f4bd80b38f0 2024-03-30T13:13:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.738+0000 7f4be0400640 1 -- 172.21.15.44:0/3499643367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd814cdf0 con 0x7f4bd80b38f0 2024-03-30T13:13:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.740+0000 7f4be0400640 1 -- 172.21.15.44:0/3499643367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd8075900 con 0x7f4bd80b38f0 2024-03-30T13:13:19.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.740+0000 7f4bd5600640 1 -- 172.21.15.44:0/3499643367 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4bcc01a070 con 0x7f4bd80b38f0 2024-03-30T13:13:19.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.741+0000 7f4bd5600640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4bb806c560 0x7f4bb806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:19.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.741+0000 7f4bd5600640 1 -- 172.21.15.44:0/3499643367 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f4bcc08a9f0 con 0x7f4bd80b38f0 2024-03-30T13:13:19.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.742+0000 7f4bdd000640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4bb806c560 0x7f4bb806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:19.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.743+0000 7f4bdd000640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4bb806c560 0x7f4bb806ea20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80b93a0 tx=0x7f4bc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:19.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:19.746+0000 7f4bd5600640 1 -- 172.21.15.44:0/3499643367 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4bd80cfc00 con 0x7f4bd80b38f0 2024-03-30T13:13:20.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.027+0000 7f4be0400640 1 -- 172.21.15.44:0/3499643367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f4bd80cf1d0 con 0x7f4bd80b38f0 2024-03-30T13:13:20.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.031+0000 7f4bd5600640 1 -- 172.21.15.44:0/3499643367 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f4bcc059140 con 0x7f4bd80b38f0 2024-03-30T13:13:20.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.034+0000 7f4be0400640 1 -- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4bb806c560 msgr2=0x7f4bb806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.034+0000 7f4be0400640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4bb806c560 0x7f4bb806ea20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80b93a0 tx=0x7f4bc4009040 comp rx=0 tx=0).stop 2024-03-30T13:13:20.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.034+0000 7f4be0400640 1 -- 172.21.15.44:0/3499643367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd80b38f0 msgr2=0x7f4bd814c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.034+0000 7f4be0400640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd80b38f0 0x7f4bd814c8b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00c730 tx=0x7f4bcc00cbf0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.034+0000 7f4be0400640 1 -- 172.21.15.44:0/3499643367 shutdown_connections 2024-03-30T13:13:20.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.034+0000 7f4be0400640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4bb806c560 0x7f4bb806ea20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.034+0000 7f4be0400640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bd80d3ee0 0x7f4bd8157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.034+0000 7f4be0400640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd80d1300 0x7f4bd81577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.034+0000 7f4be0400640 1 --2- 172.21.15.44:0/3499643367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd80b38f0 0x7f4bd814c8b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.034+0000 7f4be0400640 1 -- 172.21.15.44:0/3499643367 >> 172.21.15.44:0/3499643367 conn(0x7f4bd80676e0 msgr2=0x7f4bd80749e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:20.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.034+0000 7f4be0400640 1 -- 172.21.15.44:0/3499643367 shutdown_connections 2024-03-30T13:13:20.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.034+0000 7f4be0400640 1 -- 172.21.15.44:0/3499643367 wait complete. 2024-03-30T13:13:20.059 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-30T13:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.280+0000 7f518a200640 1 Processor -- start 2024-03-30T13:13:20.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.281+0000 7f518a200640 1 -- start start 2024-03-30T13:13:20.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.282+0000 7f518a200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f51840d3ee0 0x7f51840cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.282+0000 7f518a200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51840b38f0 0x7f51840b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.282+0000 7f518a200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51840cfc00 con 0x7f51840d1300 2024-03-30T13:13:20.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.282+0000 7f518a200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f51840cf930 con 0x7f51840d3ee0 2024-03-30T13:13:20.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.282+0000 7f518a200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f51840d3120 con 0x7f51840b38f0 2024-03-30T13:13:20.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.282+0000 7f5183400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f51840d1300 0x7f51840d16e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48126/0 (socket says 172.21.15.44:48126) 2024-03-30T13:13:20.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.282+0000 7f5183400640 1 -- 172.21.15.44:0/309030210 learned_addr learned my addr 172.21.15.44:0/309030210 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.283+0000 7f517be00640 1 --2- 172.21.15.44:0/309030210 >> v2:172.21.15.151:3300/0 conn(0x7f51840d3ee0 0x7f51840cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.283+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132299315 0 0) 0x7f5174001110 con 0x7f51840d1300 2024-03-30T13:13:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.283+0000 7f5183e00640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51840b38f0 0x7f51840b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.283+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5168003520 con 0x7f51840d1300 2024-03-30T13:13:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.283+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3245876267 0 0) 0x7f5168003520 con 0x7f51840d1300 2024-03-30T13:13:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.283+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51840b38f0 msgr2=0x7f51840b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.283+0000 7f5182a00640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51840b38f0 0x7f51840b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.283+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 >> v2:172.21.15.151:3300/0 conn(0x7f51840d3ee0 msgr2=0x7f51840cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:20.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.283+0000 7f5182a00640 1 --2- 172.21.15.44:0/309030210 >> v2:172.21.15.151:3300/0 conn(0x7f51840d3ee0 0x7f51840cf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.283+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51840d3400 con 0x7f51840d1300 2024-03-30T13:13:20.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.284+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f5174001840 con 0x7f51840d1300 2024-03-30T13:13:20.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.284+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 >> v1:172.21.15.44:6789/0 conn(0x7f51840d1300 legacy=0x7f51840d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.284+0000 7f5182a00640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51680039b0 0x7f5168003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.284+0000 7f5182a00640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5168004800 0x7f5168004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.284+0000 7f5182a00640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51840b38f0 0x7f51680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.284+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51840cf930 con 0x7f51680039b0 2024-03-30T13:13:20.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.284+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51840d3120 con 0x7f5168004800 2024-03-30T13:13:20.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.284+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f516800ba10 con 0x7f51840b38f0 2024-03-30T13:13:20.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.284+0000 7f5183400640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51680039b0 0x7f5168003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.284+0000 7f517be00640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5168004800 0x7f5168004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.285+0000 7f5183e00640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51840b38f0 0x7f51680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.285+0000 7f5183400640 1 -- 172.21.15.44:0/309030210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51840b38f0 msgr2=0x7f51680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:20.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.285+0000 7f5183400640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51840b38f0 0x7f51680051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.285+0000 7f5183400640 1 -- 172.21.15.44:0/309030210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5168004800 msgr2=0x7f5168004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:20.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.285+0000 7f5183400640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5168004800 0x7f5168004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.285+0000 7f5183400640 1 -- 172.21.15.44:0/309030210 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5168003520 con 0x7f51680039b0 2024-03-30T13:13:20.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.285+0000 7f5183e00640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51840b38f0 0x7f51680051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:20.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.286+0000 7f5183400640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51680039b0 0x7f5168003dd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f517400c350 tx=0x7f5168005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce279167d6e45c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:20.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.286+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517402cc20 con 0x7f51680039b0 2024-03-30T13:13:20.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.286+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5174030070 con 0x7f51680039b0 2024-03-30T13:13:20.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.286+0000 7f5182a00640 1 -- 172.21.15.44:0/309030210 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51740058d0 con 0x7f51680039b0 2024-03-30T13:13:20.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.287+0000 7f518a200640 1 -- 172.21.15.44:0/309030210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51680039b0 msgr2=0x7f5168003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.287+0000 7f518a200640 1 --2- 172.21.15.44:0/309030210 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51680039b0 0x7f5168003dd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f517400c350 tx=0x7f5168005830 comp rx=0 tx=0).stop 2024-03-30T13:13:20.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.287+0000 7f5183e00640 1 -- 172.21.15.44:0/309030210 reap_dead start 2024-03-30T13:13:20.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.287+0000 7f518a200640 1 -- 172.21.15.44:0/309030210 shutdown_connections 2024-03-30T13:13:20.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.287+0000 7f518a200640 1 -- 172.21.15.44:0/309030210 >> 172.21.15.44:0/309030210 conn(0x7f51840676e0 msgr2=0x7f5184067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:20.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.287+0000 7f518a200640 1 -- 172.21.15.44:0/309030210 shutdown_connections 2024-03-30T13:13:20.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.287+0000 7f518a200640 1 -- 172.21.15.44:0/309030210 wait complete. 2024-03-30T13:13:20.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.289+0000 7f518a200640 1 Processor -- start 2024-03-30T13:13:20.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.289+0000 7f518a200640 1 -- start start 2024-03-30T13:13:20.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f518a200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51680039b0 0x7f51841f8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f518a200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f518414b020 0x7f51840ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f518a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841f4200 0x7f51840c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f518a200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f518415e960 con 0x7f51841f4200 2024-03-30T13:13:20.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f518a200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51840d39c0 con 0x7f518414b020 2024-03-30T13:13:20.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f518a200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f518415eae0 con 0x7f51680039b0 2024-03-30T13:13:20.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f5183e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841f4200 0x7f51840c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f5183e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841f4200 0x7f51840c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60380/0 (socket says 172.21.15.44:60380) 2024-03-30T13:13:20.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f5183e00640 1 -- 172.21.15.44:0/1999157251 learned_addr learned my addr 172.21.15.44:0/1999157251 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:20.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f5183400640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51680039b0 0x7f51841f8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f5183e00640 1 -- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51680039b0 msgr2=0x7f51841f8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f5183e00640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51680039b0 0x7f51841f8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f5183e00640 1 -- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f518414b020 msgr2=0x7f51840ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.290+0000 7f517be00640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f518414b020 0x7f51840ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.291+0000 7f5183e00640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f518414b020 0x7f51840ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.291+0000 7f5183e00640 1 -- 172.21.15.44:0/1999157251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51841600e0 con 0x7f51841f4200 2024-03-30T13:13:20.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.291+0000 7f5183400640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51680039b0 0x7f51841f8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:20.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.291+0000 7f517be00640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f518414b020 0x7f51840ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:20.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.291+0000 7f5183e00640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841f4200 0x7f51840c9da0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f51840b7370 tx=0x7f517c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:20.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.291+0000 7f517b400640 1 -- 172.21.15.44:0/1999157251 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c01c070 con 0x7f51841f4200 2024-03-30T13:13:20.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.291+0000 7f517b400640 1 -- 172.21.15.44:0/1999157251 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c017400 con 0x7f51841f4200 2024-03-30T13:13:20.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.291+0000 7f517b400640 1 -- 172.21.15.44:0/1999157251 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c0177d0 con 0x7f51841f4200 2024-03-30T13:13:20.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.291+0000 7f518a200640 1 -- 172.21.15.44:0/1999157251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518415ec60 con 0x7f51841f4200 2024-03-30T13:13:20.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.291+0000 7f518a200640 1 -- 172.21.15.44:0/1999157251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f518414b870 con 0x7f51841f4200 2024-03-30T13:13:20.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.293+0000 7f518a200640 1 -- 172.21.15.44:0/1999157251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5184075900 con 0x7f51841f4200 2024-03-30T13:13:20.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.293+0000 7f517b400640 1 -- 172.21.15.44:0/1999157251 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f517c005d10 con 0x7f51841f4200 2024-03-30T13:13:20.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.294+0000 7f517b400640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f516006c560 0x7f516006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.294+0000 7f517b400640 1 -- 172.21.15.44:0/1999157251 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f517c08b730 con 0x7f51841f4200 2024-03-30T13:13:20.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.295+0000 7f5183400640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f516006c560 0x7f516006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.296+0000 7f5183400640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f516006c560 0x7f516006ea20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5174034000 tx=0x7f5174007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:20.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.299+0000 7f517b400640 1 -- 172.21.15.44:0/1999157251 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f51841600e0 con 0x7f51841f4200 2024-03-30T13:13:20.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.573+0000 7f518a200640 1 -- 172.21.15.44:0/1999157251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f51840cf1d0 con 0x7f51841f4200 2024-03-30T13:13:20.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.577+0000 7f517b400640 1 -- 172.21.15.44:0/1999157251 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f517c012070 con 0x7f51841f4200 2024-03-30T13:13:20.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.580+0000 7f518a200640 1 -- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f516006c560 msgr2=0x7f516006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.580+0000 7f518a200640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f516006c560 0x7f516006ea20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5174034000 tx=0x7f5174007000 comp rx=0 tx=0).stop 2024-03-30T13:13:20.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.580+0000 7f518a200640 1 -- 172.21.15.44:0/1999157251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841f4200 msgr2=0x7f51840c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.580+0000 7f518a200640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841f4200 0x7f51840c9da0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f51840b7370 tx=0x7f517c00f4a0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.580+0000 7f518a200640 1 -- 172.21.15.44:0/1999157251 shutdown_connections 2024-03-30T13:13:20.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.580+0000 7f518a200640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51841f4200 0x7f51840c9da0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.580+0000 7f518a200640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f516006c560 0x7f516006ea20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.580+0000 7f518a200640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f518414b020 0x7f51840ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.580+0000 7f518a200640 1 --2- 172.21.15.44:0/1999157251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51680039b0 0x7f51841f8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.580+0000 7f518a200640 1 -- 172.21.15.44:0/1999157251 >> 172.21.15.44:0/1999157251 conn(0x7f51840676e0 msgr2=0x7f51840b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:20.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.580+0000 7f518a200640 1 -- 172.21.15.44:0/1999157251 shutdown_connections 2024-03-30T13:13:20.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.580+0000 7f518a200640 1 -- 172.21.15.44:0/1999157251 wait complete. 2024-03-30T13:13:20.602 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:13:20.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.797+0000 7f2ff8a00640 1 Processor -- start 2024-03-30T13:13:20.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.798+0000 7f2ff8a00640 1 -- start start 2024-03-30T13:13:20.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.799+0000 7f2ff8a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2ff40d0a70 0x7f2ff4072740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.799+0000 7f2ff8a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff40b3f20 con 0x7f2ff4144970 2024-03-30T13:13:20.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.799+0000 7f2ff8a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ff40716a0 con 0x7f2ff40cd700 2024-03-30T13:13:20.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.799+0000 7f2ff8a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2ff4071980 con 0x7f2ff40d0a70 2024-03-30T13:13:20.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.799+0000 7f2ff2800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2ff4144970 0x7f2ff40b3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48138/0 (socket says 172.21.15.44:48138) 2024-03-30T13:13:20.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.800+0000 7f2ff2800640 1 -- 172.21.15.44:0/2726800931 learned_addr learned my addr 172.21.15.44:0/2726800931 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:20.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.800+0000 7f2ff3200640 1 --2- 172.21.15.44:0/2726800931 >> v2:172.21.15.44:3300/0 conn(0x7f2ff40d0a70 0x7f2ff4072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.800+0000 7f2ff1e00640 1 -- 172.21.15.44:0/2726800931 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 159106331 0 0) 0x7f2ff40b3f20 con 0x7f2ff4144970 2024-03-30T13:13:20.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.800+0000 7f2ff1e00640 1 -- 172.21.15.44:0/2726800931 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd8005730 con 0x7f2ff4144970 2024-03-30T13:13:20.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.800+0000 7f2ff3200640 1 -- 172.21.15.44:0/2726800931 >> v1:172.21.15.151:6789/0 conn(0x7f2ff40cd700 legacy=0x7f2ff40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:20.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.800+0000 7f2ff3200640 1 -- 172.21.15.44:0/2726800931 >> v1:172.21.15.44:6789/0 conn(0x7f2ff4144970 legacy=0x7f2ff40b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.800+0000 7f2ff3200640 1 -- 172.21.15.44:0/2726800931 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff4071c60 con 0x7f2ff40d0a70 2024-03-30T13:13:20.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.801+0000 7f2ff3200640 1 --2- 172.21.15.44:0/2726800931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ff40d0a70 0x7f2ff4072740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0097a0 tx=0x7f2fec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b8586c1e8b24d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:20.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.802+0000 7f2ff1e00640 1 -- 172.21.15.44:0/2726800931 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fec035020 con 0x7f2ff40d0a70 2024-03-30T13:13:20.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.802+0000 7f2ff1e00640 1 -- 172.21.15.44:0/2726800931 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fec031830 con 0x7f2ff40d0a70 2024-03-30T13:13:20.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.802+0000 7f2ff1e00640 1 -- 172.21.15.44:0/2726800931 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fec031be0 con 0x7f2ff40d0a70 2024-03-30T13:13:20.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.802+0000 7f2ff8a00640 1 -- 172.21.15.44:0/2726800931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ff40d0a70 msgr2=0x7f2ff4072740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.802+0000 7f2ff8a00640 1 --2- 172.21.15.44:0/2726800931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ff40d0a70 0x7f2ff4072740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0097a0 tx=0x7f2fec02b8d0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.802+0000 7f2ff8a00640 1 -- 172.21.15.44:0/2726800931 shutdown_connections 2024-03-30T13:13:20.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.802+0000 7f2ff8a00640 1 --2- 172.21.15.44:0/2726800931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ff40d0a70 0x7f2ff4072740 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.802+0000 7f2ff8a00640 1 -- 172.21.15.44:0/2726800931 >> 172.21.15.44:0/2726800931 conn(0x7f2ff406b9a0 msgr2=0x7f2ff406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:20.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.803+0000 7f2ff8a00640 1 -- 172.21.15.44:0/2726800931 shutdown_connections 2024-03-30T13:13:20.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.803+0000 7f2ff8a00640 1 -- 172.21.15.44:0/2726800931 wait complete. 2024-03-30T13:13:20.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.804+0000 7f2ff8a00640 1 Processor -- start 2024-03-30T13:13:20.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.804+0000 7f2ff8a00640 1 -- start start 2024-03-30T13:13:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.805+0000 7f2ff8a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ff40cd700 0x7f2ff415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.805+0000 7f2ff8a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ff40d0a70 0x7f2ff41394f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.805+0000 7f2ff8a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ff4144970 0x7f2ff415a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.805+0000 7f2ff8a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff4144d50 con 0x7f2ff40d0a70 2024-03-30T13:13:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.805+0000 7f2ff8a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff4072220 con 0x7f2ff4144970 2024-03-30T13:13:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.805+0000 7f2ff8a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f2ff4071270 con 0x7f2ff40cd700 2024-03-30T13:13:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.806+0000 7f2fe9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ff40d0a70 0x7f2ff41394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.806+0000 7f2fe9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ff40d0a70 0x7f2ff41394f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60408/0 (socket says 172.21.15.44:60408) 2024-03-30T13:13:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.806+0000 7f2fe9e00640 1 -- 172.21.15.44:0/1494416134 learned_addr learned my addr 172.21.15.44:0/1494416134 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.806+0000 7f2ff3200640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ff4144970 0x7f2ff415a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.806+0000 7f2ff2800640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ff40cd700 0x7f2ff415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.806+0000 7f2fe9e00640 1 -- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ff40cd700 msgr2=0x7f2ff415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.806+0000 7f2fe9e00640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ff40cd700 0x7f2ff415dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.806+0000 7f2fe9e00640 1 -- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ff4144970 msgr2=0x7f2ff415a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:20.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.806+0000 7f2fe9e00640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ff4144970 0x7f2ff415a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:20.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.806+0000 7f2fe9e00640 1 -- 172.21.15.44:0/1494416134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff415cb00 con 0x7f2ff40d0a70 2024-03-30T13:13:20.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.806+0000 7f2ff2800640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ff40cd700 0x7f2ff415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:20.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.806+0000 7f2fe9e00640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ff40d0a70 0x7f2ff41394f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00c430 tx=0x7f2fdc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:20.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.807+0000 7f2feb400640 1 -- 172.21.15.44:0/1494416134 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0052d0 con 0x7f2ff40d0a70 2024-03-30T13:13:20.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.807+0000 7f2feb400640 1 -- 172.21.15.44:0/1494416134 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fdc005490 con 0x7f2ff40d0a70 2024-03-30T13:13:20.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.807+0000 7f2feb400640 1 -- 172.21.15.44:0/1494416134 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc007260 con 0x7f2ff40d0a70 2024-03-30T13:13:20.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.807+0000 7f2ff8a00640 1 -- 172.21.15.44:0/1494416134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff415cde0 con 0x7f2ff40d0a70 2024-03-30T13:13:20.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.807+0000 7f2ff8a00640 1 -- 172.21.15.44:0/1494416134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff415d680 con 0x7f2ff40d0a70 2024-03-30T13:13:20.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.808+0000 7f2ff8a00640 1 -- 172.21.15.44:0/1494416134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff415cfb0 con 0x7f2ff40d0a70 2024-03-30T13:13:20.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.809+0000 7f2feb400640 1 -- 172.21.15.44:0/1494416134 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2fdc007400 con 0x7f2ff40d0a70 2024-03-30T13:13:20.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.810+0000 7f2feb400640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2fd006c530 0x7f2fd006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:20.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.810+0000 7f2feb400640 1 -- 172.21.15.44:0/1494416134 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f2fdc08ab80 con 0x7f2ff40d0a70 2024-03-30T13:13:20.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.811+0000 7f2ff2800640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2fd006c530 0x7f2fd006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:20.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.812+0000 7f2ff2800640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2fd006c530 0x7f2fd006e9f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4001560 tx=0x7f2fe4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:20.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:20.815+0000 7f2feb400640 1 -- 172.21.15.44:0/1494416134 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2fdc059230 con 0x7f2ff40d0a70 2024-03-30T13:13:21.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.017+0000 7f2ff8a00640 1 -- 172.21.15.44:0/1494416134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ff4075890 con 0x7f2ff40d0a70 2024-03-30T13:13:21.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.019+0000 7f2feb400640 1 -- 172.21.15.44:0/1494416134 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13140 (secure 0 0 0) 0x7f2fdc058b30 con 0x7f2ff40d0a70 2024-03-30T13:13:21.025 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:21.025 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":37,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:13:16.766975+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:13:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.022+0000 7f2ff8a00640 1 -- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2fd006c530 msgr2=0x7f2fd006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.022+0000 7f2ff8a00640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2fd006c530 0x7f2fd006e9f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4001560 tx=0x7f2fe4009040 comp rx=0 tx=0).stop 2024-03-30T13:13:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.022+0000 7f2ff8a00640 1 -- 172.21.15.44:0/1494416134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ff40d0a70 msgr2=0x7f2ff41394f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.022+0000 7f2ff8a00640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ff40d0a70 0x7f2ff41394f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00c430 tx=0x7f2fdc00c8f0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.022+0000 7f2ff8a00640 1 -- 172.21.15.44:0/1494416134 shutdown_connections 2024-03-30T13:13:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.022+0000 7f2ff8a00640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f2fd006c530 0x7f2fd006e9f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.022+0000 7f2ff8a00640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ff4144970 0x7f2ff415a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.022+0000 7f2ff8a00640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2ff40d0a70 0x7f2ff41394f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.022+0000 7f2ff8a00640 1 --2- 172.21.15.44:0/1494416134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ff40cd700 0x7f2ff415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.022+0000 7f2ff8a00640 1 -- 172.21.15.44:0/1494416134 >> 172.21.15.44:0/1494416134 conn(0x7f2ff406b9a0 msgr2=0x7f2ff40cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:21.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.022+0000 7f2ff8a00640 1 -- 172.21.15.44:0/1494416134 shutdown_connections 2024-03-30T13:13:21.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.022+0000 7f2ff8a00640 1 -- 172.21.15.44:0/1494416134 wait complete. 2024-03-30T13:13:21.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:13:21.045 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:13:21.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.257+0000 7f2a19e00640 1 Processor -- start 2024-03-30T13:13:21.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.258+0000 7f2a19e00640 1 -- start start 2024-03-30T13:13:21.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.259+0000 7f2a19e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2a1413f0c0 0x7f2a1406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:21.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.259+0000 7f2a19e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a140ce9c0 con 0x7f2a1406d720 2024-03-30T13:13:21.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.259+0000 7f2a19e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a14160b50 con 0x7f2a141605a0 2024-03-30T13:13:21.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.259+0000 7f2a19e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2a14160e30 con 0x7f2a1413f0c0 2024-03-30T13:13:21.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.259+0000 7f2a12a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2a1413f0c0 0x7f2a1406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:21.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.259+0000 7f2a12000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2a1406d720 0x7f2a1415fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48148/0 (socket says 172.21.15.44:48148) 2024-03-30T13:13:21.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.259+0000 7f2a12000640 1 -- 172.21.15.44:0/2281773972 learned_addr learned my addr 172.21.15.44:0/2281773972 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:21.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.260+0000 7f2a12a00640 1 -- 172.21.15.44:0/2281773972 >> v1:172.21.15.151:6789/0 conn(0x7f2a141605a0 legacy=0x7f2a140cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:21.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.260+0000 7f2a12a00640 1 -- 172.21.15.44:0/2281773972 >> v1:172.21.15.44:6789/0 conn(0x7f2a1406d720 legacy=0x7f2a1415fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.260+0000 7f2a11600640 1 -- 172.21.15.44:0/2281773972 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1943164365 0 0) 0x7f29fc001490 con 0x7f2a1406d720 2024-03-30T13:13:21.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.260+0000 7f2a12a00640 1 -- 172.21.15.44:0/2281773972 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1413fa40 con 0x7f2a1413f0c0 2024-03-30T13:13:21.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.261+0000 7f2a12a00640 1 --2- 172.21.15.44:0/2281773972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a1413f0c0 0x7f2a1406d1e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2a040097a0 tx=0x7f2a0402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59131cd9074ac3b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.261+0000 7f2a11600640 1 -- 172.21.15.44:0/2281773972 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04038070 con 0x7f2a1413f0c0 2024-03-30T13:13:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.261+0000 7f2a11600640 1 -- 172.21.15.44:0/2281773972 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a04031700 con 0x7f2a1413f0c0 2024-03-30T13:13:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.261+0000 7f2a11600640 1 -- 172.21.15.44:0/2281773972 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04031ad0 con 0x7f2a1413f0c0 2024-03-30T13:13:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.262+0000 7f2a19e00640 1 -- 172.21.15.44:0/2281773972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a1413f0c0 msgr2=0x7f2a1406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.262+0000 7f2a19e00640 1 --2- 172.21.15.44:0/2281773972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a1413f0c0 0x7f2a1406d1e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2a040097a0 tx=0x7f2a0402b7a0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.262+0000 7f2a19e00640 1 -- 172.21.15.44:0/2281773972 shutdown_connections 2024-03-30T13:13:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.262+0000 7f2a19e00640 1 --2- 172.21.15.44:0/2281773972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a1413f0c0 0x7f2a1406d1e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.262+0000 7f2a19e00640 1 -- 172.21.15.44:0/2281773972 >> 172.21.15.44:0/2281773972 conn(0x7f2a140b5b00 msgr2=0x7f2a1406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.262+0000 7f2a19e00640 1 -- 172.21.15.44:0/2281773972 shutdown_connections 2024-03-30T13:13:21.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.262+0000 7f2a19e00640 1 -- 172.21.15.44:0/2281773972 wait complete. 2024-03-30T13:13:21.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.264+0000 7f2a19e00640 1 Processor -- start 2024-03-30T13:13:21.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.264+0000 7f2a19e00640 1 -- start start 2024-03-30T13:13:21.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.265+0000 7f2a19e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a1406d720 0x7f2a141590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:21.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.265+0000 7f2a19e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a1413f0c0 0x7f2a14159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:21.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.265+0000 7f2a19e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a141605a0 0x7f2a1415ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:21.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.265+0000 7f2a19e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1413f4a0 con 0x7f2a1406d720 2024-03-30T13:13:21.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.265+0000 7f2a19e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2a14140000 con 0x7f2a1413f0c0 2024-03-30T13:13:21.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.265+0000 7f2a19e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1413f620 con 0x7f2a141605a0 2024-03-30T13:13:21.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.265+0000 7f2a12a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a1406d720 0x7f2a141590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:21.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.265+0000 7f2a12a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a1406d720 0x7f2a141590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60428/0 (socket says 172.21.15.44:60428) 2024-03-30T13:13:21.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.265+0000 7f2a12a00640 1 -- 172.21.15.44:0/2624304174 learned_addr learned my addr 172.21.15.44:0/2624304174 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:21.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.265+0000 7f2a12000640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a1413f0c0 0x7f2a14159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:21.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.265+0000 7f2a13400640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a141605a0 0x7f2a1415ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:21.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.266+0000 7f2a12a00640 1 -- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a141605a0 msgr2=0x7f2a1415ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.266+0000 7f2a12a00640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a141605a0 0x7f2a1415ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.266+0000 7f2a12a00640 1 -- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a1413f0c0 msgr2=0x7f2a14159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.266+0000 7f2a12a00640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a1413f0c0 0x7f2a14159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.266+0000 7f2a12a00640 1 -- 172.21.15.44:0/2624304174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a14157000 con 0x7f2a1406d720 2024-03-30T13:13:21.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.266+0000 7f2a12000640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a1413f0c0 0x7f2a14159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:21.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.266+0000 7f2a13400640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a141605a0 0x7f2a1415ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:21.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.266+0000 7f2a12a00640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a1406d720 0x7f2a141590a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2a040097a0 tx=0x7f2a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:21.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.266+0000 7f2a0b400640 1 -- 172.21.15.44:0/2624304174 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04038040 con 0x7f2a1406d720 2024-03-30T13:13:21.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.266+0000 7f2a0b400640 1 -- 172.21.15.44:0/2624304174 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a04033a30 con 0x7f2a1406d720 2024-03-30T13:13:21.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.266+0000 7f2a0b400640 1 -- 172.21.15.44:0/2624304174 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04031ed0 con 0x7f2a1406d720 2024-03-30T13:13:21.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.266+0000 7f2a19e00640 1 -- 172.21.15.44:0/2624304174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a141572a0 con 0x7f2a1406d720 2024-03-30T13:13:21.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.267+0000 7f2a19e00640 1 -- 172.21.15.44:0/2624304174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a14157860 con 0x7f2a1406d720 2024-03-30T13:13:21.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.268+0000 7f2a19e00640 1 -- 172.21.15.44:0/2624304174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a14075890 con 0x7f2a1406d720 2024-03-30T13:13:21.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.269+0000 7f2a0b400640 1 -- 172.21.15.44:0/2624304174 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2a04004030 con 0x7f2a1406d720 2024-03-30T13:13:21.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.270+0000 7f2a0b400640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f29f006c530 0x7f29f006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:21.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.270+0000 7f2a0b400640 1 -- 172.21.15.44:0/2624304174 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7f2a040ad360 con 0x7f2a1406d720 2024-03-30T13:13:21.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.271+0000 7f2a12000640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f29f006c530 0x7f29f006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:21.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.272+0000 7f2a12000640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f29f006c530 0x7f29f006e9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f29fc007fd0 tx=0x7f29fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:21.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.274+0000 7f2a0b400640 1 -- 172.21.15.44:0/2624304174 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2a04043020 con 0x7f2a1406d720 2024-03-30T13:13:21.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.475+0000 7f2a19e00640 1 -- 172.21.15.44:0/2624304174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2a1406c2c0 con 0x7f2a1406d720 2024-03-30T13:13:21.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.476+0000 7f2a0b400640 1 -- 172.21.15.44:0/2624304174 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f2a04030070 con 0x7f2a1406d720 2024-03-30T13:13:21.481 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:13:21.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.479+0000 7f2a19e00640 1 -- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f29f006c530 msgr2=0x7f29f006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.479+0000 7f2a19e00640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f29f006c530 0x7f29f006e9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f29fc007fd0 tx=0x7f29fc009040 comp rx=0 tx=0).stop 2024-03-30T13:13:21.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.479+0000 7f2a19e00640 1 -- 172.21.15.44:0/2624304174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a1406d720 msgr2=0x7f2a141590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.479+0000 7f2a19e00640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a1406d720 0x7f2a141590a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2a040097a0 tx=0x7f2a040046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.480+0000 7f2a19e00640 1 -- 172.21.15.44:0/2624304174 shutdown_connections 2024-03-30T13:13:21.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.480+0000 7f2a19e00640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a141605a0 0x7f2a1415ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.480+0000 7f2a19e00640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f29f006c530 0x7f29f006e9f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.480+0000 7f2a19e00640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a1413f0c0 0x7f2a14159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.480+0000 7f2a19e00640 1 --2- 172.21.15.44:0/2624304174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a1406d720 0x7f2a141590a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.480+0000 7f2a19e00640 1 -- 172.21.15.44:0/2624304174 >> 172.21.15.44:0/2624304174 conn(0x7f2a140b5b00 msgr2=0x7f2a14140520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:21.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.480+0000 7f2a19e00640 1 -- 172.21.15.44:0/2624304174 shutdown_connections 2024-03-30T13:13:21.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.480+0000 7f2a19e00640 1 -- 172.21.15.44:0/2624304174 wait complete. 2024-03-30T13:13:21.504 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-30T13:13:21.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.709+0000 7fdcccc00640 1 Processor -- start 2024-03-30T13:13:21.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.710+0000 7fdcccc00640 1 -- start start 2024-03-30T13:13:21.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.711+0000 7fdcccc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdcc80cf3c0 0x7fdcc80b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:21.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.711+0000 7fdcccc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc80b41f0 0x7fdcc80b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:21.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.711+0000 7fdcccc00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc80d2850 con 0x7fdcc815c400 2024-03-30T13:13:21.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.711+0000 7fdcccc00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fdcc80b4620 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.711+0000 7fdcccc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc80d2b30 con 0x7fdcc80b41f0 2024-03-30T13:13:21.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.711+0000 7fdcc5e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdcc815c400 0x7fdcc80cc840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48150/0 (socket says 172.21.15.44:48150) 2024-03-30T13:13:21.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.711+0000 7fdcc5400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdcc80cf3c0 0x7fdcc80b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:21.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.712+0000 7fdcc5e00640 1 -- 172.21.15.44:0/3804434973 learned_addr learned my addr 172.21.15.44:0/3804434973 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:21.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.712+0000 7fdcc6800640 1 --2- 172.21.15.44:0/3804434973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc80b41f0 0x7fdcc80b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:21.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.712+0000 7fdcc5400640 1 -- 172.21.15.44:0/3804434973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc80b41f0 msgr2=0x7fdcc80b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:21.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.712+0000 7fdcc5400640 1 --2- 172.21.15.44:0/3804434973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc80b41f0 0x7fdcc80b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.712+0000 7fdcc5400640 1 -- 172.21.15.44:0/3804434973 >> v1:172.21.15.44:6789/0 conn(0x7fdcc815c400 legacy=0x7fdcc80cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.712+0000 7fdcc4a00640 1 -- 172.21.15.44:0/3804434973 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487060986 0 0) 0x7fdcc80d2850 con 0x7fdcc815c400 2024-03-30T13:13:21.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.712+0000 7fdcc5400640 1 -- 172.21.15.44:0/3804434973 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc80d2e10 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.712+0000 7fdcc6800640 1 --2- 172.21.15.44:0/3804434973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc80b41f0 0x7fdcc80b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:21.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.713+0000 7fdcc5400640 1 --2- 172.21.15.44:0/3804434973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc80cf3c0 0x7fdcc80b3cb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00097a0 tx=0x7fdcb002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96166996dab0037 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:21.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.713+0000 7fdcc4a00640 1 -- 172.21.15.44:0/3804434973 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0031780 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.713+0000 7fdcc4a00640 1 -- 172.21.15.44:0/3804434973 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb0037070 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.714+0000 7fdcc4a00640 1 -- 172.21.15.44:0/3804434973 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0031b40 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.714+0000 7fdcccc00640 1 -- 172.21.15.44:0/3804434973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc80cf3c0 msgr2=0x7fdcc80b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.714+0000 7fdcccc00640 1 --2- 172.21.15.44:0/3804434973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc80cf3c0 0x7fdcc80b3cb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00097a0 tx=0x7fdcb002b820 comp rx=0 tx=0).stop 2024-03-30T13:13:21.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.714+0000 7fdcccc00640 1 -- 172.21.15.44:0/3804434973 shutdown_connections 2024-03-30T13:13:21.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.714+0000 7fdcccc00640 1 --2- 172.21.15.44:0/3804434973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc80b41f0 0x7fdcc80b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.714+0000 7fdcccc00640 1 --2- 172.21.15.44:0/3804434973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc80cf3c0 0x7fdcc80b3cb0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.714+0000 7fdcccc00640 1 -- 172.21.15.44:0/3804434973 >> 172.21.15.44:0/3804434973 conn(0x7fdcc80672c0 msgr2=0x7fdcc80676a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:21.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.714+0000 7fdcccc00640 1 -- 172.21.15.44:0/3804434973 shutdown_connections 2024-03-30T13:13:21.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.714+0000 7fdcccc00640 1 -- 172.21.15.44:0/3804434973 wait complete. 2024-03-30T13:13:21.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.716+0000 7fdcccc00640 1 Processor -- start 2024-03-30T13:13:21.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.716+0000 7fdcccc00640 1 -- start start 2024-03-30T13:13:21.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.717+0000 7fdcccc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc80b41f0 0x7fdcc814c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:21.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.717+0000 7fdcccc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc80cf3c0 0x7fdcc80cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.717+0000 7fdcccc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcc815c400 0x7fdcc80c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.717+0000 7fdcccc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc80b5ac0 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.717+0000 7fdcccc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc80b5940 con 0x7fdcc815c400 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.717+0000 7fdcccc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc80b5c40 con 0x7fdcc80b41f0 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.717+0000 7fdcc5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc80cf3c0 0x7fdcc80cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.717+0000 7fdcc5400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc80cf3c0 0x7fdcc80cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60438/0 (socket says 172.21.15.44:60438) 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.717+0000 7fdcc5400640 1 -- 172.21.15.44:0/3122510769 learned_addr learned my addr 172.21.15.44:0/3122510769 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.718+0000 7fdcc5e00640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc80b41f0 0x7fdcc814c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.718+0000 7fdcc5400640 1 -- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc80b41f0 msgr2=0x7fdcc814c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.718+0000 7fdcc6800640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcc815c400 0x7fdcc80c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.718+0000 7fdcc5400640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc80b41f0 0x7fdcc814c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.718+0000 7fdcc5400640 1 -- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcc815c400 msgr2=0x7fdcc80c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.718+0000 7fdcc5400640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcc815c400 0x7fdcc80c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.718+0000 7fdcc5400640 1 -- 172.21.15.44:0/3122510769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc80ca9f0 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.718+0000 7fdcc5400640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc80cf3c0 0x7fdcc80cba90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00097a0 tx=0x7fdcb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:21.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.718+0000 7fdcbe000640 1 -- 172.21.15.44:0/3122510769 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0004230 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.718+0000 7fdcbe000640 1 -- 172.21.15.44:0/3122510769 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb00043f0 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.718+0000 7fdcccc00640 1 -- 172.21.15.44:0/3122510769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc80cacd0 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.718+0000 7fdcbe000640 1 -- 172.21.15.44:0/3122510769 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0032860 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.719+0000 7fdcccc00640 1 -- 172.21.15.44:0/3122510769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc80cb290 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.719+0000 7fdcccc00640 1 -- 172.21.15.44:0/3122510769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc8075a10 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.721+0000 7fdcbe000640 1 -- 172.21.15.44:0/3122510769 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdcb0032a00 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.722+0000 7fdcbe000640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdca406c530 0x7fdca406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:21.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.722+0000 7fdcbe000640 1 -- 172.21.15.44:0/3122510769 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fdcb00ad8f0 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.722+0000 7fdcc5e00640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdca406c530 0x7fdca406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:21.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.724+0000 7fdcc5e00640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdca406c530 0x7fdca406e9f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8000f60 tx=0x7fdcb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:21.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.725+0000 7fdcbe000640 1 -- 172.21.15.44:0/3122510769 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fdcb0041070 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.927+0000 7fdcccc00640 1 -- 172.21.15.44:0/3122510769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fdcc80b6ba0 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.928+0000 7fdcbe000640 1 -- 172.21.15.44:0/3122510769 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) ==== 84+0+65 (secure 0 0 0) 0x7fdcb002f050 con 0x7fdcc80cf3c0 2024-03-30T13:13:21.933 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:21.933 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-03-30T13:13:21.933 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:13:21.933 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-03-30T13:13:21.934 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-03-30T13:13:21.934 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:13:21.934 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-03-30T13:13:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.930+0000 7fdcccc00640 1 -- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdca406c530 msgr2=0x7fdca406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.930+0000 7fdcccc00640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdca406c530 0x7fdca406e9f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8000f60 tx=0x7fdcb8009040 comp rx=0 tx=0).stop 2024-03-30T13:13:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.930+0000 7fdcccc00640 1 -- 172.21.15.44:0/3122510769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc80cf3c0 msgr2=0x7fdcc80cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.931+0000 7fdcccc00640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc80cf3c0 0x7fdcc80cba90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00097a0 tx=0x7fdcb00046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.931+0000 7fdcccc00640 1 -- 172.21.15.44:0/3122510769 shutdown_connections 2024-03-30T13:13:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.931+0000 7fdcccc00640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdca406c530 0x7fdca406e9f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.931+0000 7fdcccc00640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcc815c400 0x7fdcc80c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.931+0000 7fdcccc00640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdcc80cf3c0 0x7fdcc80cba90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.931+0000 7fdcccc00640 1 --2- 172.21.15.44:0/3122510769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc80b41f0 0x7fdcc814c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.931+0000 7fdcccc00640 1 -- 172.21.15.44:0/3122510769 >> 172.21.15.44:0/3122510769 conn(0x7fdcc80672c0 msgr2=0x7fdcc806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.931+0000 7fdcccc00640 1 -- 172.21.15.44:0/3122510769 shutdown_connections 2024-03-30T13:13:21.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:21.931+0000 7fdcccc00640 1 -- 172.21.15.44:0/3122510769 wait complete. 2024-03-30T13:13:21.955 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-30T13:13:21.955 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-30T13:13:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.175+0000 7fd8e4e00640 1 Processor -- start 2024-03-30T13:13:22.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.175+0000 7fd8e4e00640 1 -- start start 2024-03-30T13:13:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.177+0000 7fd8e4e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd8e0161c30 0x7fd8e00d2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.177+0000 7fd8e4e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd8e00b5870 0x7fd8e00d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.177+0000 7fd8e4e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e00c7870 0x7fd8e00d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.177+0000 7fd8e4e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd8e0162010 con 0x7fd8e0161c30 2024-03-30T13:13:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.177+0000 7fd8e4e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fd8e00b31c0 con 0x7fd8e00b5870 2024-03-30T13:13:22.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.177+0000 7fd8e4e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e00d22f0 con 0x7fd8e00c7870 2024-03-30T13:13:22.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.178+0000 7fd8df400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd8e0161c30 0x7fd8e00d2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:22.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.178+0000 7fd8df400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd8e0161c30 0x7fd8e00d2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60440/0 (socket says 172.21.15.44:60440) 2024-03-30T13:13:22.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.178+0000 7fd8df400640 1 -- 172.21.15.44:0/3179221852 learned_addr learned my addr 172.21.15.44:0/3179221852 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:22.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.178+0000 7fd8d7e00640 1 --2- 172.21.15.44:0/3179221852 >> v2:172.21.15.151:3300/0 conn(0x7fd8e00b5870 0x7fd8e00d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:22.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.178+0000 7fd8dfe00640 1 --2- 172.21.15.44:0/3179221852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e00c7870 0x7fd8e00d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:22.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.178+0000 7fd8df400640 1 -- 172.21.15.44:0/3179221852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e00c7870 msgr2=0x7fd8e00d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:22.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.178+0000 7fd8df400640 1 --2- 172.21.15.44:0/3179221852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e00c7870 0x7fd8e00d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:22.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.178+0000 7fd8df400640 1 -- 172.21.15.44:0/3179221852 >> v2:172.21.15.151:3300/0 conn(0x7fd8e00b5870 msgr2=0x7fd8e00d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:22.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.178+0000 7fd8df400640 1 --2- 172.21.15.44:0/3179221852 >> v2:172.21.15.151:3300/0 conn(0x7fd8e00b5870 0x7fd8e00d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:22.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.178+0000 7fd8df400640 1 -- 172.21.15.44:0/3179221852 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e00d25d0 con 0x7fd8e0161c30 2024-03-30T13:13:22.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.178+0000 7fd8dfe00640 1 --2- 172.21.15.44:0/3179221852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e00c7870 0x7fd8e00d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:22.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.179+0000 7fd8df400640 1 --2- 172.21.15.44:0/3179221852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8e0161c30 0x7fd8e00d2dd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0069010 tx=0x7fd8d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4678d0beb1bf2173 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:22.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.180+0000 7fd8dea00640 1 -- 172.21.15.44:0/3179221852 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0035020 con 0x7fd8e0161c30 2024-03-30T13:13:22.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.180+0000 7fd8dea00640 1 -- 172.21.15.44:0/3179221852 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d0031870 con 0x7fd8e0161c30 2024-03-30T13:13:22.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.180+0000 7fd8dea00640 1 -- 172.21.15.44:0/3179221852 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0031c40 con 0x7fd8e0161c30 2024-03-30T13:13:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.180+0000 7fd8e4e00640 1 -- 172.21.15.44:0/3179221852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8e0161c30 msgr2=0x7fd8e00d2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.180+0000 7fd8e4e00640 1 --2- 172.21.15.44:0/3179221852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8e0161c30 0x7fd8e00d2dd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0069010 tx=0x7fd8d002b910 comp rx=0 tx=0).stop 2024-03-30T13:13:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.181+0000 7fd8e4e00640 1 -- 172.21.15.44:0/3179221852 shutdown_connections 2024-03-30T13:13:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.181+0000 7fd8e4e00640 1 --2- 172.21.15.44:0/3179221852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e00c7870 0x7fd8e00d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.181+0000 7fd8e4e00640 1 --2- 172.21.15.44:0/3179221852 >> v2:172.21.15.151:3300/0 conn(0x7fd8e00b5870 0x7fd8e00d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.181+0000 7fd8e4e00640 1 --2- 172.21.15.44:0/3179221852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8e0161c30 0x7fd8e00d2dd0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.181+0000 7fd8e4e00640 1 -- 172.21.15.44:0/3179221852 >> 172.21.15.44:0/3179221852 conn(0x7fd8e009d510 msgr2=0x7fd8e00d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.181+0000 7fd8e4e00640 1 -- 172.21.15.44:0/3179221852 shutdown_connections 2024-03-30T13:13:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.181+0000 7fd8e4e00640 1 -- 172.21.15.44:0/3179221852 wait complete. 2024-03-30T13:13:22.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.183+0000 7fd8e4e00640 1 Processor -- start 2024-03-30T13:13:22.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.183+0000 7fd8e4e00640 1 -- start start 2024-03-30T13:13:22.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.184+0000 7fd8e4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8e00b5870 0x7fd8e00b9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:22.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8e4e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e00c7870 0x7fd8e00c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:22.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8e4e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e0161c30 0x7fd8e01f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:22.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8e4e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e00b3600 con 0x7fd8e00b5870 2024-03-30T13:13:22.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8e4e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e00d3310 con 0x7fd8e0161c30 2024-03-30T13:13:22.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8e4e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e00b3780 con 0x7fd8e00c7870 2024-03-30T13:13:22.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8e00b5870 0x7fd8e00b9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:22.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8e00b5870 0x7fd8e00b9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60452/0 (socket says 172.21.15.44:60452) 2024-03-30T13:13:22.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8df400640 1 -- 172.21.15.44:0/1691205557 learned_addr learned my addr 172.21.15.44:0/1691205557 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:22.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8d7e00640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e00c7870 0x7fd8e00c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:22.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8df400640 1 -- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e00c7870 msgr2=0x7fd8e00c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:22.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8dfe00640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e0161c30 0x7fd8e01f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8df400640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e00c7870 0x7fd8e00c9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8df400640 1 -- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e0161c30 msgr2=0x7fd8e01f41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8df400640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e0161c30 0x7fd8e01f41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.185+0000 7fd8df400640 1 -- 172.21.15.44:0/1691205557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e00ca710 con 0x7fd8e00b5870 2024-03-30T13:13:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.186+0000 7fd8df400640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8e00b5870 0x7fd8e00b9980 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd8d002b950 tx=0x7fd8d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.186+0000 7fd8d7400640 1 -- 172.21.15.44:0/1691205557 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0040070 con 0x7fd8e00b5870 2024-03-30T13:13:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.186+0000 7fd8d7400640 1 -- 172.21.15.44:0/1691205557 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d0030d00 con 0x7fd8e00b5870 2024-03-30T13:13:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.186+0000 7fd8d7400640 1 -- 172.21.15.44:0/1691205557 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d0035040 con 0x7fd8e00b5870 2024-03-30T13:13:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.186+0000 7fd8e4e00640 1 -- 172.21.15.44:0/1691205557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e00ca9f0 con 0x7fd8e00b5870 2024-03-30T13:13:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.186+0000 7fd8e4e00640 1 -- 172.21.15.44:0/1691205557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e00cc710 con 0x7fd8e00b5870 2024-03-30T13:13:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.188+0000 7fd8e4e00640 1 -- 172.21.15.44:0/1691205557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e0075890 con 0x7fd8e00b5870 2024-03-30T13:13:22.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.189+0000 7fd8d7400640 1 -- 172.21.15.44:0/1691205557 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd8d004b060 con 0x7fd8e00b5870 2024-03-30T13:13:22.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.189+0000 7fd8d7400640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd8bc06c530 0x7fd8bc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:22.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.189+0000 7fd8d7400640 1 -- 172.21.15.44:0/1691205557 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5249+0+0 (secure 0 0 0) 0x7fd8d00ad2e0 con 0x7fd8e00b5870 2024-03-30T13:13:22.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.190+0000 7fd8d7e00640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd8bc06c530 0x7fd8bc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.191+0000 7fd8d7e00640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd8bc06c530 0x7fd8bc06e9f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8006fd0 tx=0x7fd8c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:22.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.194+0000 7fd8d7400640 1 -- 172.21.15.44:0/1691205557 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd8d007bab0 con 0x7fd8e00b5870 2024-03-30T13:13:22.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.399+0000 7fd8e4e00640 1 -- 172.21.15.44:0/1691205557 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd8e00680b0 con 0x7fd8e00b5870 2024-03-30T13:13:22.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.866+0000 7fd8d7400640 1 -- 172.21.15.44:0/1691205557 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) ==== 138+0+0 (secure 0 0 0) 0x7fd8d007b3b0 con 0x7fd8e00b5870 2024-03-30T13:13:22.872 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-03-30T13:13:22.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.870+0000 7fd8e4e00640 1 -- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd8bc06c530 msgr2=0x7fd8bc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:22.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.870+0000 7fd8e4e00640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd8bc06c530 0x7fd8bc06e9f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8006fd0 tx=0x7fd8c8008040 comp rx=0 tx=0).stop 2024-03-30T13:13:22.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.870+0000 7fd8e4e00640 1 -- 172.21.15.44:0/1691205557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8e00b5870 msgr2=0x7fd8e00b9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:22.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.870+0000 7fd8e4e00640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8e00b5870 0x7fd8e00b9980 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd8d002b950 tx=0x7fd8d00046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:22.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.870+0000 7fd8e4e00640 1 -- 172.21.15.44:0/1691205557 shutdown_connections 2024-03-30T13:13:22.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.870+0000 7fd8e4e00640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd8bc06c530 0x7fd8bc06e9f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:22.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.870+0000 7fd8e4e00640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8e0161c30 0x7fd8e01f41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:22.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.870+0000 7fd8e4e00640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8e00c7870 0x7fd8e00c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:22.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.870+0000 7fd8e4e00640 1 --2- 172.21.15.44:0/1691205557 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd8e00b5870 0x7fd8e00b9980 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:22.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.870+0000 7fd8e4e00640 1 -- 172.21.15.44:0/1691205557 >> 172.21.15.44:0/1691205557 conn(0x7fd8e009d510 msgr2=0x7fd8e006d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:22.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.871+0000 7fd8e4e00640 1 -- 172.21.15.44:0/1691205557 shutdown_connections 2024-03-30T13:13:22.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:22.871+0000 7fd8e4e00640 1 -- 172.21.15.44:0/1691205557 wait complete. 2024-03-30T13:13:22.903 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-30T13:13:23.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.107+0000 7f78faa00640 1 Processor -- start 2024-03-30T13:13:23.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.107+0000 7f78faa00640 1 -- start start 2024-03-30T13:13:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.109+0000 7f78faa00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78f415e4f0 0x7f78f40b9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.109+0000 7f78faa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f78f40b6520 0x7f78f40d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.109+0000 7f78faa00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f40d2e40 con 0x7f78f40d3ee0 2024-03-30T13:13:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.109+0000 7f78faa00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f78f40d3a50 con 0x7f78f40b6520 2024-03-30T13:13:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.109+0000 7f78faa00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f78f40d3120 con 0x7f78f415e4f0 2024-03-30T13:13:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.109+0000 7f78f8a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f78f40b6520 0x7f78f40d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.109+0000 7f78f8a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f78f40b6520 0x7f78f40d26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60460/0 (socket says 172.21.15.44:60460) 2024-03-30T13:13:23.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.109+0000 7f78f8a00640 1 -- 172.21.15.44:0/4010207746 learned_addr learned my addr 172.21.15.44:0/4010207746 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:23.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.109+0000 7f78f3e00640 1 --2- 172.21.15.44:0/4010207746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78f415e4f0 0x7f78f40b9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:23.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.110+0000 7f78f8a00640 1 -- 172.21.15.44:0/4010207746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78f415e4f0 msgr2=0x7f78f40b9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:23.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.110+0000 7f78f8a00640 1 --2- 172.21.15.44:0/4010207746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78f415e4f0 0x7f78f40b9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:23.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.110+0000 7f78f8a00640 1 -- 172.21.15.44:0/4010207746 >> v1:172.21.15.151:6789/0 conn(0x7f78f40d3ee0 legacy=0x7f78f40b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:23.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.110+0000 7f78f8a00640 1 -- 172.21.15.44:0/4010207746 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f40d3400 con 0x7f78f40b6520 2024-03-30T13:13:23.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.111+0000 7f78f8a00640 1 --2- 172.21.15.44:0/4010207746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78f40b6520 0x7f78f40d26f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009e50 tx=0x7f78ec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a69ece2d6d805f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:23.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.111+0000 7f78f2a00640 1 -- 172.21.15.44:0/4010207746 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec02ca70 con 0x7f78f40b6520 2024-03-30T13:13:23.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.111+0000 7f78f2a00640 1 -- 172.21.15.44:0/4010207746 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78ec02cc10 con 0x7f78f40b6520 2024-03-30T13:13:23.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.111+0000 7f78f2a00640 1 -- 172.21.15.44:0/4010207746 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0343f0 con 0x7f78f40b6520 2024-03-30T13:13:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.112+0000 7f78faa00640 1 -- 172.21.15.44:0/4010207746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78f40b6520 msgr2=0x7f78f40d26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.112+0000 7f78faa00640 1 --2- 172.21.15.44:0/4010207746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78f40b6520 0x7f78f40d26f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009e50 tx=0x7f78ec02bed0 comp rx=0 tx=0).stop 2024-03-30T13:13:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.112+0000 7f78faa00640 1 -- 172.21.15.44:0/4010207746 shutdown_connections 2024-03-30T13:13:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.112+0000 7f78faa00640 1 --2- 172.21.15.44:0/4010207746 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78f40b6520 0x7f78f40d26f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.112+0000 7f78faa00640 1 --2- 172.21.15.44:0/4010207746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78f415e4f0 0x7f78f40b9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.112+0000 7f78faa00640 1 -- 172.21.15.44:0/4010207746 >> 172.21.15.44:0/4010207746 conn(0x7f78f40678f0 msgr2=0x7f78f40d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.112+0000 7f78faa00640 1 -- 172.21.15.44:0/4010207746 shutdown_connections 2024-03-30T13:13:23.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.112+0000 7f78faa00640 1 -- 172.21.15.44:0/4010207746 wait complete. 2024-03-30T13:13:23.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.114+0000 7f78faa00640 1 Processor -- start 2024-03-30T13:13:23.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.114+0000 7f78faa00640 1 -- start start 2024-03-30T13:13:23.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.115+0000 7f78faa00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78f40b6520 0x7f78f40c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:23.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.115+0000 7f78faa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78f40d3ee0 0x7f78f41e6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:23.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.115+0000 7f78faa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78f415e4f0 0x7f78f40cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:23.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.115+0000 7f78faa00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f78f40b74c0 con 0x7f78f415e4f0 2024-03-30T13:13:23.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.115+0000 7f78faa00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f78f415e8d0 con 0x7f78f40d3ee0 2024-03-30T13:13:23.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.115+0000 7f78faa00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f78f40b7640 con 0x7f78f40b6520 2024-03-30T13:13:23.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.115+0000 7f78f8a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78f415e4f0 0x7f78f40cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:23.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.115+0000 7f78f8a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78f415e4f0 0x7f78f40cd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60470/0 (socket says 172.21.15.44:60470) 2024-03-30T13:13:23.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.115+0000 7f78f8a00640 1 -- 172.21.15.44:0/1494886388 learned_addr learned my addr 172.21.15.44:0/1494886388 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:23.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.116+0000 7f78f3e00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78f40b6520 0x7f78f40c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:23.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.116+0000 7f78f3400640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78f40d3ee0 0x7f78f41e6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.116+0000 7f78f8a00640 1 -- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78f40b6520 msgr2=0x7f78f40c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.116+0000 7f78f8a00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78f40b6520 0x7f78f40c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.116+0000 7f78f8a00640 1 -- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78f40d3ee0 msgr2=0x7f78f41e6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.116+0000 7f78f8a00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78f40d3ee0 0x7f78f41e6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.116+0000 7f78f8a00640 1 -- 172.21.15.44:0/1494886388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f40c76d0 con 0x7f78f415e4f0 2024-03-30T13:13:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.116+0000 7f78f8a00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78f415e4f0 0x7f78f40cd630 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009e50 tx=0x7f78ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.117+0000 7f78ebe00640 1 -- 172.21.15.44:0/1494886388 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec043020 con 0x7f78f415e4f0 2024-03-30T13:13:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.117+0000 7f78ebe00640 1 -- 172.21.15.44:0/1494886388 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78ec03e450 con 0x7f78f415e4f0 2024-03-30T13:13:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.117+0000 7f78ebe00640 1 -- 172.21.15.44:0/1494886388 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ec009510 con 0x7f78f415e4f0 2024-03-30T13:13:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.117+0000 7f78faa00640 1 -- 172.21.15.44:0/1494886388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f41e7500 con 0x7f78f415e4f0 2024-03-30T13:13:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.117+0000 7f78faa00640 1 -- 172.21.15.44:0/1494886388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f41e7ac0 con 0x7f78f415e4f0 2024-03-30T13:13:23.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.118+0000 7f78faa00640 1 -- 172.21.15.44:0/1494886388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f41e7cc0 con 0x7f78f415e4f0 2024-03-30T13:13:23.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.119+0000 7f78ebe00640 1 -- 172.21.15.44:0/1494886388 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f78ec046020 con 0x7f78f415e4f0 2024-03-30T13:13:23.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.120+0000 7f78ebe00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f78d406c530 0x7f78d406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:23.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.120+0000 7f78ebe00640 1 -- 172.21.15.44:0/1494886388 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5619+0+0 (secure 0 0 0) 0x7f78ec0aded0 con 0x7f78f415e4f0 2024-03-30T13:13:23.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.121+0000 7f78f3e00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f78d406c530 0x7f78d406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:23.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.122+0000 7f78f3e00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f78d406c530 0x7f78d406e9f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f78e4006fd0 tx=0x7f78e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:23.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.125+0000 7f78ebe00640 1 -- 172.21.15.44:0/1494886388 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f78f41e7cc0 con 0x7f78f415e4f0 2024-03-30T13:13:23.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.331+0000 7f78faa00640 1 -- 172.21.15.44:0/1494886388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f78f4075890 con 0x7f78f415e4f0 2024-03-30T13:13:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.873+0000 7f78ebe00640 1 -- 172.21.15.44:0/1494886388 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) ==== 170+0+0 (secure 0 0 0) 0x7f78ec04d030 con 0x7f78f415e4f0 2024-03-30T13:13:23.878 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-03-30T13:13:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.878+0000 7f78faa00640 1 -- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f78d406c530 msgr2=0x7f78d406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:23.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.878+0000 7f78faa00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f78d406c530 0x7f78d406e9f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f78e4006fd0 tx=0x7f78e4008040 comp rx=0 tx=0).stop 2024-03-30T13:13:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.878+0000 7f78faa00640 1 -- 172.21.15.44:0/1494886388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78f415e4f0 msgr2=0x7f78f40cd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.878+0000 7f78faa00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78f415e4f0 0x7f78f40cd630 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009e50 tx=0x7f78ec004a40 comp rx=0 tx=0).stop 2024-03-30T13:13:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.879+0000 7f78faa00640 1 -- 172.21.15.44:0/1494886388 shutdown_connections 2024-03-30T13:13:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.879+0000 7f78faa00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78f415e4f0 0x7f78f40cd630 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.879+0000 7f78faa00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f78d406c530 0x7f78d406e9f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.879+0000 7f78faa00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78f40d3ee0 0x7f78f41e6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.879+0000 7f78faa00640 1 --2- 172.21.15.44:0/1494886388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78f40b6520 0x7f78f40c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.879+0000 7f78faa00640 1 -- 172.21.15.44:0/1494886388 >> 172.21.15.44:0/1494886388 conn(0x7f78f40678f0 msgr2=0x7f78f415c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:23.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.880+0000 7f78faa00640 1 -- 172.21.15.44:0/1494886388 shutdown_connections 2024-03-30T13:13:23.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:23.880+0000 7f78faa00640 1 -- 172.21.15.44:0/1494886388 wait complete. 2024-03-30T13:13:23.922 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-30T13:13:24.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.105+0000 7f8770e00640 1 Processor -- start 2024-03-30T13:13:24.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.105+0000 7f8770e00640 1 -- start start 2024-03-30T13:13:24.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.107+0000 7f8770e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f876c144cb0 0x7f876c0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:24.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.107+0000 7f8770e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f876c15f800 0x7f876c072640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:24.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.107+0000 7f8770e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f876c0b35e0 con 0x7f876c072b80 2024-03-30T13:13:24.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.107+0000 7f8770e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f876c0b3e80 con 0x7f876c15f800 2024-03-30T13:13:24.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.107+0000 7f8770e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f876c0b38c0 con 0x7f876c144cb0 2024-03-30T13:13:24.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.108+0000 7f8769e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f876c144cb0 0x7f876c0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:24.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.108+0000 7f8761400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f876c15f800 0x7f876c072640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:24.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.108+0000 7f876a800640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f876c072b80 0x7f876c071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:57200/0 (socket says 172.21.15.44:57200) 2024-03-30T13:13:24.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.108+0000 7f8761400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f876c15f800 0x7f876c072640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:33650/0 (socket says 172.21.15.44:33650) 2024-03-30T13:13:24.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.108+0000 7f876a800640 1 -- 172.21.15.44:0/4117548552 learned_addr learned my addr 172.21.15.44:0/4117548552 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:24.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.109+0000 7f8761400640 1 -- 172.21.15.44:0/4117548552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f876c144cb0 msgr2=0x7f876c0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:24.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.109+0000 7f8761400640 1 --2- 172.21.15.44:0/4117548552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f876c144cb0 0x7f876c0b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:24.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.109+0000 7f8761400640 1 -- 172.21.15.44:0/4117548552 >> v1:172.21.15.151:6789/0 conn(0x7f876c072b80 legacy=0x7f876c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:24.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.109+0000 7f8761400640 1 -- 172.21.15.44:0/4117548552 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c0b3ba0 con 0x7f876c15f800 2024-03-30T13:13:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.110+0000 7f8761400640 1 --2- 172.21.15.44:0/4117548552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f876c15f800 0x7f876c072640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f87540097a0 tx=0x7f875402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d40eb81854792a97 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.111+0000 7f8769400640 1 -- 172.21.15.44:0/4117548552 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8754035020 con 0x7f876c15f800 2024-03-30T13:13:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.111+0000 7f8769400640 1 -- 172.21.15.44:0/4117548552 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8754031830 con 0x7f876c15f800 2024-03-30T13:13:24.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.111+0000 7f8769400640 1 -- 172.21.15.44:0/4117548552 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8754031c00 con 0x7f876c15f800 2024-03-30T13:13:24.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.111+0000 7f8770e00640 1 -- 172.21.15.44:0/4117548552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f876c15f800 msgr2=0x7f876c072640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:24.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.111+0000 7f8770e00640 1 --2- 172.21.15.44:0/4117548552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f876c15f800 0x7f876c072640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f87540097a0 tx=0x7f875402b8d0 comp rx=0 tx=0).stop 2024-03-30T13:13:24.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.111+0000 7f8770e00640 1 -- 172.21.15.44:0/4117548552 shutdown_connections 2024-03-30T13:13:24.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.111+0000 7f8770e00640 1 --2- 172.21.15.44:0/4117548552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f876c15f800 0x7f876c072640 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:24.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.111+0000 7f8770e00640 1 --2- 172.21.15.44:0/4117548552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f876c144cb0 0x7f876c0b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:24.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.111+0000 7f8770e00640 1 -- 172.21.15.44:0/4117548552 >> 172.21.15.44:0/4117548552 conn(0x7f876c0b5b00 msgr2=0x7f876c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:24.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.111+0000 7f8770e00640 1 -- 172.21.15.44:0/4117548552 shutdown_connections 2024-03-30T13:13:24.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.111+0000 7f8770e00640 1 -- 172.21.15.44:0/4117548552 wait complete. 2024-03-30T13:13:24.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.113+0000 7f8770e00640 1 Processor -- start 2024-03-30T13:13:24.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.113+0000 7f8770e00640 1 -- start start 2024-03-30T13:13:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.114+0000 7f8770e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f876c072b80 0x7f876c13d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.114+0000 7f8770e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f876c144cb0 0x7f876c15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.114+0000 7f8770e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876c15f800 0x7f876c139140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.114+0000 7f8770e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f876c0cf060 con 0x7f876c15f800 2024-03-30T13:13:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.114+0000 7f8770e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f876c15fc40 con 0x7f876c144cb0 2024-03-30T13:13:24.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.114+0000 7f8770e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f876c0cf1e0 con 0x7f876c072b80 2024-03-30T13:13:24.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.115+0000 7f876a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876c15f800 0x7f876c139140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:24.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.115+0000 7f876a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876c15f800 0x7f876c139140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60486/0 (socket says 172.21.15.44:60486) 2024-03-30T13:13:24.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.115+0000 7f876a800640 1 -- 172.21.15.44:0/4291564130 learned_addr learned my addr 172.21.15.44:0/4291564130 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.115+0000 7f8769e00640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f876c072b80 0x7f876c13d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.115+0000 7f8761400640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f876c144cb0 0x7f876c15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.115+0000 7f876a800640 1 -- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f876c072b80 msgr2=0x7f876c13d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.115+0000 7f876a800640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f876c072b80 0x7f876c13d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.115+0000 7f876a800640 1 -- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f876c144cb0 msgr2=0x7f876c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.115+0000 7f876a800640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f876c144cb0 0x7f876c15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.115+0000 7f876a800640 1 -- 172.21.15.44:0/4291564130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c1380e0 con 0x7f876c15f800 2024-03-30T13:13:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.115+0000 7f8761400640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f876c144cb0 0x7f876c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:24.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.116+0000 7f876a800640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876c15f800 0x7f876c139140 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f876400cbc0 tx=0x7f876400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:24.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.116+0000 7f8762a00640 1 -- 172.21.15.44:0/4291564130 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8764017070 con 0x7f876c15f800 2024-03-30T13:13:24.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.116+0000 7f8762a00640 1 -- 172.21.15.44:0/4291564130 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876400ad40 con 0x7f876c15f800 2024-03-30T13:13:24.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.116+0000 7f8770e00640 1 -- 172.21.15.44:0/4291564130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876c13db30 con 0x7f876c15f800 2024-03-30T13:13:24.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.116+0000 7f8762a00640 1 -- 172.21.15.44:0/4291564130 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8764012600 con 0x7f876c15f800 2024-03-30T13:13:24.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.116+0000 7f8770e00640 1 -- 172.21.15.44:0/4291564130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f876c138660 con 0x7f876c15f800 2024-03-30T13:13:24.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.117+0000 7f8770e00640 1 -- 172.21.15.44:0/4291564130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f876c075890 con 0x7f876c15f800 2024-03-30T13:13:24.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.119+0000 7f8762a00640 1 -- 172.21.15.44:0/4291564130 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f876401a070 con 0x7f876c15f800 2024-03-30T13:13:24.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.120+0000 7f8762a00640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f874806c530 0x7f874806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:24.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.120+0000 7f8762a00640 1 -- 172.21.15.44:0/4291564130 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6001+0+0 (secure 0 0 0) 0x7f876408b900 con 0x7f876c15f800 2024-03-30T13:13:24.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.120+0000 7f8769e00640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f874806c530 0x7f874806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:24.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.121+0000 7f8769e00640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f874806c530 0x7f874806e9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f875c009ad0 tx=0x7f875c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:24.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.123+0000 7f8762a00640 1 -- 172.21.15.44:0/4291564130 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8764059810 con 0x7f876c15f800 2024-03-30T13:13:24.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.370+0000 7f8770e00640 1 -- 172.21.15.44:0/4291564130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f876c0b4030 con 0x7f876c15f800 2024-03-30T13:13:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.917+0000 7f8762a00640 1 -- 172.21.15.44:0/4291564130 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f876405db10 con 0x7f876c15f800 2024-03-30T13:13:24.922 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 5 and data pool 6 2024-03-30T13:13:24.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.923+0000 7f8770e00640 1 -- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f874806c530 msgr2=0x7f874806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.923+0000 7f8770e00640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f874806c530 0x7f874806e9f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f875c009ad0 tx=0x7f875c008040 comp rx=0 tx=0).stop 2024-03-30T13:13:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.923+0000 7f8770e00640 1 -- 172.21.15.44:0/4291564130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876c15f800 msgr2=0x7f876c139140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:24.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.923+0000 7f8770e00640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876c15f800 0x7f876c139140 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f876400cbc0 tx=0x7f876400a430 comp rx=0 tx=0).stop 2024-03-30T13:13:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.925+0000 7f8770e00640 1 -- 172.21.15.44:0/4291564130 shutdown_connections 2024-03-30T13:13:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.926+0000 7f8770e00640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f876c15f800 0x7f876c139140 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.926+0000 7f8770e00640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f874806c530 0x7f874806e9f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.926+0000 7f8770e00640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f876c144cb0 0x7f876c15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.926+0000 7f8770e00640 1 --2- 172.21.15.44:0/4291564130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f876c072b80 0x7f876c13d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.926+0000 7f8770e00640 1 -- 172.21.15.44:0/4291564130 >> 172.21.15.44:0/4291564130 conn(0x7f876c0b5b00 msgr2=0x7f876c0716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:24.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.926+0000 7f8770e00640 1 -- 172.21.15.44:0/4291564130 shutdown_connections 2024-03-30T13:13:24.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:24.927+0000 7f8770e00640 1 -- 172.21.15.44:0/4291564130 wait complete. 2024-03-30T13:13:24.970 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:13:25.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.146+0000 7f75c5600640 1 Processor -- start 2024-03-30T13:13:25.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.146+0000 7f75c5600640 1 -- start start 2024-03-30T13:13:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.147+0000 7f75c5600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75c00ced60 0x7f75c0162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.147+0000 7f75c5600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75c00735e0 0x7f75c0071740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.147+0000 7f75c5600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c0163030 con 0x7f75c00cf140 2024-03-30T13:13:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.148+0000 7f75c5600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f75c01480c0 con 0x7f75c00ced60 2024-03-30T13:13:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.148+0000 7f75c5600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f75c00c9760 con 0x7f75c00735e0 2024-03-30T13:13:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.148+0000 7f75bea00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75c00ced60 0x7f75c0162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.148+0000 7f75bea00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f75c00ced60 0x7f75c0162af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60502/0 (socket says 172.21.15.44:60502) 2024-03-30T13:13:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.148+0000 7f75bea00640 1 -- 172.21.15.44:0/406046981 learned_addr learned my addr 172.21.15.44:0/406046981 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:25.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.148+0000 7f75bf400640 1 --2- 172.21.15.44:0/406046981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75c00735e0 0x7f75c0071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:25.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.148+0000 7f75bea00640 1 -- 172.21.15.44:0/406046981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75c00735e0 msgr2=0x7f75c0071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:25.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.149+0000 7f75bea00640 1 --2- 172.21.15.44:0/406046981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75c00735e0 0x7f75c0071740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.149+0000 7f75bea00640 1 -- 172.21.15.44:0/406046981 >> v1:172.21.15.151:6789/0 conn(0x7f75c00cf140 legacy=0x7f75c0072ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:25.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.149+0000 7f75bea00640 1 -- 172.21.15.44:0/406046981 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c00c9a40 con 0x7f75c00ced60 2024-03-30T13:13:25.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.150+0000 7f75bea00640 1 --2- 172.21.15.44:0/406046981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75c00ced60 0x7f75c0162af0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009870 tx=0x7f75b002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb71cc9c8a9c9be9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.150+0000 7f75bd600640 1 -- 172.21.15.44:0/406046981 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0035020 con 0x7f75c00ced60 2024-03-30T13:13:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.150+0000 7f75bd600640 1 -- 172.21.15.44:0/406046981 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b0031640 con 0x7f75c00ced60 2024-03-30T13:13:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.150+0000 7f75bd600640 1 -- 172.21.15.44:0/406046981 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b002d040 con 0x7f75c00ced60 2024-03-30T13:13:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.151+0000 7f75c5600640 1 -- 172.21.15.44:0/406046981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75c00ced60 msgr2=0x7f75c0162af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.151+0000 7f75c5600640 1 --2- 172.21.15.44:0/406046981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75c00ced60 0x7f75c0162af0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009870 tx=0x7f75b002b8f0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.151+0000 7f75c5600640 1 -- 172.21.15.44:0/406046981 shutdown_connections 2024-03-30T13:13:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.151+0000 7f75c5600640 1 --2- 172.21.15.44:0/406046981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75c00735e0 0x7f75c0071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.151+0000 7f75c5600640 1 --2- 172.21.15.44:0/406046981 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75c00ced60 0x7f75c0162af0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.151+0000 7f75c5600640 1 -- 172.21.15.44:0/406046981 >> 172.21.15.44:0/406046981 conn(0x7f75c00b1c90 msgr2=0x7f75c00b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.151+0000 7f75c5600640 1 -- 172.21.15.44:0/406046981 shutdown_connections 2024-03-30T13:13:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.151+0000 7f75c5600640 1 -- 172.21.15.44:0/406046981 wait complete. 2024-03-30T13:13:25.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.153+0000 7f75c5600640 1 Processor -- start 2024-03-30T13:13:25.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.153+0000 7f75c5600640 1 -- start start 2024-03-30T13:13:25.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.154+0000 7f75c5600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75c00735e0 0x7f75c015dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:25.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.154+0000 7f75c5600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75c00ced60 0x7f75c015f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:25.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.154+0000 7f75c5600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75c00cf140 0x7f75c00b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:25.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.154+0000 7f75c5600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f75c00ca2e0 con 0x7f75c00ced60 2024-03-30T13:13:25.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.154+0000 7f75c5600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f75c00ca000 con 0x7f75c00735e0 2024-03-30T13:13:25.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.154+0000 7f75c5600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f75c00c9310 con 0x7f75c00cf140 2024-03-30T13:13:25.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.154+0000 7f75be000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75c00ced60 0x7f75c015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:25.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.154+0000 7f75be000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75c00ced60 0x7f75c015f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60504/0 (socket says 172.21.15.44:60504) 2024-03-30T13:13:25.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.154+0000 7f75be000640 1 -- 172.21.15.44:0/2371632926 learned_addr learned my addr 172.21.15.44:0/2371632926 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:25.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.155+0000 7f75bea00640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75c00735e0 0x7f75c015dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:25.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.155+0000 7f75bf400640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75c00cf140 0x7f75c00b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:25.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.155+0000 7f75be000640 1 -- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75c00cf140 msgr2=0x7f75c00b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:25.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.155+0000 7f75be000640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75c00cf140 0x7f75c00b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.155+0000 7f75be000640 1 -- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75c00735e0 msgr2=0x7f75c015dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:25.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.155+0000 7f75be000640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75c00735e0 0x7f75c015dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.155+0000 7f75be000640 1 -- 172.21.15.44:0/2371632926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c015fda0 con 0x7f75c00ced60 2024-03-30T13:13:25.161 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.155+0000 7f75bea00640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75c00735e0 0x7f75c015dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:25.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.155+0000 7f75be000640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75c00ced60 0x7f75c015f570 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f75a800ba50 tx=0x7f75a800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:25.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.156+0000 7f75b6a00640 1 -- 172.21.15.44:0/2371632926 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8019070 con 0x7f75c00ced60 2024-03-30T13:13:25.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.156+0000 7f75b6a00640 1 -- 172.21.15.44:0/2371632926 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a800cc20 con 0x7f75c00ced60 2024-03-30T13:13:25.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.156+0000 7f75c5600640 1 -- 172.21.15.44:0/2371632926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c0160080 con 0x7f75c00ced60 2024-03-30T13:13:25.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.156+0000 7f75b6a00640 1 -- 172.21.15.44:0/2371632926 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8014680 con 0x7f75c00ced60 2024-03-30T13:13:25.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.156+0000 7f75c5600640 1 -- 172.21.15.44:0/2371632926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c0160640 con 0x7f75c00ced60 2024-03-30T13:13:25.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.157+0000 7f75c5600640 1 -- 172.21.15.44:0/2371632926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c0075a10 con 0x7f75c00ced60 2024-03-30T13:13:25.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.158+0000 7f75b6a00640 1 -- 172.21.15.44:0/2371632926 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f75a801c070 con 0x7f75c00ced60 2024-03-30T13:13:25.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.159+0000 7f75b6a00640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f759c06c530 0x7f759c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:25.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.159+0000 7f75b6a00640 1 -- 172.21.15.44:0/2371632926 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f75a808b480 con 0x7f75c00ced60 2024-03-30T13:13:25.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.160+0000 7f75bea00640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f759c06c530 0x7f759c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:25.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.161+0000 7f75bea00640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f759c06c530 0x7f759c06e9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f75b0036000 tx=0x7f75b0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:25.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.164+0000 7f75b6a00640 1 -- 172.21.15.44:0/2371632926 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f75a8059350 con 0x7f75c00ced60 2024-03-30T13:13:25.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.370+0000 7f75c5600640 1 -- 172.21.15.44:0/2371632926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75c015e4a0 con 0x7f75c00ced60 2024-03-30T13:13:25.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.373+0000 7f75b6a00640 1 -- 172.21.15.44:0/2371632926 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16931 (secure 0 0 0) 0x7f75a805d650 con 0x7f75c00ced60 2024-03-30T13:13:25.378 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:25.378 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":40,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:13:24.373244+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:13:22.414656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-30T13:13:23.348753+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:13:25.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.376+0000 7f75c5600640 1 -- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f759c06c530 msgr2=0x7f759c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:25.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.376+0000 7f75c5600640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f759c06c530 0x7f759c06e9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f75b0036000 tx=0x7f75b0008030 comp rx=0 tx=0).stop 2024-03-30T13:13:25.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.376+0000 7f75c5600640 1 -- 172.21.15.44:0/2371632926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75c00ced60 msgr2=0x7f75c015f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:25.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.376+0000 7f75c5600640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75c00ced60 0x7f75c015f570 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f75a800ba50 tx=0x7f75a800bf10 comp rx=0 tx=0).stop 2024-03-30T13:13:25.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.376+0000 7f75c5600640 1 -- 172.21.15.44:0/2371632926 shutdown_connections 2024-03-30T13:13:25.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.376+0000 7f75c5600640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75c00cf140 0x7f75c00b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.376+0000 7f75c5600640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f75c00ced60 0x7f75c015f570 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.376+0000 7f75c5600640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f759c06c530 0x7f759c06e9f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.376+0000 7f75c5600640 1 --2- 172.21.15.44:0/2371632926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75c00735e0 0x7f75c015dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.376+0000 7f75c5600640 1 -- 172.21.15.44:0/2371632926 >> 172.21.15.44:0/2371632926 conn(0x7f75c00b1c90 msgr2=0x7f75c013c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:25.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.376+0000 7f75c5600640 1 -- 172.21.15.44:0/2371632926 shutdown_connections 2024-03-30T13:13:25.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.376+0000 7f75c5600640 1 -- 172.21.15.44:0/2371632926 wait complete. 2024-03-30T13:13:25.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:13:25.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.607+0000 7f93ae600640 1 Processor -- start 2024-03-30T13:13:25.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.607+0000 7f93ae600640 1 -- start start 2024-03-30T13:13:25.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.609+0000 7f93ae600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f93a80d09a0 0x7f93a81566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:25.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.609+0000 7f93ae600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f93a8142300 0x7f93a815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:25.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.609+0000 7f93ae600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93a8160c20 con 0x7f93a81562f0 2024-03-30T13:13:25.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.609+0000 7f93ae600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f93a8156c10 con 0x7f93a80d09a0 2024-03-30T13:13:25.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.609+0000 7f93ae600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f93a81427b0 con 0x7f93a8142300 2024-03-30T13:13:25.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.609+0000 7f93a7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f93a80d09a0 0x7f93a81566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:25.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.609+0000 7f93a7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f93a80d09a0 0x7f93a81566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60512/0 (socket says 172.21.15.44:60512) 2024-03-30T13:13:25.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.609+0000 7f93ad200640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f93a81562f0 0x7f93a80d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48154/0 (socket says 172.21.15.44:48154) 2024-03-30T13:13:25.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.609+0000 7f93a7e00640 1 -- 172.21.15.44:0/1338571787 learned_addr learned my addr 172.21.15.44:0/1338571787 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:25.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.610+0000 7f93adc00640 1 --2- 172.21.15.44:0/1338571787 >> v2:172.21.15.151:3300/0 conn(0x7f93a8142300 0x7f93a815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:25.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.610+0000 7f93a7e00640 1 -- 172.21.15.44:0/1338571787 >> v2:172.21.15.151:3300/0 conn(0x7f93a8142300 msgr2=0x7f93a815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:25.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.610+0000 7f93a7e00640 1 --2- 172.21.15.44:0/1338571787 >> v2:172.21.15.151:3300/0 conn(0x7f93a8142300 0x7f93a815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.610+0000 7f93a7e00640 1 -- 172.21.15.44:0/1338571787 >> v1:172.21.15.44:6789/0 conn(0x7f93a81562f0 legacy=0x7f93a80d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:25.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.610+0000 7f93a7e00640 1 -- 172.21.15.44:0/1338571787 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a81600a0 con 0x7f93a80d09a0 2024-03-30T13:13:25.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.610+0000 7f93adc00640 1 --2- 172.21.15.44:0/1338571787 >> v2:172.21.15.151:3300/0 conn(0x7f93a8142300 0x7f93a815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:25.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.611+0000 7f93a7e00640 1 --2- 172.21.15.44:0/1338571787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a80d09a0 0x7f93a81566d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f93a80cd7f0 tx=0x7f939402b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a7fbe66278debe server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:25.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.611+0000 7f93a7400640 1 -- 172.21.15.44:0/1338571787 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9394035020 con 0x7f93a80d09a0 2024-03-30T13:13:25.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.613+0000 7f93a7400640 1 -- 172.21.15.44:0/1338571787 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9394031880 con 0x7f93a80d09a0 2024-03-30T13:13:25.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.613+0000 7f93a7400640 1 -- 172.21.15.44:0/1338571787 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9394031c50 con 0x7f93a80d09a0 2024-03-30T13:13:25.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.613+0000 7f93ae600640 1 -- 172.21.15.44:0/1338571787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a80d09a0 msgr2=0x7f93a81566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:25.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.613+0000 7f93ae600640 1 --2- 172.21.15.44:0/1338571787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a80d09a0 0x7f93a81566d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f93a80cd7f0 tx=0x7f939402b920 comp rx=0 tx=0).stop 2024-03-30T13:13:25.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.613+0000 7f93ae600640 1 -- 172.21.15.44:0/1338571787 shutdown_connections 2024-03-30T13:13:25.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.613+0000 7f93ae600640 1 --2- 172.21.15.44:0/1338571787 >> v2:172.21.15.151:3300/0 conn(0x7f93a8142300 0x7f93a815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.613+0000 7f93ae600640 1 --2- 172.21.15.44:0/1338571787 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a80d09a0 0x7f93a81566d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.613+0000 7f93ae600640 1 -- 172.21.15.44:0/1338571787 >> 172.21.15.44:0/1338571787 conn(0x7f93a806b9a0 msgr2=0x7f93a806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:25.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.614+0000 7f93ae600640 1 -- 172.21.15.44:0/1338571787 shutdown_connections 2024-03-30T13:13:25.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.614+0000 7f93ae600640 1 -- 172.21.15.44:0/1338571787 wait complete. 2024-03-30T13:13:25.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.615+0000 7f93ae600640 1 Processor -- start 2024-03-30T13:13:25.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.616+0000 7f93ae600640 1 -- start start 2024-03-30T13:13:25.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.617+0000 7f93ae600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a80d09a0 0x7f93a81379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:25.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.617+0000 7f93ae600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a8142300 0x7f93a80b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:25.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.617+0000 7f93ae600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81562f0 0x7f93a8138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:25.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.617+0000 7f93ae600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f93a8160940 con 0x7f93a81562f0 2024-03-30T13:13:25.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.617+0000 7f93ae600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f93a8160660 con 0x7f93a80d09a0 2024-03-30T13:13:25.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.617+0000 7f93ae600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f93a80cca20 con 0x7f93a8142300 2024-03-30T13:13:25.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.618+0000 7f93adc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81562f0 0x7f93a8138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:25.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.618+0000 7f93adc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81562f0 0x7f93a8138380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60526/0 (socket says 172.21.15.44:60526) 2024-03-30T13:13:25.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.618+0000 7f93adc00640 1 -- 172.21.15.44:0/3381099628 learned_addr learned my addr 172.21.15.44:0/3381099628 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:25.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.618+0000 7f93a7e00640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a8142300 0x7f93a80b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:25.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.618+0000 7f93ad200640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a80d09a0 0x7f93a81379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:25.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.618+0000 7f93adc00640 1 -- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a8142300 msgr2=0x7f93a80b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:25.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.618+0000 7f93adc00640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a8142300 0x7f93a80b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.618+0000 7f93adc00640 1 -- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a80d09a0 msgr2=0x7f93a81379a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:25.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.618+0000 7f93adc00640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a80d09a0 0x7f93a81379a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.618+0000 7f93adc00640 1 -- 172.21.15.44:0/3381099628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a80b1e30 con 0x7f93a81562f0 2024-03-30T13:13:25.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.618+0000 7f93ad200640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a80d09a0 0x7f93a81379a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:25.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.619+0000 7f93adc00640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81562f0 0x7f93a8138380 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f93a000cef0 tx=0x7f93a000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:25.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.619+0000 7f93a4c00640 1 -- 172.21.15.44:0/3381099628 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a001a070 con 0x7f93a81562f0 2024-03-30T13:13:25.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.619+0000 7f93a4c00640 1 -- 172.21.15.44:0/3381099628 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a000d860 con 0x7f93a81562f0 2024-03-30T13:13:25.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.619+0000 7f93ae600640 1 -- 172.21.15.44:0/3381099628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a80b2110 con 0x7f93a81562f0 2024-03-30T13:13:25.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.619+0000 7f93a4c00640 1 -- 172.21.15.44:0/3381099628 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a000dc50 con 0x7f93a81562f0 2024-03-30T13:13:25.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.619+0000 7f93ae600640 1 -- 172.21.15.44:0/3381099628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a8155c50 con 0x7f93a81562f0 2024-03-30T13:13:25.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.621+0000 7f93ae600640 1 -- 172.21.15.44:0/3381099628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a815d400 con 0x7f93a81562f0 2024-03-30T13:13:25.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.621+0000 7f93a4c00640 1 -- 172.21.15.44:0/3381099628 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f93a001d070 con 0x7f93a81562f0 2024-03-30T13:13:25.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.622+0000 7f93a4c00640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f938806c560 0x7f938806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:25.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.622+0000 7f93a4c00640 1 -- 172.21.15.44:0/3381099628 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f93a008c080 con 0x7f93a81562f0 2024-03-30T13:13:25.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.623+0000 7f93ad200640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f938806c560 0x7f938806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:25.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.624+0000 7f93ad200640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f938806c560 0x7f938806ea20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f939c000f60 tx=0x7f939c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:25.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.627+0000 7f93a4c00640 1 -- 172.21.15.44:0/3381099628 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f93a005a660 con 0x7f93a81562f0 2024-03-30T13:13:25.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.831+0000 7f93ae600640 1 -- 172.21.15.44:0/3381099628 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93a806ef60 con 0x7f93a81562f0 2024-03-30T13:13:25.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.834+0000 7f93a4c00640 1 -- 172.21.15.44:0/3381099628 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16931 (secure 0 0 0) 0x7f93a0059f60 con 0x7f93a81562f0 2024-03-30T13:13:25.839 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:25.839 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":40,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:13:24.373244+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:13:22.414656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-30T13:13:23.348753+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:13:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.837+0000 7f93ae600640 1 -- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f938806c560 msgr2=0x7f938806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.837+0000 7f93ae600640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f938806c560 0x7f938806ea20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f939c000f60 tx=0x7f939c009040 comp rx=0 tx=0).stop 2024-03-30T13:13:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.837+0000 7f93ae600640 1 -- 172.21.15.44:0/3381099628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81562f0 msgr2=0x7f93a8138380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.837+0000 7f93ae600640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81562f0 0x7f93a8138380 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f93a000cef0 tx=0x7f93a000a710 comp rx=0 tx=0).stop 2024-03-30T13:13:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.837+0000 7f93ae600640 1 -- 172.21.15.44:0/3381099628 shutdown_connections 2024-03-30T13:13:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.837+0000 7f93ae600640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f93a81562f0 0x7f93a8138380 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.837+0000 7f93ae600640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a8142300 0x7f93a80b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.837+0000 7f93ae600640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f938806c560 0x7f938806ea20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.837+0000 7f93ae600640 1 --2- 172.21.15.44:0/3381099628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a80d09a0 0x7f93a81379a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:25.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.837+0000 7f93ae600640 1 -- 172.21.15.44:0/3381099628 >> 172.21.15.44:0/3381099628 conn(0x7f93a806b9a0 msgr2=0x7f93a8071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:25.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.837+0000 7f93ae600640 1 -- 172.21.15.44:0/3381099628 shutdown_connections 2024-03-30T13:13:25.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:25.837+0000 7f93ae600640 1 -- 172.21.15.44:0/3381099628 wait complete. 2024-03-30T13:13:25.861 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-30T13:13:26.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.106+0000 7f4955800640 1 Processor -- start 2024-03-30T13:13:26.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.106+0000 7f4955800640 1 -- start start 2024-03-30T13:13:26.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.108+0000 7f4955800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49500729e0 0x7f495015da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.108+0000 7f4955800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f495015fc20 0x7f4950072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.108+0000 7f4955800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f49500acf80 0x7f4950071890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.108+0000 7f4955800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4950073300 con 0x7f495015fc20 2024-03-30T13:13:26.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.108+0000 7f4955800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f4950160120 con 0x7f49500acf80 2024-03-30T13:13:26.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.108+0000 7f4955800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4950160400 con 0x7f49500729e0 2024-03-30T13:13:26.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.108+0000 7f494f400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f495015fc20 0x7f4950072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.108+0000 7f494f400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f495015fc20 0x7f4950072dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60528/0 (socket says 172.21.15.44:60528) 2024-03-30T13:13:26.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.108+0000 7f494f400640 1 -- 172.21.15.44:0/521256416 learned_addr learned my addr 172.21.15.44:0/521256416 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.109+0000 7f494f400640 1 -- 172.21.15.44:0/521256416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49500729e0 msgr2=0x7f495015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.109+0000 7f494f400640 1 --2- 172.21.15.44:0/521256416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49500729e0 0x7f495015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.109+0000 7f4954e00640 1 --2- 172.21.15.44:0/521256416 >> v2:172.21.15.151:3300/0 conn(0x7f49500acf80 0x7f4950071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.109+0000 7f494f400640 1 -- 172.21.15.44:0/521256416 >> v2:172.21.15.151:3300/0 conn(0x7f49500acf80 msgr2=0x7f4950071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.109+0000 7f494f400640 1 --2- 172.21.15.44:0/521256416 >> v2:172.21.15.151:3300/0 conn(0x7f49500acf80 0x7f4950071890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.109+0000 7f494f400640 1 -- 172.21.15.44:0/521256416 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49501606e0 con 0x7f495015fc20 2024-03-30T13:13:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.110+0000 7f494f400640 1 --2- 172.21.15.44:0/521256416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f495015fc20 0x7f4950072dc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f49500735a0 tx=0x7f493c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323114f21fe89abc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.110+0000 7f494ea00640 1 -- 172.21.15.44:0/521256416 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c035020 con 0x7f495015fc20 2024-03-30T13:13:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.110+0000 7f494ea00640 1 -- 172.21.15.44:0/521256416 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f493c031870 con 0x7f495015fc20 2024-03-30T13:13:26.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.110+0000 7f494ea00640 1 -- 172.21.15.44:0/521256416 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f493c031c40 con 0x7f495015fc20 2024-03-30T13:13:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.111+0000 7f4955800640 1 -- 172.21.15.44:0/521256416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f495015fc20 msgr2=0x7f4950072dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.111+0000 7f4955800640 1 --2- 172.21.15.44:0/521256416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f495015fc20 0x7f4950072dc0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f49500735a0 tx=0x7f493c02b910 comp rx=0 tx=0).stop 2024-03-30T13:13:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.111+0000 7f4955800640 1 -- 172.21.15.44:0/521256416 shutdown_connections 2024-03-30T13:13:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.111+0000 7f4955800640 1 --2- 172.21.15.44:0/521256416 >> v2:172.21.15.151:3300/0 conn(0x7f49500acf80 0x7f4950071890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.111+0000 7f4955800640 1 --2- 172.21.15.44:0/521256416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f495015fc20 0x7f4950072dc0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.111+0000 7f4955800640 1 --2- 172.21.15.44:0/521256416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49500729e0 0x7f495015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.111+0000 7f4955800640 1 -- 172.21.15.44:0/521256416 >> 172.21.15.44:0/521256416 conn(0x7f49500cfd60 msgr2=0x7f49500d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.111+0000 7f4955800640 1 -- 172.21.15.44:0/521256416 shutdown_connections 2024-03-30T13:13:26.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.111+0000 7f4955800640 1 -- 172.21.15.44:0/521256416 wait complete. 2024-03-30T13:13:26.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.113+0000 7f4955800640 1 Processor -- start 2024-03-30T13:13:26.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.113+0000 7f4955800640 1 -- start start 2024-03-30T13:13:26.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4955800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49500729e0 0x7f4950158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4955800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49500acf80 0x7f495015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4955800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f495015fc20 0x7f495009b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4955800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f49500ad590 con 0x7f495015fc20 2024-03-30T13:13:26.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4955800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f49500ad410 con 0x7f49500729e0 2024-03-30T13:13:26.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4955800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f49500ad710 con 0x7f49500acf80 2024-03-30T13:13:26.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4954e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f495015fc20 0x7f495009b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4954e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f495015fc20 0x7f495009b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60530/0 (socket says 172.21.15.44:60530) 2024-03-30T13:13:26.120 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4954e00640 1 -- 172.21.15.44:0/1388772595 learned_addr learned my addr 172.21.15.44:0/1388772595 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f494f400640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49500acf80 0x7f495015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f494fe00640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49500729e0 0x7f4950158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4954e00640 1 -- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49500acf80 msgr2=0x7f495015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4954e00640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49500acf80 0x7f495015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4954e00640 1 -- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49500729e0 msgr2=0x7f4950158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4954e00640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49500729e0 0x7f4950158ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.114+0000 7f4954e00640 1 -- 172.21.15.44:0/1388772595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495015b620 con 0x7f495015fc20 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.115+0000 7f494f400640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49500acf80 0x7f495015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.115+0000 7f4954e00640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f495015fc20 0x7f495009b470 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f494800cd70 tx=0x7f494800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.115+0000 7f4947e00640 1 -- 172.21.15.44:0/1388772595 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948003b90 con 0x7f495015fc20 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.115+0000 7f4947e00640 1 -- 172.21.15.44:0/1388772595 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4948003d30 con 0x7f495015fc20 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.115+0000 7f4947e00640 1 -- 172.21.15.44:0/1388772595 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948004240 con 0x7f495015fc20 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.115+0000 7f4955800640 1 -- 172.21.15.44:0/1388772595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4950152e10 con 0x7f495015fc20 2024-03-30T13:13:26.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.115+0000 7f4955800640 1 -- 172.21.15.44:0/1388772595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4950159610 con 0x7f495015fc20 2024-03-30T13:13:26.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.116+0000 7f4955800640 1 -- 172.21.15.44:0/1388772595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4950075890 con 0x7f495015fc20 2024-03-30T13:13:26.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.117+0000 7f4947e00640 1 -- 172.21.15.44:0/1388772595 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f49480043e0 con 0x7f495015fc20 2024-03-30T13:13:26.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.118+0000 7f4947e00640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f493006c530 0x7f493006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:26.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.118+0000 7f4947e00640 1 -- 172.21.15.44:0/1388772595 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f494808c360 con 0x7f495015fc20 2024-03-30T13:13:26.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.119+0000 7f494fe00640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f493006c530 0x7f493006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:26.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.120+0000 7f494fe00640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f493006c530 0x7f493006e9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f494000a810 tx=0x7f4940008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:26.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.123+0000 7f4947e00640 1 -- 172.21.15.44:0/1388772595 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f495015b620 con 0x7f495015fc20 2024-03-30T13:13:26.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.373+0000 7f4955800640 1 -- 172.21.15.44:0/1388772595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f49500acd60 con 0x7f495015fc20 2024-03-30T13:13:26.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.945+0000 7f4947e00640 1 -- 172.21.15.44:0/1388772595 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f494805a7f0 con 0x7f495015fc20 2024-03-30T13:13:26.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.949+0000 7f4955800640 1 -- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f493006c530 msgr2=0x7f493006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.949+0000 7f4955800640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f493006c530 0x7f493006e9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f494000a810 tx=0x7f4940008040 comp rx=0 tx=0).stop 2024-03-30T13:13:26.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.949+0000 7f4955800640 1 -- 172.21.15.44:0/1388772595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f495015fc20 msgr2=0x7f495009b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:26.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.949+0000 7f4955800640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f495015fc20 0x7f495009b470 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f494800cd70 tx=0x7f494800a660 comp rx=0 tx=0).stop 2024-03-30T13:13:26.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.949+0000 7f4955800640 1 -- 172.21.15.44:0/1388772595 shutdown_connections 2024-03-30T13:13:26.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.949+0000 7f4955800640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f495015fc20 0x7f495009b470 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.949+0000 7f4955800640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49500acf80 0x7f495015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.949+0000 7f4955800640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f493006c530 0x7f493006e9f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.949+0000 7f4955800640 1 --2- 172.21.15.44:0/1388772595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49500729e0 0x7f4950158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:26.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.949+0000 7f4955800640 1 -- 172.21.15.44:0/1388772595 >> 172.21.15.44:0/1388772595 conn(0x7f49500cfd60 msgr2=0x7f4950156b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:26.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.950+0000 7f4955800640 1 -- 172.21.15.44:0/1388772595 shutdown_connections 2024-03-30T13:13:26.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:26.950+0000 7f4955800640 1 -- 172.21.15.44:0/1388772595 wait complete. 2024-03-30T13:13:26.977 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-30T13:13:26.978 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-30T13:13:27.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.188+0000 7fc256000640 1 Processor -- start 2024-03-30T13:13:27.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.189+0000 7fc256000640 1 -- start start 2024-03-30T13:13:27.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.190+0000 7fc256000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc25013f0c0 0x7fc25006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:27.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.190+0000 7fc256000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc25006d720 0x7fc25015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:27.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.190+0000 7fc256000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2500ce9c0 con 0x7fc2501603d0 2024-03-30T13:13:27.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.190+0000 7fc256000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fc250160e30 con 0x7fc25006d720 2024-03-30T13:13:27.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.190+0000 7fc256000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc250160b50 con 0x7fc25013f0c0 2024-03-30T13:13:27.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.191+0000 7fc24ea00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc25006d720 0x7fc25015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:27.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.191+0000 7fc24f400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc25013f0c0 0x7fc25006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:27.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.191+0000 7fc24ea00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc25006d720 0x7fc25015fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:55030/0 (socket says 172.21.15.44:55030) 2024-03-30T13:13:27.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.191+0000 7fc24ea00640 1 -- 172.21.15.44:0/2842274327 learned_addr learned my addr 172.21.15.44:0/2842274327 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:27.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.192+0000 7fc24f400640 1 -- 172.21.15.44:0/2842274327 >> v2:172.21.15.151:3300/0 conn(0x7fc25006d720 msgr2=0x7fc25015fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:27.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.192+0000 7fc24f400640 1 --2- 172.21.15.44:0/2842274327 >> v2:172.21.15.151:3300/0 conn(0x7fc25006d720 0x7fc25015fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:27.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.192+0000 7fc24f400640 1 -- 172.21.15.44:0/2842274327 >> v1:172.21.15.151:6789/0 conn(0x7fc2501603d0 legacy=0x7fc2500cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:27.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.192+0000 7fc24f400640 1 -- 172.21.15.44:0/2842274327 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25013fa40 con 0x7fc25013f0c0 2024-03-30T13:13:27.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.194+0000 7fc24f400640 1 --2- 172.21.15.44:0/2842274327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc25013f0c0 0x7fc25006d1e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2400097a0 tx=0x7fc24002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67d02cbd89346e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.194+0000 7fc24e000640 1 -- 172.21.15.44:0/2842274327 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240038070 con 0x7fc25013f0c0 2024-03-30T13:13:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.195+0000 7fc24e000640 1 -- 172.21.15.44:0/2842274327 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc240031700 con 0x7fc25013f0c0 2024-03-30T13:13:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.195+0000 7fc24e000640 1 -- 172.21.15.44:0/2842274327 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc240031ad0 con 0x7fc25013f0c0 2024-03-30T13:13:27.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.195+0000 7fc256000640 1 -- 172.21.15.44:0/2842274327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc25013f0c0 msgr2=0x7fc25006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:27.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.195+0000 7fc256000640 1 --2- 172.21.15.44:0/2842274327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc25013f0c0 0x7fc25006d1e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2400097a0 tx=0x7fc24002b7a0 comp rx=0 tx=0).stop 2024-03-30T13:13:27.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.195+0000 7fc256000640 1 -- 172.21.15.44:0/2842274327 shutdown_connections 2024-03-30T13:13:27.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.195+0000 7fc256000640 1 --2- 172.21.15.44:0/2842274327 >> v2:172.21.15.151:3300/0 conn(0x7fc25006d720 0x7fc25015fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:27.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.195+0000 7fc256000640 1 --2- 172.21.15.44:0/2842274327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc25013f0c0 0x7fc25006d1e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:27.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.195+0000 7fc256000640 1 -- 172.21.15.44:0/2842274327 >> 172.21.15.44:0/2842274327 conn(0x7fc2500b5b00 msgr2=0x7fc25006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:27.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.195+0000 7fc256000640 1 -- 172.21.15.44:0/2842274327 shutdown_connections 2024-03-30T13:13:27.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.195+0000 7fc256000640 1 -- 172.21.15.44:0/2842274327 wait complete. 2024-03-30T13:13:27.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.198+0000 7fc256000640 1 Processor -- start 2024-03-30T13:13:27.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.198+0000 7fc256000640 1 -- start start 2024-03-30T13:13:27.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.200+0000 7fc256000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc25006d720 0x7fc250134790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:27.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.200+0000 7fc256000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc25013f0c0 0x7fc2500cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:27.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.200+0000 7fc256000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2501603d0 0x7fc25015ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:27.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.200+0000 7fc256000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc250160820 con 0x7fc2501603d0 2024-03-30T13:13:27.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.200+0000 7fc256000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc250140000 con 0x7fc25006d720 2024-03-30T13:13:27.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.200+0000 7fc256000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc25013f4a0 con 0x7fc25013f0c0 2024-03-30T13:13:27.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.200+0000 7fc24fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2501603d0 0x7fc25015ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:27.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.201+0000 7fc24fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2501603d0 0x7fc25015ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39230/0 (socket says 172.21.15.44:39230) 2024-03-30T13:13:27.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.201+0000 7fc24fe00640 1 -- 172.21.15.44:0/88114957 learned_addr learned my addr 172.21.15.44:0/88114957 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:27.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.201+0000 7fc24ea00640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc25013f0c0 0x7fc2500cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:27.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.201+0000 7fc24f400640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc25006d720 0x7fc250134790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:27.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.201+0000 7fc24fe00640 1 -- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc25013f0c0 msgr2=0x7fc2500cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:27.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.201+0000 7fc24fe00640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc25013f0c0 0x7fc2500cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:27.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.201+0000 7fc24fe00640 1 -- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc25006d720 msgr2=0x7fc250134790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:27.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.201+0000 7fc24fe00640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc25006d720 0x7fc250134790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:27.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.201+0000 7fc24fe00640 1 -- 172.21.15.44:0/88114957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2501404a0 con 0x7fc2501603d0 2024-03-30T13:13:27.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.201+0000 7fc24fe00640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2501603d0 0x7fc25015ec30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc24800c7d0 tx=0x7fc24800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:27.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.202+0000 7fc247400640 1 -- 172.21.15.44:0/88114957 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248003b70 con 0x7fc2501603d0 2024-03-30T13:13:27.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.202+0000 7fc247400640 1 -- 172.21.15.44:0/88114957 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc248003d30 con 0x7fc2501603d0 2024-03-30T13:13:27.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.202+0000 7fc247400640 1 -- 172.21.15.44:0/88114957 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24800aa30 con 0x7fc2501603d0 2024-03-30T13:13:27.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.202+0000 7fc256000640 1 -- 172.21.15.44:0/88114957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc250140740 con 0x7fc2501603d0 2024-03-30T13:13:27.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.202+0000 7fc256000640 1 -- 172.21.15.44:0/88114957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc250140d00 con 0x7fc2501603d0 2024-03-30T13:13:27.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.203+0000 7fc256000640 1 -- 172.21.15.44:0/88114957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc250075890 con 0x7fc2501603d0 2024-03-30T13:13:27.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.204+0000 7fc247400640 1 -- 172.21.15.44:0/88114957 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc24800abd0 con 0x7fc2501603d0 2024-03-30T13:13:27.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.205+0000 7fc247400640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc23006c530 0x7fc23006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:27.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.205+0000 7fc247400640 1 -- 172.21.15.44:0/88114957 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fc24808b7b0 con 0x7fc2501603d0 2024-03-30T13:13:27.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.206+0000 7fc24f400640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc23006c530 0x7fc23006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:27.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.207+0000 7fc24f400640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc23006c530 0x7fc23006e9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc240035000 tx=0x7fc240008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:27.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.209+0000 7fc247400640 1 -- 172.21.15.44:0/88114957 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc2500ce9c0 con 0x7fc2501603d0 2024-03-30T13:13:27.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.461+0000 7fc256000640 1 -- 172.21.15.44:0/88114957 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc25006c2c0 con 0x7fc2501603d0 2024-03-30T13:13:27.768 INFO:tasks.ceph.mds.a.smithi044.stderr:2024-03-30T13:13:27.763+0000 7f61a0a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-30T13:13:27.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.956+0000 7fc247400640 1 -- 172.21.15.44:0/88114957 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7fc248059ba0 con 0x7fc2501603d0 2024-03-30T13:13:27.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.960+0000 7fc256000640 1 -- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc23006c530 msgr2=0x7fc23006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:27.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.960+0000 7fc256000640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc23006c530 0x7fc23006e9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc240035000 tx=0x7fc240008030 comp rx=0 tx=0).stop 2024-03-30T13:13:27.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.960+0000 7fc256000640 1 -- 172.21.15.44:0/88114957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2501603d0 msgr2=0x7fc25015ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:27.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.960+0000 7fc256000640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2501603d0 0x7fc25015ec30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc24800c7d0 tx=0x7fc24800cc90 comp rx=0 tx=0).stop 2024-03-30T13:13:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.960+0000 7fc256000640 1 -- 172.21.15.44:0/88114957 shutdown_connections 2024-03-30T13:13:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.960+0000 7fc256000640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2501603d0 0x7fc25015ec30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.960+0000 7fc256000640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc25013f0c0 0x7fc2500cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.960+0000 7fc256000640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc23006c530 0x7fc23006e9f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.960+0000 7fc256000640 1 --2- 172.21.15.44:0/88114957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc25006d720 0x7fc250134790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.960+0000 7fc256000640 1 -- 172.21.15.44:0/88114957 >> 172.21.15.44:0/88114957 conn(0x7fc2500b5b00 msgr2=0x7fc25015a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.960+0000 7fc256000640 1 -- 172.21.15.44:0/88114957 shutdown_connections 2024-03-30T13:13:27.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:27.960+0000 7fc256000640 1 -- 172.21.15.44:0/88114957 wait complete. 2024-03-30T13:13:27.985 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-30T13:13:27.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:13:28.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.191+0000 7f56c3200640 1 Processor -- start 2024-03-30T13:13:28.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.192+0000 7f56c3200640 1 -- start start 2024-03-30T13:13:28.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.193+0000 7f56c3200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56c40d0d30 0x7f56c40cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.193+0000 7f56c3200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f56c40d4950 0x7f56c4161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.193+0000 7f56c3200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f56c40d1110 0x7f56c4161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.193+0000 7f56c3200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f56c40c7b90 con 0x7f56c40d4950 2024-03-30T13:13:28.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.193+0000 7f56c3200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f56c40b5b60 con 0x7f56c40d1110 2024-03-30T13:13:28.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.193+0000 7f56c3200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f56c40d4fc0 con 0x7f56c40d0d30 2024-03-30T13:13:28.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.194+0000 7f56c1400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f56c40d4950 0x7f56c4161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:28.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.194+0000 7f56c1400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f56c40d4950 0x7f56c4161760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39240/0 (socket says 172.21.15.44:39240) 2024-03-30T13:13:28.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.194+0000 7f56c1400640 1 -- 172.21.15.44:0/4148624423 learned_addr learned my addr 172.21.15.44:0/4148624423 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:28.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.194+0000 7f56c1e00640 1 --2- 172.21.15.44:0/4148624423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56c40d0d30 0x7f56c40cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:28.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.194+0000 7f56c2800640 1 --2- 172.21.15.44:0/4148624423 >> v2:172.21.15.151:3300/0 conn(0x7f56c40d1110 0x7f56c4161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:28.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.194+0000 7f56c1400640 1 -- 172.21.15.44:0/4148624423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56c40d0d30 msgr2=0x7f56c40cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:28.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.194+0000 7f56c1400640 1 --2- 172.21.15.44:0/4148624423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56c40d0d30 0x7f56c40cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.194+0000 7f56c1400640 1 -- 172.21.15.44:0/4148624423 >> v2:172.21.15.151:3300/0 conn(0x7f56c40d1110 msgr2=0x7f56c4161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:28.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.194+0000 7f56c1400640 1 --2- 172.21.15.44:0/4148624423 >> v2:172.21.15.151:3300/0 conn(0x7f56c40d1110 0x7f56c4161ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.194+0000 7f56c1400640 1 -- 172.21.15.44:0/4148624423 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c40b57f0 con 0x7f56c40d4950 2024-03-30T13:13:28.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.196+0000 7f56c1400640 1 --2- 172.21.15.44:0/4148624423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c40d4950 0x7f56c4161760 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f56c40b3110 tx=0x7f56ac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb4c0b32adca205 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:28.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.196+0000 7f56c0a00640 1 -- 172.21.15.44:0/4148624423 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac034070 con 0x7f56c40d4950 2024-03-30T13:13:28.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.196+0000 7f56c0a00640 1 -- 172.21.15.44:0/4148624423 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ac030860 con 0x7f56c40d4950 2024-03-30T13:13:28.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.196+0000 7f56c0a00640 1 -- 172.21.15.44:0/4148624423 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac030c30 con 0x7f56c40d4950 2024-03-30T13:13:28.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.197+0000 7f56c3200640 1 -- 172.21.15.44:0/4148624423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c40d4950 msgr2=0x7f56c4161760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:28.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.197+0000 7f56c3200640 1 --2- 172.21.15.44:0/4148624423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c40d4950 0x7f56c4161760 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f56c40b3110 tx=0x7f56ac02b9a0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.197+0000 7f56c3200640 1 -- 172.21.15.44:0/4148624423 shutdown_connections 2024-03-30T13:13:28.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.197+0000 7f56c3200640 1 --2- 172.21.15.44:0/4148624423 >> v2:172.21.15.151:3300/0 conn(0x7f56c40d1110 0x7f56c4161ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.197+0000 7f56c3200640 1 --2- 172.21.15.44:0/4148624423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c40d4950 0x7f56c4161760 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.197+0000 7f56c3200640 1 --2- 172.21.15.44:0/4148624423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56c40d0d30 0x7f56c40cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.197+0000 7f56c3200640 1 -- 172.21.15.44:0/4148624423 >> 172.21.15.44:0/4148624423 conn(0x7f56c409d570 msgr2=0x7f56c40d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:28.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.197+0000 7f56c3200640 1 -- 172.21.15.44:0/4148624423 shutdown_connections 2024-03-30T13:13:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.197+0000 7f56c3200640 1 -- 172.21.15.44:0/4148624423 wait complete. 2024-03-30T13:13:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.199+0000 7f56c3200640 1 Processor -- start 2024-03-30T13:13:28.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.199+0000 7f56c3200640 1 -- start start 2024-03-30T13:13:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.200+0000 7f56c3200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c40d0d30 0x7f56c40ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.200+0000 7f56c3200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c40d1110 0x7f56c41f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.200+0000 7f56c3200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56c40d4950 0x7f56c40c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.200+0000 7f56c3200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f56c40b3300 con 0x7f56c40d1110 2024-03-30T13:13:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.200+0000 7f56c3200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f56c40b3180 con 0x7f56c40d0d30 2024-03-30T13:13:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.200+0000 7f56c3200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f56c40b3a50 con 0x7f56c40d4950 2024-03-30T13:13:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.200+0000 7f56c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c40d1110 0x7f56c41f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.200+0000 7f56c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c40d1110 0x7f56c41f7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39254/0 (socket says 172.21.15.44:39254) 2024-03-30T13:13:28.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.200+0000 7f56c1400640 1 -- 172.21.15.44:0/1540634107 learned_addr learned my addr 172.21.15.44:0/1540634107 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.201+0000 7f56c1e00640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c40d0d30 0x7f56c40ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.201+0000 7f56c1400640 1 -- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56c40d4950 msgr2=0x7f56c40c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.201+0000 7f56c1400640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56c40d4950 0x7f56c40c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.201+0000 7f56c1400640 1 -- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c40d0d30 msgr2=0x7f56c40ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.201+0000 7f56c1400640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c40d0d30 0x7f56c40ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.201+0000 7f56c1400640 1 -- 172.21.15.44:0/1540634107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56c40c9cc0 con 0x7f56c40d1110 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.201+0000 7f56c1e00640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c40d0d30 0x7f56c40ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.201+0000 7f56c1400640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c40d1110 0x7f56c41f7970 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f56ac000c00 tx=0x7f56ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.201+0000 7f56ba000640 1 -- 172.21.15.44:0/1540634107 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac034040 con 0x7f56c40d1110 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.201+0000 7f56ba000640 1 -- 172.21.15.44:0/1540634107 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ac039d10 con 0x7f56c40d1110 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.201+0000 7f56ba000640 1 -- 172.21.15.44:0/1540634107 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac043630 con 0x7f56c40d1110 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.201+0000 7f56c3200640 1 -- 172.21.15.44:0/1540634107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56c41f83c0 con 0x7f56c40d1110 2024-03-30T13:13:28.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.202+0000 7f56c3200640 1 -- 172.21.15.44:0/1540634107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56c40c9f40 con 0x7f56c40d1110 2024-03-30T13:13:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.203+0000 7f56c3200640 1 -- 172.21.15.44:0/1540634107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56c4075890 con 0x7f56c40d1110 2024-03-30T13:13:28.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.204+0000 7f56ba000640 1 -- 172.21.15.44:0/1540634107 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f56ac037070 con 0x7f56c40d1110 2024-03-30T13:13:28.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.205+0000 7f56ba000640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f56a006c530 0x7f56a006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.205+0000 7f56ba000640 1 -- 172.21.15.44:0/1540634107 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f56ac0ad9e0 con 0x7f56c40d1110 2024-03-30T13:13:28.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.205+0000 7f56c1e00640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f56a006c530 0x7f56a006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:28.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.206+0000 7f56c1e00640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f56a006c530 0x7f56a006e9f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f56b4006fd0 tx=0x7f56b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:28.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.209+0000 7f56ba000640 1 -- 172.21.15.44:0/1540634107 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f56c40c9cc0 con 0x7f56c40d1110 2024-03-30T13:13:28.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.454+0000 7f56c3200640 1 -- 172.21.15.44:0/1540634107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56c406de70 con 0x7f56c40d1110 2024-03-30T13:13:28.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.455+0000 7f56ba000640 1 -- 172.21.15.44:0/1540634107 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f56ac03e070 con 0x7f56c40d1110 2024-03-30T13:13:28.460 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:28.460 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/3435907345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3435907345},{"type":"v1","addr":"172.21.15.151:6836","nonce":3435907345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3966337326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":3966337326},{"type":"v1","addr":"172.21.15.151:6837","nonce":3966337326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/4136308231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":4136308231},{"type":"v1","addr":"172.21.15.44:6833","nonce":4136308231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:13:24.374039+0000","modified":"2024-03-30T13:13:27.463153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/585602782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":585602782},{"type":"v1","addr":"172.21.15.44:6835","nonce":585602782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5298,"qdb_cluster":[5298]},"id":2}]} 2024-03-30T13:13:28.460 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-03-30T13:13:28.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.458+0000 7f56c3200640 1 -- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f56a006c530 msgr2=0x7f56a006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:28.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.458+0000 7f56c3200640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f56a006c530 0x7f56a006e9f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f56b4006fd0 tx=0x7f56b4008040 comp rx=0 tx=0).stop 2024-03-30T13:13:28.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.458+0000 7f56c3200640 1 -- 172.21.15.44:0/1540634107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c40d1110 msgr2=0x7f56c41f7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:28.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.458+0000 7f56c3200640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c40d1110 0x7f56c41f7970 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f56ac000c00 tx=0x7f56ac0046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.458+0000 7f56c3200640 1 -- 172.21.15.44:0/1540634107 shutdown_connections 2024-03-30T13:13:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.458+0000 7f56c3200640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56c40d4950 0x7f56c40c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.458+0000 7f56c3200640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56c40d1110 0x7f56c41f7970 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.458+0000 7f56c3200640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f56a006c530 0x7f56a006e9f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.458+0000 7f56c3200640 1 --2- 172.21.15.44:0/1540634107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c40d0d30 0x7f56c40ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.458+0000 7f56c3200640 1 -- 172.21.15.44:0/1540634107 >> 172.21.15.44:0/1540634107 conn(0x7f56c409d570 msgr2=0x7f56c40d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:28.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.459+0000 7f56c3200640 1 -- 172.21.15.44:0/1540634107 shutdown_connections 2024-03-30T13:13:28.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.459+0000 7f56c3200640 1 -- 172.21.15.44:0/1540634107 wait complete. 2024-03-30T13:13:28.484 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:13:28.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.696+0000 7f22c2400640 1 Processor -- start 2024-03-30T13:13:28.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.696+0000 7f22c2400640 1 -- start start 2024-03-30T13:13:28.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.698+0000 7f22c2400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f22bc0d0d30 0x7f22bc0cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.698+0000 7f22c2400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f22bc0d4950 0x7f22bc161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.698+0000 7f22c2400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22bc0b5b60 con 0x7f22bc0d1110 2024-03-30T13:13:28.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.698+0000 7f22c2400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f22bc0c7b90 con 0x7f22bc0d0d30 2024-03-30T13:13:28.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.698+0000 7f22c2400640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f22bc0d4fc0 con 0x7f22bc0d4950 2024-03-30T13:13:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.698+0000 7f22c1000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f22bc0d0d30 0x7f22bc0cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.698+0000 7f22c1a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f22bc0d1110 0x7f22bc0b3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54024/0 (socket says 172.21.15.44:54024) 2024-03-30T13:13:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.698+0000 7f22c1a00640 1 -- 172.21.15.44:0/2598518523 learned_addr learned my addr 172.21.15.44:0/2598518523 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.699+0000 7f22b3e00640 1 --2- 172.21.15.44:0/2598518523 >> v2:172.21.15.151:3300/0 conn(0x7f22bc0d4950 0x7f22bc161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.699+0000 7f22c1000640 1 -- 172.21.15.44:0/2598518523 >> v2:172.21.15.151:3300/0 conn(0x7f22bc0d4950 msgr2=0x7f22bc161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.699+0000 7f22c1000640 1 --2- 172.21.15.44:0/2598518523 >> v2:172.21.15.151:3300/0 conn(0x7f22bc0d4950 0x7f22bc161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.699+0000 7f22c1000640 1 -- 172.21.15.44:0/2598518523 >> v1:172.21.15.44:6789/0 conn(0x7f22bc0d1110 legacy=0x7f22bc0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.699+0000 7f22c1000640 1 -- 172.21.15.44:0/2598518523 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc0b57f0 con 0x7f22bc0d0d30 2024-03-30T13:13:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.699+0000 7f22bbe00640 1 -- 172.21.15.44:0/2598518523 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4167823243 0 0) 0x7f22bc0b5b60 con 0x7f22bc0d1110 2024-03-30T13:13:28.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.699+0000 7f22b3e00640 1 --2- 172.21.15.44:0/2598518523 >> v2:172.21.15.151:3300/0 conn(0x7f22bc0d4950 0x7f22bc161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:28.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.700+0000 7f22c1000640 1 --2- 172.21.15.44:0/2598518523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc0d0d30 0x7f22bc0cfde0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f22bc068f70 tx=0x7f22ac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221fe1172d667bf3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:28.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.701+0000 7f22bbe00640 1 -- 172.21.15.44:0/2598518523 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac039070 con 0x7f22bc0d0d30 2024-03-30T13:13:28.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.701+0000 7f22bbe00640 1 -- 172.21.15.44:0/2598518523 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ac02cc80 con 0x7f22bc0d0d30 2024-03-30T13:13:28.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.701+0000 7f22bbe00640 1 -- 172.21.15.44:0/2598518523 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac034660 con 0x7f22bc0d0d30 2024-03-30T13:13:28.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.701+0000 7f22c2400640 1 -- 172.21.15.44:0/2598518523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc0d0d30 msgr2=0x7f22bc0cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:28.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.701+0000 7f22c2400640 1 --2- 172.21.15.44:0/2598518523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc0d0d30 0x7f22bc0cfde0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f22bc068f70 tx=0x7f22ac02bed0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.701+0000 7f22c2400640 1 -- 172.21.15.44:0/2598518523 shutdown_connections 2024-03-30T13:13:28.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.701+0000 7f22c2400640 1 --2- 172.21.15.44:0/2598518523 >> v2:172.21.15.151:3300/0 conn(0x7f22bc0d4950 0x7f22bc161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.701+0000 7f22c2400640 1 --2- 172.21.15.44:0/2598518523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc0d0d30 0x7f22bc0cfde0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.701+0000 7f22c2400640 1 -- 172.21.15.44:0/2598518523 >> 172.21.15.44:0/2598518523 conn(0x7f22bc09d570 msgr2=0x7f22bc0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:28.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.702+0000 7f22c2400640 1 -- 172.21.15.44:0/2598518523 shutdown_connections 2024-03-30T13:13:28.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.702+0000 7f22c2400640 1 -- 172.21.15.44:0/2598518523 wait complete. 2024-03-30T13:13:28.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.703+0000 7f22c2400640 1 Processor -- start 2024-03-30T13:13:28.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.703+0000 7f22c2400640 1 -- start start 2024-03-30T13:13:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.704+0000 7f22c2400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc0d0d30 0x7f22bc1f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.704+0000 7f22c2400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22bc0d1110 0x7f22bc154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.704+0000 7f22c2400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22bc0d4950 0x7f22bc0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.704+0000 7f22c2400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc0b3300 con 0x7f22bc0d0d30 2024-03-30T13:13:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.704+0000 7f22c2400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc0b3180 con 0x7f22bc0d4950 2024-03-30T13:13:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.704+0000 7f22c2400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc0d3150 con 0x7f22bc0d1110 2024-03-30T13:13:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.705+0000 7f22c1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc0d0d30 0x7f22bc1f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.705+0000 7f22c1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc0d0d30 0x7f22bc1f3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39274/0 (socket says 172.21.15.44:39274) 2024-03-30T13:13:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.705+0000 7f22c1000640 1 -- 172.21.15.44:0/3198716230 learned_addr learned my addr 172.21.15.44:0/3198716230 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:28.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.705+0000 7f22b3e00640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22bc0d1110 0x7f22bc154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.705+0000 7f22c1a00640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22bc0d4950 0x7f22bc0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.705+0000 7f22c1000640 1 -- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22bc0d1110 msgr2=0x7f22bc154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.705+0000 7f22c1000640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22bc0d1110 0x7f22bc154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.705+0000 7f22c1000640 1 -- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22bc0d4950 msgr2=0x7f22bc0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.705+0000 7f22c1000640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22bc0d4950 0x7f22bc0b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.705+0000 7f22c1000640 1 -- 172.21.15.44:0/3198716230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc1530a0 con 0x7f22bc0d0d30 2024-03-30T13:13:28.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.705+0000 7f22c1a00640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22bc0d4950 0x7f22bc0b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.706+0000 7f22c1000640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc0d0d30 0x7f22bc1f3b40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009e80 tx=0x7f22ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.706+0000 7f22b9600640 1 -- 172.21.15.44:0/3198716230 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac039050 con 0x7f22bc0d0d30 2024-03-30T13:13:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.706+0000 7f22b9600640 1 -- 172.21.15.44:0/3198716230 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ac03a040 con 0x7f22bc0d0d30 2024-03-30T13:13:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.706+0000 7f22b9600640 1 -- 172.21.15.44:0/3198716230 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac003990 con 0x7f22bc0d0d30 2024-03-30T13:13:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.706+0000 7f22c2400640 1 -- 172.21.15.44:0/3198716230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc153380 con 0x7f22bc0d0d30 2024-03-30T13:13:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.706+0000 7f22c2400640 1 -- 172.21.15.44:0/3198716230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc153940 con 0x7f22bc0d0d30 2024-03-30T13:13:28.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.707+0000 7f22c2400640 1 -- 172.21.15.44:0/3198716230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22bc075890 con 0x7f22bc0d0d30 2024-03-30T13:13:28.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.708+0000 7f22b9600640 1 -- 172.21.15.44:0/3198716230 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f22ac047030 con 0x7f22bc0d0d30 2024-03-30T13:13:28.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.709+0000 7f22b9600640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f229806c560 0x7f229806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:28.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.709+0000 7f22b9600640 1 -- 172.21.15.44:0/3198716230 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f22ac0adb60 con 0x7f22bc0d0d30 2024-03-30T13:13:28.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.710+0000 7f22b3e00640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f229806c560 0x7f229806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:28.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.711+0000 7f22b3e00640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f229806c560 0x7f229806ea20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f22bc15d810 tx=0x7f22a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:28.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.714+0000 7f22b9600640 1 -- 172.21.15.44:0/3198716230 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f22ac04e060 con 0x7f22bc0d0d30 2024-03-30T13:13:28.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.924+0000 7f22c2400640 1 -- 172.21.15.44:0/3198716230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22bc0b2180 con 0x7f22bc0d0d30 2024-03-30T13:13:28.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.926+0000 7f22b9600640 1 -- 172.21.15.44:0/3198716230 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+16918 (secure 0 0 0) 0x7f22ac080e20 con 0x7f22bc0d0d30 2024-03-30T13:13:28.931 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:28.931 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":41,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:13:25.918180+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:13:22.414656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-30T13:13:23.348753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:13:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.930+0000 7f22c2400640 1 -- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f229806c560 msgr2=0x7f229806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.930+0000 7f22c2400640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f229806c560 0x7f229806ea20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f22bc15d810 tx=0x7f22a4008040 comp rx=0 tx=0).stop 2024-03-30T13:13:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.930+0000 7f22c2400640 1 -- 172.21.15.44:0/3198716230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc0d0d30 msgr2=0x7f22bc1f3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.930+0000 7f22c2400640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc0d0d30 0x7f22bc1f3b40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f22ac009e80 tx=0x7f22ac004a40 comp rx=0 tx=0).stop 2024-03-30T13:13:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.930+0000 7f22c2400640 1 -- 172.21.15.44:0/3198716230 shutdown_connections 2024-03-30T13:13:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.930+0000 7f22c2400640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f229806c560 0x7f229806ea20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.930+0000 7f22c2400640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22bc0d4950 0x7f22bc0b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.930+0000 7f22c2400640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22bc0d1110 0x7f22bc154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.930+0000 7f22c2400640 1 --2- 172.21.15.44:0/3198716230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f22bc0d0d30 0x7f22bc1f3b40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:28.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.930+0000 7f22c2400640 1 -- 172.21.15.44:0/3198716230 >> 172.21.15.44:0/3198716230 conn(0x7f22bc09d570 msgr2=0x7f22bc0ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:28.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.930+0000 7f22c2400640 1 -- 172.21.15.44:0/3198716230 shutdown_connections 2024-03-30T13:13:28.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:28.930+0000 7f22c2400640 1 -- 172.21.15.44:0/3198716230 wait complete. 2024-03-30T13:13:28.962 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-30T13:13:28.963 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:13:29.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.163+0000 7f5068e00640 1 Processor -- start 2024-03-30T13:13:29.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.164+0000 7f5068e00640 1 -- start start 2024-03-30T13:13:29.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.167+0000 7f5068e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f50640b5950 0x7f50641624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:29.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.167+0000 7f5068e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5064141910 con 0x7f5064141530 2024-03-30T13:13:29.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.167+0000 7f5068e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5064162af0 con 0x7f5064162030 2024-03-30T13:13:29.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.167+0000 7f5068e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f5064162dd0 con 0x7f50640b5950 2024-03-30T13:13:29.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.167+0000 7f5061e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5064141530 0x7f5064071920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54036/0 (socket says 172.21.15.44:54036) 2024-03-30T13:13:29.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.167+0000 7f5061e00640 1 -- 172.21.15.44:0/1393795598 learned_addr learned my addr 172.21.15.44:0/1393795598 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:29.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.167+0000 7f5062800640 1 --2- 172.21.15.44:0/1393795598 >> v2:172.21.15.44:3300/0 conn(0x7f50640b5950 0x7f50641624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:29.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.168+0000 7f5060a00640 1 -- 172.21.15.44:0/1393795598 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 238620484 0 0) 0x7f5064141910 con 0x7f5064141530 2024-03-30T13:13:29.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.168+0000 7f5062800640 1 -- 172.21.15.44:0/1393795598 >> v1:172.21.15.151:6789/0 conn(0x7f5064162030 legacy=0x7f50640b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:29.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.168+0000 7f5062800640 1 -- 172.21.15.44:0/1393795598 >> v1:172.21.15.44:6789/0 conn(0x7f5064141530 legacy=0x7f5064071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:29.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.168+0000 7f5062800640 1 -- 172.21.15.44:0/1393795598 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5064071120 con 0x7f50640b5950 2024-03-30T13:13:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.169+0000 7f5062800640 1 --2- 172.21.15.44:0/1393795598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50640b5950 0x7f50641624e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f505c009d90 tx=0x7f505c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28aa66f273f0869c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.170+0000 7f5060a00640 1 -- 172.21.15.44:0/1393795598 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c039070 con 0x7f50640b5950 2024-03-30T13:13:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.170+0000 7f5060a00640 1 -- 172.21.15.44:0/1393795598 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f505c02cc60 con 0x7f50640b5950 2024-03-30T13:13:29.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.170+0000 7f5060a00640 1 -- 172.21.15.44:0/1393795598 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505c034660 con 0x7f50640b5950 2024-03-30T13:13:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.170+0000 7f5068e00640 1 -- 172.21.15.44:0/1393795598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50640b5950 msgr2=0x7f50641624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.170+0000 7f5068e00640 1 --2- 172.21.15.44:0/1393795598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50640b5950 0x7f50641624e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f505c009d90 tx=0x7f505c02beb0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.170+0000 7f5068e00640 1 -- 172.21.15.44:0/1393795598 shutdown_connections 2024-03-30T13:13:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.170+0000 7f5068e00640 1 --2- 172.21.15.44:0/1393795598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50640b5950 0x7f50641624e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.170+0000 7f5068e00640 1 -- 172.21.15.44:0/1393795598 >> 172.21.15.44:0/1393795598 conn(0x7f506406f8b0 msgr2=0x7f506406fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:29.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.170+0000 7f5068e00640 1 -- 172.21.15.44:0/1393795598 shutdown_connections 2024-03-30T13:13:29.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.171+0000 7f5068e00640 1 -- 172.21.15.44:0/1393795598 wait complete. 2024-03-30T13:13:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.172+0000 7f5068e00640 1 Processor -- start 2024-03-30T13:13:29.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.172+0000 7f5068e00640 1 -- start start 2024-03-30T13:13:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.173+0000 7f5068e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50640b5950 0x7f5064151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.173+0000 7f5068e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5064141530 0x7f50640b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.173+0000 7f5068e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5064162030 0x7f506413d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.173+0000 7f5068e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5064141c10 con 0x7f50640b5950 2024-03-30T13:13:29.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.173+0000 7f5068e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f50640b1950 con 0x7f5064141530 2024-03-30T13:13:29.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.173+0000 7f5068e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5064141d90 con 0x7f5064162030 2024-03-30T13:13:29.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.173+0000 7f5061e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50640b5950 0x7f5064151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:29.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.174+0000 7f5061e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50640b5950 0x7f5064151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39286/0 (socket says 172.21.15.44:39286) 2024-03-30T13:13:29.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.174+0000 7f5061e00640 1 -- 172.21.15.44:0/2363007491 learned_addr learned my addr 172.21.15.44:0/2363007491 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:29.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.174+0000 7f5062800640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5064162030 0x7f506413d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:29.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.174+0000 7f5061400640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5064141530 0x7f50640b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:29.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.174+0000 7f5061e00640 1 -- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5064162030 msgr2=0x7f506413d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:29.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.174+0000 7f5061e00640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5064162030 0x7f506413d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.174+0000 7f5061e00640 1 -- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5064141530 msgr2=0x7f50640b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:29.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.174+0000 7f5061e00640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5064141530 0x7f50640b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.174+0000 7f5061e00640 1 -- 172.21.15.44:0/2363007491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5064151d80 con 0x7f50640b5950 2024-03-30T13:13:29.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.174+0000 7f5061e00640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50640b5950 0x7f5064151840 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f505400c490 tx=0x7f505400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:29.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.175+0000 7f505a000640 1 -- 172.21.15.44:0/2363007491 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054005ce0 con 0x7f50640b5950 2024-03-30T13:13:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.175+0000 7f505a000640 1 -- 172.21.15.44:0/2363007491 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5054007070 con 0x7f50640b5950 2024-03-30T13:13:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.175+0000 7f505a000640 1 -- 172.21.15.44:0/2363007491 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054007460 con 0x7f50640b5950 2024-03-30T13:13:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.175+0000 7f5068e00640 1 -- 172.21.15.44:0/2363007491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506413b020 con 0x7f50640b5950 2024-03-30T13:13:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.175+0000 7f5068e00640 1 -- 172.21.15.44:0/2363007491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506413c430 con 0x7f50640b5950 2024-03-30T13:13:29.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.176+0000 7f5068e00640 1 -- 172.21.15.44:0/2363007491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5064075a10 con 0x7f50640b5950 2024-03-30T13:13:29.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.177+0000 7f505a000640 1 -- 172.21.15.44:0/2363007491 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5054007600 con 0x7f50640b5950 2024-03-30T13:13:29.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.178+0000 7f505a000640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f504406c530 0x7f504406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:29.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.179+0000 7f505a000640 1 -- 172.21.15.44:0/2363007491 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f505408b570 con 0x7f50640b5950 2024-03-30T13:13:29.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.179+0000 7f5061400640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f504406c530 0x7f504406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:29.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.180+0000 7f5061400640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f504406c530 0x7f504406e9f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f50640b4f30 tx=0x7f5050009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:29.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.183+0000 7f505a000640 1 -- 172.21.15.44:0/2363007491 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5064151d80 con 0x7f50640b5950 2024-03-30T13:13:29.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.384+0000 7f5068e00640 1 -- 172.21.15.44:0/2363007491 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50640d2f00 con 0x7f504406c530 2024-03-30T13:13:29.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.403+0000 7f505a000640 1 -- 172.21.15.44:0/2363007491 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241416 (secure 0 0 0) 0x7f50640d2f00 con 0x7f504406c530 2024-03-30T13:13:29.411 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:29.412 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:13:29.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.408+0000 7f5068e00640 1 -- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f504406c530 msgr2=0x7f504406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:29.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.408+0000 7f5068e00640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f504406c530 0x7f504406e9f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f50640b4f30 tx=0x7f5050009040 comp rx=0 tx=0).stop 2024-03-30T13:13:29.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.408+0000 7f5068e00640 1 -- 172.21.15.44:0/2363007491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50640b5950 msgr2=0x7f5064151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:29.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.408+0000 7f5068e00640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50640b5950 0x7f5064151840 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f505400c490 tx=0x7f505400c950 comp rx=0 tx=0).stop 2024-03-30T13:13:29.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.408+0000 7f5068e00640 1 -- 172.21.15.44:0/2363007491 shutdown_connections 2024-03-30T13:13:29.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.408+0000 7f5068e00640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5064162030 0x7f506413d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.408+0000 7f5068e00640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f504406c530 0x7f504406e9f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.408+0000 7f5068e00640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5064141530 0x7f50640b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.408+0000 7f5068e00640 1 --2- 172.21.15.44:0/2363007491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50640b5950 0x7f5064151840 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.408+0000 7f5068e00640 1 -- 172.21.15.44:0/2363007491 >> 172.21.15.44:0/2363007491 conn(0x7f506406f8b0 msgr2=0x7f50641443a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.409+0000 7f5068e00640 1 -- 172.21.15.44:0/2363007491 shutdown_connections 2024-03-30T13:13:29.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.409+0000 7f5068e00640 1 -- 172.21.15.44:0/2363007491 wait complete. 2024-03-30T13:13:29.431 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-03-30T13:13:27.989747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220716,"kb_used_data":4548,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754004,"statfs":{"total":773094113280,"available":772868100096,"internally_reserved":0,"allocated":4657152,"data_stored":2636139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.118510"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927384+0000","last_change":"2024-03-30T13:13:24.947993+0000","last_active":"2024-03-30T13:13:25.927384+0000","last_peered":"2024-03-30T13:13:25.927384+0000","last_clean":"2024-03-30T13:13:25.927384+0000","last_became_active":"2024-03-30T13:13:24.947711+0000","last_became_peered":"2024-03-30T13:13:24.947711+0000","last_unstale":"2024-03-30T13:13:25.927384+0000","last_undegraded":"2024-03-30T13:13:25.927384+0000","last_fullsized":"2024-03-30T13:13:25.927384+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:12:19.243241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927408+0000","last_change":"2024-03-30T13:13:24.937291+0000","last_active":"2024-03-30T13:13:25.927408+0000","last_peered":"2024-03-30T13:13:25.927408+0000","last_clean":"2024-03-30T13:13:25.927408+0000","last_became_active":"2024-03-30T13:13:24.936746+0000","last_became_peered":"2024-03-30T13:13:24.936746+0000","last_unstale":"2024-03-30T13:13:25.927408+0000","last_undegraded":"2024-03-30T13:13:25.927408+0000","last_fullsized":"2024-03-30T13:13:25.927408+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:43:13.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927823+0000","last_change":"2024-03-30T13:13:24.944867+0000","last_active":"2024-03-30T13:13:25.927823+0000","last_peered":"2024-03-30T13:13:25.927823+0000","last_clean":"2024-03-30T13:13:25.927823+0000","last_became_active":"2024-03-30T13:13:24.944515+0000","last_became_peered":"2024-03-30T13:13:24.944515+0000","last_unstale":"2024-03-30T13:13:25.927823+0000","last_undegraded":"2024-03-30T13:13:25.927823+0000","last_fullsized":"2024-03-30T13:13:25.927823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:11.845513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927147+0000","last_change":"2024-03-30T13:13:24.939423+0000","last_active":"2024-03-30T13:13:25.927147+0000","last_peered":"2024-03-30T13:13:25.927147+0000","last_clean":"2024-03-30T13:13:25.927147+0000","last_became_active":"2024-03-30T13:13:24.939153+0000","last_became_peered":"2024-03-30T13:13:24.939153+0000","last_unstale":"2024-03-30T13:13:25.927147+0000","last_undegraded":"2024-03-30T13:13:25.927147+0000","last_fullsized":"2024-03-30T13:13:25.927147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:13:55.741135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.888026+0000","last_change":"2024-03-30T13:13:22.888026+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.888026+0000","last_undegraded":"2024-03-30T13:13:22.888026+0000","last_fullsized":"2024-03-30T13:13:22.888026+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.876951+0000","last_change":"2024-03-30T13:13:22.876951+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.876951+0000","last_undegraded":"2024-03-30T13:13:22.876951+0000","last_fullsized":"2024-03-30T13:13:22.876951+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.880466+0000","last_change":"2024-03-30T13:13:22.880466+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.880466+0000","last_undegraded":"2024-03-30T13:13:22.880466+0000","last_fullsized":"2024-03-30T13:13:22.880466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.886104+0000","last_change":"2024-03-30T13:13:22.886104+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.886104+0000","last_undegraded":"2024-03-30T13:13:22.886104+0000","last_fullsized":"2024-03-30T13:13:22.886104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.878876+0000","last_change":"2024-03-30T13:13:22.878876+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.878876+0000","last_undegraded":"2024-03-30T13:13:22.878876+0000","last_fullsized":"2024-03-30T13:13:22.878876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.879468+0000","last_change":"2024-03-30T13:13:22.879468+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.879468+0000","last_undegraded":"2024-03-30T13:13:22.879468+0000","last_fullsized":"2024-03-30T13:13:22.879468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.880439+0000","last_change":"2024-03-30T13:13:22.880439+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.880439+0000","last_undegraded":"2024-03-30T13:13:22.880439+0000","last_fullsized":"2024-03-30T13:13:22.880439+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.885476+0000","last_change":"2024-03-30T13:13:22.885476+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.885476+0000","last_undegraded":"2024-03-30T13:13:22.885476+0000","last_fullsized":"2024-03-30T13:13:22.885476+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927543+0000","last_change":"2024-03-30T13:13:24.950234+0000","last_active":"2024-03-30T13:13:25.927543+0000","last_peered":"2024-03-30T13:13:25.927543+0000","last_clean":"2024-03-30T13:13:25.927543+0000","last_became_active":"2024-03-30T13:13:24.945869+0000","last_became_peered":"2024-03-30T13:13:24.945869+0000","last_unstale":"2024-03-30T13:13:25.927543+0000","last_undegraded":"2024-03-30T13:13:25.927543+0000","last_fullsized":"2024-03-30T13:13:25.927543+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:51:18.065282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.885284+0000","last_change":"2024-03-30T13:13:22.885284+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.885284+0000","last_undegraded":"2024-03-30T13:13:22.885284+0000","last_fullsized":"2024-03-30T13:13:22.885284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.877314+0000","last_change":"2024-03-30T13:13:22.877314+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.877314+0000","last_undegraded":"2024-03-30T13:13:22.877314+0000","last_fullsized":"2024-03-30T13:13:22.877314+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.876831+0000","last_change":"2024-03-30T13:13:22.876831+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.876831+0000","last_undegraded":"2024-03-30T13:13:22.876831+0000","last_fullsized":"2024-03-30T13:13:22.876831+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.885020+0000","last_change":"2024-03-30T13:13:22.885020+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.885020+0000","last_undegraded":"2024-03-30T13:13:22.885020+0000","last_fullsized":"2024-03-30T13:13:22.885020+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.884527+0000","last_change":"2024-03-30T13:13:22.884527+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.884527+0000","last_undegraded":"2024-03-30T13:13:22.884527+0000","last_fullsized":"2024-03-30T13:13:22.884527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.881775+0000","last_change":"2024-03-30T13:13:22.881775+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.881775+0000","last_undegraded":"2024-03-30T13:13:22.881775+0000","last_fullsized":"2024-03-30T13:13:22.881775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.886820+0000","last_change":"2024-03-30T13:13:22.886820+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.886820+0000","last_undegraded":"2024-03-30T13:13:22.886820+0000","last_fullsized":"2024-03-30T13:13:22.886820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.876843+0000","last_change":"2024-03-30T13:13:22.876843+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.876843+0000","last_undegraded":"2024-03-30T13:13:22.876843+0000","last_fullsized":"2024-03-30T13:13:22.876843+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.877601+0000","last_change":"2024-03-30T13:13:22.877601+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.877601+0000","last_undegraded":"2024-03-30T13:13:22.877601+0000","last_fullsized":"2024-03-30T13:13:22.877601+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.887546+0000","last_change":"2024-03-30T13:13:22.887546+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.887546+0000","last_undegraded":"2024-03-30T13:13:22.887546+0000","last_fullsized":"2024-03-30T13:13:22.887546+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927745+0000","last_change":"2024-03-30T13:13:23.902484+0000","last_active":"2024-03-30T13:13:25.927745+0000","last_peered":"2024-03-30T13:13:25.927745+0000","last_clean":"2024-03-30T13:13:25.927745+0000","last_became_active":"2024-03-30T13:13:23.902216+0000","last_became_peered":"2024-03-30T13:13:23.902216+0000","last_unstale":"2024-03-30T13:13:25.927745+0000","last_undegraded":"2024-03-30T13:13:25.927745+0000","last_fullsized":"2024-03-30T13:13:25.927745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:55:03.679777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.928018+0000","last_change":"2024-03-30T13:13:24.949378+0000","last_active":"2024-03-30T13:13:25.928018+0000","last_peered":"2024-03-30T13:13:25.928018+0000","last_clean":"2024-03-30T13:13:25.928018+0000","last_became_active":"2024-03-30T13:13:24.944690+0000","last_became_peered":"2024-03-30T13:13:24.944690+0000","last_unstale":"2024-03-30T13:13:25.928018+0000","last_undegraded":"2024-03-30T13:13:25.928018+0000","last_fullsized":"2024-03-30T13:13:25.928018+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:43:31.023520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.880296+0000","last_change":"2024-03-30T13:13:22.880296+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.880296+0000","last_undegraded":"2024-03-30T13:13:22.880296+0000","last_fullsized":"2024-03-30T13:13:22.880296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927510+0000","last_change":"2024-03-30T13:13:23.906510+0000","last_active":"2024-03-30T13:13:25.927510+0000","last_peered":"2024-03-30T13:13:25.927510+0000","last_clean":"2024-03-30T13:13:25.927510+0000","last_became_active":"2024-03-30T13:13:23.906250+0000","last_became_peered":"2024-03-30T13:13:23.906250+0000","last_unstale":"2024-03-30T13:13:25.927510+0000","last_undegraded":"2024-03-30T13:13:25.927510+0000","last_fullsized":"2024-03-30T13:13:25.927510+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:32:41.206020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927271+0000","last_change":"2024-03-30T13:13:23.908274+0000","last_active":"2024-03-30T13:13:25.927271+0000","last_peered":"2024-03-30T13:13:25.927271+0000","last_clean":"2024-03-30T13:13:25.927271+0000","last_became_active":"2024-03-30T13:13:23.908014+0000","last_became_peered":"2024-03-30T13:13:23.908014+0000","last_unstale":"2024-03-30T13:13:25.927271+0000","last_undegraded":"2024-03-30T13:13:25.927271+0000","last_fullsized":"2024-03-30T13:13:25.927271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:29:03.705190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.879125+0000","last_change":"2024-03-30T13:13:22.879125+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.879125+0000","last_undegraded":"2024-03-30T13:13:22.879125+0000","last_fullsized":"2024-03-30T13:13:22.879125+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927062+0000","last_change":"2024-03-30T13:13:23.906042+0000","last_active":"2024-03-30T13:13:25.927062+0000","last_peered":"2024-03-30T13:13:25.927062+0000","last_clean":"2024-03-30T13:13:25.927062+0000","last_became_active":"2024-03-30T13:13:23.905731+0000","last_became_peered":"2024-03-30T13:13:23.905731+0000","last_unstale":"2024-03-30T13:13:25.927062+0000","last_undegraded":"2024-03-30T13:13:25.927062+0000","last_fullsized":"2024-03-30T13:13:25.927062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:21:24.535622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.876287+0000","last_change":"2024-03-30T13:13:22.876287+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.876287+0000","last_undegraded":"2024-03-30T13:13:22.876287+0000","last_fullsized":"2024-03-30T13:13:22.876287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.944800+0000","last_change":"2024-03-30T13:13:23.911792+0000","last_active":"2024-03-30T13:13:25.944800+0000","last_peered":"2024-03-30T13:13:25.944800+0000","last_clean":"2024-03-30T13:13:25.944800+0000","last_became_active":"2024-03-30T13:13:23.911449+0000","last_became_peered":"2024-03-30T13:13:23.911449+0000","last_unstale":"2024-03-30T13:13:25.944800+0000","last_undegraded":"2024-03-30T13:13:25.944800+0000","last_fullsized":"2024-03-30T13:13:25.944800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:27:29.816936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.876767+0000","last_change":"2024-03-30T13:13:22.876767+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.876767+0000","last_undegraded":"2024-03-30T13:13:22.876767+0000","last_fullsized":"2024-03-30T13:13:22.876767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.876450+0000","last_change":"2024-03-30T13:13:22.876450+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.876450+0000","last_undegraded":"2024-03-30T13:13:22.876450+0000","last_fullsized":"2024-03-30T13:13:22.876450+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.886967+0000","last_change":"2024-03-30T13:13:22.886967+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.886967+0000","last_undegraded":"2024-03-30T13:13:22.886967+0000","last_fullsized":"2024-03-30T13:13:22.886967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.885630+0000","last_change":"2024-03-30T13:13:22.885630+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.885630+0000","last_undegraded":"2024-03-30T13:13:22.885630+0000","last_fullsized":"2024-03-30T13:13:22.885630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.883194+0000","last_change":"2024-03-30T13:13:22.883194+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.883194+0000","last_undegraded":"2024-03-30T13:13:22.883194+0000","last_fullsized":"2024-03-30T13:13:22.883194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.877284+0000","last_change":"2024-03-30T13:13:22.877284+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.877284+0000","last_undegraded":"2024-03-30T13:13:22.877284+0000","last_fullsized":"2024-03-30T13:13:22.877284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":200,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-30T13:13:22.880345+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:13:22.880345+0000","last_peered":"2024-03-30T13:13:22.880345+0000","last_clean":"2024-03-30T13:13:22.880345+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:13:22.880345+0000","last_undegraded":"2024-03-30T13:13:22.880345+0000","last_fullsized":"2024-03-30T13:13:22.880345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":770495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":173918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":180127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":180127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":180127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":180127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":770495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":200723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:13:29.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:13:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.687+0000 7f5201c00640 1 Processor -- start 2024-03-30T13:13:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.688+0000 7f5201c00640 1 -- start start 2024-03-30T13:13:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.689+0000 7f5201c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f51fc0d0d30 0x7f51fc0cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.689+0000 7f5201c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f51fc0d4950 0x7f51fc161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.689+0000 7f5201c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0d1110 0x7f51fc161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.689+0000 7f5201c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f51fc0c7b90 con 0x7f51fc0d0d30 2024-03-30T13:13:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.689+0000 7f5201c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f51fc0b5b60 con 0x7f51fc0d4950 2024-03-30T13:13:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.689+0000 7f5201c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc0d4fc0 con 0x7f51fc0d1110 2024-03-30T13:13:29.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.689+0000 7f51fbe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f51fc0d0d30 0x7f51fc0cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:29.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.690+0000 7f51fbe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f51fc0d0d30 0x7f51fc0cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39292/0 (socket says 172.21.15.44:39292) 2024-03-30T13:13:29.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.690+0000 7f51fbe00640 1 -- 172.21.15.44:0/1634368409 learned_addr learned my addr 172.21.15.44:0/1634368409 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:29.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.690+0000 7f51fbe00640 1 -- 172.21.15.44:0/1634368409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0d1110 msgr2=0x7f51fc161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:29.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.690+0000 7f5201200640 1 --2- 172.21.15.44:0/1634368409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0d1110 0x7f51fc161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:29.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.690+0000 7f51fbe00640 1 --2- 172.21.15.44:0/1634368409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0d1110 0x7f51fc161ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.690+0000 7f51f3400640 1 --2- 172.21.15.44:0/1634368409 >> v2:172.21.15.151:3300/0 conn(0x7f51fc0d4950 0x7f51fc161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:29.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.690+0000 7f51fbe00640 1 -- 172.21.15.44:0/1634368409 >> v2:172.21.15.151:3300/0 conn(0x7f51fc0d4950 msgr2=0x7f51fc161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:29.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.690+0000 7f51fbe00640 1 --2- 172.21.15.44:0/1634368409 >> v2:172.21.15.151:3300/0 conn(0x7f51fc0d4950 0x7f51fc161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.690+0000 7f51fbe00640 1 -- 172.21.15.44:0/1634368409 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc0b57f0 con 0x7f51fc0d0d30 2024-03-30T13:13:29.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.690+0000 7f51f3400640 1 --2- 172.21.15.44:0/1634368409 >> v2:172.21.15.151:3300/0 conn(0x7f51fc0d4950 0x7f51fc161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.691+0000 7f51fbe00640 1 --2- 172.21.15.44:0/1634368409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51fc0d0d30 0x7f51fc0cfde0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f51fc068f70 tx=0x7f51ec02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97107459164f5ed server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.691+0000 7f51fb400640 1 -- 172.21.15.44:0/1634368409 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec02ca80 con 0x7f51fc0d0d30 2024-03-30T13:13:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.692+0000 7f51fb400640 1 -- 172.21.15.44:0/1634368409 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51ec02cc20 con 0x7f51fc0d0d30 2024-03-30T13:13:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.692+0000 7f51fb400640 1 -- 172.21.15.44:0/1634368409 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0343f0 con 0x7f51fc0d0d30 2024-03-30T13:13:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.692+0000 7f5201c00640 1 -- 172.21.15.44:0/1634368409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51fc0d0d30 msgr2=0x7f51fc0cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.692+0000 7f5201c00640 1 --2- 172.21.15.44:0/1634368409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51fc0d0d30 0x7f51fc0cfde0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f51fc068f70 tx=0x7f51ec02bee0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.692+0000 7f5201c00640 1 -- 172.21.15.44:0/1634368409 shutdown_connections 2024-03-30T13:13:29.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.692+0000 7f5201c00640 1 --2- 172.21.15.44:0/1634368409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0d1110 0x7f51fc161ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.692+0000 7f5201c00640 1 --2- 172.21.15.44:0/1634368409 >> v2:172.21.15.151:3300/0 conn(0x7f51fc0d4950 0x7f51fc161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.692+0000 7f5201c00640 1 --2- 172.21.15.44:0/1634368409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51fc0d0d30 0x7f51fc0cfde0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.692+0000 7f5201c00640 1 -- 172.21.15.44:0/1634368409 >> 172.21.15.44:0/1634368409 conn(0x7f51fc09d570 msgr2=0x7f51fc0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:29.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.692+0000 7f5201c00640 1 -- 172.21.15.44:0/1634368409 shutdown_connections 2024-03-30T13:13:29.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.692+0000 7f5201c00640 1 -- 172.21.15.44:0/1634368409 wait complete. 2024-03-30T13:13:29.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.694+0000 7f5201c00640 1 Processor -- start 2024-03-30T13:13:29.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.694+0000 7f5201c00640 1 -- start start 2024-03-30T13:13:29.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.695+0000 7f5201c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51fc0d0d30 0x7f51fc1e6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:29.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.695+0000 7f5201c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0d1110 0x7f51fc0ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.695+0000 7f5201c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51fc0d4950 0x7f51fc1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.695+0000 7f5201c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc0b3300 con 0x7f51fc0d4950 2024-03-30T13:13:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.695+0000 7f5201c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc0b3180 con 0x7f51fc0d0d30 2024-03-30T13:13:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.695+0000 7f5201c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc0b3a50 con 0x7f51fc0d1110 2024-03-30T13:13:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.696+0000 7f5201200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51fc0d4950 0x7f51fc1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.696+0000 7f5201200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51fc0d4950 0x7f51fc1564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39302/0 (socket says 172.21.15.44:39302) 2024-03-30T13:13:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.696+0000 7f5201200640 1 -- 172.21.15.44:0/2545076772 learned_addr learned my addr 172.21.15.44:0/2545076772 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.696+0000 7f51fbe00640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51fc0d0d30 0x7f51fc1e6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:29.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.696+0000 7f51f3400640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0d1110 0x7f51fc0ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.696+0000 7f5201200640 1 -- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0d1110 msgr2=0x7f51fc0ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.696+0000 7f5201200640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0d1110 0x7f51fc0ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.696+0000 7f5201200640 1 -- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51fc0d0d30 msgr2=0x7f51fc1e6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.696+0000 7f5201200640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51fc0d0d30 0x7f51fc1e6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.696+0000 7f5201200640 1 -- 172.21.15.44:0/2545076772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc1e8580 con 0x7f51fc0d4950 2024-03-30T13:13:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.697+0000 7f5201200640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51fc0d4950 0x7f51fc1564f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f51f400c570 tx=0x7f51f400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.697+0000 7f51f8c00640 1 -- 172.21.15.44:0/2545076772 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f4015070 con 0x7f51fc0d4950 2024-03-30T13:13:29.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.697+0000 7f51f8c00640 1 -- 172.21.15.44:0/2545076772 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f4004220 con 0x7f51fc0d4950 2024-03-30T13:13:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.697+0000 7f51f8c00640 1 -- 172.21.15.44:0/2545076772 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f4003610 con 0x7f51fc0d4950 2024-03-30T13:13:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.697+0000 7f5201c00640 1 -- 172.21.15.44:0/2545076772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51fc1e74e0 con 0x7f51fc0d4950 2024-03-30T13:13:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.697+0000 7f5201c00640 1 -- 172.21.15.44:0/2545076772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51fc1e7aa0 con 0x7f51fc0d4950 2024-03-30T13:13:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.698+0000 7f5201c00640 1 -- 172.21.15.44:0/2545076772 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51fc075890 con 0x7f51fc0d4950 2024-03-30T13:13:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.700+0000 7f51f8c00640 1 -- 172.21.15.44:0/2545076772 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f51f40037b0 con 0x7f51fc0d4950 2024-03-30T13:13:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.701+0000 7f51f8c00640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f51d806c530 0x7f51d806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.701+0000 7f51f8c00640 1 -- 172.21.15.44:0/2545076772 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f51f408b650 con 0x7f51fc0d4950 2024-03-30T13:13:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.702+0000 7f51fbe00640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f51d806c530 0x7f51d806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.703+0000 7f51fbe00640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f51d806c530 0x7f51d806e9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f51ec035000 tx=0x7f51ec030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.706+0000 7f51f8c00640 1 -- 172.21.15.44:0/2545076772 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f51f4059ae0 con 0x7f51fc0d4950 2024-03-30T13:13:29.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.903+0000 7f5201c00640 1 -- 172.21.15.44:0/2545076772 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51fc15ffc0 con 0x7f51d806c530 2024-03-30T13:13:29.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.922+0000 7f51f8c00640 1 -- 172.21.15.44:0/2545076772 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241416 (secure 0 0 0) 0x7f51fc15ffc0 con 0x7f51d806c530 2024-03-30T13:13:29.929 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:29.931 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:13:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.927+0000 7f5201c00640 1 -- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f51d806c530 msgr2=0x7f51d806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.927+0000 7f5201c00640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f51d806c530 0x7f51d806e9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f51ec035000 tx=0x7f51ec030000 comp rx=0 tx=0).stop 2024-03-30T13:13:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.927+0000 7f5201c00640 1 -- 172.21.15.44:0/2545076772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51fc0d4950 msgr2=0x7f51fc1564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.927+0000 7f5201c00640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51fc0d4950 0x7f51fc1564f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f51f400c570 tx=0x7f51f400ca30 comp rx=0 tx=0).stop 2024-03-30T13:13:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.927+0000 7f5201c00640 1 -- 172.21.15.44:0/2545076772 shutdown_connections 2024-03-30T13:13:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.927+0000 7f5201c00640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51fc0d4950 0x7f51fc1564f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.927+0000 7f5201c00640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0d1110 0x7f51fc0ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.927+0000 7f5201c00640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f51d806c530 0x7f51d806e9f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.927+0000 7f5201c00640 1 --2- 172.21.15.44:0/2545076772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51fc0d0d30 0x7f51fc1e6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.927+0000 7f5201c00640 1 -- 172.21.15.44:0/2545076772 >> 172.21.15.44:0/2545076772 conn(0x7f51fc09d570 msgr2=0x7f51fc0d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.927+0000 7f5201c00640 1 -- 172.21.15.44:0/2545076772 shutdown_connections 2024-03-30T13:13:29.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:29.927+0000 7f5201c00640 1 -- 172.21.15.44:0/2545076772 wait complete. 2024-03-30T13:13:29.953 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-03-30T13:13:27.989747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590438,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220716,"kb_used_data":4548,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754004,"statfs":{"total":773094113280,"available":772868100096,"internally_reserved":0,"allocated":4657152,"data_stored":2636139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.118510"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927384+0000","last_change":"2024-03-30T13:13:24.947993+0000","last_active":"2024-03-30T13:13:25.927384+0000","last_peered":"2024-03-30T13:13:25.927384+0000","last_clean":"2024-03-30T13:13:25.927384+0000","last_became_active":"2024-03-30T13:13:24.947711+0000","last_became_peered":"2024-03-30T13:13:24.947711+0000","last_unstale":"2024-03-30T13:13:25.927384+0000","last_undegraded":"2024-03-30T13:13:25.927384+0000","last_fullsized":"2024-03-30T13:13:25.927384+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:12:19.243241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927408+0000","last_change":"2024-03-30T13:13:24.937291+0000","last_active":"2024-03-30T13:13:25.927408+0000","last_peered":"2024-03-30T13:13:25.927408+0000","last_clean":"2024-03-30T13:13:25.927408+0000","last_became_active":"2024-03-30T13:13:24.936746+0000","last_became_peered":"2024-03-30T13:13:24.936746+0000","last_unstale":"2024-03-30T13:13:25.927408+0000","last_undegraded":"2024-03-30T13:13:25.927408+0000","last_fullsized":"2024-03-30T13:13:25.927408+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:43:13.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927823+0000","last_change":"2024-03-30T13:13:24.944867+0000","last_active":"2024-03-30T13:13:25.927823+0000","last_peered":"2024-03-30T13:13:25.927823+0000","last_clean":"2024-03-30T13:13:25.927823+0000","last_became_active":"2024-03-30T13:13:24.944515+0000","last_became_peered":"2024-03-30T13:13:24.944515+0000","last_unstale":"2024-03-30T13:13:25.927823+0000","last_undegraded":"2024-03-30T13:13:25.927823+0000","last_fullsized":"2024-03-30T13:13:25.927823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:11.845513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927147+0000","last_change":"2024-03-30T13:13:24.939423+0000","last_active":"2024-03-30T13:13:25.927147+0000","last_peered":"2024-03-30T13:13:25.927147+0000","last_clean":"2024-03-30T13:13:25.927147+0000","last_became_active":"2024-03-30T13:13:24.939153+0000","last_became_peered":"2024-03-30T13:13:24.939153+0000","last_unstale":"2024-03-30T13:13:25.927147+0000","last_undegraded":"2024-03-30T13:13:25.927147+0000","last_fullsized":"2024-03-30T13:13:25.927147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:13:55.741135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.888026+0000","last_change":"2024-03-30T13:13:22.888026+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.888026+0000","last_undegraded":"2024-03-30T13:13:22.888026+0000","last_fullsized":"2024-03-30T13:13:22.888026+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.876951+0000","last_change":"2024-03-30T13:13:22.876951+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.876951+0000","last_undegraded":"2024-03-30T13:13:22.876951+0000","last_fullsized":"2024-03-30T13:13:22.876951+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.880466+0000","last_change":"2024-03-30T13:13:22.880466+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.880466+0000","last_undegraded":"2024-03-30T13:13:22.880466+0000","last_fullsized":"2024-03-30T13:13:22.880466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.886104+0000","last_change":"2024-03-30T13:13:22.886104+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.886104+0000","last_undegraded":"2024-03-30T13:13:22.886104+0000","last_fullsized":"2024-03-30T13:13:22.886104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.878876+0000","last_change":"2024-03-30T13:13:22.878876+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.878876+0000","last_undegraded":"2024-03-30T13:13:22.878876+0000","last_fullsized":"2024-03-30T13:13:22.878876+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.879468+0000","last_change":"2024-03-30T13:13:22.879468+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.879468+0000","last_undegraded":"2024-03-30T13:13:22.879468+0000","last_fullsized":"2024-03-30T13:13:22.879468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.880439+0000","last_change":"2024-03-30T13:13:22.880439+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.880439+0000","last_undegraded":"2024-03-30T13:13:22.880439+0000","last_fullsized":"2024-03-30T13:13:22.880439+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.885476+0000","last_change":"2024-03-30T13:13:22.885476+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.885476+0000","last_undegraded":"2024-03-30T13:13:22.885476+0000","last_fullsized":"2024-03-30T13:13:22.885476+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927543+0000","last_change":"2024-03-30T13:13:24.950234+0000","last_active":"2024-03-30T13:13:25.927543+0000","last_peered":"2024-03-30T13:13:25.927543+0000","last_clean":"2024-03-30T13:13:25.927543+0000","last_became_active":"2024-03-30T13:13:24.945869+0000","last_became_peered":"2024-03-30T13:13:24.945869+0000","last_unstale":"2024-03-30T13:13:25.927543+0000","last_undegraded":"2024-03-30T13:13:25.927543+0000","last_fullsized":"2024-03-30T13:13:25.927543+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:51:18.065282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.885284+0000","last_change":"2024-03-30T13:13:22.885284+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.885284+0000","last_undegraded":"2024-03-30T13:13:22.885284+0000","last_fullsized":"2024-03-30T13:13:22.885284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.877314+0000","last_change":"2024-03-30T13:13:22.877314+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.877314+0000","last_undegraded":"2024-03-30T13:13:22.877314+0000","last_fullsized":"2024-03-30T13:13:22.877314+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.876831+0000","last_change":"2024-03-30T13:13:22.876831+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.876831+0000","last_undegraded":"2024-03-30T13:13:22.876831+0000","last_fullsized":"2024-03-30T13:13:22.876831+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.885020+0000","last_change":"2024-03-30T13:13:22.885020+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.885020+0000","last_undegraded":"2024-03-30T13:13:22.885020+0000","last_fullsized":"2024-03-30T13:13:22.885020+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.884527+0000","last_change":"2024-03-30T13:13:22.884527+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.884527+0000","last_undegraded":"2024-03-30T13:13:22.884527+0000","last_fullsized":"2024-03-30T13:13:22.884527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.881775+0000","last_change":"2024-03-30T13:13:22.881775+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.881775+0000","last_undegraded":"2024-03-30T13:13:22.881775+0000","last_fullsized":"2024-03-30T13:13:22.881775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.886820+0000","last_change":"2024-03-30T13:13:22.886820+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.886820+0000","last_undegraded":"2024-03-30T13:13:22.886820+0000","last_fullsized":"2024-03-30T13:13:22.886820+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.876843+0000","last_change":"2024-03-30T13:13:22.876843+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.876843+0000","last_undegraded":"2024-03-30T13:13:22.876843+0000","last_fullsized":"2024-03-30T13:13:22.876843+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.877601+0000","last_change":"2024-03-30T13:13:22.877601+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.877601+0000","last_undegraded":"2024-03-30T13:13:22.877601+0000","last_fullsized":"2024-03-30T13:13:22.877601+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.887546+0000","last_change":"2024-03-30T13:13:22.887546+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.887546+0000","last_undegraded":"2024-03-30T13:13:22.887546+0000","last_fullsized":"2024-03-30T13:13:22.887546+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927745+0000","last_change":"2024-03-30T13:13:23.902484+0000","last_active":"2024-03-30T13:13:25.927745+0000","last_peered":"2024-03-30T13:13:25.927745+0000","last_clean":"2024-03-30T13:13:25.927745+0000","last_became_active":"2024-03-30T13:13:23.902216+0000","last_became_peered":"2024-03-30T13:13:23.902216+0000","last_unstale":"2024-03-30T13:13:25.927745+0000","last_undegraded":"2024-03-30T13:13:25.927745+0000","last_fullsized":"2024-03-30T13:13:25.927745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:55:03.679777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.928018+0000","last_change":"2024-03-30T13:13:24.949378+0000","last_active":"2024-03-30T13:13:25.928018+0000","last_peered":"2024-03-30T13:13:25.928018+0000","last_clean":"2024-03-30T13:13:25.928018+0000","last_became_active":"2024-03-30T13:13:24.944690+0000","last_became_peered":"2024-03-30T13:13:24.944690+0000","last_unstale":"2024-03-30T13:13:25.928018+0000","last_undegraded":"2024-03-30T13:13:25.928018+0000","last_fullsized":"2024-03-30T13:13:25.928018+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:43:31.023520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.880296+0000","last_change":"2024-03-30T13:13:22.880296+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.880296+0000","last_undegraded":"2024-03-30T13:13:22.880296+0000","last_fullsized":"2024-03-30T13:13:22.880296+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927510+0000","last_change":"2024-03-30T13:13:23.906510+0000","last_active":"2024-03-30T13:13:25.927510+0000","last_peered":"2024-03-30T13:13:25.927510+0000","last_clean":"2024-03-30T13:13:25.927510+0000","last_became_active":"2024-03-30T13:13:23.906250+0000","last_became_peered":"2024-03-30T13:13:23.906250+0000","last_unstale":"2024-03-30T13:13:25.927510+0000","last_undegraded":"2024-03-30T13:13:25.927510+0000","last_fullsized":"2024-03-30T13:13:25.927510+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:32:41.206020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927271+0000","last_change":"2024-03-30T13:13:23.908274+0000","last_active":"2024-03-30T13:13:25.927271+0000","last_peered":"2024-03-30T13:13:25.927271+0000","last_clean":"2024-03-30T13:13:25.927271+0000","last_became_active":"2024-03-30T13:13:23.908014+0000","last_became_peered":"2024-03-30T13:13:23.908014+0000","last_unstale":"2024-03-30T13:13:25.927271+0000","last_undegraded":"2024-03-30T13:13:25.927271+0000","last_fullsized":"2024-03-30T13:13:25.927271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:29:03.705190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.879125+0000","last_change":"2024-03-30T13:13:22.879125+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.879125+0000","last_undegraded":"2024-03-30T13:13:22.879125+0000","last_fullsized":"2024-03-30T13:13:22.879125+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927062+0000","last_change":"2024-03-30T13:13:23.906042+0000","last_active":"2024-03-30T13:13:25.927062+0000","last_peered":"2024-03-30T13:13:25.927062+0000","last_clean":"2024-03-30T13:13:25.927062+0000","last_became_active":"2024-03-30T13:13:23.905731+0000","last_became_peered":"2024-03-30T13:13:23.905731+0000","last_unstale":"2024-03-30T13:13:25.927062+0000","last_undegraded":"2024-03-30T13:13:25.927062+0000","last_fullsized":"2024-03-30T13:13:25.927062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:21:24.535622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.876287+0000","last_change":"2024-03-30T13:13:22.876287+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.876287+0000","last_undegraded":"2024-03-30T13:13:22.876287+0000","last_fullsized":"2024-03-30T13:13:22.876287+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.944800+0000","last_change":"2024-03-30T13:13:23.911792+0000","last_active":"2024-03-30T13:13:25.944800+0000","last_peered":"2024-03-30T13:13:25.944800+0000","last_clean":"2024-03-30T13:13:25.944800+0000","last_became_active":"2024-03-30T13:13:23.911449+0000","last_became_peered":"2024-03-30T13:13:23.911449+0000","last_unstale":"2024-03-30T13:13:25.944800+0000","last_undegraded":"2024-03-30T13:13:25.944800+0000","last_fullsized":"2024-03-30T13:13:25.944800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:27:29.816936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.876767+0000","last_change":"2024-03-30T13:13:22.876767+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.876767+0000","last_undegraded":"2024-03-30T13:13:22.876767+0000","last_fullsized":"2024-03-30T13:13:22.876767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.876450+0000","last_change":"2024-03-30T13:13:22.876450+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.876450+0000","last_undegraded":"2024-03-30T13:13:22.876450+0000","last_fullsized":"2024-03-30T13:13:22.876450+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.886967+0000","last_change":"2024-03-30T13:13:22.886967+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.886967+0000","last_undegraded":"2024-03-30T13:13:22.886967+0000","last_fullsized":"2024-03-30T13:13:22.886967+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.885630+0000","last_change":"2024-03-30T13:13:22.885630+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.885630+0000","last_undegraded":"2024-03-30T13:13:22.885630+0000","last_fullsized":"2024-03-30T13:13:22.885630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.883194+0000","last_change":"2024-03-30T13:13:22.883194+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.883194+0000","last_undegraded":"2024-03-30T13:13:22.883194+0000","last_fullsized":"2024-03-30T13:13:22.883194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-30T13:13:23.867835+0000","last_change":"2024-03-30T13:13:23.867835+0000","last_active":"2024-03-30T13:13:23.867835+0000","last_peered":"2024-03-30T13:13:23.867835+0000","last_clean":"2024-03-30T13:13:23.867835+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:23.867835+0000","last_undegraded":"2024-03-30T13:13:23.867835+0000","last_fullsized":"2024-03-30T13:13:23.867835+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":38,"state":"creating+peering","last_fresh":"2024-03-30T13:13:22.877284+0000","last_change":"2024-03-30T13:13:22.877284+0000","last_active":"2024-03-30T13:13:22.855272+0000","last_peered":"2024-03-30T13:13:22.855272+0000","last_clean":"2024-03-30T13:13:22.855272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-30T13:13:22.877284+0000","last_undegraded":"2024-03-30T13:13:22.877284+0000","last_fullsized":"2024-03-30T13:13:22.877284+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":200,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-30T13:13:22.880345+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:13:22.880345+0000","last_peered":"2024-03-30T13:13:22.880345+0000","last_clean":"2024-03-30T13:13:22.880345+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:13:22.880345+0000","last_undegraded":"2024-03-30T13:13:22.880345+0000","last_fullsized":"2024-03-30T13:13:22.880345+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509466,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":770495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":173918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":180127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":180127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":180127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":180127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":770495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":200723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:13:29.960 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:13:30.039 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:13:30.046 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:13:30.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.200+0000 7fa0a3200640 1 Processor -- start 2024-03-30T13:13:30.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.201+0000 7fa0a3200640 1 -- start start 2024-03-30T13:13:30.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.203+0000 7fa0a3200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40d4950 0x7fa0a4161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.203+0000 7fa0a3200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0a40b5b60 con 0x7fa0a40d1110 2024-03-30T13:13:30.208 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.203+0000 7fa0a3200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0a40d4fc0 con 0x7fa0a40d0d30 2024-03-30T13:13:30.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.203+0000 7fa0a3200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a40c7b90 con 0x7fa0a40d4950 2024-03-30T13:13:30.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.203+0000 7fa0a2800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa0a40d1110 0x7fa0a40b3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54052/0 (socket says 172.21.15.44:54052) 2024-03-30T13:13:30.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.203+0000 7fa0a2800640 1 -- 172.21.15.44:0/3289935272 learned_addr learned my addr 172.21.15.44:0/3289935272 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:30.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a1400640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40d4950 0x7fa0a4161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1464630972 0 0) 0x7fa0a40b5b60 con 0x7fa0a40d1110 2024-03-30T13:13:30.209 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa088003520 con 0x7fa0a40d1110 2024-03-30T13:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 255724531 0 0) 0x7fa088003520 con 0x7fa0a40d1110 2024-03-30T13:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40d4950 msgr2=0x7fa0a4161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:30.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40d4950 0x7fa0a4161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 >> v1:172.21.15.151:6789/0 conn(0x7fa0a40d0d30 legacy=0x7fa0a40cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a40b57f0 con 0x7fa0a40d1110 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fa09c0019f0 con 0x7fa0a40d1110 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 >> v1:172.21.15.44:6789/0 conn(0x7fa0a40d1110 legacy=0x7fa0a40b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0880039e0 0x7fa088003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa088004800 0x7fa088004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40d4950 0x7fa0880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a40c7b90 con 0x7fa0880039e0 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa08800ba70 con 0x7fa088004800 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.204+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa08800bc70 con 0x7fa0a40d4950 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.205+0000 7fa0a1e00640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0880039e0 0x7fa088003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.205+0000 7fa0a2800640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40d4950 0x7fa0880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.205+0000 7fa0a1400640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa088004800 0x7fa088004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.205+0000 7fa0a1e00640 1 -- 172.21.15.44:0/3289935272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40d4950 msgr2=0x7fa0880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:30.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.205+0000 7fa0a1e00640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40d4950 0x7fa0880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.205+0000 7fa0a1e00640 1 -- 172.21.15.44:0/3289935272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa088004800 msgr2=0x7fa088004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:30.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.205+0000 7fa0a1e00640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa088004800 0x7fa088004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.205+0000 7fa0a1e00640 1 -- 172.21.15.44:0/3289935272 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa088003520 con 0x7fa0880039e0 2024-03-30T13:13:30.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.205+0000 7fa0a2800640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40d4950 0x7fa0880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:30.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.206+0000 7fa0a1e00640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0880039e0 0x7fa088003e00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa094001720 tx=0x7fa088005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f4036bee4b506a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:30.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.206+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa094001370 con 0x7fa0880039e0 2024-03-30T13:13:30.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.206+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0940052d0 con 0x7fa0880039e0 2024-03-30T13:13:30.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.206+0000 7fa0a0a00640 1 -- 172.21.15.44:0/3289935272 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa094003830 con 0x7fa0880039e0 2024-03-30T13:13:30.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.207+0000 7fa0a3200640 1 -- 172.21.15.44:0/3289935272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0880039e0 msgr2=0x7fa088003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:30.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.207+0000 7fa0a3200640 1 --2- 172.21.15.44:0/3289935272 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0880039e0 0x7fa088003e00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa094001720 tx=0x7fa088005830 comp rx=0 tx=0).stop 2024-03-30T13:13:30.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.207+0000 7fa0a2800640 1 -- 172.21.15.44:0/3289935272 reap_dead start 2024-03-30T13:13:30.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.207+0000 7fa0a3200640 1 -- 172.21.15.44:0/3289935272 shutdown_connections 2024-03-30T13:13:30.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.207+0000 7fa0a3200640 1 -- 172.21.15.44:0/3289935272 >> 172.21.15.44:0/3289935272 conn(0x7fa0a409d570 msgr2=0x7fa0a40d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.207+0000 7fa0a3200640 1 -- 172.21.15.44:0/3289935272 shutdown_connections 2024-03-30T13:13:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.207+0000 7fa0a3200640 1 -- 172.21.15.44:0/3289935272 wait complete. 2024-03-30T13:13:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.210+0000 7fa0a3200640 1 Processor -- start 2024-03-30T13:13:30.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.210+0000 7fa0a3200640 1 -- start start 2024-03-30T13:13:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.212+0000 7fa0a3200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0880039e0 0x7fa0a40b9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.212+0000 7fa0a3200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0a40ca750 0x7fa0a40cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.212+0000 7fa0a3200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40ce2a0 0x7fa0a40cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.212+0000 7fa0a3200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a40d32d0 con 0x7fa0a40ca750 2024-03-30T13:13:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.212+0000 7fa0a3200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a40d3150 con 0x7fa0880039e0 2024-03-30T13:13:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.212+0000 7fa0a3200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a40d3450 con 0x7fa0a40ce2a0 2024-03-30T13:13:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.212+0000 7fa0a1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0a40ca750 0x7fa0a40cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.212+0000 7fa0a1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0a40ca750 0x7fa0a40cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39314/0 (socket says 172.21.15.44:39314) 2024-03-30T13:13:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.212+0000 7fa0a1400640 1 -- 172.21.15.44:0/1437852400 learned_addr learned my addr 172.21.15.44:0/1437852400 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.212+0000 7fa0a2800640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40ce2a0 0x7fa0a40cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.212+0000 7fa0a1e00640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0880039e0 0x7fa0a40b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.213+0000 7fa0a1400640 1 -- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40ce2a0 msgr2=0x7fa0a40cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.213+0000 7fa0a1400640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40ce2a0 0x7fa0a40cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.213+0000 7fa0a1400640 1 -- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0880039e0 msgr2=0x7fa0a40b9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.213+0000 7fa0a1400640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0880039e0 0x7fa0a40b9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.213+0000 7fa0a1400640 1 -- 172.21.15.44:0/1437852400 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a40b7e10 con 0x7fa0a40ca750 2024-03-30T13:13:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.213+0000 7fa0a2800640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40ce2a0 0x7fa0a40cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.213+0000 7fa0a1400640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0a40ca750 0x7fa0a40cdd60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa0900108c0 tx=0x7fa090010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.213+0000 7fa09a000640 1 -- 172.21.15.44:0/1437852400 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09000f040 con 0x7fa0a40ca750 2024-03-30T13:13:30.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.213+0000 7fa09a000640 1 -- 172.21.15.44:0/1437852400 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09000eb20 con 0x7fa0a40ca750 2024-03-30T13:13:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.213+0000 7fa0a3200640 1 -- 172.21.15.44:0/1437852400 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a40b80f0 con 0x7fa0a40ca750 2024-03-30T13:13:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.213+0000 7fa09a000640 1 -- 172.21.15.44:0/1437852400 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa09001c400 con 0x7fa0a40ca750 2024-03-30T13:13:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.213+0000 7fa0a3200640 1 -- 172.21.15.44:0/1437852400 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a40b86b0 con 0x7fa0a40ca750 2024-03-30T13:13:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.215+0000 7fa0a3200640 1 -- 172.21.15.44:0/1437852400 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0a4075890 con 0x7fa0a40ca750 2024-03-30T13:13:30.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.215+0000 7fa09a000640 1 -- 172.21.15.44:0/1437852400 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa0900253f0 con 0x7fa0a40ca750 2024-03-30T13:13:30.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.216+0000 7fa09a000640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa08406c530 0x7fa08406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.216+0000 7fa09a000640 1 -- 172.21.15.44:0/1437852400 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fa09008bfe0 con 0x7fa0a40ca750 2024-03-30T13:13:30.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.217+0000 7fa0a1e00640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa08406c530 0x7fa08406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.218+0000 7fa0a1e00640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa08406c530 0x7fa08406e9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa094033000 tx=0x7fa094009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:30.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.221+0000 7fa09a000640 1 -- 172.21.15.44:0/1437852400 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa090018030 con 0x7fa0a40ca750 2024-03-30T13:13:30.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.425+0000 7fa0a3200640 1 -- 172.21.15.44:0/1437852400 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0a415ec80 con 0x7fa08406c530 2024-03-30T13:13:30.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.446+0000 7fa09a000640 1 -- 172.21.15.44:0/1437852400 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7fa0a415ec80 con 0x7fa08406c530 2024-03-30T13:13:30.454 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:30.456 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:13:30.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.451+0000 7fa0a3200640 1 -- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa08406c530 msgr2=0x7fa08406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:30.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.451+0000 7fa0a3200640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa08406c530 0x7fa08406e9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa094033000 tx=0x7fa094009030 comp rx=0 tx=0).stop 2024-03-30T13:13:30.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.451+0000 7fa0a3200640 1 -- 172.21.15.44:0/1437852400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0a40ca750 msgr2=0x7fa0a40cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:30.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.451+0000 7fa0a3200640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0a40ca750 0x7fa0a40cdd60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa0900108c0 tx=0x7fa090010d80 comp rx=0 tx=0).stop 2024-03-30T13:13:30.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.451+0000 7fa0a3200640 1 -- 172.21.15.44:0/1437852400 shutdown_connections 2024-03-30T13:13:30.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.451+0000 7fa0a3200640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0a40ce2a0 0x7fa0a40cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.451+0000 7fa0a3200640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa0a40ca750 0x7fa0a40cdd60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.451+0000 7fa0a3200640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa08406c530 0x7fa08406e9f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.451+0000 7fa0a3200640 1 --2- 172.21.15.44:0/1437852400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0880039e0 0x7fa0a40b9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.451+0000 7fa0a3200640 1 -- 172.21.15.44:0/1437852400 >> 172.21.15.44:0/1437852400 conn(0x7fa0a409d570 msgr2=0x7fa0a415e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:30.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.452+0000 7fa0a3200640 1 -- 172.21.15.44:0/1437852400 shutdown_connections 2024-03-30T13:13:30.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.452+0000 7fa0a3200640 1 -- 172.21.15.44:0/1437852400 wait complete. 2024-03-30T13:13:30.477 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-03-30T13:13:29.990420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221056,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753664,"statfs":{"total":773094113280,"available":772867751936,"internally_reserved":0,"allocated":4988928,"data_stored":2790780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.113395"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313177+0000","last_change":"2024-03-30T13:13:24.933366+0000","last_active":"2024-03-30T13:13:26.313177+0000","last_peered":"2024-03-30T13:13:26.313177+0000","last_clean":"2024-03-30T13:13:26.313177+0000","last_became_active":"2024-03-30T13:13:24.933098+0000","last_became_peered":"2024-03-30T13:13:24.933098+0000","last_unstale":"2024-03-30T13:13:26.313177+0000","last_undegraded":"2024-03-30T13:13:26.313177+0000","last_fullsized":"2024-03-30T13:13:26.313177+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:50.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313100+0000","last_change":"2024-03-30T13:13:24.939484+0000","last_active":"2024-03-30T13:13:26.313100+0000","last_peered":"2024-03-30T13:13:26.313100+0000","last_clean":"2024-03-30T13:13:26.313100+0000","last_became_active":"2024-03-30T13:13:24.939204+0000","last_became_peered":"2024-03-30T13:13:24.939204+0000","last_unstale":"2024-03-30T13:13:26.313100+0000","last_undegraded":"2024-03-30T13:13:26.313100+0000","last_fullsized":"2024-03-30T13:13:26.313100+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:39.867975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560860+0000","last_change":"2024-03-30T13:13:24.932690+0000","last_active":"2024-03-30T13:13:26.560860+0000","last_peered":"2024-03-30T13:13:26.560860+0000","last_clean":"2024-03-30T13:13:26.560860+0000","last_became_active":"2024-03-30T13:13:24.932364+0000","last_became_peered":"2024-03-30T13:13:24.932364+0000","last_unstale":"2024-03-30T13:13:26.560860+0000","last_undegraded":"2024-03-30T13:13:26.560860+0000","last_fullsized":"2024-03-30T13:13:26.560860+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:14:38.399564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927384+0000","last_change":"2024-03-30T13:13:24.947993+0000","last_active":"2024-03-30T13:13:25.927384+0000","last_peered":"2024-03-30T13:13:25.927384+0000","last_clean":"2024-03-30T13:13:25.927384+0000","last_became_active":"2024-03-30T13:13:24.947711+0000","last_became_peered":"2024-03-30T13:13:24.947711+0000","last_unstale":"2024-03-30T13:13:25.927384+0000","last_undegraded":"2024-03-30T13:13:25.927384+0000","last_fullsized":"2024-03-30T13:13:25.927384+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:12:19.243241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927408+0000","last_change":"2024-03-30T13:13:24.937291+0000","last_active":"2024-03-30T13:13:25.927408+0000","last_peered":"2024-03-30T13:13:25.927408+0000","last_clean":"2024-03-30T13:13:25.927408+0000","last_became_active":"2024-03-30T13:13:24.936746+0000","last_became_peered":"2024-03-30T13:13:24.936746+0000","last_unstale":"2024-03-30T13:13:25.927408+0000","last_undegraded":"2024-03-30T13:13:25.927408+0000","last_fullsized":"2024-03-30T13:13:25.927408+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:43:13.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558422+0000","last_change":"2024-03-30T13:13:24.930014+0000","last_active":"2024-03-30T13:13:26.558422+0000","last_peered":"2024-03-30T13:13:26.558422+0000","last_clean":"2024-03-30T13:13:26.558422+0000","last_became_active":"2024-03-30T13:13:24.929670+0000","last_became_peered":"2024-03-30T13:13:24.929670+0000","last_unstale":"2024-03-30T13:13:26.558422+0000","last_undegraded":"2024-03-30T13:13:26.558422+0000","last_fullsized":"2024-03-30T13:13:26.558422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:29:34.921944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.933762+0000","last_change":"2024-03-30T13:13:24.940932+0000","last_active":"2024-03-30T13:13:25.933762+0000","last_peered":"2024-03-30T13:13:25.933762+0000","last_clean":"2024-03-30T13:13:25.933762+0000","last_became_active":"2024-03-30T13:13:24.940655+0000","last_became_peered":"2024-03-30T13:13:24.940655+0000","last_unstale":"2024-03-30T13:13:25.933762+0000","last_undegraded":"2024-03-30T13:13:25.933762+0000","last_fullsized":"2024-03-30T13:13:25.933762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:06.544052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312364+0000","last_change":"2024-03-30T13:13:24.945794+0000","last_active":"2024-03-30T13:13:26.312364+0000","last_peered":"2024-03-30T13:13:26.312364+0000","last_clean":"2024-03-30T13:13:26.312364+0000","last_became_active":"2024-03-30T13:13:24.945398+0000","last_became_peered":"2024-03-30T13:13:24.945398+0000","last_unstale":"2024-03-30T13:13:26.312364+0000","last_undegraded":"2024-03-30T13:13:26.312364+0000","last_fullsized":"2024-03-30T13:13:26.312364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:48.857782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.561166+0000","last_change":"2024-03-30T13:13:24.942052+0000","last_active":"2024-03-30T13:13:26.561166+0000","last_peered":"2024-03-30T13:13:26.561166+0000","last_clean":"2024-03-30T13:13:26.561166+0000","last_became_active":"2024-03-30T13:13:24.941161+0000","last_became_peered":"2024-03-30T13:13:24.941161+0000","last_unstale":"2024-03-30T13:13:26.561166+0000","last_undegraded":"2024-03-30T13:13:26.561166+0000","last_fullsized":"2024-03-30T13:13:26.561166+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:25:48.336489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937550+0000","last_change":"2024-03-30T13:13:24.936995+0000","last_active":"2024-03-30T13:13:25.937550+0000","last_peered":"2024-03-30T13:13:25.937550+0000","last_clean":"2024-03-30T13:13:25.937550+0000","last_became_active":"2024-03-30T13:13:24.936724+0000","last_became_peered":"2024-03-30T13:13:24.936724+0000","last_unstale":"2024-03-30T13:13:25.937550+0000","last_undegraded":"2024-03-30T13:13:25.937550+0000","last_fullsized":"2024-03-30T13:13:25.937550+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:05.845450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935947+0000","last_change":"2024-03-30T13:13:24.937824+0000","last_active":"2024-03-30T13:13:25.935947+0000","last_peered":"2024-03-30T13:13:25.935947+0000","last_clean":"2024-03-30T13:13:25.935947+0000","last_became_active":"2024-03-30T13:13:24.937424+0000","last_became_peered":"2024-03-30T13:13:24.937424+0000","last_unstale":"2024-03-30T13:13:25.935947+0000","last_undegraded":"2024-03-30T13:13:25.935947+0000","last_fullsized":"2024-03-30T13:13:25.935947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:01.919458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560837+0000","last_change":"2024-03-30T13:13:24.951191+0000","last_active":"2024-03-30T13:13:26.560837+0000","last_peered":"2024-03-30T13:13:26.560837+0000","last_clean":"2024-03-30T13:13:26.560837+0000","last_became_active":"2024-03-30T13:13:24.950840+0000","last_became_peered":"2024-03-30T13:13:24.950840+0000","last_unstale":"2024-03-30T13:13:26.560837+0000","last_undegraded":"2024-03-30T13:13:26.560837+0000","last_fullsized":"2024-03-30T13:13:26.560837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:32:37.703237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935965+0000","last_change":"2024-03-30T13:13:24.933576+0000","last_active":"2024-03-30T13:13:25.935965+0000","last_peered":"2024-03-30T13:13:25.935965+0000","last_clean":"2024-03-30T13:13:25.935965+0000","last_became_active":"2024-03-30T13:13:24.933261+0000","last_became_peered":"2024-03-30T13:13:24.933261+0000","last_unstale":"2024-03-30T13:13:25.935965+0000","last_undegraded":"2024-03-30T13:13:25.935965+0000","last_fullsized":"2024-03-30T13:13:25.935965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:16:27.204486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558241+0000","last_change":"2024-03-30T13:13:24.925051+0000","last_active":"2024-03-30T13:13:26.558241+0000","last_peered":"2024-03-30T13:13:26.558241+0000","last_clean":"2024-03-30T13:13:26.558241+0000","last_became_active":"2024-03-30T13:13:24.924651+0000","last_became_peered":"2024-03-30T13:13:24.924651+0000","last_unstale":"2024-03-30T13:13:26.558241+0000","last_undegraded":"2024-03-30T13:13:26.558241+0000","last_fullsized":"2024-03-30T13:13:26.558241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:11:49.156277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.934166+0000","last_change":"2024-03-30T13:13:24.946201+0000","last_active":"2024-03-30T13:13:25.934166+0000","last_peered":"2024-03-30T13:13:25.934166+0000","last_clean":"2024-03-30T13:13:25.934166+0000","last_became_active":"2024-03-30T13:13:24.945720+0000","last_became_peered":"2024-03-30T13:13:24.945720+0000","last_unstale":"2024-03-30T13:13:25.934166+0000","last_undegraded":"2024-03-30T13:13:25.934166+0000","last_fullsized":"2024-03-30T13:13:25.934166+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:46:37.184683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.932773+0000","last_change":"2024-03-30T13:13:24.939447+0000","last_active":"2024-03-30T13:13:25.932773+0000","last_peered":"2024-03-30T13:13:25.932773+0000","last_clean":"2024-03-30T13:13:25.932773+0000","last_became_active":"2024-03-30T13:13:24.939130+0000","last_became_peered":"2024-03-30T13:13:24.939130+0000","last_unstale":"2024-03-30T13:13:25.932773+0000","last_undegraded":"2024-03-30T13:13:25.932773+0000","last_fullsized":"2024-03-30T13:13:25.932773+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:42:41.962873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937559+0000","last_change":"2024-03-30T13:13:24.940595+0000","last_active":"2024-03-30T13:13:25.937559+0000","last_peered":"2024-03-30T13:13:25.937559+0000","last_clean":"2024-03-30T13:13:25.937559+0000","last_became_active":"2024-03-30T13:13:24.940303+0000","last_became_peered":"2024-03-30T13:13:24.940303+0000","last_unstale":"2024-03-30T13:13:25.937559+0000","last_undegraded":"2024-03-30T13:13:25.937559+0000","last_fullsized":"2024-03-30T13:13:25.937559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:01.919458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.561038+0000","last_change":"2024-03-30T13:13:24.936819+0000","last_active":"2024-03-30T13:13:26.561038+0000","last_peered":"2024-03-30T13:13:26.561038+0000","last_clean":"2024-03-30T13:13:26.561038+0000","last_became_active":"2024-03-30T13:13:24.936416+0000","last_became_peered":"2024-03-30T13:13:24.936416+0000","last_unstale":"2024-03-30T13:13:26.561038+0000","last_undegraded":"2024-03-30T13:13:26.561038+0000","last_fullsized":"2024-03-30T13:13:26.561038+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:28:45.868296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927823+0000","last_change":"2024-03-30T13:13:24.944867+0000","last_active":"2024-03-30T13:13:25.927823+0000","last_peered":"2024-03-30T13:13:25.927823+0000","last_clean":"2024-03-30T13:13:25.927823+0000","last_became_active":"2024-03-30T13:13:24.944515+0000","last_became_peered":"2024-03-30T13:13:24.944515+0000","last_unstale":"2024-03-30T13:13:25.927823+0000","last_undegraded":"2024-03-30T13:13:25.927823+0000","last_fullsized":"2024-03-30T13:13:25.927823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:11.845513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560908+0000","last_change":"2024-03-30T13:13:24.932873+0000","last_active":"2024-03-30T13:13:26.560908+0000","last_peered":"2024-03-30T13:13:26.560908+0000","last_clean":"2024-03-30T13:13:26.560908+0000","last_became_active":"2024-03-30T13:13:24.932568+0000","last_became_peered":"2024-03-30T13:13:24.932568+0000","last_unstale":"2024-03-30T13:13:26.560908+0000","last_undegraded":"2024-03-30T13:13:26.560908+0000","last_fullsized":"2024-03-30T13:13:26.560908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:29.827966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936484+0000","last_change":"2024-03-30T13:13:24.941578+0000","last_active":"2024-03-30T13:13:25.936484+0000","last_peered":"2024-03-30T13:13:25.936484+0000","last_clean":"2024-03-30T13:13:25.936484+0000","last_became_active":"2024-03-30T13:13:24.941271+0000","last_became_peered":"2024-03-30T13:13:24.941271+0000","last_unstale":"2024-03-30T13:13:25.936484+0000","last_undegraded":"2024-03-30T13:13:25.936484+0000","last_fullsized":"2024-03-30T13:13:25.936484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:43.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559662+0000","last_change":"2024-03-30T13:13:24.950241+0000","last_active":"2024-03-30T13:13:26.559662+0000","last_peered":"2024-03-30T13:13:26.559662+0000","last_clean":"2024-03-30T13:13:26.559662+0000","last_became_active":"2024-03-30T13:13:24.949773+0000","last_became_peered":"2024-03-30T13:13:24.949773+0000","last_unstale":"2024-03-30T13:13:26.559662+0000","last_undegraded":"2024-03-30T13:13:26.559662+0000","last_fullsized":"2024-03-30T13:13:26.559662+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:29:34.921944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.932979+0000","last_change":"2024-03-30T13:13:24.949377+0000","last_active":"2024-03-30T13:13:25.932979+0000","last_peered":"2024-03-30T13:13:25.932979+0000","last_clean":"2024-03-30T13:13:25.932979+0000","last_became_active":"2024-03-30T13:13:24.948977+0000","last_became_peered":"2024-03-30T13:13:24.948977+0000","last_unstale":"2024-03-30T13:13:25.932979+0000","last_undegraded":"2024-03-30T13:13:25.932979+0000","last_fullsized":"2024-03-30T13:13:25.932979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:02:58.879182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927147+0000","last_change":"2024-03-30T13:13:24.939423+0000","last_active":"2024-03-30T13:13:25.927147+0000","last_peered":"2024-03-30T13:13:25.927147+0000","last_clean":"2024-03-30T13:13:25.927147+0000","last_became_active":"2024-03-30T13:13:24.939153+0000","last_became_peered":"2024-03-30T13:13:24.939153+0000","last_unstale":"2024-03-30T13:13:25.927147+0000","last_undegraded":"2024-03-30T13:13:25.927147+0000","last_fullsized":"2024-03-30T13:13:25.927147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:13:55.741135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.561079+0000","last_change":"2024-03-30T13:13:24.934918+0000","last_active":"2024-03-30T13:13:26.561079+0000","last_peered":"2024-03-30T13:13:26.561079+0000","last_clean":"2024-03-30T13:13:26.561079+0000","last_became_active":"2024-03-30T13:13:24.934348+0000","last_became_peered":"2024-03-30T13:13:24.934348+0000","last_unstale":"2024-03-30T13:13:26.561079+0000","last_undegraded":"2024-03-30T13:13:26.561079+0000","last_fullsized":"2024-03-30T13:13:26.561079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:25.356557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559920+0000","last_change":"2024-03-30T13:13:24.935924+0000","last_active":"2024-03-30T13:13:26.559920+0000","last_peered":"2024-03-30T13:13:26.559920+0000","last_clean":"2024-03-30T13:13:26.559920+0000","last_became_active":"2024-03-30T13:13:24.935616+0000","last_became_peered":"2024-03-30T13:13:24.935616+0000","last_unstale":"2024-03-30T13:13:26.559920+0000","last_undegraded":"2024-03-30T13:13:26.559920+0000","last_fullsized":"2024-03-30T13:13:26.559920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:27.932652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560398+0000","last_change":"2024-03-30T13:13:24.945549+0000","last_active":"2024-03-30T13:13:26.560398+0000","last_peered":"2024-03-30T13:13:26.560398+0000","last_clean":"2024-03-30T13:13:26.560398+0000","last_became_active":"2024-03-30T13:13:24.945243+0000","last_became_peered":"2024-03-30T13:13:24.945243+0000","last_unstale":"2024-03-30T13:13:26.560398+0000","last_undegraded":"2024-03-30T13:13:26.560398+0000","last_fullsized":"2024-03-30T13:13:26.560398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:28:47.620617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937130+0000","last_change":"2024-03-30T13:13:24.947492+0000","last_active":"2024-03-30T13:13:25.937130+0000","last_peered":"2024-03-30T13:13:25.937130+0000","last_clean":"2024-03-30T13:13:25.937130+0000","last_became_active":"2024-03-30T13:13:24.947189+0000","last_became_peered":"2024-03-30T13:13:24.947189+0000","last_unstale":"2024-03-30T13:13:25.937130+0000","last_undegraded":"2024-03-30T13:13:25.937130+0000","last_fullsized":"2024-03-30T13:13:25.937130+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:29:49.897116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560350+0000","last_change":"2024-03-30T13:13:24.933293+0000","last_active":"2024-03-30T13:13:26.560350+0000","last_peered":"2024-03-30T13:13:26.560350+0000","last_clean":"2024-03-30T13:13:26.560350+0000","last_became_active":"2024-03-30T13:13:24.933025+0000","last_became_peered":"2024-03-30T13:13:24.933025+0000","last_unstale":"2024-03-30T13:13:26.560350+0000","last_undegraded":"2024-03-30T13:13:26.560350+0000","last_fullsized":"2024-03-30T13:13:26.560350+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:08.019034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560552+0000","last_change":"2024-03-30T13:13:24.929414+0000","last_active":"2024-03-30T13:13:26.560552+0000","last_peered":"2024-03-30T13:13:26.560552+0000","last_clean":"2024-03-30T13:13:26.560552+0000","last_became_active":"2024-03-30T13:13:24.929055+0000","last_became_peered":"2024-03-30T13:13:24.929055+0000","last_unstale":"2024-03-30T13:13:26.560552+0000","last_undegraded":"2024-03-30T13:13:26.560552+0000","last_fullsized":"2024-03-30T13:13:26.560552+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:38:49.015365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.933584+0000","last_change":"2024-03-30T13:13:24.949110+0000","last_active":"2024-03-30T13:13:25.933584+0000","last_peered":"2024-03-30T13:13:25.933584+0000","last_clean":"2024-03-30T13:13:25.933584+0000","last_became_active":"2024-03-30T13:13:24.948809+0000","last_became_peered":"2024-03-30T13:13:24.948809+0000","last_unstale":"2024-03-30T13:13:25.933584+0000","last_undegraded":"2024-03-30T13:13:25.933584+0000","last_fullsized":"2024-03-30T13:13:25.933584+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:54:15.639267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558430+0000","last_change":"2024-03-30T13:13:24.949015+0000","last_active":"2024-03-30T13:13:26.558430+0000","last_peered":"2024-03-30T13:13:26.558430+0000","last_clean":"2024-03-30T13:13:26.558430+0000","last_became_active":"2024-03-30T13:13:24.948697+0000","last_became_peered":"2024-03-30T13:13:24.948697+0000","last_unstale":"2024-03-30T13:13:26.558430+0000","last_undegraded":"2024-03-30T13:13:26.558430+0000","last_fullsized":"2024-03-30T13:13:26.558430+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:19:42.226017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935645+0000","last_change":"2024-03-30T13:13:24.944732+0000","last_active":"2024-03-30T13:13:25.935645+0000","last_peered":"2024-03-30T13:13:25.935645+0000","last_clean":"2024-03-30T13:13:25.935645+0000","last_became_active":"2024-03-30T13:13:24.944398+0000","last_became_peered":"2024-03-30T13:13:24.944398+0000","last_unstale":"2024-03-30T13:13:25.935645+0000","last_undegraded":"2024-03-30T13:13:25.935645+0000","last_fullsized":"2024-03-30T13:13:25.935645+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:46:37.184683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560950+0000","last_change":"2024-03-30T13:13:23.912435+0000","last_active":"2024-03-30T13:13:26.560950+0000","last_peered":"2024-03-30T13:13:26.560950+0000","last_clean":"2024-03-30T13:13:26.560950+0000","last_became_active":"2024-03-30T13:13:23.912109+0000","last_became_peered":"2024-03-30T13:13:23.912109+0000","last_unstale":"2024-03-30T13:13:26.560950+0000","last_undegraded":"2024-03-30T13:13:26.560950+0000","last_fullsized":"2024-03-30T13:13:26.560950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:43:12.875054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559894+0000","last_change":"2024-03-30T13:13:24.935447+0000","last_active":"2024-03-30T13:13:26.559894+0000","last_peered":"2024-03-30T13:13:26.559894+0000","last_clean":"2024-03-30T13:13:26.559894+0000","last_became_active":"2024-03-30T13:13:24.935129+0000","last_became_peered":"2024-03-30T13:13:24.935129+0000","last_unstale":"2024-03-30T13:13:26.559894+0000","last_undegraded":"2024-03-30T13:13:26.559894+0000","last_fullsized":"2024-03-30T13:13:26.559894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:19:14.766849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560906+0000","last_change":"2024-03-30T13:13:23.905749+0000","last_active":"2024-03-30T13:13:26.560906+0000","last_peered":"2024-03-30T13:13:26.560906+0000","last_clean":"2024-03-30T13:13:26.560906+0000","last_became_active":"2024-03-30T13:13:23.905396+0000","last_became_peered":"2024-03-30T13:13:23.905396+0000","last_unstale":"2024-03-30T13:13:26.560906+0000","last_undegraded":"2024-03-30T13:13:26.560906+0000","last_fullsized":"2024-03-30T13:13:26.560906+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:47.127657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559467+0000","last_change":"2024-03-30T13:13:24.926075+0000","last_active":"2024-03-30T13:13:26.559467+0000","last_peered":"2024-03-30T13:13:26.559467+0000","last_clean":"2024-03-30T13:13:26.559467+0000","last_became_active":"2024-03-30T13:13:24.925773+0000","last_became_peered":"2024-03-30T13:13:24.925773+0000","last_unstale":"2024-03-30T13:13:26.559467+0000","last_undegraded":"2024-03-30T13:13:26.559467+0000","last_fullsized":"2024-03-30T13:13:26.559467+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:45.193052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559798+0000","last_change":"2024-03-30T13:13:23.907148+0000","last_active":"2024-03-30T13:13:26.559798+0000","last_peered":"2024-03-30T13:13:26.559798+0000","last_clean":"2024-03-30T13:13:26.559798+0000","last_became_active":"2024-03-30T13:13:23.906845+0000","last_became_peered":"2024-03-30T13:13:23.906845+0000","last_unstale":"2024-03-30T13:13:26.559798+0000","last_undegraded":"2024-03-30T13:13:26.559798+0000","last_fullsized":"2024-03-30T13:13:26.559798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:19:01.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313210+0000","last_change":"2024-03-30T13:13:24.925531+0000","last_active":"2024-03-30T13:13:26.313210+0000","last_peered":"2024-03-30T13:13:26.313210+0000","last_clean":"2024-03-30T13:13:26.313210+0000","last_became_active":"2024-03-30T13:13:24.925210+0000","last_became_peered":"2024-03-30T13:13:24.925210+0000","last_unstale":"2024-03-30T13:13:26.313210+0000","last_undegraded":"2024-03-30T13:13:26.313210+0000","last_fullsized":"2024-03-30T13:13:26.313210+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:55:24.799048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558712+0000","last_change":"2024-03-30T13:13:23.913141+0000","last_active":"2024-03-30T13:13:26.558712+0000","last_peered":"2024-03-30T13:13:26.558712+0000","last_clean":"2024-03-30T13:13:26.558712+0000","last_became_active":"2024-03-30T13:13:23.912862+0000","last_became_peered":"2024-03-30T13:13:23.912862+0000","last_unstale":"2024-03-30T13:13:26.558712+0000","last_undegraded":"2024-03-30T13:13:26.558712+0000","last_fullsized":"2024-03-30T13:13:26.558712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:04:33.269431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558847+0000","last_change":"2024-03-30T13:13:24.936927+0000","last_active":"2024-03-30T13:13:26.558847+0000","last_peered":"2024-03-30T13:13:26.558847+0000","last_clean":"2024-03-30T13:13:26.558847+0000","last_became_active":"2024-03-30T13:13:24.936696+0000","last_became_peered":"2024-03-30T13:13:24.936696+0000","last_unstale":"2024-03-30T13:13:26.558847+0000","last_undegraded":"2024-03-30T13:13:26.558847+0000","last_fullsized":"2024-03-30T13:13:26.558847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:19:42.226017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936632+0000","last_change":"2024-03-30T13:13:23.909692+0000","last_active":"2024-03-30T13:13:25.936632+0000","last_peered":"2024-03-30T13:13:25.936632+0000","last_clean":"2024-03-30T13:13:25.936632+0000","last_became_active":"2024-03-30T13:13:23.909057+0000","last_became_peered":"2024-03-30T13:13:23.909057+0000","last_unstale":"2024-03-30T13:13:25.936632+0000","last_undegraded":"2024-03-30T13:13:25.936632+0000","last_fullsized":"2024-03-30T13:13:25.936632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:28:44.855733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935443+0000","last_change":"2024-03-30T13:13:24.941969+0000","last_active":"2024-03-30T13:13:25.935443+0000","last_peered":"2024-03-30T13:13:25.935443+0000","last_clean":"2024-03-30T13:13:25.935443+0000","last_became_active":"2024-03-30T13:13:24.941381+0000","last_became_peered":"2024-03-30T13:13:24.941381+0000","last_unstale":"2024-03-30T13:13:25.935443+0000","last_undegraded":"2024-03-30T13:13:25.935443+0000","last_fullsized":"2024-03-30T13:13:25.935443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:05.103106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.934648+0000","last_change":"2024-03-30T13:13:23.913401+0000","last_active":"2024-03-30T13:13:25.934648+0000","last_peered":"2024-03-30T13:13:25.934648+0000","last_clean":"2024-03-30T13:13:25.934648+0000","last_became_active":"2024-03-30T13:13:23.913124+0000","last_became_peered":"2024-03-30T13:13:23.913124+0000","last_unstale":"2024-03-30T13:13:25.934648+0000","last_undegraded":"2024-03-30T13:13:25.934648+0000","last_fullsized":"2024-03-30T13:13:25.934648+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:28.815403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558700+0000","last_change":"2024-03-30T13:13:24.942700+0000","last_active":"2024-03-30T13:13:26.558700+0000","last_peered":"2024-03-30T13:13:26.558700+0000","last_clean":"2024-03-30T13:13:26.558700+0000","last_became_active":"2024-03-30T13:13:24.942280+0000","last_became_peered":"2024-03-30T13:13:24.942280+0000","last_unstale":"2024-03-30T13:13:26.558700+0000","last_undegraded":"2024-03-30T13:13:26.558700+0000","last_fullsized":"2024-03-30T13:13:26.558700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:40.881861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558297+0000","last_change":"2024-03-30T13:13:23.914025+0000","last_active":"2024-03-30T13:13:26.558297+0000","last_peered":"2024-03-30T13:13:26.558297+0000","last_clean":"2024-03-30T13:13:26.558297+0000","last_became_active":"2024-03-30T13:13:23.913731+0000","last_became_peered":"2024-03-30T13:13:23.913731+0000","last_unstale":"2024-03-30T13:13:26.558297+0000","last_undegraded":"2024-03-30T13:13:26.558297+0000","last_fullsized":"2024-03-30T13:13:26.558297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:36.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312710+0000","last_change":"2024-03-30T13:13:24.922261+0000","last_active":"2024-03-30T13:13:26.312710+0000","last_peered":"2024-03-30T13:13:26.312710+0000","last_clean":"2024-03-30T13:13:26.312710+0000","last_became_active":"2024-03-30T13:13:24.921795+0000","last_became_peered":"2024-03-30T13:13:24.921795+0000","last_unstale":"2024-03-30T13:13:26.312710+0000","last_undegraded":"2024-03-30T13:13:26.312710+0000","last_fullsized":"2024-03-30T13:13:26.312710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:29.747181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.557952+0000","last_change":"2024-03-30T13:13:23.914096+0000","last_active":"2024-03-30T13:13:26.557952+0000","last_peered":"2024-03-30T13:13:26.557952+0000","last_clean":"2024-03-30T13:13:26.557952+0000","last_became_active":"2024-03-30T13:13:23.913765+0000","last_became_peered":"2024-03-30T13:13:23.913765+0000","last_unstale":"2024-03-30T13:13:26.557952+0000","last_undegraded":"2024-03-30T13:13:26.557952+0000","last_fullsized":"2024-03-30T13:13:26.557952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:12:05.502548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927543+0000","last_change":"2024-03-30T13:13:24.950234+0000","last_active":"2024-03-30T13:13:25.927543+0000","last_peered":"2024-03-30T13:13:25.927543+0000","last_clean":"2024-03-30T13:13:25.927543+0000","last_became_active":"2024-03-30T13:13:24.945869+0000","last_became_peered":"2024-03-30T13:13:24.945869+0000","last_unstale":"2024-03-30T13:13:25.927543+0000","last_undegraded":"2024-03-30T13:13:25.927543+0000","last_fullsized":"2024-03-30T13:13:25.927543+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:51:18.065282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313213+0000","last_change":"2024-03-30T13:13:23.907227+0000","last_active":"2024-03-30T13:13:26.313213+0000","last_peered":"2024-03-30T13:13:26.313213+0000","last_clean":"2024-03-30T13:13:26.313213+0000","last_became_active":"2024-03-30T13:13:23.906937+0000","last_became_peered":"2024-03-30T13:13:23.906937+0000","last_unstale":"2024-03-30T13:13:26.313213+0000","last_undegraded":"2024-03-30T13:13:26.313213+0000","last_fullsized":"2024-03-30T13:13:26.313213+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:19:41.213454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935422+0000","last_change":"2024-03-30T13:13:24.924923+0000","last_active":"2024-03-30T13:13:25.935422+0000","last_peered":"2024-03-30T13:13:25.935422+0000","last_clean":"2024-03-30T13:13:25.935422+0000","last_became_active":"2024-03-30T13:13:24.923094+0000","last_became_peered":"2024-03-30T13:13:24.923094+0000","last_unstale":"2024-03-30T13:13:25.935422+0000","last_undegraded":"2024-03-30T13:13:25.935422+0000","last_fullsized":"2024-03-30T13:13:25.935422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:09:33.229806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937693+0000","last_change":"2024-03-30T13:13:23.909082+0000","last_active":"2024-03-30T13:13:25.937693+0000","last_peered":"2024-03-30T13:13:25.937693+0000","last_clean":"2024-03-30T13:13:25.937693+0000","last_became_active":"2024-03-30T13:13:23.908747+0000","last_became_peered":"2024-03-30T13:13:23.908747+0000","last_unstale":"2024-03-30T13:13:25.937693+0000","last_undegraded":"2024-03-30T13:13:25.937693+0000","last_fullsized":"2024-03-30T13:13:25.937693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:10.504569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560854+0000","last_change":"2024-03-30T13:13:24.927692+0000","last_active":"2024-03-30T13:13:26.560854+0000","last_peered":"2024-03-30T13:13:26.560854+0000","last_clean":"2024-03-30T13:13:26.560854+0000","last_became_active":"2024-03-30T13:13:24.927182+0000","last_became_peered":"2024-03-30T13:13:24.927182+0000","last_unstale":"2024-03-30T13:13:26.560854+0000","last_undegraded":"2024-03-30T13:13:26.560854+0000","last_fullsized":"2024-03-30T13:13:26.560854+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:21.652459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936864+0000","last_change":"2024-03-30T13:13:23.907257+0000","last_active":"2024-03-30T13:13:25.936864+0000","last_peered":"2024-03-30T13:13:25.936864+0000","last_clean":"2024-03-30T13:13:25.936864+0000","last_became_active":"2024-03-30T13:13:23.906115+0000","last_became_peered":"2024-03-30T13:13:23.906115+0000","last_unstale":"2024-03-30T13:13:25.936864+0000","last_undegraded":"2024-03-30T13:13:25.936864+0000","last_fullsized":"2024-03-30T13:13:25.936864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:24.343994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560048+0000","last_change":"2024-03-30T13:13:24.949472+0000","last_active":"2024-03-30T13:13:26.560048+0000","last_peered":"2024-03-30T13:13:26.560048+0000","last_clean":"2024-03-30T13:13:26.560048+0000","last_became_active":"2024-03-30T13:13:24.949147+0000","last_became_peered":"2024-03-30T13:13:24.949147+0000","last_unstale":"2024-03-30T13:13:26.560048+0000","last_undegraded":"2024-03-30T13:13:26.560048+0000","last_fullsized":"2024-03-30T13:13:26.560048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:19:42.226017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312819+0000","last_change":"2024-03-30T13:13:23.904054+0000","last_active":"2024-03-30T13:13:26.312819+0000","last_peered":"2024-03-30T13:13:26.312819+0000","last_clean":"2024-03-30T13:13:26.312819+0000","last_became_active":"2024-03-30T13:13:23.903743+0000","last_became_peered":"2024-03-30T13:13:23.903743+0000","last_unstale":"2024-03-30T13:13:26.312819+0000","last_undegraded":"2024-03-30T13:13:26.312819+0000","last_fullsized":"2024-03-30T13:13:26.312819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:44.180489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559457+0000","last_change":"2024-03-30T13:13:24.939455+0000","last_active":"2024-03-30T13:13:26.559457+0000","last_peered":"2024-03-30T13:13:26.559457+0000","last_clean":"2024-03-30T13:13:26.559457+0000","last_became_active":"2024-03-30T13:13:24.939178+0000","last_became_peered":"2024-03-30T13:13:24.939178+0000","last_unstale":"2024-03-30T13:13:26.559457+0000","last_undegraded":"2024-03-30T13:13:26.559457+0000","last_fullsized":"2024-03-30T13:13:26.559457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:27:16.659922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312822+0000","last_change":"2024-03-30T13:13:23.912339+0000","last_active":"2024-03-30T13:13:26.312822+0000","last_peered":"2024-03-30T13:13:26.312822+0000","last_clean":"2024-03-30T13:13:26.312822+0000","last_became_active":"2024-03-30T13:13:23.912014+0000","last_became_peered":"2024-03-30T13:13:23.912014+0000","last_unstale":"2024-03-30T13:13:26.312822+0000","last_undegraded":"2024-03-30T13:13:26.312822+0000","last_fullsized":"2024-03-30T13:13:26.312822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:29:33.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312507+0000","last_change":"2024-03-30T13:13:24.935581+0000","last_active":"2024-03-30T13:13:26.312507+0000","last_peered":"2024-03-30T13:13:26.312507+0000","last_clean":"2024-03-30T13:13:26.312507+0000","last_became_active":"2024-03-30T13:13:24.934328+0000","last_became_peered":"2024-03-30T13:13:24.934328+0000","last_unstale":"2024-03-30T13:13:26.312507+0000","last_undegraded":"2024-03-30T13:13:26.312507+0000","last_fullsized":"2024-03-30T13:13:26.312507+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:50:47.878866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558554+0000","last_change":"2024-03-30T13:13:23.909571+0000","last_active":"2024-03-30T13:13:26.558554+0000","last_peered":"2024-03-30T13:13:26.558554+0000","last_clean":"2024-03-30T13:13:26.558554+0000","last_became_active":"2024-03-30T13:13:23.908787+0000","last_became_peered":"2024-03-30T13:13:23.908787+0000","last_unstale":"2024-03-30T13:13:26.558554+0000","last_undegraded":"2024-03-30T13:13:26.558554+0000","last_fullsized":"2024-03-30T13:13:26.558554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:47.127657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.934972+0000","last_change":"2024-03-30T13:13:24.949259+0000","last_active":"2024-03-30T13:13:25.934972+0000","last_peered":"2024-03-30T13:13:25.934972+0000","last_clean":"2024-03-30T13:13:25.934972+0000","last_became_active":"2024-03-30T13:13:24.948978+0000","last_became_peered":"2024-03-30T13:13:24.948978+0000","last_unstale":"2024-03-30T13:13:25.934972+0000","last_undegraded":"2024-03-30T13:13:25.934972+0000","last_fullsized":"2024-03-30T13:13:25.934972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:11.515578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559517+0000","last_change":"2024-03-30T13:13:23.912393+0000","last_active":"2024-03-30T13:13:26.559517+0000","last_peered":"2024-03-30T13:13:26.559517+0000","last_clean":"2024-03-30T13:13:26.559517+0000","last_became_active":"2024-03-30T13:13:23.911987+0000","last_became_peered":"2024-03-30T13:13:23.911987+0000","last_unstale":"2024-03-30T13:13:26.559517+0000","last_undegraded":"2024-03-30T13:13:26.559517+0000","last_fullsized":"2024-03-30T13:13:26.559517+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:12:18.230678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312750+0000","last_change":"2024-03-30T13:13:24.929096+0000","last_active":"2024-03-30T13:13:26.312750+0000","last_peered":"2024-03-30T13:13:26.312750+0000","last_clean":"2024-03-30T13:13:26.312750+0000","last_became_active":"2024-03-30T13:13:24.928756+0000","last_became_peered":"2024-03-30T13:13:24.928756+0000","last_unstale":"2024-03-30T13:13:26.312750+0000","last_undegraded":"2024-03-30T13:13:26.312750+0000","last_fullsized":"2024-03-30T13:13:26.312750+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:38:59.271961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.932662+0000","last_change":"2024-03-30T13:13:23.910811+0000","last_active":"2024-03-30T13:13:25.932662+0000","last_peered":"2024-03-30T13:13:25.932662+0000","last_clean":"2024-03-30T13:13:25.932662+0000","last_became_active":"2024-03-30T13:13:23.910524+0000","last_became_peered":"2024-03-30T13:13:23.910524+0000","last_unstale":"2024-03-30T13:13:25.932662+0000","last_undegraded":"2024-03-30T13:13:25.932662+0000","last_fullsized":"2024-03-30T13:13:25.932662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:07.006471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312978+0000","last_change":"2024-03-30T13:13:24.921721+0000","last_active":"2024-03-30T13:13:26.312978+0000","last_peered":"2024-03-30T13:13:26.312978+0000","last_clean":"2024-03-30T13:13:26.312978+0000","last_became_active":"2024-03-30T13:13:24.921340+0000","last_became_peered":"2024-03-30T13:13:24.921340+0000","last_unstale":"2024-03-30T13:13:26.312978+0000","last_undegraded":"2024-03-30T13:13:26.312978+0000","last_fullsized":"2024-03-30T13:13:26.312978+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:54:43.683984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937516+0000","last_change":"2024-03-30T13:13:23.910688+0000","last_active":"2024-03-30T13:13:25.937516+0000","last_peered":"2024-03-30T13:13:25.937516+0000","last_clean":"2024-03-30T13:13:25.937516+0000","last_became_active":"2024-03-30T13:13:23.910389+0000","last_became_peered":"2024-03-30T13:13:23.910389+0000","last_unstale":"2024-03-30T13:13:25.937516+0000","last_undegraded":"2024-03-30T13:13:25.937516+0000","last_fullsized":"2024-03-30T13:13:25.937516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:54:48.348579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936429+0000","last_change":"2024-03-30T13:13:24.941714+0000","last_active":"2024-03-30T13:13:25.936429+0000","last_peered":"2024-03-30T13:13:25.936429+0000","last_clean":"2024-03-30T13:13:25.936429+0000","last_became_active":"2024-03-30T13:13:24.941308+0000","last_became_peered":"2024-03-30T13:13:24.941308+0000","last_unstale":"2024-03-30T13:13:25.936429+0000","last_undegraded":"2024-03-30T13:13:25.936429+0000","last_fullsized":"2024-03-30T13:13:25.936429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:46:34.360151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559491+0000","last_change":"2024-03-30T13:13:23.917176+0000","last_active":"2024-03-30T13:13:26.559491+0000","last_peered":"2024-03-30T13:13:26.559491+0000","last_clean":"2024-03-30T13:13:26.559491+0000","last_became_active":"2024-03-30T13:13:23.916685+0000","last_became_peered":"2024-03-30T13:13:23.916685+0000","last_unstale":"2024-03-30T13:13:26.559491+0000","last_undegraded":"2024-03-30T13:13:26.559491+0000","last_fullsized":"2024-03-30T13:13:26.559491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:19:01.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559142+0000","last_change":"2024-03-30T13:13:24.930644+0000","last_active":"2024-03-30T13:13:26.559142+0000","last_peered":"2024-03-30T13:13:26.559142+0000","last_clean":"2024-03-30T13:13:26.559142+0000","last_became_active":"2024-03-30T13:13:24.930343+0000","last_became_peered":"2024-03-30T13:13:24.930343+0000","last_unstale":"2024-03-30T13:13:26.559142+0000","last_undegraded":"2024-03-30T13:13:26.559142+0000","last_fullsized":"2024-03-30T13:13:26.559142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:01:37.950139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927745+0000","last_change":"2024-03-30T13:13:23.902484+0000","last_active":"2024-03-30T13:13:25.927745+0000","last_peered":"2024-03-30T13:13:25.927745+0000","last_clean":"2024-03-30T13:13:25.927745+0000","last_became_active":"2024-03-30T13:13:23.902216+0000","last_became_peered":"2024-03-30T13:13:23.902216+0000","last_unstale":"2024-03-30T13:13:25.927745+0000","last_undegraded":"2024-03-30T13:13:25.927745+0000","last_fullsized":"2024-03-30T13:13:25.927745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:55:03.679777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.928018+0000","last_change":"2024-03-30T13:13:24.949378+0000","last_active":"2024-03-30T13:13:25.928018+0000","last_peered":"2024-03-30T13:13:25.928018+0000","last_clean":"2024-03-30T13:13:25.928018+0000","last_became_active":"2024-03-30T13:13:24.944690+0000","last_became_peered":"2024-03-30T13:13:24.944690+0000","last_unstale":"2024-03-30T13:13:25.928018+0000","last_undegraded":"2024-03-30T13:13:25.928018+0000","last_fullsized":"2024-03-30T13:13:25.928018+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:43:31.023520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558918+0000","last_change":"2024-03-30T13:13:23.910268+0000","last_active":"2024-03-30T13:13:26.558918+0000","last_peered":"2024-03-30T13:13:26.558918+0000","last_clean":"2024-03-30T13:13:26.558918+0000","last_became_active":"2024-03-30T13:13:23.909961+0000","last_became_peered":"2024-03-30T13:13:23.909961+0000","last_unstale":"2024-03-30T13:13:26.558918+0000","last_undegraded":"2024-03-30T13:13:26.558918+0000","last_fullsized":"2024-03-30T13:13:26.558918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:13:03.451305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.933139+0000","last_change":"2024-03-30T13:13:24.944391+0000","last_active":"2024-03-30T13:13:25.933139+0000","last_peered":"2024-03-30T13:13:25.933139+0000","last_clean":"2024-03-30T13:13:25.933139+0000","last_became_active":"2024-03-30T13:13:24.944103+0000","last_became_peered":"2024-03-30T13:13:24.944103+0000","last_unstale":"2024-03-30T13:13:25.933139+0000","last_undegraded":"2024-03-30T13:13:25.933139+0000","last_fullsized":"2024-03-30T13:13:25.933139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:05.047128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927510+0000","last_change":"2024-03-30T13:13:23.906510+0000","last_active":"2024-03-30T13:13:25.927510+0000","last_peered":"2024-03-30T13:13:25.927510+0000","last_clean":"2024-03-30T13:13:25.927510+0000","last_became_active":"2024-03-30T13:13:23.906250+0000","last_became_peered":"2024-03-30T13:13:23.906250+0000","last_unstale":"2024-03-30T13:13:25.927510+0000","last_undegraded":"2024-03-30T13:13:25.927510+0000","last_fullsized":"2024-03-30T13:13:25.927510+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:32:41.206020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560470+0000","last_change":"2024-03-30T13:13:24.928466+0000","last_active":"2024-03-30T13:13:26.560470+0000","last_peered":"2024-03-30T13:13:26.560470+0000","last_clean":"2024-03-30T13:13:26.560470+0000","last_became_active":"2024-03-30T13:13:24.928199+0000","last_became_peered":"2024-03-30T13:13:24.928199+0000","last_unstale":"2024-03-30T13:13:26.560470+0000","last_undegraded":"2024-03-30T13:13:26.560470+0000","last_fullsized":"2024-03-30T13:13:26.560470+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:27.932652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927271+0000","last_change":"2024-03-30T13:13:23.908274+0000","last_active":"2024-03-30T13:13:25.927271+0000","last_peered":"2024-03-30T13:13:25.927271+0000","last_clean":"2024-03-30T13:13:25.927271+0000","last_became_active":"2024-03-30T13:13:23.908014+0000","last_became_peered":"2024-03-30T13:13:23.908014+0000","last_unstale":"2024-03-30T13:13:25.927271+0000","last_undegraded":"2024-03-30T13:13:25.927271+0000","last_fullsized":"2024-03-30T13:13:25.927271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:29:03.705190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936075+0000","last_change":"2024-03-30T13:13:24.943618+0000","last_active":"2024-03-30T13:13:25.936075+0000","last_peered":"2024-03-30T13:13:25.936075+0000","last_clean":"2024-03-30T13:13:25.936075+0000","last_became_active":"2024-03-30T13:13:24.943319+0000","last_became_peered":"2024-03-30T13:13:24.943319+0000","last_unstale":"2024-03-30T13:13:25.936075+0000","last_undegraded":"2024-03-30T13:13:25.936075+0000","last_fullsized":"2024-03-30T13:13:25.936075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:59.300554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.934155+0000","last_change":"2024-03-30T13:13:23.913050+0000","last_active":"2024-03-30T13:13:25.934155+0000","last_peered":"2024-03-30T13:13:25.934155+0000","last_clean":"2024-03-30T13:13:25.934155+0000","last_became_active":"2024-03-30T13:13:23.910147+0000","last_became_peered":"2024-03-30T13:13:23.910147+0000","last_unstale":"2024-03-30T13:13:25.934155+0000","last_undegraded":"2024-03-30T13:13:25.934155+0000","last_fullsized":"2024-03-30T13:13:25.934155+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:38:48.002802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312882+0000","last_change":"2024-03-30T13:13:24.923947+0000","last_active":"2024-03-30T13:13:26.312882+0000","last_peered":"2024-03-30T13:13:26.312882+0000","last_clean":"2024-03-30T13:13:26.312882+0000","last_became_active":"2024-03-30T13:13:24.923452+0000","last_became_peered":"2024-03-30T13:13:24.923452+0000","last_unstale":"2024-03-30T13:13:26.312882+0000","last_undegraded":"2024-03-30T13:13:26.312882+0000","last_fullsized":"2024-03-30T13:13:26.312882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:56:26.254760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927062+0000","last_change":"2024-03-30T13:13:23.906042+0000","last_active":"2024-03-30T13:13:25.927062+0000","last_peered":"2024-03-30T13:13:25.927062+0000","last_clean":"2024-03-30T13:13:25.927062+0000","last_became_active":"2024-03-30T13:13:23.905731+0000","last_became_peered":"2024-03-30T13:13:23.905731+0000","last_unstale":"2024-03-30T13:13:25.927062+0000","last_undegraded":"2024-03-30T13:13:25.927062+0000","last_fullsized":"2024-03-30T13:13:25.927062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:21:24.535622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559038+0000","last_change":"2024-03-30T13:13:24.945544+0000","last_active":"2024-03-30T13:13:26.559038+0000","last_peered":"2024-03-30T13:13:26.559038+0000","last_clean":"2024-03-30T13:13:26.559038+0000","last_became_active":"2024-03-30T13:13:24.945246+0000","last_became_peered":"2024-03-30T13:13:24.945246+0000","last_unstale":"2024-03-30T13:13:26.559038+0000","last_undegraded":"2024-03-30T13:13:26.559038+0000","last_fullsized":"2024-03-30T13:13:26.559038+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:27:16.659922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.938015+0000","last_change":"2024-03-30T13:13:23.906657+0000","last_active":"2024-03-30T13:13:25.938015+0000","last_peered":"2024-03-30T13:13:25.938015+0000","last_clean":"2024-03-30T13:13:25.938015+0000","last_became_active":"2024-03-30T13:13:23.906356+0000","last_became_peered":"2024-03-30T13:13:23.906356+0000","last_unstale":"2024-03-30T13:13:25.938015+0000","last_undegraded":"2024-03-30T13:13:25.938015+0000","last_fullsized":"2024-03-30T13:13:25.938015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:27:00.100392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935866+0000","last_change":"2024-03-30T13:13:24.925860+0000","last_active":"2024-03-30T13:13:25.935866+0000","last_peered":"2024-03-30T13:13:25.935866+0000","last_clean":"2024-03-30T13:13:25.935866+0000","last_became_active":"2024-03-30T13:13:24.923570+0000","last_became_peered":"2024-03-30T13:13:24.923570+0000","last_unstale":"2024-03-30T13:13:25.935866+0000","last_undegraded":"2024-03-30T13:13:25.935866+0000","last_fullsized":"2024-03-30T13:13:25.935866+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:05.103106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.944800+0000","last_change":"2024-03-30T13:13:23.911792+0000","last_active":"2024-03-30T13:13:25.944800+0000","last_peered":"2024-03-30T13:13:25.944800+0000","last_clean":"2024-03-30T13:13:25.944800+0000","last_became_active":"2024-03-30T13:13:23.911449+0000","last_became_peered":"2024-03-30T13:13:23.911449+0000","last_unstale":"2024-03-30T13:13:25.944800+0000","last_undegraded":"2024-03-30T13:13:25.944800+0000","last_fullsized":"2024-03-30T13:13:25.944800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:27:29.816936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313272+0000","last_change":"2024-03-30T13:13:24.930626+0000","last_active":"2024-03-30T13:13:26.313272+0000","last_peered":"2024-03-30T13:13:26.313272+0000","last_clean":"2024-03-30T13:13:26.313272+0000","last_became_active":"2024-03-30T13:13:24.930269+0000","last_became_peered":"2024-03-30T13:13:24.930269+0000","last_unstale":"2024-03-30T13:13:26.313272+0000","last_undegraded":"2024-03-30T13:13:26.313272+0000","last_fullsized":"2024-03-30T13:13:26.313272+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:39:59.822381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560471+0000","last_change":"2024-03-30T13:13:23.901415+0000","last_active":"2024-03-30T13:13:26.560471+0000","last_peered":"2024-03-30T13:13:26.560471+0000","last_clean":"2024-03-30T13:13:26.560471+0000","last_became_active":"2024-03-30T13:13:23.900935+0000","last_became_peered":"2024-03-30T13:13:23.900935+0000","last_unstale":"2024-03-30T13:13:26.560471+0000","last_undegraded":"2024-03-30T13:13:26.560471+0000","last_fullsized":"2024-03-30T13:13:26.560471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:13:03.451305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559860+0000","last_change":"2024-03-30T13:13:24.929852+0000","last_active":"2024-03-30T13:13:26.559860+0000","last_peered":"2024-03-30T13:13:26.559860+0000","last_clean":"2024-03-30T13:13:26.559860+0000","last_became_active":"2024-03-30T13:13:24.929560+0000","last_became_peered":"2024-03-30T13:13:24.929560+0000","last_unstale":"2024-03-30T13:13:26.559860+0000","last_undegraded":"2024-03-30T13:13:26.559860+0000","last_fullsized":"2024-03-30T13:13:26.559860+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:19:14.766849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560586+0000","last_change":"2024-03-30T13:13:23.907243+0000","last_active":"2024-03-30T13:13:26.560586+0000","last_peered":"2024-03-30T13:13:26.560586+0000","last_clean":"2024-03-30T13:13:26.560586+0000","last_became_active":"2024-03-30T13:13:23.906998+0000","last_became_peered":"2024-03-30T13:13:23.906998+0000","last_unstale":"2024-03-30T13:13:26.560586+0000","last_undegraded":"2024-03-30T13:13:26.560586+0000","last_fullsized":"2024-03-30T13:13:26.560586+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:14:03.970356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558398+0000","last_change":"2024-03-30T13:13:24.927802+0000","last_active":"2024-03-30T13:13:26.558398+0000","last_peered":"2024-03-30T13:13:26.558398+0000","last_clean":"2024-03-30T13:13:26.558398+0000","last_became_active":"2024-03-30T13:13:24.926782+0000","last_became_peered":"2024-03-30T13:13:24.926782+0000","last_unstale":"2024-03-30T13:13:26.558398+0000","last_undegraded":"2024-03-30T13:13:26.558398+0000","last_fullsized":"2024-03-30T13:13:26.558398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:45.193052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560258+0000","last_change":"2024-03-30T13:13:23.912742+0000","last_active":"2024-03-30T13:13:26.560258+0000","last_peered":"2024-03-30T13:13:26.560258+0000","last_clean":"2024-03-30T13:13:26.560258+0000","last_became_active":"2024-03-30T13:13:23.912393+0000","last_became_peered":"2024-03-30T13:13:23.912393+0000","last_unstale":"2024-03-30T13:13:26.560258+0000","last_undegraded":"2024-03-30T13:13:26.560258+0000","last_fullsized":"2024-03-30T13:13:26.560258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:13:54.728572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558891+0000","last_change":"2024-03-30T13:13:24.932828+0000","last_active":"2024-03-30T13:13:26.558891+0000","last_peered":"2024-03-30T13:13:26.558891+0000","last_clean":"2024-03-30T13:13:26.558891+0000","last_became_active":"2024-03-30T13:13:24.931315+0000","last_became_peered":"2024-03-30T13:13:24.931315+0000","last_unstale":"2024-03-30T13:13:26.558891+0000","last_undegraded":"2024-03-30T13:13:26.558891+0000","last_fullsized":"2024-03-30T13:13:26.558891+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:34:06.451438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.557958+0000","last_change":"2024-03-30T13:13:23.914082+0000","last_active":"2024-03-30T13:13:26.557958+0000","last_peered":"2024-03-30T13:13:26.557958+0000","last_clean":"2024-03-30T13:13:26.557958+0000","last_became_active":"2024-03-30T13:13:23.911673+0000","last_became_peered":"2024-03-30T13:13:23.911673+0000","last_unstale":"2024-03-30T13:13:26.557958+0000","last_undegraded":"2024-03-30T13:13:26.557958+0000","last_fullsized":"2024-03-30T13:13:26.557958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:26:33.267469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935443+0000","last_change":"2024-03-30T13:13:24.921325+0000","last_active":"2024-03-30T13:13:25.935443+0000","last_peered":"2024-03-30T13:13:25.935443+0000","last_clean":"2024-03-30T13:13:25.935443+0000","last_became_active":"2024-03-30T13:13:24.920741+0000","last_became_peered":"2024-03-30T13:13:24.920741+0000","last_unstale":"2024-03-30T13:13:25.935443+0000","last_undegraded":"2024-03-30T13:13:25.935443+0000","last_fullsized":"2024-03-30T13:13:25.935443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:06.544052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312345+0000","last_change":"2024-03-30T13:13:23.904883+0000","last_active":"2024-03-30T13:13:26.312345+0000","last_peered":"2024-03-30T13:13:26.312345+0000","last_clean":"2024-03-30T13:13:26.312345+0000","last_became_active":"2024-03-30T13:13:23.904444+0000","last_became_peered":"2024-03-30T13:13:23.904444+0000","last_unstale":"2024-03-30T13:13:26.312345+0000","last_undegraded":"2024-03-30T13:13:26.312345+0000","last_fullsized":"2024-03-30T13:13:26.312345+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:01:36.937575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937189+0000","last_change":"2024-03-30T13:13:24.947600+0000","last_active":"2024-03-30T13:13:25.937189+0000","last_peered":"2024-03-30T13:13:25.937189+0000","last_clean":"2024-03-30T13:13:25.937189+0000","last_became_active":"2024-03-30T13:13:24.947367+0000","last_became_peered":"2024-03-30T13:13:24.947367+0000","last_unstale":"2024-03-30T13:13:25.937189+0000","last_undegraded":"2024-03-30T13:13:25.937189+0000","last_fullsized":"2024-03-30T13:13:25.937189+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:19.282770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935829+0000","last_change":"2024-03-30T13:13:23.901342+0000","last_active":"2024-03-30T13:13:25.935829+0000","last_peered":"2024-03-30T13:13:25.935829+0000","last_clean":"2024-03-30T13:13:25.935829+0000","last_became_active":"2024-03-30T13:13:23.901013+0000","last_became_peered":"2024-03-30T13:13:23.901013+0000","last_unstale":"2024-03-30T13:13:25.935829+0000","last_undegraded":"2024-03-30T13:13:25.935829+0000","last_fullsized":"2024-03-30T13:13:25.935829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:28:46.608054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":206,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.932993+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:13:25.932993+0000","last_peered":"2024-03-30T13:13:25.932993+0000","last_clean":"2024-03-30T13:13:25.932993+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:13:25.932993+0000","last_undegraded":"2024-03-30T13:13:25.932993+0000","last_fullsized":"2024-03-30T13:13:25.932993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":792703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":200765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":202299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":200743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":791055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":200723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:13:30.481 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-30T13:13:30.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.726+0000 7fcf0a200640 1 Processor -- start 2024-03-30T13:13:30.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.727+0000 7fcf0a200640 1 -- start start 2024-03-30T13:13:30.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.728+0000 7fcf0a200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040d0d30 0x7fcf040cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.728+0000 7fcf0a200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf040b5b60 con 0x7fcf04161e70 2024-03-30T13:13:30.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.728+0000 7fcf0a200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf040d4fc0 con 0x7fcf040d4950 2024-03-30T13:13:30.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.728+0000 7fcf0a200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcf040c7b90 con 0x7fcf040d0d30 2024-03-30T13:13:30.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.728+0000 7fcf09800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcf04161e70 0x7fcf040b3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54060/0 (socket says 172.21.15.44:54060) 2024-03-30T13:13:30.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.728+0000 7fcf09800640 1 -- 172.21.15.44:0/4175806677 learned_addr learned my addr 172.21.15.44:0/4175806677 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.729+0000 7fcf08e00640 1 --2- 172.21.15.44:0/4175806677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040d0d30 0x7fcf040cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.729+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2061984395 0 0) 0x7fcf040b5b60 con 0x7fcf04161e70 2024-03-30T13:13:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.729+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fceec003520 con 0x7fcf04161e70 2024-03-30T13:13:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.729+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1108360876 0 0) 0x7fceec003520 con 0x7fcf04161e70 2024-03-30T13:13:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.729+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040d0d30 msgr2=0x7fcf040cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.729+0000 7fcf03400640 1 --2- 172.21.15.44:0/4175806677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040d0d30 0x7fcf040cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.729+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 >> v1:172.21.15.151:6789/0 conn(0x7fcf040d4950 legacy=0x7fcf04161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf040b57f0 con 0x7fcf04161e70 2024-03-30T13:13:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fcefc0019f0 con 0x7fcf04161e70 2024-03-30T13:13:30.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 >> v1:172.21.15.44:6789/0 conn(0x7fcf04161e70 legacy=0x7fcf040b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:30.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf03400640 1 --2- 172.21.15.44:0/4175806677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fceec0039e0 0x7fceec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf03400640 1 --2- 172.21.15.44:0/4175806677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fceec004800 0x7fceec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf03400640 1 --2- 172.21.15.44:0/4175806677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040d0d30 0x7fceec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcf040c7b90 con 0x7fceec004800 2024-03-30T13:13:30.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fceec00bb00 con 0x7fceec0039e0 2024-03-30T13:13:30.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fceec00bd00 con 0x7fcf040d0d30 2024-03-30T13:13:30.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf03e00640 1 --2- 172.21.15.44:0/4175806677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fceec004800 0x7fceec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf08e00640 1 --2- 172.21.15.44:0/4175806677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fceec0039e0 0x7fceec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf09800640 1 --2- 172.21.15.44:0/4175806677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040d0d30 0x7fceec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.730+0000 7fcf03e00640 1 -- 172.21.15.44:0/4175806677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040d0d30 msgr2=0x7fceec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:30.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.731+0000 7fcf03e00640 1 --2- 172.21.15.44:0/4175806677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040d0d30 0x7fceec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.731+0000 7fcf03e00640 1 -- 172.21.15.44:0/4175806677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fceec0039e0 msgr2=0x7fceec003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:30.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.731+0000 7fcf03e00640 1 --2- 172.21.15.44:0/4175806677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fceec0039e0 0x7fceec003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.731+0000 7fcf03e00640 1 -- 172.21.15.44:0/4175806677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec003520 con 0x7fceec004800 2024-03-30T13:13:30.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.732+0000 7fcf03e00640 1 --2- 172.21.15.44:0/4175806677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fceec004800 0x7fceec004c80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcf040d4d70 tx=0x7fceec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b395822b6b5723 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:30.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.732+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef0001370 con 0x7fceec004800 2024-03-30T13:13:30.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.732+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef00052d0 con 0x7fceec004800 2024-03-30T13:13:30.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.732+0000 7fcf03400640 1 -- 172.21.15.44:0/4175806677 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef0003830 con 0x7fceec004800 2024-03-30T13:13:30.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.733+0000 7fcf0a200640 1 -- 172.21.15.44:0/4175806677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fceec004800 msgr2=0x7fceec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:30.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.733+0000 7fcf0a200640 1 --2- 172.21.15.44:0/4175806677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fceec004800 0x7fceec004c80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcf040d4d70 tx=0x7fceec005830 comp rx=0 tx=0).stop 2024-03-30T13:13:30.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.733+0000 7fcf09800640 1 -- 172.21.15.44:0/4175806677 reap_dead start 2024-03-30T13:13:30.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.733+0000 7fcf0a200640 1 -- 172.21.15.44:0/4175806677 shutdown_connections 2024-03-30T13:13:30.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.733+0000 7fcf0a200640 1 -- 172.21.15.44:0/4175806677 >> 172.21.15.44:0/4175806677 conn(0x7fcf0409d570 msgr2=0x7fcf040d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:30.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.733+0000 7fcf0a200640 1 -- 172.21.15.44:0/4175806677 shutdown_connections 2024-03-30T13:13:30.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.733+0000 7fcf0a200640 1 -- 172.21.15.44:0/4175806677 wait complete. 2024-03-30T13:13:30.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.735+0000 7fcf0a200640 1 Processor -- start 2024-03-30T13:13:30.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.735+0000 7fcf0a200640 1 -- start start 2024-03-30T13:13:30.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.736+0000 7fcf0a200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fceec004800 0x7fcf040b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.736+0000 7fcf0a200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040b9a90 0x7fcf041526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.736+0000 7fcf0a200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040c86d0 0x7fcf040b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.736+0000 7fcf0a200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcf040d1290 con 0x7fcf040b9a90 2024-03-30T13:13:30.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.736+0000 7fcf0a200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcf040d1110 con 0x7fceec004800 2024-03-30T13:13:30.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.736+0000 7fcf0a200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcf040d1410 con 0x7fcf040c86d0 2024-03-30T13:13:30.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.736+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040b9a90 0x7fcf041526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.736+0000 7fcf03e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040b9a90 0x7fcf041526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39324/0 (socket says 172.21.15.44:39324) 2024-03-30T13:13:30.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.736+0000 7fcf03e00640 1 -- 172.21.15.44:0/1093221425 learned_addr learned my addr 172.21.15.44:0/1093221425 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:30.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf08e00640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fceec004800 0x7fcf040b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf09800640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040c86d0 0x7fcf040b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf03e00640 1 -- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040c86d0 msgr2=0x7fcf040b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:30.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf03e00640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040c86d0 0x7fcf040b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf03e00640 1 -- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fceec004800 msgr2=0x7fcf040b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:30.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf03e00640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fceec004800 0x7fcf040b7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:30.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf03e00640 1 -- 172.21.15.44:0/1093221425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf04152c00 con 0x7fcf040b9a90 2024-03-30T13:13:30.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf09800640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040c86d0 0x7fcf040b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:30.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf03e00640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040b9a90 0x7fcf041526c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fcef0001810 tx=0x7fcef0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:30.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf00c00640 1 -- 172.21.15.44:0/1093221425 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef0041070 con 0x7fcf040b9a90 2024-03-30T13:13:30.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf00c00640 1 -- 172.21.15.44:0/1093221425 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef0005480 con 0x7fcf040b9a90 2024-03-30T13:13:30.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf00c00640 1 -- 172.21.15.44:0/1093221425 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef0007a30 con 0x7fcf040b9a90 2024-03-30T13:13:30.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.737+0000 7fcf0a200640 1 -- 172.21.15.44:0/1093221425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf040b6ef0 con 0x7fcf040b9a90 2024-03-30T13:13:30.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.738+0000 7fcf0a200640 1 -- 172.21.15.44:0/1093221425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf040b7470 con 0x7fcf040b9a90 2024-03-30T13:13:30.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.739+0000 7fcf0a200640 1 -- 172.21.15.44:0/1093221425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf04075890 con 0x7fcf040b9a90 2024-03-30T13:13:30.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.740+0000 7fcf00c00640 1 -- 172.21.15.44:0/1093221425 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcef0044070 con 0x7fcf040b9a90 2024-03-30T13:13:30.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.741+0000 7fcf00c00640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcee406c560 0x7fcee406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:30.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.741+0000 7fcf00c00640 1 -- 172.21.15.44:0/1093221425 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fcef00ad2c0 con 0x7fcf040b9a90 2024-03-30T13:13:30.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.741+0000 7fcf08e00640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcee406c560 0x7fcee406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:30.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.743+0000 7fcf08e00640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcee406c560 0x7fcee406ea20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009a10 tx=0x7fcef8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:30.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:30.746+0000 7fcf00c00640 1 -- 172.21.15.44:0/1093221425 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fcf04152c00 con 0x7fcf040b9a90 2024-03-30T13:13:31.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.033+0000 7fcf0a200640 1 -- 172.21.15.44:0/1093221425 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fcf040d4370 con 0x7fcf040b9a90 2024-03-30T13:13:31.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.033+0000 7fcf00c00640 1 -- 172.21.15.44:0/1093221425 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1013 (secure 0 0 0) 0x7fcef00052a0 con 0x7fcf040b9a90 2024-03-30T13:13:31.038 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:31.038 INFO:teuthology.orchestra.run.smithi044.stdout:{"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":130,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1711804292,"num_in_osds":8,"osd_in_since":1711804284,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":226361344,"bytes_avail":772867751936,"bytes_total":773094113280,"write_bytes_sec":2345,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5298}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-03-30T13:12:45.974179+0000","services":{}},"progress_events":{}} 2024-03-30T13:13:31.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.036+0000 7fcf0a200640 1 -- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcee406c560 msgr2=0x7fcee406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.036+0000 7fcf0a200640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcee406c560 0x7fcee406ea20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009a10 tx=0x7fcef8008040 comp rx=0 tx=0).stop 2024-03-30T13:13:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.036+0000 7fcf0a200640 1 -- 172.21.15.44:0/1093221425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040b9a90 msgr2=0x7fcf041526c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.036+0000 7fcf0a200640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040b9a90 0x7fcf041526c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fcef0001810 tx=0x7fcef0001120 comp rx=0 tx=0).stop 2024-03-30T13:13:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.036+0000 7fcf0a200640 1 -- 172.21.15.44:0/1093221425 shutdown_connections 2024-03-30T13:13:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.036+0000 7fcf0a200640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf040c86d0 0x7fcf040b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.036+0000 7fcf0a200640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcf040b9a90 0x7fcf041526c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.036+0000 7fcf0a200640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcee406c560 0x7fcee406ea20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.036+0000 7fcf0a200640 1 --2- 172.21.15.44:0/1093221425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fceec004800 0x7fcf040b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.036+0000 7fcf0a200640 1 -- 172.21.15.44:0/1093221425 >> 172.21.15.44:0/1093221425 conn(0x7fcf0409d570 msgr2=0x7fcf0406c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.036+0000 7fcf0a200640 1 -- 172.21.15.44:0/1093221425 shutdown_connections 2024-03-30T13:13:31.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.036+0000 7fcf0a200640 1 -- 172.21.15.44:0/1093221425 wait complete. 2024-03-30T13:13:31.058 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-30T13:13:31.058 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:13:31.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.266+0000 7f3a67200640 1 Processor -- start 2024-03-30T13:13:31.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.266+0000 7f3a67200640 1 -- start start 2024-03-30T13:13:31.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.267+0000 7f3a67200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a681562f0 0x7f3a681566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:31.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.267+0000 7f3a67200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3a680d09a0 0x7f3a6815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:31.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.267+0000 7f3a67200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a68160c20 con 0x7f3a68142300 2024-03-30T13:13:31.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.267+0000 7f3a67200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f3a68156c10 con 0x7f3a681562f0 2024-03-30T13:13:31.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.267+0000 7f3a67200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f3a681600a0 con 0x7f3a680d09a0 2024-03-30T13:13:31.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.268+0000 7f3a65e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f3a681562f0 0x7f3a681566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:31.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.268+0000 7f3a5fe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f3a68142300 0x7f3a680d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54074/0 (socket says 172.21.15.44:54074) 2024-03-30T13:13:31.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.268+0000 7f3a5fe00640 1 -- 172.21.15.44:0/3350981838 learned_addr learned my addr 172.21.15.44:0/3350981838 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:31.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.268+0000 7f3a66800640 1 --2- 172.21.15.44:0/3350981838 >> v2:172.21.15.151:3300/0 conn(0x7f3a680d09a0 0x7f3a6815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:31.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.268+0000 7f3a65e00640 1 -- 172.21.15.44:0/3350981838 >> v2:172.21.15.151:3300/0 conn(0x7f3a680d09a0 msgr2=0x7f3a6815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:31.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.268+0000 7f3a65e00640 1 --2- 172.21.15.44:0/3350981838 >> v2:172.21.15.151:3300/0 conn(0x7f3a680d09a0 0x7f3a6815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.268+0000 7f3a65e00640 1 -- 172.21.15.44:0/3350981838 >> v1:172.21.15.44:6789/0 conn(0x7f3a68142300 legacy=0x7f3a680d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:31.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.268+0000 7f3a65400640 1 -- 172.21.15.44:0/3350981838 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1299478244 0 0) 0x7f3a68160c20 con 0x7f3a68142300 2024-03-30T13:13:31.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.268+0000 7f3a65e00640 1 -- 172.21.15.44:0/3350981838 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a68160380 con 0x7f3a681562f0 2024-03-30T13:13:31.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.269+0000 7f3a65e00640 1 --2- 172.21.15.44:0/3350981838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a681562f0 0x7f3a681566d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3a680cdd80 tx=0x7f3a5802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2760eaddfbac1b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:31.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.270+0000 7f3a65400640 1 -- 172.21.15.44:0/3350981838 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a580315a0 con 0x7f3a681562f0 2024-03-30T13:13:31.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.270+0000 7f3a65400640 1 -- 172.21.15.44:0/3350981838 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a58037070 con 0x7f3a681562f0 2024-03-30T13:13:31.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.270+0000 7f3a65400640 1 -- 172.21.15.44:0/3350981838 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58031960 con 0x7f3a681562f0 2024-03-30T13:13:31.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.270+0000 7f3a67200640 1 -- 172.21.15.44:0/3350981838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a681562f0 msgr2=0x7f3a681566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:31.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.270+0000 7f3a67200640 1 --2- 172.21.15.44:0/3350981838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a681562f0 0x7f3a681566d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3a680cdd80 tx=0x7f3a5802b840 comp rx=0 tx=0).stop 2024-03-30T13:13:31.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.270+0000 7f3a67200640 1 -- 172.21.15.44:0/3350981838 shutdown_connections 2024-03-30T13:13:31.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.270+0000 7f3a67200640 1 --2- 172.21.15.44:0/3350981838 >> v2:172.21.15.151:3300/0 conn(0x7f3a680d09a0 0x7f3a6815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.270+0000 7f3a67200640 1 --2- 172.21.15.44:0/3350981838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a681562f0 0x7f3a681566d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.270+0000 7f3a67200640 1 -- 172.21.15.44:0/3350981838 >> 172.21.15.44:0/3350981838 conn(0x7f3a6806b9a0 msgr2=0x7f3a6806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:31.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.271+0000 7f3a67200640 1 -- 172.21.15.44:0/3350981838 shutdown_connections 2024-03-30T13:13:31.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.271+0000 7f3a67200640 1 -- 172.21.15.44:0/3350981838 wait complete. 2024-03-30T13:13:31.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.273+0000 7f3a67200640 1 Processor -- start 2024-03-30T13:13:31.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.273+0000 7f3a67200640 1 -- start start 2024-03-30T13:13:31.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a67200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d09a0 0x7f3a680726c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:31.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a67200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a68142300 0x7f3a681550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:31.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a67200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a681562f0 0x7f3a680b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:31.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a67200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68142780 con 0x7f3a680d09a0 2024-03-30T13:13:31.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a67200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3a68160940 con 0x7f3a681562f0 2024-03-30T13:13:31.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a67200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f3a680cca20 con 0x7f3a68142300 2024-03-30T13:13:31.281 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a65e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d09a0 0x7f3a680726c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a65e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d09a0 0x7f3a680726c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39346/0 (socket says 172.21.15.44:39346) 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a65e00640 1 -- 172.21.15.44:0/80777192 learned_addr learned my addr 172.21.15.44:0/80777192 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a5fe00640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a68142300 0x7f3a681550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a66800640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a681562f0 0x7f3a680b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a65e00640 1 -- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a68142300 msgr2=0x7f3a681550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a65e00640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a68142300 0x7f3a681550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a65e00640 1 -- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a681562f0 msgr2=0x7f3a680b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a65e00640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a681562f0 0x7f3a680b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a65e00640 1 -- 172.21.15.44:0/80777192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a680af2a0 con 0x7f3a680d09a0 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.275+0000 7f3a5fe00640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a68142300 0x7f3a681550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.276+0000 7f3a65e00640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d09a0 0x7f3a680726c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009890 tx=0x7f3a580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.276+0000 7f3a5e000640 1 -- 172.21.15.44:0/80777192 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58032640 con 0x7f3a680d09a0 2024-03-30T13:13:31.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.276+0000 7f3a5e000640 1 -- 172.21.15.44:0/80777192 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a58032800 con 0x7f3a680d09a0 2024-03-30T13:13:31.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.276+0000 7f3a5e000640 1 -- 172.21.15.44:0/80777192 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58032bf0 con 0x7f3a680d09a0 2024-03-30T13:13:31.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.276+0000 7f3a67200640 1 -- 172.21.15.44:0/80777192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a680aefc0 con 0x7f3a680d09a0 2024-03-30T13:13:31.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.276+0000 7f3a67200640 1 -- 172.21.15.44:0/80777192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a6815cda0 con 0x7f3a680d09a0 2024-03-30T13:13:31.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.278+0000 7f3a67200640 1 -- 172.21.15.44:0/80777192 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a68075890 con 0x7f3a680d09a0 2024-03-30T13:13:31.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.279+0000 7f3a5e000640 1 -- 172.21.15.44:0/80777192 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3a5804c020 con 0x7f3a680d09a0 2024-03-30T13:13:31.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.280+0000 7f3a5e000640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a4406c530 0x7f3a4406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:31.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.280+0000 7f3a5e000640 1 -- 172.21.15.44:0/80777192 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f3a5802f020 con 0x7f3a680d09a0 2024-03-30T13:13:31.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.281+0000 7f3a5fe00640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a4406c530 0x7f3a4406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:31.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.282+0000 7f3a5fe00640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a4406c530 0x7f3a4406e9f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3a68072c30 tx=0x7f3a50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:31.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.284+0000 7f3a5e000640 1 -- 172.21.15.44:0/80777192 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3a58040070 con 0x7f3a680d09a0 2024-03-30T13:13:31.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.482+0000 7f3a67200640 1 -- 172.21.15.44:0/80777192 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a6806ef60 con 0x7f3a4406c530 2024-03-30T13:13:31.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.501+0000 7f3a5e000640 1 -- 172.21.15.44:0/80777192 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7f3a6806ef60 con 0x7f3a4406c530 2024-03-30T13:13:31.509 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:31.511 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:13:31.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.507+0000 7f3a67200640 1 -- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a4406c530 msgr2=0x7f3a4406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:31.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.507+0000 7f3a67200640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a4406c530 0x7f3a4406e9f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3a68072c30 tx=0x7f3a50009040 comp rx=0 tx=0).stop 2024-03-30T13:13:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.507+0000 7f3a67200640 1 -- 172.21.15.44:0/80777192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d09a0 msgr2=0x7f3a680726c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.507+0000 7f3a67200640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d09a0 0x7f3a680726c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009890 tx=0x7f3a580046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.507+0000 7f3a67200640 1 -- 172.21.15.44:0/80777192 shutdown_connections 2024-03-30T13:13:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.507+0000 7f3a67200640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f3a4406c530 0x7f3a4406e9f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.507+0000 7f3a67200640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a681562f0 0x7f3a680b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.507+0000 7f3a67200640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3a68142300 0x7f3a681550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.507+0000 7f3a67200640 1 --2- 172.21.15.44:0/80777192 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3a680d09a0 0x7f3a680726c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.507+0000 7f3a67200640 1 -- 172.21.15.44:0/80777192 >> 172.21.15.44:0/80777192 conn(0x7f3a6806b9a0 msgr2=0x7f3a680b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.507+0000 7f3a67200640 1 -- 172.21.15.44:0/80777192 shutdown_connections 2024-03-30T13:13:31.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:31.507+0000 7f3a67200640 1 -- 172.21.15.44:0/80777192 wait complete. 2024-03-30T13:13:31.533 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-03-30T13:13:29.990420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221056,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753664,"statfs":{"total":773094113280,"available":772867751936,"internally_reserved":0,"allocated":4988928,"data_stored":2790780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.113395"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313177+0000","last_change":"2024-03-30T13:13:24.933366+0000","last_active":"2024-03-30T13:13:26.313177+0000","last_peered":"2024-03-30T13:13:26.313177+0000","last_clean":"2024-03-30T13:13:26.313177+0000","last_became_active":"2024-03-30T13:13:24.933098+0000","last_became_peered":"2024-03-30T13:13:24.933098+0000","last_unstale":"2024-03-30T13:13:26.313177+0000","last_undegraded":"2024-03-30T13:13:26.313177+0000","last_fullsized":"2024-03-30T13:13:26.313177+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:50.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313100+0000","last_change":"2024-03-30T13:13:24.939484+0000","last_active":"2024-03-30T13:13:26.313100+0000","last_peered":"2024-03-30T13:13:26.313100+0000","last_clean":"2024-03-30T13:13:26.313100+0000","last_became_active":"2024-03-30T13:13:24.939204+0000","last_became_peered":"2024-03-30T13:13:24.939204+0000","last_unstale":"2024-03-30T13:13:26.313100+0000","last_undegraded":"2024-03-30T13:13:26.313100+0000","last_fullsized":"2024-03-30T13:13:26.313100+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:39.867975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560860+0000","last_change":"2024-03-30T13:13:24.932690+0000","last_active":"2024-03-30T13:13:26.560860+0000","last_peered":"2024-03-30T13:13:26.560860+0000","last_clean":"2024-03-30T13:13:26.560860+0000","last_became_active":"2024-03-30T13:13:24.932364+0000","last_became_peered":"2024-03-30T13:13:24.932364+0000","last_unstale":"2024-03-30T13:13:26.560860+0000","last_undegraded":"2024-03-30T13:13:26.560860+0000","last_fullsized":"2024-03-30T13:13:26.560860+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:14:38.399564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927384+0000","last_change":"2024-03-30T13:13:24.947993+0000","last_active":"2024-03-30T13:13:25.927384+0000","last_peered":"2024-03-30T13:13:25.927384+0000","last_clean":"2024-03-30T13:13:25.927384+0000","last_became_active":"2024-03-30T13:13:24.947711+0000","last_became_peered":"2024-03-30T13:13:24.947711+0000","last_unstale":"2024-03-30T13:13:25.927384+0000","last_undegraded":"2024-03-30T13:13:25.927384+0000","last_fullsized":"2024-03-30T13:13:25.927384+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:12:19.243241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927408+0000","last_change":"2024-03-30T13:13:24.937291+0000","last_active":"2024-03-30T13:13:25.927408+0000","last_peered":"2024-03-30T13:13:25.927408+0000","last_clean":"2024-03-30T13:13:25.927408+0000","last_became_active":"2024-03-30T13:13:24.936746+0000","last_became_peered":"2024-03-30T13:13:24.936746+0000","last_unstale":"2024-03-30T13:13:25.927408+0000","last_undegraded":"2024-03-30T13:13:25.927408+0000","last_fullsized":"2024-03-30T13:13:25.927408+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:43:13.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558422+0000","last_change":"2024-03-30T13:13:24.930014+0000","last_active":"2024-03-30T13:13:26.558422+0000","last_peered":"2024-03-30T13:13:26.558422+0000","last_clean":"2024-03-30T13:13:26.558422+0000","last_became_active":"2024-03-30T13:13:24.929670+0000","last_became_peered":"2024-03-30T13:13:24.929670+0000","last_unstale":"2024-03-30T13:13:26.558422+0000","last_undegraded":"2024-03-30T13:13:26.558422+0000","last_fullsized":"2024-03-30T13:13:26.558422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:29:34.921944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.933762+0000","last_change":"2024-03-30T13:13:24.940932+0000","last_active":"2024-03-30T13:13:25.933762+0000","last_peered":"2024-03-30T13:13:25.933762+0000","last_clean":"2024-03-30T13:13:25.933762+0000","last_became_active":"2024-03-30T13:13:24.940655+0000","last_became_peered":"2024-03-30T13:13:24.940655+0000","last_unstale":"2024-03-30T13:13:25.933762+0000","last_undegraded":"2024-03-30T13:13:25.933762+0000","last_fullsized":"2024-03-30T13:13:25.933762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:06.544052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312364+0000","last_change":"2024-03-30T13:13:24.945794+0000","last_active":"2024-03-30T13:13:26.312364+0000","last_peered":"2024-03-30T13:13:26.312364+0000","last_clean":"2024-03-30T13:13:26.312364+0000","last_became_active":"2024-03-30T13:13:24.945398+0000","last_became_peered":"2024-03-30T13:13:24.945398+0000","last_unstale":"2024-03-30T13:13:26.312364+0000","last_undegraded":"2024-03-30T13:13:26.312364+0000","last_fullsized":"2024-03-30T13:13:26.312364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:48.857782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.561166+0000","last_change":"2024-03-30T13:13:24.942052+0000","last_active":"2024-03-30T13:13:26.561166+0000","last_peered":"2024-03-30T13:13:26.561166+0000","last_clean":"2024-03-30T13:13:26.561166+0000","last_became_active":"2024-03-30T13:13:24.941161+0000","last_became_peered":"2024-03-30T13:13:24.941161+0000","last_unstale":"2024-03-30T13:13:26.561166+0000","last_undegraded":"2024-03-30T13:13:26.561166+0000","last_fullsized":"2024-03-30T13:13:26.561166+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:25:48.336489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937550+0000","last_change":"2024-03-30T13:13:24.936995+0000","last_active":"2024-03-30T13:13:25.937550+0000","last_peered":"2024-03-30T13:13:25.937550+0000","last_clean":"2024-03-30T13:13:25.937550+0000","last_became_active":"2024-03-30T13:13:24.936724+0000","last_became_peered":"2024-03-30T13:13:24.936724+0000","last_unstale":"2024-03-30T13:13:25.937550+0000","last_undegraded":"2024-03-30T13:13:25.937550+0000","last_fullsized":"2024-03-30T13:13:25.937550+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:05.845450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935947+0000","last_change":"2024-03-30T13:13:24.937824+0000","last_active":"2024-03-30T13:13:25.935947+0000","last_peered":"2024-03-30T13:13:25.935947+0000","last_clean":"2024-03-30T13:13:25.935947+0000","last_became_active":"2024-03-30T13:13:24.937424+0000","last_became_peered":"2024-03-30T13:13:24.937424+0000","last_unstale":"2024-03-30T13:13:25.935947+0000","last_undegraded":"2024-03-30T13:13:25.935947+0000","last_fullsized":"2024-03-30T13:13:25.935947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:01.919458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560837+0000","last_change":"2024-03-30T13:13:24.951191+0000","last_active":"2024-03-30T13:13:26.560837+0000","last_peered":"2024-03-30T13:13:26.560837+0000","last_clean":"2024-03-30T13:13:26.560837+0000","last_became_active":"2024-03-30T13:13:24.950840+0000","last_became_peered":"2024-03-30T13:13:24.950840+0000","last_unstale":"2024-03-30T13:13:26.560837+0000","last_undegraded":"2024-03-30T13:13:26.560837+0000","last_fullsized":"2024-03-30T13:13:26.560837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:32:37.703237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935965+0000","last_change":"2024-03-30T13:13:24.933576+0000","last_active":"2024-03-30T13:13:25.935965+0000","last_peered":"2024-03-30T13:13:25.935965+0000","last_clean":"2024-03-30T13:13:25.935965+0000","last_became_active":"2024-03-30T13:13:24.933261+0000","last_became_peered":"2024-03-30T13:13:24.933261+0000","last_unstale":"2024-03-30T13:13:25.935965+0000","last_undegraded":"2024-03-30T13:13:25.935965+0000","last_fullsized":"2024-03-30T13:13:25.935965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:16:27.204486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558241+0000","last_change":"2024-03-30T13:13:24.925051+0000","last_active":"2024-03-30T13:13:26.558241+0000","last_peered":"2024-03-30T13:13:26.558241+0000","last_clean":"2024-03-30T13:13:26.558241+0000","last_became_active":"2024-03-30T13:13:24.924651+0000","last_became_peered":"2024-03-30T13:13:24.924651+0000","last_unstale":"2024-03-30T13:13:26.558241+0000","last_undegraded":"2024-03-30T13:13:26.558241+0000","last_fullsized":"2024-03-30T13:13:26.558241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:11:49.156277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.934166+0000","last_change":"2024-03-30T13:13:24.946201+0000","last_active":"2024-03-30T13:13:25.934166+0000","last_peered":"2024-03-30T13:13:25.934166+0000","last_clean":"2024-03-30T13:13:25.934166+0000","last_became_active":"2024-03-30T13:13:24.945720+0000","last_became_peered":"2024-03-30T13:13:24.945720+0000","last_unstale":"2024-03-30T13:13:25.934166+0000","last_undegraded":"2024-03-30T13:13:25.934166+0000","last_fullsized":"2024-03-30T13:13:25.934166+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:46:37.184683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.932773+0000","last_change":"2024-03-30T13:13:24.939447+0000","last_active":"2024-03-30T13:13:25.932773+0000","last_peered":"2024-03-30T13:13:25.932773+0000","last_clean":"2024-03-30T13:13:25.932773+0000","last_became_active":"2024-03-30T13:13:24.939130+0000","last_became_peered":"2024-03-30T13:13:24.939130+0000","last_unstale":"2024-03-30T13:13:25.932773+0000","last_undegraded":"2024-03-30T13:13:25.932773+0000","last_fullsized":"2024-03-30T13:13:25.932773+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:42:41.962873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937559+0000","last_change":"2024-03-30T13:13:24.940595+0000","last_active":"2024-03-30T13:13:25.937559+0000","last_peered":"2024-03-30T13:13:25.937559+0000","last_clean":"2024-03-30T13:13:25.937559+0000","last_became_active":"2024-03-30T13:13:24.940303+0000","last_became_peered":"2024-03-30T13:13:24.940303+0000","last_unstale":"2024-03-30T13:13:25.937559+0000","last_undegraded":"2024-03-30T13:13:25.937559+0000","last_fullsized":"2024-03-30T13:13:25.937559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:01.919458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.561038+0000","last_change":"2024-03-30T13:13:24.936819+0000","last_active":"2024-03-30T13:13:26.561038+0000","last_peered":"2024-03-30T13:13:26.561038+0000","last_clean":"2024-03-30T13:13:26.561038+0000","last_became_active":"2024-03-30T13:13:24.936416+0000","last_became_peered":"2024-03-30T13:13:24.936416+0000","last_unstale":"2024-03-30T13:13:26.561038+0000","last_undegraded":"2024-03-30T13:13:26.561038+0000","last_fullsized":"2024-03-30T13:13:26.561038+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:28:45.868296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927823+0000","last_change":"2024-03-30T13:13:24.944867+0000","last_active":"2024-03-30T13:13:25.927823+0000","last_peered":"2024-03-30T13:13:25.927823+0000","last_clean":"2024-03-30T13:13:25.927823+0000","last_became_active":"2024-03-30T13:13:24.944515+0000","last_became_peered":"2024-03-30T13:13:24.944515+0000","last_unstale":"2024-03-30T13:13:25.927823+0000","last_undegraded":"2024-03-30T13:13:25.927823+0000","last_fullsized":"2024-03-30T13:13:25.927823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:11.845513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560908+0000","last_change":"2024-03-30T13:13:24.932873+0000","last_active":"2024-03-30T13:13:26.560908+0000","last_peered":"2024-03-30T13:13:26.560908+0000","last_clean":"2024-03-30T13:13:26.560908+0000","last_became_active":"2024-03-30T13:13:24.932568+0000","last_became_peered":"2024-03-30T13:13:24.932568+0000","last_unstale":"2024-03-30T13:13:26.560908+0000","last_undegraded":"2024-03-30T13:13:26.560908+0000","last_fullsized":"2024-03-30T13:13:26.560908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:29.827966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936484+0000","last_change":"2024-03-30T13:13:24.941578+0000","last_active":"2024-03-30T13:13:25.936484+0000","last_peered":"2024-03-30T13:13:25.936484+0000","last_clean":"2024-03-30T13:13:25.936484+0000","last_became_active":"2024-03-30T13:13:24.941271+0000","last_became_peered":"2024-03-30T13:13:24.941271+0000","last_unstale":"2024-03-30T13:13:25.936484+0000","last_undegraded":"2024-03-30T13:13:25.936484+0000","last_fullsized":"2024-03-30T13:13:25.936484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:43.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559662+0000","last_change":"2024-03-30T13:13:24.950241+0000","last_active":"2024-03-30T13:13:26.559662+0000","last_peered":"2024-03-30T13:13:26.559662+0000","last_clean":"2024-03-30T13:13:26.559662+0000","last_became_active":"2024-03-30T13:13:24.949773+0000","last_became_peered":"2024-03-30T13:13:24.949773+0000","last_unstale":"2024-03-30T13:13:26.559662+0000","last_undegraded":"2024-03-30T13:13:26.559662+0000","last_fullsized":"2024-03-30T13:13:26.559662+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:29:34.921944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.932979+0000","last_change":"2024-03-30T13:13:24.949377+0000","last_active":"2024-03-30T13:13:25.932979+0000","last_peered":"2024-03-30T13:13:25.932979+0000","last_clean":"2024-03-30T13:13:25.932979+0000","last_became_active":"2024-03-30T13:13:24.948977+0000","last_became_peered":"2024-03-30T13:13:24.948977+0000","last_unstale":"2024-03-30T13:13:25.932979+0000","last_undegraded":"2024-03-30T13:13:25.932979+0000","last_fullsized":"2024-03-30T13:13:25.932979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:02:58.879182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927147+0000","last_change":"2024-03-30T13:13:24.939423+0000","last_active":"2024-03-30T13:13:25.927147+0000","last_peered":"2024-03-30T13:13:25.927147+0000","last_clean":"2024-03-30T13:13:25.927147+0000","last_became_active":"2024-03-30T13:13:24.939153+0000","last_became_peered":"2024-03-30T13:13:24.939153+0000","last_unstale":"2024-03-30T13:13:25.927147+0000","last_undegraded":"2024-03-30T13:13:25.927147+0000","last_fullsized":"2024-03-30T13:13:25.927147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:13:55.741135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.561079+0000","last_change":"2024-03-30T13:13:24.934918+0000","last_active":"2024-03-30T13:13:26.561079+0000","last_peered":"2024-03-30T13:13:26.561079+0000","last_clean":"2024-03-30T13:13:26.561079+0000","last_became_active":"2024-03-30T13:13:24.934348+0000","last_became_peered":"2024-03-30T13:13:24.934348+0000","last_unstale":"2024-03-30T13:13:26.561079+0000","last_undegraded":"2024-03-30T13:13:26.561079+0000","last_fullsized":"2024-03-30T13:13:26.561079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:25.356557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559920+0000","last_change":"2024-03-30T13:13:24.935924+0000","last_active":"2024-03-30T13:13:26.559920+0000","last_peered":"2024-03-30T13:13:26.559920+0000","last_clean":"2024-03-30T13:13:26.559920+0000","last_became_active":"2024-03-30T13:13:24.935616+0000","last_became_peered":"2024-03-30T13:13:24.935616+0000","last_unstale":"2024-03-30T13:13:26.559920+0000","last_undegraded":"2024-03-30T13:13:26.559920+0000","last_fullsized":"2024-03-30T13:13:26.559920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:27.932652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560398+0000","last_change":"2024-03-30T13:13:24.945549+0000","last_active":"2024-03-30T13:13:26.560398+0000","last_peered":"2024-03-30T13:13:26.560398+0000","last_clean":"2024-03-30T13:13:26.560398+0000","last_became_active":"2024-03-30T13:13:24.945243+0000","last_became_peered":"2024-03-30T13:13:24.945243+0000","last_unstale":"2024-03-30T13:13:26.560398+0000","last_undegraded":"2024-03-30T13:13:26.560398+0000","last_fullsized":"2024-03-30T13:13:26.560398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:28:47.620617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937130+0000","last_change":"2024-03-30T13:13:24.947492+0000","last_active":"2024-03-30T13:13:25.937130+0000","last_peered":"2024-03-30T13:13:25.937130+0000","last_clean":"2024-03-30T13:13:25.937130+0000","last_became_active":"2024-03-30T13:13:24.947189+0000","last_became_peered":"2024-03-30T13:13:24.947189+0000","last_unstale":"2024-03-30T13:13:25.937130+0000","last_undegraded":"2024-03-30T13:13:25.937130+0000","last_fullsized":"2024-03-30T13:13:25.937130+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:29:49.897116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560350+0000","last_change":"2024-03-30T13:13:24.933293+0000","last_active":"2024-03-30T13:13:26.560350+0000","last_peered":"2024-03-30T13:13:26.560350+0000","last_clean":"2024-03-30T13:13:26.560350+0000","last_became_active":"2024-03-30T13:13:24.933025+0000","last_became_peered":"2024-03-30T13:13:24.933025+0000","last_unstale":"2024-03-30T13:13:26.560350+0000","last_undegraded":"2024-03-30T13:13:26.560350+0000","last_fullsized":"2024-03-30T13:13:26.560350+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:08.019034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560552+0000","last_change":"2024-03-30T13:13:24.929414+0000","last_active":"2024-03-30T13:13:26.560552+0000","last_peered":"2024-03-30T13:13:26.560552+0000","last_clean":"2024-03-30T13:13:26.560552+0000","last_became_active":"2024-03-30T13:13:24.929055+0000","last_became_peered":"2024-03-30T13:13:24.929055+0000","last_unstale":"2024-03-30T13:13:26.560552+0000","last_undegraded":"2024-03-30T13:13:26.560552+0000","last_fullsized":"2024-03-30T13:13:26.560552+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:38:49.015365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.933584+0000","last_change":"2024-03-30T13:13:24.949110+0000","last_active":"2024-03-30T13:13:25.933584+0000","last_peered":"2024-03-30T13:13:25.933584+0000","last_clean":"2024-03-30T13:13:25.933584+0000","last_became_active":"2024-03-30T13:13:24.948809+0000","last_became_peered":"2024-03-30T13:13:24.948809+0000","last_unstale":"2024-03-30T13:13:25.933584+0000","last_undegraded":"2024-03-30T13:13:25.933584+0000","last_fullsized":"2024-03-30T13:13:25.933584+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:54:15.639267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558430+0000","last_change":"2024-03-30T13:13:24.949015+0000","last_active":"2024-03-30T13:13:26.558430+0000","last_peered":"2024-03-30T13:13:26.558430+0000","last_clean":"2024-03-30T13:13:26.558430+0000","last_became_active":"2024-03-30T13:13:24.948697+0000","last_became_peered":"2024-03-30T13:13:24.948697+0000","last_unstale":"2024-03-30T13:13:26.558430+0000","last_undegraded":"2024-03-30T13:13:26.558430+0000","last_fullsized":"2024-03-30T13:13:26.558430+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:19:42.226017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935645+0000","last_change":"2024-03-30T13:13:24.944732+0000","last_active":"2024-03-30T13:13:25.935645+0000","last_peered":"2024-03-30T13:13:25.935645+0000","last_clean":"2024-03-30T13:13:25.935645+0000","last_became_active":"2024-03-30T13:13:24.944398+0000","last_became_peered":"2024-03-30T13:13:24.944398+0000","last_unstale":"2024-03-30T13:13:25.935645+0000","last_undegraded":"2024-03-30T13:13:25.935645+0000","last_fullsized":"2024-03-30T13:13:25.935645+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:46:37.184683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560950+0000","last_change":"2024-03-30T13:13:23.912435+0000","last_active":"2024-03-30T13:13:26.560950+0000","last_peered":"2024-03-30T13:13:26.560950+0000","last_clean":"2024-03-30T13:13:26.560950+0000","last_became_active":"2024-03-30T13:13:23.912109+0000","last_became_peered":"2024-03-30T13:13:23.912109+0000","last_unstale":"2024-03-30T13:13:26.560950+0000","last_undegraded":"2024-03-30T13:13:26.560950+0000","last_fullsized":"2024-03-30T13:13:26.560950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:43:12.875054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559894+0000","last_change":"2024-03-30T13:13:24.935447+0000","last_active":"2024-03-30T13:13:26.559894+0000","last_peered":"2024-03-30T13:13:26.559894+0000","last_clean":"2024-03-30T13:13:26.559894+0000","last_became_active":"2024-03-30T13:13:24.935129+0000","last_became_peered":"2024-03-30T13:13:24.935129+0000","last_unstale":"2024-03-30T13:13:26.559894+0000","last_undegraded":"2024-03-30T13:13:26.559894+0000","last_fullsized":"2024-03-30T13:13:26.559894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:19:14.766849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560906+0000","last_change":"2024-03-30T13:13:23.905749+0000","last_active":"2024-03-30T13:13:26.560906+0000","last_peered":"2024-03-30T13:13:26.560906+0000","last_clean":"2024-03-30T13:13:26.560906+0000","last_became_active":"2024-03-30T13:13:23.905396+0000","last_became_peered":"2024-03-30T13:13:23.905396+0000","last_unstale":"2024-03-30T13:13:26.560906+0000","last_undegraded":"2024-03-30T13:13:26.560906+0000","last_fullsized":"2024-03-30T13:13:26.560906+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:47.127657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559467+0000","last_change":"2024-03-30T13:13:24.926075+0000","last_active":"2024-03-30T13:13:26.559467+0000","last_peered":"2024-03-30T13:13:26.559467+0000","last_clean":"2024-03-30T13:13:26.559467+0000","last_became_active":"2024-03-30T13:13:24.925773+0000","last_became_peered":"2024-03-30T13:13:24.925773+0000","last_unstale":"2024-03-30T13:13:26.559467+0000","last_undegraded":"2024-03-30T13:13:26.559467+0000","last_fullsized":"2024-03-30T13:13:26.559467+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:45.193052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559798+0000","last_change":"2024-03-30T13:13:23.907148+0000","last_active":"2024-03-30T13:13:26.559798+0000","last_peered":"2024-03-30T13:13:26.559798+0000","last_clean":"2024-03-30T13:13:26.559798+0000","last_became_active":"2024-03-30T13:13:23.906845+0000","last_became_peered":"2024-03-30T13:13:23.906845+0000","last_unstale":"2024-03-30T13:13:26.559798+0000","last_undegraded":"2024-03-30T13:13:26.559798+0000","last_fullsized":"2024-03-30T13:13:26.559798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:19:01.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313210+0000","last_change":"2024-03-30T13:13:24.925531+0000","last_active":"2024-03-30T13:13:26.313210+0000","last_peered":"2024-03-30T13:13:26.313210+0000","last_clean":"2024-03-30T13:13:26.313210+0000","last_became_active":"2024-03-30T13:13:24.925210+0000","last_became_peered":"2024-03-30T13:13:24.925210+0000","last_unstale":"2024-03-30T13:13:26.313210+0000","last_undegraded":"2024-03-30T13:13:26.313210+0000","last_fullsized":"2024-03-30T13:13:26.313210+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:55:24.799048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558712+0000","last_change":"2024-03-30T13:13:23.913141+0000","last_active":"2024-03-30T13:13:26.558712+0000","last_peered":"2024-03-30T13:13:26.558712+0000","last_clean":"2024-03-30T13:13:26.558712+0000","last_became_active":"2024-03-30T13:13:23.912862+0000","last_became_peered":"2024-03-30T13:13:23.912862+0000","last_unstale":"2024-03-30T13:13:26.558712+0000","last_undegraded":"2024-03-30T13:13:26.558712+0000","last_fullsized":"2024-03-30T13:13:26.558712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:04:33.269431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558847+0000","last_change":"2024-03-30T13:13:24.936927+0000","last_active":"2024-03-30T13:13:26.558847+0000","last_peered":"2024-03-30T13:13:26.558847+0000","last_clean":"2024-03-30T13:13:26.558847+0000","last_became_active":"2024-03-30T13:13:24.936696+0000","last_became_peered":"2024-03-30T13:13:24.936696+0000","last_unstale":"2024-03-30T13:13:26.558847+0000","last_undegraded":"2024-03-30T13:13:26.558847+0000","last_fullsized":"2024-03-30T13:13:26.558847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:19:42.226017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936632+0000","last_change":"2024-03-30T13:13:23.909692+0000","last_active":"2024-03-30T13:13:25.936632+0000","last_peered":"2024-03-30T13:13:25.936632+0000","last_clean":"2024-03-30T13:13:25.936632+0000","last_became_active":"2024-03-30T13:13:23.909057+0000","last_became_peered":"2024-03-30T13:13:23.909057+0000","last_unstale":"2024-03-30T13:13:25.936632+0000","last_undegraded":"2024-03-30T13:13:25.936632+0000","last_fullsized":"2024-03-30T13:13:25.936632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:28:44.855733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935443+0000","last_change":"2024-03-30T13:13:24.941969+0000","last_active":"2024-03-30T13:13:25.935443+0000","last_peered":"2024-03-30T13:13:25.935443+0000","last_clean":"2024-03-30T13:13:25.935443+0000","last_became_active":"2024-03-30T13:13:24.941381+0000","last_became_peered":"2024-03-30T13:13:24.941381+0000","last_unstale":"2024-03-30T13:13:25.935443+0000","last_undegraded":"2024-03-30T13:13:25.935443+0000","last_fullsized":"2024-03-30T13:13:25.935443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:05.103106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.934648+0000","last_change":"2024-03-30T13:13:23.913401+0000","last_active":"2024-03-30T13:13:25.934648+0000","last_peered":"2024-03-30T13:13:25.934648+0000","last_clean":"2024-03-30T13:13:25.934648+0000","last_became_active":"2024-03-30T13:13:23.913124+0000","last_became_peered":"2024-03-30T13:13:23.913124+0000","last_unstale":"2024-03-30T13:13:25.934648+0000","last_undegraded":"2024-03-30T13:13:25.934648+0000","last_fullsized":"2024-03-30T13:13:25.934648+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:28.815403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558700+0000","last_change":"2024-03-30T13:13:24.942700+0000","last_active":"2024-03-30T13:13:26.558700+0000","last_peered":"2024-03-30T13:13:26.558700+0000","last_clean":"2024-03-30T13:13:26.558700+0000","last_became_active":"2024-03-30T13:13:24.942280+0000","last_became_peered":"2024-03-30T13:13:24.942280+0000","last_unstale":"2024-03-30T13:13:26.558700+0000","last_undegraded":"2024-03-30T13:13:26.558700+0000","last_fullsized":"2024-03-30T13:13:26.558700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:40.881861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558297+0000","last_change":"2024-03-30T13:13:23.914025+0000","last_active":"2024-03-30T13:13:26.558297+0000","last_peered":"2024-03-30T13:13:26.558297+0000","last_clean":"2024-03-30T13:13:26.558297+0000","last_became_active":"2024-03-30T13:13:23.913731+0000","last_became_peered":"2024-03-30T13:13:23.913731+0000","last_unstale":"2024-03-30T13:13:26.558297+0000","last_undegraded":"2024-03-30T13:13:26.558297+0000","last_fullsized":"2024-03-30T13:13:26.558297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:36.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312710+0000","last_change":"2024-03-30T13:13:24.922261+0000","last_active":"2024-03-30T13:13:26.312710+0000","last_peered":"2024-03-30T13:13:26.312710+0000","last_clean":"2024-03-30T13:13:26.312710+0000","last_became_active":"2024-03-30T13:13:24.921795+0000","last_became_peered":"2024-03-30T13:13:24.921795+0000","last_unstale":"2024-03-30T13:13:26.312710+0000","last_undegraded":"2024-03-30T13:13:26.312710+0000","last_fullsized":"2024-03-30T13:13:26.312710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:29.747181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.557952+0000","last_change":"2024-03-30T13:13:23.914096+0000","last_active":"2024-03-30T13:13:26.557952+0000","last_peered":"2024-03-30T13:13:26.557952+0000","last_clean":"2024-03-30T13:13:26.557952+0000","last_became_active":"2024-03-30T13:13:23.913765+0000","last_became_peered":"2024-03-30T13:13:23.913765+0000","last_unstale":"2024-03-30T13:13:26.557952+0000","last_undegraded":"2024-03-30T13:13:26.557952+0000","last_fullsized":"2024-03-30T13:13:26.557952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:12:05.502548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927543+0000","last_change":"2024-03-30T13:13:24.950234+0000","last_active":"2024-03-30T13:13:25.927543+0000","last_peered":"2024-03-30T13:13:25.927543+0000","last_clean":"2024-03-30T13:13:25.927543+0000","last_became_active":"2024-03-30T13:13:24.945869+0000","last_became_peered":"2024-03-30T13:13:24.945869+0000","last_unstale":"2024-03-30T13:13:25.927543+0000","last_undegraded":"2024-03-30T13:13:25.927543+0000","last_fullsized":"2024-03-30T13:13:25.927543+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:51:18.065282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313213+0000","last_change":"2024-03-30T13:13:23.907227+0000","last_active":"2024-03-30T13:13:26.313213+0000","last_peered":"2024-03-30T13:13:26.313213+0000","last_clean":"2024-03-30T13:13:26.313213+0000","last_became_active":"2024-03-30T13:13:23.906937+0000","last_became_peered":"2024-03-30T13:13:23.906937+0000","last_unstale":"2024-03-30T13:13:26.313213+0000","last_undegraded":"2024-03-30T13:13:26.313213+0000","last_fullsized":"2024-03-30T13:13:26.313213+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:19:41.213454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935422+0000","last_change":"2024-03-30T13:13:24.924923+0000","last_active":"2024-03-30T13:13:25.935422+0000","last_peered":"2024-03-30T13:13:25.935422+0000","last_clean":"2024-03-30T13:13:25.935422+0000","last_became_active":"2024-03-30T13:13:24.923094+0000","last_became_peered":"2024-03-30T13:13:24.923094+0000","last_unstale":"2024-03-30T13:13:25.935422+0000","last_undegraded":"2024-03-30T13:13:25.935422+0000","last_fullsized":"2024-03-30T13:13:25.935422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:09:33.229806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937693+0000","last_change":"2024-03-30T13:13:23.909082+0000","last_active":"2024-03-30T13:13:25.937693+0000","last_peered":"2024-03-30T13:13:25.937693+0000","last_clean":"2024-03-30T13:13:25.937693+0000","last_became_active":"2024-03-30T13:13:23.908747+0000","last_became_peered":"2024-03-30T13:13:23.908747+0000","last_unstale":"2024-03-30T13:13:25.937693+0000","last_undegraded":"2024-03-30T13:13:25.937693+0000","last_fullsized":"2024-03-30T13:13:25.937693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:10.504569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560854+0000","last_change":"2024-03-30T13:13:24.927692+0000","last_active":"2024-03-30T13:13:26.560854+0000","last_peered":"2024-03-30T13:13:26.560854+0000","last_clean":"2024-03-30T13:13:26.560854+0000","last_became_active":"2024-03-30T13:13:24.927182+0000","last_became_peered":"2024-03-30T13:13:24.927182+0000","last_unstale":"2024-03-30T13:13:26.560854+0000","last_undegraded":"2024-03-30T13:13:26.560854+0000","last_fullsized":"2024-03-30T13:13:26.560854+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:21.652459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936864+0000","last_change":"2024-03-30T13:13:23.907257+0000","last_active":"2024-03-30T13:13:25.936864+0000","last_peered":"2024-03-30T13:13:25.936864+0000","last_clean":"2024-03-30T13:13:25.936864+0000","last_became_active":"2024-03-30T13:13:23.906115+0000","last_became_peered":"2024-03-30T13:13:23.906115+0000","last_unstale":"2024-03-30T13:13:25.936864+0000","last_undegraded":"2024-03-30T13:13:25.936864+0000","last_fullsized":"2024-03-30T13:13:25.936864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:24.343994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560048+0000","last_change":"2024-03-30T13:13:24.949472+0000","last_active":"2024-03-30T13:13:26.560048+0000","last_peered":"2024-03-30T13:13:26.560048+0000","last_clean":"2024-03-30T13:13:26.560048+0000","last_became_active":"2024-03-30T13:13:24.949147+0000","last_became_peered":"2024-03-30T13:13:24.949147+0000","last_unstale":"2024-03-30T13:13:26.560048+0000","last_undegraded":"2024-03-30T13:13:26.560048+0000","last_fullsized":"2024-03-30T13:13:26.560048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:19:42.226017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312819+0000","last_change":"2024-03-30T13:13:23.904054+0000","last_active":"2024-03-30T13:13:26.312819+0000","last_peered":"2024-03-30T13:13:26.312819+0000","last_clean":"2024-03-30T13:13:26.312819+0000","last_became_active":"2024-03-30T13:13:23.903743+0000","last_became_peered":"2024-03-30T13:13:23.903743+0000","last_unstale":"2024-03-30T13:13:26.312819+0000","last_undegraded":"2024-03-30T13:13:26.312819+0000","last_fullsized":"2024-03-30T13:13:26.312819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:44.180489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559457+0000","last_change":"2024-03-30T13:13:24.939455+0000","last_active":"2024-03-30T13:13:26.559457+0000","last_peered":"2024-03-30T13:13:26.559457+0000","last_clean":"2024-03-30T13:13:26.559457+0000","last_became_active":"2024-03-30T13:13:24.939178+0000","last_became_peered":"2024-03-30T13:13:24.939178+0000","last_unstale":"2024-03-30T13:13:26.559457+0000","last_undegraded":"2024-03-30T13:13:26.559457+0000","last_fullsized":"2024-03-30T13:13:26.559457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:27:16.659922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312822+0000","last_change":"2024-03-30T13:13:23.912339+0000","last_active":"2024-03-30T13:13:26.312822+0000","last_peered":"2024-03-30T13:13:26.312822+0000","last_clean":"2024-03-30T13:13:26.312822+0000","last_became_active":"2024-03-30T13:13:23.912014+0000","last_became_peered":"2024-03-30T13:13:23.912014+0000","last_unstale":"2024-03-30T13:13:26.312822+0000","last_undegraded":"2024-03-30T13:13:26.312822+0000","last_fullsized":"2024-03-30T13:13:26.312822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:29:33.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312507+0000","last_change":"2024-03-30T13:13:24.935581+0000","last_active":"2024-03-30T13:13:26.312507+0000","last_peered":"2024-03-30T13:13:26.312507+0000","last_clean":"2024-03-30T13:13:26.312507+0000","last_became_active":"2024-03-30T13:13:24.934328+0000","last_became_peered":"2024-03-30T13:13:24.934328+0000","last_unstale":"2024-03-30T13:13:26.312507+0000","last_undegraded":"2024-03-30T13:13:26.312507+0000","last_fullsized":"2024-03-30T13:13:26.312507+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:50:47.878866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558554+0000","last_change":"2024-03-30T13:13:23.909571+0000","last_active":"2024-03-30T13:13:26.558554+0000","last_peered":"2024-03-30T13:13:26.558554+0000","last_clean":"2024-03-30T13:13:26.558554+0000","last_became_active":"2024-03-30T13:13:23.908787+0000","last_became_peered":"2024-03-30T13:13:23.908787+0000","last_unstale":"2024-03-30T13:13:26.558554+0000","last_undegraded":"2024-03-30T13:13:26.558554+0000","last_fullsized":"2024-03-30T13:13:26.558554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:47.127657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.934972+0000","last_change":"2024-03-30T13:13:24.949259+0000","last_active":"2024-03-30T13:13:25.934972+0000","last_peered":"2024-03-30T13:13:25.934972+0000","last_clean":"2024-03-30T13:13:25.934972+0000","last_became_active":"2024-03-30T13:13:24.948978+0000","last_became_peered":"2024-03-30T13:13:24.948978+0000","last_unstale":"2024-03-30T13:13:25.934972+0000","last_undegraded":"2024-03-30T13:13:25.934972+0000","last_fullsized":"2024-03-30T13:13:25.934972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:11.515578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559517+0000","last_change":"2024-03-30T13:13:23.912393+0000","last_active":"2024-03-30T13:13:26.559517+0000","last_peered":"2024-03-30T13:13:26.559517+0000","last_clean":"2024-03-30T13:13:26.559517+0000","last_became_active":"2024-03-30T13:13:23.911987+0000","last_became_peered":"2024-03-30T13:13:23.911987+0000","last_unstale":"2024-03-30T13:13:26.559517+0000","last_undegraded":"2024-03-30T13:13:26.559517+0000","last_fullsized":"2024-03-30T13:13:26.559517+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:12:18.230678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312750+0000","last_change":"2024-03-30T13:13:24.929096+0000","last_active":"2024-03-30T13:13:26.312750+0000","last_peered":"2024-03-30T13:13:26.312750+0000","last_clean":"2024-03-30T13:13:26.312750+0000","last_became_active":"2024-03-30T13:13:24.928756+0000","last_became_peered":"2024-03-30T13:13:24.928756+0000","last_unstale":"2024-03-30T13:13:26.312750+0000","last_undegraded":"2024-03-30T13:13:26.312750+0000","last_fullsized":"2024-03-30T13:13:26.312750+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:38:59.271961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.932662+0000","last_change":"2024-03-30T13:13:23.910811+0000","last_active":"2024-03-30T13:13:25.932662+0000","last_peered":"2024-03-30T13:13:25.932662+0000","last_clean":"2024-03-30T13:13:25.932662+0000","last_became_active":"2024-03-30T13:13:23.910524+0000","last_became_peered":"2024-03-30T13:13:23.910524+0000","last_unstale":"2024-03-30T13:13:25.932662+0000","last_undegraded":"2024-03-30T13:13:25.932662+0000","last_fullsized":"2024-03-30T13:13:25.932662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:07.006471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312978+0000","last_change":"2024-03-30T13:13:24.921721+0000","last_active":"2024-03-30T13:13:26.312978+0000","last_peered":"2024-03-30T13:13:26.312978+0000","last_clean":"2024-03-30T13:13:26.312978+0000","last_became_active":"2024-03-30T13:13:24.921340+0000","last_became_peered":"2024-03-30T13:13:24.921340+0000","last_unstale":"2024-03-30T13:13:26.312978+0000","last_undegraded":"2024-03-30T13:13:26.312978+0000","last_fullsized":"2024-03-30T13:13:26.312978+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:54:43.683984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937516+0000","last_change":"2024-03-30T13:13:23.910688+0000","last_active":"2024-03-30T13:13:25.937516+0000","last_peered":"2024-03-30T13:13:25.937516+0000","last_clean":"2024-03-30T13:13:25.937516+0000","last_became_active":"2024-03-30T13:13:23.910389+0000","last_became_peered":"2024-03-30T13:13:23.910389+0000","last_unstale":"2024-03-30T13:13:25.937516+0000","last_undegraded":"2024-03-30T13:13:25.937516+0000","last_fullsized":"2024-03-30T13:13:25.937516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:54:48.348579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936429+0000","last_change":"2024-03-30T13:13:24.941714+0000","last_active":"2024-03-30T13:13:25.936429+0000","last_peered":"2024-03-30T13:13:25.936429+0000","last_clean":"2024-03-30T13:13:25.936429+0000","last_became_active":"2024-03-30T13:13:24.941308+0000","last_became_peered":"2024-03-30T13:13:24.941308+0000","last_unstale":"2024-03-30T13:13:25.936429+0000","last_undegraded":"2024-03-30T13:13:25.936429+0000","last_fullsized":"2024-03-30T13:13:25.936429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:46:34.360151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559491+0000","last_change":"2024-03-30T13:13:23.917176+0000","last_active":"2024-03-30T13:13:26.559491+0000","last_peered":"2024-03-30T13:13:26.559491+0000","last_clean":"2024-03-30T13:13:26.559491+0000","last_became_active":"2024-03-30T13:13:23.916685+0000","last_became_peered":"2024-03-30T13:13:23.916685+0000","last_unstale":"2024-03-30T13:13:26.559491+0000","last_undegraded":"2024-03-30T13:13:26.559491+0000","last_fullsized":"2024-03-30T13:13:26.559491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:19:01.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559142+0000","last_change":"2024-03-30T13:13:24.930644+0000","last_active":"2024-03-30T13:13:26.559142+0000","last_peered":"2024-03-30T13:13:26.559142+0000","last_clean":"2024-03-30T13:13:26.559142+0000","last_became_active":"2024-03-30T13:13:24.930343+0000","last_became_peered":"2024-03-30T13:13:24.930343+0000","last_unstale":"2024-03-30T13:13:26.559142+0000","last_undegraded":"2024-03-30T13:13:26.559142+0000","last_fullsized":"2024-03-30T13:13:26.559142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:01:37.950139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927745+0000","last_change":"2024-03-30T13:13:23.902484+0000","last_active":"2024-03-30T13:13:25.927745+0000","last_peered":"2024-03-30T13:13:25.927745+0000","last_clean":"2024-03-30T13:13:25.927745+0000","last_became_active":"2024-03-30T13:13:23.902216+0000","last_became_peered":"2024-03-30T13:13:23.902216+0000","last_unstale":"2024-03-30T13:13:25.927745+0000","last_undegraded":"2024-03-30T13:13:25.927745+0000","last_fullsized":"2024-03-30T13:13:25.927745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:55:03.679777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.928018+0000","last_change":"2024-03-30T13:13:24.949378+0000","last_active":"2024-03-30T13:13:25.928018+0000","last_peered":"2024-03-30T13:13:25.928018+0000","last_clean":"2024-03-30T13:13:25.928018+0000","last_became_active":"2024-03-30T13:13:24.944690+0000","last_became_peered":"2024-03-30T13:13:24.944690+0000","last_unstale":"2024-03-30T13:13:25.928018+0000","last_undegraded":"2024-03-30T13:13:25.928018+0000","last_fullsized":"2024-03-30T13:13:25.928018+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:43:31.023520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558918+0000","last_change":"2024-03-30T13:13:23.910268+0000","last_active":"2024-03-30T13:13:26.558918+0000","last_peered":"2024-03-30T13:13:26.558918+0000","last_clean":"2024-03-30T13:13:26.558918+0000","last_became_active":"2024-03-30T13:13:23.909961+0000","last_became_peered":"2024-03-30T13:13:23.909961+0000","last_unstale":"2024-03-30T13:13:26.558918+0000","last_undegraded":"2024-03-30T13:13:26.558918+0000","last_fullsized":"2024-03-30T13:13:26.558918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:13:03.451305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.933139+0000","last_change":"2024-03-30T13:13:24.944391+0000","last_active":"2024-03-30T13:13:25.933139+0000","last_peered":"2024-03-30T13:13:25.933139+0000","last_clean":"2024-03-30T13:13:25.933139+0000","last_became_active":"2024-03-30T13:13:24.944103+0000","last_became_peered":"2024-03-30T13:13:24.944103+0000","last_unstale":"2024-03-30T13:13:25.933139+0000","last_undegraded":"2024-03-30T13:13:25.933139+0000","last_fullsized":"2024-03-30T13:13:25.933139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:05.047128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927510+0000","last_change":"2024-03-30T13:13:23.906510+0000","last_active":"2024-03-30T13:13:25.927510+0000","last_peered":"2024-03-30T13:13:25.927510+0000","last_clean":"2024-03-30T13:13:25.927510+0000","last_became_active":"2024-03-30T13:13:23.906250+0000","last_became_peered":"2024-03-30T13:13:23.906250+0000","last_unstale":"2024-03-30T13:13:25.927510+0000","last_undegraded":"2024-03-30T13:13:25.927510+0000","last_fullsized":"2024-03-30T13:13:25.927510+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:32:41.206020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560470+0000","last_change":"2024-03-30T13:13:24.928466+0000","last_active":"2024-03-30T13:13:26.560470+0000","last_peered":"2024-03-30T13:13:26.560470+0000","last_clean":"2024-03-30T13:13:26.560470+0000","last_became_active":"2024-03-30T13:13:24.928199+0000","last_became_peered":"2024-03-30T13:13:24.928199+0000","last_unstale":"2024-03-30T13:13:26.560470+0000","last_undegraded":"2024-03-30T13:13:26.560470+0000","last_fullsized":"2024-03-30T13:13:26.560470+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:27.932652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927271+0000","last_change":"2024-03-30T13:13:23.908274+0000","last_active":"2024-03-30T13:13:25.927271+0000","last_peered":"2024-03-30T13:13:25.927271+0000","last_clean":"2024-03-30T13:13:25.927271+0000","last_became_active":"2024-03-30T13:13:23.908014+0000","last_became_peered":"2024-03-30T13:13:23.908014+0000","last_unstale":"2024-03-30T13:13:25.927271+0000","last_undegraded":"2024-03-30T13:13:25.927271+0000","last_fullsized":"2024-03-30T13:13:25.927271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:29:03.705190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936075+0000","last_change":"2024-03-30T13:13:24.943618+0000","last_active":"2024-03-30T13:13:25.936075+0000","last_peered":"2024-03-30T13:13:25.936075+0000","last_clean":"2024-03-30T13:13:25.936075+0000","last_became_active":"2024-03-30T13:13:24.943319+0000","last_became_peered":"2024-03-30T13:13:24.943319+0000","last_unstale":"2024-03-30T13:13:25.936075+0000","last_undegraded":"2024-03-30T13:13:25.936075+0000","last_fullsized":"2024-03-30T13:13:25.936075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:59.300554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.934155+0000","last_change":"2024-03-30T13:13:23.913050+0000","last_active":"2024-03-30T13:13:25.934155+0000","last_peered":"2024-03-30T13:13:25.934155+0000","last_clean":"2024-03-30T13:13:25.934155+0000","last_became_active":"2024-03-30T13:13:23.910147+0000","last_became_peered":"2024-03-30T13:13:23.910147+0000","last_unstale":"2024-03-30T13:13:25.934155+0000","last_undegraded":"2024-03-30T13:13:25.934155+0000","last_fullsized":"2024-03-30T13:13:25.934155+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:38:48.002802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312882+0000","last_change":"2024-03-30T13:13:24.923947+0000","last_active":"2024-03-30T13:13:26.312882+0000","last_peered":"2024-03-30T13:13:26.312882+0000","last_clean":"2024-03-30T13:13:26.312882+0000","last_became_active":"2024-03-30T13:13:24.923452+0000","last_became_peered":"2024-03-30T13:13:24.923452+0000","last_unstale":"2024-03-30T13:13:26.312882+0000","last_undegraded":"2024-03-30T13:13:26.312882+0000","last_fullsized":"2024-03-30T13:13:26.312882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:56:26.254760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927062+0000","last_change":"2024-03-30T13:13:23.906042+0000","last_active":"2024-03-30T13:13:25.927062+0000","last_peered":"2024-03-30T13:13:25.927062+0000","last_clean":"2024-03-30T13:13:25.927062+0000","last_became_active":"2024-03-30T13:13:23.905731+0000","last_became_peered":"2024-03-30T13:13:23.905731+0000","last_unstale":"2024-03-30T13:13:25.927062+0000","last_undegraded":"2024-03-30T13:13:25.927062+0000","last_fullsized":"2024-03-30T13:13:25.927062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:21:24.535622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559038+0000","last_change":"2024-03-30T13:13:24.945544+0000","last_active":"2024-03-30T13:13:26.559038+0000","last_peered":"2024-03-30T13:13:26.559038+0000","last_clean":"2024-03-30T13:13:26.559038+0000","last_became_active":"2024-03-30T13:13:24.945246+0000","last_became_peered":"2024-03-30T13:13:24.945246+0000","last_unstale":"2024-03-30T13:13:26.559038+0000","last_undegraded":"2024-03-30T13:13:26.559038+0000","last_fullsized":"2024-03-30T13:13:26.559038+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:27:16.659922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.938015+0000","last_change":"2024-03-30T13:13:23.906657+0000","last_active":"2024-03-30T13:13:25.938015+0000","last_peered":"2024-03-30T13:13:25.938015+0000","last_clean":"2024-03-30T13:13:25.938015+0000","last_became_active":"2024-03-30T13:13:23.906356+0000","last_became_peered":"2024-03-30T13:13:23.906356+0000","last_unstale":"2024-03-30T13:13:25.938015+0000","last_undegraded":"2024-03-30T13:13:25.938015+0000","last_fullsized":"2024-03-30T13:13:25.938015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:27:00.100392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935866+0000","last_change":"2024-03-30T13:13:24.925860+0000","last_active":"2024-03-30T13:13:25.935866+0000","last_peered":"2024-03-30T13:13:25.935866+0000","last_clean":"2024-03-30T13:13:25.935866+0000","last_became_active":"2024-03-30T13:13:24.923570+0000","last_became_peered":"2024-03-30T13:13:24.923570+0000","last_unstale":"2024-03-30T13:13:25.935866+0000","last_undegraded":"2024-03-30T13:13:25.935866+0000","last_fullsized":"2024-03-30T13:13:25.935866+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:05.103106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.944800+0000","last_change":"2024-03-30T13:13:23.911792+0000","last_active":"2024-03-30T13:13:25.944800+0000","last_peered":"2024-03-30T13:13:25.944800+0000","last_clean":"2024-03-30T13:13:25.944800+0000","last_became_active":"2024-03-30T13:13:23.911449+0000","last_became_peered":"2024-03-30T13:13:23.911449+0000","last_unstale":"2024-03-30T13:13:25.944800+0000","last_undegraded":"2024-03-30T13:13:25.944800+0000","last_fullsized":"2024-03-30T13:13:25.944800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:27:29.816936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313272+0000","last_change":"2024-03-30T13:13:24.930626+0000","last_active":"2024-03-30T13:13:26.313272+0000","last_peered":"2024-03-30T13:13:26.313272+0000","last_clean":"2024-03-30T13:13:26.313272+0000","last_became_active":"2024-03-30T13:13:24.930269+0000","last_became_peered":"2024-03-30T13:13:24.930269+0000","last_unstale":"2024-03-30T13:13:26.313272+0000","last_undegraded":"2024-03-30T13:13:26.313272+0000","last_fullsized":"2024-03-30T13:13:26.313272+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:39:59.822381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560471+0000","last_change":"2024-03-30T13:13:23.901415+0000","last_active":"2024-03-30T13:13:26.560471+0000","last_peered":"2024-03-30T13:13:26.560471+0000","last_clean":"2024-03-30T13:13:26.560471+0000","last_became_active":"2024-03-30T13:13:23.900935+0000","last_became_peered":"2024-03-30T13:13:23.900935+0000","last_unstale":"2024-03-30T13:13:26.560471+0000","last_undegraded":"2024-03-30T13:13:26.560471+0000","last_fullsized":"2024-03-30T13:13:26.560471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:13:03.451305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559860+0000","last_change":"2024-03-30T13:13:24.929852+0000","last_active":"2024-03-30T13:13:26.559860+0000","last_peered":"2024-03-30T13:13:26.559860+0000","last_clean":"2024-03-30T13:13:26.559860+0000","last_became_active":"2024-03-30T13:13:24.929560+0000","last_became_peered":"2024-03-30T13:13:24.929560+0000","last_unstale":"2024-03-30T13:13:26.559860+0000","last_undegraded":"2024-03-30T13:13:26.559860+0000","last_fullsized":"2024-03-30T13:13:26.559860+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:19:14.766849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560586+0000","last_change":"2024-03-30T13:13:23.907243+0000","last_active":"2024-03-30T13:13:26.560586+0000","last_peered":"2024-03-30T13:13:26.560586+0000","last_clean":"2024-03-30T13:13:26.560586+0000","last_became_active":"2024-03-30T13:13:23.906998+0000","last_became_peered":"2024-03-30T13:13:23.906998+0000","last_unstale":"2024-03-30T13:13:26.560586+0000","last_undegraded":"2024-03-30T13:13:26.560586+0000","last_fullsized":"2024-03-30T13:13:26.560586+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:14:03.970356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558398+0000","last_change":"2024-03-30T13:13:24.927802+0000","last_active":"2024-03-30T13:13:26.558398+0000","last_peered":"2024-03-30T13:13:26.558398+0000","last_clean":"2024-03-30T13:13:26.558398+0000","last_became_active":"2024-03-30T13:13:24.926782+0000","last_became_peered":"2024-03-30T13:13:24.926782+0000","last_unstale":"2024-03-30T13:13:26.558398+0000","last_undegraded":"2024-03-30T13:13:26.558398+0000","last_fullsized":"2024-03-30T13:13:26.558398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:45.193052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560258+0000","last_change":"2024-03-30T13:13:23.912742+0000","last_active":"2024-03-30T13:13:26.560258+0000","last_peered":"2024-03-30T13:13:26.560258+0000","last_clean":"2024-03-30T13:13:26.560258+0000","last_became_active":"2024-03-30T13:13:23.912393+0000","last_became_peered":"2024-03-30T13:13:23.912393+0000","last_unstale":"2024-03-30T13:13:26.560258+0000","last_undegraded":"2024-03-30T13:13:26.560258+0000","last_fullsized":"2024-03-30T13:13:26.560258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:13:54.728572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558891+0000","last_change":"2024-03-30T13:13:24.932828+0000","last_active":"2024-03-30T13:13:26.558891+0000","last_peered":"2024-03-30T13:13:26.558891+0000","last_clean":"2024-03-30T13:13:26.558891+0000","last_became_active":"2024-03-30T13:13:24.931315+0000","last_became_peered":"2024-03-30T13:13:24.931315+0000","last_unstale":"2024-03-30T13:13:26.558891+0000","last_undegraded":"2024-03-30T13:13:26.558891+0000","last_fullsized":"2024-03-30T13:13:26.558891+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:34:06.451438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.557958+0000","last_change":"2024-03-30T13:13:23.914082+0000","last_active":"2024-03-30T13:13:26.557958+0000","last_peered":"2024-03-30T13:13:26.557958+0000","last_clean":"2024-03-30T13:13:26.557958+0000","last_became_active":"2024-03-30T13:13:23.911673+0000","last_became_peered":"2024-03-30T13:13:23.911673+0000","last_unstale":"2024-03-30T13:13:26.557958+0000","last_undegraded":"2024-03-30T13:13:26.557958+0000","last_fullsized":"2024-03-30T13:13:26.557958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:26:33.267469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935443+0000","last_change":"2024-03-30T13:13:24.921325+0000","last_active":"2024-03-30T13:13:25.935443+0000","last_peered":"2024-03-30T13:13:25.935443+0000","last_clean":"2024-03-30T13:13:25.935443+0000","last_became_active":"2024-03-30T13:13:24.920741+0000","last_became_peered":"2024-03-30T13:13:24.920741+0000","last_unstale":"2024-03-30T13:13:25.935443+0000","last_undegraded":"2024-03-30T13:13:25.935443+0000","last_fullsized":"2024-03-30T13:13:25.935443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:06.544052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312345+0000","last_change":"2024-03-30T13:13:23.904883+0000","last_active":"2024-03-30T13:13:26.312345+0000","last_peered":"2024-03-30T13:13:26.312345+0000","last_clean":"2024-03-30T13:13:26.312345+0000","last_became_active":"2024-03-30T13:13:23.904444+0000","last_became_peered":"2024-03-30T13:13:23.904444+0000","last_unstale":"2024-03-30T13:13:26.312345+0000","last_undegraded":"2024-03-30T13:13:26.312345+0000","last_fullsized":"2024-03-30T13:13:26.312345+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:01:36.937575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937189+0000","last_change":"2024-03-30T13:13:24.947600+0000","last_active":"2024-03-30T13:13:25.937189+0000","last_peered":"2024-03-30T13:13:25.937189+0000","last_clean":"2024-03-30T13:13:25.937189+0000","last_became_active":"2024-03-30T13:13:24.947367+0000","last_became_peered":"2024-03-30T13:13:24.947367+0000","last_unstale":"2024-03-30T13:13:25.937189+0000","last_undegraded":"2024-03-30T13:13:25.937189+0000","last_fullsized":"2024-03-30T13:13:25.937189+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:19.282770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935829+0000","last_change":"2024-03-30T13:13:23.901342+0000","last_active":"2024-03-30T13:13:25.935829+0000","last_peered":"2024-03-30T13:13:25.935829+0000","last_clean":"2024-03-30T13:13:25.935829+0000","last_became_active":"2024-03-30T13:13:23.901013+0000","last_became_peered":"2024-03-30T13:13:23.901013+0000","last_unstale":"2024-03-30T13:13:25.935829+0000","last_undegraded":"2024-03-30T13:13:25.935829+0000","last_fullsized":"2024-03-30T13:13:25.935829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:28:46.608054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":206,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.932993+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:13:25.932993+0000","last_peered":"2024-03-30T13:13:25.932993+0000","last_clean":"2024-03-30T13:13:25.932993+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:13:25.932993+0000","last_undegraded":"2024-03-30T13:13:25.932993+0000","last_fullsized":"2024-03-30T13:13:25.932993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":792703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509466,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509466,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":200765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509466,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":202299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":200743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":791055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":200723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:13:34.538 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:13:34.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.761+0000 7f8863600640 1 Processor -- start 2024-03-30T13:13:34.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.762+0000 7f8863600640 1 -- start start 2024-03-30T13:13:34.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.763+0000 7f8863600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f885c15e950 0x7f885c0d4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:34.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.763+0000 7f8863600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f885c0d48c0 0x7f885c0d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:34.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.763+0000 7f8863600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f885c0d36f0 con 0x7f885c0d2f00 2024-03-30T13:13:34.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.763+0000 7f8863600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f885c0d3cb0 con 0x7f885c15e950 2024-03-30T13:13:34.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.763+0000 7f8863600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f885c0d4d00 con 0x7f885c0d48c0 2024-03-30T13:13:34.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.763+0000 7f8860c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f885c15e950 0x7f885c0d4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:34.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.763+0000 7f8860c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f885c15e950 0x7f885c0d4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39356/0 (socket says 172.21.15.44:39356) 2024-03-30T13:13:34.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.763+0000 7f8860c00640 1 -- 172.21.15.44:0/2194877038 learned_addr learned my addr 172.21.15.44:0/2194877038 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:34.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.764+0000 7f885be00640 1 --2- 172.21.15.44:0/2194877038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f885c0d48c0 0x7f885c0d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:34.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.764+0000 7f8860c00640 1 -- 172.21.15.44:0/2194877038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f885c0d48c0 msgr2=0x7f885c0d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:34.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.764+0000 7f8860c00640 1 --2- 172.21.15.44:0/2194877038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f885c0d48c0 0x7f885c0d29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:34.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.764+0000 7f8860c00640 1 -- 172.21.15.44:0/2194877038 >> v1:172.21.15.151:6789/0 conn(0x7f885c0d2f00 legacy=0x7f885c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:34.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.764+0000 7f8860c00640 1 -- 172.21.15.44:0/2194877038 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c0d39d0 con 0x7f885c15e950 2024-03-30T13:13:34.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.764+0000 7f885be00640 1 --2- 172.21.15.44:0/2194877038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f885c0d48c0 0x7f885c0d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:34.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.765+0000 7f8860c00640 1 --2- 172.21.15.44:0/2194877038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f885c15e950 0x7f885c0d4380 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8850009870 tx=0x7f885002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c74932a6135b75 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:34.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.766+0000 7f885b400640 1 -- 172.21.15.44:0/2194877038 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850034070 con 0x7f885c15e950 2024-03-30T13:13:34.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.766+0000 7f885b400640 1 -- 172.21.15.44:0/2194877038 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8850030840 con 0x7f885c15e950 2024-03-30T13:13:34.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.766+0000 7f885b400640 1 -- 172.21.15.44:0/2194877038 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850030c10 con 0x7f885c15e950 2024-03-30T13:13:34.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.766+0000 7f8863600640 1 -- 172.21.15.44:0/2194877038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f885c15e950 msgr2=0x7f885c0d4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:34.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.766+0000 7f8863600640 1 --2- 172.21.15.44:0/2194877038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f885c15e950 0x7f885c0d4380 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8850009870 tx=0x7f885002b980 comp rx=0 tx=0).stop 2024-03-30T13:13:34.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.767+0000 7f8863600640 1 -- 172.21.15.44:0/2194877038 shutdown_connections 2024-03-30T13:13:34.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.767+0000 7f8863600640 1 --2- 172.21.15.44:0/2194877038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f885c0d48c0 0x7f885c0d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:34.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.767+0000 7f8863600640 1 --2- 172.21.15.44:0/2194877038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f885c15e950 0x7f885c0d4380 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:34.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.767+0000 7f8863600640 1 -- 172.21.15.44:0/2194877038 >> 172.21.15.44:0/2194877038 conn(0x7f885c0676e0 msgr2=0x7f885c067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:34.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.767+0000 7f8863600640 1 -- 172.21.15.44:0/2194877038 shutdown_connections 2024-03-30T13:13:34.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.767+0000 7f8863600640 1 -- 172.21.15.44:0/2194877038 wait complete. 2024-03-30T13:13:34.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.768+0000 7f8863600640 1 Processor -- start 2024-03-30T13:13:34.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.769+0000 7f8863600640 1 -- start start 2024-03-30T13:13:34.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8863600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f885c0d2f00 0x7f885c161620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:34.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8863600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f885c0d48c0 0x7f885c1f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:34.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8863600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f885c15e950 0x7f885c157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:34.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8863600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f885c0d3390 con 0x7f885c15e950 2024-03-30T13:13:34.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8863600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f885c0b7da0 con 0x7f885c0d48c0 2024-03-30T13:13:34.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8863600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f885c15ed30 con 0x7f885c0d2f00 2024-03-30T13:13:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8861600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f885c15e950 0x7f885c157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8861600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f885c15e950 0x7f885c157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39358/0 (socket says 172.21.15.44:39358) 2024-03-30T13:13:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8861600640 1 -- 172.21.15.44:0/4075914682 learned_addr learned my addr 172.21.15.44:0/4075914682 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8860c00640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f885c0d2f00 0x7f885c161620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f885be00640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f885c0d48c0 0x7f885c1f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8861600640 1 -- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f885c0d2f00 msgr2=0x7f885c161620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8861600640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f885c0d2f00 0x7f885c161620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8861600640 1 -- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f885c0d48c0 msgr2=0x7f885c1f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8861600640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f885c0d48c0 0x7f885c1f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f8861600640 1 -- 172.21.15.44:0/4075914682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c160580 con 0x7f885c15e950 2024-03-30T13:13:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.770+0000 7f885be00640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f885c0d48c0 0x7f885c1f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:34.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.771+0000 7f8861600640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f885c15e950 0x7f885c157300 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f885400c780 tx=0x7f885400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:34.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.771+0000 7f8858c00640 1 -- 172.21.15.44:0/4075914682 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8854004b60 con 0x7f885c15e950 2024-03-30T13:13:34.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.771+0000 7f8858c00640 1 -- 172.21.15.44:0/4075914682 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8854004d00 con 0x7f885c15e950 2024-03-30T13:13:34.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.771+0000 7f8858c00640 1 -- 172.21.15.44:0/4075914682 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885400aa90 con 0x7f885c15e950 2024-03-30T13:13:34.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.771+0000 7f8863600640 1 -- 172.21.15.44:0/4075914682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885c160860 con 0x7f885c15e950 2024-03-30T13:13:34.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.771+0000 7f8863600640 1 -- 172.21.15.44:0/4075914682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885c160e20 con 0x7f885c15e950 2024-03-30T13:13:34.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.772+0000 7f8863600640 1 -- 172.21.15.44:0/4075914682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885c161b60 con 0x7f885c15e950 2024-03-30T13:13:34.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.773+0000 7f8858c00640 1 -- 172.21.15.44:0/4075914682 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f885400ac30 con 0x7f885c15e950 2024-03-30T13:13:34.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.775+0000 7f8858c00640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f883c06c530 0x7f883c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:34.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.775+0000 7f8858c00640 1 -- 172.21.15.44:0/4075914682 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f885408bc30 con 0x7f885c15e950 2024-03-30T13:13:34.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.776+0000 7f8860c00640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f883c06c530 0x7f883c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:34.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.777+0000 7f8860c00640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f883c06c530 0x7f883c06e9f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8850036000 tx=0x7f885003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:34.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:34.780+0000 7f8858c00640 1 -- 172.21.15.44:0/4075914682 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8854020070 con 0x7f885c15e950 2024-03-30T13:13:35.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.016+0000 7f8863600640 1 -- 172.21.15.44:0/4075914682 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f885c075a10 con 0x7f883c06c530 2024-03-30T13:13:35.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.034+0000 7f8858c00640 1 -- 172.21.15.44:0/4075914682 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251847 (secure 0 0 0) 0x7f885c075a10 con 0x7f883c06c530 2024-03-30T13:13:35.041 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:35.044 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:13:35.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.040+0000 7f8863600640 1 -- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f883c06c530 msgr2=0x7f883c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:35.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.041+0000 7f8863600640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f883c06c530 0x7f883c06e9f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8850036000 tx=0x7f885003b040 comp rx=0 tx=0).stop 2024-03-30T13:13:35.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.041+0000 7f8863600640 1 -- 172.21.15.44:0/4075914682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f885c15e950 msgr2=0x7f885c157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:35.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.041+0000 7f8863600640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f885c15e950 0x7f885c157300 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f885400c780 tx=0x7f885400cc40 comp rx=0 tx=0).stop 2024-03-30T13:13:35.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.041+0000 7f8863600640 1 -- 172.21.15.44:0/4075914682 shutdown_connections 2024-03-30T13:13:35.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.041+0000 7f8863600640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f885c15e950 0x7f885c157300 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.041+0000 7f8863600640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f883c06c530 0x7f883c06e9f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.041+0000 7f8863600640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f885c0d48c0 0x7f885c1f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.041+0000 7f8863600640 1 --2- 172.21.15.44:0/4075914682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f885c0d2f00 0x7f885c161620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.041+0000 7f8863600640 1 -- 172.21.15.44:0/4075914682 >> 172.21.15.44:0/4075914682 conn(0x7f885c0676e0 msgr2=0x7f885c0cc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:35.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.041+0000 7f8863600640 1 -- 172.21.15.44:0/4075914682 shutdown_connections 2024-03-30T13:13:35.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.041+0000 7f8863600640 1 -- 172.21.15.44:0/4075914682 wait complete. 2024-03-30T13:13:35.071 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-03-30T13:13:33.991920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221056,"kb_used_data":4872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753664,"statfs":{"total":773094113280,"available":772867751936,"internally_reserved":0,"allocated":4988928,"data_stored":2790780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.092640"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313177+0000","last_change":"2024-03-30T13:13:24.933366+0000","last_active":"2024-03-30T13:13:26.313177+0000","last_peered":"2024-03-30T13:13:26.313177+0000","last_clean":"2024-03-30T13:13:26.313177+0000","last_became_active":"2024-03-30T13:13:24.933098+0000","last_became_peered":"2024-03-30T13:13:24.933098+0000","last_unstale":"2024-03-30T13:13:26.313177+0000","last_undegraded":"2024-03-30T13:13:26.313177+0000","last_fullsized":"2024-03-30T13:13:26.313177+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:13:50.527145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313100+0000","last_change":"2024-03-30T13:13:24.939484+0000","last_active":"2024-03-30T13:13:26.313100+0000","last_peered":"2024-03-30T13:13:26.313100+0000","last_clean":"2024-03-30T13:13:26.313100+0000","last_became_active":"2024-03-30T13:13:24.939204+0000","last_became_peered":"2024-03-30T13:13:24.939204+0000","last_unstale":"2024-03-30T13:13:26.313100+0000","last_undegraded":"2024-03-30T13:13:26.313100+0000","last_fullsized":"2024-03-30T13:13:26.313100+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:38:39.867975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560860+0000","last_change":"2024-03-30T13:13:24.932690+0000","last_active":"2024-03-30T13:13:26.560860+0000","last_peered":"2024-03-30T13:13:26.560860+0000","last_clean":"2024-03-30T13:13:26.560860+0000","last_became_active":"2024-03-30T13:13:24.932364+0000","last_became_peered":"2024-03-30T13:13:24.932364+0000","last_unstale":"2024-03-30T13:13:26.560860+0000","last_undegraded":"2024-03-30T13:13:26.560860+0000","last_fullsized":"2024-03-30T13:13:26.560860+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:14:38.399564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927384+0000","last_change":"2024-03-30T13:13:24.947993+0000","last_active":"2024-03-30T13:13:25.927384+0000","last_peered":"2024-03-30T13:13:25.927384+0000","last_clean":"2024-03-30T13:13:25.927384+0000","last_became_active":"2024-03-30T13:13:24.947711+0000","last_became_peered":"2024-03-30T13:13:24.947711+0000","last_unstale":"2024-03-30T13:13:25.927384+0000","last_undegraded":"2024-03-30T13:13:25.927384+0000","last_fullsized":"2024-03-30T13:13:25.927384+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:12:19.243241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927408+0000","last_change":"2024-03-30T13:13:24.937291+0000","last_active":"2024-03-30T13:13:25.927408+0000","last_peered":"2024-03-30T13:13:25.927408+0000","last_clean":"2024-03-30T13:13:25.927408+0000","last_became_active":"2024-03-30T13:13:24.936746+0000","last_became_peered":"2024-03-30T13:13:24.936746+0000","last_unstale":"2024-03-30T13:13:25.927408+0000","last_undegraded":"2024-03-30T13:13:25.927408+0000","last_fullsized":"2024-03-30T13:13:25.927408+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:43:13.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558422+0000","last_change":"2024-03-30T13:13:24.930014+0000","last_active":"2024-03-30T13:13:26.558422+0000","last_peered":"2024-03-30T13:13:26.558422+0000","last_clean":"2024-03-30T13:13:26.558422+0000","last_became_active":"2024-03-30T13:13:24.929670+0000","last_became_peered":"2024-03-30T13:13:24.929670+0000","last_unstale":"2024-03-30T13:13:26.558422+0000","last_undegraded":"2024-03-30T13:13:26.558422+0000","last_fullsized":"2024-03-30T13:13:26.558422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:29:34.921944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.933762+0000","last_change":"2024-03-30T13:13:24.940932+0000","last_active":"2024-03-30T13:13:25.933762+0000","last_peered":"2024-03-30T13:13:25.933762+0000","last_clean":"2024-03-30T13:13:25.933762+0000","last_became_active":"2024-03-30T13:13:24.940655+0000","last_became_peered":"2024-03-30T13:13:24.940655+0000","last_unstale":"2024-03-30T13:13:25.933762+0000","last_undegraded":"2024-03-30T13:13:25.933762+0000","last_fullsized":"2024-03-30T13:13:25.933762+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:06.544052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312364+0000","last_change":"2024-03-30T13:13:24.945794+0000","last_active":"2024-03-30T13:13:26.312364+0000","last_peered":"2024-03-30T13:13:26.312364+0000","last_clean":"2024-03-30T13:13:26.312364+0000","last_became_active":"2024-03-30T13:13:24.945398+0000","last_became_peered":"2024-03-30T13:13:24.945398+0000","last_unstale":"2024-03-30T13:13:26.312364+0000","last_undegraded":"2024-03-30T13:13:26.312364+0000","last_fullsized":"2024-03-30T13:13:26.312364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:48.857782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.561166+0000","last_change":"2024-03-30T13:13:24.942052+0000","last_active":"2024-03-30T13:13:26.561166+0000","last_peered":"2024-03-30T13:13:26.561166+0000","last_clean":"2024-03-30T13:13:26.561166+0000","last_became_active":"2024-03-30T13:13:24.941161+0000","last_became_peered":"2024-03-30T13:13:24.941161+0000","last_unstale":"2024-03-30T13:13:26.561166+0000","last_undegraded":"2024-03-30T13:13:26.561166+0000","last_fullsized":"2024-03-30T13:13:26.561166+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:25:48.336489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937550+0000","last_change":"2024-03-30T13:13:24.936995+0000","last_active":"2024-03-30T13:13:25.937550+0000","last_peered":"2024-03-30T13:13:25.937550+0000","last_clean":"2024-03-30T13:13:25.937550+0000","last_became_active":"2024-03-30T13:13:24.936724+0000","last_became_peered":"2024-03-30T13:13:24.936724+0000","last_unstale":"2024-03-30T13:13:25.937550+0000","last_undegraded":"2024-03-30T13:13:25.937550+0000","last_fullsized":"2024-03-30T13:13:25.937550+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:16:05.845450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935947+0000","last_change":"2024-03-30T13:13:24.937824+0000","last_active":"2024-03-30T13:13:25.935947+0000","last_peered":"2024-03-30T13:13:25.935947+0000","last_clean":"2024-03-30T13:13:25.935947+0000","last_became_active":"2024-03-30T13:13:24.937424+0000","last_became_peered":"2024-03-30T13:13:24.937424+0000","last_unstale":"2024-03-30T13:13:25.935947+0000","last_undegraded":"2024-03-30T13:13:25.935947+0000","last_fullsized":"2024-03-30T13:13:25.935947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:01.919458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560837+0000","last_change":"2024-03-30T13:13:24.951191+0000","last_active":"2024-03-30T13:13:26.560837+0000","last_peered":"2024-03-30T13:13:26.560837+0000","last_clean":"2024-03-30T13:13:26.560837+0000","last_became_active":"2024-03-30T13:13:24.950840+0000","last_became_peered":"2024-03-30T13:13:24.950840+0000","last_unstale":"2024-03-30T13:13:26.560837+0000","last_undegraded":"2024-03-30T13:13:26.560837+0000","last_fullsized":"2024-03-30T13:13:26.560837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:32:37.703237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935965+0000","last_change":"2024-03-30T13:13:24.933576+0000","last_active":"2024-03-30T13:13:25.935965+0000","last_peered":"2024-03-30T13:13:25.935965+0000","last_clean":"2024-03-30T13:13:25.935965+0000","last_became_active":"2024-03-30T13:13:24.933261+0000","last_became_peered":"2024-03-30T13:13:24.933261+0000","last_unstale":"2024-03-30T13:13:25.935965+0000","last_undegraded":"2024-03-30T13:13:25.935965+0000","last_fullsized":"2024-03-30T13:13:25.935965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:16:27.204486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558241+0000","last_change":"2024-03-30T13:13:24.925051+0000","last_active":"2024-03-30T13:13:26.558241+0000","last_peered":"2024-03-30T13:13:26.558241+0000","last_clean":"2024-03-30T13:13:26.558241+0000","last_became_active":"2024-03-30T13:13:24.924651+0000","last_became_peered":"2024-03-30T13:13:24.924651+0000","last_unstale":"2024-03-30T13:13:26.558241+0000","last_undegraded":"2024-03-30T13:13:26.558241+0000","last_fullsized":"2024-03-30T13:13:26.558241+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:11:49.156277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.934166+0000","last_change":"2024-03-30T13:13:24.946201+0000","last_active":"2024-03-30T13:13:25.934166+0000","last_peered":"2024-03-30T13:13:25.934166+0000","last_clean":"2024-03-30T13:13:25.934166+0000","last_became_active":"2024-03-30T13:13:24.945720+0000","last_became_peered":"2024-03-30T13:13:24.945720+0000","last_unstale":"2024-03-30T13:13:25.934166+0000","last_undegraded":"2024-03-30T13:13:25.934166+0000","last_fullsized":"2024-03-30T13:13:25.934166+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:46:37.184683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.932773+0000","last_change":"2024-03-30T13:13:24.939447+0000","last_active":"2024-03-30T13:13:25.932773+0000","last_peered":"2024-03-30T13:13:25.932773+0000","last_clean":"2024-03-30T13:13:25.932773+0000","last_became_active":"2024-03-30T13:13:24.939130+0000","last_became_peered":"2024-03-30T13:13:24.939130+0000","last_unstale":"2024-03-30T13:13:25.932773+0000","last_undegraded":"2024-03-30T13:13:25.932773+0000","last_fullsized":"2024-03-30T13:13:25.932773+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:42:41.962873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937559+0000","last_change":"2024-03-30T13:13:24.940595+0000","last_active":"2024-03-30T13:13:25.937559+0000","last_peered":"2024-03-30T13:13:25.937559+0000","last_clean":"2024-03-30T13:13:25.937559+0000","last_became_active":"2024-03-30T13:13:24.940303+0000","last_became_peered":"2024-03-30T13:13:24.940303+0000","last_unstale":"2024-03-30T13:13:25.937559+0000","last_undegraded":"2024-03-30T13:13:25.937559+0000","last_fullsized":"2024-03-30T13:13:25.937559+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:19:01.919458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.561038+0000","last_change":"2024-03-30T13:13:24.936819+0000","last_active":"2024-03-30T13:13:26.561038+0000","last_peered":"2024-03-30T13:13:26.561038+0000","last_clean":"2024-03-30T13:13:26.561038+0000","last_became_active":"2024-03-30T13:13:24.936416+0000","last_became_peered":"2024-03-30T13:13:24.936416+0000","last_unstale":"2024-03-30T13:13:26.561038+0000","last_undegraded":"2024-03-30T13:13:26.561038+0000","last_fullsized":"2024-03-30T13:13:26.561038+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:28:45.868296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927823+0000","last_change":"2024-03-30T13:13:24.944867+0000","last_active":"2024-03-30T13:13:25.927823+0000","last_peered":"2024-03-30T13:13:25.927823+0000","last_clean":"2024-03-30T13:13:25.927823+0000","last_became_active":"2024-03-30T13:13:24.944515+0000","last_became_peered":"2024-03-30T13:13:24.944515+0000","last_unstale":"2024-03-30T13:13:25.927823+0000","last_undegraded":"2024-03-30T13:13:25.927823+0000","last_fullsized":"2024-03-30T13:13:25.927823+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:11.845513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560908+0000","last_change":"2024-03-30T13:13:24.932873+0000","last_active":"2024-03-30T13:13:26.560908+0000","last_peered":"2024-03-30T13:13:26.560908+0000","last_clean":"2024-03-30T13:13:26.560908+0000","last_became_active":"2024-03-30T13:13:24.932568+0000","last_became_peered":"2024-03-30T13:13:24.932568+0000","last_unstale":"2024-03-30T13:13:26.560908+0000","last_undegraded":"2024-03-30T13:13:26.560908+0000","last_fullsized":"2024-03-30T13:13:26.560908+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:29.827966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936484+0000","last_change":"2024-03-30T13:13:24.941578+0000","last_active":"2024-03-30T13:13:25.936484+0000","last_peered":"2024-03-30T13:13:25.936484+0000","last_clean":"2024-03-30T13:13:25.936484+0000","last_became_active":"2024-03-30T13:13:24.941271+0000","last_became_peered":"2024-03-30T13:13:24.941271+0000","last_unstale":"2024-03-30T13:13:25.936484+0000","last_undegraded":"2024-03-30T13:13:25.936484+0000","last_fullsized":"2024-03-30T13:13:25.936484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:13:43.596917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559662+0000","last_change":"2024-03-30T13:13:24.950241+0000","last_active":"2024-03-30T13:13:26.559662+0000","last_peered":"2024-03-30T13:13:26.559662+0000","last_clean":"2024-03-30T13:13:26.559662+0000","last_became_active":"2024-03-30T13:13:24.949773+0000","last_became_peered":"2024-03-30T13:13:24.949773+0000","last_unstale":"2024-03-30T13:13:26.559662+0000","last_undegraded":"2024-03-30T13:13:26.559662+0000","last_fullsized":"2024-03-30T13:13:26.559662+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:29:34.921944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.932979+0000","last_change":"2024-03-30T13:13:24.949377+0000","last_active":"2024-03-30T13:13:25.932979+0000","last_peered":"2024-03-30T13:13:25.932979+0000","last_clean":"2024-03-30T13:13:25.932979+0000","last_became_active":"2024-03-30T13:13:24.948977+0000","last_became_peered":"2024-03-30T13:13:24.948977+0000","last_unstale":"2024-03-30T13:13:25.932979+0000","last_undegraded":"2024-03-30T13:13:25.932979+0000","last_fullsized":"2024-03-30T13:13:25.932979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:02:58.879182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927147+0000","last_change":"2024-03-30T13:13:24.939423+0000","last_active":"2024-03-30T13:13:25.927147+0000","last_peered":"2024-03-30T13:13:25.927147+0000","last_clean":"2024-03-30T13:13:25.927147+0000","last_became_active":"2024-03-30T13:13:24.939153+0000","last_became_peered":"2024-03-30T13:13:24.939153+0000","last_unstale":"2024-03-30T13:13:25.927147+0000","last_undegraded":"2024-03-30T13:13:25.927147+0000","last_fullsized":"2024-03-30T13:13:25.927147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:13:55.741135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.561079+0000","last_change":"2024-03-30T13:13:24.934918+0000","last_active":"2024-03-30T13:13:26.561079+0000","last_peered":"2024-03-30T13:13:26.561079+0000","last_clean":"2024-03-30T13:13:26.561079+0000","last_became_active":"2024-03-30T13:13:24.934348+0000","last_became_peered":"2024-03-30T13:13:24.934348+0000","last_unstale":"2024-03-30T13:13:26.561079+0000","last_undegraded":"2024-03-30T13:13:26.561079+0000","last_fullsized":"2024-03-30T13:13:26.561079+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:25.356557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559920+0000","last_change":"2024-03-30T13:13:24.935924+0000","last_active":"2024-03-30T13:13:26.559920+0000","last_peered":"2024-03-30T13:13:26.559920+0000","last_clean":"2024-03-30T13:13:26.559920+0000","last_became_active":"2024-03-30T13:13:24.935616+0000","last_became_peered":"2024-03-30T13:13:24.935616+0000","last_unstale":"2024-03-30T13:13:26.559920+0000","last_undegraded":"2024-03-30T13:13:26.559920+0000","last_fullsized":"2024-03-30T13:13:26.559920+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:27.932652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560398+0000","last_change":"2024-03-30T13:13:24.945549+0000","last_active":"2024-03-30T13:13:26.560398+0000","last_peered":"2024-03-30T13:13:26.560398+0000","last_clean":"2024-03-30T13:13:26.560398+0000","last_became_active":"2024-03-30T13:13:24.945243+0000","last_became_peered":"2024-03-30T13:13:24.945243+0000","last_unstale":"2024-03-30T13:13:26.560398+0000","last_undegraded":"2024-03-30T13:13:26.560398+0000","last_fullsized":"2024-03-30T13:13:26.560398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:28:47.620617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937130+0000","last_change":"2024-03-30T13:13:24.947492+0000","last_active":"2024-03-30T13:13:25.937130+0000","last_peered":"2024-03-30T13:13:25.937130+0000","last_clean":"2024-03-30T13:13:25.937130+0000","last_became_active":"2024-03-30T13:13:24.947189+0000","last_became_peered":"2024-03-30T13:13:24.947189+0000","last_unstale":"2024-03-30T13:13:25.937130+0000","last_undegraded":"2024-03-30T13:13:25.937130+0000","last_fullsized":"2024-03-30T13:13:25.937130+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:29:49.897116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560350+0000","last_change":"2024-03-30T13:13:24.933293+0000","last_active":"2024-03-30T13:13:26.560350+0000","last_peered":"2024-03-30T13:13:26.560350+0000","last_clean":"2024-03-30T13:13:26.560350+0000","last_became_active":"2024-03-30T13:13:24.933025+0000","last_became_peered":"2024-03-30T13:13:24.933025+0000","last_unstale":"2024-03-30T13:13:26.560350+0000","last_undegraded":"2024-03-30T13:13:26.560350+0000","last_fullsized":"2024-03-30T13:13:26.560350+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:08.019034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560552+0000","last_change":"2024-03-30T13:13:24.929414+0000","last_active":"2024-03-30T13:13:26.560552+0000","last_peered":"2024-03-30T13:13:26.560552+0000","last_clean":"2024-03-30T13:13:26.560552+0000","last_became_active":"2024-03-30T13:13:24.929055+0000","last_became_peered":"2024-03-30T13:13:24.929055+0000","last_unstale":"2024-03-30T13:13:26.560552+0000","last_undegraded":"2024-03-30T13:13:26.560552+0000","last_fullsized":"2024-03-30T13:13:26.560552+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:38:49.015365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.933584+0000","last_change":"2024-03-30T13:13:24.949110+0000","last_active":"2024-03-30T13:13:25.933584+0000","last_peered":"2024-03-30T13:13:25.933584+0000","last_clean":"2024-03-30T13:13:25.933584+0000","last_became_active":"2024-03-30T13:13:24.948809+0000","last_became_peered":"2024-03-30T13:13:24.948809+0000","last_unstale":"2024-03-30T13:13:25.933584+0000","last_undegraded":"2024-03-30T13:13:25.933584+0000","last_fullsized":"2024-03-30T13:13:25.933584+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:54:15.639267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558430+0000","last_change":"2024-03-30T13:13:24.949015+0000","last_active":"2024-03-30T13:13:26.558430+0000","last_peered":"2024-03-30T13:13:26.558430+0000","last_clean":"2024-03-30T13:13:26.558430+0000","last_became_active":"2024-03-30T13:13:24.948697+0000","last_became_peered":"2024-03-30T13:13:24.948697+0000","last_unstale":"2024-03-30T13:13:26.558430+0000","last_undegraded":"2024-03-30T13:13:26.558430+0000","last_fullsized":"2024-03-30T13:13:26.558430+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:19:42.226017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935645+0000","last_change":"2024-03-30T13:13:24.944732+0000","last_active":"2024-03-30T13:13:25.935645+0000","last_peered":"2024-03-30T13:13:25.935645+0000","last_clean":"2024-03-30T13:13:25.935645+0000","last_became_active":"2024-03-30T13:13:24.944398+0000","last_became_peered":"2024-03-30T13:13:24.944398+0000","last_unstale":"2024-03-30T13:13:25.935645+0000","last_undegraded":"2024-03-30T13:13:25.935645+0000","last_fullsized":"2024-03-30T13:13:25.935645+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:46:37.184683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560950+0000","last_change":"2024-03-30T13:13:23.912435+0000","last_active":"2024-03-30T13:13:26.560950+0000","last_peered":"2024-03-30T13:13:26.560950+0000","last_clean":"2024-03-30T13:13:26.560950+0000","last_became_active":"2024-03-30T13:13:23.912109+0000","last_became_peered":"2024-03-30T13:13:23.912109+0000","last_unstale":"2024-03-30T13:13:26.560950+0000","last_undegraded":"2024-03-30T13:13:26.560950+0000","last_fullsized":"2024-03-30T13:13:26.560950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:43:12.875054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559894+0000","last_change":"2024-03-30T13:13:24.935447+0000","last_active":"2024-03-30T13:13:26.559894+0000","last_peered":"2024-03-30T13:13:26.559894+0000","last_clean":"2024-03-30T13:13:26.559894+0000","last_became_active":"2024-03-30T13:13:24.935129+0000","last_became_peered":"2024-03-30T13:13:24.935129+0000","last_unstale":"2024-03-30T13:13:26.559894+0000","last_undegraded":"2024-03-30T13:13:26.559894+0000","last_fullsized":"2024-03-30T13:13:26.559894+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:19:14.766849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560906+0000","last_change":"2024-03-30T13:13:23.905749+0000","last_active":"2024-03-30T13:13:26.560906+0000","last_peered":"2024-03-30T13:13:26.560906+0000","last_clean":"2024-03-30T13:13:26.560906+0000","last_became_active":"2024-03-30T13:13:23.905396+0000","last_became_peered":"2024-03-30T13:13:23.905396+0000","last_unstale":"2024-03-30T13:13:26.560906+0000","last_undegraded":"2024-03-30T13:13:26.560906+0000","last_fullsized":"2024-03-30T13:13:26.560906+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:47.127657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559467+0000","last_change":"2024-03-30T13:13:24.926075+0000","last_active":"2024-03-30T13:13:26.559467+0000","last_peered":"2024-03-30T13:13:26.559467+0000","last_clean":"2024-03-30T13:13:26.559467+0000","last_became_active":"2024-03-30T13:13:24.925773+0000","last_became_peered":"2024-03-30T13:13:24.925773+0000","last_unstale":"2024-03-30T13:13:26.559467+0000","last_undegraded":"2024-03-30T13:13:26.559467+0000","last_fullsized":"2024-03-30T13:13:26.559467+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:45.193052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559798+0000","last_change":"2024-03-30T13:13:23.907148+0000","last_active":"2024-03-30T13:13:26.559798+0000","last_peered":"2024-03-30T13:13:26.559798+0000","last_clean":"2024-03-30T13:13:26.559798+0000","last_became_active":"2024-03-30T13:13:23.906845+0000","last_became_peered":"2024-03-30T13:13:23.906845+0000","last_unstale":"2024-03-30T13:13:26.559798+0000","last_undegraded":"2024-03-30T13:13:26.559798+0000","last_fullsized":"2024-03-30T13:13:26.559798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:19:01.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313210+0000","last_change":"2024-03-30T13:13:24.925531+0000","last_active":"2024-03-30T13:13:26.313210+0000","last_peered":"2024-03-30T13:13:26.313210+0000","last_clean":"2024-03-30T13:13:26.313210+0000","last_became_active":"2024-03-30T13:13:24.925210+0000","last_became_peered":"2024-03-30T13:13:24.925210+0000","last_unstale":"2024-03-30T13:13:26.313210+0000","last_undegraded":"2024-03-30T13:13:26.313210+0000","last_fullsized":"2024-03-30T13:13:26.313210+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:55:24.799048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558712+0000","last_change":"2024-03-30T13:13:23.913141+0000","last_active":"2024-03-30T13:13:26.558712+0000","last_peered":"2024-03-30T13:13:26.558712+0000","last_clean":"2024-03-30T13:13:26.558712+0000","last_became_active":"2024-03-30T13:13:23.912862+0000","last_became_peered":"2024-03-30T13:13:23.912862+0000","last_unstale":"2024-03-30T13:13:26.558712+0000","last_undegraded":"2024-03-30T13:13:26.558712+0000","last_fullsized":"2024-03-30T13:13:26.558712+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:04:33.269431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558847+0000","last_change":"2024-03-30T13:13:24.936927+0000","last_active":"2024-03-30T13:13:26.558847+0000","last_peered":"2024-03-30T13:13:26.558847+0000","last_clean":"2024-03-30T13:13:26.558847+0000","last_became_active":"2024-03-30T13:13:24.936696+0000","last_became_peered":"2024-03-30T13:13:24.936696+0000","last_unstale":"2024-03-30T13:13:26.558847+0000","last_undegraded":"2024-03-30T13:13:26.558847+0000","last_fullsized":"2024-03-30T13:13:26.558847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:19:42.226017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936632+0000","last_change":"2024-03-30T13:13:23.909692+0000","last_active":"2024-03-30T13:13:25.936632+0000","last_peered":"2024-03-30T13:13:25.936632+0000","last_clean":"2024-03-30T13:13:25.936632+0000","last_became_active":"2024-03-30T13:13:23.909057+0000","last_became_peered":"2024-03-30T13:13:23.909057+0000","last_unstale":"2024-03-30T13:13:25.936632+0000","last_undegraded":"2024-03-30T13:13:25.936632+0000","last_fullsized":"2024-03-30T13:13:25.936632+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T19:28:44.855733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935443+0000","last_change":"2024-03-30T13:13:24.941969+0000","last_active":"2024-03-30T13:13:25.935443+0000","last_peered":"2024-03-30T13:13:25.935443+0000","last_clean":"2024-03-30T13:13:25.935443+0000","last_became_active":"2024-03-30T13:13:24.941381+0000","last_became_peered":"2024-03-30T13:13:24.941381+0000","last_unstale":"2024-03-30T13:13:25.935443+0000","last_undegraded":"2024-03-30T13:13:25.935443+0000","last_fullsized":"2024-03-30T13:13:25.935443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:05.103106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.934648+0000","last_change":"2024-03-30T13:13:23.913401+0000","last_active":"2024-03-30T13:13:25.934648+0000","last_peered":"2024-03-30T13:13:25.934648+0000","last_clean":"2024-03-30T13:13:25.934648+0000","last_became_active":"2024-03-30T13:13:23.913124+0000","last_became_peered":"2024-03-30T13:13:23.913124+0000","last_unstale":"2024-03-30T13:13:25.934648+0000","last_undegraded":"2024-03-30T13:13:25.934648+0000","last_fullsized":"2024-03-30T13:13:25.934648+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:49:28.815403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558700+0000","last_change":"2024-03-30T13:13:24.942700+0000","last_active":"2024-03-30T13:13:26.558700+0000","last_peered":"2024-03-30T13:13:26.558700+0000","last_clean":"2024-03-30T13:13:26.558700+0000","last_became_active":"2024-03-30T13:13:24.942280+0000","last_became_peered":"2024-03-30T13:13:24.942280+0000","last_unstale":"2024-03-30T13:13:26.558700+0000","last_undegraded":"2024-03-30T13:13:26.558700+0000","last_fullsized":"2024-03-30T13:13:26.558700+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:33:40.881861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558297+0000","last_change":"2024-03-30T13:13:23.914025+0000","last_active":"2024-03-30T13:13:26.558297+0000","last_peered":"2024-03-30T13:13:26.558297+0000","last_clean":"2024-03-30T13:13:26.558297+0000","last_became_active":"2024-03-30T13:13:23.913731+0000","last_became_peered":"2024-03-30T13:13:23.913731+0000","last_unstale":"2024-03-30T13:13:26.558297+0000","last_undegraded":"2024-03-30T13:13:26.558297+0000","last_fullsized":"2024-03-30T13:13:26.558297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:17:36.792074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312710+0000","last_change":"2024-03-30T13:13:24.922261+0000","last_active":"2024-03-30T13:13:26.312710+0000","last_peered":"2024-03-30T13:13:26.312710+0000","last_clean":"2024-03-30T13:13:26.312710+0000","last_became_active":"2024-03-30T13:13:24.921795+0000","last_became_peered":"2024-03-30T13:13:24.921795+0000","last_unstale":"2024-03-30T13:13:26.312710+0000","last_undegraded":"2024-03-30T13:13:26.312710+0000","last_fullsized":"2024-03-30T13:13:26.312710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:50:29.747181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.557952+0000","last_change":"2024-03-30T13:13:23.914096+0000","last_active":"2024-03-30T13:13:26.557952+0000","last_peered":"2024-03-30T13:13:26.557952+0000","last_clean":"2024-03-30T13:13:26.557952+0000","last_became_active":"2024-03-30T13:13:23.913765+0000","last_became_peered":"2024-03-30T13:13:23.913765+0000","last_unstale":"2024-03-30T13:13:26.557952+0000","last_undegraded":"2024-03-30T13:13:26.557952+0000","last_fullsized":"2024-03-30T13:13:26.557952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:12:05.502548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927543+0000","last_change":"2024-03-30T13:13:24.950234+0000","last_active":"2024-03-30T13:13:25.927543+0000","last_peered":"2024-03-30T13:13:25.927543+0000","last_clean":"2024-03-30T13:13:25.927543+0000","last_became_active":"2024-03-30T13:13:24.945869+0000","last_became_peered":"2024-03-30T13:13:24.945869+0000","last_unstale":"2024-03-30T13:13:25.927543+0000","last_undegraded":"2024-03-30T13:13:25.927543+0000","last_fullsized":"2024-03-30T13:13:25.927543+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:51:18.065282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313213+0000","last_change":"2024-03-30T13:13:23.907227+0000","last_active":"2024-03-30T13:13:26.313213+0000","last_peered":"2024-03-30T13:13:26.313213+0000","last_clean":"2024-03-30T13:13:26.313213+0000","last_became_active":"2024-03-30T13:13:23.906937+0000","last_became_peered":"2024-03-30T13:13:23.906937+0000","last_unstale":"2024-03-30T13:13:26.313213+0000","last_undegraded":"2024-03-30T13:13:26.313213+0000","last_fullsized":"2024-03-30T13:13:26.313213+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:19:41.213454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935422+0000","last_change":"2024-03-30T13:13:24.924923+0000","last_active":"2024-03-30T13:13:25.935422+0000","last_peered":"2024-03-30T13:13:25.935422+0000","last_clean":"2024-03-30T13:13:25.935422+0000","last_became_active":"2024-03-30T13:13:24.923094+0000","last_became_peered":"2024-03-30T13:13:24.923094+0000","last_unstale":"2024-03-30T13:13:25.935422+0000","last_undegraded":"2024-03-30T13:13:25.935422+0000","last_fullsized":"2024-03-30T13:13:25.935422+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:09:33.229806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937693+0000","last_change":"2024-03-30T13:13:23.909082+0000","last_active":"2024-03-30T13:13:25.937693+0000","last_peered":"2024-03-30T13:13:25.937693+0000","last_clean":"2024-03-30T13:13:25.937693+0000","last_became_active":"2024-03-30T13:13:23.908747+0000","last_became_peered":"2024-03-30T13:13:23.908747+0000","last_unstale":"2024-03-30T13:13:25.937693+0000","last_undegraded":"2024-03-30T13:13:25.937693+0000","last_fullsized":"2024-03-30T13:13:25.937693+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:25:10.504569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560854+0000","last_change":"2024-03-30T13:13:24.927692+0000","last_active":"2024-03-30T13:13:26.560854+0000","last_peered":"2024-03-30T13:13:26.560854+0000","last_clean":"2024-03-30T13:13:26.560854+0000","last_became_active":"2024-03-30T13:13:24.927182+0000","last_became_peered":"2024-03-30T13:13:24.927182+0000","last_unstale":"2024-03-30T13:13:26.560854+0000","last_undegraded":"2024-03-30T13:13:26.560854+0000","last_fullsized":"2024-03-30T13:13:26.560854+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:39:21.652459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936864+0000","last_change":"2024-03-30T13:13:23.907257+0000","last_active":"2024-03-30T13:13:25.936864+0000","last_peered":"2024-03-30T13:13:25.936864+0000","last_clean":"2024-03-30T13:13:25.936864+0000","last_became_active":"2024-03-30T13:13:23.906115+0000","last_became_peered":"2024-03-30T13:13:23.906115+0000","last_unstale":"2024-03-30T13:13:25.936864+0000","last_undegraded":"2024-03-30T13:13:25.936864+0000","last_fullsized":"2024-03-30T13:13:25.936864+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:19:24.343994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560048+0000","last_change":"2024-03-30T13:13:24.949472+0000","last_active":"2024-03-30T13:13:26.560048+0000","last_peered":"2024-03-30T13:13:26.560048+0000","last_clean":"2024-03-30T13:13:26.560048+0000","last_became_active":"2024-03-30T13:13:24.949147+0000","last_became_peered":"2024-03-30T13:13:24.949147+0000","last_unstale":"2024-03-30T13:13:26.560048+0000","last_undegraded":"2024-03-30T13:13:26.560048+0000","last_fullsized":"2024-03-30T13:13:26.560048+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:19:42.226017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312819+0000","last_change":"2024-03-30T13:13:23.904054+0000","last_active":"2024-03-30T13:13:26.312819+0000","last_peered":"2024-03-30T13:13:26.312819+0000","last_clean":"2024-03-30T13:13:26.312819+0000","last_became_active":"2024-03-30T13:13:23.903743+0000","last_became_peered":"2024-03-30T13:13:23.903743+0000","last_unstale":"2024-03-30T13:13:26.312819+0000","last_undegraded":"2024-03-30T13:13:26.312819+0000","last_fullsized":"2024-03-30T13:13:26.312819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:44.180489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559457+0000","last_change":"2024-03-30T13:13:24.939455+0000","last_active":"2024-03-30T13:13:26.559457+0000","last_peered":"2024-03-30T13:13:26.559457+0000","last_clean":"2024-03-30T13:13:26.559457+0000","last_became_active":"2024-03-30T13:13:24.939178+0000","last_became_peered":"2024-03-30T13:13:24.939178+0000","last_unstale":"2024-03-30T13:13:26.559457+0000","last_undegraded":"2024-03-30T13:13:26.559457+0000","last_fullsized":"2024-03-30T13:13:26.559457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:27:16.659922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312822+0000","last_change":"2024-03-30T13:13:23.912339+0000","last_active":"2024-03-30T13:13:26.312822+0000","last_peered":"2024-03-30T13:13:26.312822+0000","last_clean":"2024-03-30T13:13:26.312822+0000","last_became_active":"2024-03-30T13:13:23.912014+0000","last_became_peered":"2024-03-30T13:13:23.912014+0000","last_unstale":"2024-03-30T13:13:26.312822+0000","last_undegraded":"2024-03-30T13:13:26.312822+0000","last_fullsized":"2024-03-30T13:13:26.312822+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:29:33.909381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312507+0000","last_change":"2024-03-30T13:13:24.935581+0000","last_active":"2024-03-30T13:13:26.312507+0000","last_peered":"2024-03-30T13:13:26.312507+0000","last_clean":"2024-03-30T13:13:26.312507+0000","last_became_active":"2024-03-30T13:13:24.934328+0000","last_became_peered":"2024-03-30T13:13:24.934328+0000","last_unstale":"2024-03-30T13:13:26.312507+0000","last_undegraded":"2024-03-30T13:13:26.312507+0000","last_fullsized":"2024-03-30T13:13:26.312507+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:50:47.878866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558554+0000","last_change":"2024-03-30T13:13:23.909571+0000","last_active":"2024-03-30T13:13:26.558554+0000","last_peered":"2024-03-30T13:13:26.558554+0000","last_clean":"2024-03-30T13:13:26.558554+0000","last_became_active":"2024-03-30T13:13:23.908787+0000","last_became_peered":"2024-03-30T13:13:23.908787+0000","last_unstale":"2024-03-30T13:13:26.558554+0000","last_undegraded":"2024-03-30T13:13:26.558554+0000","last_fullsized":"2024-03-30T13:13:26.558554+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:30:47.127657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.934972+0000","last_change":"2024-03-30T13:13:24.949259+0000","last_active":"2024-03-30T13:13:25.934972+0000","last_peered":"2024-03-30T13:13:25.934972+0000","last_clean":"2024-03-30T13:13:25.934972+0000","last_became_active":"2024-03-30T13:13:24.948978+0000","last_became_peered":"2024-03-30T13:13:24.948978+0000","last_unstale":"2024-03-30T13:13:25.934972+0000","last_undegraded":"2024-03-30T13:13:25.934972+0000","last_fullsized":"2024-03-30T13:13:25.934972+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:51:11.515578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559517+0000","last_change":"2024-03-30T13:13:23.912393+0000","last_active":"2024-03-30T13:13:26.559517+0000","last_peered":"2024-03-30T13:13:26.559517+0000","last_clean":"2024-03-30T13:13:26.559517+0000","last_became_active":"2024-03-30T13:13:23.911987+0000","last_became_peered":"2024-03-30T13:13:23.911987+0000","last_unstale":"2024-03-30T13:13:26.559517+0000","last_undegraded":"2024-03-30T13:13:26.559517+0000","last_fullsized":"2024-03-30T13:13:26.559517+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:12:18.230678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312750+0000","last_change":"2024-03-30T13:13:24.929096+0000","last_active":"2024-03-30T13:13:26.312750+0000","last_peered":"2024-03-30T13:13:26.312750+0000","last_clean":"2024-03-30T13:13:26.312750+0000","last_became_active":"2024-03-30T13:13:24.928756+0000","last_became_peered":"2024-03-30T13:13:24.928756+0000","last_unstale":"2024-03-30T13:13:26.312750+0000","last_undegraded":"2024-03-30T13:13:26.312750+0000","last_fullsized":"2024-03-30T13:13:26.312750+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:38:59.271961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.932662+0000","last_change":"2024-03-30T13:13:23.910811+0000","last_active":"2024-03-30T13:13:25.932662+0000","last_peered":"2024-03-30T13:13:25.932662+0000","last_clean":"2024-03-30T13:13:25.932662+0000","last_became_active":"2024-03-30T13:13:23.910524+0000","last_became_peered":"2024-03-30T13:13:23.910524+0000","last_unstale":"2024-03-30T13:13:25.932662+0000","last_undegraded":"2024-03-30T13:13:25.932662+0000","last_fullsized":"2024-03-30T13:13:25.932662+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:37:07.006471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312978+0000","last_change":"2024-03-30T13:13:24.921721+0000","last_active":"2024-03-30T13:13:26.312978+0000","last_peered":"2024-03-30T13:13:26.312978+0000","last_clean":"2024-03-30T13:13:26.312978+0000","last_became_active":"2024-03-30T13:13:24.921340+0000","last_became_peered":"2024-03-30T13:13:24.921340+0000","last_unstale":"2024-03-30T13:13:26.312978+0000","last_undegraded":"2024-03-30T13:13:26.312978+0000","last_fullsized":"2024-03-30T13:13:26.312978+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:54:43.683984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937516+0000","last_change":"2024-03-30T13:13:23.910688+0000","last_active":"2024-03-30T13:13:25.937516+0000","last_peered":"2024-03-30T13:13:25.937516+0000","last_clean":"2024-03-30T13:13:25.937516+0000","last_became_active":"2024-03-30T13:13:23.910389+0000","last_became_peered":"2024-03-30T13:13:23.910389+0000","last_unstale":"2024-03-30T13:13:25.937516+0000","last_undegraded":"2024-03-30T13:13:25.937516+0000","last_fullsized":"2024-03-30T13:13:25.937516+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:54:48.348579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936429+0000","last_change":"2024-03-30T13:13:24.941714+0000","last_active":"2024-03-30T13:13:25.936429+0000","last_peered":"2024-03-30T13:13:25.936429+0000","last_clean":"2024-03-30T13:13:25.936429+0000","last_became_active":"2024-03-30T13:13:24.941308+0000","last_became_peered":"2024-03-30T13:13:24.941308+0000","last_unstale":"2024-03-30T13:13:25.936429+0000","last_undegraded":"2024-03-30T13:13:25.936429+0000","last_fullsized":"2024-03-30T13:13:25.936429+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:46:34.360151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559491+0000","last_change":"2024-03-30T13:13:23.917176+0000","last_active":"2024-03-30T13:13:26.559491+0000","last_peered":"2024-03-30T13:13:26.559491+0000","last_clean":"2024-03-30T13:13:26.559491+0000","last_became_active":"2024-03-30T13:13:23.916685+0000","last_became_peered":"2024-03-30T13:13:23.916685+0000","last_unstale":"2024-03-30T13:13:26.559491+0000","last_undegraded":"2024-03-30T13:13:26.559491+0000","last_fullsized":"2024-03-30T13:13:26.559491+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:19:01.231166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559142+0000","last_change":"2024-03-30T13:13:24.930644+0000","last_active":"2024-03-30T13:13:26.559142+0000","last_peered":"2024-03-30T13:13:26.559142+0000","last_clean":"2024-03-30T13:13:26.559142+0000","last_became_active":"2024-03-30T13:13:24.930343+0000","last_became_peered":"2024-03-30T13:13:24.930343+0000","last_unstale":"2024-03-30T13:13:26.559142+0000","last_undegraded":"2024-03-30T13:13:26.559142+0000","last_fullsized":"2024-03-30T13:13:26.559142+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:01:37.950139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927745+0000","last_change":"2024-03-30T13:13:23.902484+0000","last_active":"2024-03-30T13:13:25.927745+0000","last_peered":"2024-03-30T13:13:25.927745+0000","last_clean":"2024-03-30T13:13:25.927745+0000","last_became_active":"2024-03-30T13:13:23.902216+0000","last_became_peered":"2024-03-30T13:13:23.902216+0000","last_unstale":"2024-03-30T13:13:25.927745+0000","last_undegraded":"2024-03-30T13:13:25.927745+0000","last_fullsized":"2024-03-30T13:13:25.927745+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:55:03.679777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.928018+0000","last_change":"2024-03-30T13:13:24.949378+0000","last_active":"2024-03-30T13:13:25.928018+0000","last_peered":"2024-03-30T13:13:25.928018+0000","last_clean":"2024-03-30T13:13:25.928018+0000","last_became_active":"2024-03-30T13:13:24.944690+0000","last_became_peered":"2024-03-30T13:13:24.944690+0000","last_unstale":"2024-03-30T13:13:25.928018+0000","last_undegraded":"2024-03-30T13:13:25.928018+0000","last_fullsized":"2024-03-30T13:13:25.928018+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:43:31.023520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558918+0000","last_change":"2024-03-30T13:13:23.910268+0000","last_active":"2024-03-30T13:13:26.558918+0000","last_peered":"2024-03-30T13:13:26.558918+0000","last_clean":"2024-03-30T13:13:26.558918+0000","last_became_active":"2024-03-30T13:13:23.909961+0000","last_became_peered":"2024-03-30T13:13:23.909961+0000","last_unstale":"2024-03-30T13:13:26.558918+0000","last_undegraded":"2024-03-30T13:13:26.558918+0000","last_fullsized":"2024-03-30T13:13:26.558918+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:13:03.451305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.933139+0000","last_change":"2024-03-30T13:13:24.944391+0000","last_active":"2024-03-30T13:13:25.933139+0000","last_peered":"2024-03-30T13:13:25.933139+0000","last_clean":"2024-03-30T13:13:25.933139+0000","last_became_active":"2024-03-30T13:13:24.944103+0000","last_became_peered":"2024-03-30T13:13:24.944103+0000","last_unstale":"2024-03-30T13:13:25.933139+0000","last_undegraded":"2024-03-30T13:13:25.933139+0000","last_fullsized":"2024-03-30T13:13:25.933139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:56:05.047128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927510+0000","last_change":"2024-03-30T13:13:23.906510+0000","last_active":"2024-03-30T13:13:25.927510+0000","last_peered":"2024-03-30T13:13:25.927510+0000","last_clean":"2024-03-30T13:13:25.927510+0000","last_became_active":"2024-03-30T13:13:23.906250+0000","last_became_peered":"2024-03-30T13:13:23.906250+0000","last_unstale":"2024-03-30T13:13:25.927510+0000","last_undegraded":"2024-03-30T13:13:25.927510+0000","last_fullsized":"2024-03-30T13:13:25.927510+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:32:41.206020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560470+0000","last_change":"2024-03-30T13:13:24.928466+0000","last_active":"2024-03-30T13:13:26.560470+0000","last_peered":"2024-03-30T13:13:26.560470+0000","last_clean":"2024-03-30T13:13:26.560470+0000","last_became_active":"2024-03-30T13:13:24.928199+0000","last_became_peered":"2024-03-30T13:13:24.928199+0000","last_unstale":"2024-03-30T13:13:26.560470+0000","last_undegraded":"2024-03-30T13:13:26.560470+0000","last_fullsized":"2024-03-30T13:13:26.560470+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:24:27.932652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927271+0000","last_change":"2024-03-30T13:13:23.908274+0000","last_active":"2024-03-30T13:13:25.927271+0000","last_peered":"2024-03-30T13:13:25.927271+0000","last_clean":"2024-03-30T13:13:25.927271+0000","last_became_active":"2024-03-30T13:13:23.908014+0000","last_became_peered":"2024-03-30T13:13:23.908014+0000","last_unstale":"2024-03-30T13:13:25.927271+0000","last_undegraded":"2024-03-30T13:13:25.927271+0000","last_fullsized":"2024-03-30T13:13:25.927271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:29:03.705190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.936075+0000","last_change":"2024-03-30T13:13:24.943618+0000","last_active":"2024-03-30T13:13:25.936075+0000","last_peered":"2024-03-30T13:13:25.936075+0000","last_clean":"2024-03-30T13:13:25.936075+0000","last_became_active":"2024-03-30T13:13:24.943319+0000","last_became_peered":"2024-03-30T13:13:24.943319+0000","last_unstale":"2024-03-30T13:13:25.936075+0000","last_undegraded":"2024-03-30T13:13:25.936075+0000","last_fullsized":"2024-03-30T13:13:25.936075+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T13:47:59.300554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.934155+0000","last_change":"2024-03-30T13:13:23.913050+0000","last_active":"2024-03-30T13:13:25.934155+0000","last_peered":"2024-03-30T13:13:25.934155+0000","last_clean":"2024-03-30T13:13:25.934155+0000","last_became_active":"2024-03-30T13:13:23.910147+0000","last_became_peered":"2024-03-30T13:13:23.910147+0000","last_unstale":"2024-03-30T13:13:25.934155+0000","last_undegraded":"2024-03-30T13:13:25.934155+0000","last_fullsized":"2024-03-30T13:13:25.934155+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:38:48.002802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312882+0000","last_change":"2024-03-30T13:13:24.923947+0000","last_active":"2024-03-30T13:13:26.312882+0000","last_peered":"2024-03-30T13:13:26.312882+0000","last_clean":"2024-03-30T13:13:26.312882+0000","last_became_active":"2024-03-30T13:13:24.923452+0000","last_became_peered":"2024-03-30T13:13:24.923452+0000","last_unstale":"2024-03-30T13:13:26.312882+0000","last_undegraded":"2024-03-30T13:13:26.312882+0000","last_fullsized":"2024-03-30T13:13:26.312882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:56:26.254760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.927062+0000","last_change":"2024-03-30T13:13:23.906042+0000","last_active":"2024-03-30T13:13:25.927062+0000","last_peered":"2024-03-30T13:13:25.927062+0000","last_clean":"2024-03-30T13:13:25.927062+0000","last_became_active":"2024-03-30T13:13:23.905731+0000","last_became_peered":"2024-03-30T13:13:23.905731+0000","last_unstale":"2024-03-30T13:13:25.927062+0000","last_undegraded":"2024-03-30T13:13:25.927062+0000","last_fullsized":"2024-03-30T13:13:25.927062+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T18:21:24.535622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559038+0000","last_change":"2024-03-30T13:13:24.945544+0000","last_active":"2024-03-30T13:13:26.559038+0000","last_peered":"2024-03-30T13:13:26.559038+0000","last_clean":"2024-03-30T13:13:26.559038+0000","last_became_active":"2024-03-30T13:13:24.945246+0000","last_became_peered":"2024-03-30T13:13:24.945246+0000","last_unstale":"2024-03-30T13:13:26.559038+0000","last_undegraded":"2024-03-30T13:13:26.559038+0000","last_fullsized":"2024-03-30T13:13:26.559038+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:27:16.659922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.938015+0000","last_change":"2024-03-30T13:13:23.906657+0000","last_active":"2024-03-30T13:13:25.938015+0000","last_peered":"2024-03-30T13:13:25.938015+0000","last_clean":"2024-03-30T13:13:25.938015+0000","last_became_active":"2024-03-30T13:13:23.906356+0000","last_became_peered":"2024-03-30T13:13:23.906356+0000","last_unstale":"2024-03-30T13:13:25.938015+0000","last_undegraded":"2024-03-30T13:13:25.938015+0000","last_fullsized":"2024-03-30T13:13:25.938015+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T16:27:00.100392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935866+0000","last_change":"2024-03-30T13:13:24.925860+0000","last_active":"2024-03-30T13:13:25.935866+0000","last_peered":"2024-03-30T13:13:25.935866+0000","last_clean":"2024-03-30T13:13:25.935866+0000","last_became_active":"2024-03-30T13:13:24.923570+0000","last_became_peered":"2024-03-30T13:13:24.923570+0000","last_unstale":"2024-03-30T13:13:25.935866+0000","last_undegraded":"2024-03-30T13:13:25.935866+0000","last_fullsized":"2024-03-30T13:13:25.935866+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:05.103106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.944800+0000","last_change":"2024-03-30T13:13:23.911792+0000","last_active":"2024-03-30T13:13:25.944800+0000","last_peered":"2024-03-30T13:13:25.944800+0000","last_clean":"2024-03-30T13:13:25.944800+0000","last_became_active":"2024-03-30T13:13:23.911449+0000","last_became_peered":"2024-03-30T13:13:23.911449+0000","last_unstale":"2024-03-30T13:13:25.944800+0000","last_undegraded":"2024-03-30T13:13:25.944800+0000","last_fullsized":"2024-03-30T13:13:25.944800+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T17:27:29.816936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.313272+0000","last_change":"2024-03-30T13:13:24.930626+0000","last_active":"2024-03-30T13:13:26.313272+0000","last_peered":"2024-03-30T13:13:26.313272+0000","last_clean":"2024-03-30T13:13:26.313272+0000","last_became_active":"2024-03-30T13:13:24.930269+0000","last_became_peered":"2024-03-30T13:13:24.930269+0000","last_unstale":"2024-03-30T13:13:26.313272+0000","last_undegraded":"2024-03-30T13:13:26.313272+0000","last_fullsized":"2024-03-30T13:13:26.313272+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:39:59.822381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560471+0000","last_change":"2024-03-30T13:13:23.901415+0000","last_active":"2024-03-30T13:13:26.560471+0000","last_peered":"2024-03-30T13:13:26.560471+0000","last_clean":"2024-03-30T13:13:26.560471+0000","last_became_active":"2024-03-30T13:13:23.900935+0000","last_became_peered":"2024-03-30T13:13:23.900935+0000","last_unstale":"2024-03-30T13:13:26.560471+0000","last_undegraded":"2024-03-30T13:13:26.560471+0000","last_fullsized":"2024-03-30T13:13:26.560471+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:13:03.451305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.559860+0000","last_change":"2024-03-30T13:13:24.929852+0000","last_active":"2024-03-30T13:13:26.559860+0000","last_peered":"2024-03-30T13:13:26.559860+0000","last_clean":"2024-03-30T13:13:26.559860+0000","last_became_active":"2024-03-30T13:13:24.929560+0000","last_became_peered":"2024-03-30T13:13:24.929560+0000","last_unstale":"2024-03-30T13:13:26.559860+0000","last_undegraded":"2024-03-30T13:13:26.559860+0000","last_fullsized":"2024-03-30T13:13:26.559860+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T00:19:14.766849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560586+0000","last_change":"2024-03-30T13:13:23.907243+0000","last_active":"2024-03-30T13:13:26.560586+0000","last_peered":"2024-03-30T13:13:26.560586+0000","last_clean":"2024-03-30T13:13:26.560586+0000","last_became_active":"2024-03-30T13:13:23.906998+0000","last_became_peered":"2024-03-30T13:13:23.906998+0000","last_unstale":"2024-03-30T13:13:26.560586+0000","last_undegraded":"2024-03-30T13:13:26.560586+0000","last_fullsized":"2024-03-30T13:13:26.560586+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:14:03.970356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558398+0000","last_change":"2024-03-30T13:13:24.927802+0000","last_active":"2024-03-30T13:13:26.558398+0000","last_peered":"2024-03-30T13:13:26.558398+0000","last_clean":"2024-03-30T13:13:26.558398+0000","last_became_active":"2024-03-30T13:13:24.926782+0000","last_became_peered":"2024-03-30T13:13:24.926782+0000","last_unstale":"2024-03-30T13:13:26.558398+0000","last_undegraded":"2024-03-30T13:13:26.558398+0000","last_fullsized":"2024-03-30T13:13:26.558398+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T22:10:45.193052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.560258+0000","last_change":"2024-03-30T13:13:23.912742+0000","last_active":"2024-03-30T13:13:26.560258+0000","last_peered":"2024-03-30T13:13:26.560258+0000","last_clean":"2024-03-30T13:13:26.560258+0000","last_became_active":"2024-03-30T13:13:23.912393+0000","last_became_peered":"2024-03-30T13:13:23.912393+0000","last_unstale":"2024-03-30T13:13:26.560258+0000","last_undegraded":"2024-03-30T13:13:26.560258+0000","last_fullsized":"2024-03-30T13:13:26.560258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:13:54.728572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.558891+0000","last_change":"2024-03-30T13:13:24.932828+0000","last_active":"2024-03-30T13:13:26.558891+0000","last_peered":"2024-03-30T13:13:26.558891+0000","last_clean":"2024-03-30T13:13:26.558891+0000","last_became_active":"2024-03-30T13:13:24.931315+0000","last_became_peered":"2024-03-30T13:13:24.931315+0000","last_unstale":"2024-03-30T13:13:26.558891+0000","last_undegraded":"2024-03-30T13:13:26.558891+0000","last_fullsized":"2024-03-30T13:13:26.558891+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T20:34:06.451438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.557958+0000","last_change":"2024-03-30T13:13:23.914082+0000","last_active":"2024-03-30T13:13:26.557958+0000","last_peered":"2024-03-30T13:13:26.557958+0000","last_clean":"2024-03-30T13:13:26.557958+0000","last_became_active":"2024-03-30T13:13:23.911673+0000","last_became_peered":"2024-03-30T13:13:23.911673+0000","last_unstale":"2024-03-30T13:13:26.557958+0000","last_undegraded":"2024-03-30T13:13:26.557958+0000","last_fullsized":"2024-03-30T13:13:26.557958+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:26:33.267469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935443+0000","last_change":"2024-03-30T13:13:24.921325+0000","last_active":"2024-03-30T13:13:25.935443+0000","last_peered":"2024-03-30T13:13:25.935443+0000","last_clean":"2024-03-30T13:13:25.935443+0000","last_became_active":"2024-03-30T13:13:24.920741+0000","last_became_peered":"2024-03-30T13:13:24.920741+0000","last_unstale":"2024-03-30T13:13:25.935443+0000","last_undegraded":"2024-03-30T13:13:25.935443+0000","last_fullsized":"2024-03-30T13:13:25.935443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T21:20:06.544052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:26.312345+0000","last_change":"2024-03-30T13:13:23.904883+0000","last_active":"2024-03-30T13:13:26.312345+0000","last_peered":"2024-03-30T13:13:26.312345+0000","last_clean":"2024-03-30T13:13:26.312345+0000","last_became_active":"2024-03-30T13:13:23.904444+0000","last_became_peered":"2024-03-30T13:13:23.904444+0000","last_unstale":"2024-03-30T13:13:26.312345+0000","last_undegraded":"2024-03-30T13:13:26.312345+0000","last_fullsized":"2024-03-30T13:13:26.312345+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-01T01:01:36.937575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.937189+0000","last_change":"2024-03-30T13:13:24.947600+0000","last_active":"2024-03-30T13:13:25.937189+0000","last_peered":"2024-03-30T13:13:25.937189+0000","last_clean":"2024-03-30T13:13:25.937189+0000","last_became_active":"2024-03-30T13:13:24.947367+0000","last_became_peered":"2024-03-30T13:13:24.947367+0000","last_unstale":"2024-03-30T13:13:25.937189+0000","last_undegraded":"2024-03-30T13:13:25.937189+0000","last_fullsized":"2024-03-30T13:13:25.937189+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:23.867835+0000","last_clean_scrub_stamp":"2024-03-30T13:13:23.867835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:19.282770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.935829+0000","last_change":"2024-03-30T13:13:23.901342+0000","last_active":"2024-03-30T13:13:25.935829+0000","last_peered":"2024-03-30T13:13:25.935829+0000","last_clean":"2024-03-30T13:13:25.935829+0000","last_became_active":"2024-03-30T13:13:23.901013+0000","last_became_peered":"2024-03-30T13:13:23.901013+0000","last_unstale":"2024-03-30T13:13:25.935829+0000","last_undegraded":"2024-03-30T13:13:25.935829+0000","last_fullsized":"2024-03-30T13:13:25.935829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:13:22.855272+0000","last_clean_scrub_stamp":"2024-03-30T13:13:22.855272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T15:28:46.608054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":206,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-30T13:13:25.932993+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:13:25.932993+0000","last_peered":"2024-03-30T13:13:25.932993+0000","last_clean":"2024-03-30T13:13:25.932993+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:13:25.932993+0000","last_undegraded":"2024-03-30T13:13:25.932993+0000","last_fullsized":"2024-03-30T13:13:25.932993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509468,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":792703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":201235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509467,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":200765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":201257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509468,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":202299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":200743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509466,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1064960,"data_stored":791055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":200723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:13:35.075 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-30T13:13:35.075 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-30T13:13:35.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.346+0000 7fdb17e00640 1 Processor -- start 2024-03-30T13:13:35.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.346+0000 7fdb17e00640 1 -- start start 2024-03-30T13:13:35.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.347+0000 7fdb17e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb1815e710 0x7fdb180cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.347+0000 7fdb17e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdb180d0850 0x7fdb180d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.347+0000 7fdb17e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb180d27b0 0x7fdb180d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.347+0000 7fdb17e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fdb180d15f0 con 0x7fdb180d0850 2024-03-30T13:13:35.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.347+0000 7fdb17e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fdb180cecc0 con 0x7fdb1815e710 2024-03-30T13:13:35.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.347+0000 7fdb17e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fdb180d3180 con 0x7fdb180d27b0 2024-03-30T13:13:35.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.347+0000 7fdb16000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdb180d0850 0x7fdb180d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.348+0000 7fdb16000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdb180d0850 0x7fdb180d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39368/0 (socket says 172.21.15.44:39368) 2024-03-30T13:13:35.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.348+0000 7fdb16000640 1 -- 172.21.15.44:0/1987657885 learned_addr learned my addr 172.21.15.44:0/1987657885 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:35.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.348+0000 7fdb17400640 1 --2- 172.21.15.44:0/1987657885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb180d27b0 0x7fdb180d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.348+0000 7fdb16a00640 1 --2- 172.21.15.44:0/1987657885 >> v2:172.21.15.151:3300/0 conn(0x7fdb1815e710 0x7fdb180cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.348+0000 7fdb16000640 1 -- 172.21.15.44:0/1987657885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb180d27b0 msgr2=0x7fdb180d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:35.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.348+0000 7fdb16000640 1 --2- 172.21.15.44:0/1987657885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb180d27b0 0x7fdb180d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.348+0000 7fdb16000640 1 -- 172.21.15.44:0/1987657885 >> v2:172.21.15.151:3300/0 conn(0x7fdb1815e710 msgr2=0x7fdb180cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:35.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.348+0000 7fdb16000640 1 --2- 172.21.15.44:0/1987657885 >> v2:172.21.15.151:3300/0 conn(0x7fdb1815e710 0x7fdb180cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.348+0000 7fdb16000640 1 -- 172.21.15.44:0/1987657885 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb180d1310 con 0x7fdb180d0850 2024-03-30T13:13:35.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.348+0000 7fdb16a00640 1 --2- 172.21.15.44:0/1987657885 >> v2:172.21.15.151:3300/0 conn(0x7fdb1815e710 0x7fdb180cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:35.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.350+0000 7fdb16000640 1 --2- 172.21.15.44:0/1987657885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb180d0850 0x7fdb180d0cb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdb1806e6b0 tx=0x7fdb0002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fae6cecca2a1bd7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:35.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.350+0000 7fdb15600640 1 -- 172.21.15.44:0/1987657885 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0002ca70 con 0x7fdb180d0850 2024-03-30T13:13:35.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.350+0000 7fdb15600640 1 -- 172.21.15.44:0/1987657885 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0002cc10 con 0x7fdb180d0850 2024-03-30T13:13:35.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.350+0000 7fdb15600640 1 -- 172.21.15.44:0/1987657885 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb000343f0 con 0x7fdb180d0850 2024-03-30T13:13:35.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.350+0000 7fdb17e00640 1 -- 172.21.15.44:0/1987657885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb180d0850 msgr2=0x7fdb180d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:35.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.350+0000 7fdb17e00640 1 --2- 172.21.15.44:0/1987657885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb180d0850 0x7fdb180d0cb0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdb1806e6b0 tx=0x7fdb0002bed0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.351+0000 7fdb17e00640 1 -- 172.21.15.44:0/1987657885 shutdown_connections 2024-03-30T13:13:35.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.351+0000 7fdb17e00640 1 --2- 172.21.15.44:0/1987657885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb180d27b0 0x7fdb180d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.351+0000 7fdb17e00640 1 --2- 172.21.15.44:0/1987657885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb180d0850 0x7fdb180d0cb0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.351+0000 7fdb17e00640 1 --2- 172.21.15.44:0/1987657885 >> v2:172.21.15.151:3300/0 conn(0x7fdb1815e710 0x7fdb180cfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.351+0000 7fdb17e00640 1 -- 172.21.15.44:0/1987657885 >> 172.21.15.44:0/1987657885 conn(0x7fdb1809d500 msgr2=0x7fdb180d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:35.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.351+0000 7fdb17e00640 1 -- 172.21.15.44:0/1987657885 shutdown_connections 2024-03-30T13:13:35.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.351+0000 7fdb17e00640 1 -- 172.21.15.44:0/1987657885 wait complete. 2024-03-30T13:13:35.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.352+0000 7fdb17e00640 1 Processor -- start 2024-03-30T13:13:35.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.353+0000 7fdb17e00640 1 -- start start 2024-03-30T13:13:35.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.354+0000 7fdb17e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb180d0850 0x7fdb1809e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.354+0000 7fdb17e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb180d27b0 0x7fdb180b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.354+0000 7fdb17e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1815e710 0x7fdb18154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.354+0000 7fdb17e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdb180cf520 con 0x7fdb180d0850 2024-03-30T13:13:35.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.354+0000 7fdb17e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdb180cf240 con 0x7fdb1815e710 2024-03-30T13:13:35.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.354+0000 7fdb17e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fdb180d21e0 con 0x7fdb180d27b0 2024-03-30T13:13:35.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.354+0000 7fdb16a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb180d0850 0x7fdb1809e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.354+0000 7fdb16000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb180d27b0 0x7fdb180b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.354+0000 7fdb17400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1815e710 0x7fdb18154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.354+0000 7fdb16a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb180d0850 0x7fdb1809e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39384/0 (socket says 172.21.15.44:39384) 2024-03-30T13:13:35.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.354+0000 7fdb16a00640 1 -- 172.21.15.44:0/2882153558 learned_addr learned my addr 172.21.15.44:0/2882153558 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:35.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.355+0000 7fdb16a00640 1 -- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb180d27b0 msgr2=0x7fdb180b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:35.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.355+0000 7fdb16a00640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb180d27b0 0x7fdb180b7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.355+0000 7fdb16a00640 1 -- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1815e710 msgr2=0x7fdb18154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:35.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.355+0000 7fdb16a00640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1815e710 0x7fdb18154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.355+0000 7fdb16a00640 1 -- 172.21.15.44:0/2882153558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb180b8900 con 0x7fdb180d0850 2024-03-30T13:13:35.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.355+0000 7fdb17400640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1815e710 0x7fdb18154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:35.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.355+0000 7fdb16a00640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb180d0850 0x7fdb1809e370 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800e810 tx=0x7fdb0800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:35.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.355+0000 7fdb0f400640 1 -- 172.21.15.44:0/2882153558 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800f040 con 0x7fdb180d0850 2024-03-30T13:13:35.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.355+0000 7fdb0f400640 1 -- 172.21.15.44:0/2882153558 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb08004030 con 0x7fdb180d0850 2024-03-30T13:13:35.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.355+0000 7fdb0f400640 1 -- 172.21.15.44:0/2882153558 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb08004400 con 0x7fdb180d0850 2024-03-30T13:13:35.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.355+0000 7fdb17e00640 1 -- 172.21.15.44:0/2882153558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb180b8be0 con 0x7fdb180d0850 2024-03-30T13:13:35.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.356+0000 7fdb17e00640 1 -- 172.21.15.44:0/2882153558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb180b91a0 con 0x7fdb180d0850 2024-03-30T13:13:35.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.357+0000 7fdb17e00640 1 -- 172.21.15.44:0/2882153558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb18075890 con 0x7fdb180d0850 2024-03-30T13:13:35.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.359+0000 7fdb0f400640 1 -- 172.21.15.44:0/2882153558 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdb0800c6d0 con 0x7fdb180d0850 2024-03-30T13:13:35.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.359+0000 7fdb0f400640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdaf406c560 0x7fdaf406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.360+0000 7fdb0f400640 1 -- 172.21.15.44:0/2882153558 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fdb0808b630 con 0x7fdb180d0850 2024-03-30T13:13:35.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.360+0000 7fdb16000640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdaf406c560 0x7fdaf406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.361+0000 7fdb16000640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdaf406c560 0x7fdaf406ea20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdb00035000 tx=0x7fdb00030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:35.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.365+0000 7fdb0f400640 1 -- 172.21.15.44:0/2882153558 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fdb08017020 con 0x7fdb180d0850 2024-03-30T13:13:35.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.652+0000 7fdb17e00640 1 -- 172.21.15.44:0/2882153558 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fdb180d1780 con 0x7fdb180d0850 2024-03-30T13:13:35.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.655+0000 7fdb0f400640 1 -- 172.21.15.44:0/2882153558 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fdb080593d0 con 0x7fdb180d0850 2024-03-30T13:13:35.660 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-03-30T13:13:35.660 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBKDwhmQIprJBAAmTYCUPcFur+aT859aD7+jQ== 2024-03-30T13:13:35.660 INFO:teuthology.orchestra.run.smithi044.stdout: caps mds = "allow" 2024-03-30T13:13:35.660 INFO:teuthology.orchestra.run.smithi044.stdout: caps mon = "allow r" 2024-03-30T13:13:35.661 INFO:teuthology.orchestra.run.smithi044.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-30T13:13:35.661 INFO:teuthology.orchestra.run.smithi044.stderr:updated caps for client.0 2024-03-30T13:13:35.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.658+0000 7fdb17e00640 1 -- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdaf406c560 msgr2=0x7fdaf406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:35.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.658+0000 7fdb17e00640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdaf406c560 0x7fdaf406ea20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdb00035000 tx=0x7fdb00030000 comp rx=0 tx=0).stop 2024-03-30T13:13:35.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.658+0000 7fdb17e00640 1 -- 172.21.15.44:0/2882153558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb180d0850 msgr2=0x7fdb1809e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:35.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.658+0000 7fdb17e00640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb180d0850 0x7fdb1809e370 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800e810 tx=0x7fdb0800ecd0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.658+0000 7fdb17e00640 1 -- 172.21.15.44:0/2882153558 shutdown_connections 2024-03-30T13:13:35.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.658+0000 7fdb17e00640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdaf406c560 0x7fdaf406ea20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.658+0000 7fdb17e00640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1815e710 0x7fdb18154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.658+0000 7fdb17e00640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb180d27b0 0x7fdb180b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.658+0000 7fdb17e00640 1 --2- 172.21.15.44:0/2882153558 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdb180d0850 0x7fdb1809e370 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.658+0000 7fdb17e00640 1 -- 172.21.15.44:0/2882153558 >> 172.21.15.44:0/2882153558 conn(0x7fdb1809d500 msgr2=0x7fdb180d46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.658+0000 7fdb17e00640 1 -- 172.21.15.44:0/2882153558 shutdown_connections 2024-03-30T13:13:35.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.658+0000 7fdb17e00640 1 -- 172.21.15.44:0/2882153558 wait complete. 2024-03-30T13:13:35.683 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:13:35.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.892+0000 7f8e16800640 1 Processor -- start 2024-03-30T13:13:35.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.892+0000 7f8e16800640 1 -- start start 2024-03-30T13:13:35.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.894+0000 7f8e16800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8e10072e30 0x7f8e1006b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.894+0000 7f8e16800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e1006bf20 con 0x7f8e101605d0 2024-03-30T13:13:35.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.894+0000 7f8e16800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e1015c610 con 0x7f8e1006bac0 2024-03-30T13:13:35.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.894+0000 7f8e16800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f8e10160a40 con 0x7f8e10072e30 2024-03-30T13:13:35.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.894+0000 7f8e15e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8e101605d0 0x7f8e100cf7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:54076/0 (socket says 172.21.15.44:54076) 2024-03-30T13:13:35.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.894+0000 7f8e15e00640 1 -- 172.21.15.44:0/2203483539 learned_addr learned my addr 172.21.15.44:0/2203483539 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:35.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.895+0000 7f8e15400640 1 --2- 172.21.15.44:0/2203483539 >> v2:172.21.15.151:3300/0 conn(0x7f8e10072e30 0x7f8e1006b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.895+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099831984 0 0) 0x7f8e1006bf20 con 0x7f8e101605d0 2024-03-30T13:13:35.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.895+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8df8003520 con 0x7f8e101605d0 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.895+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2413454002 0 0) 0x7f8df8003520 con 0x7f8e101605d0 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.895+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 >> v2:172.21.15.151:3300/0 conn(0x7f8e10072e30 msgr2=0x7f8e1006b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.895+0000 7f8e0fe00640 1 --2- 172.21.15.44:0/2203483539 >> v2:172.21.15.151:3300/0 conn(0x7f8e10072e30 0x7f8e1006b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.895+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 >> v1:172.21.15.151:6789/0 conn(0x7f8e1006bac0 legacy=0x7f8e1015fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.896+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1015c890 con 0x7f8e101605d0 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.896+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f8e080019f0 con 0x7f8e101605d0 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.896+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 >> v1:172.21.15.44:6789/0 conn(0x7f8e101605d0 legacy=0x7f8e100cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.896+0000 7f8e0fe00640 1 --2- 172.21.15.44:0/2203483539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 0x7f8df8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.896+0000 7f8e0fe00640 1 --2- 172.21.15.44:0/2203483539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8df8004800 0x7f8df8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.896+0000 7f8e0fe00640 1 --2- 172.21.15.44:0/2203483539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8df80051c0 0x7f8df800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.896+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8e10160a40 con 0x7f8df80039b0 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.896+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8df800c060 con 0x7f8df80051c0 2024-03-30T13:13:35.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.896+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f8df800c260 con 0x7f8df8004800 2024-03-30T13:13:35.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.896+0000 7f8e15400640 1 --2- 172.21.15.44:0/2203483539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 0x7f8df8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.896+0000 7f8e15e00640 1 --2- 172.21.15.44:0/2203483539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8df80051c0 0x7f8df800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.896+0000 7f8e14a00640 1 --2- 172.21.15.44:0/2203483539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8df8004800 0x7f8df8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.897+0000 7f8e15400640 1 -- 172.21.15.44:0/2203483539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8df8004800 msgr2=0x7f8df8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:35.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.897+0000 7f8e15400640 1 --2- 172.21.15.44:0/2203483539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8df8004800 0x7f8df8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.897+0000 7f8e15400640 1 -- 172.21.15.44:0/2203483539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8df80051c0 msgr2=0x7f8df800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:35.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.897+0000 7f8e15400640 1 --2- 172.21.15.44:0/2203483539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8df80051c0 0x7f8df800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.897+0000 7f8e15400640 1 -- 172.21.15.44:0/2203483539 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df8003520 con 0x7f8df80039b0 2024-03-30T13:13:35.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.897+0000 7f8e15e00640 1 -- 172.21.15.44:0/2203483539 reap_dead start 2024-03-30T13:13:35.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.898+0000 7f8e15400640 1 --2- 172.21.15.44:0/2203483539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 0x7f8df8003dd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009ac0 tx=0x7f8df8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18aea6f201ea72ec server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:35.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.898+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04039070 con 0x7f8df80039b0 2024-03-30T13:13:35.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.898+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e0402c6b0 con 0x7f8df80039b0 2024-03-30T13:13:35.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.898+0000 7f8e0fe00640 1 -- 172.21.15.44:0/2203483539 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04009690 con 0x7f8df80039b0 2024-03-30T13:13:35.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.899+0000 7f8e16800640 1 -- 172.21.15.44:0/2203483539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 msgr2=0x7f8df8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:35.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.899+0000 7f8e16800640 1 --2- 172.21.15.44:0/2203483539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 0x7f8df8003dd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009ac0 tx=0x7f8df8005830 comp rx=0 tx=0).stop 2024-03-30T13:13:35.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.899+0000 7f8e16800640 1 -- 172.21.15.44:0/2203483539 shutdown_connections 2024-03-30T13:13:35.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.899+0000 7f8e16800640 1 --2- 172.21.15.44:0/2203483539 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 0x7f8df8003dd0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.899+0000 7f8e16800640 1 -- 172.21.15.44:0/2203483539 >> 172.21.15.44:0/2203483539 conn(0x7f8e1006d130 msgr2=0x7f8e100b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:35.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.899+0000 7f8e16800640 1 -- 172.21.15.44:0/2203483539 shutdown_connections 2024-03-30T13:13:35.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.899+0000 7f8e16800640 1 -- 172.21.15.44:0/2203483539 wait complete. 2024-03-30T13:13:35.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.901+0000 7f8e16800640 1 Processor -- start 2024-03-30T13:13:35.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.901+0000 7f8e16800640 1 -- start start 2024-03-30T13:13:35.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.902+0000 7f8e16800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 0x7f8e10144440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.902+0000 7f8e16800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e10134bb0 0x7f8e100b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.902+0000 7f8e16800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e100b4ef0 0x7f8e101327e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.902+0000 7f8e16800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1015ce50 con 0x7f8df80039b0 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.902+0000 7f8e16800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1015d1c0 con 0x7f8e10134bb0 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.902+0000 7f8e16800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f8e10073210 con 0x7f8e100b4ef0 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.902+0000 7f8e15400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 0x7f8e10144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.902+0000 7f8e15400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 0x7f8e10144440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39404/0 (socket says 172.21.15.44:39404) 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.902+0000 7f8e15400640 1 -- 172.21.15.44:0/1989292318 learned_addr learned my addr 172.21.15.44:0/1989292318 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e15400640 1 -- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e100b4ef0 msgr2=0x7f8e101327e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e14a00640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e10134bb0 0x7f8e100b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e15e00640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e100b4ef0 0x7f8e101327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e15400640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e100b4ef0 0x7f8e101327e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e15400640 1 -- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e10134bb0 msgr2=0x7f8e100b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:35.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e15400640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e10134bb0 0x7f8e100b49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:35.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e15400640 1 -- 172.21.15.44:0/1989292318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e10144c90 con 0x7f8df80039b0 2024-03-30T13:13:35.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e14a00640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e10134bb0 0x7f8e100b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:35.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e15400640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 0x7f8e10144440 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009be0 tx=0x7f8e04004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:35.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e0d600640 1 -- 172.21.15.44:0/1989292318 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04042020 con 0x7f8df80039b0 2024-03-30T13:13:35.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e0d600640 1 -- 172.21.15.44:0/1989292318 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e0403a040 con 0x7f8df80039b0 2024-03-30T13:13:35.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e0d600640 1 -- 172.21.15.44:0/1989292318 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04039070 con 0x7f8df80039b0 2024-03-30T13:13:35.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e16800640 1 -- 172.21.15.44:0/1989292318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e10144f70 con 0x7f8df80039b0 2024-03-30T13:13:35.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.903+0000 7f8e16800640 1 -- 172.21.15.44:0/1989292318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e101322c0 con 0x7f8df80039b0 2024-03-30T13:13:35.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.905+0000 7f8e16800640 1 -- 172.21.15.44:0/1989292318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e10075890 con 0x7f8df80039b0 2024-03-30T13:13:35.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.907+0000 7f8e0d600640 1 -- 172.21.15.44:0/1989292318 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8e04045020 con 0x7f8df80039b0 2024-03-30T13:13:35.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.907+0000 7f8e0d600640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8df006c530 0x7f8df006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:35.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.907+0000 7f8e0d600640 1 -- 172.21.15.44:0/1989292318 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f8e040acc20 con 0x7f8df80039b0 2024-03-30T13:13:35.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.908+0000 7f8e14a00640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8df006c530 0x7f8df006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:35.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.909+0000 7f8e14a00640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8df006c530 0x7f8df006e9f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e10145630 tx=0x7f8dfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:35.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:35.913+0000 7f8e0d600640 1 -- 172.21.15.44:0/1989292318 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8e0404c070 con 0x7f8df80039b0 2024-03-30T13:13:36.166 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.161+0000 7f8e16800640 1 -- 172.21.15.44:0/1989292318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e100b52d0 con 0x7f8df80039b0 2024-03-30T13:13:36.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.162+0000 7f8e0d600640 1 -- 172.21.15.44:0/1989292318 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f8e0407b0a0 con 0x7f8df80039b0 2024-03-30T13:13:36.167 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:13:36.168 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/3435907345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3435907345},{"type":"v1","addr":"172.21.15.151:6836","nonce":3435907345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3966337326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":3966337326},{"type":"v1","addr":"172.21.15.151:6837","nonce":3966337326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/4136308231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":4136308231},{"type":"v1","addr":"172.21.15.44:6833","nonce":4136308231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:13:24.374039+0000","modified":"2024-03-30T13:13:27.463153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/585602782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":585602782},{"type":"v1","addr":"172.21.15.44:6835","nonce":585602782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5298,"qdb_cluster":[5298]},"id":2}]} 2024-03-30T13:13:36.168 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-03-30T13:13:36.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.165+0000 7f8e16800640 1 -- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8df006c530 msgr2=0x7f8df006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:36.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.165+0000 7f8e16800640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8df006c530 0x7f8df006e9f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e10145630 tx=0x7f8dfc009040 comp rx=0 tx=0).stop 2024-03-30T13:13:36.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.165+0000 7f8e16800640 1 -- 172.21.15.44:0/1989292318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 msgr2=0x7f8e10144440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:36.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.165+0000 7f8e16800640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 0x7f8e10144440 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009be0 tx=0x7f8e04004730 comp rx=0 tx=0).stop 2024-03-30T13:13:36.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.165+0000 7f8e16800640 1 -- 172.21.15.44:0/1989292318 shutdown_connections 2024-03-30T13:13:36.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.165+0000 7f8e16800640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e100b4ef0 0x7f8e101327e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.165+0000 7f8e16800640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8df006c530 0x7f8df006e9f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.165+0000 7f8e16800640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e10134bb0 0x7f8e100b49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.165+0000 7f8e16800640 1 --2- 172.21.15.44:0/1989292318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8df80039b0 0x7f8e10144440 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.165+0000 7f8e16800640 1 -- 172.21.15.44:0/1989292318 >> 172.21.15.44:0/1989292318 conn(0x7f8e1006d130 msgr2=0x7f8e1015e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:36.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.165+0000 7f8e16800640 1 -- 172.21.15.44:0/1989292318 shutdown_connections 2024-03-30T13:13:36.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.165+0000 7f8e16800640 1 -- 172.21.15.44:0/1989292318 wait complete. 2024-03-30T13:13:36.592 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-30T13:13:24.374039+0000', 'modified': '2024-03-30T13:13:27.463153+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5298}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5298': {'gid': 5298, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.44:6835/585602782', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6834', 'nonce': 585602782}, {'type': 'v1', 'addr': '172.21.15.44:6835', 'nonce': 585602782}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5298, 'qdb_cluster': [5298]} 2024-03-30T13:13:36.593 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-30T13:13:36.593 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-30T13:13:36.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.816+0000 7f479de00640 1 Processor -- start 2024-03-30T13:13:36.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.816+0000 7f479de00640 1 -- start start 2024-03-30T13:13:36.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.818+0000 7f479de00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4798145850 0x7f4798072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.818+0000 7f479de00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4798148bb0 0x7f4798072a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.818+0000 7f479de00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4798163b70 con 0x7f4798166210 2024-03-30T13:13:36.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.818+0000 7f479de00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4798166f20 con 0x7f4798145850 2024-03-30T13:13:36.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.818+0000 7f479de00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f47981480d0 con 0x7f4798148bb0 2024-03-30T13:13:36.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.818+0000 7f479ca00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4798145850 0x7f4798072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.818+0000 7f479ca00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4798145850 0x7f4798072510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39414/0 (socket says 172.21.15.44:39414) 2024-03-30T13:13:36.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.818+0000 7f479ca00640 1 -- 172.21.15.44:0/2128186568 learned_addr learned my addr 172.21.15.44:0/2128186568 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:36.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.818+0000 7f479ca00640 1 -- 172.21.15.44:0/2128186568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4798148bb0 msgr2=0x7f4798072a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:36.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.818+0000 7f4797e00640 1 --2- 172.21.15.44:0/2128186568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4798148bb0 0x7f4798072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.819+0000 7f479ca00640 1 --2- 172.21.15.44:0/2128186568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4798148bb0 0x7f4798072a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.819+0000 7f479ca00640 1 -- 172.21.15.44:0/2128186568 >> v1:172.21.15.151:6789/0 conn(0x7f4798166210 legacy=0x7f4798166680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.819+0000 7f479ca00640 1 -- 172.21.15.44:0/2128186568 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47981483b0 con 0x7f4798145850 2024-03-30T13:13:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.819+0000 7f4797e00640 1 --2- 172.21.15.44:0/2128186568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4798148bb0 0x7f4798072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:36.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.820+0000 7f479ca00640 1 --2- 172.21.15.44:0/2128186568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4798145850 0x7f4798072510 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f47980b31b0 tx=0x7f478c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd71c50f3af78ed server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.820+0000 7f4797400640 1 -- 172.21.15.44:0/2128186568 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c035020 con 0x7f4798145850 2024-03-30T13:13:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.820+0000 7f4797400640 1 -- 172.21.15.44:0/2128186568 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f478c031830 con 0x7f4798145850 2024-03-30T13:13:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.820+0000 7f4797400640 1 -- 172.21.15.44:0/2128186568 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c031c00 con 0x7f4798145850 2024-03-30T13:13:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.821+0000 7f479de00640 1 -- 172.21.15.44:0/2128186568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4798145850 msgr2=0x7f4798072510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.821+0000 7f479de00640 1 --2- 172.21.15.44:0/2128186568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4798145850 0x7f4798072510 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f47980b31b0 tx=0x7f478c02b8d0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.821+0000 7f479de00640 1 -- 172.21.15.44:0/2128186568 shutdown_connections 2024-03-30T13:13:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.821+0000 7f479de00640 1 --2- 172.21.15.44:0/2128186568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4798148bb0 0x7f4798072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.821+0000 7f479de00640 1 --2- 172.21.15.44:0/2128186568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4798145850 0x7f4798072510 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.821+0000 7f479de00640 1 -- 172.21.15.44:0/2128186568 >> 172.21.15.44:0/2128186568 conn(0x7f479806b970 msgr2=0x7f479806bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:36.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.821+0000 7f479de00640 1 -- 172.21.15.44:0/2128186568 shutdown_connections 2024-03-30T13:13:36.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.821+0000 7f479de00640 1 -- 172.21.15.44:0/2128186568 wait complete. 2024-03-30T13:13:36.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.823+0000 7f479de00640 1 Processor -- start 2024-03-30T13:13:36.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.823+0000 7f479de00640 1 -- start start 2024-03-30T13:13:36.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.824+0000 7f479de00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4798145850 0x7f47981475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.824+0000 7f479de00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4798148bb0 0x7f479815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.824+0000 7f479de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4798166210 0x7f479815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.824+0000 7f479de00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f479815f970 con 0x7f4798166210 2024-03-30T13:13:36.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.824+0000 7f479de00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f479815f7f0 con 0x7f4798145850 2024-03-30T13:13:36.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.824+0000 7f479de00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f479815faf0 con 0x7f4798148bb0 2024-03-30T13:13:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.824+0000 7f479d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4798166210 0x7f479815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.824+0000 7f479d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4798166210 0x7f479815d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39418/0 (socket says 172.21.15.44:39418) 2024-03-30T13:13:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.824+0000 7f479d400640 1 -- 172.21.15.44:0/4018264152 learned_addr learned my addr 172.21.15.44:0/4018264152 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.825+0000 7f479ca00640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4798145850 0x7f47981475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.825+0000 7f4797e00640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4798148bb0 0x7f479815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.825+0000 7f479d400640 1 -- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4798148bb0 msgr2=0x7f479815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:36.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.825+0000 7f479d400640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4798148bb0 0x7f479815d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.825+0000 7f479d400640 1 -- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4798145850 msgr2=0x7f47981475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:36.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.825+0000 7f479d400640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4798145850 0x7f47981475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.825+0000 7f479d400640 1 -- 172.21.15.44:0/4018264152 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47980ce390 con 0x7f4798166210 2024-03-30T13:13:36.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.825+0000 7f479d400640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4798166210 0x7f479815d5f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f479000b9a0 tx=0x7f479000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:36.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.826+0000 7f4794c00640 1 -- 172.21.15.44:0/4018264152 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4790019070 con 0x7f4798166210 2024-03-30T13:13:36.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.826+0000 7f4794c00640 1 -- 172.21.15.44:0/4018264152 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f479000cba0 con 0x7f4798166210 2024-03-30T13:13:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.826+0000 7f4794c00640 1 -- 172.21.15.44:0/4018264152 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4790014440 con 0x7f4798166210 2024-03-30T13:13:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.826+0000 7f479de00640 1 -- 172.21.15.44:0/4018264152 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4798161790 con 0x7f4798166210 2024-03-30T13:13:36.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.826+0000 7f479de00640 1 -- 172.21.15.44:0/4018264152 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4798161d50 con 0x7f4798166210 2024-03-30T13:13:36.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.829+0000 7f4794c00640 1 -- 172.21.15.44:0/4018264152 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f479001c070 con 0x7f4798166210 2024-03-30T13:13:36.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.829+0000 7f4794c00640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f477806c530 0x7f477806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.830+0000 7f4794c00640 1 -- 172.21.15.44:0/4018264152 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f479008b440 con 0x7f4798166210 2024-03-30T13:13:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.830+0000 7f47a2003740 1 Processor -- start 2024-03-30T13:13:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.830+0000 7f479ca00640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f477806c530 0x7f477806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.830+0000 7f47a2003740 1 -- start start 2024-03-30T13:13:36.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.831+0000 7f479ca00640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f477806c530 0x7f477806e9f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f478c036000 tx=0x7f478c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.832+0000 7f47a2003740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4efa4d0 0x5649a4ecd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.832+0000 7f47a2003740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 0x5649a4efd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.832+0000 7f47a2003740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4ecd9b0 0x5649a4efd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.832+0000 7f47a2003740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649a4e94c80 con 0x5649a4ecd9b0 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.832+0000 7f47a2003740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5649a4e36fa0 con 0x5649a4efa8b0 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.832+0000 7f47a2003740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5649a4ddf560 con 0x5649a4efa4d0 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.832+0000 7f479d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4ecd9b0 0x5649a4efd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.832+0000 7f479d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4ecd9b0 0x5649a4efd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39426/0 (socket says 172.21.15.44:39426) 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.832+0000 7f479d400640 1 -- 172.21.15.44:0/1233463469 learned_addr learned my addr 172.21.15.44:0/1233463469 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.832+0000 7f4797e00640 1 --2- 172.21.15.44:0/1233463469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 0x5649a4efd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.833+0000 7f479d400640 1 -- 172.21.15.44:0/1233463469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4efa4d0 msgr2=0x5649a4ecd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.833+0000 7f479ca00640 1 --2- 172.21.15.44:0/1233463469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4efa4d0 0x5649a4ecd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.833+0000 7f479d400640 1 --2- 172.21.15.44:0/1233463469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4efa4d0 0x5649a4ecd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.833+0000 7f479d400640 1 -- 172.21.15.44:0/1233463469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 msgr2=0x5649a4efd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.833+0000 7f479d400640 1 --2- 172.21.15.44:0/1233463469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 0x5649a4efd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.833+0000 7f479d400640 1 -- 172.21.15.44:0/1233463469 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a4b4b2d0 con 0x5649a4ecd9b0 2024-03-30T13:13:36.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.833+0000 7f4797e00640 1 --2- 172.21.15.44:0/1233463469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 0x5649a4efd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:36.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.833+0000 7f479d400640 1 --2- 172.21.15.44:0/1233463469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4ecd9b0 0x5649a4efd7a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4790061880 tx=0x7f47900591d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf28968506de8ae server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.833+0000 7f4789200640 1 -- 172.21.15.44:0/1233463469 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47900574d0 con 0x5649a4ecd9b0 2024-03-30T13:13:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.833+0000 7f4789200640 1 -- 172.21.15.44:0/1233463469 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4790055840 con 0x5649a4ecd9b0 2024-03-30T13:13:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.833+0000 7f4789200640 1 -- 172.21.15.44:0/1233463469 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4790059430 con 0x5649a4ecd9b0 2024-03-30T13:13:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.834+0000 7f47a2003740 1 -- 172.21.15.44:0/1233463469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4ecd9b0 msgr2=0x5649a4efd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.834+0000 7f47a2003740 1 --2- 172.21.15.44:0/1233463469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4ecd9b0 0x5649a4efd7a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4790061880 tx=0x7f47900591d0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.834+0000 7f47a2003740 1 -- 172.21.15.44:0/1233463469 shutdown_connections 2024-03-30T13:13:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.834+0000 7f47a2003740 1 --2- 172.21.15.44:0/1233463469 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4ecd9b0 0x5649a4efd7a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.834+0000 7f47a2003740 1 --2- 172.21.15.44:0/1233463469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 0x5649a4efd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.834+0000 7f47a2003740 1 --2- 172.21.15.44:0/1233463469 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4efa4d0 0x5649a4ecd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.834+0000 7f47a2003740 1 -- 172.21.15.44:0/1233463469 >> 172.21.15.44:0/1233463469 conn(0x5649a4ecf6e0 msgr2=0x5649a4f18260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:36.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.834+0000 7f47a2003740 1 -- 172.21.15.44:0/1233463469 shutdown_connections 2024-03-30T13:13:36.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.834+0000 7f47a2003740 1 -- 172.21.15.44:0/1233463469 wait complete. 2024-03-30T13:13:36.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.835+0000 7f47a2003740 1 -- start start 2024-03-30T13:13:36.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.835+0000 7f47a2003740 1 Processor -- start 2024-03-30T13:13:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.836+0000 7f47a2003740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 0x5649a4f28980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.836+0000 7f47a2003740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 0x5649a4ef3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.836+0000 7f47a2003740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 0x5649a4ef3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.836+0000 7f47a2003740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649a4df2920 con 0x5649a4efa4d0 2024-03-30T13:13:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.836+0000 7f47a2003740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5649a4e32f50 con 0x5649a4efa8b0 2024-03-30T13:13:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.836+0000 7f47a2003740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5649a4ed1c80 con 0x5649a4f00f50 2024-03-30T13:13:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.836+0000 7f47a2003740 10 client.0 _ll_register_callbacks cb 0x5649a4df2310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.837+0000 7f479ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 0x5649a4f28980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.837+0000 7f479ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 0x5649a4f28980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39438/0 (socket says 172.21.15.44:39438) 2024-03-30T13:13:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.837+0000 7f479ca00640 1 -- 172.21.15.44:0/2429924499 learned_addr learned my addr 172.21.15.44:0/2429924499 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.837+0000 7f4797e00640 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 0x5649a4ef3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.837+0000 7f479d400640 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 0x5649a4ef3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.837+0000 7f479ca00640 1 -- 172.21.15.44:0/2429924499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 msgr2=0x5649a4ef3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.837+0000 7f479ca00640 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 0x5649a4ef3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.837+0000 7f479ca00640 1 -- 172.21.15.44:0/2429924499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 msgr2=0x5649a4ef3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.837+0000 7f479ca00640 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 0x5649a4ef3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.837+0000 7f479ca00640 1 -- 172.21.15.44:0/2429924499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649a4c156b0 con 0x5649a4efa4d0 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.838+0000 7f479ca00640 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 0x5649a4f28980 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f478c02bee0 tx=0x7f478c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cb72b6e8853318 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.838+0000 7f477d600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.838+0000 7f477d600640 1 -- 172.21.15.44:0/2429924499 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c053060 con 0x5649a4efa4d0 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.838+0000 7f477d600640 1 -- 172.21.15.44:0/2429924499 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f478c041070 con 0x5649a4efa4d0 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.838+0000 7f47a2003740 1 -- 172.21.15.44:0/2429924499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4790055840 con 0x5649a4efa4d0 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.838+0000 7f477d600640 1 -- 172.21.15.44:0/2429924499 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f478c035040 con 0x5649a4efa4d0 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.838+0000 7f47a2003740 10 client.5502 fetch_fsmap learned FSMap version 17 2024-03-30T13:13:36.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.838+0000 7f47a2003740 1 -- 172.21.15.44:0/2429924499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5649a4f29750 con 0x5649a4efa4d0 2024-03-30T13:13:36.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.838+0000 7f477d600640 1 -- 172.21.15.44:0/2429924499 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4790055840 con 0x5649a4efa4d0 2024-03-30T13:13:36.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.839+0000 7f477d600640 1 -- 172.21.15.44:0/2429924499 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f478c05c080 con 0x5649a4efa4d0 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.839+0000 7f47a2003740 10 client.5502 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.839+0000 7f47a2003740 10 client.5502 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.839+0000 7f47a2003740 20 client.5502 populate_metadata read hostname 'smithi044' 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.839+0000 7f47a2003740 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5649a4efc810 0x5649a4efcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.839+0000 7f47a2003740 4 client.5502 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.839+0000 7f47a2003740 1 -- 172.21.15.44:0/2429924499 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649a4e444e0 con 0x5649a4efc810 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.839+0000 7f4797e00640 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5649a4efc810 0x5649a4efcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.840+0000 7f4797e00640 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5649a4efc810 0x5649a4efcbf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55d19c9d11bcfb02 server_cookie=6d09b25efb15e48d in_seq=0 out_seq=0 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.840+0000 7f477d600640 10 client.5502 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f477d600640 1 -- 172.21.15.44:0/2429924499 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5649a4e444e0 con 0x5649a4efc810 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f477d600640 10 client.5502 handle_command_reply: tid=0 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f47a2003740 1 client.5502 shutdown 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f47a2003740 1 -- 172.21.15.44:0/2429924499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 msgr2=0x5649a4f28980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:36.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f47a2003740 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 0x5649a4f28980 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f478c02bee0 tx=0x7f478c004730 comp rx=0 tx=0).stop 2024-03-30T13:13:36.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f47a2003740 1 -- 172.21.15.44:0/2429924499 shutdown_connections 2024-03-30T13:13:36.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f47a2003740 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5649a4efc810 0x5649a4efcbf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f47a2003740 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 0x5649a4ef3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f47a2003740 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 0x5649a4ef3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f47a2003740 1 --2- 172.21.15.44:0/2429924499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 0x5649a4f28980 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f47a2003740 1 -- 172.21.15.44:0/2429924499 >> 172.21.15.44:0/2429924499 conn(0x5649a4ecd9b0 msgr2=0x5649a4ed13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:36.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f477d600640 0 client.5502 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:13:36.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f47a2003740 1 -- 172.21.15.44:0/2429924499 shutdown_connections 2024-03-30T13:13:36.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.841+0000 7f47a2003740 1 -- 172.21.15.44:0/2429924499 wait complete. 2024-03-30T13:13:36.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.842+0000 7f47a2003740 20 client.5502 trim_cache size 0 max 16384 2024-03-30T13:13:36.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.862+0000 7f47a2003740 1 Processor -- start 2024-03-30T13:13:36.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.862+0000 7f47a2003740 1 -- start start 2024-03-30T13:13:36.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.863+0000 7f47a2003740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa4d0 0x5649a4efac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.863+0000 7f47a2003740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa8b0 0x5649a4efb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.863+0000 7f47a2003740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 0x5649a4ef2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.863+0000 7f47a2003740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4798204400 con 0x5649a4efa8b0 2024-03-30T13:13:36.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.863+0000 7f47a2003740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f479815c230 con 0x5649a4efa4d0 2024-03-30T13:13:36.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.863+0000 7f47a2003740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f479815c880 con 0x5649a4f00f50 2024-03-30T13:13:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.863+0000 7f4797e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa8b0 0x5649a4efb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.863+0000 7f4797e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa8b0 0x5649a4efb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39452/0 (socket says 172.21.15.44:39452) 2024-03-30T13:13:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.863+0000 7f4797e00640 1 -- 172.21.15.44:0/3098534931 learned_addr learned my addr 172.21.15.44:0/3098534931 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.864+0000 7f479ca00640 1 --2- 172.21.15.44:0/3098534931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa4d0 0x5649a4efac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.864+0000 7f4797e00640 1 -- 172.21.15.44:0/3098534931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 msgr2=0x5649a4ef2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.864+0000 7f4797e00640 1 --2- 172.21.15.44:0/3098534931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 0x5649a4ef2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.864+0000 7f4797e00640 1 -- 172.21.15.44:0/3098534931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa4d0 msgr2=0x5649a4efac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.864+0000 7f4797e00640 1 --2- 172.21.15.44:0/3098534931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa4d0 0x5649a4efac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.864+0000 7f4797e00640 1 -- 172.21.15.44:0/3098534931 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649a4f00d60 con 0x5649a4efa8b0 2024-03-30T13:13:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.864+0000 7f4797e00640 1 --2- 172.21.15.44:0/3098534931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa8b0 0x5649a4efb1d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f479815e7f0 tx=0x7f4784008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da634fa3f28f6fb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:36.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.864+0000 7f477fe00640 1 -- 172.21.15.44:0/3098534931 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784004030 con 0x5649a4efa8b0 2024-03-30T13:13:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.864+0000 7f477fe00640 1 -- 172.21.15.44:0/3098534931 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47840041d0 con 0x5649a4efa8b0 2024-03-30T13:13:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.864+0000 7f477fe00640 1 -- 172.21.15.44:0/3098534931 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784004380 con 0x5649a4efa8b0 2024-03-30T13:13:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.865+0000 7f47a2003740 1 -- 172.21.15.44:0/3098534931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa8b0 msgr2=0x5649a4efb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.865+0000 7f47a2003740 1 --2- 172.21.15.44:0/3098534931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa8b0 0x5649a4efb1d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f479815e7f0 tx=0x7f4784008040 comp rx=0 tx=0).stop 2024-03-30T13:13:36.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.865+0000 7f47a2003740 1 -- 172.21.15.44:0/3098534931 shutdown_connections 2024-03-30T13:13:36.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.865+0000 7f47a2003740 1 --2- 172.21.15.44:0/3098534931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 0x5649a4ef2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.865+0000 7f47a2003740 1 --2- 172.21.15.44:0/3098534931 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa8b0 0x5649a4efb1d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.865+0000 7f47a2003740 1 --2- 172.21.15.44:0/3098534931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa4d0 0x5649a4efac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.865+0000 7f47a2003740 1 -- 172.21.15.44:0/3098534931 >> 172.21.15.44:0/3098534931 conn(0x5649a4ecd9b0 msgr2=0x5649a4efccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:36.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.865+0000 7f47a2003740 1 -- 172.21.15.44:0/3098534931 shutdown_connections 2024-03-30T13:13:36.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.865+0000 7f47a2003740 1 -- 172.21.15.44:0/3098534931 wait complete. 2024-03-30T13:13:36.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.866+0000 7f47a2003740 1 -- start start 2024-03-30T13:13:36.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.866+0000 7f47a2003740 1 Processor -- start 2024-03-30T13:13:36.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.867+0000 7f47a2003740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 0x5649a4f3b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.867+0000 7f47a2003740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 0x5649a4ef2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.867+0000 7f47a2003740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 0x5649a4efac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.867+0000 7f47a2003740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5649a4ef3470 con 0x5649a4efa4d0 2024-03-30T13:13:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.867+0000 7f47a2003740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5649a4efbc40 con 0x5649a4efa8b0 2024-03-30T13:13:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.867+0000 7f47a2003740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5649a4f2c6f0 con 0x5649a4f00f50 2024-03-30T13:13:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.867+0000 7f47a2003740 10 client.0 _ll_register_callbacks cb 0x7f478c031a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:13:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.867+0000 7f479ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 0x5649a4f3b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.867+0000 7f479ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 0x5649a4f3b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39466/0 (socket says 172.21.15.44:39466) 2024-03-30T13:13:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.867+0000 7f479ca00640 1 -- 172.21.15.44:0/1773773123 learned_addr learned my addr 172.21.15.44:0/1773773123 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.868+0000 7f479ca00640 1 -- 172.21.15.44:0/1773773123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 msgr2=0x5649a4efac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:36.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.868+0000 7f479ca00640 1 --2- 172.21.15.44:0/1773773123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 0x5649a4efac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.868+0000 7f479ca00640 1 -- 172.21.15.44:0/1773773123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 msgr2=0x5649a4ef2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:36.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.868+0000 7f479ca00640 1 --2- 172.21.15.44:0/1773773123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 0x5649a4ef2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.868+0000 7f479ca00640 1 -- 172.21.15.44:0/1773773123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649a4ef3e90 con 0x5649a4efa4d0 2024-03-30T13:13:36.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.868+0000 7f479ca00640 1 --2- 172.21.15.44:0/1773773123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 0x5649a4f3b420 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f478c009960 tx=0x7f478c031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcff95b4ab9b03f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:36.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.868+0000 7f477d600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:13:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.868+0000 7f477d600640 1 -- 172.21.15.44:0/1773773123 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c04e9d0 con 0x5649a4efa4d0 2024-03-30T13:13:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.868+0000 7f477d600640 1 -- 172.21.15.44:0/1773773123 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f478c04b040 con 0x5649a4efa4d0 2024-03-30T13:13:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.868+0000 7f47a2003740 1 -- 172.21.15.44:0/1773773123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47840041d0 con 0x5649a4efa4d0 2024-03-30T13:13:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.869+0000 7f477d600640 1 -- 172.21.15.44:0/1773773123 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f478c067050 con 0x5649a4efa4d0 2024-03-30T13:13:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.869+0000 7f47a2003740 10 client.5508 fetch_fsmap learned FSMap version 17 2024-03-30T13:13:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.869+0000 7f47a2003740 1 -- 172.21.15.44:0/1773773123 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5649a4ef3bb0 con 0x5649a4efa4d0 2024-03-30T13:13:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.869+0000 7f477d600640 1 -- 172.21.15.44:0/1773773123 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47840041d0 con 0x5649a4efa4d0 2024-03-30T13:13:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.869+0000 7f477d600640 1 -- 172.21.15.44:0/1773773123 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f478c06a020 con 0x5649a4efa4d0 2024-03-30T13:13:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.869+0000 7f47a2003740 10 client.5508 fetch_fsmap finished waiting for FSMap version 17 2024-03-30T13:13:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.869+0000 7f47a2003740 10 client.5508 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-30T13:13:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.869+0000 7f47a2003740 20 client.5508 populate_metadata read hostname 'smithi044' 2024-03-30T13:13:36.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.869+0000 7f47a2003740 1 --2- 172.21.15.44:0/1773773123 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5649a4f94190 0x5649a4f94570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.869+0000 7f47a2003740 4 client.5508 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.869+0000 7f47a2003740 1 -- 172.21.15.44:0/1773773123 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "status"}) -- 0x5649a4e3e830 con 0x5649a4f94190 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.870+0000 7f4797e00640 1 --2- 172.21.15.44:0/1773773123 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5649a4f94190 0x5649a4f94570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.870+0000 7f4797e00640 1 --2- 172.21.15.44:0/1773773123 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5649a4f94190 0x5649a4f94570 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d60f7747ca9fe8 server_cookie=9727f385a32c1bae in_seq=0 out_seq=0 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.870+0000 7f477d600640 10 client.5508 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.870+0000 7f477d600640 1 -- 172.21.15.44:0/1773773123 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5649a4e3e830 con 0x5649a4f94190 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.870+0000 7f477d600640 10 client.5508 handle_command_reply: tid=0 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.870+0000 7f47a2003740 1 client.5508 shutdown 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.871+0000 7f47a2003740 1 -- 172.21.15.44:0/1773773123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 msgr2=0x5649a4f3b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.871+0000 7f47a2003740 1 --2- 172.21.15.44:0/1773773123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 0x5649a4f3b420 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f478c009960 tx=0x7f478c031000 comp rx=0 tx=0).stop 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.871+0000 7f47a2003740 1 -- 172.21.15.44:0/1773773123 shutdown_connections 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.871+0000 7f47a2003740 1 --2- 172.21.15.44:0/1773773123 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5649a4f94190 0x5649a4f94570 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.871+0000 7f47a2003740 1 --2- 172.21.15.44:0/1773773123 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5649a4f00f50 0x5649a4efac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.871+0000 7f47a2003740 1 --2- 172.21.15.44:0/1773773123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649a4efa8b0 0x5649a4ef2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.871+0000 7f47a2003740 1 --2- 172.21.15.44:0/1773773123 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5649a4efa4d0 0x5649a4f3b420 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.871+0000 7f47a2003740 1 -- 172.21.15.44:0/1773773123 >> 172.21.15.44:0/1773773123 conn(0x5649a4ecd9b0 msgr2=0x5649a4efcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:36.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.871+0000 7f477d600640 0 client.5508 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:13:36.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.871+0000 7f47a2003740 1 -- 172.21.15.44:0/1773773123 shutdown_connections 2024-03-30T13:13:36.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.871+0000 7f47a2003740 1 -- 172.21.15.44:0/1773773123 wait complete. 2024-03-30T13:13:36.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.871+0000 7f47a2003740 20 client.5508 trim_cache size 0 max 16384 2024-03-30T13:13:36.879 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:13:36.879 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "cf82a1f9-ad5a-4657-adf6-b77304ed0e9d", 2024-03-30T13:13:36.879 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-03-30T13:13:36.879 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 5298, 2024-03-30T13:13:36.879 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-03-30T13:13:36.880 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-03-30T13:13:36.880 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-03-30T13:13:36.880 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 11.949856057, 2024-03-30T13:13:36.880 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 17, 2024-03-30T13:13:36.880 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 41, 2024-03-30T13:13:36.880 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 41, 2024-03-30T13:13:36.880 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 20.883417389000002 2024-03-30T13:13:36.880 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:13:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.872+0000 7f479de00640 1 -- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f477806c530 msgr2=0x7f477806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.872+0000 7f479de00640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f477806c530 0x7f477806e9f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f478c036000 tx=0x7f478c03c040 comp rx=0 tx=0).stop 2024-03-30T13:13:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.872+0000 7f479de00640 1 -- 172.21.15.44:0/4018264152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4798166210 msgr2=0x7f479815d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.872+0000 7f479de00640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4798166210 0x7f479815d5f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f479000b9a0 tx=0x7f479000be60 comp rx=0 tx=0).stop 2024-03-30T13:13:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.872+0000 7f479de00640 1 -- 172.21.15.44:0/4018264152 shutdown_connections 2024-03-30T13:13:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.872+0000 7f479de00640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4798166210 0x7f479815d5f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.872+0000 7f479de00640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4798148bb0 0x7f479815d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.872+0000 7f479de00640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f477806c530 0x7f477806e9f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.872+0000 7f479de00640 1 --2- 172.21.15.44:0/4018264152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4798145850 0x7f47981475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:36.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.872+0000 7f479de00640 1 -- 172.21.15.44:0/4018264152 >> 172.21.15.44:0/4018264152 conn(0x7f479806b970 msgr2=0x7f4798072510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:36.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.872+0000 7f479de00640 1 -- 172.21.15.44:0/4018264152 shutdown_connections 2024-03-30T13:13:36.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:36.872+0000 7f479de00640 1 -- 172.21.15.44:0/4018264152 wait complete. 2024-03-30T13:13:36.894 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:13:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.079+0000 7f5e13600640 1 Processor -- start 2024-03-30T13:13:37.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.079+0000 7f5e13600640 1 -- start start 2024-03-30T13:13:37.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.080+0000 7f5e13600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c071c30 0x7f5e0c160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:37.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.080+0000 7f5e13600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e0c146040 con 0x7f5e0c160660 2024-03-30T13:13:37.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.080+0000 7f5e13600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e0c160e50 con 0x7f5e0c145c60 2024-03-30T13:13:37.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.080+0000 7f5e13600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5e0c15d8b0 con 0x7f5e0c071c30 2024-03-30T13:13:37.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.081+0000 7f5e11600640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5e0c160660 0x7f5e0c0ca830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48584/0 (socket says 172.21.15.44:48584) 2024-03-30T13:13:37.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.081+0000 7f5e11600640 1 -- 172.21.15.44:0/336907028 learned_addr learned my addr 172.21.15.44:0/336907028 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.081+0000 7f5e0be00640 1 --2- 172.21.15.44:0/336907028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c071c30 0x7f5e0c160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.081+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958337899 0 0) 0x7f5e0c146040 con 0x7f5e0c160660 2024-03-30T13:13:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.081+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5df4003520 con 0x7f5e0c160660 2024-03-30T13:13:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1039394764 0 0) 0x7f5df4003520 con 0x7f5e0c160660 2024-03-30T13:13:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c071c30 msgr2=0x7f5e0c160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 --2- 172.21.15.44:0/336907028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c071c30 0x7f5e0c160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 >> v1:172.21.15.151:6789/0 conn(0x7f5e0c145c60 legacy=0x7f5e0c071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c15caf0 con 0x7f5e0c160660 2024-03-30T13:13:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f5e040019f0 con 0x7f5e0c160660 2024-03-30T13:13:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 >> v1:172.21.15.44:6789/0 conn(0x7f5e0c160660 legacy=0x7f5e0c0ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 --2- 172.21.15.44:0/336907028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c071c30 0x7f5df40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:37.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 --2- 172.21.15.44:0/336907028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df4003f60 0x7f5df4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:37.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 --2- 172.21.15.44:0/336907028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df4004d40 0x7f5df40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:37.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c15d8b0 con 0x7f5df4004d40 2024-03-30T13:13:37.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5df400bb50 con 0x7f5df4003f60 2024-03-30T13:13:37.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5df400bd50 con 0x7f5e0c071c30 2024-03-30T13:13:37.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.082+0000 7f5e11600640 1 --2- 172.21.15.44:0/336907028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df4004d40 0x7f5df40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:37.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.083+0000 7f5e10c00640 1 --2- 172.21.15.44:0/336907028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c071c30 0x7f5df40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:37.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.083+0000 7f5e0be00640 1 --2- 172.21.15.44:0/336907028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df4003f60 0x7f5df4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:37.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.083+0000 7f5e11600640 1 -- 172.21.15.44:0/336907028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c071c30 msgr2=0x7f5df40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:37.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.083+0000 7f5e11600640 1 --2- 172.21.15.44:0/336907028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c071c30 0x7f5df40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:37.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.083+0000 7f5e11600640 1 -- 172.21.15.44:0/336907028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df4003f60 msgr2=0x7f5df4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:37.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.083+0000 7f5e11600640 1 --2- 172.21.15.44:0/336907028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df4003f60 0x7f5df4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:37.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.083+0000 7f5e11600640 1 -- 172.21.15.44:0/336907028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df4003520 con 0x7f5df4004d40 2024-03-30T13:13:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.084+0000 7f5e11600640 1 --2- 172.21.15.44:0/336907028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df4004d40 0x7f5df40051c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400a860 tx=0x7f5df4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56abcdfa78121969 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.084+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400a480 con 0x7f5df4004d40 2024-03-30T13:13:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.084+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e04034630 con 0x7f5df4004d40 2024-03-30T13:13:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.084+0000 7f5e0b400640 1 -- 172.21.15.44:0/336907028 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04034a40 con 0x7f5df4004d40 2024-03-30T13:13:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.085+0000 7f5e13600640 1 -- 172.21.15.44:0/336907028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df4004d40 msgr2=0x7f5df40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.085+0000 7f5e13600640 1 --2- 172.21.15.44:0/336907028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5df4004d40 0x7f5df40051c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400a860 tx=0x7f5df4005830 comp rx=0 tx=0).stop 2024-03-30T13:13:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.085+0000 7f5e11600640 1 -- 172.21.15.44:0/336907028 reap_dead start 2024-03-30T13:13:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.085+0000 7f5e13600640 1 -- 172.21.15.44:0/336907028 shutdown_connections 2024-03-30T13:13:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.085+0000 7f5e13600640 1 -- 172.21.15.44:0/336907028 >> 172.21.15.44:0/336907028 conn(0x7f5e0c0b1c90 msgr2=0x7f5e0c0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.085+0000 7f5e13600640 1 -- 172.21.15.44:0/336907028 shutdown_connections 2024-03-30T13:13:37.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.085+0000 7f5e13600640 1 -- 172.21.15.44:0/336907028 wait complete. 2024-03-30T13:13:37.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.087+0000 7f5e13600640 1 Processor -- start 2024-03-30T13:13:37.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.088+0000 7f5e13600640 1 -- start start 2024-03-30T13:13:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.089+0000 7f5e13600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df4004d40 0x7f5e0c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:37.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.089+0000 7f5e13600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c1f2200 0x7f5e0c0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.089+0000 7f5e13600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e0c1f2680 0x7f5e0c0c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.089+0000 7f5e13600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c160b10 con 0x7f5e0c1f2680 2024-03-30T13:13:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.089+0000 7f5e13600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c15d0b0 con 0x7f5df4004d40 2024-03-30T13:13:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.089+0000 7f5e13600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5e0c160120 con 0x7f5e0c1f2200 2024-03-30T13:13:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.089+0000 7f5e11600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e0c1f2680 0x7f5e0c0c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.089+0000 7f5e11600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e0c1f2680 0x7f5e0c0c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58384/0 (socket says 172.21.15.44:58384) 2024-03-30T13:13:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.089+0000 7f5e11600640 1 -- 172.21.15.44:0/1473400906 learned_addr learned my addr 172.21.15.44:0/1473400906 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.089+0000 7f5e10c00640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df4004d40 0x7f5e0c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.089+0000 7f5e0be00640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c1f2200 0x7f5e0c0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.090+0000 7f5e11600640 1 -- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c1f2200 msgr2=0x7f5e0c0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.090+0000 7f5e11600640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c1f2200 0x7f5e0c0c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:37.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.090+0000 7f5e11600640 1 -- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df4004d40 msgr2=0x7f5e0c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:37.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.090+0000 7f5e11600640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df4004d40 0x7f5e0c15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:37.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.090+0000 7f5e11600640 1 -- 172.21.15.44:0/1473400906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c0c5390 con 0x7f5e0c1f2680 2024-03-30T13:13:37.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.090+0000 7f5e0be00640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c1f2200 0x7f5e0c0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:13:37.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.090+0000 7f5e11600640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e0c1f2680 0x7f5e0c0c7ba0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e0402cc70 tx=0x7f5e0c15ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.090+0000 7f5e08c00640 1 -- 172.21.15.44:0/1473400906 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04045070 con 0x7f5e0c1f2680 2024-03-30T13:13:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.090+0000 7f5e08c00640 1 -- 172.21.15.44:0/1473400906 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e0403a040 con 0x7f5e0c1f2680 2024-03-30T13:13:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.090+0000 7f5e13600640 1 -- 172.21.15.44:0/1473400906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0c0c5670 con 0x7f5e0c1f2680 2024-03-30T13:13:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.090+0000 7f5e08c00640 1 -- 172.21.15.44:0/1473400906 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400a480 con 0x7f5e0c1f2680 2024-03-30T13:13:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.090+0000 7f5e13600640 1 -- 172.21.15.44:0/1473400906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0c0c5c30 con 0x7f5e0c1f2680 2024-03-30T13:13:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.092+0000 7f5e13600640 1 -- 172.21.15.44:0/1473400906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e0c075a10 con 0x7f5e0c1f2680 2024-03-30T13:13:37.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.093+0000 7f5e08c00640 1 -- 172.21.15.44:0/1473400906 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5e04048070 con 0x7f5e0c1f2680 2024-03-30T13:13:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.093+0000 7f5e08c00640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5df006c560 0x7f5df006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:37.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.094+0000 7f5e08c00640 1 -- 172.21.15.44:0/1473400906 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f5e040ad3d0 con 0x7f5e0c1f2680 2024-03-30T13:13:37.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.094+0000 7f5e10c00640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5df006c560 0x7f5df006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:37.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.095+0000 7f5e10c00640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5df006c560 0x7f5df006ea20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0b5ee0 tx=0x7f5e00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:37.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.098+0000 7f5e08c00640 1 -- 172.21.15.44:0/1473400906 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5e0407b170 con 0x7f5e0c1f2680 2024-03-30T13:13:37.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.345+0000 7f5e13600640 1 -- 172.21.15.44:0/1473400906 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5e0c0ca610 con 0x7f5e0c1f2680 2024-03-30T13:13:37.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.346+0000 7f5e08c00640 1 -- 172.21.15.44:0/1473400906 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f5e0407f470 con 0x7f5e0c1f2680 2024-03-30T13:13:37.351 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:13:37.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.348+0000 7f5e13600640 1 -- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5df006c560 msgr2=0x7f5df006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:37.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.348+0000 7f5e13600640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5df006c560 0x7f5df006ea20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0b5ee0 tx=0x7f5e00009040 comp rx=0 tx=0).stop 2024-03-30T13:13:37.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.348+0000 7f5e13600640 1 -- 172.21.15.44:0/1473400906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e0c1f2680 msgr2=0x7f5e0c0c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:37.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.348+0000 7f5e13600640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e0c1f2680 0x7f5e0c0c7ba0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e0402cc70 tx=0x7f5e0c15ccc0 comp rx=0 tx=0).stop 2024-03-30T13:13:37.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.348+0000 7f5e13600640 1 -- 172.21.15.44:0/1473400906 shutdown_connections 2024-03-30T13:13:37.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.348+0000 7f5e13600640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5e0c1f2680 0x7f5e0c0c7ba0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:37.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.348+0000 7f5e13600640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e0c1f2200 0x7f5e0c0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:37.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.348+0000 7f5e13600640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5df006c560 0x7f5df006ea20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:37.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.348+0000 7f5e13600640 1 --2- 172.21.15.44:0/1473400906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5df4004d40 0x7f5e0c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:37.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.348+0000 7f5e13600640 1 -- 172.21.15.44:0/1473400906 >> 172.21.15.44:0/1473400906 conn(0x7f5e0c0b1c90 msgr2=0x7f5e0c15f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:37.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.349+0000 7f5e13600640 1 -- 172.21.15.44:0/1473400906 shutdown_connections 2024-03-30T13:13:37.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37.349+0000 7f5e13600640 1 -- 172.21.15.44:0/1473400906 wait complete. 2024-03-30T13:13:37.372 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-30T13:13:37.372 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:13:37.372 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-03-30T13:13:37.372 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-30T13:13:37.372 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-30T13:13:37.372 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-30T13:13:37.372 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-30T13:13:37.373 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:13:37.373 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:13:37.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:37.373 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-03-30T13:13:37.419 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:13:37.419 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:13:37.419 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:13:37.419 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:37.419 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-03-30T13:13:37.419 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:37.419 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:13:37.419 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-03-30T13:13:37.419 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-03-30T13:13:37.419 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:13:37.419 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 42468sec preferred_lft 42468sec 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether be:3f:aa:6f:f2:70 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:13:37.420 INFO:teuthology.orchestra.run.smithi044.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T13:13:37.421 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:37.421 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::9812:b6ff:fe91:f007/64 scope link 2024-03-30T13:13:37.421 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:37.421 INFO:teuthology.orchestra.run.smithi044.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:13:37.421 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether be:3f:aa:6f:f2:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:13:37.421 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::bc3f:aaff:fe6f:f270/64 scope link 2024-03-30T13:13:37.421 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:37.421 INFO:teuthology.orchestra.run.smithi044.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:13:37.421 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether e6:25:ae:dc:4c:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:13:37.421 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::e425:aeff:fedc:4c23/64 scope link 2024-03-30T13:13:37.421 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:37.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:37.422 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:13:37.543 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-03-30T13:13:37.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:37.548 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-03-30T13:13:37.596 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-03-30T13:13:37.630 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:13:37.630 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-30T13:13:37.631 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-30T13:13:37.631 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:13:37.631 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:13:37.631 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-03-30T13:13:37.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-30T13:13:37.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-30T13:13:37.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-30T13:13:37.631 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-03-30T13:13:37.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:13:37.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:13:37.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:37.882 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-03-30T13:13:37.925 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-30T13:13:37.926 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-30T13:13:37.926 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:13:37.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:37.926 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-03-30T13:13:38.052 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:13:38.052 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-30T13:13:38.101 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-30T13:13:38.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:13:38.102 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-30T13:13:38.148 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T13:13:38.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:38.148 DEBUG:teuthology.orchestra.run.smithi044:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:13:38.335 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:13:38.336 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T13:13:38.336 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-03-30T13:13:38.359 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:13:38.359 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T13:13:38.360 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-03-30T13:13:38.360 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.151:3300,172.21.15.151:3301" 2024-03-30T13:13:38.360 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:13:38.389 INFO:teuthology.orchestra.run.smithi044.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-30T13:13:38.389 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-30T13:13:38.389 INFO:teuthology.orchestra.run.smithi044.stdout:invalid new device string format 2024-03-30T13:13:38.389 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.151:3300,172.21.15.151:3301" 2024-03-30T13:13:38.389 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:13:38.389 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.151:6789,172.21.15.151:6790" 2024-03-30T13:13:38.390 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2024-03-30T13:13:38.390 INFO:teuthology.orchestra.run.smithi044.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cf82a1f9-ad5a-4657-adf6-b77304ed0e9d" will pass to kernel 2024-03-30T13:13:38.393 INFO:teuthology.orchestra.run.smithi044.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-30T13:13:38.394 INFO:teuthology.orchestra.run.smithi044.stdout: You just mounted a file system that supports labels which does not 2024-03-30T13:13:38.394 INFO:teuthology.orchestra.run.smithi044.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T13:13:38.394 INFO:teuthology.orchestra.run.smithi044.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T13:13:38.394 INFO:teuthology.orchestra.run.smithi044.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T13:13:38.400 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T13:13:38.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:38.400 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-30T13:13:38.488 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:13:38.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:13:38.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:13:38.622 INFO:teuthology.orchestra.run.smithi044.stdout:client5161 2024-03-30T13:13:38.623 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:13:38.623 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:13:38.669 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-30T13:13:38.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.926+0000 7fbc12400640 1 Processor -- start 2024-03-30T13:13:38.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.926+0000 7fbc12400640 1 -- start start 2024-03-30T13:13:38.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.928+0000 7fbc12400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbc0c145c60 0x7fbc0c071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:38.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.928+0000 7fbc12400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0c146040 con 0x7fbc0c160830 2024-03-30T13:13:38.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.928+0000 7fbc12400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0c160e50 con 0x7fbc0c071a60 2024-03-30T13:13:38.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.928+0000 7fbc12400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fbc0c071ed0 con 0x7fbc0c145c60 2024-03-30T13:13:38.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.928+0000 7fbc0b400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fbc0c145c60 0x7fbc0c071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:38.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.928+0000 7fbc0be00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fbc0c160830 0x7fbc0c0ca830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48586/0 (socket says 172.21.15.44:48586) 2024-03-30T13:13:38.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.929+0000 7fbc0be00640 1 -- 172.21.15.44:0/1570317885 learned_addr learned my addr 172.21.15.44:0/1570317885 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:38.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.929+0000 7fbc0b400640 1 -- 172.21.15.44:0/1570317885 >> v1:172.21.15.151:6789/0 conn(0x7fbc0c071a60 legacy=0x7fbc0c160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:38.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.929+0000 7fbc0b400640 1 -- 172.21.15.44:0/1570317885 >> v1:172.21.15.44:6789/0 conn(0x7fbc0c160830 legacy=0x7fbc0c0ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:38.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.929+0000 7fbc0b400640 1 -- 172.21.15.44:0/1570317885 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0c15d8b0 con 0x7fbc0c145c60 2024-03-30T13:13:38.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.930+0000 7fbc0b400640 1 --2- 172.21.15.44:0/1570317885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc0c145c60 0x7fbc0c071520 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0097a0 tx=0x7fbbfc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6eff34a4af5a25 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:38.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.930+0000 7fbc0aa00640 1 -- 172.21.15.44:0/1570317885 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0315a0 con 0x7fbc0c145c60 2024-03-30T13:13:38.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.930+0000 7fbc0aa00640 1 -- 172.21.15.44:0/1570317885 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbfc037070 con 0x7fbc0c145c60 2024-03-30T13:13:38.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.930+0000 7fbc0aa00640 1 -- 172.21.15.44:0/1570317885 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc031960 con 0x7fbc0c145c60 2024-03-30T13:13:38.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.931+0000 7fbc12400640 1 -- 172.21.15.44:0/1570317885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc0c145c60 msgr2=0x7fbc0c071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:38.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.931+0000 7fbc12400640 1 --2- 172.21.15.44:0/1570317885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc0c145c60 0x7fbc0c071520 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0097a0 tx=0x7fbbfc02b840 comp rx=0 tx=0).stop 2024-03-30T13:13:38.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.931+0000 7fbc12400640 1 -- 172.21.15.44:0/1570317885 shutdown_connections 2024-03-30T13:13:38.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.931+0000 7fbc12400640 1 --2- 172.21.15.44:0/1570317885 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc0c145c60 0x7fbc0c071520 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:38.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.931+0000 7fbc12400640 1 -- 172.21.15.44:0/1570317885 >> 172.21.15.44:0/1570317885 conn(0x7fbc0c0b1c90 msgr2=0x7fbc0c0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:38.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.931+0000 7fbc12400640 1 -- 172.21.15.44:0/1570317885 shutdown_connections 2024-03-30T13:13:38.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.931+0000 7fbc12400640 1 -- 172.21.15.44:0/1570317885 wait complete. 2024-03-30T13:13:38.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.933+0000 7fbc12400640 1 Processor -- start 2024-03-30T13:13:38.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.933+0000 7fbc12400640 1 -- start start 2024-03-30T13:13:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.934+0000 7fbc12400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc0c071a60 0x7fbc0c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.934+0000 7fbc12400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc0c145c60 0x7fbc0c1f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.934+0000 7fbc12400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc0c160830 0x7fbc0c1f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.934+0000 7fbc12400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0c15d0b0 con 0x7fbc0c071a60 2024-03-30T13:13:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.934+0000 7fbc12400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0c15cdd0 con 0x7fbc0c160830 2024-03-30T13:13:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.934+0000 7fbc12400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fbc0c0caf40 con 0x7fbc0c145c60 2024-03-30T13:13:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.934+0000 7fbc0b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc0c071a60 0x7fbc0c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.934+0000 7fbc0b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc0c071a60 0x7fbc0c0b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58412/0 (socket says 172.21.15.44:58412) 2024-03-30T13:13:38.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.934+0000 7fbc0b400640 1 -- 172.21.15.44:0/1858805218 learned_addr learned my addr 172.21.15.44:0/1858805218 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:38.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.935+0000 7fbc0b400640 1 -- 172.21.15.44:0/1858805218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc0c145c60 msgr2=0x7fbc0c1f8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:38.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.935+0000 7fbc0b400640 1 --2- 172.21.15.44:0/1858805218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc0c145c60 0x7fbc0c1f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:38.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.935+0000 7fbc0b400640 1 -- 172.21.15.44:0/1858805218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc0c160830 msgr2=0x7fbc0c1f8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:38.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.935+0000 7fbc0b400640 1 --2- 172.21.15.44:0/1858805218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc0c160830 0x7fbc0c1f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:38.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.935+0000 7fbc0b400640 1 -- 172.21.15.44:0/1858805218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0c1f8560 con 0x7fbc0c071a60 2024-03-30T13:13:38.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.935+0000 7fbc0b400640 1 --2- 172.21.15.44:0/1858805218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc0c071a60 0x7fbc0c0b3da0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0098c0 tx=0x7fbbfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:38.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.935+0000 7fbc03400640 1 -- 172.21.15.44:0/1858805218 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc032840 con 0x7fbc0c071a60 2024-03-30T13:13:38.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.935+0000 7fbc03400640 1 -- 172.21.15.44:0/1858805218 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbfc0329e0 con 0x7fbc0c071a60 2024-03-30T13:13:38.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.935+0000 7fbc03400640 1 -- 172.21.15.44:0/1858805218 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc032dd0 con 0x7fbc0c071a60 2024-03-30T13:13:38.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.935+0000 7fbc12400640 1 -- 172.21.15.44:0/1858805218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc0c0b4710 con 0x7fbc0c071a60 2024-03-30T13:13:38.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.936+0000 7fbc12400640 1 -- 172.21.15.44:0/1858805218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc0c0b4cd0 con 0x7fbc0c071a60 2024-03-30T13:13:38.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.937+0000 7fbc12400640 1 -- 172.21.15.44:0/1858805218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc0c075a10 con 0x7fbc0c071a60 2024-03-30T13:13:38.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.938+0000 7fbc03400640 1 -- 172.21.15.44:0/1858805218 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbbfc03b3f0 con 0x7fbc0c071a60 2024-03-30T13:13:38.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.939+0000 7fbc03400640 1 --2- 172.21.15.44:0/1858805218 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbbe806c530 0x7fbbe806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:38.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.939+0000 7fbc03400640 1 -- 172.21.15.44:0/1858805218 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fbbfc02f030 con 0x7fbc0c071a60 2024-03-30T13:13:38.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.939+0000 7fbc03e00640 1 --2- 172.21.15.44:0/1858805218 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbbe806c530 0x7fbbe806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:38.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.940+0000 7fbc03e00640 1 --2- 172.21.15.44:0/1858805218 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbbe806c530 0x7fbbe806e9f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c15bdb0 tx=0x7fbbf40079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:38.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:38.948+0000 7fbc03400640 1 -- 172.21.15.44:0/1858805218 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fbbfc040070 con 0x7fbc0c071a60 2024-03-30T13:13:39.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.262+0000 7fbc12400640 1 -- 172.21.15.44:0/1858805218 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbc0c144fa0 con 0x7fbc0c071a60 2024-03-30T13:13:39.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.263+0000 7fbc03400640 1 -- 172.21.15.44:0/1858805218 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fbbfc07bcd0 con 0x7fbc0c071a60 2024-03-30T13:13:39.268 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-30T13:13:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.266+0000 7fbc12400640 1 -- 172.21.15.44:0/1858805218 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbbe806c530 msgr2=0x7fbbe806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.266+0000 7fbc12400640 1 --2- 172.21.15.44:0/1858805218 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbbe806c530 0x7fbbe806e9f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c15bdb0 tx=0x7fbbf40079b0 comp rx=0 tx=0).stop 2024-03-30T13:13:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.266+0000 7fbc12400640 1 -- 172.21.15.44:0/1858805218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc0c071a60 msgr2=0x7fbc0c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.266+0000 7fbc12400640 1 --2- 172.21.15.44:0/1858805218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc0c071a60 0x7fbc0c0b3da0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0098c0 tx=0x7fbbfc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:13:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.266+0000 7fbc12400640 1 -- 172.21.15.44:0/1858805218 shutdown_connections 2024-03-30T13:13:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.266+0000 7fbc12400640 1 --2- 172.21.15.44:0/1858805218 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fbbe806c530 0x7fbbe806e9f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.266+0000 7fbc12400640 1 --2- 172.21.15.44:0/1858805218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc0c160830 0x7fbc0c1f8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.266+0000 7fbc12400640 1 --2- 172.21.15.44:0/1858805218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc0c145c60 0x7fbc0c1f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.266+0000 7fbc12400640 1 --2- 172.21.15.44:0/1858805218 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbc0c071a60 0x7fbc0c0b3da0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.267+0000 7fbc12400640 1 -- 172.21.15.44:0/1858805218 >> 172.21.15.44:0/1858805218 conn(0x7fbc0c0b1c90 msgr2=0x7fbc0c0ca830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.267+0000 7fbc12400640 1 -- 172.21.15.44:0/1858805218 shutdown_connections 2024-03-30T13:13:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:39.267+0000 7fbc12400640 1 -- 172.21.15.44:0/1858805218 wait complete. 2024-03-30T13:13:39.291 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-30T13:13:39.292 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-30T13:13:39.292 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2024-03-30T13:13:39.292 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-30T13:13:39.292 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-30T13:13:39.292 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-30T13:13:39.292 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-30T13:13:39.292 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-30T13:13:39.292 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:13:39.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:39.293 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2024-03-30T13:13:39.349 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-30T13:13:39.349 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-30T13:13:39.349 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2024-03-30T13:13:39.350 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42495sec preferred_lft 42495sec 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 26:60:c6:bc:70:ef brd ff:ff:ff:ff:ff:ff 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::7437:83ff:feb4:94a/64 scope link 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 26:60:c6:bc:70:ef brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::2460:c6ff:febc:70ef/64 scope link 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:39.351 INFO:teuthology.orchestra.run.smithi151.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-30T13:13:39.352 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 4a:5e:3a:ea:0c:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:13:39.352 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::485e:3aff:feea:c46/64 scope link 2024-03-30T13:13:39.352 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2024-03-30T13:13:39.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:39.353 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-30T13:13:39.438 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-03-30T13:13:39.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:39.442 DEBUG:teuthology.orchestra.run.smithi151:> route 2024-03-30T13:13:39.493 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2024-03-30T13:13:39.494 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-30T13:13:39.494 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-30T13:13:39.494 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-30T13:13:39.494 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-30T13:13:39.494 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-30T13:13:39.494 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2024-03-30T13:13:39.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-30T13:13:39.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-30T13:13:39.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-30T13:13:39.495 DEBUG:teuthology.orchestra.run.smithi151:> ') 2024-03-30T13:13:39.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:13:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-30T13:13:39.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:13:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:13:39.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:39.736 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2024-03-30T13:13:39.785 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-30T13:13:39.785 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-30T13:13:39.785 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:13:39.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:39.786 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2024-03-30T13:13:39.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:13:39.881 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-30T13:13:39.935 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-30T13:13:39.936 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-30T13:13:39.936 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-30T13:13:39.984 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-30T13:13:39.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:39.984 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:13:40.110 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:13:40.110 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T13:13:40.110 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2024-03-30T13:13:40.130 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:13:40.130 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T13:13:40.130 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2024-03-30T13:13:40.130 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.151:3300,172.21.15.151:3301" 2024-03-30T13:13:40.130 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:13:40.157 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-30T13:13:40.157 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-30T13:13:40.157 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2024-03-30T13:13:40.157 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.44:3300,172.21.15.151:3300,172.21.15.151:3301" 2024-03-30T13:13:40.157 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-30T13:13:40.157 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.44:6789,172.21.15.151:6789,172.21.15.151:6790" 2024-03-30T13:13:40.157 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.44:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2024-03-30T13:13:40.157 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=cf82a1f9-ad5a-4657-adf6-b77304ed0e9d" will pass to kernel 2024-03-30T13:13:40.159 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-30T13:13:40.159 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2024-03-30T13:13:40.159 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-30T13:13:40.159 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2024-03-30T13:13:40.159 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-30T13:13:40.162 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-30T13:13:40.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:13:40.162 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-30T13:13:40.240 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-30T13:13:40.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:13:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-30T13:13:40.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-03-30T13:13:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-30T13:13:40.360 INFO:teuthology.orchestra.run.smithi151.stdout:client4853 2024-03-30T13:13:40.361 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:13:40.361 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:13:40.409 DEBUG:tasks.cephfs.test_uninlining:setting inline_data:1 2024-03-30T13:13:40.410 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs inline_data 1 --yes-i-really-really-mean-it 2024-03-30T13:13:40.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.632+0000 7ff41be00640 1 Processor -- start 2024-03-30T13:13:40.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.632+0000 7ff41be00640 1 -- start start 2024-03-30T13:13:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.634+0000 7ff41be00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff41c0d01c0 0x7ff41c0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.634+0000 7ff41be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff41c0ce690 0x7ff41c0cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.634+0000 7ff41be00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41c15c780 con 0x7ff41c13f000 2024-03-30T13:13:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.634+0000 7ff41be00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff41c0d0b70 con 0x7ff41c0ce690 2024-03-30T13:13:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.634+0000 7ff41be00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7ff41c15ca60 con 0x7ff41c0d01c0 2024-03-30T13:13:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.634+0000 7ff41aa00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff41c13f000 0x7ff41c141fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:48592/0 (socket says 172.21.15.44:48592) 2024-03-30T13:13:40.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.634+0000 7ff41aa00640 1 -- 172.21.15.44:0/1977852122 learned_addr learned my addr 172.21.15.44:0/1977852122 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:13:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.634+0000 7ff41b400640 1 --2- 172.21.15.44:0/1977852122 >> v2:172.21.15.44:3300/0 conn(0x7ff41c0ce690 0x7ff41c0cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.634+0000 7ff41a000640 1 --2- 172.21.15.44:0/1977852122 >> v2:172.21.15.151:3300/0 conn(0x7ff41c0d01c0 0x7ff41c0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.635+0000 7ff41b400640 1 -- 172.21.15.44:0/1977852122 >> v2:172.21.15.151:3300/0 conn(0x7ff41c0d01c0 msgr2=0x7ff41c0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.635+0000 7ff41b400640 1 --2- 172.21.15.44:0/1977852122 >> v2:172.21.15.151:3300/0 conn(0x7ff41c0d01c0 0x7ff41c0d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.635+0000 7ff41b400640 1 -- 172.21.15.44:0/1977852122 >> v1:172.21.15.44:6789/0 conn(0x7ff41c13f000 legacy=0x7ff41c141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:40.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.635+0000 7ff41b400640 1 -- 172.21.15.44:0/1977852122 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c15cd40 con 0x7ff41c0ce690 2024-03-30T13:13:40.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.636+0000 7ff41b400640 1 --2- 172.21.15.44:0/1977852122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c0ce690 0x7ff41c0cea90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0d0d90 tx=0x7ff41402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69d97a70e2ba77e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:40.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.636+0000 7ff419600640 1 -- 172.21.15.44:0/1977852122 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414039070 con 0x7ff41c0ce690 2024-03-30T13:13:40.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.637+0000 7ff419600640 1 -- 172.21.15.44:0/1977852122 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41402cc70 con 0x7ff41c0ce690 2024-03-30T13:13:40.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.637+0000 7ff419600640 1 -- 172.21.15.44:0/1977852122 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414034660 con 0x7ff41c0ce690 2024-03-30T13:13:40.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.637+0000 7ff41be00640 1 -- 172.21.15.44:0/1977852122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c0ce690 msgr2=0x7ff41c0cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:40.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.637+0000 7ff41be00640 1 --2- 172.21.15.44:0/1977852122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c0ce690 0x7ff41c0cea90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0d0d90 tx=0x7ff41402bec0 comp rx=0 tx=0).stop 2024-03-30T13:13:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.637+0000 7ff41be00640 1 -- 172.21.15.44:0/1977852122 shutdown_connections 2024-03-30T13:13:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.637+0000 7ff41be00640 1 --2- 172.21.15.44:0/1977852122 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c0ce690 0x7ff41c0cea90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.637+0000 7ff41be00640 1 --2- 172.21.15.44:0/1977852122 >> v2:172.21.15.151:3300/0 conn(0x7ff41c0d01c0 0x7ff41c0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.637+0000 7ff41be00640 1 -- 172.21.15.44:0/1977852122 >> 172.21.15.44:0/1977852122 conn(0x7ff41c06b9a0 msgr2=0x7ff41c06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.638+0000 7ff41be00640 1 -- 172.21.15.44:0/1977852122 shutdown_connections 2024-03-30T13:13:40.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.638+0000 7ff41be00640 1 -- 172.21.15.44:0/1977852122 wait complete. 2024-03-30T13:13:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.639+0000 7ff41be00640 1 Processor -- start 2024-03-30T13:13:40.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.640+0000 7ff41be00640 1 -- start start 2024-03-30T13:13:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.640+0000 7ff41be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c0ce690 0x7ff41c15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c0d01c0 0x7ff41c143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41be00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c13f000 0x7ff41c06d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c13f3e0 con 0x7ff41c0ce690 2024-03-30T13:13:40.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41be00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c1426d0 con 0x7ff41c0d01c0 2024-03-30T13:13:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41be00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff41c13f560 con 0x7ff41c13f000 2024-03-30T13:13:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c0ce690 0x7ff41c15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c0ce690 0x7ff41c15b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58434/0 (socket says 172.21.15.44:58434) 2024-03-30T13:13:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41aa00640 1 -- 172.21.15.44:0/830495335 learned_addr learned my addr 172.21.15.44:0/830495335 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41a000640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c0d01c0 0x7ff41c143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41b400640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c13f000 0x7ff41c06d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41aa00640 1 -- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c13f000 msgr2=0x7ff41c06d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41aa00640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c13f000 0x7ff41c06d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41aa00640 1 -- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c0d01c0 msgr2=0x7ff41c143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41aa00640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c0d01c0 0x7ff41c143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.641+0000 7ff41aa00640 1 -- 172.21.15.44:0/830495335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c1f3930 con 0x7ff41c0ce690 2024-03-30T13:13:40.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.642+0000 7ff41aa00640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c0ce690 0x7ff41c15b5c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff40400c3c0 tx=0x7ff40400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.642+0000 7ff412a00640 1 -- 172.21.15.44:0/830495335 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404017070 con 0x7ff41c0ce690 2024-03-30T13:13:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.642+0000 7ff412a00640 1 -- 172.21.15.44:0/830495335 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff404005ce0 con 0x7ff41c0ce690 2024-03-30T13:13:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.642+0000 7ff412a00640 1 -- 172.21.15.44:0/830495335 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4040072f0 con 0x7ff41c0ce690 2024-03-30T13:13:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.642+0000 7ff41be00640 1 -- 172.21.15.44:0/830495335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41c1f3650 con 0x7ff41c0ce690 2024-03-30T13:13:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.642+0000 7ff41be00640 1 -- 172.21.15.44:0/830495335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41c1e5d50 con 0x7ff41c0ce690 2024-03-30T13:13:40.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.643+0000 7ff41be00640 1 -- 172.21.15.44:0/830495335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff41c075890 con 0x7ff41c0ce690 2024-03-30T13:13:40.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.645+0000 7ff412a00640 1 -- 172.21.15.44:0/830495335 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff40401a070 con 0x7ff41c0ce690 2024-03-30T13:13:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.645+0000 7ff412a00640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3f806c530 0x7ff3f806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:40.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.646+0000 7ff412a00640 1 -- 172.21.15.44:0/830495335 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7ff40408abf0 con 0x7ff41c0ce690 2024-03-30T13:13:40.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.646+0000 7ff41a000640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3f806c530 0x7ff3f806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:40.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.647+0000 7ff41a000640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3f806c530 0x7ff3f806e9f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff41c15f860 tx=0x7ff40c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:40.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:40.650+0000 7ff412a00640 1 -- 172.21.15.44:0/830495335 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff404059070 con 0x7ff41c0ce690 2024-03-30T13:13:41.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.047+0000 7ff41be00640 1 -- 172.21.15.44:0/830495335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "1", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff41c06f3c0 con 0x7ff41c0ce690 2024-03-30T13:13:41.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.081+0000 7ff412a00640 1 -- 172.21.15.44:0/830495335 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "1", "yes_i_really_really_mean_it": true}]=0 inline data enabled v18) ==== 165+0+0 (secure 0 0 0) 0x7ff404058970 con 0x7ff41c0ce690 2024-03-30T13:13:41.086 INFO:teuthology.orchestra.run.smithi044.stderr:inline data enabled 2024-03-30T13:13:41.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.084+0000 7ff41be00640 1 -- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3f806c530 msgr2=0x7ff3f806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:41.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.084+0000 7ff41be00640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3f806c530 0x7ff3f806e9f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff41c15f860 tx=0x7ff40c008040 comp rx=0 tx=0).stop 2024-03-30T13:13:41.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.084+0000 7ff41be00640 1 -- 172.21.15.44:0/830495335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c0ce690 msgr2=0x7ff41c15b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:41.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.084+0000 7ff41be00640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c0ce690 0x7ff41c15b5c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff40400c3c0 tx=0x7ff40400c880 comp rx=0 tx=0).stop 2024-03-30T13:13:41.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.084+0000 7ff41be00640 1 -- 172.21.15.44:0/830495335 shutdown_connections 2024-03-30T13:13:41.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.084+0000 7ff41be00640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c13f000 0x7ff41c06d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:41.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.084+0000 7ff41be00640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3f806c530 0x7ff3f806e9f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:41.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.084+0000 7ff41be00640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c0d01c0 0x7ff41c143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:41.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.084+0000 7ff41be00640 1 --2- 172.21.15.44:0/830495335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c0ce690 0x7ff41c15b5c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:41.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.084+0000 7ff41be00640 1 -- 172.21.15.44:0/830495335 >> 172.21.15.44:0/830495335 conn(0x7ff41c06b9a0 msgr2=0x7ff41c0b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:41.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.085+0000 7ff41be00640 1 -- 172.21.15.44:0/830495335 shutdown_connections 2024-03-30T13:13:41.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:41.085+0000 7ff41be00640 1 -- 172.21.15.44:0/830495335 wait complete. 2024-03-30T13:13:41.107 DEBUG:tasks.cephfs.test_uninlining:fetching tarball 2024-03-30T13:13:41.107 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && wget http://download.ceph.com/qa/linux-5.4.tar.gz 2024-03-30T13:13:41.180 INFO:teuthology.orchestra.run.smithi044.stderr:--2024-03-30 13:13:41-- http://download.ceph.com/qa/linux-5.4.tar.gz 2024-03-30T13:13:41.181 INFO:teuthology.orchestra.run.smithi044.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-03-30T13:13:41.254 INFO:teuthology.orchestra.run.smithi044.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-03-30T13:13:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:HTTP request sent, awaiting response... 200 OK 2024-03-30T13:13:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:Length: 172616875 (165M) [application/octet-stream] 2024-03-30T13:13:41.316 INFO:teuthology.orchestra.run.smithi044.stderr:Saving to: ‘linux-5.4.tar.gz’ 2024-03-30T13:13:41.325 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-03-30T13:13:41.417 INFO:teuthology.orchestra.run.smithi044.stderr: 0K .......... .......... .......... .......... .......... 0% 496K 5m40s 2024-03-30T13:13:41.456 INFO:teuthology.orchestra.run.smithi044.stderr: 50K .......... .......... .......... .......... .......... 0% 1.22M 3m57s 2024-03-30T13:13:41.460 INFO:teuthology.orchestra.run.smithi044.stderr: 100K .......... .......... .......... .......... .......... 0% 12.9M 2m42s 2024-03-30T13:13:41.508 INFO:teuthology.orchestra.run.smithi044.stderr: 150K .......... .......... .......... .......... .......... 0% 1.05M 2m41s 2024-03-30T13:13:41.511 INFO:teuthology.orchestra.run.smithi044.stderr: 200K .......... .......... .......... .......... .......... 0% 47.8M 2m9s 2024-03-30T13:13:41.514 INFO:teuthology.orchestra.run.smithi044.stderr: 250K .......... .......... .......... .......... .......... 0% 9.42M 1m51s 2024-03-30T13:13:41.557 INFO:teuthology.orchestra.run.smithi044.stderr: 300K .......... .......... .......... .......... .......... 0% 1.12M 1m56s 2024-03-30T13:13:41.560 INFO:teuthology.orchestra.run.smithi044.stderr: 350K .......... .......... .......... .......... .......... 0% 25.3M 1m42s 2024-03-30T13:13:41.560 INFO:teuthology.orchestra.run.smithi044.stderr: 400K .......... .......... .......... .......... .......... 0% 66.1M 91s 2024-03-30T13:13:41.563 INFO:teuthology.orchestra.run.smithi044.stderr: 450K .......... .......... .......... .......... .......... 0% 74.9M 82s 2024-03-30T13:13:41.566 INFO:teuthology.orchestra.run.smithi044.stderr: 500K .......... .......... .......... .......... .......... 0% 11.8M 76s 2024-03-30T13:13:41.605 INFO:teuthology.orchestra.run.smithi044.stderr: 550K .......... .......... .......... .......... .......... 0% 1.21M 81s 2024-03-30T13:13:41.609 INFO:teuthology.orchestra.run.smithi044.stderr: 600K .......... .......... .......... .......... .......... 0% 20.3M 75s 2024-03-30T13:13:41.609 INFO:teuthology.orchestra.run.smithi044.stderr: 650K .......... .......... .......... .......... .......... 0% 72.2M 70s 2024-03-30T13:13:41.609 INFO:teuthology.orchestra.run.smithi044.stderr: 700K .......... .......... .......... .......... .......... 0% 47.9M 66s 2024-03-30T13:13:41.610 INFO:teuthology.orchestra.run.smithi044.stderr: 750K .......... .......... .......... .......... .......... 0% 28.1M 62s 2024-03-30T13:13:41.614 INFO:teuthology.orchestra.run.smithi044.stderr: 800K .......... .......... .......... .......... .......... 0% 11.9M 59s 2024-03-30T13:13:41.646 INFO:teuthology.orchestra.run.smithi044.stderr: 850K .......... .......... .......... .......... .......... 0% 1.54M 62s 2024-03-30T13:13:41.652 INFO:teuthology.orchestra.run.smithi044.stderr: 900K .......... .......... .......... .......... .......... 0% 25.6M 59s 2024-03-30T13:13:41.652 INFO:teuthology.orchestra.run.smithi044.stderr: 950K .......... .......... .......... .......... .......... 0% 43.8M 56s 2024-03-30T13:13:41.652 INFO:teuthology.orchestra.run.smithi044.stderr: 1000K .......... .......... .......... .......... .......... 0% 44.1M 53s 2024-03-30T13:13:41.654 INFO:teuthology.orchestra.run.smithi044.stderr: 1050K .......... .......... .......... .......... .......... 0% 12.8M 52s 2024-03-30T13:13:41.699 INFO:teuthology.orchestra.run.smithi044.stderr: 1100K .......... .......... .......... .......... .......... 0% 1.10M 56s 2024-03-30T13:13:41.731 INFO:teuthology.orchestra.run.smithi044.stderr: 1150K .......... .......... .......... .......... .......... 0% 1.56M 58s 2024-03-30T13:13:41.733 INFO:teuthology.orchestra.run.smithi044.stderr: 1200K .......... .......... .......... .......... .......... 0% 23.1M 56s 2024-03-30T13:13:41.735 INFO:teuthology.orchestra.run.smithi044.stderr: 1250K .......... .......... .......... .......... .......... 0% 16.9M 54s 2024-03-30T13:13:41.738 INFO:teuthology.orchestra.run.smithi044.stderr: 1300K .......... .......... .......... .......... .......... 0% 20.6M 52s 2024-03-30T13:13:41.741 INFO:teuthology.orchestra.run.smithi044.stderr: 1350K .......... .......... .......... .......... .......... 0% 14.4M 51s 2024-03-30T13:13:41.748 INFO:teuthology.orchestra.run.smithi044.stderr: 1400K .......... .......... .......... .......... .......... 0% 6.22M 50s 2024-03-30T13:13:41.766 INFO:teuthology.orchestra.run.smithi044.stderr: 1450K .......... .......... .......... .......... .......... 0% 2.81M 50s 2024-03-30T13:13:41.768 INFO:teuthology.orchestra.run.smithi044.stderr: 1500K .......... .......... .......... .......... .......... 0% 21.4M 49s 2024-03-30T13:13:41.771 INFO:teuthology.orchestra.run.smithi044.stderr: 1550K .......... .......... .......... .......... .......... 0% 17.9M 48s 2024-03-30T13:13:41.773 INFO:teuthology.orchestra.run.smithi044.stderr: 1600K .......... .......... .......... .......... .......... 0% 23.9M 46s 2024-03-30T13:13:41.777 INFO:teuthology.orchestra.run.smithi044.stderr: 1650K .......... .......... .......... .......... .......... 1% 13.9M 45s 2024-03-30T13:13:41.779 INFO:teuthology.orchestra.run.smithi044.stderr: 1700K .......... .......... .......... .......... .......... 1% 23.3M 44s 2024-03-30T13:13:41.802 INFO:teuthology.orchestra.run.smithi044.stderr: 1750K .......... .......... .......... .......... .......... 1% 2.07M 45s 2024-03-30T13:13:41.805 INFO:teuthology.orchestra.run.smithi044.stderr: 1800K .......... .......... .......... .......... .......... 1% 17.6M 44s 2024-03-30T13:13:41.808 INFO:teuthology.orchestra.run.smithi044.stderr: 1850K .......... .......... .......... .......... .......... 1% 16.0M 43s 2024-03-30T13:13:41.812 INFO:teuthology.orchestra.run.smithi044.stderr: 1900K .......... .......... .......... .......... .......... 1% 13.6M 42s 2024-03-30T13:13:41.814 INFO:teuthology.orchestra.run.smithi044.stderr: 1950K .......... .......... .......... .......... .......... 1% 20.7M 41s 2024-03-30T13:13:41.818 INFO:teuthology.orchestra.run.smithi044.stderr: 2000K .......... .......... .......... .......... .......... 1% 16.4M 41s 2024-03-30T13:13:41.824 INFO:teuthology.orchestra.run.smithi044.stderr: 2050K .......... .......... .......... .......... .......... 1% 6.44M 40s 2024-03-30T13:13:41.841 INFO:teuthology.orchestra.run.smithi044.stderr: 2100K .......... .......... .......... .......... .......... 1% 3.03M 41s 2024-03-30T13:13:41.845 INFO:teuthology.orchestra.run.smithi044.stderr: 2150K .......... .......... .......... .......... .......... 1% 13.0M 40s 2024-03-30T13:13:41.847 INFO:teuthology.orchestra.run.smithi044.stderr: 2200K .......... .......... .......... .......... .......... 1% 21.1M 39s 2024-03-30T13:13:41.851 INFO:teuthology.orchestra.run.smithi044.stderr: 2250K .......... .......... .......... .......... .......... 1% 12.3M 39s 2024-03-30T13:13:41.853 INFO:teuthology.orchestra.run.smithi044.stderr: 2300K .......... .......... .......... .......... .......... 1% 25.8M 38s 2024-03-30T13:13:41.858 INFO:teuthology.orchestra.run.smithi044.stderr: 2350K .......... .......... .......... .......... .......... 1% 11.0M 37s 2024-03-30T13:13:41.864 INFO:teuthology.orchestra.run.smithi044.stderr: 2400K .......... .......... .......... .......... .......... 1% 7.76M 37s 2024-03-30T13:13:41.882 INFO:teuthology.orchestra.run.smithi044.stderr: 2450K .......... .......... .......... .......... .......... 1% 2.65M 38s 2024-03-30T13:13:41.886 INFO:teuthology.orchestra.run.smithi044.stderr: 2500K .......... .......... .......... .......... .......... 1% 11.5M 37s 2024-03-30T13:13:41.888 INFO:teuthology.orchestra.run.smithi044.stderr: 2550K .......... .......... .......... .......... .......... 1% 24.0M 37s 2024-03-30T13:13:41.893 INFO:teuthology.orchestra.run.smithi044.stderr: 2600K .......... .......... .......... .......... .......... 1% 10.7M 36s 2024-03-30T13:13:41.895 INFO:teuthology.orchestra.run.smithi044.stderr: 2650K .......... .......... .......... .......... .......... 1% 24.5M 36s 2024-03-30T13:13:41.902 INFO:teuthology.orchestra.run.smithi044.stderr: 2700K .......... .......... .......... .......... .......... 1% 10.6M 35s 2024-03-30T13:13:41.905 INFO:teuthology.orchestra.run.smithi044.stderr: 2750K .......... .......... .......... .......... .......... 1% 25.5M 35s 2024-03-30T13:13:41.958 INFO:teuthology.orchestra.run.smithi044.stderr: 2800K .......... .......... .......... .......... .......... 1% 885K 37s 2024-03-30T13:13:41.960 INFO:teuthology.orchestra.run.smithi044.stderr: 2850K .......... .......... .......... .......... .......... 1% 22.6M 37s 2024-03-30T13:13:41.963 INFO:teuthology.orchestra.run.smithi044.stderr: 2900K .......... .......... .......... .......... .......... 1% 21.4M 36s 2024-03-30T13:13:41.964 INFO:teuthology.orchestra.run.smithi044.stderr: 2950K .......... .......... .......... .......... .......... 1% 28.0M 36s 2024-03-30T13:13:41.966 INFO:teuthology.orchestra.run.smithi044.stderr: 3000K .......... .......... .......... .......... .......... 1% 22.0M 35s 2024-03-30T13:13:41.968 INFO:teuthology.orchestra.run.smithi044.stderr: 3050K .......... .......... .......... .......... .......... 1% 28.7M 35s 2024-03-30T13:13:42.047 INFO:teuthology.orchestra.run.smithi044.stderr: 3100K .......... .......... .......... .......... .......... 1% 649K 38s 2024-03-30T13:13:42.047 INFO:teuthology.orchestra.run.smithi044.stderr: 3150K .......... .......... .......... .......... .......... 1% 43.3M 38s 2024-03-30T13:13:42.059 INFO:teuthology.orchestra.run.smithi044.stderr: 3200K .......... .......... .......... .......... .......... 1% 40.9M 37s 2024-03-30T13:13:42.060 INFO:teuthology.orchestra.run.smithi044.stderr: 3250K .......... .......... .......... .......... .......... 1% 48.4M 37s 2024-03-30T13:13:42.060 INFO:teuthology.orchestra.run.smithi044.stderr: 3300K .......... .......... .......... .......... .......... 1% 45.0M 36s 2024-03-30T13:13:42.060 INFO:teuthology.orchestra.run.smithi044.stderr: 3350K .......... .......... .......... .......... .......... 2% 45.0M 36s 2024-03-30T13:13:42.060 INFO:teuthology.orchestra.run.smithi044.stderr: 3400K .......... .......... .......... .......... .......... 2% 41.6M 35s 2024-03-30T13:13:42.060 INFO:teuthology.orchestra.run.smithi044.stderr: 3450K .......... .......... .......... .......... .......... 2% 45.6M 35s 2024-03-30T13:13:42.060 INFO:teuthology.orchestra.run.smithi044.stderr: 3500K .......... .......... .......... .......... .......... 2% 46.4M 34s 2024-03-30T13:13:42.060 INFO:teuthology.orchestra.run.smithi044.stderr: 3550K .......... .......... .......... .......... .......... 2% 46.1M 34s 2024-03-30T13:13:42.060 INFO:teuthology.orchestra.run.smithi044.stderr: 3600K .......... .......... .......... .......... .......... 2% 40.9M 33s 2024-03-30T13:13:42.060 INFO:teuthology.orchestra.run.smithi044.stderr: 3650K .......... .......... .......... .......... .......... 2% 48.9M 33s 2024-03-30T13:13:42.060 INFO:teuthology.orchestra.run.smithi044.stderr: 3700K .......... .......... .......... .......... .......... 2% 48.6M 33s 2024-03-30T13:13:42.066 INFO:teuthology.orchestra.run.smithi044.stderr: 3750K .......... .......... .......... .......... .......... 2% 6.20M 33s 2024-03-30T13:13:42.071 INFO:teuthology.orchestra.run.smithi044.stderr: 3800K .......... .......... .......... .......... .......... 2% 10.5M 32s 2024-03-30T13:13:42.082 INFO:teuthology.orchestra.run.smithi044.stderr: 3850K .......... .......... .......... .......... .......... 2% 4.30M 32s 2024-03-30T13:13:42.086 INFO:teuthology.orchestra.run.smithi044.stderr: 3900K .......... .......... .......... .......... .......... 2% 12.4M 32s 2024-03-30T13:13:42.091 INFO:teuthology.orchestra.run.smithi044.stderr: 3950K .......... .......... .......... .......... .......... 2% 14.0M 32s 2024-03-30T13:13:42.091 INFO:teuthology.orchestra.run.smithi044.stderr: 4000K .......... .......... .......... .......... .......... 2% 35.3M 31s 2024-03-30T13:13:42.111 INFO:teuthology.orchestra.run.smithi044.stderr: 4050K .......... .......... .......... .......... .......... 2% 2.40M 32s 2024-03-30T13:13:42.112 INFO:teuthology.orchestra.run.smithi044.stderr: 4100K .......... .......... .......... .......... .......... 2% 28.2M 32s 2024-03-30T13:13:42.118 INFO:teuthology.orchestra.run.smithi044.stderr: 4150K .......... .......... .......... .......... .......... 2% 8.98M 31s 2024-03-30T13:13:42.123 INFO:teuthology.orchestra.run.smithi044.stderr: 4200K .......... .......... .......... .......... .......... 2% 10.6M 31s 2024-03-30T13:13:42.129 INFO:teuthology.orchestra.run.smithi044.stderr: 4250K .......... .......... .......... .......... .......... 2% 8.86M 31s 2024-03-30T13:13:42.182 INFO:teuthology.orchestra.run.smithi044.stderr: 4300K .......... .......... .......... .......... .......... 2% 935K 33s 2024-03-30T13:13:42.184 INFO:teuthology.orchestra.run.smithi044.stderr: 4350K .......... .......... .......... .......... .......... 2% 22.4M 32s 2024-03-30T13:13:42.186 INFO:teuthology.orchestra.run.smithi044.stderr: 4400K .......... .......... .......... .......... .......... 2% 22.6M 32s 2024-03-30T13:13:42.190 INFO:teuthology.orchestra.run.smithi044.stderr: 4450K .......... .......... .......... .......... .......... 2% 11.9M 32s 2024-03-30T13:13:42.193 INFO:teuthology.orchestra.run.smithi044.stderr: 4500K .......... .......... .......... .......... .......... 2% 20.6M 32s 2024-03-30T13:13:42.195 INFO:teuthology.orchestra.run.smithi044.stderr: 4550K .......... .......... .......... .......... .......... 2% 27.2M 31s 2024-03-30T13:13:42.224 INFO:teuthology.orchestra.run.smithi044.stderr: 4600K .......... .......... .......... .......... .......... 2% 1.64M 32s 2024-03-30T13:13:42.226 INFO:teuthology.orchestra.run.smithi044.stderr: 4650K .......... .......... .......... .......... .......... 2% 22.7M 32s 2024-03-30T13:13:42.230 INFO:teuthology.orchestra.run.smithi044.stderr: 4700K .......... .......... .......... .......... .......... 2% 18.5M 31s 2024-03-30T13:13:42.238 INFO:teuthology.orchestra.run.smithi044.stderr: 4750K .......... .......... .......... .......... .......... 2% 5.24M 31s 2024-03-30T13:13:42.242 INFO:teuthology.orchestra.run.smithi044.stderr: 4800K .......... .......... .......... .......... .......... 2% 16.6M 31s 2024-03-30T13:13:42.242 INFO:teuthology.orchestra.run.smithi044.stderr: 4850K .......... .......... .......... .......... .......... 2% 71.7M 31s 2024-03-30T13:13:42.275 INFO:teuthology.orchestra.run.smithi044.stderr: 4900K .......... .......... .......... .......... .......... 2% 1.47M 32s 2024-03-30T13:13:42.279 INFO:teuthology.orchestra.run.smithi044.stderr: 4950K .......... .......... .......... .......... .......... 2% 13.5M 31s 2024-03-30T13:13:42.284 INFO:teuthology.orchestra.run.smithi044.stderr: 5000K .......... .......... .......... .......... .......... 2% 9.40M 31s 2024-03-30T13:13:42.290 INFO:teuthology.orchestra.run.smithi044.stderr: 5050K .......... .......... .......... .......... .......... 3% 8.55M 31s 2024-03-30T13:13:42.292 INFO:teuthology.orchestra.run.smithi044.stderr: 5100K .......... .......... .......... .......... .......... 3% 37.4M 31s 2024-03-30T13:13:42.292 INFO:teuthology.orchestra.run.smithi044.stderr: 5150K .......... .......... .......... .......... .......... 3% 39.5M 31s 2024-03-30T13:13:42.324 INFO:teuthology.orchestra.run.smithi044.stderr: 5200K .......... .......... .......... .......... .......... 3% 1.62M 31s 2024-03-30T13:13:42.324 INFO:teuthology.orchestra.run.smithi044.stderr: 5250K .......... .......... .......... .......... .......... 3% 34.5M 31s 2024-03-30T13:13:42.328 INFO:teuthology.orchestra.run.smithi044.stderr: 5300K .......... .......... .......... .......... .......... 3% 10.3M 31s 2024-03-30T13:13:42.335 INFO:teuthology.orchestra.run.smithi044.stderr: 5350K .......... .......... .......... .......... .......... 3% 8.18M 31s 2024-03-30T13:13:42.337 INFO:teuthology.orchestra.run.smithi044.stderr: 5400K .......... .......... .......... .......... .......... 3% 39.3M 31s 2024-03-30T13:13:42.337 INFO:teuthology.orchestra.run.smithi044.stderr: 5450K .......... .......... .......... .......... .......... 3% 32.6M 30s 2024-03-30T13:13:42.371 INFO:teuthology.orchestra.run.smithi044.stderr: 5500K .......... .......... .......... .......... .......... 3% 1.47M 31s 2024-03-30T13:13:42.371 INFO:teuthology.orchestra.run.smithi044.stderr: 5550K .......... .......... .......... .......... .......... 3% 35.1M 31s 2024-03-30T13:13:42.376 INFO:teuthology.orchestra.run.smithi044.stderr: 5600K .......... .......... .......... .......... .......... 3% 11.5M 31s 2024-03-30T13:13:42.382 INFO:teuthology.orchestra.run.smithi044.stderr: 5650K .......... .......... .......... .......... .......... 3% 7.26M 30s 2024-03-30T13:13:42.384 INFO:teuthology.orchestra.run.smithi044.stderr: 5700K .......... .......... .......... .......... .......... 3% 31.7M 30s 2024-03-30T13:13:42.386 INFO:teuthology.orchestra.run.smithi044.stderr: 5750K .......... .......... .......... .......... .......... 3% 35.9M 30s 2024-03-30T13:13:42.408 INFO:teuthology.orchestra.run.smithi044.stderr: 5800K .......... .......... .......... .......... .......... 3% 2.41M 30s 2024-03-30T13:13:42.408 INFO:teuthology.orchestra.run.smithi044.stderr: 5850K .......... .......... .......... .......... .......... 3% 32.2M 30s 2024-03-30T13:13:42.411 INFO:teuthology.orchestra.run.smithi044.stderr: 5900K .......... .......... .......... .......... .......... 3% 11.3M 30s 2024-03-30T13:13:42.421 INFO:teuthology.orchestra.run.smithi044.stderr: 5950K .......... .......... .......... .......... .......... 3% 7.29M 30s 2024-03-30T13:13:42.421 INFO:teuthology.orchestra.run.smithi044.stderr: 6000K .......... .......... .......... .......... .......... 3% 34.6M 30s 2024-03-30T13:13:42.422 INFO:teuthology.orchestra.run.smithi044.stderr: 6050K .......... .......... .......... .......... .......... 3% 22.5M 29s 2024-03-30T13:13:42.495 INFO:teuthology.orchestra.run.smithi044.stderr: 6100K .......... .......... .......... .......... .......... 3% 685K 31s 2024-03-30T13:13:42.497 INFO:teuthology.orchestra.run.smithi044.stderr: 6150K .......... .......... .......... .......... .......... 3% 30.0M 31s 2024-03-30T13:13:42.499 INFO:teuthology.orchestra.run.smithi044.stderr: 6200K .......... .......... .......... .......... .......... 3% 25.8M 31s 2024-03-30T13:13:42.501 INFO:teuthology.orchestra.run.smithi044.stderr: 6250K .......... .......... .......... .......... .......... 3% 30.0M 30s 2024-03-30T13:13:42.504 INFO:teuthology.orchestra.run.smithi044.stderr: 6300K .......... .......... .......... .......... .......... 3% 32.9M 30s 2024-03-30T13:13:42.504 INFO:teuthology.orchestra.run.smithi044.stderr: 6350K .......... .......... .......... .......... .......... 3% 27.4M 30s 2024-03-30T13:13:42.540 INFO:teuthology.orchestra.run.smithi044.stderr: 6400K .......... .......... .......... .......... .......... 3% 1.60M 31s 2024-03-30T13:13:42.540 INFO:teuthology.orchestra.run.smithi044.stderr: 6450K .......... .......... .......... .......... .......... 3% 33.1M 30s 2024-03-30T13:13:42.541 INFO:teuthology.orchestra.run.smithi044.stderr: 6500K .......... .......... .......... .......... .......... 3% 34.0M 30s 2024-03-30T13:13:42.541 INFO:teuthology.orchestra.run.smithi044.stderr: 6550K .......... .......... .......... .......... .......... 3% 30.2M 30s 2024-03-30T13:13:42.541 INFO:teuthology.orchestra.run.smithi044.stderr: 6600K .......... .......... .......... .......... .......... 3% 27.1M 30s 2024-03-30T13:13:42.542 INFO:teuthology.orchestra.run.smithi044.stderr: 6650K .......... .......... .......... .......... .......... 3% 26.5M 30s 2024-03-30T13:13:42.570 INFO:teuthology.orchestra.run.smithi044.stderr: 6700K .......... .......... .......... .......... .......... 4% 1.80M 30s 2024-03-30T13:13:42.572 INFO:teuthology.orchestra.run.smithi044.stderr: 6750K .......... .......... .......... .......... .......... 4% 27.6M 30s 2024-03-30T13:13:42.573 INFO:teuthology.orchestra.run.smithi044.stderr: 6800K .......... .......... .......... .......... .......... 4% 40.4M 30s 2024-03-30T13:13:42.574 INFO:teuthology.orchestra.run.smithi044.stderr: 6850K .......... .......... .......... .......... .......... 4% 27.3M 29s 2024-03-30T13:13:42.576 INFO:teuthology.orchestra.run.smithi044.stderr: 6900K .......... .......... .......... .......... .......... 4% 20.5M 29s 2024-03-30T13:13:42.581 INFO:teuthology.orchestra.run.smithi044.stderr: 6950K .......... .......... .......... .......... .......... 4% 9.08M 29s 2024-03-30T13:13:42.604 INFO:teuthology.orchestra.run.smithi044.stderr: 7000K .......... .......... .......... .......... .......... 4% 2.14M 30s 2024-03-30T13:13:42.606 INFO:teuthology.orchestra.run.smithi044.stderr: 7050K .......... .......... .......... .......... .......... 4% 34.7M 29s 2024-03-30T13:13:42.607 INFO:teuthology.orchestra.run.smithi044.stderr: 7100K .......... .......... .......... .......... .......... 4% 31.6M 29s 2024-03-30T13:13:42.609 INFO:teuthology.orchestra.run.smithi044.stderr: 7150K .......... .......... .......... .......... .......... 4% 30.4M 29s 2024-03-30T13:13:42.612 INFO:teuthology.orchestra.run.smithi044.stderr: 7200K .......... .......... .......... .......... .......... 4% 21.4M 29s 2024-03-30T13:13:42.617 INFO:teuthology.orchestra.run.smithi044.stderr: 7250K .......... .......... .......... .......... .......... 4% 8.49M 29s 2024-03-30T13:13:42.618 INFO:teuthology.orchestra.run.smithi044.stderr: 7300K .......... .......... .......... .......... .......... 4% 36.0M 29s 2024-03-30T13:13:42.643 INFO:teuthology.orchestra.run.smithi044.stderr: 7350K .......... .......... .......... .......... .......... 4% 2.12M 29s 2024-03-30T13:13:42.643 INFO:teuthology.orchestra.run.smithi044.stderr: 7400K .......... .......... .......... .......... .......... 4% 34.1M 29s 2024-03-30T13:13:42.645 INFO:teuthology.orchestra.run.smithi044.stderr: 7450K .......... .......... .......... .......... .......... 4% 35.9M 29s 2024-03-30T13:13:42.646 INFO:teuthology.orchestra.run.smithi044.stderr: 7500K .......... .......... .......... .......... .......... 4% 23.6M 28s 2024-03-30T13:13:42.650 INFO:teuthology.orchestra.run.smithi044.stderr: 7550K .......... .......... .......... .......... .......... 4% 13.6M 28s 2024-03-30T13:13:42.689 INFO:teuthology.orchestra.run.smithi044.stderr: 7600K .......... .......... .......... .......... .......... 4% 1.26M 29s 2024-03-30T13:13:42.694 INFO:teuthology.orchestra.run.smithi044.stderr: 7650K .......... .......... .......... .......... .......... 4% 8.22M 29s 2024-03-30T13:13:42.696 INFO:teuthology.orchestra.run.smithi044.stderr: 7700K .......... .......... .......... .......... .......... 4% 27.2M 29s 2024-03-30T13:13:42.698 INFO:teuthology.orchestra.run.smithi044.stderr: 7750K .......... .......... .......... .......... .......... 4% 26.8M 28s 2024-03-30T13:13:42.700 INFO:teuthology.orchestra.run.smithi044.stderr: 7800K .......... .......... .......... .......... .......... 4% 32.5M 28s 2024-03-30T13:13:42.701 INFO:teuthology.orchestra.run.smithi044.stderr: 7850K .......... .......... .......... .......... .......... 4% 32.9M 28s 2024-03-30T13:13:42.751 INFO:teuthology.orchestra.run.smithi044.stderr: 7900K .......... .......... .......... .......... .......... 4% 1012K 29s 2024-03-30T13:13:42.763 INFO:teuthology.orchestra.run.smithi044.stderr: 7950K .......... .......... .......... .......... .......... 4% 3.83M 29s 2024-03-30T13:13:42.785 INFO:teuthology.orchestra.run.smithi044.stderr: 8000K .......... .......... .......... .......... .......... 4% 2.24M 29s 2024-03-30T13:13:42.787 INFO:teuthology.orchestra.run.smithi044.stderr: 8050K .......... .......... .......... .......... .......... 4% 30.3M 29s 2024-03-30T13:13:42.794 INFO:teuthology.orchestra.run.smithi044.stderr: 8100K .......... .......... .......... .......... .......... 4% 7.28M 29s 2024-03-30T13:13:42.875 INFO:teuthology.orchestra.run.smithi044.stderr: 8150K .......... .......... .......... .......... .......... 4% 682K 30s 2024-03-30T13:13:42.875 INFO:teuthology.orchestra.run.smithi044.stderr: 8200K .......... .......... .......... .......... .......... 4% 40.0M 30s 2024-03-30T13:13:42.875 INFO:teuthology.orchestra.run.smithi044.stderr: 8250K .......... .......... .......... .......... .......... 4% 42.1M 30s 2024-03-30T13:13:42.875 INFO:teuthology.orchestra.run.smithi044.stderr: 8300K .......... .......... .......... .......... .......... 4% 32.0M 30s 2024-03-30T13:13:42.875 INFO:teuthology.orchestra.run.smithi044.stderr: 8350K .......... .......... .......... .......... .......... 4% 38.1M 30s 2024-03-30T13:13:42.875 INFO:teuthology.orchestra.run.smithi044.stderr: 8400K .......... .......... .......... .......... .......... 5% 41.2M 30s 2024-03-30T13:13:42.875 INFO:teuthology.orchestra.run.smithi044.stderr: 8450K .......... .......... .......... .......... .......... 5% 38.2M 29s 2024-03-30T13:13:42.879 INFO:teuthology.orchestra.run.smithi044.stderr: 8500K .......... .......... .......... .......... .......... 5% 32.1M 29s 2024-03-30T13:13:42.879 INFO:teuthology.orchestra.run.smithi044.stderr: 8550K .......... .......... .......... .......... .......... 5% 41.8M 29s 2024-03-30T13:13:42.880 INFO:teuthology.orchestra.run.smithi044.stderr: 8600K .......... .......... .......... .......... .......... 5% 42.3M 29s 2024-03-30T13:13:42.883 INFO:teuthology.orchestra.run.smithi044.stderr: 8650K .......... .......... .......... .......... .......... 5% 15.4M 29s 2024-03-30T13:13:42.883 INFO:teuthology.orchestra.run.smithi044.stderr: 8700K .......... .......... .......... .......... .......... 5% 29.9M 29s 2024-03-30T13:13:42.907 INFO:teuthology.orchestra.run.smithi044.stderr: 8750K .......... .......... .......... .......... .......... 5% 2.09M 29s 2024-03-30T13:13:42.909 INFO:teuthology.orchestra.run.smithi044.stderr: 8800K .......... .......... .......... .......... .......... 5% 16.3M 29s 2024-03-30T13:13:42.916 INFO:teuthology.orchestra.run.smithi044.stderr: 8850K .......... .......... .......... .......... .......... 5% 7.30M 29s 2024-03-30T13:13:42.922 INFO:teuthology.orchestra.run.smithi044.stderr: 8900K .......... .......... .......... .......... .......... 5% 10.6M 29s 2024-03-30T13:13:42.938 INFO:teuthology.orchestra.run.smithi044.stderr: 8950K .......... .......... .......... .......... .......... 5% 2.78M 29s 2024-03-30T13:13:42.943 INFO:teuthology.orchestra.run.smithi044.stderr: 9000K .......... .......... .......... .......... .......... 5% 10.3M 29s 2024-03-30T13:13:42.951 INFO:teuthology.orchestra.run.smithi044.stderr: 9050K .......... .......... .......... .......... .......... 5% 6.56M 29s 2024-03-30T13:13:42.955 INFO:teuthology.orchestra.run.smithi044.stderr: 9100K .......... .......... .......... .......... .......... 5% 10.1M 29s 2024-03-30T13:13:42.958 INFO:teuthology.orchestra.run.smithi044.stderr: 9150K .......... .......... .......... .......... .......... 5% 15.0M 28s 2024-03-30T13:13:42.979 INFO:teuthology.orchestra.run.smithi044.stderr: 9200K .......... .......... .......... .......... .......... 5% 2.49M 29s 2024-03-30T13:13:42.981 INFO:teuthology.orchestra.run.smithi044.stderr: 9250K .......... .......... .......... .......... .......... 5% 20.7M 29s 2024-03-30T13:13:42.990 INFO:teuthology.orchestra.run.smithi044.stderr: 9300K .......... .......... .......... .......... .......... 5% 5.02M 29s 2024-03-30T13:13:42.992 INFO:teuthology.orchestra.run.smithi044.stderr: 9350K .......... .......... .......... .......... .......... 5% 26.1M 28s 2024-03-30T13:13:43.008 INFO:teuthology.orchestra.run.smithi044.stderr: 9400K .......... .......... .......... .......... .......... 5% 2.91M 29s 2024-03-30T13:13:43.014 INFO:teuthology.orchestra.run.smithi044.stderr: 9450K .......... .......... .......... .......... .......... 5% 8.91M 28s 2024-03-30T13:13:43.022 INFO:teuthology.orchestra.run.smithi044.stderr: 9500K .......... .......... .......... .......... .......... 5% 6.47M 28s 2024-03-30T13:13:43.026 INFO:teuthology.orchestra.run.smithi044.stderr: 9550K .......... .......... .......... .......... .......... 5% 10.7M 28s 2024-03-30T13:13:43.030 INFO:teuthology.orchestra.run.smithi044.stderr: 9600K .......... .......... .......... .......... .......... 5% 14.8M 28s 2024-03-30T13:13:43.049 INFO:teuthology.orchestra.run.smithi044.stderr: 9650K .......... .......... .......... .......... .......... 5% 2.51M 28s 2024-03-30T13:13:43.052 INFO:teuthology.orchestra.run.smithi044.stderr: 9700K .......... .......... .......... .......... .......... 5% 15.8M 28s 2024-03-30T13:13:43.058 INFO:teuthology.orchestra.run.smithi044.stderr: 9750K .......... .......... .......... .......... .......... 5% 7.65M 28s 2024-03-30T13:13:43.063 INFO:teuthology.orchestra.run.smithi044.stderr: 9800K .......... .......... .......... .......... .......... 5% 11.0M 28s 2024-03-30T13:13:43.081 INFO:teuthology.orchestra.run.smithi044.stderr: 9850K .......... .......... .......... .......... .......... 5% 2.86M 28s 2024-03-30T13:13:43.085 INFO:teuthology.orchestra.run.smithi044.stderr: 9900K .......... .......... .......... .......... .......... 5% 8.95M 28s 2024-03-30T13:13:43.094 INFO:teuthology.orchestra.run.smithi044.stderr: 9950K .......... .......... .......... .......... .......... 5% 6.40M 28s 2024-03-30T13:13:43.097 INFO:teuthology.orchestra.run.smithi044.stderr: 10000K .......... .......... .......... .......... .......... 5% 12.5M 28s 2024-03-30T13:13:43.099 INFO:teuthology.orchestra.run.smithi044.stderr: 10050K .......... .......... .......... .......... .......... 5% 23.2M 28s 2024-03-30T13:13:43.119 INFO:teuthology.orchestra.run.smithi044.stderr: 10100K .......... .......... .......... .......... .......... 6% 2.47M 28s 2024-03-30T13:13:43.121 INFO:teuthology.orchestra.run.smithi044.stderr: 10150K .......... .......... .......... .......... .......... 6% 17.1M 28s 2024-03-30T13:13:43.129 INFO:teuthology.orchestra.run.smithi044.stderr: 10200K .......... .......... .......... .......... .......... 6% 6.38M 28s 2024-03-30T13:13:43.134 INFO:teuthology.orchestra.run.smithi044.stderr: 10250K .......... .......... .......... .......... .......... 6% 10.4M 28s 2024-03-30T13:13:43.152 INFO:teuthology.orchestra.run.smithi044.stderr: 10300K .......... .......... .......... .......... .......... 6% 2.87M 28s 2024-03-30T13:13:43.157 INFO:teuthology.orchestra.run.smithi044.stderr: 10350K .......... .......... .......... .......... .......... 6% 9.42M 28s 2024-03-30T13:13:43.165 INFO:teuthology.orchestra.run.smithi044.stderr: 10400K .......... .......... .......... .......... .......... 6% 6.39M 28s 2024-03-30T13:13:43.170 INFO:teuthology.orchestra.run.smithi044.stderr: 10450K .......... .......... .......... .......... .......... 6% 11.5M 28s 2024-03-30T13:13:43.170 INFO:teuthology.orchestra.run.smithi044.stderr: 10500K .......... .......... .......... .......... .......... 6% 26.2M 28s 2024-03-30T13:13:43.189 INFO:teuthology.orchestra.run.smithi044.stderr: 10550K .......... .......... .......... .......... .......... 6% 2.59M 28s 2024-03-30T13:13:43.193 INFO:teuthology.orchestra.run.smithi044.stderr: 10600K .......... .......... .......... .......... .......... 6% 13.7M 28s 2024-03-30T13:13:43.200 INFO:teuthology.orchestra.run.smithi044.stderr: 10650K .......... .......... .......... .......... .......... 6% 6.33M 28s 2024-03-30T13:13:43.205 INFO:teuthology.orchestra.run.smithi044.stderr: 10700K .......... .......... .......... .......... .......... 6% 11.8M 28s 2024-03-30T13:13:43.208 INFO:teuthology.orchestra.run.smithi044.stderr: 10750K .......... .......... .......... .......... .......... 6% 12.0M 28s 2024-03-30T13:13:43.227 INFO:teuthology.orchestra.run.smithi044.stderr: 10800K .......... .......... .......... .......... .......... 6% 2.56M 28s 2024-03-30T13:13:43.230 INFO:teuthology.orchestra.run.smithi044.stderr: 10850K .......... .......... .......... .......... .......... 6% 18.8M 28s 2024-03-30T13:13:43.236 INFO:teuthology.orchestra.run.smithi044.stderr: 10900K .......... .......... .......... .......... .......... 6% 7.64M 28s 2024-03-30T13:13:43.241 INFO:teuthology.orchestra.run.smithi044.stderr: 10950K .......... .......... .......... .......... .......... 6% 11.4M 28s 2024-03-30T13:13:43.258 INFO:teuthology.orchestra.run.smithi044.stderr: 11000K .......... .......... .......... .......... .......... 6% 2.77M 28s 2024-03-30T13:13:43.263 INFO:teuthology.orchestra.run.smithi044.stderr: 11050K .......... .......... .......... .......... .......... 6% 9.36M 28s 2024-03-30T13:13:43.271 INFO:teuthology.orchestra.run.smithi044.stderr: 11100K .......... .......... .......... .......... .......... 6% 6.74M 28s 2024-03-30T13:13:43.275 INFO:teuthology.orchestra.run.smithi044.stderr: 11150K .......... .......... .......... .......... .......... 6% 11.2M 28s 2024-03-30T13:13:43.276 INFO:teuthology.orchestra.run.smithi044.stderr: 11200K .......... .......... .......... .......... .......... 6% 31.3M 27s 2024-03-30T13:13:43.294 INFO:teuthology.orchestra.run.smithi044.stderr: 11250K .......... .......... .......... .......... .......... 6% 2.80M 28s 2024-03-30T13:13:43.300 INFO:teuthology.orchestra.run.smithi044.stderr: 11300K .......... .......... .......... .......... .......... 6% 8.99M 27s 2024-03-30T13:13:43.307 INFO:teuthology.orchestra.run.smithi044.stderr: 11350K .......... .......... .......... .......... .......... 6% 6.80M 27s 2024-03-30T13:13:43.311 INFO:teuthology.orchestra.run.smithi044.stderr: 11400K .......... .......... .......... .......... .......... 6% 11.7M 27s 2024-03-30T13:13:43.315 INFO:teuthology.orchestra.run.smithi044.stderr: 11450K .......... .......... .......... .......... .......... 6% 11.8M 27s 2024-03-30T13:13:43.334 INFO:teuthology.orchestra.run.smithi044.stderr: 11500K .......... .......... .......... .......... .......... 6% 2.57M 27s 2024-03-30T13:13:43.335 INFO:teuthology.orchestra.run.smithi044.stderr: 11550K .......... .......... .......... .......... .......... 6% 37.7M 27s 2024-03-30T13:13:43.343 INFO:teuthology.orchestra.run.smithi044.stderr: 11600K .......... .......... .......... .......... .......... 6% 6.86M 27s 2024-03-30T13:13:43.347 INFO:teuthology.orchestra.run.smithi044.stderr: 11650K .......... .......... .......... .......... .......... 6% 11.0M 27s 2024-03-30T13:13:43.367 INFO:teuthology.orchestra.run.smithi044.stderr: 11700K .......... .......... .......... .......... .......... 6% 2.67M 27s 2024-03-30T13:13:43.371 INFO:teuthology.orchestra.run.smithi044.stderr: 11750K .......... .......... .......... .......... .......... 7% 9.72M 27s 2024-03-30T13:13:43.378 INFO:teuthology.orchestra.run.smithi044.stderr: 11800K .......... .......... .......... .......... .......... 7% 7.05M 27s 2024-03-30T13:13:43.382 INFO:teuthology.orchestra.run.smithi044.stderr: 11850K .......... .......... .......... .......... .......... 7% 11.4M 27s 2024-03-30T13:13:43.383 INFO:teuthology.orchestra.run.smithi044.stderr: 11900K .......... .......... .......... .......... .......... 7% 34.4M 27s 2024-03-30T13:13:43.401 INFO:teuthology.orchestra.run.smithi044.stderr: 11950K .......... .......... .......... .......... .......... 7% 2.69M 27s 2024-03-30T13:13:43.406 INFO:teuthology.orchestra.run.smithi044.stderr: 12000K .......... .......... .......... .......... .......... 7% 9.74M 27s 2024-03-30T13:13:43.414 INFO:teuthology.orchestra.run.smithi044.stderr: 12050K .......... .......... .......... .......... .......... 7% 6.86M 27s 2024-03-30T13:13:43.418 INFO:teuthology.orchestra.run.smithi044.stderr: 12100K .......... .......... .......... .......... .......... 7% 12.0M 27s 2024-03-30T13:13:43.420 INFO:teuthology.orchestra.run.smithi044.stderr: 12150K .......... .......... .......... .......... .......... 7% 14.4M 27s 2024-03-30T13:13:43.438 INFO:teuthology.orchestra.run.smithi044.stderr: 12200K .......... .......... .......... .......... .......... 7% 2.70M 27s 2024-03-30T13:13:43.441 INFO:teuthology.orchestra.run.smithi044.stderr: 12250K .......... .......... .......... .......... .......... 7% 16.8M 27s 2024-03-30T13:13:43.449 INFO:teuthology.orchestra.run.smithi044.stderr: 12300K .......... .......... .......... .......... .......... 7% 6.45M 27s 2024-03-30T13:13:43.453 INFO:teuthology.orchestra.run.smithi044.stderr: 12350K .......... .......... .......... .......... .......... 7% 12.1M 27s 2024-03-30T13:13:43.457 INFO:teuthology.orchestra.run.smithi044.stderr: 12400K .......... .......... .......... .......... .......... 7% 12.1M 27s 2024-03-30T13:13:43.477 INFO:teuthology.orchestra.run.smithi044.stderr: 12450K .......... .......... .......... .......... .......... 7% 2.60M 27s 2024-03-30T13:13:43.483 INFO:teuthology.orchestra.run.smithi044.stderr: 12500K .......... .......... .......... .......... .......... 7% 22.8M 27s 2024-03-30T13:13:43.485 INFO:teuthology.orchestra.run.smithi044.stderr: 12550K .......... .......... .......... .......... .......... 7% 7.22M 27s 2024-03-30T13:13:43.489 INFO:teuthology.orchestra.run.smithi044.stderr: 12600K .......... .......... .......... .......... .......... 7% 11.8M 27s 2024-03-30T13:13:43.508 INFO:teuthology.orchestra.run.smithi044.stderr: 12650K .......... .......... .......... .......... .......... 7% 2.62M 27s 2024-03-30T13:13:43.513 INFO:teuthology.orchestra.run.smithi044.stderr: 12700K .......... .......... .......... .......... .......... 7% 11.8M 27s 2024-03-30T13:13:43.520 INFO:teuthology.orchestra.run.smithi044.stderr: 12750K .......... .......... .......... .......... .......... 7% 6.56M 27s 2024-03-30T13:13:43.525 INFO:teuthology.orchestra.run.smithi044.stderr: 12800K .......... .......... .......... .......... .......... 7% 12.5M 27s 2024-03-30T13:13:43.525 INFO:teuthology.orchestra.run.smithi044.stderr: 12850K .......... .......... .......... .......... .......... 7% 35.9M 27s 2024-03-30T13:13:43.543 INFO:teuthology.orchestra.run.smithi044.stderr: 12900K .......... .......... .......... .......... .......... 7% 2.59M 27s 2024-03-30T13:13:43.547 INFO:teuthology.orchestra.run.smithi044.stderr: 12950K .......... .......... .......... .......... .......... 7% 11.8M 27s 2024-03-30T13:13:43.555 INFO:teuthology.orchestra.run.smithi044.stderr: 13000K .......... .......... .......... .......... .......... 7% 6.54M 27s 2024-03-30T13:13:43.560 INFO:teuthology.orchestra.run.smithi044.stderr: 13050K .......... .......... .......... .......... .......... 7% 12.5M 27s 2024-03-30T13:13:43.560 INFO:teuthology.orchestra.run.smithi044.stderr: 13100K .......... .......... .......... .......... .......... 7% 39.8M 27s 2024-03-30T13:13:43.580 INFO:teuthology.orchestra.run.smithi044.stderr: 13150K .......... .......... .......... .......... .......... 7% 2.57M 27s 2024-03-30T13:13:43.584 INFO:teuthology.orchestra.run.smithi044.stderr: 13200K .......... .......... .......... .......... .......... 7% 11.1M 27s 2024-03-30T13:13:43.591 INFO:teuthology.orchestra.run.smithi044.stderr: 13250K .......... .......... .......... .......... .......... 7% 6.84M 27s 2024-03-30T13:13:43.595 INFO:teuthology.orchestra.run.smithi044.stderr: 13300K .......... .......... .......... .......... .......... 7% 12.7M 26s 2024-03-30T13:13:43.598 INFO:teuthology.orchestra.run.smithi044.stderr: 13350K .......... .......... .......... .......... .......... 7% 12.7M 26s 2024-03-30T13:13:43.615 INFO:teuthology.orchestra.run.smithi044.stderr: 13400K .......... .......... .......... .......... .......... 7% 2.96M 27s 2024-03-30T13:13:43.619 INFO:teuthology.orchestra.run.smithi044.stderr: 13450K .......... .......... .......... .......... .......... 8% 11.9M 26s 2024-03-30T13:13:43.627 INFO:teuthology.orchestra.run.smithi044.stderr: 13500K .......... .......... .......... .......... .......... 8% 6.56M 26s 2024-03-30T13:13:43.631 INFO:teuthology.orchestra.run.smithi044.stderr: 13550K .......... .......... .......... .......... .......... 8% 13.4M 26s 2024-03-30T13:13:43.634 INFO:teuthology.orchestra.run.smithi044.stderr: 13600K .......... .......... .......... .......... .......... 8% 12.5M 26s 2024-03-30T13:13:43.651 INFO:teuthology.orchestra.run.smithi044.stderr: 13650K .......... .......... .......... .......... .......... 8% 2.80M 26s 2024-03-30T13:13:43.654 INFO:teuthology.orchestra.run.smithi044.stderr: 13700K .......... .......... .......... .......... .......... 8% 14.8M 26s 2024-03-30T13:13:43.662 INFO:teuthology.orchestra.run.smithi044.stderr: 13750K .......... .......... .......... .......... .......... 8% 6.43M 26s 2024-03-30T13:13:43.666 INFO:teuthology.orchestra.run.smithi044.stderr: 13800K .......... .......... .......... .......... .......... 8% 13.5M 26s 2024-03-30T13:13:43.670 INFO:teuthology.orchestra.run.smithi044.stderr: 13850K .......... .......... .......... .......... .......... 8% 11.5M 26s 2024-03-30T13:13:43.689 INFO:teuthology.orchestra.run.smithi044.stderr: 13900K .......... .......... .......... .......... .......... 8% 2.89M 26s 2024-03-30T13:13:43.691 INFO:teuthology.orchestra.run.smithi044.stderr: 13950K .......... .......... .......... .......... .......... 8% 12.3M 26s 2024-03-30T13:13:43.698 INFO:teuthology.orchestra.run.smithi044.stderr: 14000K .......... .......... .......... .......... .......... 8% 7.20M 26s 2024-03-30T13:13:43.702 INFO:teuthology.orchestra.run.smithi044.stderr: 14050K .......... .......... .......... .......... .......... 8% 13.2M 26s 2024-03-30T13:13:43.721 INFO:teuthology.orchestra.run.smithi044.stderr: 14100K .......... .......... .......... .......... .......... 8% 2.53M 26s 2024-03-30T13:13:43.724 INFO:teuthology.orchestra.run.smithi044.stderr: 14150K .......... .......... .......... .......... .......... 8% 12.8M 26s 2024-03-30T13:13:43.734 INFO:teuthology.orchestra.run.smithi044.stderr: 14200K .......... .......... .......... .......... .......... 8% 6.09M 26s 2024-03-30T13:13:43.734 INFO:teuthology.orchestra.run.smithi044.stderr: 14250K .......... .......... .......... .......... .......... 8% 53.0M 26s 2024-03-30T13:13:43.738 INFO:teuthology.orchestra.run.smithi044.stderr: 14300K .......... .......... .......... .......... .......... 8% 12.9M 26s 2024-03-30T13:13:43.757 INFO:teuthology.orchestra.run.smithi044.stderr: 14350K .......... .......... .......... .......... .......... 8% 2.51M 26s 2024-03-30T13:13:43.760 INFO:teuthology.orchestra.run.smithi044.stderr: 14400K .......... .......... .......... .......... .......... 8% 14.9M 26s 2024-03-30T13:13:43.769 INFO:teuthology.orchestra.run.smithi044.stderr: 14450K .......... .......... .......... .......... .......... 8% 5.90M 26s 2024-03-30T13:13:43.773 INFO:teuthology.orchestra.run.smithi044.stderr: 14500K .......... .......... .......... .......... .......... 8% 13.6M 26s 2024-03-30T13:13:43.773 INFO:teuthology.orchestra.run.smithi044.stderr: 14550K .......... .......... .......... .......... .......... 8% 39.4M 26s 2024-03-30T13:13:43.793 INFO:teuthology.orchestra.run.smithi044.stderr: 14600K .......... .......... .......... .......... .......... 8% 2.56M 26s 2024-03-30T13:13:43.795 INFO:teuthology.orchestra.run.smithi044.stderr: 14650K .......... .......... .......... .......... .......... 8% 14.9M 26s 2024-03-30T13:13:43.805 INFO:teuthology.orchestra.run.smithi044.stderr: 14700K .......... .......... .......... .......... .......... 8% 5.56M 26s 2024-03-30T13:13:43.808 INFO:teuthology.orchestra.run.smithi044.stderr: 14750K .......... .......... .......... .......... .......... 8% 15.3M 26s 2024-03-30T13:13:43.808 INFO:teuthology.orchestra.run.smithi044.stderr: 14800K .......... .......... .......... .......... .......... 8% 46.2M 26s 2024-03-30T13:13:43.829 INFO:teuthology.orchestra.run.smithi044.stderr: 14850K .......... .......... .......... .......... .......... 8% 2.53M 26s 2024-03-30T13:13:43.832 INFO:teuthology.orchestra.run.smithi044.stderr: 14900K .......... .......... .......... .......... .......... 8% 15.5M 26s 2024-03-30T13:13:43.841 INFO:teuthology.orchestra.run.smithi044.stderr: 14950K .......... .......... .......... .......... .......... 8% 5.39M 26s 2024-03-30T13:13:43.843 INFO:teuthology.orchestra.run.smithi044.stderr: 15000K .......... .......... .......... .......... .......... 8% 16.5M 26s 2024-03-30T13:13:43.844 INFO:teuthology.orchestra.run.smithi044.stderr: 15050K .......... .......... .......... .......... .......... 8% 40.5M 26s 2024-03-30T13:13:43.865 INFO:teuthology.orchestra.run.smithi044.stderr: 15100K .......... .......... .......... .......... .......... 8% 2.55M 26s 2024-03-30T13:13:43.866 INFO:teuthology.orchestra.run.smithi044.stderr: 15150K .......... .......... .......... .......... .......... 9% 15.7M 26s 2024-03-30T13:13:43.876 INFO:teuthology.orchestra.run.smithi044.stderr: 15200K .......... .......... .......... .......... .......... 9% 5.20M 26s 2024-03-30T13:13:43.878 INFO:teuthology.orchestra.run.smithi044.stderr: 15250K .......... .......... .......... .......... .......... 9% 18.3M 26s 2024-03-30T13:13:43.880 INFO:teuthology.orchestra.run.smithi044.stderr: 15300K .......... .......... .......... .......... .......... 9% 38.4M 26s 2024-03-30T13:13:43.900 INFO:teuthology.orchestra.run.smithi044.stderr: 15350K .......... .......... .......... .......... .......... 9% 2.56M 26s 2024-03-30T13:13:43.902 INFO:teuthology.orchestra.run.smithi044.stderr: 15400K .......... .......... .......... .......... .......... 9% 16.3M 26s 2024-03-30T13:13:43.912 INFO:teuthology.orchestra.run.smithi044.stderr: 15450K .......... .......... .......... .......... .......... 9% 5.13M 26s 2024-03-30T13:13:43.914 INFO:teuthology.orchestra.run.smithi044.stderr: 15500K .......... .......... .......... .......... .......... 9% 18.4M 26s 2024-03-30T13:13:43.915 INFO:teuthology.orchestra.run.smithi044.stderr: 15550K .......... .......... .......... .......... .......... 9% 37.7M 25s 2024-03-30T13:13:43.935 INFO:teuthology.orchestra.run.smithi044.stderr: 15600K .......... .......... .......... .......... .......... 9% 2.53M 26s 2024-03-30T13:13:43.937 INFO:teuthology.orchestra.run.smithi044.stderr: 15650K .......... .......... .......... .......... .......... 9% 18.2M 26s 2024-03-30T13:13:43.947 INFO:teuthology.orchestra.run.smithi044.stderr: 15700K .......... .......... .......... .......... .......... 9% 5.24M 26s 2024-03-30T13:13:43.951 INFO:teuthology.orchestra.run.smithi044.stderr: 15750K .......... .......... .......... .......... .......... 9% 16.3M 25s 2024-03-30T13:13:43.951 INFO:teuthology.orchestra.run.smithi044.stderr: 15800K .......... .......... .......... .......... .......... 9% 39.4M 25s 2024-03-30T13:13:43.971 INFO:teuthology.orchestra.run.smithi044.stderr: 15850K .......... .......... .......... .......... .......... 9% 2.53M 25s 2024-03-30T13:13:43.972 INFO:teuthology.orchestra.run.smithi044.stderr: 15900K .......... .......... .......... .......... .......... 9% 18.8M 25s 2024-03-30T13:13:43.983 INFO:teuthology.orchestra.run.smithi044.stderr: 15950K .......... .......... .......... .......... .......... 9% 5.19M 25s 2024-03-30T13:13:43.985 INFO:teuthology.orchestra.run.smithi044.stderr: 16000K .......... .......... .......... .......... .......... 9% 16.1M 25s 2024-03-30T13:13:43.986 INFO:teuthology.orchestra.run.smithi044.stderr: 16050K .......... .......... .......... .......... .......... 9% 41.3M 25s 2024-03-30T13:13:44.007 INFO:teuthology.orchestra.run.smithi044.stderr: 16100K .......... .......... .......... .......... .......... 9% 2.51M 25s 2024-03-30T13:13:44.008 INFO:teuthology.orchestra.run.smithi044.stderr: 16150K .......... .......... .......... .......... .......... 9% 21.1M 25s 2024-03-30T13:13:44.018 INFO:teuthology.orchestra.run.smithi044.stderr: 16200K .......... .......... .......... .......... .......... 9% 5.04M 25s 2024-03-30T13:13:44.021 INFO:teuthology.orchestra.run.smithi044.stderr: 16250K .......... .......... .......... .......... .......... 9% 17.0M 25s 2024-03-30T13:13:44.022 INFO:teuthology.orchestra.run.smithi044.stderr: 16300K .......... .......... .......... .......... .......... 9% 43.6M 25s 2024-03-30T13:13:44.042 INFO:teuthology.orchestra.run.smithi044.stderr: 16350K .......... .......... .......... .......... .......... 9% 2.52M 25s 2024-03-30T13:13:44.043 INFO:teuthology.orchestra.run.smithi044.stderr: 16400K .......... .......... .......... .......... .......... 9% 19.7M 25s 2024-03-30T13:13:44.054 INFO:teuthology.orchestra.run.smithi044.stderr: 16450K .......... .......... .......... .......... .......... 9% 5.04M 25s 2024-03-30T13:13:44.057 INFO:teuthology.orchestra.run.smithi044.stderr: 16500K .......... .......... .......... .......... .......... 9% 17.1M 25s 2024-03-30T13:13:44.057 INFO:teuthology.orchestra.run.smithi044.stderr: 16550K .......... .......... .......... .......... .......... 9% 35.9M 25s 2024-03-30T13:13:44.077 INFO:teuthology.orchestra.run.smithi044.stderr: 16600K .......... .......... .......... .......... .......... 9% 2.52M 25s 2024-03-30T13:13:44.079 INFO:teuthology.orchestra.run.smithi044.stderr: 16650K .......... .......... .......... .......... .......... 9% 23.3M 25s 2024-03-30T13:13:44.089 INFO:teuthology.orchestra.run.smithi044.stderr: 16700K .......... .......... .......... .......... .......... 9% 5.05M 25s 2024-03-30T13:13:44.092 INFO:teuthology.orchestra.run.smithi044.stderr: 16750K .......... .......... .......... .......... .......... 9% 16.8M 25s 2024-03-30T13:13:44.096 INFO:teuthology.orchestra.run.smithi044.stderr: 16800K .......... .......... .......... .......... .......... 9% 28.8M 25s 2024-03-30T13:13:44.113 INFO:teuthology.orchestra.run.smithi044.stderr: 16850K .......... .......... .......... .......... .......... 10% 2.50M 25s 2024-03-30T13:13:44.114 INFO:teuthology.orchestra.run.smithi044.stderr: 16900K .......... .......... .......... .......... .......... 10% 32.0M 25s 2024-03-30T13:13:44.127 INFO:teuthology.orchestra.run.smithi044.stderr: 16950K .......... .......... .......... .......... .......... 10% 5.41M 25s 2024-03-30T13:13:44.128 INFO:teuthology.orchestra.run.smithi044.stderr: 17000K .......... .......... .......... .......... .......... 10% 12.1M 25s 2024-03-30T13:13:44.131 INFO:teuthology.orchestra.run.smithi044.stderr: 17050K .......... .......... .......... .......... .......... 10% 40.1M 25s 2024-03-30T13:13:44.149 INFO:teuthology.orchestra.run.smithi044.stderr: 17100K .......... .......... .......... .......... .......... 10% 2.49M 25s 2024-03-30T13:13:44.150 INFO:teuthology.orchestra.run.smithi044.stderr: 17150K .......... .......... .......... .......... .......... 10% 34.6M 25s 2024-03-30T13:13:44.159 INFO:teuthology.orchestra.run.smithi044.stderr: 17200K .......... .......... .......... .......... .......... 10% 5.32M 25s 2024-03-30T13:13:44.163 INFO:teuthology.orchestra.run.smithi044.stderr: 17250K .......... .......... .......... .......... .......... 10% 11.2M 25s 2024-03-30T13:13:44.167 INFO:teuthology.orchestra.run.smithi044.stderr: 17300K .......... .......... .......... .......... .......... 10% 13.2M 25s 2024-03-30T13:13:44.184 INFO:teuthology.orchestra.run.smithi044.stderr: 17350K .......... .......... .......... .......... .......... 10% 2.88M 25s 2024-03-30T13:13:44.185 INFO:teuthology.orchestra.run.smithi044.stderr: 17400K .......... .......... .......... .......... .......... 10% 31.2M 25s 2024-03-30T13:13:44.194 INFO:teuthology.orchestra.run.smithi044.stderr: 17450K .......... .......... .......... .......... .......... 10% 5.34M 25s 2024-03-30T13:13:44.199 INFO:teuthology.orchestra.run.smithi044.stderr: 17500K .......... .......... .......... .......... .......... 10% 11.6M 25s 2024-03-30T13:13:44.203 INFO:teuthology.orchestra.run.smithi044.stderr: 17550K .......... .......... .......... .......... .......... 10% 13.0M 25s 2024-03-30T13:13:44.220 INFO:teuthology.orchestra.run.smithi044.stderr: 17600K .......... .......... .......... .......... .......... 10% 2.92M 25s 2024-03-30T13:13:44.220 INFO:teuthology.orchestra.run.smithi044.stderr: 17650K .......... .......... .......... .......... .......... 10% 30.2M 25s 2024-03-30T13:13:44.230 INFO:teuthology.orchestra.run.smithi044.stderr: 17700K .......... .......... .......... .......... .......... 10% 5.32M 25s 2024-03-30T13:13:44.235 INFO:teuthology.orchestra.run.smithi044.stderr: 17750K .......... .......... .......... .......... .......... 10% 11.7M 25s 2024-03-30T13:13:44.238 INFO:teuthology.orchestra.run.smithi044.stderr: 17800K .......... .......... .......... .......... .......... 10% 12.6M 25s 2024-03-30T13:13:44.257 INFO:teuthology.orchestra.run.smithi044.stderr: 17850K .......... .......... .......... .......... .......... 10% 2.91M 25s 2024-03-30T13:13:44.257 INFO:teuthology.orchestra.run.smithi044.stderr: 17900K .......... .......... .......... .......... .......... 10% 38.0M 25s 2024-03-30T13:13:44.265 INFO:teuthology.orchestra.run.smithi044.stderr: 17950K .......... .......... .......... .......... .......... 10% 5.27M 25s 2024-03-30T13:13:44.270 INFO:teuthology.orchestra.run.smithi044.stderr: 18000K .......... .......... .......... .......... .......... 10% 11.0M 25s 2024-03-30T13:13:44.270 INFO:teuthology.orchestra.run.smithi044.stderr: 18050K .......... .......... .......... .......... .......... 10% 61.2M 25s 2024-03-30T13:13:44.291 INFO:teuthology.orchestra.run.smithi044.stderr: 18100K .......... .......... .......... .......... .......... 10% 2.50M 25s 2024-03-30T13:13:44.291 INFO:teuthology.orchestra.run.smithi044.stderr: 18150K .......... .......... .......... .......... .......... 10% 54.9M 25s 2024-03-30T13:13:44.294 INFO:teuthology.orchestra.run.smithi044.stderr: 18200K .......... .......... .......... .......... .......... 10% 17.0M 25s 2024-03-30T13:13:44.306 INFO:teuthology.orchestra.run.smithi044.stderr: 18250K .......... .......... .......... .......... .......... 10% 4.35M 25s 2024-03-30T13:13:44.306 INFO:teuthology.orchestra.run.smithi044.stderr: 18300K .......... .......... .......... .......... .......... 10% 58.1M 24s 2024-03-30T13:13:44.327 INFO:teuthology.orchestra.run.smithi044.stderr: 18350K .......... .......... .......... .......... .......... 10% 2.50M 25s 2024-03-30T13:13:44.327 INFO:teuthology.orchestra.run.smithi044.stderr: 18400K .......... .......... .......... .......... .......... 10% 55.3M 24s 2024-03-30T13:13:44.329 INFO:teuthology.orchestra.run.smithi044.stderr: 18450K .......... .......... .......... .......... .......... 10% 17.2M 24s 2024-03-30T13:13:44.341 INFO:teuthology.orchestra.run.smithi044.stderr: 18500K .......... .......... .......... .......... .......... 11% 4.32M 24s 2024-03-30T13:13:44.341 INFO:teuthology.orchestra.run.smithi044.stderr: 18550K .......... .......... .......... .......... .......... 11% 69.1M 24s 2024-03-30T13:13:44.362 INFO:teuthology.orchestra.run.smithi044.stderr: 18600K .......... .......... .......... .......... .......... 11% 13.1M 24s 2024-03-30T13:13:44.362 INFO:teuthology.orchestra.run.smithi044.stderr: 18650K .......... .......... .......... .......... .......... 11% 2.88M 24s 2024-03-30T13:13:44.364 INFO:teuthology.orchestra.run.smithi044.stderr: 18700K .......... .......... .......... .......... .......... 11% 19.3M 24s 2024-03-30T13:13:44.376 INFO:teuthology.orchestra.run.smithi044.stderr: 18750K .......... .......... .......... .......... .......... 11% 4.26M 24s 2024-03-30T13:13:44.377 INFO:teuthology.orchestra.run.smithi044.stderr: 18800K .......... .......... .......... .......... .......... 11% 57.4M 24s 2024-03-30T13:13:44.380 INFO:teuthology.orchestra.run.smithi044.stderr: 18850K .......... .......... .......... .......... .......... 11% 13.4M 24s 2024-03-30T13:13:44.398 INFO:teuthology.orchestra.run.smithi044.stderr: 18900K .......... .......... .......... .......... .......... 11% 2.89M 24s 2024-03-30T13:13:44.399 INFO:teuthology.orchestra.run.smithi044.stderr: 18950K .......... .......... .......... .......... .......... 11% 21.7M 24s 2024-03-30T13:13:44.413 INFO:teuthology.orchestra.run.smithi044.stderr: 19000K .......... .......... .......... .......... .......... 11% 4.08M 24s 2024-03-30T13:13:44.413 INFO:teuthology.orchestra.run.smithi044.stderr: 19050K .......... .......... .......... .......... .......... 11% 65.6M 24s 2024-03-30T13:13:44.416 INFO:teuthology.orchestra.run.smithi044.stderr: 19100K .......... .......... .......... .......... .......... 11% 14.0M 24s 2024-03-30T13:13:44.434 INFO:teuthology.orchestra.run.smithi044.stderr: 19150K .......... .......... .......... .......... .......... 11% 2.84M 24s 2024-03-30T13:13:44.435 INFO:teuthology.orchestra.run.smithi044.stderr: 19200K .......... .......... .......... .......... .......... 11% 70.9M 24s 2024-03-30T13:13:44.447 INFO:teuthology.orchestra.run.smithi044.stderr: 19250K .......... .......... .......... .......... .......... 11% 3.73M 24s 2024-03-30T13:13:44.448 INFO:teuthology.orchestra.run.smithi044.stderr: 19300K .......... .......... .......... .......... .......... 11% 56.5M 24s 2024-03-30T13:13:44.451 INFO:teuthology.orchestra.run.smithi044.stderr: 19350K .......... .......... .......... .......... .......... 11% 14.2M 24s 2024-03-30T13:13:44.469 INFO:teuthology.orchestra.run.smithi044.stderr: 19400K .......... .......... .......... .......... .......... 11% 2.82M 24s 2024-03-30T13:13:44.469 INFO:teuthology.orchestra.run.smithi044.stderr: 19450K .......... .......... .......... .......... .......... 11% 68.0M 24s 2024-03-30T13:13:44.479 INFO:teuthology.orchestra.run.smithi044.stderr: 19500K .......... .......... .......... .......... .......... 11% 4.88M 24s 2024-03-30T13:13:44.484 INFO:teuthology.orchestra.run.smithi044.stderr: 19550K .......... .......... .......... .......... .......... 11% 12.5M 24s 2024-03-30T13:13:44.487 INFO:teuthology.orchestra.run.smithi044.stderr: 19600K .......... .......... .......... .......... .......... 11% 14.8M 24s 2024-03-30T13:13:44.505 INFO:teuthology.orchestra.run.smithi044.stderr: 19650K .......... .......... .......... .......... .......... 11% 2.76M 24s 2024-03-30T13:13:44.505 INFO:teuthology.orchestra.run.smithi044.stderr: 19700K .......... .......... .......... .......... .......... 11% 65.1M 24s 2024-03-30T13:13:44.514 INFO:teuthology.orchestra.run.smithi044.stderr: 19750K .......... .......... .......... .......... .......... 11% 5.00M 24s 2024-03-30T13:13:44.519 INFO:teuthology.orchestra.run.smithi044.stderr: 19800K .......... .......... .......... .......... .......... 11% 12.5M 24s 2024-03-30T13:13:44.519 INFO:teuthology.orchestra.run.smithi044.stderr: 19850K .......... .......... .......... .......... .......... 11% 68.5M 24s 2024-03-30T13:13:44.540 INFO:teuthology.orchestra.run.smithi044.stderr: 19900K .......... .......... .......... .......... .......... 11% 2.40M 24s 2024-03-30T13:13:44.540 INFO:teuthology.orchestra.run.smithi044.stderr: 19950K .......... .......... .......... .......... .......... 11% 58.2M 24s 2024-03-30T13:13:44.542 INFO:teuthology.orchestra.run.smithi044.stderr: 20000K .......... .......... .......... .......... .......... 11% 24.8M 24s 2024-03-30T13:13:44.554 INFO:teuthology.orchestra.run.smithi044.stderr: 20050K .......... .......... .......... .......... .......... 11% 4.26M 24s 2024-03-30T13:13:44.554 INFO:teuthology.orchestra.run.smithi044.stderr: 20100K .......... .......... .......... .......... .......... 11% 54.9M 24s 2024-03-30T13:13:44.576 INFO:teuthology.orchestra.run.smithi044.stderr: 20150K .......... .......... .......... .......... .......... 11% 2.40M 24s 2024-03-30T13:13:44.576 INFO:teuthology.orchestra.run.smithi044.stderr: 20200K .......... .......... .......... .......... .......... 12% 52.3M 24s 2024-03-30T13:13:44.577 INFO:teuthology.orchestra.run.smithi044.stderr: 20250K .......... .......... .......... .......... .......... 12% 31.5M 24s 2024-03-30T13:13:44.590 INFO:teuthology.orchestra.run.smithi044.stderr: 20300K .......... .......... .......... .......... .......... 12% 4.17M 24s 2024-03-30T13:13:44.590 INFO:teuthology.orchestra.run.smithi044.stderr: 20350K .......... .......... .......... .......... .......... 12% 56.3M 24s 2024-03-30T13:13:44.593 INFO:teuthology.orchestra.run.smithi044.stderr: 20400K .......... .......... .......... .......... .......... 12% 14.9M 24s 2024-03-30T13:13:44.611 INFO:teuthology.orchestra.run.smithi044.stderr: 20450K .......... .......... .......... .......... .......... 12% 2.71M 24s 2024-03-30T13:13:44.613 INFO:teuthology.orchestra.run.smithi044.stderr: 20500K .......... .......... .......... .......... .......... 12% 32.5M 24s 2024-03-30T13:13:44.626 INFO:teuthology.orchestra.run.smithi044.stderr: 20550K .......... .......... .......... .......... .......... 12% 4.06M 24s 2024-03-30T13:13:44.626 INFO:teuthology.orchestra.run.smithi044.stderr: 20600K .......... .......... .......... .......... .......... 12% 67.9M 24s 2024-03-30T13:13:44.628 INFO:teuthology.orchestra.run.smithi044.stderr: 20650K .......... .......... .......... .......... .......... 12% 15.4M 24s 2024-03-30T13:13:44.647 INFO:teuthology.orchestra.run.smithi044.stderr: 20700K .......... .......... .......... .......... .......... 12% 2.70M 24s 2024-03-30T13:13:44.648 INFO:teuthology.orchestra.run.smithi044.stderr: 20750K .......... .......... .......... .......... .......... 12% 38.4M 24s 2024-03-30T13:13:44.661 INFO:teuthology.orchestra.run.smithi044.stderr: 20800K .......... .......... .......... .......... .......... 12% 4.03M 24s 2024-03-30T13:13:44.661 INFO:teuthology.orchestra.run.smithi044.stderr: 20850K .......... .......... .......... .......... .......... 12% 61.1M 24s 2024-03-30T13:13:44.664 INFO:teuthology.orchestra.run.smithi044.stderr: 20900K .......... .......... .......... .......... .......... 12% 15.7M 24s 2024-03-30T13:13:44.683 INFO:teuthology.orchestra.run.smithi044.stderr: 20950K .......... .......... .......... .......... .......... 12% 2.70M 24s 2024-03-30T13:13:44.683 INFO:teuthology.orchestra.run.smithi044.stderr: 21000K .......... .......... .......... .......... .......... 12% 67.1M 24s 2024-03-30T13:13:44.692 INFO:teuthology.orchestra.run.smithi044.stderr: 21050K .......... .......... .......... .......... .......... 12% 4.94M 24s 2024-03-30T13:13:44.697 INFO:teuthology.orchestra.run.smithi044.stderr: 21100K .......... .......... .......... .......... .......... 12% 13.8M 24s 2024-03-30T13:13:44.699 INFO:teuthology.orchestra.run.smithi044.stderr: 21150K .......... .......... .......... .......... .......... 12% 15.9M 24s 2024-03-30T13:13:44.718 INFO:teuthology.orchestra.run.smithi044.stderr: 21200K .......... .......... .......... .......... .......... 12% 2.70M 24s 2024-03-30T13:13:44.718 INFO:teuthology.orchestra.run.smithi044.stderr: 21250K .......... .......... .......... .......... .......... 12% 64.0M 24s 2024-03-30T13:13:44.728 INFO:teuthology.orchestra.run.smithi044.stderr: 21300K .......... .......... .......... .......... .......... 12% 4.86M 24s 2024-03-30T13:13:44.732 INFO:teuthology.orchestra.run.smithi044.stderr: 21350K .......... .......... .......... .......... .......... 12% 13.8M 23s 2024-03-30T13:13:44.732 INFO:teuthology.orchestra.run.smithi044.stderr: 21400K .......... .......... .......... .......... .......... 12% 74.7M 23s 2024-03-30T13:13:44.754 INFO:teuthology.orchestra.run.smithi044.stderr: 21450K .......... .......... .......... .......... .......... 12% 2.42M 24s 2024-03-30T13:13:44.754 INFO:teuthology.orchestra.run.smithi044.stderr: 21500K .......... .......... .......... .......... .......... 12% 51.5M 23s 2024-03-30T13:13:44.755 INFO:teuthology.orchestra.run.smithi044.stderr: 21550K .......... .......... .......... .......... .......... 12% 35.8M 23s 2024-03-30T13:13:44.768 INFO:teuthology.orchestra.run.smithi044.stderr: 21600K .......... .......... .......... .......... .......... 12% 4.04M 23s 2024-03-30T13:13:44.768 INFO:teuthology.orchestra.run.smithi044.stderr: 21650K .......... .......... .......... .......... .......... 12% 64.2M 23s 2024-03-30T13:13:44.771 INFO:teuthology.orchestra.run.smithi044.stderr: 21700K .......... .......... .......... .......... .......... 12% 15.5M 23s 2024-03-30T13:13:44.790 INFO:teuthology.orchestra.run.smithi044.stderr: 21750K .......... .......... .......... .......... .......... 12% 2.70M 23s 2024-03-30T13:13:44.790 INFO:teuthology.orchestra.run.smithi044.stderr: 21800K .......... .......... .......... .......... .......... 12% 39.9M 23s 2024-03-30T13:13:44.803 INFO:teuthology.orchestra.run.smithi044.stderr: 21850K .......... .......... .......... .......... .......... 12% 4.06M 23s 2024-03-30T13:13:44.803 INFO:teuthology.orchestra.run.smithi044.stderr: 21900K .......... .......... .......... .......... .......... 13% 53.6M 23s 2024-03-30T13:13:44.807 INFO:teuthology.orchestra.run.smithi044.stderr: 21950K .......... .......... .......... .......... .......... 13% 15.4M 23s 2024-03-30T13:13:44.825 INFO:teuthology.orchestra.run.smithi044.stderr: 22000K .......... .......... .......... .......... .......... 13% 2.69M 23s 2024-03-30T13:13:44.826 INFO:teuthology.orchestra.run.smithi044.stderr: 22050K .......... .......... .......... .......... .......... 13% 46.8M 23s 2024-03-30T13:13:44.839 INFO:teuthology.orchestra.run.smithi044.stderr: 22100K .......... .......... .......... .......... .......... 13% 4.02M 23s 2024-03-30T13:13:44.839 INFO:teuthology.orchestra.run.smithi044.stderr: 22150K .......... .......... .......... .......... .......... 13% 68.8M 23s 2024-03-30T13:13:44.842 INFO:teuthology.orchestra.run.smithi044.stderr: 22200K .......... .......... .......... .......... .......... 13% 13.9M 23s 2024-03-30T13:13:44.861 INFO:teuthology.orchestra.run.smithi044.stderr: 22250K .......... .......... .......... .......... .......... 13% 2.68M 23s 2024-03-30T13:13:44.861 INFO:teuthology.orchestra.run.smithi044.stderr: 22300K .......... .......... .......... .......... .......... 13% 70.1M 23s 2024-03-30T13:13:44.874 INFO:teuthology.orchestra.run.smithi044.stderr: 22350K .......... .......... .......... .......... .......... 13% 4.92M 23s 2024-03-30T13:13:44.874 INFO:teuthology.orchestra.run.smithi044.stderr: 22400K .......... .......... .......... .......... .......... 13% 15.5M 23s 2024-03-30T13:13:44.877 INFO:teuthology.orchestra.run.smithi044.stderr: 22450K .......... .......... .......... .......... .......... 13% 14.8M 23s 2024-03-30T13:13:44.896 INFO:teuthology.orchestra.run.smithi044.stderr: 22500K .......... .......... .......... .......... .......... 13% 2.66M 23s 2024-03-30T13:13:44.896 INFO:teuthology.orchestra.run.smithi044.stderr: 22550K .......... .......... .......... .......... .......... 13% 75.4M 23s 2024-03-30T13:13:44.906 INFO:teuthology.orchestra.run.smithi044.stderr: 22600K .......... .......... .......... .......... .......... 13% 4.85M 23s 2024-03-30T13:13:44.910 INFO:teuthology.orchestra.run.smithi044.stderr: 22650K .......... .......... .......... .......... .......... 13% 17.2M 23s 2024-03-30T13:13:44.910 INFO:teuthology.orchestra.run.smithi044.stderr: 22700K .......... .......... .......... .......... .......... 13% 66.7M 23s 2024-03-30T13:13:44.932 INFO:teuthology.orchestra.run.smithi044.stderr: 22750K .......... .......... .......... .......... .......... 13% 2.33M 23s 2024-03-30T13:13:44.932 INFO:teuthology.orchestra.run.smithi044.stderr: 22800K .......... .......... .......... .......... .......... 13% 61.2M 23s 2024-03-30T13:13:44.933 INFO:teuthology.orchestra.run.smithi044.stderr: 22850K .......... .......... .......... .......... .......... 13% 33.4M 23s 2024-03-30T13:13:44.946 INFO:teuthology.orchestra.run.smithi044.stderr: 22900K .......... .......... .......... .......... .......... 13% 4.36M 23s 2024-03-30T13:13:44.946 INFO:teuthology.orchestra.run.smithi044.stderr: 22950K .......... .......... .......... .......... .......... 13% 54.4M 23s 2024-03-30T13:13:44.948 INFO:teuthology.orchestra.run.smithi044.stderr: 23000K .......... .......... .......... .......... .......... 13% 13.8M 23s 2024-03-30T13:13:44.967 INFO:teuthology.orchestra.run.smithi044.stderr: 23050K .......... .......... .......... .......... .......... 13% 2.68M 23s 2024-03-30T13:13:44.971 INFO:teuthology.orchestra.run.smithi044.stderr: 23100K .......... .......... .......... .......... .......... 13% 61.1M 23s 2024-03-30T13:13:44.980 INFO:teuthology.orchestra.run.smithi044.stderr: 23150K .......... .......... .......... .......... .......... 13% 4.12M 23s 2024-03-30T13:13:44.981 INFO:teuthology.orchestra.run.smithi044.stderr: 23200K .......... .......... .......... .......... .......... 13% 57.3M 23s 2024-03-30T13:13:44.984 INFO:teuthology.orchestra.run.smithi044.stderr: 23250K .......... .......... .......... .......... .......... 13% 13.9M 23s 2024-03-30T13:13:45.003 INFO:teuthology.orchestra.run.smithi044.stderr: 23300K .......... .......... .......... .......... .......... 13% 2.65M 23s 2024-03-30T13:13:45.004 INFO:teuthology.orchestra.run.smithi044.stderr: 23350K .......... .......... .......... .......... .......... 13% 62.2M 23s 2024-03-30T13:13:45.013 INFO:teuthology.orchestra.run.smithi044.stderr: 23400K .......... .......... .......... .......... .......... 13% 5.03M 23s 2024-03-30T13:13:45.016 INFO:teuthology.orchestra.run.smithi044.stderr: 23450K .......... .......... .......... .......... .......... 13% 16.0M 23s 2024-03-30T13:13:45.017 INFO:teuthology.orchestra.run.smithi044.stderr: 23500K .......... .......... .......... .......... .......... 13% 37.2M 23s 2024-03-30T13:13:45.038 INFO:teuthology.orchestra.run.smithi044.stderr: 23550K .......... .......... .......... .......... .......... 14% 2.36M 23s 2024-03-30T13:13:45.040 INFO:teuthology.orchestra.run.smithi044.stderr: 23600K .......... .......... .......... .......... .......... 14% 38.4M 23s 2024-03-30T13:13:45.040 INFO:teuthology.orchestra.run.smithi044.stderr: 23650K .......... .......... .......... .......... .......... 14% 74.6M 23s 2024-03-30T13:13:45.052 INFO:teuthology.orchestra.run.smithi044.stderr: 23700K .......... .......... .......... .......... .......... 14% 4.26M 23s 2024-03-30T13:13:45.052 INFO:teuthology.orchestra.run.smithi044.stderr: 23750K .......... .......... .......... .......... .......... 14% 64.8M 23s 2024-03-30T13:13:45.055 INFO:teuthology.orchestra.run.smithi044.stderr: 23800K .......... .......... .......... .......... .......... 14% 15.7M 23s 2024-03-30T13:13:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: 23850K .......... .......... .......... .......... .......... 14% 2.60M 23s 2024-03-30T13:13:45.075 INFO:teuthology.orchestra.run.smithi044.stderr: 23900K .......... .......... .......... .......... .......... 14% 77.4M 23s 2024-03-30T13:13:45.088 INFO:teuthology.orchestra.run.smithi044.stderr: 23950K .......... .......... .......... .......... .......... 14% 3.91M 23s 2024-03-30T13:13:45.088 INFO:teuthology.orchestra.run.smithi044.stderr: 24000K .......... .......... .......... .......... .......... 14% 59.7M 23s 2024-03-30T13:13:45.090 INFO:teuthology.orchestra.run.smithi044.stderr: 24050K .......... .......... .......... .......... .......... 14% 19.3M 23s 2024-03-30T13:13:45.111 INFO:teuthology.orchestra.run.smithi044.stderr: 24100K .......... .......... .......... .......... .......... 14% 2.58M 23s 2024-03-30T13:13:45.111 INFO:teuthology.orchestra.run.smithi044.stderr: 24150K .......... .......... .......... .......... .......... 14% 62.0M 23s 2024-03-30T13:13:45.123 INFO:teuthology.orchestra.run.smithi044.stderr: 24200K .......... .......... .......... .......... .......... 14% 3.81M 23s 2024-03-30T13:13:45.126 INFO:teuthology.orchestra.run.smithi044.stderr: 24250K .......... .......... .......... .......... .......... 14% 37.9M 23s 2024-03-30T13:13:45.129 INFO:teuthology.orchestra.run.smithi044.stderr: 24300K .......... .......... .......... .......... .......... 14% 10.3M 23s 2024-03-30T13:13:45.145 INFO:teuthology.orchestra.run.smithi044.stderr: 24350K .......... .......... .......... .......... .......... 14% 3.06M 23s 2024-03-30T13:13:45.147 INFO:teuthology.orchestra.run.smithi044.stderr: 24400K .......... .......... .......... .......... .......... 14% 26.2M 23s 2024-03-30T13:13:45.155 INFO:teuthology.orchestra.run.smithi044.stderr: 24450K .......... .......... .......... .......... .......... 14% 5.85M 23s 2024-03-30T13:13:45.163 INFO:teuthology.orchestra.run.smithi044.stderr: 24500K .......... .......... .......... .......... .......... 14% 5.97M 23s 2024-03-30T13:13:45.166 INFO:teuthology.orchestra.run.smithi044.stderr: 24550K .......... .......... .......... .......... .......... 14% 19.5M 23s 2024-03-30T13:13:45.167 INFO:teuthology.orchestra.run.smithi044.stderr: 24600K .......... .......... .......... .......... .......... 14% 38.6M 22s 2024-03-30T13:13:45.182 INFO:teuthology.orchestra.run.smithi044.stderr: 24650K .......... .......... .......... .......... .......... 14% 3.39M 23s 2024-03-30T13:13:45.182 INFO:teuthology.orchestra.run.smithi044.stderr: 24700K .......... .......... .......... .......... .......... 14% 68.5M 22s 2024-03-30T13:13:45.194 INFO:teuthology.orchestra.run.smithi044.stderr: 24750K .......... .......... .......... .......... .......... 14% 4.03M 22s 2024-03-30T13:13:45.201 INFO:teuthology.orchestra.run.smithi044.stderr: 24800K .......... .......... .......... .......... .......... 14% 7.39M 22s 2024-03-30T13:13:45.202 INFO:teuthology.orchestra.run.smithi044.stderr: 24850K .......... .......... .......... .......... .......... 14% 35.0M 22s 2024-03-30T13:13:45.217 INFO:teuthology.orchestra.run.smithi044.stderr: 24900K .......... .......... .......... .......... .......... 14% 3.41M 22s 2024-03-30T13:13:45.218 INFO:teuthology.orchestra.run.smithi044.stderr: 24950K .......... .......... .......... .......... .......... 14% 61.4M 22s 2024-03-30T13:13:45.230 INFO:teuthology.orchestra.run.smithi044.stderr: 25000K .......... .......... .......... .......... .......... 14% 4.00M 22s 2024-03-30T13:13:45.236 INFO:teuthology.orchestra.run.smithi044.stderr: 25050K .......... .......... .......... .......... .......... 14% 7.61M 22s 2024-03-30T13:13:45.238 INFO:teuthology.orchestra.run.smithi044.stderr: 25100K .......... .......... .......... .......... .......... 14% 35.8M 22s 2024-03-30T13:13:45.252 INFO:teuthology.orchestra.run.smithi044.stderr: 25150K .......... .......... .......... .......... .......... 14% 3.41M 22s 2024-03-30T13:13:45.253 INFO:teuthology.orchestra.run.smithi044.stderr: 25200K .......... .......... .......... .......... .......... 14% 47.0M 22s 2024-03-30T13:13:45.261 INFO:teuthology.orchestra.run.smithi044.stderr: 25250K .......... .......... .......... .......... .......... 15% 5.42M 22s 2024-03-30T13:13:45.270 INFO:teuthology.orchestra.run.smithi044.stderr: 25300K .......... .......... .......... .......... .......... 15% 5.88M 22s 2024-03-30T13:13:45.272 INFO:teuthology.orchestra.run.smithi044.stderr: 25350K .......... .......... .......... .......... .......... 15% 22.7M 22s 2024-03-30T13:13:45.273 INFO:teuthology.orchestra.run.smithi044.stderr: 25400K .......... .......... .......... .......... .......... 15% 32.9M 22s 2024-03-30T13:13:45.288 INFO:teuthology.orchestra.run.smithi044.stderr: 25450K .......... .......... .......... .......... .......... 15% 3.42M 22s 2024-03-30T13:13:45.288 INFO:teuthology.orchestra.run.smithi044.stderr: 25500K .......... .......... .......... .......... .......... 15% 65.6M 22s 2024-03-30T13:13:45.301 INFO:teuthology.orchestra.run.smithi044.stderr: 25550K .......... .......... .......... .......... .......... 15% 3.98M 22s 2024-03-30T13:13:45.308 INFO:teuthology.orchestra.run.smithi044.stderr: 25600K .......... .......... .......... .......... .......... 15% 7.34M 22s 2024-03-30T13:13:45.309 INFO:teuthology.orchestra.run.smithi044.stderr: 25650K .......... .......... .......... .......... .......... 15% 40.0M 22s 2024-03-30T13:13:45.324 INFO:teuthology.orchestra.run.smithi044.stderr: 25700K .......... .......... .......... .......... .......... 15% 3.45M 22s 2024-03-30T13:13:45.324 INFO:teuthology.orchestra.run.smithi044.stderr: 25750K .......... .......... .......... .......... .......... 15% 54.6M 22s 2024-03-30T13:13:45.336 INFO:teuthology.orchestra.run.smithi044.stderr: 25800K .......... .......... .......... .......... .......... 15% 3.98M 22s 2024-03-30T13:13:45.342 INFO:teuthology.orchestra.run.smithi044.stderr: 25850K .......... .......... .......... .......... .......... 15% 9.57M 22s 2024-03-30T13:13:45.344 INFO:teuthology.orchestra.run.smithi044.stderr: 25900K .......... .......... .......... .......... .......... 15% 18.5M 22s 2024-03-30T13:13:45.359 INFO:teuthology.orchestra.run.smithi044.stderr: 25950K .......... .......... .......... .......... .......... 15% 3.43M 22s 2024-03-30T13:13:45.359 INFO:teuthology.orchestra.run.smithi044.stderr: 26000K .......... .......... .......... .......... .......... 15% 47.0M 22s 2024-03-30T13:13:45.368 INFO:teuthology.orchestra.run.smithi044.stderr: 26050K .......... .......... .......... .......... .......... 15% 5.25M 22s 2024-03-30T13:13:45.374 INFO:teuthology.orchestra.run.smithi044.stderr: 26100K .......... .......... .......... .......... .......... 15% 13.1M 22s 2024-03-30T13:13:45.380 INFO:teuthology.orchestra.run.smithi044.stderr: 26150K .......... .......... .......... .......... .......... 15% 7.24M 22s 2024-03-30T13:13:45.380 INFO:teuthology.orchestra.run.smithi044.stderr: 26200K .......... .......... .......... .......... .......... 15% 44.1M 22s 2024-03-30T13:13:45.395 INFO:teuthology.orchestra.run.smithi044.stderr: 26250K .......... .......... .......... .......... .......... 15% 3.40M 22s 2024-03-30T13:13:45.395 INFO:teuthology.orchestra.run.smithi044.stderr: 26300K .......... .......... .......... .......... .......... 15% 65.8M 22s 2024-03-30T13:13:45.407 INFO:teuthology.orchestra.run.smithi044.stderr: 26350K .......... .......... .......... .......... .......... 15% 4.01M 22s 2024-03-30T13:13:45.415 INFO:teuthology.orchestra.run.smithi044.stderr: 26400K .......... .......... .......... .......... .......... 15% 7.28M 22s 2024-03-30T13:13:45.415 INFO:teuthology.orchestra.run.smithi044.stderr: 26450K .......... .......... .......... .......... .......... 15% 49.0M 22s 2024-03-30T13:13:45.430 INFO:teuthology.orchestra.run.smithi044.stderr: 26500K .......... .......... .......... .......... .......... 15% 3.38M 22s 2024-03-30T13:13:45.430 INFO:teuthology.orchestra.run.smithi044.stderr: 26550K .......... .......... .......... .......... .......... 15% 57.3M 22s 2024-03-30T13:13:45.439 INFO:teuthology.orchestra.run.smithi044.stderr: 26600K .......... .......... .......... .......... .......... 15% 5.24M 22s 2024-03-30T13:13:45.443 INFO:teuthology.orchestra.run.smithi044.stderr: 26650K .......... .......... .......... .......... .......... 15% 13.7M 22s 2024-03-30T13:13:45.450 INFO:teuthology.orchestra.run.smithi044.stderr: 26700K .......... .......... .......... .......... .......... 15% 7.21M 22s 2024-03-30T13:13:45.451 INFO:teuthology.orchestra.run.smithi044.stderr: 26750K .......... .......... .......... .......... .......... 15% 35.2M 22s 2024-03-30T13:13:45.466 INFO:teuthology.orchestra.run.smithi044.stderr: 26800K .......... .......... .......... .......... .......... 15% 3.28M 22s 2024-03-30T13:13:45.467 INFO:teuthology.orchestra.run.smithi044.stderr: 26850K .......... .......... .......... .......... .......... 15% 42.0M 22s 2024-03-30T13:13:45.479 INFO:teuthology.orchestra.run.smithi044.stderr: 26900K .......... .......... .......... .......... .......... 15% 4.29M 22s 2024-03-30T13:13:45.485 INFO:teuthology.orchestra.run.smithi044.stderr: 26950K .......... .......... .......... .......... .......... 16% 7.62M 22s 2024-03-30T13:13:45.487 INFO:teuthology.orchestra.run.smithi044.stderr: 27000K .......... .......... .......... .......... .......... 16% 35.6M 22s 2024-03-30T13:13:45.501 INFO:teuthology.orchestra.run.smithi044.stderr: 27050K .......... .......... .......... .......... .......... 16% 3.41M 22s 2024-03-30T13:13:45.503 INFO:teuthology.orchestra.run.smithi044.stderr: 27100K .......... .......... .......... .......... .......... 16% 33.0M 22s 2024-03-30T13:13:45.514 INFO:teuthology.orchestra.run.smithi044.stderr: 27150K .......... .......... .......... .......... .......... 16% 4.35M 22s 2024-03-30T13:13:45.519 INFO:teuthology.orchestra.run.smithi044.stderr: 27200K .......... .......... .......... .......... .......... 16% 9.73M 22s 2024-03-30T13:13:45.521 INFO:teuthology.orchestra.run.smithi044.stderr: 27250K .......... .......... .......... .......... .......... 16% 16.6M 22s 2024-03-30T13:13:45.537 INFO:teuthology.orchestra.run.smithi044.stderr: 27300K .......... .......... .......... .......... .......... 16% 34.2M 22s 2024-03-30T13:13:45.538 INFO:teuthology.orchestra.run.smithi044.stderr: 27350K .......... .......... .......... .......... .......... 16% 3.39M 22s 2024-03-30T13:13:45.546 INFO:teuthology.orchestra.run.smithi044.stderr: 27400K .......... .......... .......... .......... .......... 16% 41.4M 22s 2024-03-30T13:13:45.550 INFO:teuthology.orchestra.run.smithi044.stderr: 27450K .......... .......... .......... .......... .......... 16% 4.23M 22s 2024-03-30T13:13:45.557 INFO:teuthology.orchestra.run.smithi044.stderr: 27500K .......... .......... .......... .......... .......... 16% 7.83M 22s 2024-03-30T13:13:45.558 INFO:teuthology.orchestra.run.smithi044.stderr: 27550K .......... .......... .......... .......... .......... 16% 30.9M 22s 2024-03-30T13:13:45.572 INFO:teuthology.orchestra.run.smithi044.stderr: 27600K .......... .......... .......... .......... .......... 16% 3.42M 22s 2024-03-30T13:13:45.574 INFO:teuthology.orchestra.run.smithi044.stderr: 27650K .......... .......... .......... .......... .......... 16% 35.8M 22s 2024-03-30T13:13:45.585 INFO:teuthology.orchestra.run.smithi044.stderr: 27700K .......... .......... .......... .......... .......... 16% 4.24M 22s 2024-03-30T13:13:45.590 INFO:teuthology.orchestra.run.smithi044.stderr: 27750K .......... .......... .......... .......... .......... 16% 10.3M 22s 2024-03-30T13:13:45.593 INFO:teuthology.orchestra.run.smithi044.stderr: 27800K .......... .......... .......... .......... .......... 16% 16.3M 22s 2024-03-30T13:13:45.607 INFO:teuthology.orchestra.run.smithi044.stderr: 27850K .......... .......... .......... .......... .......... 16% 3.38M 22s 2024-03-30T13:13:45.609 INFO:teuthology.orchestra.run.smithi044.stderr: 27900K .......... .......... .......... .......... .......... 16% 34.5M 22s 2024-03-30T13:13:45.617 INFO:teuthology.orchestra.run.smithi044.stderr: 27950K .......... .......... .......... .......... .......... 16% 5.69M 22s 2024-03-30T13:13:45.621 INFO:teuthology.orchestra.run.smithi044.stderr: 28000K .......... .......... .......... .......... .......... 16% 12.5M 22s 2024-03-30T13:13:45.628 INFO:teuthology.orchestra.run.smithi044.stderr: 28050K .......... .......... .......... .......... .......... 16% 7.46M 22s 2024-03-30T13:13:45.629 INFO:teuthology.orchestra.run.smithi044.stderr: 28100K .......... .......... .......... .......... .......... 16% 44.4M 22s 2024-03-30T13:13:45.644 INFO:teuthology.orchestra.run.smithi044.stderr: 28150K .......... .......... .......... .......... .......... 16% 3.35M 22s 2024-03-30T13:13:45.644 INFO:teuthology.orchestra.run.smithi044.stderr: 28200K .......... .......... .......... .......... .......... 16% 59.1M 21s 2024-03-30T13:13:45.656 INFO:teuthology.orchestra.run.smithi044.stderr: 28250K .......... .......... .......... .......... .......... 16% 4.10M 22s 2024-03-30T13:13:45.661 INFO:teuthology.orchestra.run.smithi044.stderr: 28300K .......... .......... .......... .......... .......... 16% 10.2M 21s 2024-03-30T13:13:45.664 INFO:teuthology.orchestra.run.smithi044.stderr: 28350K .......... .......... .......... .......... .......... 16% 17.6M 21s 2024-03-30T13:13:45.680 INFO:teuthology.orchestra.run.smithi044.stderr: 28400K .......... .......... .......... .......... .......... 16% 3.27M 21s 2024-03-30T13:13:45.680 INFO:teuthology.orchestra.run.smithi044.stderr: 28450K .......... .......... .......... .......... .......... 16% 68.5M 21s 2024-03-30T13:13:45.688 INFO:teuthology.orchestra.run.smithi044.stderr: 28500K .......... .......... .......... .......... .......... 16% 5.31M 21s 2024-03-30T13:13:45.692 INFO:teuthology.orchestra.run.smithi044.stderr: 28550K .......... .......... .......... .......... .......... 16% 13.6M 21s 2024-03-30T13:13:45.700 INFO:teuthology.orchestra.run.smithi044.stderr: 28600K .......... .......... .......... .......... .......... 16% 7.22M 21s 2024-03-30T13:13:45.700 INFO:teuthology.orchestra.run.smithi044.stderr: 28650K .......... .......... .......... .......... .......... 17% 46.7M 21s 2024-03-30T13:13:45.715 INFO:teuthology.orchestra.run.smithi044.stderr: 28700K .......... .......... .......... .......... .......... 17% 3.39M 21s 2024-03-30T13:13:45.715 INFO:teuthology.orchestra.run.smithi044.stderr: 28750K .......... .......... .......... .......... .......... 17% 59.7M 21s 2024-03-30T13:13:45.727 INFO:teuthology.orchestra.run.smithi044.stderr: 28800K .......... .......... .......... .......... .......... 17% 4.04M 21s 2024-03-30T13:13:45.732 INFO:teuthology.orchestra.run.smithi044.stderr: 28850K .......... .......... .......... .......... .......... 17% 10.4M 21s 2024-03-30T13:13:45.735 INFO:teuthology.orchestra.run.smithi044.stderr: 28900K .......... .......... .......... .......... .......... 17% 17.3M 21s 2024-03-30T13:13:45.750 INFO:teuthology.orchestra.run.smithi044.stderr: 28950K .......... .......... .......... .......... .......... 17% 3.34M 21s 2024-03-30T13:13:45.751 INFO:teuthology.orchestra.run.smithi044.stderr: 29000K .......... .......... .......... .......... .......... 17% 52.1M 21s 2024-03-30T13:13:45.760 INFO:teuthology.orchestra.run.smithi044.stderr: 29050K .......... .......... .......... .......... .......... 17% 5.15M 21s 2024-03-30T13:13:45.763 INFO:teuthology.orchestra.run.smithi044.stderr: 29100K .......... .......... .......... .......... .......... 17% 14.6M 21s 2024-03-30T13:13:45.771 INFO:teuthology.orchestra.run.smithi044.stderr: 29150K .......... .......... .......... .......... .......... 17% 7.30M 21s 2024-03-30T13:13:45.771 INFO:teuthology.orchestra.run.smithi044.stderr: 29200K .......... .......... .......... .......... .......... 17% 47.6M 21s 2024-03-30T13:13:45.786 INFO:teuthology.orchestra.run.smithi044.stderr: 29250K .......... .......... .......... .......... .......... 17% 3.36M 21s 2024-03-30T13:13:45.786 INFO:teuthology.orchestra.run.smithi044.stderr: 29300K .......... .......... .......... .......... .......... 17% 57.6M 21s 2024-03-30T13:13:45.798 INFO:teuthology.orchestra.run.smithi044.stderr: 29350K .......... .......... .......... .......... .......... 17% 4.04M 21s 2024-03-30T13:13:45.803 INFO:teuthology.orchestra.run.smithi044.stderr: 29400K .......... .......... .......... .......... .......... 17% 10.1M 21s 2024-03-30T13:13:45.806 INFO:teuthology.orchestra.run.smithi044.stderr: 29450K .......... .......... .......... .......... .......... 17% 16.4M 21s 2024-03-30T13:13:45.821 INFO:teuthology.orchestra.run.smithi044.stderr: 29500K .......... .......... .......... .......... .......... 17% 3.43M 21s 2024-03-30T13:13:45.822 INFO:teuthology.orchestra.run.smithi044.stderr: 29550K .......... .......... .......... .......... .......... 17% 57.0M 21s 2024-03-30T13:13:45.831 INFO:teuthology.orchestra.run.smithi044.stderr: 29600K .......... .......... .......... .......... .......... 17% 5.06M 21s 2024-03-30T13:13:45.834 INFO:teuthology.orchestra.run.smithi044.stderr: 29650K .......... .......... .......... .......... .......... 17% 15.5M 21s 2024-03-30T13:13:45.841 INFO:teuthology.orchestra.run.smithi044.stderr: 29700K .......... .......... .......... .......... .......... 17% 7.11M 21s 2024-03-30T13:13:45.842 INFO:teuthology.orchestra.run.smithi044.stderr: 29750K .......... .......... .......... .......... .......... 17% 46.4M 21s 2024-03-30T13:13:45.857 INFO:teuthology.orchestra.run.smithi044.stderr: 29800K .......... .......... .......... .......... .......... 17% 3.41M 21s 2024-03-30T13:13:45.857 INFO:teuthology.orchestra.run.smithi044.stderr: 29850K .......... .......... .......... .......... .......... 17% 62.5M 21s 2024-03-30T13:13:45.866 INFO:teuthology.orchestra.run.smithi044.stderr: 29900K .......... .......... .......... .......... .......... 17% 5.07M 21s 2024-03-30T13:13:45.870 INFO:teuthology.orchestra.run.smithi044.stderr: 29950K .......... .......... .......... .......... .......... 17% 14.8M 21s 2024-03-30T13:13:45.877 INFO:teuthology.orchestra.run.smithi044.stderr: 30000K .......... .......... .......... .......... .......... 17% 7.21M 21s 2024-03-30T13:13:45.878 INFO:teuthology.orchestra.run.smithi044.stderr: 30050K .......... .......... .......... .......... .......... 17% 40.0M 21s 2024-03-30T13:13:45.893 INFO:teuthology.orchestra.run.smithi044.stderr: 30100K .......... .......... .......... .......... .......... 17% 3.43M 21s 2024-03-30T13:13:45.893 INFO:teuthology.orchestra.run.smithi044.stderr: 30150K .......... .......... .......... .......... .......... 17% 73.5M 21s 2024-03-30T13:13:45.905 INFO:teuthology.orchestra.run.smithi044.stderr: 30200K .......... .......... .......... .......... .......... 17% 4.00M 21s 2024-03-30T13:13:45.909 INFO:teuthology.orchestra.run.smithi044.stderr: 30250K .......... .......... .......... .......... .......... 17% 10.3M 21s 2024-03-30T13:13:45.912 INFO:teuthology.orchestra.run.smithi044.stderr: 30300K .......... .......... .......... .......... .......... 18% 18.2M 21s 2024-03-30T13:13:45.928 INFO:teuthology.orchestra.run.smithi044.stderr: 30350K .......... .......... .......... .......... .......... 18% 3.31M 21s 2024-03-30T13:13:45.928 INFO:teuthology.orchestra.run.smithi044.stderr: 30400K .......... .......... .......... .......... .......... 18% 63.9M 21s 2024-03-30T13:13:45.937 INFO:teuthology.orchestra.run.smithi044.stderr: 30450K .......... .......... .......... .......... .......... 18% 5.11M 21s 2024-03-30T13:13:45.941 INFO:teuthology.orchestra.run.smithi044.stderr: 30500K .......... .......... .......... .......... .......... 18% 14.7M 21s 2024-03-30T13:13:45.948 INFO:teuthology.orchestra.run.smithi044.stderr: 30550K .......... .......... .......... .......... .......... 18% 6.91M 21s 2024-03-30T13:13:45.950 INFO:teuthology.orchestra.run.smithi044.stderr: 30600K .......... .......... .......... .......... .......... 18% 27.5M 21s 2024-03-30T13:13:45.963 INFO:teuthology.orchestra.run.smithi044.stderr: 30650K .......... .......... .......... .......... .......... 18% 3.64M 21s 2024-03-30T13:13:45.964 INFO:teuthology.orchestra.run.smithi044.stderr: 30700K .......... .......... .......... .......... .......... 18% 48.4M 21s 2024-03-30T13:13:45.976 INFO:teuthology.orchestra.run.smithi044.stderr: 30750K .......... .......... .......... .......... .......... 18% 4.21M 21s 2024-03-30T13:13:45.981 INFO:teuthology.orchestra.run.smithi044.stderr: 30800K .......... .......... .......... .......... .......... 18% 9.94M 21s 2024-03-30T13:13:45.984 INFO:teuthology.orchestra.run.smithi044.stderr: 30850K .......... .......... .......... .......... .......... 18% 17.5M 21s 2024-03-30T13:13:45.999 INFO:teuthology.orchestra.run.smithi044.stderr: 30900K .......... .......... .......... .......... .......... 18% 34.3M 21s 2024-03-30T13:13:45.999 INFO:teuthology.orchestra.run.smithi044.stderr: 30950K .......... .......... .......... .......... .......... 18% 3.46M 21s 2024-03-30T13:13:46.009 INFO:teuthology.orchestra.run.smithi044.stderr: 31000K .......... .......... .......... .......... .......... 18% 5.10M 21s 2024-03-30T13:13:46.011 INFO:teuthology.orchestra.run.smithi044.stderr: 31050K .......... .......... .......... .......... .......... 18% 15.3M 21s 2024-03-30T13:13:46.019 INFO:teuthology.orchestra.run.smithi044.stderr: 31100K .......... .......... .......... .......... .......... 18% 7.26M 21s 2024-03-30T13:13:46.019 INFO:teuthology.orchestra.run.smithi044.stderr: 31150K .......... .......... .......... .......... .......... 18% 58.6M 21s 2024-03-30T13:13:46.035 INFO:teuthology.orchestra.run.smithi044.stderr: 31200K .......... .......... .......... .......... .......... 18% 3.32M 21s 2024-03-30T13:13:46.035 INFO:teuthology.orchestra.run.smithi044.stderr: 31250K .......... .......... .......... .......... .......... 18% 69.6M 21s 2024-03-30T13:13:46.044 INFO:teuthology.orchestra.run.smithi044.stderr: 31300K .......... .......... .......... .......... .......... 18% 5.00M 21s 2024-03-30T13:13:46.047 INFO:teuthology.orchestra.run.smithi044.stderr: 31350K .......... .......... .......... .......... .......... 18% 16.3M 21s 2024-03-30T13:13:46.055 INFO:teuthology.orchestra.run.smithi044.stderr: 31400K .......... .......... .......... .......... .......... 18% 6.78M 21s 2024-03-30T13:13:46.055 INFO:teuthology.orchestra.run.smithi044.stderr: 31450K .......... .......... .......... .......... .......... 18% 46.9M 21s 2024-03-30T13:13:46.070 INFO:teuthology.orchestra.run.smithi044.stderr: 31500K .......... .......... .......... .......... .......... 18% 3.48M 21s 2024-03-30T13:13:46.070 INFO:teuthology.orchestra.run.smithi044.stderr: 31550K .......... .......... .......... .......... .......... 18% 67.5M 21s 2024-03-30T13:13:46.082 INFO:teuthology.orchestra.run.smithi044.stderr: 31600K .......... .......... .......... .......... .......... 18% 4.08M 21s 2024-03-30T13:13:46.087 INFO:teuthology.orchestra.run.smithi044.stderr: 31650K .......... .......... .......... .......... .......... 18% 9.72M 21s 2024-03-30T13:13:46.090 INFO:teuthology.orchestra.run.smithi044.stderr: 31700K .......... .......... .......... .......... .......... 18% 16.9M 21s 2024-03-30T13:13:46.106 INFO:teuthology.orchestra.run.smithi044.stderr: 31750K .......... .......... .......... .......... .......... 18% 3.40M 21s 2024-03-30T13:13:46.106 INFO:teuthology.orchestra.run.smithi044.stderr: 31800K .......... .......... .......... .......... .......... 18% 62.9M 21s 2024-03-30T13:13:46.115 INFO:teuthology.orchestra.run.smithi044.stderr: 31850K .......... .......... .......... .......... .......... 18% 4.88M 21s 2024-03-30T13:13:46.118 INFO:teuthology.orchestra.run.smithi044.stderr: 31900K .......... .......... .......... .......... .......... 18% 16.5M 21s 2024-03-30T13:13:46.128 INFO:teuthology.orchestra.run.smithi044.stderr: 31950K .......... .......... .......... .......... .......... 18% 5.41M 21s 2024-03-30T13:13:46.128 INFO:teuthology.orchestra.run.smithi044.stderr: 32000K .......... .......... .......... .......... .......... 19% 73.7M 20s 2024-03-30T13:13:46.142 INFO:teuthology.orchestra.run.smithi044.stderr: 32050K .......... .......... .......... .......... .......... 19% 3.78M 21s 2024-03-30T13:13:46.142 INFO:teuthology.orchestra.run.smithi044.stderr: 32100K .......... .......... .......... .......... .......... 19% 76.3M 20s 2024-03-30T13:13:46.151 INFO:teuthology.orchestra.run.smithi044.stderr: 32150K .......... .......... .......... .......... .......... 19% 5.17M 20s 2024-03-30T13:13:46.154 INFO:teuthology.orchestra.run.smithi044.stderr: 32200K .......... .......... .......... .......... .......... 19% 15.1M 20s 2024-03-30T13:13:46.165 INFO:teuthology.orchestra.run.smithi044.stderr: 32250K .......... .......... .......... .......... .......... 19% 5.36M 20s 2024-03-30T13:13:46.165 INFO:teuthology.orchestra.run.smithi044.stderr: 32300K .......... .......... .......... .......... .......... 19% 60.6M 20s 2024-03-30T13:13:46.177 INFO:teuthology.orchestra.run.smithi044.stderr: 32350K .......... .......... .......... .......... .......... 19% 3.89M 20s 2024-03-30T13:13:46.178 INFO:teuthology.orchestra.run.smithi044.stderr: 32400K .......... .......... .......... .......... .......... 19% 76.7M 20s 2024-03-30T13:13:46.193 INFO:teuthology.orchestra.run.smithi044.stderr: 32450K .......... .......... .......... .......... .......... 19% 4.24M 20s 2024-03-30T13:13:46.194 INFO:teuthology.orchestra.run.smithi044.stderr: 32500K .......... .......... .......... .......... .......... 19% 47.9M 20s 2024-03-30T13:13:46.200 INFO:teuthology.orchestra.run.smithi044.stderr: 32550K .......... .......... .......... .......... .......... 19% 5.24M 20s 2024-03-30T13:13:46.200 INFO:teuthology.orchestra.run.smithi044.stderr: 32600K .......... .......... .......... .......... .......... 19% 78.2M 20s 2024-03-30T13:13:46.213 INFO:teuthology.orchestra.run.smithi044.stderr: 32650K .......... .......... .......... .......... .......... 19% 3.82M 20s 2024-03-30T13:13:46.222 INFO:teuthology.orchestra.run.smithi044.stderr: 32700K .......... .......... .......... .......... .......... 19% 5.32M 20s 2024-03-30T13:13:46.225 INFO:teuthology.orchestra.run.smithi044.stderr: 32750K .......... .......... .......... .......... .......... 19% 15.7M 20s 2024-03-30T13:13:46.234 INFO:teuthology.orchestra.run.smithi044.stderr: 32800K .......... .......... .......... .......... .......... 19% 11.4M 20s 2024-03-30T13:13:46.235 INFO:teuthology.orchestra.run.smithi044.stderr: 32850K .......... .......... .......... .......... .......... 19% 8.55M 20s 2024-03-30T13:13:46.247 INFO:teuthology.orchestra.run.smithi044.stderr: 32900K .......... .......... .......... .......... .......... 19% 4.10M 20s 2024-03-30T13:13:46.249 INFO:teuthology.orchestra.run.smithi044.stderr: 32950K .......... .......... .......... .......... .......... 19% 33.8M 20s 2024-03-30T13:13:46.257 INFO:teuthology.orchestra.run.smithi044.stderr: 33000K .......... .......... .......... .......... .......... 19% 5.24M 20s 2024-03-30T13:13:46.261 INFO:teuthology.orchestra.run.smithi044.stderr: 33050K .......... .......... .......... .......... .......... 19% 15.3M 20s 2024-03-30T13:13:46.271 INFO:teuthology.orchestra.run.smithi044.stderr: 33100K .......... .......... .......... .......... .......... 19% 5.58M 20s 2024-03-30T13:13:46.271 INFO:teuthology.orchestra.run.smithi044.stderr: 33150K .......... .......... .......... .......... .......... 19% 45.2M 20s 2024-03-30T13:13:46.284 INFO:teuthology.orchestra.run.smithi044.stderr: 33200K .......... .......... .......... .......... .......... 19% 3.77M 20s 2024-03-30T13:13:46.285 INFO:teuthology.orchestra.run.smithi044.stderr: 33250K .......... .......... .......... .......... .......... 19% 58.5M 20s 2024-03-30T13:13:46.293 INFO:teuthology.orchestra.run.smithi044.stderr: 33300K .......... .......... .......... .......... .......... 19% 5.49M 20s 2024-03-30T13:13:46.296 INFO:teuthology.orchestra.run.smithi044.stderr: 33350K .......... .......... .......... .......... .......... 19% 15.2M 20s 2024-03-30T13:13:46.307 INFO:teuthology.orchestra.run.smithi044.stderr: 33400K .......... .......... .......... .......... .......... 19% 5.36M 20s 2024-03-30T13:13:46.307 INFO:teuthology.orchestra.run.smithi044.stderr: 33450K .......... .......... .......... .......... .......... 19% 53.2M 20s 2024-03-30T13:13:46.320 INFO:teuthology.orchestra.run.smithi044.stderr: 33500K .......... .......... .......... .......... .......... 19% 3.87M 20s 2024-03-30T13:13:46.329 INFO:teuthology.orchestra.run.smithi044.stderr: 33550K .......... .......... .......... .......... .......... 19% 47.5M 20s 2024-03-30T13:13:46.332 INFO:teuthology.orchestra.run.smithi044.stderr: 33600K .......... .......... .......... .......... .......... 19% 4.41M 20s 2024-03-30T13:13:46.335 INFO:teuthology.orchestra.run.smithi044.stderr: 33650K .......... .......... .......... .......... .......... 19% 44.7M 20s 2024-03-30T13:13:46.341 INFO:teuthology.orchestra.run.smithi044.stderr: 33700K .......... .......... .......... .......... .......... 20% 5.59M 20s 2024-03-30T13:13:46.353 INFO:teuthology.orchestra.run.smithi044.stderr: 33750K .......... .......... .......... .......... .......... 20% 4.00M 20s 2024-03-30T13:13:46.355 INFO:teuthology.orchestra.run.smithi044.stderr: 33800K .......... .......... .......... .......... .......... 20% 29.4M 20s 2024-03-30T13:13:46.364 INFO:teuthology.orchestra.run.smithi044.stderr: 33850K .......... .......... .......... .......... .......... 20% 5.36M 20s 2024-03-30T13:13:46.367 INFO:teuthology.orchestra.run.smithi044.stderr: 33900K .......... .......... .......... .......... .......... 20% 17.2M 20s 2024-03-30T13:13:46.371 INFO:teuthology.orchestra.run.smithi044.stderr: 33950K .......... .......... .......... .......... .......... 20% 11.8M 20s 2024-03-30T13:13:46.377 INFO:teuthology.orchestra.run.smithi044.stderr: 34000K .......... .......... .......... .......... .......... 20% 7.85M 20s 2024-03-30T13:13:46.391 INFO:teuthology.orchestra.run.smithi044.stderr: 34050K .......... .......... .......... .......... .......... 20% 3.90M 20s 2024-03-30T13:13:46.391 INFO:teuthology.orchestra.run.smithi044.stderr: 34100K .......... .......... .......... .......... .......... 20% 50.1M 20s 2024-03-30T13:13:46.400 INFO:teuthology.orchestra.run.smithi044.stderr: 34150K .......... .......... .......... .......... .......... 20% 5.45M 20s 2024-03-30T13:13:46.403 INFO:teuthology.orchestra.run.smithi044.stderr: 34200K .......... .......... .......... .......... .......... 20% 16.4M 20s 2024-03-30T13:13:46.413 INFO:teuthology.orchestra.run.smithi044.stderr: 34250K .......... .......... .......... .......... .......... 20% 5.37M 20s 2024-03-30T13:13:46.413 INFO:teuthology.orchestra.run.smithi044.stderr: 34300K .......... .......... .......... .......... .......... 20% 45.1M 20s 2024-03-30T13:13:46.427 INFO:teuthology.orchestra.run.smithi044.stderr: 34350K .......... .......... .......... .......... .......... 20% 3.81M 20s 2024-03-30T13:13:46.427 INFO:teuthology.orchestra.run.smithi044.stderr: 34400K .......... .......... .......... .......... .......... 20% 69.5M 20s 2024-03-30T13:13:46.435 INFO:teuthology.orchestra.run.smithi044.stderr: 34450K .......... .......... .......... .......... .......... 20% 5.43M 20s 2024-03-30T13:13:46.438 INFO:teuthology.orchestra.run.smithi044.stderr: 34500K .......... .......... .......... .......... .......... 20% 16.1M 20s 2024-03-30T13:13:46.449 INFO:teuthology.orchestra.run.smithi044.stderr: 34550K .......... .......... .......... .......... .......... 20% 5.30M 20s 2024-03-30T13:13:46.449 INFO:teuthology.orchestra.run.smithi044.stderr: 34600K .......... .......... .......... .......... .......... 20% 46.1M 20s 2024-03-30T13:13:46.462 INFO:teuthology.orchestra.run.smithi044.stderr: 34650K .......... .......... .......... .......... .......... 20% 3.86M 20s 2024-03-30T13:13:46.462 INFO:teuthology.orchestra.run.smithi044.stderr: 34700K .......... .......... .......... .......... .......... 20% 70.3M 20s 2024-03-30T13:13:46.471 INFO:teuthology.orchestra.run.smithi044.stderr: 34750K .......... .......... .......... .......... .......... 20% 5.41M 20s 2024-03-30T13:13:46.474 INFO:teuthology.orchestra.run.smithi044.stderr: 34800K .......... .......... .......... .......... .......... 20% 16.8M 20s 2024-03-30T13:13:46.484 INFO:teuthology.orchestra.run.smithi044.stderr: 34850K .......... .......... .......... .......... .......... 20% 5.22M 20s 2024-03-30T13:13:46.484 INFO:teuthology.orchestra.run.smithi044.stderr: 34900K .......... .......... .......... .......... .......... 20% 57.7M 20s 2024-03-30T13:13:46.498 INFO:teuthology.orchestra.run.smithi044.stderr: 34950K .......... .......... .......... .......... .......... 20% 3.85M 20s 2024-03-30T13:13:46.498 INFO:teuthology.orchestra.run.smithi044.stderr: 35000K .......... .......... .......... .......... .......... 20% 59.1M 20s 2024-03-30T13:13:46.509 INFO:teuthology.orchestra.run.smithi044.stderr: 35050K .......... .......... .......... .......... .......... 20% 4.44M 20s 2024-03-30T13:13:46.510 INFO:teuthology.orchestra.run.smithi044.stderr: 35100K .......... .......... .......... .......... .......... 20% 52.4M 20s 2024-03-30T13:13:46.520 INFO:teuthology.orchestra.run.smithi044.stderr: 35150K .......... .......... .......... .......... .......... 20% 5.08M 20s 2024-03-30T13:13:46.531 INFO:teuthology.orchestra.run.smithi044.stderr: 35200K .......... .......... .......... .......... .......... 20% 53.5M 20s 2024-03-30T13:13:46.534 INFO:teuthology.orchestra.run.smithi044.stderr: 35250K .......... .......... .......... .......... .......... 20% 3.77M 20s 2024-03-30T13:13:46.542 INFO:teuthology.orchestra.run.smithi044.stderr: 35300K .......... .......... .......... .......... .......... 20% 5.68M 20s 2024-03-30T13:13:46.545 INFO:teuthology.orchestra.run.smithi044.stderr: 35350K .......... .......... .......... .......... .......... 21% 16.5M 20s 2024-03-30T13:13:46.549 INFO:teuthology.orchestra.run.smithi044.stderr: 35400K .......... .......... .......... .......... .......... 21% 12.0M 20s 2024-03-30T13:13:46.556 INFO:teuthology.orchestra.run.smithi044.stderr: 35450K .......... .......... .......... .......... .......... 21% 7.73M 20s 2024-03-30T13:13:46.567 INFO:teuthology.orchestra.run.smithi044.stderr: 35500K .......... .......... .......... .......... .......... 21% 4.10M 20s 2024-03-30T13:13:46.570 INFO:teuthology.orchestra.run.smithi044.stderr: 35550K .......... .......... .......... .......... .......... 21% 25.9M 20s 2024-03-30T13:13:46.578 INFO:teuthology.orchestra.run.smithi044.stderr: 35600K .......... .......... .......... .......... .......... 21% 5.30M 20s 2024-03-30T13:13:46.581 INFO:teuthology.orchestra.run.smithi044.stderr: 35650K .......... .......... .......... .......... .......... 21% 19.5M 20s 2024-03-30T13:13:46.585 INFO:teuthology.orchestra.run.smithi044.stderr: 35700K .......... .......... .......... .......... .......... 21% 12.8M 20s 2024-03-30T13:13:46.592 INFO:teuthology.orchestra.run.smithi044.stderr: 35750K .......... .......... .......... .......... .......... 21% 7.34M 20s 2024-03-30T13:13:46.603 INFO:teuthology.orchestra.run.smithi044.stderr: 35800K .......... .......... .......... .......... .......... 21% 4.04M 20s 2024-03-30T13:13:46.605 INFO:teuthology.orchestra.run.smithi044.stderr: 35850K .......... .......... .......... .......... .......... 21% 26.8M 20s 2024-03-30T13:13:46.614 INFO:teuthology.orchestra.run.smithi044.stderr: 35900K .......... .......... .......... .......... .......... 21% 5.61M 20s 2024-03-30T13:13:46.617 INFO:teuthology.orchestra.run.smithi044.stderr: 35950K .......... .......... .......... .......... .......... 21% 17.3M 20s 2024-03-30T13:13:46.628 INFO:teuthology.orchestra.run.smithi044.stderr: 36000K .......... .......... .......... .......... .......... 21% 5.46M 20s 2024-03-30T13:13:46.628 INFO:teuthology.orchestra.run.smithi044.stderr: 36050K .......... .......... .......... .......... .......... 21% 42.1M 19s 2024-03-30T13:13:46.639 INFO:teuthology.orchestra.run.smithi044.stderr: 36100K .......... .......... .......... .......... .......... 21% 3.97M 19s 2024-03-30T13:13:46.640 INFO:teuthology.orchestra.run.smithi044.stderr: 36150K .......... .......... .......... .......... .......... 21% 38.1M 19s 2024-03-30T13:13:46.649 INFO:teuthology.orchestra.run.smithi044.stderr: 36200K .......... .......... .......... .......... .......... 21% 5.62M 19s 2024-03-30T13:13:46.652 INFO:teuthology.orchestra.run.smithi044.stderr: 36250K .......... .......... .......... .......... .......... 21% 15.2M 19s 2024-03-30T13:13:46.662 INFO:teuthology.orchestra.run.smithi044.stderr: 36300K .......... .......... .......... .......... .......... 21% 5.39M 19s 2024-03-30T13:13:46.662 INFO:teuthology.orchestra.run.smithi044.stderr: 36350K .......... .......... .......... .......... .......... 21% 42.1M 19s 2024-03-30T13:13:46.674 INFO:teuthology.orchestra.run.smithi044.stderr: 36400K .......... .......... .......... .......... .......... 21% 4.01M 19s 2024-03-30T13:13:46.676 INFO:teuthology.orchestra.run.smithi044.stderr: 36450K .......... .......... .......... .......... .......... 21% 32.6M 19s 2024-03-30T13:13:46.684 INFO:teuthology.orchestra.run.smithi044.stderr: 36500K .......... .......... .......... .......... .......... 21% 5.66M 19s 2024-03-30T13:13:46.687 INFO:teuthology.orchestra.run.smithi044.stderr: 36550K .......... .......... .......... .......... .......... 21% 17.0M 19s 2024-03-30T13:13:46.697 INFO:teuthology.orchestra.run.smithi044.stderr: 36600K .......... .......... .......... .......... .......... 21% 5.37M 19s 2024-03-30T13:13:46.698 INFO:teuthology.orchestra.run.smithi044.stderr: 36650K .......... .......... .......... .......... .......... 21% 35.2M 19s 2024-03-30T13:13:46.711 INFO:teuthology.orchestra.run.smithi044.stderr: 36700K .......... .......... .......... .......... .......... 21% 3.90M 19s 2024-03-30T13:13:46.711 INFO:teuthology.orchestra.run.smithi044.stderr: 36750K .......... .......... .......... .......... .......... 21% 47.0M 19s 2024-03-30T13:13:46.813 INFO:teuthology.orchestra.run.smithi044.stderr: 36800K .......... .......... .......... .......... .......... 21% 552K 20s 2024-03-30T13:13:46.814 INFO:teuthology.orchestra.run.smithi044.stderr: 36850K .......... .......... .......... .......... .......... 21% 94.3M 20s 2024-03-30T13:13:46.814 INFO:teuthology.orchestra.run.smithi044.stderr: 36900K .......... .......... .......... .......... .......... 21% 97.5M 20s 2024-03-30T13:13:46.814 INFO:teuthology.orchestra.run.smithi044.stderr: 36950K .......... .......... .......... .......... .......... 21% 114M 20s 2024-03-30T13:13:46.814 INFO:teuthology.orchestra.run.smithi044.stderr: 37000K .......... .......... .......... .......... .......... 21% 117M 19s 2024-03-30T13:13:46.814 INFO:teuthology.orchestra.run.smithi044.stderr: 37050K .......... .......... .......... .......... .......... 22% 185M 19s 2024-03-30T13:13:46.814 INFO:teuthology.orchestra.run.smithi044.stderr: 37100K .......... .......... .......... .......... .......... 22% 126M 19s 2024-03-30T13:13:46.814 INFO:teuthology.orchestra.run.smithi044.stderr: 37150K .......... .......... .......... .......... .......... 22% 185M 19s 2024-03-30T13:13:46.814 INFO:teuthology.orchestra.run.smithi044.stderr: 37200K .......... .......... .......... .......... .......... 22% 137M 19s 2024-03-30T13:13:46.814 INFO:teuthology.orchestra.run.smithi044.stderr: 37250K .......... .......... .......... .......... .......... 22% 130M 19s 2024-03-30T13:13:46.814 INFO:teuthology.orchestra.run.smithi044.stderr: 37300K .......... .......... .......... .......... .......... 22% 150M 19s 2024-03-30T13:13:46.814 INFO:teuthology.orchestra.run.smithi044.stderr: 37350K .......... .......... .......... .......... .......... 22% 129M 19s 2024-03-30T13:13:46.844 INFO:teuthology.orchestra.run.smithi044.stderr: 37400K .......... .......... .......... .......... .......... 22% 1.53M 19s 2024-03-30T13:13:46.844 INFO:teuthology.orchestra.run.smithi044.stderr: 37450K .......... .......... .......... .......... .......... 22% 59.6M 19s 2024-03-30T13:13:46.844 INFO:teuthology.orchestra.run.smithi044.stderr: 37500K .......... .......... .......... .......... .......... 22% 47.9M 19s 2024-03-30T13:13:46.844 INFO:teuthology.orchestra.run.smithi044.stderr: 37550K .......... .......... .......... .......... .......... 22% 80.9M 19s 2024-03-30T13:13:46.844 INFO:teuthology.orchestra.run.smithi044.stderr: 37600K .......... .......... .......... .......... .......... 22% 72.0M 19s 2024-03-30T13:13:46.844 INFO:teuthology.orchestra.run.smithi044.stderr: 37650K .......... .......... .......... .......... .......... 22% 84.0M 19s 2024-03-30T13:13:46.877 INFO:teuthology.orchestra.run.smithi044.stderr: 37700K .......... .......... .......... .......... .......... 22% 1.44M 19s 2024-03-30T13:13:46.878 INFO:teuthology.orchestra.run.smithi044.stderr: 37750K .......... .......... .......... .......... .......... 22% 30.4M 19s 2024-03-30T13:13:46.879 INFO:teuthology.orchestra.run.smithi044.stderr: 37800K .......... .......... .......... .......... .......... 22% 36.6M 19s 2024-03-30T13:13:46.880 INFO:teuthology.orchestra.run.smithi044.stderr: 37850K .......... .......... .......... .......... .......... 22% 31.6M 19s 2024-03-30T13:13:46.882 INFO:teuthology.orchestra.run.smithi044.stderr: 37900K .......... .......... .......... .......... .......... 22% 33.9M 19s 2024-03-30T13:13:46.883 INFO:teuthology.orchestra.run.smithi044.stderr: 37950K .......... .......... .......... .......... .......... 22% 31.9M 19s 2024-03-30T13:13:46.911 INFO:teuthology.orchestra.run.smithi044.stderr: 38000K .......... .......... .......... .......... .......... 22% 1.81M 19s 2024-03-30T13:13:46.915 INFO:teuthology.orchestra.run.smithi044.stderr: 38050K .......... .......... .......... .......... .......... 22% 27.7M 19s 2024-03-30T13:13:46.915 INFO:teuthology.orchestra.run.smithi044.stderr: 38100K .......... .......... .......... .......... .......... 22% 37.3M 19s 2024-03-30T13:13:46.915 INFO:teuthology.orchestra.run.smithi044.stderr: 38150K .......... .......... .......... .......... .......... 22% 40.0M 19s 2024-03-30T13:13:46.916 INFO:teuthology.orchestra.run.smithi044.stderr: 38200K .......... .......... .......... .......... .......... 22% 31.3M 19s 2024-03-30T13:13:46.917 INFO:teuthology.orchestra.run.smithi044.stderr: 38250K .......... .......... .......... .......... .......... 22% 36.4M 19s 2024-03-30T13:13:46.945 INFO:teuthology.orchestra.run.smithi044.stderr: 38300K .......... .......... .......... .......... .......... 22% 1.75M 19s 2024-03-30T13:13:46.948 INFO:teuthology.orchestra.run.smithi044.stderr: 38350K .......... .......... .......... .......... .......... 22% 23.4M 19s 2024-03-30T13:13:46.949 INFO:teuthology.orchestra.run.smithi044.stderr: 38400K .......... .......... .......... .......... .......... 22% 33.8M 19s 2024-03-30T13:13:46.953 INFO:teuthology.orchestra.run.smithi044.stderr: 38450K .......... .......... .......... .......... .......... 22% 33.4M 19s 2024-03-30T13:13:46.953 INFO:teuthology.orchestra.run.smithi044.stderr: 38500K .......... .......... .......... .......... .......... 22% 37.4M 19s 2024-03-30T13:13:46.953 INFO:teuthology.orchestra.run.smithi044.stderr: 38550K .......... .......... .......... .......... .......... 22% 34.8M 19s 2024-03-30T13:13:46.982 INFO:teuthology.orchestra.run.smithi044.stderr: 38600K .......... .......... .......... .......... .......... 22% 1.75M 19s 2024-03-30T13:13:46.983 INFO:teuthology.orchestra.run.smithi044.stderr: 38650K .......... .......... .......... .......... .......... 22% 28.7M 19s 2024-03-30T13:13:46.984 INFO:teuthology.orchestra.run.smithi044.stderr: 38700K .......... .......... .......... .......... .......... 22% 30.6M 19s 2024-03-30T13:13:46.986 INFO:teuthology.orchestra.run.smithi044.stderr: 38750K .......... .......... .......... .......... .......... 23% 29.2M 19s 2024-03-30T13:13:46.988 INFO:teuthology.orchestra.run.smithi044.stderr: 38800K .......... .......... .......... .......... .......... 23% 32.5M 19s 2024-03-30T13:13:46.989 INFO:teuthology.orchestra.run.smithi044.stderr: 38850K .......... .......... .......... .......... .......... 23% 34.2M 19s 2024-03-30T13:13:47.017 INFO:teuthology.orchestra.run.smithi044.stderr: 38900K .......... .......... .......... .......... .......... 23% 1.76M 19s 2024-03-30T13:13:47.018 INFO:teuthology.orchestra.run.smithi044.stderr: 38950K .......... .......... .......... .......... .......... 23% 27.0M 19s 2024-03-30T13:13:47.020 INFO:teuthology.orchestra.run.smithi044.stderr: 39000K .......... .......... .......... .......... .......... 23% 32.8M 19s 2024-03-30T13:13:47.021 INFO:teuthology.orchestra.run.smithi044.stderr: 39050K .......... .......... .......... .......... .......... 23% 31.4M 19s 2024-03-30T13:13:47.023 INFO:teuthology.orchestra.run.smithi044.stderr: 39100K .......... .......... .......... .......... .......... 23% 33.6M 19s 2024-03-30T13:13:47.025 INFO:teuthology.orchestra.run.smithi044.stderr: 39150K .......... .......... .......... .......... .......... 23% 33.4M 19s 2024-03-30T13:13:47.052 INFO:teuthology.orchestra.run.smithi044.stderr: 39200K .......... .......... .......... .......... .......... 23% 1.77M 19s 2024-03-30T13:13:47.054 INFO:teuthology.orchestra.run.smithi044.stderr: 39250K .......... .......... .......... .......... .......... 23% 26.0M 19s 2024-03-30T13:13:47.056 INFO:teuthology.orchestra.run.smithi044.stderr: 39300K .......... .......... .......... .......... .......... 23% 28.7M 19s 2024-03-30T13:13:47.057 INFO:teuthology.orchestra.run.smithi044.stderr: 39350K .......... .......... .......... .......... .......... 23% 30.8M 19s 2024-03-30T13:13:47.059 INFO:teuthology.orchestra.run.smithi044.stderr: 39400K .......... .......... .......... .......... .......... 23% 31.3M 19s 2024-03-30T13:13:47.060 INFO:teuthology.orchestra.run.smithi044.stderr: 39450K .......... .......... .......... .......... .......... 23% 30.9M 19s 2024-03-30T13:13:47.088 INFO:teuthology.orchestra.run.smithi044.stderr: 39500K .......... .......... .......... .......... .......... 23% 1.79M 19s 2024-03-30T13:13:47.089 INFO:teuthology.orchestra.run.smithi044.stderr: 39550K .......... .......... .......... .......... .......... 23% 28.1M 19s 2024-03-30T13:13:47.091 INFO:teuthology.orchestra.run.smithi044.stderr: 39600K .......... .......... .......... .......... .......... 23% 23.2M 19s 2024-03-30T13:13:47.093 INFO:teuthology.orchestra.run.smithi044.stderr: 39650K .......... .......... .......... .......... .......... 23% 31.6M 19s 2024-03-30T13:13:47.095 INFO:teuthology.orchestra.run.smithi044.stderr: 39700K .......... .......... .......... .......... .......... 23% 35.3M 19s 2024-03-30T13:13:47.096 INFO:teuthology.orchestra.run.smithi044.stderr: 39750K .......... .......... .......... .......... .......... 23% 34.7M 19s 2024-03-30T13:13:47.125 INFO:teuthology.orchestra.run.smithi044.stderr: 39800K .......... .......... .......... .......... .......... 23% 1.80M 19s 2024-03-30T13:13:47.127 INFO:teuthology.orchestra.run.smithi044.stderr: 39850K .......... .......... .......... .......... .......... 23% 12.7M 19s 2024-03-30T13:13:47.128 INFO:teuthology.orchestra.run.smithi044.stderr: 39900K .......... .......... .......... .......... .......... 23% 31.8M 19s 2024-03-30T13:13:47.130 INFO:teuthology.orchestra.run.smithi044.stderr: 39950K .......... .......... .......... .......... .......... 23% 27.2M 19s 2024-03-30T13:13:47.131 INFO:teuthology.orchestra.run.smithi044.stderr: 40000K .......... .......... .......... .......... .......... 23% 34.3M 19s 2024-03-30T13:13:47.133 INFO:teuthology.orchestra.run.smithi044.stderr: 40050K .......... .......... .......... .......... .......... 23% 29.7M 19s 2024-03-30T13:13:47.163 INFO:teuthology.orchestra.run.smithi044.stderr: 40100K .......... .......... .......... .......... .......... 23% 1.77M 19s 2024-03-30T13:13:47.164 INFO:teuthology.orchestra.run.smithi044.stderr: 40150K .......... .......... .......... .......... .......... 23% 15.9M 19s 2024-03-30T13:13:47.165 INFO:teuthology.orchestra.run.smithi044.stderr: 40200K .......... .......... .......... .......... .......... 23% 28.1M 19s 2024-03-30T13:13:47.167 INFO:teuthology.orchestra.run.smithi044.stderr: 40250K .......... .......... .......... .......... .......... 23% 32.0M 19s 2024-03-30T13:13:47.169 INFO:teuthology.orchestra.run.smithi044.stderr: 40300K .......... .......... .......... .......... .......... 23% 32.9M 19s 2024-03-30T13:13:47.170 INFO:teuthology.orchestra.run.smithi044.stderr: 40350K .......... .......... .......... .......... .......... 23% 29.1M 19s 2024-03-30T13:13:47.194 INFO:teuthology.orchestra.run.smithi044.stderr: 40400K .......... .......... .......... .......... .......... 23% 2.07M 19s 2024-03-30T13:13:47.199 INFO:teuthology.orchestra.run.smithi044.stderr: 40450K .......... .......... .......... .......... .......... 24% 8.98M 19s 2024-03-30T13:13:47.201 INFO:teuthology.orchestra.run.smithi044.stderr: 40500K .......... .......... .......... .......... .......... 24% 27.8M 19s 2024-03-30T13:13:47.202 INFO:teuthology.orchestra.run.smithi044.stderr: 40550K .......... .......... .......... .......... .......... 24% 30.6M 19s 2024-03-30T13:13:47.205 INFO:teuthology.orchestra.run.smithi044.stderr: 40600K .......... .......... .......... .......... .......... 24% 27.4M 19s 2024-03-30T13:13:47.206 INFO:teuthology.orchestra.run.smithi044.stderr: 40650K .......... .......... .......... .......... .......... 24% 32.8M 19s 2024-03-30T13:13:47.220 INFO:teuthology.orchestra.run.smithi044.stderr: 40700K .......... .......... .......... .......... .......... 24% 3.49M 19s 2024-03-30T13:13:47.235 INFO:teuthology.orchestra.run.smithi044.stderr: 40750K .......... .......... .......... .......... .......... 24% 3.32M 19s 2024-03-30T13:13:47.237 INFO:teuthology.orchestra.run.smithi044.stderr: 40800K .......... .......... .......... .......... .......... 24% 25.4M 19s 2024-03-30T13:13:47.238 INFO:teuthology.orchestra.run.smithi044.stderr: 40850K .......... .......... .......... .......... .......... 24% 31.9M 18s 2024-03-30T13:13:47.239 INFO:teuthology.orchestra.run.smithi044.stderr: 40900K .......... .......... .......... .......... .......... 24% 33.2M 18s 2024-03-30T13:13:47.242 INFO:teuthology.orchestra.run.smithi044.stderr: 40950K .......... .......... .......... .......... .......... 24% 22.3M 18s 2024-03-30T13:13:47.255 INFO:teuthology.orchestra.run.smithi044.stderr: 41000K .......... .......... .......... .......... .......... 24% 3.59M 18s 2024-03-30T13:13:47.270 INFO:teuthology.orchestra.run.smithi044.stderr: 41050K .......... .......... .......... .......... .......... 24% 3.37M 18s 2024-03-30T13:13:47.271 INFO:teuthology.orchestra.run.smithi044.stderr: 41100K .......... .......... .......... .......... .......... 24% 26.5M 18s 2024-03-30T13:13:47.273 INFO:teuthology.orchestra.run.smithi044.stderr: 41150K .......... .......... .......... .......... .......... 24% 31.2M 18s 2024-03-30T13:13:47.275 INFO:teuthology.orchestra.run.smithi044.stderr: 41200K .......... .......... .......... .......... .......... 24% 26.7M 18s 2024-03-30T13:13:47.276 INFO:teuthology.orchestra.run.smithi044.stderr: 41250K .......... .......... .......... .......... .......... 24% 34.8M 18s 2024-03-30T13:13:47.278 INFO:teuthology.orchestra.run.smithi044.stderr: 41300K .......... .......... .......... .......... .......... 24% 31.4M 18s 2024-03-30T13:13:47.305 INFO:teuthology.orchestra.run.smithi044.stderr: 41350K .......... .......... .......... .......... .......... 24% 1.80M 18s 2024-03-30T13:13:47.307 INFO:teuthology.orchestra.run.smithi044.stderr: 41400K .......... .......... .......... .......... .......... 24% 27.6M 18s 2024-03-30T13:13:47.309 INFO:teuthology.orchestra.run.smithi044.stderr: 41450K .......... .......... .......... .......... .......... 24% 23.5M 18s 2024-03-30T13:13:47.312 INFO:teuthology.orchestra.run.smithi044.stderr: 41500K .......... .......... .......... .......... .......... 24% 33.6M 18s 2024-03-30T13:13:47.312 INFO:teuthology.orchestra.run.smithi044.stderr: 41550K .......... .......... .......... .......... .......... 24% 35.3M 18s 2024-03-30T13:13:47.313 INFO:teuthology.orchestra.run.smithi044.stderr: 41600K .......... .......... .......... .......... .......... 24% 35.9M 18s 2024-03-30T13:13:47.341 INFO:teuthology.orchestra.run.smithi044.stderr: 41650K .......... .......... .......... .......... .......... 24% 1.77M 18s 2024-03-30T13:13:47.342 INFO:teuthology.orchestra.run.smithi044.stderr: 41700K .......... .......... .......... .......... .......... 24% 24.9M 18s 2024-03-30T13:13:47.345 INFO:teuthology.orchestra.run.smithi044.stderr: 41750K .......... .......... .......... .......... .......... 24% 29.9M 18s 2024-03-30T13:13:47.346 INFO:teuthology.orchestra.run.smithi044.stderr: 41800K .......... .......... .......... .......... .......... 24% 30.8M 18s 2024-03-30T13:13:47.347 INFO:teuthology.orchestra.run.smithi044.stderr: 41850K .......... .......... .......... .......... .......... 24% 29.9M 18s 2024-03-30T13:13:47.349 INFO:teuthology.orchestra.run.smithi044.stderr: 41900K .......... .......... .......... .......... .......... 24% 30.2M 18s 2024-03-30T13:13:47.376 INFO:teuthology.orchestra.run.smithi044.stderr: 41950K .......... .......... .......... .......... .......... 24% 1.82M 18s 2024-03-30T13:13:47.378 INFO:teuthology.orchestra.run.smithi044.stderr: 42000K .......... .......... .......... .......... .......... 24% 28.8M 18s 2024-03-30T13:13:47.380 INFO:teuthology.orchestra.run.smithi044.stderr: 42050K .......... .......... .......... .......... .......... 24% 23.5M 18s 2024-03-30T13:13:47.382 INFO:teuthology.orchestra.run.smithi044.stderr: 42100K .......... .......... .......... .......... .......... 25% 31.3M 18s 2024-03-30T13:13:47.382 INFO:teuthology.orchestra.run.smithi044.stderr: 42150K .......... .......... .......... .......... .......... 25% 36.5M 18s 2024-03-30T13:13:47.385 INFO:teuthology.orchestra.run.smithi044.stderr: 42200K .......... .......... .......... .......... .......... 25% 31.8M 18s 2024-03-30T13:13:47.408 INFO:teuthology.orchestra.run.smithi044.stderr: 42250K .......... .......... .......... .......... .......... 25% 2.09M 18s 2024-03-30T13:13:47.413 INFO:teuthology.orchestra.run.smithi044.stderr: 42300K .......... .......... .......... .......... .......... 25% 9.10M 18s 2024-03-30T13:13:47.416 INFO:teuthology.orchestra.run.smithi044.stderr: 42350K .......... .......... .......... .......... .......... 25% 22.1M 18s 2024-03-30T13:13:47.417 INFO:teuthology.orchestra.run.smithi044.stderr: 42400K .......... .......... .......... .......... .......... 25% 30.6M 18s 2024-03-30T13:13:47.418 INFO:teuthology.orchestra.run.smithi044.stderr: 42450K .......... .......... .......... .......... .......... 25% 35.3M 18s 2024-03-30T13:13:47.420 INFO:teuthology.orchestra.run.smithi044.stderr: 42500K .......... .......... .......... .......... .......... 25% 33.6M 18s 2024-03-30T13:13:47.421 INFO:teuthology.orchestra.run.smithi044.stderr: 42550K .......... .......... .......... .......... .......... 25% 26.7M 18s 2024-03-30T13:13:47.448 INFO:teuthology.orchestra.run.smithi044.stderr: 42600K .......... .......... .......... .......... .......... 25% 1.84M 18s 2024-03-30T13:13:47.450 INFO:teuthology.orchestra.run.smithi044.stderr: 42650K .......... .......... .......... .......... .......... 25% 22.1M 18s 2024-03-30T13:13:47.452 INFO:teuthology.orchestra.run.smithi044.stderr: 42700K .......... .......... .......... .......... .......... 25% 28.5M 18s 2024-03-30T13:13:47.453 INFO:teuthology.orchestra.run.smithi044.stderr: 42750K .......... .......... .......... .......... .......... 25% 28.6M 18s 2024-03-30T13:13:47.456 INFO:teuthology.orchestra.run.smithi044.stderr: 42800K .......... .......... .......... .......... .......... 25% 31.7M 18s 2024-03-30T13:13:47.457 INFO:teuthology.orchestra.run.smithi044.stderr: 42850K .......... .......... .......... .......... .......... 25% 28.3M 18s 2024-03-30T13:13:47.483 INFO:teuthology.orchestra.run.smithi044.stderr: 42900K .......... .......... .......... .......... .......... 25% 1.85M 18s 2024-03-30T13:13:47.485 INFO:teuthology.orchestra.run.smithi044.stderr: 42950K .......... .......... .......... .......... .......... 25% 26.3M 18s 2024-03-30T13:13:47.488 INFO:teuthology.orchestra.run.smithi044.stderr: 43000K .......... .......... .......... .......... .......... 25% 27.0M 18s 2024-03-30T13:13:47.489 INFO:teuthology.orchestra.run.smithi044.stderr: 43050K .......... .......... .......... .......... .......... 25% 29.8M 18s 2024-03-30T13:13:47.491 INFO:teuthology.orchestra.run.smithi044.stderr: 43100K .......... .......... .......... .......... .......... 25% 27.7M 18s 2024-03-30T13:13:47.492 INFO:teuthology.orchestra.run.smithi044.stderr: 43150K .......... .......... .......... .......... .......... 25% 30.7M 18s 2024-03-30T13:13:47.519 INFO:teuthology.orchestra.run.smithi044.stderr: 43200K .......... .......... .......... .......... .......... 25% 1.85M 18s 2024-03-30T13:13:47.521 INFO:teuthology.orchestra.run.smithi044.stderr: 43250K .......... .......... .......... .......... .......... 25% 25.3M 18s 2024-03-30T13:13:47.522 INFO:teuthology.orchestra.run.smithi044.stderr: 43300K .......... .......... .......... .......... .......... 25% 28.4M 18s 2024-03-30T13:13:47.523 INFO:teuthology.orchestra.run.smithi044.stderr: 43350K .......... .......... .......... .......... .......... 25% 30.7M 18s 2024-03-30T13:13:47.525 INFO:teuthology.orchestra.run.smithi044.stderr: 43400K .......... .......... .......... .......... .......... 25% 32.0M 18s 2024-03-30T13:13:47.527 INFO:teuthology.orchestra.run.smithi044.stderr: 43450K .......... .......... .......... .......... .......... 25% 28.8M 18s 2024-03-30T13:13:47.552 INFO:teuthology.orchestra.run.smithi044.stderr: 43500K .......... .......... .......... .......... .......... 25% 1.95M 18s 2024-03-30T13:13:47.560 INFO:teuthology.orchestra.run.smithi044.stderr: 43550K .......... .......... .......... .......... .......... 25% 14.9M 18s 2024-03-30T13:13:47.560 INFO:teuthology.orchestra.run.smithi044.stderr: 43600K .......... .......... .......... .......... .......... 25% 56.9M 18s 2024-03-30T13:13:47.560 INFO:teuthology.orchestra.run.smithi044.stderr: 43650K .......... .......... .......... .......... .......... 25% 69.7M 18s 2024-03-30T13:13:47.560 INFO:teuthology.orchestra.run.smithi044.stderr: 43700K .......... .......... .......... .......... .......... 25% 68.5M 18s 2024-03-30T13:13:47.560 INFO:teuthology.orchestra.run.smithi044.stderr: 43750K .......... .......... .......... .......... .......... 25% 61.6M 18s 2024-03-30T13:13:47.575 INFO:teuthology.orchestra.run.smithi044.stderr: 43800K .......... .......... .......... .......... .......... 26% 2.89M 18s 2024-03-30T13:13:47.590 INFO:teuthology.orchestra.run.smithi044.stderr: 43850K .......... .......... .......... .......... .......... 26% 3.27M 18s 2024-03-30T13:13:47.594 INFO:teuthology.orchestra.run.smithi044.stderr: 43900K .......... .......... .......... .......... .......... 26% 43.1M 18s 2024-03-30T13:13:47.594 INFO:teuthology.orchestra.run.smithi044.stderr: 43950K .......... .......... .......... .......... .......... 26% 65.1M 18s 2024-03-30T13:13:47.595 INFO:teuthology.orchestra.run.smithi044.stderr: 44000K .......... .......... .......... .......... .......... 26% 66.2M 18s 2024-03-30T13:13:47.595 INFO:teuthology.orchestra.run.smithi044.stderr: 44050K .......... .......... .......... .......... .......... 26% 54.4M 18s 2024-03-30T13:13:47.595 INFO:teuthology.orchestra.run.smithi044.stderr: 44100K .......... .......... .......... .......... .......... 26% 77.2M 18s 2024-03-30T13:13:47.626 INFO:teuthology.orchestra.run.smithi044.stderr: 44150K .......... .......... .......... .......... .......... 26% 1.57M 18s 2024-03-30T13:13:47.627 INFO:teuthology.orchestra.run.smithi044.stderr: 44200K .......... .......... .......... .......... .......... 26% 45.7M 18s 2024-03-30T13:13:47.630 INFO:teuthology.orchestra.run.smithi044.stderr: 44250K .......... .......... .......... .......... .......... 26% 66.5M 18s 2024-03-30T13:13:47.630 INFO:teuthology.orchestra.run.smithi044.stderr: 44300K .......... .......... .......... .......... .......... 26% 57.2M 18s 2024-03-30T13:13:47.630 INFO:teuthology.orchestra.run.smithi044.stderr: 44350K .......... .......... .......... .......... .......... 26% 67.8M 18s 2024-03-30T13:13:47.631 INFO:teuthology.orchestra.run.smithi044.stderr: 44400K .......... .......... .......... .......... .......... 26% 75.8M 18s 2024-03-30T13:13:47.659 INFO:teuthology.orchestra.run.smithi044.stderr: 44450K .......... .......... .......... .......... .......... 26% 1.63M 18s 2024-03-30T13:13:47.665 INFO:teuthology.orchestra.run.smithi044.stderr: 44500K .......... .......... .......... .......... .......... 26% 20.1M 18s 2024-03-30T13:13:47.665 INFO:teuthology.orchestra.run.smithi044.stderr: 44550K .......... .......... .......... .......... .......... 26% 58.7M 18s 2024-03-30T13:13:47.665 INFO:teuthology.orchestra.run.smithi044.stderr: 44600K .......... .......... .......... .......... .......... 26% 68.8M 18s 2024-03-30T13:13:47.665 INFO:teuthology.orchestra.run.smithi044.stderr: 44650K .......... .......... .......... .......... .......... 26% 68.0M 18s 2024-03-30T13:13:47.665 INFO:teuthology.orchestra.run.smithi044.stderr: 44700K .......... .......... .......... .......... .......... 26% 69.5M 18s 2024-03-30T13:13:47.695 INFO:teuthology.orchestra.run.smithi044.stderr: 44750K .......... .......... .......... .......... .......... 26% 1.63M 18s 2024-03-30T13:13:47.700 INFO:teuthology.orchestra.run.smithi044.stderr: 44800K .......... .......... .......... .......... .......... 26% 21.1M 18s 2024-03-30T13:13:47.701 INFO:teuthology.orchestra.run.smithi044.stderr: 44850K .......... .......... .......... .......... .......... 26% 66.7M 18s 2024-03-30T13:13:47.701 INFO:teuthology.orchestra.run.smithi044.stderr: 44900K .......... .......... .......... .......... .......... 26% 71.4M 18s 2024-03-30T13:13:47.701 INFO:teuthology.orchestra.run.smithi044.stderr: 44950K .......... .......... .......... .......... .......... 26% 59.2M 18s 2024-03-30T13:13:47.701 INFO:teuthology.orchestra.run.smithi044.stderr: 45000K .......... .......... .......... .......... .......... 26% 68.3M 18s 2024-03-30T13:13:47.717 INFO:teuthology.orchestra.run.smithi044.stderr: 45050K .......... .......... .......... .......... .......... 26% 2.84M 18s 2024-03-30T13:13:47.733 INFO:teuthology.orchestra.run.smithi044.stderr: 45100K .......... .......... .......... .......... .......... 26% 3.21M 18s 2024-03-30T13:13:47.734 INFO:teuthology.orchestra.run.smithi044.stderr: 45150K .......... .......... .......... .......... .......... 26% 57.1M 18s 2024-03-30T13:13:47.734 INFO:teuthology.orchestra.run.smithi044.stderr: 45200K .......... .......... .......... .......... .......... 26% 66.5M 17s 2024-03-30T13:13:47.734 INFO:teuthology.orchestra.run.smithi044.stderr: 45250K .......... .......... .......... .......... .......... 26% 69.9M 17s 2024-03-30T13:13:47.736 INFO:teuthology.orchestra.run.smithi044.stderr: 45300K .......... .......... .......... .......... .......... 26% 72.1M 17s 2024-03-30T13:13:47.736 INFO:teuthology.orchestra.run.smithi044.stderr: 45350K .......... .......... .......... .......... .......... 26% 64.2M 17s 2024-03-30T13:13:47.769 INFO:teuthology.orchestra.run.smithi044.stderr: 45400K .......... .......... .......... .......... .......... 26% 1.53M 17s 2024-03-30T13:13:47.769 INFO:teuthology.orchestra.run.smithi044.stderr: 45450K .......... .......... .......... .......... .......... 26% 56.8M 17s 2024-03-30T13:13:47.772 INFO:teuthology.orchestra.run.smithi044.stderr: 45500K .......... .......... .......... .......... .......... 27% 40.9M 17s 2024-03-30T13:13:47.772 INFO:teuthology.orchestra.run.smithi044.stderr: 45550K .......... .......... .......... .......... .......... 27% 61.7M 17s 2024-03-30T13:13:47.773 INFO:teuthology.orchestra.run.smithi044.stderr: 45600K .......... .......... .......... .......... .......... 27% 75.1M 17s 2024-03-30T13:13:47.773 INFO:teuthology.orchestra.run.smithi044.stderr: 45650K .......... .......... .......... .......... .......... 27% 80.9M 17s 2024-03-30T13:13:47.808 INFO:teuthology.orchestra.run.smithi044.stderr: 45700K .......... .......... .......... .......... .......... 27% 1.56M 17s 2024-03-30T13:13:47.809 INFO:teuthology.orchestra.run.smithi044.stderr: 45750K .......... .......... .......... .......... .......... 27% 62.1M 17s 2024-03-30T13:13:47.809 INFO:teuthology.orchestra.run.smithi044.stderr: 45800K .......... .......... .......... .......... .......... 27% 68.1M 17s 2024-03-30T13:13:47.809 INFO:teuthology.orchestra.run.smithi044.stderr: 45850K .......... .......... .......... .......... .......... 27% 57.2M 17s 2024-03-30T13:13:47.809 INFO:teuthology.orchestra.run.smithi044.stderr: 45900K .......... .......... .......... .......... .......... 27% 71.0M 17s 2024-03-30T13:13:47.809 INFO:teuthology.orchestra.run.smithi044.stderr: 45950K .......... .......... .......... .......... .......... 27% 77.5M 17s 2024-03-30T13:13:47.835 INFO:teuthology.orchestra.run.smithi044.stderr: 46000K .......... .......... .......... .......... .......... 27% 1.76M 17s 2024-03-30T13:13:47.842 INFO:teuthology.orchestra.run.smithi044.stderr: 46050K .......... .......... .......... .......... .......... 27% 10.3M 17s 2024-03-30T13:13:47.842 INFO:teuthology.orchestra.run.smithi044.stderr: 46100K .......... .......... .......... .......... .......... 27% 66.2M 17s 2024-03-30T13:13:47.842 INFO:teuthology.orchestra.run.smithi044.stderr: 46150K .......... .......... .......... .......... .......... 27% 59.9M 17s 2024-03-30T13:13:47.842 INFO:teuthology.orchestra.run.smithi044.stderr: 46200K .......... .......... .......... .......... .......... 27% 68.1M 17s 2024-03-30T13:13:47.843 INFO:teuthology.orchestra.run.smithi044.stderr: 46250K .......... .......... .......... .......... .......... 27% 50.6M 17s 2024-03-30T13:13:47.859 INFO:teuthology.orchestra.run.smithi044.stderr: 46300K .......... .......... .......... .......... .......... 27% 2.93M 17s 2024-03-30T13:13:47.874 INFO:teuthology.orchestra.run.smithi044.stderr: 46350K .......... .......... .......... .......... .......... 27% 3.19M 17s 2024-03-30T13:13:47.878 INFO:teuthology.orchestra.run.smithi044.stderr: 46400K .......... .......... .......... .......... .......... 27% 67.0M 17s 2024-03-30T13:13:47.879 INFO:teuthology.orchestra.run.smithi044.stderr: 46450K .......... .......... .......... .......... .......... 27% 64.4M 17s 2024-03-30T13:13:47.879 INFO:teuthology.orchestra.run.smithi044.stderr: 46500K .......... .......... .......... .......... .......... 27% 56.6M 17s 2024-03-30T13:13:47.879 INFO:teuthology.orchestra.run.smithi044.stderr: 46550K .......... .......... .......... .......... .......... 27% 74.7M 17s 2024-03-30T13:13:47.879 INFO:teuthology.orchestra.run.smithi044.stderr: 46600K .......... .......... .......... .......... .......... 27% 79.8M 17s 2024-03-30T13:13:47.909 INFO:teuthology.orchestra.run.smithi044.stderr: 46650K .......... .......... .......... .......... .......... 27% 1.64M 17s 2024-03-30T13:13:47.912 INFO:teuthology.orchestra.run.smithi044.stderr: 46700K .......... .......... .......... .......... .......... 27% 14.9M 17s 2024-03-30T13:13:47.915 INFO:teuthology.orchestra.run.smithi044.stderr: 46750K .......... .......... .......... .......... .......... 27% 34.2M 17s 2024-03-30T13:13:47.915 INFO:teuthology.orchestra.run.smithi044.stderr: 46800K .......... .......... .......... .......... .......... 27% 34.2M 17s 2024-03-30T13:13:47.917 INFO:teuthology.orchestra.run.smithi044.stderr: 46850K .......... .......... .......... .......... .......... 27% 41.7M 17s 2024-03-30T13:13:47.917 INFO:teuthology.orchestra.run.smithi044.stderr: 46900K .......... .......... .......... .......... .......... 27% 36.2M 17s 2024-03-30T13:13:47.941 INFO:teuthology.orchestra.run.smithi044.stderr: 46950K .......... .......... .......... .......... .......... 27% 1.99M 17s 2024-03-30T13:13:47.946 INFO:teuthology.orchestra.run.smithi044.stderr: 47000K .......... .......... .......... .......... .......... 27% 10.1M 17s 2024-03-30T13:13:47.948 INFO:teuthology.orchestra.run.smithi044.stderr: 47050K .......... .......... .......... .......... .......... 27% 28.8M 17s 2024-03-30T13:13:47.949 INFO:teuthology.orchestra.run.smithi044.stderr: 47100K .......... .......... .......... .......... .......... 27% 37.4M 17s 2024-03-30T13:13:47.951 INFO:teuthology.orchestra.run.smithi044.stderr: 47150K .......... .......... .......... .......... .......... 28% 41.1M 17s 2024-03-30T13:13:47.952 INFO:teuthology.orchestra.run.smithi044.stderr: 47200K .......... .......... .......... .......... .......... 28% 42.6M 17s 2024-03-30T13:13:47.953 INFO:teuthology.orchestra.run.smithi044.stderr: 47250K .......... .......... .......... .......... .......... 28% 36.4M 17s 2024-03-30T13:13:47.987 INFO:teuthology.orchestra.run.smithi044.stderr: 47300K .......... .......... .......... .......... .......... 28% 1.72M 17s 2024-03-30T13:13:47.987 INFO:teuthology.orchestra.run.smithi044.stderr: 47350K .......... .......... .......... .......... .......... 28% 33.3M 17s 2024-03-30T13:13:47.987 INFO:teuthology.orchestra.run.smithi044.stderr: 47400K .......... .......... .......... .......... .......... 28% 34.5M 17s 2024-03-30T13:13:47.987 INFO:teuthology.orchestra.run.smithi044.stderr: 47450K .......... .......... .......... .......... .......... 28% 38.9M 17s 2024-03-30T13:13:47.987 INFO:teuthology.orchestra.run.smithi044.stderr: 47500K .......... .......... .......... .......... .......... 28% 56.1M 17s 2024-03-30T13:13:47.987 INFO:teuthology.orchestra.run.smithi044.stderr: 47550K .......... .......... .......... .......... .......... 28% 82.8M 17s 2024-03-30T13:13:48.014 INFO:teuthology.orchestra.run.smithi044.stderr: 47600K .......... .......... .......... .......... .......... 28% 1.75M 17s 2024-03-30T13:13:48.018 INFO:teuthology.orchestra.run.smithi044.stderr: 47650K .......... .......... .......... .......... .......... 28% 17.5M 17s 2024-03-30T13:13:48.018 INFO:teuthology.orchestra.run.smithi044.stderr: 47700K .......... .......... .......... .......... .......... 28% 58.1M 17s 2024-03-30T13:13:48.019 INFO:teuthology.orchestra.run.smithi044.stderr: 47750K .......... .......... .......... .......... .......... 28% 66.7M 17s 2024-03-30T13:13:48.021 INFO:teuthology.orchestra.run.smithi044.stderr: 47800K .......... .......... .......... .......... .......... 28% 66.4M 17s 2024-03-30T13:13:48.021 INFO:teuthology.orchestra.run.smithi044.stderr: 47850K .......... .......... .......... .......... .......... 28% 79.0M 17s 2024-03-30T13:13:48.037 INFO:teuthology.orchestra.run.smithi044.stderr: 47900K .......... .......... .......... .......... .......... 28% 70.4M 17s 2024-03-30T13:13:48.052 INFO:teuthology.orchestra.run.smithi044.stderr: 47950K .......... .......... .......... .......... .......... 28% 1.56M 17s 2024-03-30T13:13:48.056 INFO:teuthology.orchestra.run.smithi044.stderr: 48000K .......... .......... .......... .......... .......... 28% 55.0M 17s 2024-03-30T13:13:48.057 INFO:teuthology.orchestra.run.smithi044.stderr: 48050K .......... .......... .......... .......... .......... 28% 65.5M 17s 2024-03-30T13:13:48.057 INFO:teuthology.orchestra.run.smithi044.stderr: 48100K .......... .......... .......... .......... .......... 28% 57.7M 17s 2024-03-30T13:13:48.057 INFO:teuthology.orchestra.run.smithi044.stderr: 48150K .......... .......... .......... .......... .......... 28% 72.3M 17s 2024-03-30T13:13:48.057 INFO:teuthology.orchestra.run.smithi044.stderr: 48200K .......... .......... .......... .......... .......... 28% 77.5M 17s 2024-03-30T13:13:48.086 INFO:teuthology.orchestra.run.smithi044.stderr: 48250K .......... .......... .......... .......... .......... 28% 1.64M 17s 2024-03-30T13:13:48.090 INFO:teuthology.orchestra.run.smithi044.stderr: 48300K .......... .......... .......... .......... .......... 28% 14.0M 17s 2024-03-30T13:13:48.094 INFO:teuthology.orchestra.run.smithi044.stderr: 48350K .......... .......... .......... .......... .......... 28% 32.7M 17s 2024-03-30T13:13:48.094 INFO:teuthology.orchestra.run.smithi044.stderr: 48400K .......... .......... .......... .......... .......... 28% 60.5M 17s 2024-03-30T13:13:48.094 INFO:teuthology.orchestra.run.smithi044.stderr: 48450K .......... .......... .......... .......... .......... 28% 74.0M 17s 2024-03-30T13:13:48.094 INFO:teuthology.orchestra.run.smithi044.stderr: 48500K .......... .......... .......... .......... .......... 28% 83.9M 17s 2024-03-30T13:13:48.108 INFO:teuthology.orchestra.run.smithi044.stderr: 48550K .......... .......... .......... .......... .......... 28% 3.18M 17s 2024-03-30T13:13:48.130 INFO:teuthology.orchestra.run.smithi044.stderr: 48600K .......... .......... .......... .......... .......... 28% 2.72M 17s 2024-03-30T13:13:48.130 INFO:teuthology.orchestra.run.smithi044.stderr: 48650K .......... .......... .......... .......... .......... 28% 50.5M 17s 2024-03-30T13:13:48.130 INFO:teuthology.orchestra.run.smithi044.stderr: 48700K .......... .......... .......... .......... .......... 28% 81.0M 17s 2024-03-30T13:13:48.130 INFO:teuthology.orchestra.run.smithi044.stderr: 48750K .......... .......... .......... .......... .......... 28% 54.6M 17s 2024-03-30T13:13:48.130 INFO:teuthology.orchestra.run.smithi044.stderr: 48800K .......... .......... .......... .......... .......... 28% 76.9M 17s 2024-03-30T13:13:48.131 INFO:teuthology.orchestra.run.smithi044.stderr: 48850K .......... .......... .......... .......... .......... 29% 77.7M 17s 2024-03-30T13:13:48.157 INFO:teuthology.orchestra.run.smithi044.stderr: 48900K .......... .......... .......... .......... .......... 29% 1.81M 17s 2024-03-30T13:13:48.163 INFO:teuthology.orchestra.run.smithi044.stderr: 48950K .......... .......... .......... .......... .......... 29% 8.11M 17s 2024-03-30T13:13:48.167 INFO:teuthology.orchestra.run.smithi044.stderr: 49000K .......... .......... .......... .......... .......... 29% 37.9M 17s 2024-03-30T13:13:48.167 INFO:teuthology.orchestra.run.smithi044.stderr: 49050K .......... .......... .......... .......... .......... 29% 80.6M 17s 2024-03-30T13:13:48.167 INFO:teuthology.orchestra.run.smithi044.stderr: 49100K .......... .......... .......... .......... .......... 29% 73.9M 17s 2024-03-30T13:13:48.167 INFO:teuthology.orchestra.run.smithi044.stderr: 49150K .......... .......... .......... .......... .......... 29% 74.1M 17s 2024-03-30T13:13:48.180 INFO:teuthology.orchestra.run.smithi044.stderr: 49200K .......... .......... .......... .......... .......... 29% 3.61M 17s 2024-03-30T13:13:48.198 INFO:teuthology.orchestra.run.smithi044.stderr: 49250K .......... .......... .......... .......... .......... 29% 2.73M 17s 2024-03-30T13:13:48.198 INFO:teuthology.orchestra.run.smithi044.stderr: 49300K .......... .......... .......... .......... .......... 29% 61.1M 17s 2024-03-30T13:13:48.201 INFO:teuthology.orchestra.run.smithi044.stderr: 49350K .......... .......... .......... .......... .......... 29% 53.1M 17s 2024-03-30T13:13:48.202 INFO:teuthology.orchestra.run.smithi044.stderr: 49400K .......... .......... .......... .......... .......... 29% 60.2M 17s 2024-03-30T13:13:48.202 INFO:teuthology.orchestra.run.smithi044.stderr: 49450K .......... .......... .......... .......... .......... 29% 77.9M 17s 2024-03-30T13:13:48.202 INFO:teuthology.orchestra.run.smithi044.stderr: 49500K .......... .......... .......... .......... .......... 29% 82.9M 17s 2024-03-30T13:13:48.228 INFO:teuthology.orchestra.run.smithi044.stderr: 49550K .......... .......... .......... .......... .......... 29% 1.83M 17s 2024-03-30T13:13:48.238 INFO:teuthology.orchestra.run.smithi044.stderr: 49600K .......... .......... .......... .......... .......... 29% 8.23M 17s 2024-03-30T13:13:48.238 INFO:teuthology.orchestra.run.smithi044.stderr: 49650K .......... .......... .......... .......... .......... 29% 35.8M 17s 2024-03-30T13:13:48.238 INFO:teuthology.orchestra.run.smithi044.stderr: 49700K .......... .......... .......... .......... .......... 29% 61.2M 17s 2024-03-30T13:13:48.238 INFO:teuthology.orchestra.run.smithi044.stderr: 49750K .......... .......... .......... .......... .......... 29% 83.2M 17s 2024-03-30T13:13:48.238 INFO:teuthology.orchestra.run.smithi044.stderr: 49800K .......... .......... .......... .......... .......... 29% 84.6M 16s 2024-03-30T13:13:48.251 INFO:teuthology.orchestra.run.smithi044.stderr: 49850K .......... .......... .......... .......... .......... 29% 3.58M 16s 2024-03-30T13:13:48.273 INFO:teuthology.orchestra.run.smithi044.stderr: 49900K .......... .......... .......... .......... .......... 29% 2.78M 17s 2024-03-30T13:13:48.273 INFO:teuthology.orchestra.run.smithi044.stderr: 49950K .......... .......... .......... .......... .......... 29% 30.5M 16s 2024-03-30T13:13:48.273 INFO:teuthology.orchestra.run.smithi044.stderr: 50000K .......... .......... .......... .......... .......... 29% 41.4M 16s 2024-03-30T13:13:48.273 INFO:teuthology.orchestra.run.smithi044.stderr: 50050K .......... .......... .......... .......... .......... 29% 81.3M 16s 2024-03-30T13:13:48.273 INFO:teuthology.orchestra.run.smithi044.stderr: 50100K .......... .......... .......... .......... .......... 29% 85.9M 16s 2024-03-30T13:13:48.273 INFO:teuthology.orchestra.run.smithi044.stderr: 50150K .......... .......... .......... .......... .......... 29% 60.1M 16s 2024-03-30T13:13:48.299 INFO:teuthology.orchestra.run.smithi044.stderr: 50200K .......... .......... .......... .......... .......... 29% 1.88M 16s 2024-03-30T13:13:48.305 INFO:teuthology.orchestra.run.smithi044.stderr: 50250K .......... .......... .......... .......... .......... 29% 8.89M 16s 2024-03-30T13:13:48.309 INFO:teuthology.orchestra.run.smithi044.stderr: 50300K .......... .......... .......... .......... .......... 29% 30.7M 16s 2024-03-30T13:13:48.309 INFO:teuthology.orchestra.run.smithi044.stderr: 50350K .......... .......... .......... .......... .......... 29% 57.4M 16s 2024-03-30T13:13:48.309 INFO:teuthology.orchestra.run.smithi044.stderr: 50400K .......... .......... .......... .......... .......... 29% 79.6M 16s 2024-03-30T13:13:48.309 INFO:teuthology.orchestra.run.smithi044.stderr: 50450K .......... .......... .......... .......... .......... 29% 84.9M 16s 2024-03-30T13:13:48.332 INFO:teuthology.orchestra.run.smithi044.stderr: 50500K .......... .......... .......... .......... .......... 29% 3.56M 16s 2024-03-30T13:13:48.339 INFO:teuthology.orchestra.run.smithi044.stderr: 50550K .......... .......... .......... .......... .......... 30% 2.80M 16s 2024-03-30T13:13:48.340 INFO:teuthology.orchestra.run.smithi044.stderr: 50600K .......... .......... .......... .......... .......... 30% 48.5M 16s 2024-03-30T13:13:48.344 INFO:teuthology.orchestra.run.smithi044.stderr: 50650K .......... .......... .......... .......... .......... 30% 43.4M 16s 2024-03-30T13:13:48.344 INFO:teuthology.orchestra.run.smithi044.stderr: 50700K .......... .......... .......... .......... .......... 30% 41.9M 16s 2024-03-30T13:13:48.344 INFO:teuthology.orchestra.run.smithi044.stderr: 50750K .......... .......... .......... .......... .......... 30% 84.2M 16s 2024-03-30T13:13:48.344 INFO:teuthology.orchestra.run.smithi044.stderr: 50800K .......... .......... .......... .......... .......... 30% 81.8M 16s 2024-03-30T13:13:48.371 INFO:teuthology.orchestra.run.smithi044.stderr: 50850K .......... .......... .......... .......... .......... 30% 1.84M 16s 2024-03-30T13:13:48.377 INFO:teuthology.orchestra.run.smithi044.stderr: 50900K .......... .......... .......... .......... .......... 30% 9.64M 16s 2024-03-30T13:13:48.377 INFO:teuthology.orchestra.run.smithi044.stderr: 50950K .......... .......... .......... .......... .......... 30% 37.5M 16s 2024-03-30T13:13:48.380 INFO:teuthology.orchestra.run.smithi044.stderr: 51000K .......... .......... .......... .......... .......... 30% 36.3M 16s 2024-03-30T13:13:48.380 INFO:teuthology.orchestra.run.smithi044.stderr: 51050K .......... .......... .......... .......... .......... 30% 78.9M 16s 2024-03-30T13:13:48.380 INFO:teuthology.orchestra.run.smithi044.stderr: 51100K .......... .......... .......... .......... .......... 30% 85.8M 16s 2024-03-30T13:13:48.393 INFO:teuthology.orchestra.run.smithi044.stderr: 51150K .......... .......... .......... .......... .......... 30% 3.56M 16s 2024-03-30T13:13:48.416 INFO:teuthology.orchestra.run.smithi044.stderr: 51200K .......... .......... .......... .......... .......... 30% 2.81M 16s 2024-03-30T13:13:48.416 INFO:teuthology.orchestra.run.smithi044.stderr: 51250K .......... .......... .......... .......... .......... 30% 38.8M 16s 2024-03-30T13:13:48.416 INFO:teuthology.orchestra.run.smithi044.stderr: 51300K .......... .......... .......... .......... .......... 30% 41.8M 16s 2024-03-30T13:13:48.416 INFO:teuthology.orchestra.run.smithi044.stderr: 51350K .......... .......... .......... .......... .......... 30% 39.5M 16s 2024-03-30T13:13:48.416 INFO:teuthology.orchestra.run.smithi044.stderr: 51400K .......... .......... .......... .......... .......... 30% 79.5M 16s 2024-03-30T13:13:48.416 INFO:teuthology.orchestra.run.smithi044.stderr: 51450K .......... .......... .......... .......... .......... 30% 83.4M 16s 2024-03-30T13:13:48.442 INFO:teuthology.orchestra.run.smithi044.stderr: 51500K .......... .......... .......... .......... .......... 30% 1.88M 16s 2024-03-30T13:13:48.448 INFO:teuthology.orchestra.run.smithi044.stderr: 51550K .......... .......... .......... .......... .......... 30% 9.12M 16s 2024-03-30T13:13:48.448 INFO:teuthology.orchestra.run.smithi044.stderr: 51600K .......... .......... .......... .......... .......... 30% 38.7M 16s 2024-03-30T13:13:48.451 INFO:teuthology.orchestra.run.smithi044.stderr: 51650K .......... .......... .......... .......... .......... 30% 37.2M 16s 2024-03-30T13:13:48.451 INFO:teuthology.orchestra.run.smithi044.stderr: 51700K .......... .......... .......... .......... .......... 30% 58.5M 16s 2024-03-30T13:13:48.451 INFO:teuthology.orchestra.run.smithi044.stderr: 51750K .......... .......... .......... .......... .......... 30% 82.1M 16s 2024-03-30T13:13:48.464 INFO:teuthology.orchestra.run.smithi044.stderr: 51800K .......... .......... .......... .......... .......... 30% 3.59M 16s 2024-03-30T13:13:48.477 INFO:teuthology.orchestra.run.smithi044.stderr: 51850K .......... .......... .......... .......... .......... 30% 3.77M 16s 2024-03-30T13:13:48.482 INFO:teuthology.orchestra.run.smithi044.stderr: 51900K .......... .......... .......... .......... .......... 30% 9.42M 16s 2024-03-30T13:13:48.486 INFO:teuthology.orchestra.run.smithi044.stderr: 51950K .......... .......... .......... .......... .......... 30% 35.7M 16s 2024-03-30T13:13:48.486 INFO:teuthology.orchestra.run.smithi044.stderr: 52000K .......... .......... .......... .......... .......... 30% 40.7M 16s 2024-03-30T13:13:48.487 INFO:teuthology.orchestra.run.smithi044.stderr: 52050K .......... .......... .......... .......... .......... 30% 60.1M 16s 2024-03-30T13:13:48.487 INFO:teuthology.orchestra.run.smithi044.stderr: 52100K .......... .......... .......... .......... .......... 30% 85.6M 16s 2024-03-30T13:13:48.510 INFO:teuthology.orchestra.run.smithi044.stderr: 52150K .......... .......... .......... .......... .......... 30% 2.04M 16s 2024-03-30T13:13:48.517 INFO:teuthology.orchestra.run.smithi044.stderr: 52200K .......... .......... .......... .......... .......... 30% 7.19M 16s 2024-03-30T13:13:48.519 INFO:teuthology.orchestra.run.smithi044.stderr: 52250K .......... .......... .......... .......... .......... 31% 33.6M 16s 2024-03-30T13:13:48.520 INFO:teuthology.orchestra.run.smithi044.stderr: 52300K .......... .......... .......... .......... .......... 31% 38.1M 16s 2024-03-30T13:13:48.523 INFO:teuthology.orchestra.run.smithi044.stderr: 52350K .......... .......... .......... .......... .......... 31% 40.2M 16s 2024-03-30T13:13:48.523 INFO:teuthology.orchestra.run.smithi044.stderr: 52400K .......... .......... .......... .......... .......... 31% 78.3M 16s 2024-03-30T13:13:48.523 INFO:teuthology.orchestra.run.smithi044.stderr: 52450K .......... .......... .......... .......... .......... 31% 83.5M 16s 2024-03-30T13:13:48.548 INFO:teuthology.orchestra.run.smithi044.stderr: 52500K .......... .......... .......... .......... .......... 31% 1.89M 16s 2024-03-30T13:13:48.555 INFO:teuthology.orchestra.run.smithi044.stderr: 52550K .......... .......... .......... .......... .......... 31% 8.97M 16s 2024-03-30T13:13:48.555 INFO:teuthology.orchestra.run.smithi044.stderr: 52600K .......... .......... .......... .......... .......... 31% 34.3M 16s 2024-03-30T13:13:48.558 INFO:teuthology.orchestra.run.smithi044.stderr: 52650K .......... .......... .......... .......... .......... 31% 45.3M 16s 2024-03-30T13:13:48.558 INFO:teuthology.orchestra.run.smithi044.stderr: 52700K .......... .......... .......... .......... .......... 31% 55.1M 16s 2024-03-30T13:13:48.558 INFO:teuthology.orchestra.run.smithi044.stderr: 52750K .......... .......... .......... .......... .......... 31% 84.1M 16s 2024-03-30T13:13:48.571 INFO:teuthology.orchestra.run.smithi044.stderr: 52800K .......... .......... .......... .......... .......... 31% 3.66M 16s 2024-03-30T13:13:48.584 INFO:teuthology.orchestra.run.smithi044.stderr: 52850K .......... .......... .......... .......... .......... 31% 3.70M 16s 2024-03-30T13:13:48.594 INFO:teuthology.orchestra.run.smithi044.stderr: 52900K .......... .......... .......... .......... .......... 31% 8.97M 16s 2024-03-30T13:13:48.594 INFO:teuthology.orchestra.run.smithi044.stderr: 52950K .......... .......... .......... .......... .......... 31% 37.9M 16s 2024-03-30T13:13:48.594 INFO:teuthology.orchestra.run.smithi044.stderr: 53000K .......... .......... .......... .......... .......... 31% 42.4M 16s 2024-03-30T13:13:48.594 INFO:teuthology.orchestra.run.smithi044.stderr: 53050K .......... .......... .......... .......... .......... 31% 66.2M 16s 2024-03-30T13:13:48.594 INFO:teuthology.orchestra.run.smithi044.stderr: 53100K .......... .......... .......... .......... .......... 31% 83.1M 16s 2024-03-30T13:13:48.617 INFO:teuthology.orchestra.run.smithi044.stderr: 53150K .......... .......... .......... .......... .......... 31% 2.05M 16s 2024-03-30T13:13:48.624 INFO:teuthology.orchestra.run.smithi044.stderr: 53200K .......... .......... .......... .......... .......... 31% 7.27M 16s 2024-03-30T13:13:48.626 INFO:teuthology.orchestra.run.smithi044.stderr: 53250K .......... .......... .......... .......... .......... 31% 31.3M 16s 2024-03-30T13:13:48.627 INFO:teuthology.orchestra.run.smithi044.stderr: 53300K .......... .......... .......... .......... .......... 31% 55.1M 16s 2024-03-30T13:13:48.627 INFO:teuthology.orchestra.run.smithi044.stderr: 53350K .......... .......... .......... .......... .......... 31% 51.1M 16s 2024-03-30T13:13:48.629 INFO:teuthology.orchestra.run.smithi044.stderr: 53400K .......... .......... .......... .......... .......... 31% 50.0M 16s 2024-03-30T13:13:48.629 INFO:teuthology.orchestra.run.smithi044.stderr: 53450K .......... .......... .......... .......... .......... 31% 80.9M 16s 2024-03-30T13:13:48.655 INFO:teuthology.orchestra.run.smithi044.stderr: 53500K .......... .......... .......... .......... .......... 31% 1.86M 16s 2024-03-30T13:13:48.663 INFO:teuthology.orchestra.run.smithi044.stderr: 53550K .......... .......... .......... .......... .......... 31% 9.23M 16s 2024-03-30T13:13:48.663 INFO:teuthology.orchestra.run.smithi044.stderr: 53600K .......... .......... .......... .......... .......... 31% 39.6M 16s 2024-03-30T13:13:48.663 INFO:teuthology.orchestra.run.smithi044.stderr: 53650K .......... .......... .......... .......... .......... 31% 39.8M 16s 2024-03-30T13:13:48.665 INFO:teuthology.orchestra.run.smithi044.stderr: 53700K .......... .......... .......... .......... .......... 31% 48.2M 16s 2024-03-30T13:13:48.665 INFO:teuthology.orchestra.run.smithi044.stderr: 53750K .......... .......... .......... .......... .......... 31% 83.7M 16s 2024-03-30T13:13:48.677 INFO:teuthology.orchestra.run.smithi044.stderr: 53800K .......... .......... .......... .......... .......... 31% 3.72M 16s 2024-03-30T13:13:48.691 INFO:teuthology.orchestra.run.smithi044.stderr: 53850K .......... .......... .......... .......... .......... 31% 3.65M 16s 2024-03-30T13:13:48.696 INFO:teuthology.orchestra.run.smithi044.stderr: 53900K .......... .......... .......... .......... .......... 32% 8.75M 16s 2024-03-30T13:13:48.700 INFO:teuthology.orchestra.run.smithi044.stderr: 53950K .......... .......... .......... .......... .......... 32% 43.9M 16s 2024-03-30T13:13:48.700 INFO:teuthology.orchestra.run.smithi044.stderr: 54000K .......... .......... .......... .......... .......... 32% 43.1M 16s 2024-03-30T13:13:48.700 INFO:teuthology.orchestra.run.smithi044.stderr: 54050K .......... .......... .......... .......... .......... 32% 62.4M 16s 2024-03-30T13:13:48.700 INFO:teuthology.orchestra.run.smithi044.stderr: 54100K .......... .......... .......... .......... .......... 32% 71.8M 16s 2024-03-30T13:13:48.724 INFO:teuthology.orchestra.run.smithi044.stderr: 54150K .......... .......... .......... .......... .......... 32% 2.08M 16s 2024-03-30T13:13:48.726 INFO:teuthology.orchestra.run.smithi044.stderr: 54200K .......... .......... .......... .......... .......... 32% 16.4M 16s 2024-03-30T13:13:48.732 INFO:teuthology.orchestra.run.smithi044.stderr: 54250K .......... .......... .......... .......... .......... 32% 8.80M 16s 2024-03-30T13:13:48.735 INFO:teuthology.orchestra.run.smithi044.stderr: 54300K .......... .......... .......... .......... .......... 32% 42.3M 16s 2024-03-30T13:13:48.736 INFO:teuthology.orchestra.run.smithi044.stderr: 54350K .......... .......... .......... .......... .......... 32% 39.4M 16s 2024-03-30T13:13:48.736 INFO:teuthology.orchestra.run.smithi044.stderr: 54400K .......... .......... .......... .......... .......... 32% 64.2M 16s 2024-03-30T13:13:48.748 INFO:teuthology.orchestra.run.smithi044.stderr: 54450K .......... .......... .......... .......... .......... 32% 81.7M 16s 2024-03-30T13:13:48.761 INFO:teuthology.orchestra.run.smithi044.stderr: 54500K .......... .......... .......... .......... .......... 32% 1.91M 16s 2024-03-30T13:13:48.767 INFO:teuthology.orchestra.run.smithi044.stderr: 54550K .......... .......... .......... .......... .......... 32% 8.84M 16s 2024-03-30T13:13:48.768 INFO:teuthology.orchestra.run.smithi044.stderr: 54600K .......... .......... .......... .......... .......... 32% 36.7M 16s 2024-03-30T13:13:48.770 INFO:teuthology.orchestra.run.smithi044.stderr: 54650K .......... .......... .......... .......... .......... 32% 49.5M 16s 2024-03-30T13:13:48.770 INFO:teuthology.orchestra.run.smithi044.stderr: 54700K .......... .......... .......... .......... .......... 32% 40.2M 15s 2024-03-30T13:13:48.772 INFO:teuthology.orchestra.run.smithi044.stderr: 54750K .......... .......... .......... .......... .......... 32% 74.9M 15s 2024-03-30T13:13:48.784 INFO:teuthology.orchestra.run.smithi044.stderr: 54800K .......... .......... .......... .......... .......... 32% 3.74M 15s 2024-03-30T13:13:48.797 INFO:teuthology.orchestra.run.smithi044.stderr: 54850K .......... .......... .......... .......... .......... 32% 3.73M 15s 2024-03-30T13:13:48.803 INFO:teuthology.orchestra.run.smithi044.stderr: 54900K .......... .......... .......... .......... .......... 32% 9.15M 15s 2024-03-30T13:13:48.806 INFO:teuthology.orchestra.run.smithi044.stderr: 54950K .......... .......... .......... .......... .......... 32% 53.9M 15s 2024-03-30T13:13:48.806 INFO:teuthology.orchestra.run.smithi044.stderr: 55000K .......... .......... .......... .......... .......... 32% 53.9M 15s 2024-03-30T13:13:48.806 INFO:teuthology.orchestra.run.smithi044.stderr: 55050K .......... .......... .......... .......... .......... 32% 62.1M 15s 2024-03-30T13:13:48.806 INFO:teuthology.orchestra.run.smithi044.stderr: 55100K .......... .......... .......... .......... .......... 32% 53.0M 15s 2024-03-30T13:13:48.830 INFO:teuthology.orchestra.run.smithi044.stderr: 55150K .......... .......... .......... .......... .......... 32% 2.03M 15s 2024-03-30T13:13:48.837 INFO:teuthology.orchestra.run.smithi044.stderr: 55200K .......... .......... .......... .......... .......... 32% 6.95M 15s 2024-03-30T13:13:48.839 INFO:teuthology.orchestra.run.smithi044.stderr: 55250K .......... .......... .......... .......... .......... 32% 28.0M 15s 2024-03-30T13:13:48.842 INFO:teuthology.orchestra.run.smithi044.stderr: 55300K .......... .......... .......... .......... .......... 32% 45.3M 15s 2024-03-30T13:13:48.842 INFO:teuthology.orchestra.run.smithi044.stderr: 55350K .......... .......... .......... .......... .......... 32% 65.9M 15s 2024-03-30T13:13:48.843 INFO:teuthology.orchestra.run.smithi044.stderr: 55400K .......... .......... .......... .......... .......... 32% 41.1M 15s 2024-03-30T13:13:48.855 INFO:teuthology.orchestra.run.smithi044.stderr: 55450K .......... .......... .......... .......... .......... 32% 3.75M 15s 2024-03-30T13:13:48.868 INFO:teuthology.orchestra.run.smithi044.stderr: 55500K .......... .......... .......... .......... .......... 32% 3.78M 15s 2024-03-30T13:13:48.872 INFO:teuthology.orchestra.run.smithi044.stderr: 55550K .......... .......... .......... .......... .......... 32% 9.88M 15s 2024-03-30T13:13:48.874 INFO:teuthology.orchestra.run.smithi044.stderr: 55600K .......... .......... .......... .......... .......... 33% 29.8M 15s 2024-03-30T13:13:48.877 INFO:teuthology.orchestra.run.smithi044.stderr: 55650K .......... .......... .......... .......... .......... 33% 60.6M 15s 2024-03-30T13:13:48.877 INFO:teuthology.orchestra.run.smithi044.stderr: 55700K .......... .......... .......... .......... .......... 33% 63.5M 15s 2024-03-30T13:13:48.877 INFO:teuthology.orchestra.run.smithi044.stderr: 55750K .......... .......... .......... .......... .......... 33% 43.2M 15s 2024-03-30T13:13:48.891 INFO:teuthology.orchestra.run.smithi044.stderr: 55800K .......... .......... .......... .......... .......... 33% 3.54M 15s 2024-03-30T13:13:48.904 INFO:teuthology.orchestra.run.smithi044.stderr: 55850K .......... .......... .......... .......... .......... 33% 3.87M 15s 2024-03-30T13:13:48.909 INFO:teuthology.orchestra.run.smithi044.stderr: 55900K .......... .......... .......... .......... .......... 33% 8.45M 15s 2024-03-30T13:13:48.913 INFO:teuthology.orchestra.run.smithi044.stderr: 55950K .......... .......... .......... .......... .......... 33% 38.6M 15s 2024-03-30T13:13:48.913 INFO:teuthology.orchestra.run.smithi044.stderr: 56000K .......... .......... .......... .......... .......... 33% 54.3M 15s 2024-03-30T13:13:48.913 INFO:teuthology.orchestra.run.smithi044.stderr: 56050K .......... .......... .......... .......... .......... 33% 42.2M 15s 2024-03-30T13:13:48.913 INFO:teuthology.orchestra.run.smithi044.stderr: 56100K .......... .......... .......... .......... .......... 33% 81.0M 15s 2024-03-30T13:13:48.926 INFO:teuthology.orchestra.run.smithi044.stderr: 56150K .......... .......... .......... .......... .......... 33% 3.62M 15s 2024-03-30T13:13:48.939 INFO:teuthology.orchestra.run.smithi044.stderr: 56200K .......... .......... .......... .......... .......... 33% 3.85M 15s 2024-03-30T13:13:48.945 INFO:teuthology.orchestra.run.smithi044.stderr: 56250K .......... .......... .......... .......... .......... 33% 8.01M 15s 2024-03-30T13:13:48.947 INFO:teuthology.orchestra.run.smithi044.stderr: 56300K .......... .......... .......... .......... .......... 33% 41.0M 15s 2024-03-30T13:13:48.948 INFO:teuthology.orchestra.run.smithi044.stderr: 56350K .......... .......... .......... .......... .......... 33% 58.0M 15s 2024-03-30T13:13:48.950 INFO:teuthology.orchestra.run.smithi044.stderr: 56400K .......... .......... .......... .......... .......... 33% 42.7M 15s 2024-03-30T13:13:48.950 INFO:teuthology.orchestra.run.smithi044.stderr: 56450K .......... .......... .......... .......... .......... 33% 59.6M 15s 2024-03-30T13:13:48.972 INFO:teuthology.orchestra.run.smithi044.stderr: 56500K .......... .......... .......... .......... .......... 33% 2.14M 15s 2024-03-30T13:13:48.979 INFO:teuthology.orchestra.run.smithi044.stderr: 56550K .......... .......... .......... .......... .......... 33% 6.91M 15s 2024-03-30T13:13:48.980 INFO:teuthology.orchestra.run.smithi044.stderr: 56600K .......... .......... .......... .......... .......... 33% 38.7M 15s 2024-03-30T13:13:48.981 INFO:teuthology.orchestra.run.smithi044.stderr: 56650K .......... .......... .......... .......... .......... 33% 50.4M 15s 2024-03-30T13:13:48.982 INFO:teuthology.orchestra.run.smithi044.stderr: 56700K .......... .......... .......... .......... .......... 33% 72.9M 15s 2024-03-30T13:13:48.983 INFO:teuthology.orchestra.run.smithi044.stderr: 56750K .......... .......... .......... .......... .......... 33% 53.2M 15s 2024-03-30T13:13:48.998 INFO:teuthology.orchestra.run.smithi044.stderr: 56800K .......... .......... .......... .......... .......... 33% 3.45M 15s 2024-03-30T13:13:49.007 INFO:teuthology.orchestra.run.smithi044.stderr: 56850K .......... .......... .......... .......... .......... 33% 4.60M 15s 2024-03-30T13:13:49.016 INFO:teuthology.orchestra.run.smithi044.stderr: 56900K .......... .......... .......... .......... .......... 33% 6.36M 15s 2024-03-30T13:13:49.017 INFO:teuthology.orchestra.run.smithi044.stderr: 56950K .......... .......... .......... .......... .......... 33% 50.2M 15s 2024-03-30T13:13:49.018 INFO:teuthology.orchestra.run.smithi044.stderr: 57000K .......... .......... .......... .......... .......... 33% 70.6M 15s 2024-03-30T13:13:49.018 INFO:teuthology.orchestra.run.smithi044.stderr: 57050K .......... .......... .......... .......... .......... 33% 67.4M 15s 2024-03-30T13:13:49.020 INFO:teuthology.orchestra.run.smithi044.stderr: 57100K .......... .......... .......... .......... .......... 33% 51.4M 15s 2024-03-30T13:13:49.034 INFO:teuthology.orchestra.run.smithi044.stderr: 57150K .......... .......... .......... .......... .......... 33% 3.42M 15s 2024-03-30T13:13:49.044 INFO:teuthology.orchestra.run.smithi044.stderr: 57200K .......... .......... .......... .......... .......... 33% 4.78M 15s 2024-03-30T13:13:49.056 INFO:teuthology.orchestra.run.smithi044.stderr: 57250K .......... .......... .......... .......... .......... 33% 6.23M 15s 2024-03-30T13:13:49.056 INFO:teuthology.orchestra.run.smithi044.stderr: 57300K .......... .......... .......... .......... .......... 34% 55.6M 15s 2024-03-30T13:13:49.056 INFO:teuthology.orchestra.run.smithi044.stderr: 57350K .......... .......... .......... .......... .......... 34% 61.4M 15s 2024-03-30T13:13:49.056 INFO:teuthology.orchestra.run.smithi044.stderr: 57400K .......... .......... .......... .......... .......... 34% 72.1M 15s 2024-03-30T13:13:49.056 INFO:teuthology.orchestra.run.smithi044.stderr: 57450K .......... .......... .......... .......... .......... 34% 38.1M 15s 2024-03-30T13:13:49.069 INFO:teuthology.orchestra.run.smithi044.stderr: 57500K .......... .......... .......... .......... .......... 34% 3.46M 15s 2024-03-30T13:13:49.080 INFO:teuthology.orchestra.run.smithi044.stderr: 57550K .......... .......... .......... .......... .......... 34% 4.40M 15s 2024-03-30T13:13:49.088 INFO:teuthology.orchestra.run.smithi044.stderr: 57600K .......... .......... .......... .......... .......... 34% 7.11M 15s 2024-03-30T13:13:49.088 INFO:teuthology.orchestra.run.smithi044.stderr: 57650K .......... .......... .......... .......... .......... 34% 65.8M 15s 2024-03-30T13:13:49.089 INFO:teuthology.orchestra.run.smithi044.stderr: 57700K .......... .......... .......... .......... .......... 34% 70.2M 15s 2024-03-30T13:13:49.089 INFO:teuthology.orchestra.run.smithi044.stderr: 57750K .......... .......... .......... .......... .......... 34% 50.4M 15s 2024-03-30T13:13:49.091 INFO:teuthology.orchestra.run.smithi044.stderr: 57800K .......... .......... .......... .......... .......... 34% 31.3M 15s 2024-03-30T13:13:49.105 INFO:teuthology.orchestra.run.smithi044.stderr: 57850K .......... .......... .......... .......... .......... 34% 3.56M 15s 2024-03-30T13:13:49.117 INFO:teuthology.orchestra.run.smithi044.stderr: 57900K .......... .......... .......... .......... .......... 34% 4.14M 15s 2024-03-30T13:13:49.129 INFO:teuthology.orchestra.run.smithi044.stderr: 57950K .......... .......... .......... .......... .......... 34% 5.12M 15s 2024-03-30T13:13:49.129 INFO:teuthology.orchestra.run.smithi044.stderr: 58000K .......... .......... .......... .......... .......... 34% 47.8M 15s 2024-03-30T13:13:49.129 INFO:teuthology.orchestra.run.smithi044.stderr: 58050K .......... .......... .......... .......... .......... 34% 75.6M 15s 2024-03-30T13:13:49.129 INFO:teuthology.orchestra.run.smithi044.stderr: 58100K .......... .......... .......... .......... .......... 34% 74.1M 15s 2024-03-30T13:13:49.129 INFO:teuthology.orchestra.run.smithi044.stderr: 58150K .......... .......... .......... .......... .......... 34% 74.8M 15s 2024-03-30T13:13:49.141 INFO:teuthology.orchestra.run.smithi044.stderr: 58200K .......... .......... .......... .......... .......... 34% 4.00M 15s 2024-03-30T13:13:49.152 INFO:teuthology.orchestra.run.smithi044.stderr: 58250K .......... .......... .......... .......... .......... 34% 4.25M 15s 2024-03-30T13:13:49.166 INFO:teuthology.orchestra.run.smithi044.stderr: 58300K .......... .......... .......... .......... .......... 34% 4.88M 15s 2024-03-30T13:13:49.167 INFO:teuthology.orchestra.run.smithi044.stderr: 58350K .......... .......... .......... .......... .......... 34% 68.4M 15s 2024-03-30T13:13:49.167 INFO:teuthology.orchestra.run.smithi044.stderr: 58400K .......... .......... .......... .......... .......... 34% 58.7M 15s 2024-03-30T13:13:49.167 INFO:teuthology.orchestra.run.smithi044.stderr: 58450K .......... .......... .......... .......... .......... 34% 79.5M 15s 2024-03-30T13:13:49.167 INFO:teuthology.orchestra.run.smithi044.stderr: 58500K .......... .......... .......... .......... .......... 34% 84.1M 15s 2024-03-30T13:13:49.177 INFO:teuthology.orchestra.run.smithi044.stderr: 58550K .......... .......... .......... .......... .......... 34% 4.15M 15s 2024-03-30T13:13:49.189 INFO:teuthology.orchestra.run.smithi044.stderr: 58600K .......... .......... .......... .......... .......... 34% 4.08M 15s 2024-03-30T13:13:49.200 INFO:teuthology.orchestra.run.smithi044.stderr: 58650K .......... .......... .......... .......... .......... 34% 5.29M 15s 2024-03-30T13:13:49.200 INFO:teuthology.orchestra.run.smithi044.stderr: 58700K .......... .......... .......... .......... .......... 34% 51.8M 15s 2024-03-30T13:13:49.200 INFO:teuthology.orchestra.run.smithi044.stderr: 58750K .......... .......... .......... .......... .......... 34% 67.7M 15s 2024-03-30T13:13:49.202 INFO:teuthology.orchestra.run.smithi044.stderr: 58800K .......... .......... .......... .......... .......... 34% 56.5M 15s 2024-03-30T13:13:49.202 INFO:teuthology.orchestra.run.smithi044.stderr: 58850K .......... .......... .......... .......... .......... 34% 71.2M 15s 2024-03-30T13:13:49.241 INFO:teuthology.orchestra.run.smithi044.stderr: 58900K .......... .......... .......... .......... .......... 34% 1.24M 15s 2024-03-30T13:13:49.260 INFO:teuthology.orchestra.run.smithi044.stderr: 58950K .......... .......... .......... .......... .......... 35% 4.58M 15s 2024-03-30T13:13:49.273 INFO:teuthology.orchestra.run.smithi044.stderr: 59000K .......... .......... .......... .......... .......... 35% 2.42M 15s 2024-03-30T13:13:49.276 INFO:teuthology.orchestra.run.smithi044.stderr: 59050K .......... .......... .......... .......... .......... 35% 36.0M 15s 2024-03-30T13:13:49.276 INFO:teuthology.orchestra.run.smithi044.stderr: 59100K .......... .......... .......... .......... .......... 35% 52.7M 15s 2024-03-30T13:13:49.276 INFO:teuthology.orchestra.run.smithi044.stderr: 59150K .......... .......... .......... .......... .......... 35% 38.7M 15s 2024-03-30T13:13:49.288 INFO:teuthology.orchestra.run.smithi044.stderr: 59200K .......... .......... .......... .......... .......... 35% 4.07M 15s 2024-03-30T13:13:49.317 INFO:teuthology.orchestra.run.smithi044.stderr: 59250K .......... .......... .......... .......... .......... 35% 1.67M 15s 2024-03-30T13:13:49.325 INFO:teuthology.orchestra.run.smithi044.stderr: 59300K .......... .......... .......... .......... .......... 35% 5.83M 15s 2024-03-30T13:13:49.334 INFO:teuthology.orchestra.run.smithi044.stderr: 59350K .......... .......... .......... .......... .......... 35% 8.00M 15s 2024-03-30T13:13:49.335 INFO:teuthology.orchestra.run.smithi044.stderr: 59400K .......... .......... .......... .......... .......... 35% 57.6M 15s 2024-03-30T13:13:49.335 INFO:teuthology.orchestra.run.smithi044.stderr: 59450K .......... .......... .......... .......... .......... 35% 60.4M 15s 2024-03-30T13:13:49.335 INFO:teuthology.orchestra.run.smithi044.stderr: 59500K .......... .......... .......... .......... .......... 35% 73.5M 15s 2024-03-30T13:13:49.335 INFO:teuthology.orchestra.run.smithi044.stderr: 59550K .......... .......... .......... .......... .......... 35% 78.3M 15s 2024-03-30T13:13:49.352 INFO:teuthology.orchestra.run.smithi044.stderr: 59600K .......... .......... .......... .......... .......... 35% 2.70M 15s 2024-03-30T13:13:49.360 INFO:teuthology.orchestra.run.smithi044.stderr: 59650K .......... .......... .......... .......... .......... 35% 5.86M 15s 2024-03-30T13:13:49.370 INFO:teuthology.orchestra.run.smithi044.stderr: 59700K .......... .......... .......... .......... .......... 35% 7.91M 15s 2024-03-30T13:13:49.370 INFO:teuthology.orchestra.run.smithi044.stderr: 59750K .......... .......... .......... .......... .......... 35% 56.4M 15s 2024-03-30T13:13:49.370 INFO:teuthology.orchestra.run.smithi044.stderr: 59800K .......... .......... .......... .......... .......... 35% 66.9M 15s 2024-03-30T13:13:49.371 INFO:teuthology.orchestra.run.smithi044.stderr: 59850K .......... .......... .......... .......... .......... 35% 74.8M 15s 2024-03-30T13:13:49.371 INFO:teuthology.orchestra.run.smithi044.stderr: 59900K .......... .......... .......... .......... .......... 35% 74.3M 15s 2024-03-30T13:13:49.388 INFO:teuthology.orchestra.run.smithi044.stderr: 59950K .......... .......... .......... .......... .......... 35% 2.69M 15s 2024-03-30T13:13:49.396 INFO:teuthology.orchestra.run.smithi044.stderr: 60000K .......... .......... .......... .......... .......... 35% 5.90M 15s 2024-03-30T13:13:49.403 INFO:teuthology.orchestra.run.smithi044.stderr: 60050K .......... .......... .......... .......... .......... 35% 7.12M 15s 2024-03-30T13:13:49.405 INFO:teuthology.orchestra.run.smithi044.stderr: 60100K .......... .......... .......... .......... .......... 35% 30.8M 15s 2024-03-30T13:13:49.407 INFO:teuthology.orchestra.run.smithi044.stderr: 60150K .......... .......... .......... .......... .......... 35% 34.8M 15s 2024-03-30T13:13:49.408 INFO:teuthology.orchestra.run.smithi044.stderr: 60200K .......... .......... .......... .......... .......... 35% 115M 15s 2024-03-30T13:13:49.408 INFO:teuthology.orchestra.run.smithi044.stderr: 60250K .......... .......... .......... .......... .......... 35% 92.7M 15s 2024-03-30T13:13:49.423 INFO:teuthology.orchestra.run.smithi044.stderr: 60300K .......... .......... .......... .......... .......... 35% 2.96M 15s 2024-03-30T13:13:49.431 INFO:teuthology.orchestra.run.smithi044.stderr: 60350K .......... .......... .......... .......... .......... 35% 5.80M 15s 2024-03-30T13:13:49.439 INFO:teuthology.orchestra.run.smithi044.stderr: 60400K .......... .......... .......... .......... .......... 35% 7.42M 15s 2024-03-30T13:13:49.440 INFO:teuthology.orchestra.run.smithi044.stderr: 60450K .......... .......... .......... .......... .......... 35% 29.8M 15s 2024-03-30T13:13:49.441 INFO:teuthology.orchestra.run.smithi044.stderr: 60500K .......... .......... .......... .......... .......... 35% 38.8M 14s 2024-03-30T13:13:49.444 INFO:teuthology.orchestra.run.smithi044.stderr: 60550K .......... .......... .......... .......... .......... 35% 42.5M 14s 2024-03-30T13:13:49.444 INFO:teuthology.orchestra.run.smithi044.stderr: 60600K .......... .......... .......... .......... .......... 35% 43.4M 14s 2024-03-30T13:13:49.459 INFO:teuthology.orchestra.run.smithi044.stderr: 60650K .......... .......... .......... .......... .......... 36% 3.19M 14s 2024-03-30T13:13:49.467 INFO:teuthology.orchestra.run.smithi044.stderr: 60700K .......... .......... .......... .......... .......... 36% 5.85M 14s 2024-03-30T13:13:49.475 INFO:teuthology.orchestra.run.smithi044.stderr: 60750K .......... .......... .......... .......... .......... 36% 7.03M 14s 2024-03-30T13:13:49.476 INFO:teuthology.orchestra.run.smithi044.stderr: 60800K .......... .......... .......... .......... .......... 36% 35.8M 14s 2024-03-30T13:13:49.477 INFO:teuthology.orchestra.run.smithi044.stderr: 60850K .......... .......... .......... .......... .......... 36% 33.3M 14s 2024-03-30T13:13:49.478 INFO:teuthology.orchestra.run.smithi044.stderr: 60900K .......... .......... .......... .......... .......... 36% 42.6M 14s 2024-03-30T13:13:49.479 INFO:teuthology.orchestra.run.smithi044.stderr: 60950K .......... .......... .......... .......... .......... 36% 42.5M 14s 2024-03-30T13:13:49.494 INFO:teuthology.orchestra.run.smithi044.stderr: 61000K .......... .......... .......... .......... .......... 36% 41.4M 14s 2024-03-30T13:13:49.508 INFO:teuthology.orchestra.run.smithi044.stderr: 61050K .......... .......... .......... .......... .......... 36% 1.75M 14s 2024-03-30T13:13:49.510 INFO:teuthology.orchestra.run.smithi044.stderr: 61100K .......... .......... .......... .......... .......... 36% 33.5M 14s 2024-03-30T13:13:49.512 INFO:teuthology.orchestra.run.smithi044.stderr: 61150K .......... .......... .......... .......... .......... 36% 35.2M 14s 2024-03-30T13:13:49.513 INFO:teuthology.orchestra.run.smithi044.stderr: 61200K .......... .......... .......... .......... .......... 36% 33.5M 14s 2024-03-30T13:13:49.514 INFO:teuthology.orchestra.run.smithi044.stderr: 61250K .......... .......... .......... .......... .......... 36% 42.3M 14s 2024-03-30T13:13:49.515 INFO:teuthology.orchestra.run.smithi044.stderr: 61300K .......... .......... .......... .......... .......... 36% 42.1M 14s 2024-03-30T13:13:49.516 INFO:teuthology.orchestra.run.smithi044.stderr: 61350K .......... .......... .......... .......... .......... 36% 41.1M 14s 2024-03-30T13:13:49.544 INFO:teuthology.orchestra.run.smithi044.stderr: 61400K .......... .......... .......... .......... .......... 36% 1.76M 14s 2024-03-30T13:13:49.545 INFO:teuthology.orchestra.run.smithi044.stderr: 61450K .......... .......... .......... .......... .......... 36% 34.8M 14s 2024-03-30T13:13:49.547 INFO:teuthology.orchestra.run.smithi044.stderr: 61500K .......... .......... .......... .......... .......... 36% 31.7M 14s 2024-03-30T13:13:49.548 INFO:teuthology.orchestra.run.smithi044.stderr: 61550K .......... .......... .......... .......... .......... 36% 37.3M 14s 2024-03-30T13:13:49.549 INFO:teuthology.orchestra.run.smithi044.stderr: 61600K .......... .......... .......... .......... .......... 36% 38.2M 14s 2024-03-30T13:13:49.550 INFO:teuthology.orchestra.run.smithi044.stderr: 61650K .......... .......... .......... .......... .......... 36% 42.8M 14s 2024-03-30T13:13:49.552 INFO:teuthology.orchestra.run.smithi044.stderr: 61700K .......... .......... .......... .......... .......... 36% 34.9M 14s 2024-03-30T13:13:49.579 INFO:teuthology.orchestra.run.smithi044.stderr: 61750K .......... .......... .......... .......... .......... 36% 1.77M 14s 2024-03-30T13:13:49.581 INFO:teuthology.orchestra.run.smithi044.stderr: 61800K .......... .......... .......... .......... .......... 36% 29.8M 14s 2024-03-30T13:13:49.582 INFO:teuthology.orchestra.run.smithi044.stderr: 61850K .......... .......... .......... .......... .......... 36% 37.8M 14s 2024-03-30T13:13:49.583 INFO:teuthology.orchestra.run.smithi044.stderr: 61900K .......... .......... .......... .......... .......... 36% 36.5M 14s 2024-03-30T13:13:49.585 INFO:teuthology.orchestra.run.smithi044.stderr: 61950K .......... .......... .......... .......... .......... 36% 37.9M 14s 2024-03-30T13:13:49.587 INFO:teuthology.orchestra.run.smithi044.stderr: 62000K .......... .......... .......... .......... .......... 36% 36.7M 14s 2024-03-30T13:13:49.587 INFO:teuthology.orchestra.run.smithi044.stderr: 62050K .......... .......... .......... .......... .......... 36% 41.6M 14s 2024-03-30T13:13:49.616 INFO:teuthology.orchestra.run.smithi044.stderr: 62100K .......... .......... .......... .......... .......... 36% 1.78M 14s 2024-03-30T13:13:49.616 INFO:teuthology.orchestra.run.smithi044.stderr: 62150K .......... .......... .......... .......... .......... 36% 33.7M 14s 2024-03-30T13:13:49.618 INFO:teuthology.orchestra.run.smithi044.stderr: 62200K .......... .......... .......... .......... .......... 36% 32.2M 14s 2024-03-30T13:13:49.624 INFO:teuthology.orchestra.run.smithi044.stderr: 62250K .......... .......... .......... .......... .......... 36% 37.8M 14s 2024-03-30T13:13:49.624 INFO:teuthology.orchestra.run.smithi044.stderr: 62300K .......... .......... .......... .......... .......... 36% 37.5M 14s 2024-03-30T13:13:49.625 INFO:teuthology.orchestra.run.smithi044.stderr: 62350K .......... .......... .......... .......... .......... 37% 42.4M 14s 2024-03-30T13:13:49.625 INFO:teuthology.orchestra.run.smithi044.stderr: 62400K .......... .......... .......... .......... .......... 37% 35.4M 14s 2024-03-30T13:13:49.646 INFO:teuthology.orchestra.run.smithi044.stderr: 62450K .......... .......... .......... .......... .......... 37% 2.10M 14s 2024-03-30T13:13:49.654 INFO:teuthology.orchestra.run.smithi044.stderr: 62500K .......... .......... .......... .......... .......... 37% 5.94M 14s 2024-03-30T13:13:49.656 INFO:teuthology.orchestra.run.smithi044.stderr: 62550K .......... .......... .......... .......... .......... 37% 30.1M 14s 2024-03-30T13:13:49.658 INFO:teuthology.orchestra.run.smithi044.stderr: 62600K .......... .......... .......... .......... .......... 37% 22.5M 14s 2024-03-30T13:13:49.659 INFO:teuthology.orchestra.run.smithi044.stderr: 62650K .......... .......... .......... .......... .......... 37% 36.4M 14s 2024-03-30T13:13:49.662 INFO:teuthology.orchestra.run.smithi044.stderr: 62700K .......... .......... .......... .......... .......... 37% 17.7M 14s 2024-03-30T13:13:49.666 INFO:teuthology.orchestra.run.smithi044.stderr: 62750K .......... .......... .......... .......... .......... 37% 24.7M 14s 2024-03-30T13:13:49.681 INFO:teuthology.orchestra.run.smithi044.stderr: 62800K .......... .......... .......... .......... .......... 37% 2.79M 14s 2024-03-30T13:13:49.690 INFO:teuthology.orchestra.run.smithi044.stderr: 62850K .......... .......... .......... .......... .......... 37% 5.96M 14s 2024-03-30T13:13:49.691 INFO:teuthology.orchestra.run.smithi044.stderr: 62900K .......... .......... .......... .......... .......... 37% 32.8M 14s 2024-03-30T13:13:49.694 INFO:teuthology.orchestra.run.smithi044.stderr: 62950K .......... .......... .......... .......... .......... 37% 20.9M 14s 2024-03-30T13:13:49.695 INFO:teuthology.orchestra.run.smithi044.stderr: 63000K .......... .......... .......... .......... .......... 37% 34.0M 14s 2024-03-30T13:13:49.698 INFO:teuthology.orchestra.run.smithi044.stderr: 63050K .......... .......... .......... .......... .......... 37% 18.3M 14s 2024-03-30T13:13:49.699 INFO:teuthology.orchestra.run.smithi044.stderr: 63100K .......... .......... .......... .......... .......... 37% 25.1M 14s 2024-03-30T13:13:49.717 INFO:teuthology.orchestra.run.smithi044.stderr: 63150K .......... .......... .......... .......... .......... 37% 2.79M 14s 2024-03-30T13:13:49.727 INFO:teuthology.orchestra.run.smithi044.stderr: 63200K .......... .......... .......... .......... .......... 37% 5.93M 14s 2024-03-30T13:13:49.728 INFO:teuthology.orchestra.run.smithi044.stderr: 63250K .......... .......... .......... .......... .......... 37% 41.2M 14s 2024-03-30T13:13:49.730 INFO:teuthology.orchestra.run.smithi044.stderr: 63300K .......... .......... .......... .......... .......... 37% 18.4M 14s 2024-03-30T13:13:49.731 INFO:teuthology.orchestra.run.smithi044.stderr: 63350K .......... .......... .......... .......... .......... 37% 49.2M 14s 2024-03-30T13:13:49.733 INFO:teuthology.orchestra.run.smithi044.stderr: 63400K .......... .......... .......... .......... .......... 37% 17.6M 14s 2024-03-30T13:13:49.735 INFO:teuthology.orchestra.run.smithi044.stderr: 63450K .......... .......... .......... .......... .......... 37% 25.0M 14s 2024-03-30T13:13:49.752 INFO:teuthology.orchestra.run.smithi044.stderr: 63500K .......... .......... .......... .......... .......... 37% 2.81M 14s 2024-03-30T13:13:49.760 INFO:teuthology.orchestra.run.smithi044.stderr: 63550K .......... .......... .......... .......... .......... 37% 6.19M 14s 2024-03-30T13:13:49.762 INFO:teuthology.orchestra.run.smithi044.stderr: 63600K .......... .......... .......... .......... .......... 37% 24.7M 14s 2024-03-30T13:13:49.766 INFO:teuthology.orchestra.run.smithi044.stderr: 63650K .......... .......... .......... .......... .......... 37% 19.3M 14s 2024-03-30T13:13:49.766 INFO:teuthology.orchestra.run.smithi044.stderr: 63700K .......... .......... .......... .......... .......... 37% 45.0M 14s 2024-03-30T13:13:49.770 INFO:teuthology.orchestra.run.smithi044.stderr: 63750K .......... .......... .......... .......... .......... 37% 10.7M 14s 2024-03-30T13:13:49.777 INFO:teuthology.orchestra.run.smithi044.stderr: 63800K .......... .......... .......... .......... .......... 37% 7.97M 14s 2024-03-30T13:13:49.788 INFO:teuthology.orchestra.run.smithi044.stderr: 63850K .......... .......... .......... .......... .......... 37% 4.25M 14s 2024-03-30T13:13:49.796 INFO:teuthology.orchestra.run.smithi044.stderr: 63900K .......... .......... .......... .......... .......... 37% 6.27M 14s 2024-03-30T13:13:49.798 INFO:teuthology.orchestra.run.smithi044.stderr: 63950K .......... .......... .......... .......... .......... 37% 25.0M 14s 2024-03-30T13:13:49.799 INFO:teuthology.orchestra.run.smithi044.stderr: 64000K .......... .......... .......... .......... .......... 37% 24.3M 14s 2024-03-30T13:13:49.803 INFO:teuthology.orchestra.run.smithi044.stderr: 64050K .......... .......... .......... .......... .......... 38% 15.3M 14s 2024-03-30T13:13:49.813 INFO:teuthology.orchestra.run.smithi044.stderr: 64100K .......... .......... .......... .......... .......... 38% 4.54M 14s 2024-03-30T13:13:49.816 INFO:teuthology.orchestra.run.smithi044.stderr: 64150K .......... .......... .......... .......... .......... 38% 26.0M 14s 2024-03-30T13:13:49.824 INFO:teuthology.orchestra.run.smithi044.stderr: 64200K .......... .......... .......... .......... .......... 38% 5.69M 14s 2024-03-30T13:13:49.831 INFO:teuthology.orchestra.run.smithi044.stderr: 64250K .......... .......... .......... .......... .......... 38% 6.86M 14s 2024-03-30T13:13:49.833 INFO:teuthology.orchestra.run.smithi044.stderr: 64300K .......... .......... .......... .......... .......... 38% 26.8M 14s 2024-03-30T13:13:49.835 INFO:teuthology.orchestra.run.smithi044.stderr: 64350K .......... .......... .......... .......... .......... 38% 18.8M 14s 2024-03-30T13:13:49.838 INFO:teuthology.orchestra.run.smithi044.stderr: 64400K .......... .......... .......... .......... .......... 38% 19.1M 14s 2024-03-30T13:13:49.849 INFO:teuthology.orchestra.run.smithi044.stderr: 64450K .......... .......... .......... .......... .......... 38% 4.47M 14s 2024-03-30T13:13:49.851 INFO:teuthology.orchestra.run.smithi044.stderr: 64500K .......... .......... .......... .......... .......... 38% 21.2M 14s 2024-03-30T13:13:49.860 INFO:teuthology.orchestra.run.smithi044.stderr: 64550K .......... .......... .......... .......... .......... 38% 8.93M 14s 2024-03-30T13:13:49.867 INFO:teuthology.orchestra.run.smithi044.stderr: 64600K .......... .......... .......... .......... .......... 38% 5.04M 14s 2024-03-30T13:13:49.873 INFO:teuthology.orchestra.run.smithi044.stderr: 64650K .......... .......... .......... .......... .......... 38% 8.23M 14s 2024-03-30T13:13:49.875 INFO:teuthology.orchestra.run.smithi044.stderr: 64700K .......... .......... .......... .......... .......... 38% 17.1M 14s 2024-03-30T13:13:49.876 INFO:teuthology.orchestra.run.smithi044.stderr: 64750K .......... .......... .......... .......... .......... 38% 36.4M 14s 2024-03-30T13:13:49.885 INFO:teuthology.orchestra.run.smithi044.stderr: 64800K .......... .......... .......... .......... .......... 38% 7.04M 14s 2024-03-30T13:13:49.887 INFO:teuthology.orchestra.run.smithi044.stderr: 64850K .......... .......... .......... .......... .......... 38% 12.9M 14s 2024-03-30T13:13:49.900 INFO:teuthology.orchestra.run.smithi044.stderr: 64900K .......... .......... .......... .......... .......... 38% 3.98M 14s 2024-03-30T13:13:49.903 INFO:teuthology.orchestra.run.smithi044.stderr: 64950K .......... .......... .......... .......... .......... 38% 14.2M 14s 2024-03-30T13:13:49.911 INFO:teuthology.orchestra.run.smithi044.stderr: 65000K .......... .......... .......... .......... .......... 38% 6.01M 14s 2024-03-30T13:13:49.915 INFO:teuthology.orchestra.run.smithi044.stderr: 65050K .......... .......... .......... .......... .......... 38% 31.3M 14s 2024-03-30T13:13:49.915 INFO:teuthology.orchestra.run.smithi044.stderr: 65100K .......... .......... .......... .......... .......... 38% 36.7M 14s 2024-03-30T13:13:49.919 INFO:teuthology.orchestra.run.smithi044.stderr: 65150K .......... .......... .......... .......... .......... 38% 9.75M 14s 2024-03-30T13:13:49.924 INFO:teuthology.orchestra.run.smithi044.stderr: 65200K .......... .......... .......... .......... .......... 38% 10.4M 14s 2024-03-30T13:13:49.935 INFO:teuthology.orchestra.run.smithi044.stderr: 65250K .......... .......... .......... .......... .......... 38% 4.31M 14s 2024-03-30T13:13:49.939 INFO:teuthology.orchestra.run.smithi044.stderr: 65300K .......... .......... .......... .......... .......... 38% 13.9M 14s 2024-03-30T13:13:49.947 INFO:teuthology.orchestra.run.smithi044.stderr: 65350K .......... .......... .......... .......... .......... 38% 5.99M 14s 2024-03-30T13:13:49.948 INFO:teuthology.orchestra.run.smithi044.stderr: 65400K .......... .......... .......... .......... .......... 38% 43.6M 14s 2024-03-30T13:13:49.950 INFO:teuthology.orchestra.run.smithi044.stderr: 65450K .......... .......... .......... .......... .......... 38% 41.7M 14s 2024-03-30T13:13:49.955 INFO:teuthology.orchestra.run.smithi044.stderr: 65500K .......... .......... .......... .......... .......... 38% 8.77M 14s 2024-03-30T13:13:49.961 INFO:teuthology.orchestra.run.smithi044.stderr: 65550K .......... .......... .......... .......... .......... 38% 10.5M 14s 2024-03-30T13:13:49.973 INFO:teuthology.orchestra.run.smithi044.stderr: 65600K .......... .......... .......... .......... .......... 38% 4.26M 14s 2024-03-30T13:13:49.973 INFO:teuthology.orchestra.run.smithi044.stderr: 65650K .......... .......... .......... .......... .......... 38% 25.9M 14s 2024-03-30T13:13:49.987 INFO:teuthology.orchestra.run.smithi044.stderr: 65700K .......... .......... .......... .......... .......... 39% 3.60M 14s 2024-03-30T13:13:49.991 INFO:teuthology.orchestra.run.smithi044.stderr: 65750K .......... .......... .......... .......... .......... 39% 25.1M 14s 2024-03-30T13:13:49.991 INFO:teuthology.orchestra.run.smithi044.stderr: 65800K .......... .......... .......... .......... .......... 39% 31.6M 14s 2024-03-30T13:13:49.997 INFO:teuthology.orchestra.run.smithi044.stderr: 65850K .......... .......... .......... .......... .......... 39% 6.60M 14s 2024-03-30T13:13:50.005 INFO:teuthology.orchestra.run.smithi044.stderr: 65900K .......... .......... .......... .......... .......... 39% 6.18M 14s 2024-03-30T13:13:50.020 INFO:teuthology.orchestra.run.smithi044.stderr: 65950K .......... .......... .......... .......... .......... 39% 4.04M 14s 2024-03-30T13:13:50.020 INFO:teuthology.orchestra.run.smithi044.stderr: 66000K .......... .......... .......... .......... .......... 39% 40.5M 14s 2024-03-30T13:13:50.020 INFO:teuthology.orchestra.run.smithi044.stderr: 66050K .......... .......... .......... .......... .......... 39% 46.7M 13s 2024-03-30T13:13:50.024 INFO:teuthology.orchestra.run.smithi044.stderr: 66100K .......... .......... .......... .......... .......... 39% 11.5M 13s 2024-03-30T13:13:50.025 INFO:teuthology.orchestra.run.smithi044.stderr: 66150K .......... .......... .......... .......... .......... 39% 36.0M 13s 2024-03-30T13:13:50.030 INFO:teuthology.orchestra.run.smithi044.stderr: 66200K .......... .......... .......... .......... .......... 39% 9.64M 13s 2024-03-30T13:13:50.040 INFO:teuthology.orchestra.run.smithi044.stderr: 66250K .......... .......... .......... .......... .......... 39% 4.83M 13s 2024-03-30T13:13:50.043 INFO:teuthology.orchestra.run.smithi044.stderr: 66300K .......... .......... .......... .......... .......... 39% 14.5M 13s 2024-03-30T13:13:50.061 INFO:teuthology.orchestra.run.smithi044.stderr: 66350K .......... .......... .......... .......... .......... 39% 3.25M 13s 2024-03-30T13:13:50.061 INFO:teuthology.orchestra.run.smithi044.stderr: 66400K .......... .......... .......... .......... .......... 39% 36.7M 13s 2024-03-30T13:13:50.068 INFO:teuthology.orchestra.run.smithi044.stderr: 66450K .......... .......... .......... .......... .......... 39% 8.04M 13s 2024-03-30T13:13:50.068 INFO:teuthology.orchestra.run.smithi044.stderr: 66500K .......... .......... .......... .......... .......... 39% 43.6M 13s 2024-03-30T13:13:50.069 INFO:teuthology.orchestra.run.smithi044.stderr: 66550K .......... .......... .......... .......... .......... 39% 59.3M 13s 2024-03-30T13:13:50.075 INFO:teuthology.orchestra.run.smithi044.stderr: 66600K .......... .......... .......... .......... .......... 39% 6.36M 13s 2024-03-30T13:13:50.079 INFO:teuthology.orchestra.run.smithi044.stderr: 66650K .......... .......... .......... .......... .......... 39% 14.0M 13s 2024-03-30T13:13:50.095 INFO:teuthology.orchestra.run.smithi044.stderr: 66700K .......... .......... .......... .......... .......... 39% 3.27M 13s 2024-03-30T13:13:50.095 INFO:teuthology.orchestra.run.smithi044.stderr: 66750K .......... .......... .......... .......... .......... 39% 48.1M 13s 2024-03-30T13:13:50.103 INFO:teuthology.orchestra.run.smithi044.stderr: 66800K .......... .......... .......... .......... .......... 39% 7.67M 13s 2024-03-30T13:13:50.103 INFO:teuthology.orchestra.run.smithi044.stderr: 66850K .......... .......... .......... .......... .......... 39% 40.4M 13s 2024-03-30T13:13:50.104 INFO:teuthology.orchestra.run.smithi044.stderr: 66900K .......... .......... .......... .......... .......... 39% 50.1M 13s 2024-03-30T13:13:50.110 INFO:teuthology.orchestra.run.smithi044.stderr: 66950K .......... .......... .......... .......... .......... 39% 7.57M 13s 2024-03-30T13:13:50.114 INFO:teuthology.orchestra.run.smithi044.stderr: 67000K .......... .......... .......... .......... .......... 39% 13.2M 13s 2024-03-30T13:13:50.131 INFO:teuthology.orchestra.run.smithi044.stderr: 67050K .......... .......... .......... .......... .......... 39% 3.15M 13s 2024-03-30T13:13:50.131 INFO:teuthology.orchestra.run.smithi044.stderr: 67100K .......... .......... .......... .......... .......... 39% 34.7M 13s 2024-03-30T13:13:50.135 INFO:teuthology.orchestra.run.smithi044.stderr: 67150K .......... .......... .......... .......... .......... 39% 10.8M 13s 2024-03-30T13:13:50.139 INFO:teuthology.orchestra.run.smithi044.stderr: 67200K .......... .......... .......... .......... .......... 39% 20.6M 13s 2024-03-30T13:13:50.139 INFO:teuthology.orchestra.run.smithi044.stderr: 67250K .......... .......... .......... .......... .......... 39% 49.3M 13s 2024-03-30T13:13:50.141 INFO:teuthology.orchestra.run.smithi044.stderr: 67300K .......... .......... .......... .......... .......... 39% 16.7M 13s 2024-03-30T13:13:50.148 INFO:teuthology.orchestra.run.smithi044.stderr: 67350K .......... .......... .......... .......... .......... 39% 7.02M 13s 2024-03-30T13:13:50.166 INFO:teuthology.orchestra.run.smithi044.stderr: 67400K .......... .......... .......... .......... .......... 40% 3.05M 13s 2024-03-30T13:13:50.166 INFO:teuthology.orchestra.run.smithi044.stderr: 67450K .......... .......... .......... .......... .......... 40% 38.4M 13s 2024-03-30T13:13:50.168 INFO:teuthology.orchestra.run.smithi044.stderr: 67500K .......... .......... .......... .......... .......... 40% 23.6M 13s 2024-03-30T13:13:50.175 INFO:teuthology.orchestra.run.smithi044.stderr: 67550K .......... .......... .......... .......... .......... 40% 9.56M 13s 2024-03-30T13:13:50.175 INFO:teuthology.orchestra.run.smithi044.stderr: 67600K .......... .......... .......... .......... .......... 40% 41.1M 13s 2024-03-30T13:13:50.175 INFO:teuthology.orchestra.run.smithi044.stderr: 67650K .......... .......... .......... .......... .......... 40% 35.1M 13s 2024-03-30T13:13:50.182 INFO:teuthology.orchestra.run.smithi044.stderr: 67700K .......... .......... .......... .......... .......... 40% 7.06M 13s 2024-03-30T13:13:50.186 INFO:teuthology.orchestra.run.smithi044.stderr: 67750K .......... .......... .......... .......... .......... 40% 13.7M 13s 2024-03-30T13:13:50.201 INFO:teuthology.orchestra.run.smithi044.stderr: 67800K .......... .......... .......... .......... .......... 40% 3.35M 13s 2024-03-30T13:13:50.202 INFO:teuthology.orchestra.run.smithi044.stderr: 67850K .......... .......... .......... .......... .......... 40% 28.7M 13s 2024-03-30T13:13:50.210 INFO:teuthology.orchestra.run.smithi044.stderr: 67900K .......... .......... .......... .......... .......... 40% 8.08M 13s 2024-03-30T13:13:50.210 INFO:teuthology.orchestra.run.smithi044.stderr: 67950K .......... .......... .......... .......... .......... 40% 50.7M 13s 2024-03-30T13:13:50.210 INFO:teuthology.orchestra.run.smithi044.stderr: 68000K .......... .......... .......... .......... .......... 40% 40.8M 13s 2024-03-30T13:13:50.217 INFO:teuthology.orchestra.run.smithi044.stderr: 68050K .......... .......... .......... .......... .......... 40% 6.88M 13s 2024-03-30T13:13:50.220 INFO:teuthology.orchestra.run.smithi044.stderr: 68100K .......... .......... .......... .......... .......... 40% 16.7M 13s 2024-03-30T13:13:50.238 INFO:teuthology.orchestra.run.smithi044.stderr: 68150K .......... .......... .......... .......... .......... 40% 3.12M 13s 2024-03-30T13:13:50.238 INFO:teuthology.orchestra.run.smithi044.stderr: 68200K .......... .......... .......... .......... .......... 40% 47.9M 13s 2024-03-30T13:13:50.243 INFO:teuthology.orchestra.run.smithi044.stderr: 68250K .......... .......... .......... .......... .......... 40% 10.0M 13s 2024-03-30T13:13:50.245 INFO:teuthology.orchestra.run.smithi044.stderr: 68300K .......... .......... .......... .......... .......... 40% 20.4M 13s 2024-03-30T13:13:50.247 INFO:teuthology.orchestra.run.smithi044.stderr: 68350K .......... .......... .......... .......... .......... 40% 25.0M 13s 2024-03-30T13:13:50.252 INFO:teuthology.orchestra.run.smithi044.stderr: 68400K .......... .......... .......... .......... .......... 40% 8.01M 13s 2024-03-30T13:13:50.256 INFO:teuthology.orchestra.run.smithi044.stderr: 68450K .......... .......... .......... .......... .......... 40% 15.0M 13s 2024-03-30T13:13:50.273 INFO:teuthology.orchestra.run.smithi044.stderr: 68500K .......... .......... .......... .......... .......... 40% 3.00M 13s 2024-03-30T13:13:50.273 INFO:teuthology.orchestra.run.smithi044.stderr: 68550K .......... .......... .......... .......... .......... 40% 62.2M 13s 2024-03-30T13:13:50.274 INFO:teuthology.orchestra.run.smithi044.stderr: 68600K .......... .......... .......... .......... .......... 40% 24.1M 13s 2024-03-30T13:13:50.281 INFO:teuthology.orchestra.run.smithi044.stderr: 68650K .......... .......... .......... .......... .......... 40% 8.86M 13s 2024-03-30T13:13:50.282 INFO:teuthology.orchestra.run.smithi044.stderr: 68700K .......... .......... .......... .......... .......... 40% 23.5M 13s 2024-03-30T13:13:50.285 INFO:teuthology.orchestra.run.smithi044.stderr: 68750K .......... .......... .......... .......... .......... 40% 20.7M 13s 2024-03-30T13:13:50.290 INFO:teuthology.orchestra.run.smithi044.stderr: 68800K .......... .......... .......... .......... .......... 40% 9.60M 13s 2024-03-30T13:13:50.292 INFO:teuthology.orchestra.run.smithi044.stderr: 68850K .......... .......... .......... .......... .......... 40% 17.0M 13s 2024-03-30T13:13:50.307 INFO:teuthology.orchestra.run.smithi044.stderr: 68900K .......... .......... .......... .......... .......... 40% 3.19M 13s 2024-03-30T13:13:50.310 INFO:teuthology.orchestra.run.smithi044.stderr: 68950K .......... .......... .......... .......... .......... 40% 24.3M 13s 2024-03-30T13:13:50.315 INFO:teuthology.orchestra.run.smithi044.stderr: 69000K .......... .......... .......... .......... .......... 40% 9.24M 13s 2024-03-30T13:13:50.317 INFO:teuthology.orchestra.run.smithi044.stderr: 69050K .......... .......... .......... .......... .......... 40% 32.4M 13s 2024-03-30T13:13:50.321 INFO:teuthology.orchestra.run.smithi044.stderr: 69100K .......... .......... .......... .......... .......... 41% 13.7M 13s 2024-03-30T13:13:50.325 INFO:teuthology.orchestra.run.smithi044.stderr: 69150K .......... .......... .......... .......... .......... 41% 10.2M 13s 2024-03-30T13:13:50.328 INFO:teuthology.orchestra.run.smithi044.stderr: 69200K .......... .......... .......... .......... .......... 41% 17.5M 13s 2024-03-30T13:13:50.344 INFO:teuthology.orchestra.run.smithi044.stderr: 69250K .......... .......... .......... .......... .......... 41% 3.19M 13s 2024-03-30T13:13:50.345 INFO:teuthology.orchestra.run.smithi044.stderr: 69300K .......... .......... .......... .......... .......... 41% 23.9M 13s 2024-03-30T13:13:50.351 INFO:teuthology.orchestra.run.smithi044.stderr: 69350K .......... .......... .......... .......... .......... 41% 8.89M 13s 2024-03-30T13:13:50.353 INFO:teuthology.orchestra.run.smithi044.stderr: 69400K .......... .......... .......... .......... .......... 41% 31.5M 13s 2024-03-30T13:13:50.354 INFO:teuthology.orchestra.run.smithi044.stderr: 69450K .......... .......... .......... .......... .......... 41% 19.7M 13s 2024-03-30T13:13:50.361 INFO:teuthology.orchestra.run.smithi044.stderr: 69500K .......... .......... .......... .......... .......... 41% 8.52M 13s 2024-03-30T13:13:50.362 INFO:teuthology.orchestra.run.smithi044.stderr: 69550K .......... .......... .......... .......... .......... 41% 23.3M 13s 2024-03-30T13:13:50.379 INFO:teuthology.orchestra.run.smithi044.stderr: 69600K .......... .......... .......... .......... .......... 41% 3.03M 13s 2024-03-30T13:13:50.380 INFO:teuthology.orchestra.run.smithi044.stderr: 69650K .......... .......... .......... .......... .......... 41% 36.2M 13s 2024-03-30T13:13:50.384 INFO:teuthology.orchestra.run.smithi044.stderr: 69700K .......... .......... .......... .......... .......... 41% 13.0M 13s 2024-03-30T13:13:50.388 INFO:teuthology.orchestra.run.smithi044.stderr: 69750K .......... .......... .......... .......... .......... 41% 12.0M 13s 2024-03-30T13:13:50.390 INFO:teuthology.orchestra.run.smithi044.stderr: 69800K .......... .......... .......... .......... .......... 41% 21.6M 13s 2024-03-30T13:13:50.392 INFO:teuthology.orchestra.run.smithi044.stderr: 69850K .......... .......... .......... .......... .......... 41% 20.3M 13s 2024-03-30T13:13:50.397 INFO:teuthology.orchestra.run.smithi044.stderr: 69900K .......... .......... .......... .......... .......... 41% 10.5M 13s 2024-03-30T13:13:50.415 INFO:teuthology.orchestra.run.smithi044.stderr: 69950K .......... .......... .......... .......... .......... 41% 2.87M 13s 2024-03-30T13:13:50.416 INFO:teuthology.orchestra.run.smithi044.stderr: 70000K .......... .......... .......... .......... .......... 41% 36.1M 13s 2024-03-30T13:13:50.417 INFO:teuthology.orchestra.run.smithi044.stderr: 70050K .......... .......... .......... .......... .......... 41% 24.9M 13s 2024-03-30T13:13:50.422 INFO:teuthology.orchestra.run.smithi044.stderr: 70100K .......... .......... .......... .......... .......... 41% 9.51M 13s 2024-03-30T13:13:50.424 INFO:teuthology.orchestra.run.smithi044.stderr: 70150K .......... .......... .......... .......... .......... 41% 26.2M 13s 2024-03-30T13:13:50.428 INFO:teuthology.orchestra.run.smithi044.stderr: 70200K .......... .......... .......... .......... .......... 41% 13.3M 13s 2024-03-30T13:13:50.432 INFO:teuthology.orchestra.run.smithi044.stderr: 70250K .......... .......... .......... .......... .......... 41% 11.6M 13s 2024-03-30T13:13:50.435 INFO:teuthology.orchestra.run.smithi044.stderr: 70300K .......... .......... .......... .......... .......... 41% 17.2M 13s 2024-03-30T13:13:50.451 INFO:teuthology.orchestra.run.smithi044.stderr: 70350K .......... .......... .......... .......... .......... 41% 3.08M 13s 2024-03-30T13:13:50.453 INFO:teuthology.orchestra.run.smithi044.stderr: 70400K .......... .......... .......... .......... .......... 41% 36.6M 13s 2024-03-30T13:13:50.458 INFO:teuthology.orchestra.run.smithi044.stderr: 70450K .......... .......... .......... .......... .......... 41% 9.15M 13s 2024-03-30T13:13:50.460 INFO:teuthology.orchestra.run.smithi044.stderr: 70500K .......... .......... .......... .......... .......... 41% 22.7M 13s 2024-03-30T13:13:50.461 INFO:teuthology.orchestra.run.smithi044.stderr: 70550K .......... .......... .......... .......... .......... 41% 30.2M 13s 2024-03-30T13:13:50.467 INFO:teuthology.orchestra.run.smithi044.stderr: 70600K .......... .......... .......... .......... .......... 41% 8.23M 13s 2024-03-30T13:13:50.470 INFO:teuthology.orchestra.run.smithi044.stderr: 70650K .......... .......... .......... .......... .......... 41% 19.5M 13s 2024-03-30T13:13:50.486 INFO:teuthology.orchestra.run.smithi044.stderr: 70700K .......... .......... .......... .......... .......... 41% 3.01M 13s 2024-03-30T13:13:50.487 INFO:teuthology.orchestra.run.smithi044.stderr: 70750K .......... .......... .......... .......... .......... 42% 30.4M 13s 2024-03-30T13:13:50.490 INFO:teuthology.orchestra.run.smithi044.stderr: 70800K .......... .......... .......... .......... .......... 42% 18.3M 13s 2024-03-30T13:13:50.495 INFO:teuthology.orchestra.run.smithi044.stderr: 70850K .......... .......... .......... .......... .......... 42% 10.5M 13s 2024-03-30T13:13:50.496 INFO:teuthology.orchestra.run.smithi044.stderr: 70900K .......... .......... .......... .......... .......... 42% 34.5M 13s 2024-03-30T13:13:50.503 INFO:teuthology.orchestra.run.smithi044.stderr: 70950K .......... .......... .......... .......... .......... 42% 8.40M 13s 2024-03-30T13:13:50.505 INFO:teuthology.orchestra.run.smithi044.stderr: 71000K .......... .......... .......... .......... .......... 42% 19.4M 13s 2024-03-30T13:13:50.523 INFO:teuthology.orchestra.run.smithi044.stderr: 71050K .......... .......... .......... .......... .......... 42% 2.90M 13s 2024-03-30T13:13:50.525 INFO:teuthology.orchestra.run.smithi044.stderr: 71100K .......... .......... .......... .......... .......... 42% 27.3M 13s 2024-03-30T13:13:50.525 INFO:teuthology.orchestra.run.smithi044.stderr: 71150K .......... .......... .......... .......... .......... 42% 38.6M 13s 2024-03-30T13:13:50.531 INFO:teuthology.orchestra.run.smithi044.stderr: 71200K .......... .......... .......... .......... .......... 42% 9.13M 13s 2024-03-30T13:13:50.531 INFO:teuthology.orchestra.run.smithi044.stderr: 71250K .......... .......... .......... .......... .......... 42% 36.4M 13s 2024-03-30T13:13:50.535 INFO:teuthology.orchestra.run.smithi044.stderr: 71300K .......... .......... .......... .......... .......... 42% 14.3M 13s 2024-03-30T13:13:50.541 INFO:teuthology.orchestra.run.smithi044.stderr: 71350K .......... .......... .......... .......... .......... 42% 9.73M 13s 2024-03-30T13:13:50.558 INFO:teuthology.orchestra.run.smithi044.stderr: 71400K .......... .......... .......... .......... .......... 42% 18.6M 13s 2024-03-30T13:13:50.559 INFO:teuthology.orchestra.run.smithi044.stderr: 71450K .......... .......... .......... .......... .......... 42% 2.94M 13s 2024-03-30T13:13:50.561 INFO:teuthology.orchestra.run.smithi044.stderr: 71500K .......... .......... .......... .......... .......... 42% 34.8M 13s 2024-03-30T13:13:50.565 INFO:teuthology.orchestra.run.smithi044.stderr: 71550K .......... .......... .......... .......... .......... 42% 10.2M 13s 2024-03-30T13:13:50.567 INFO:teuthology.orchestra.run.smithi044.stderr: 71600K .......... .......... .......... .......... .......... 42% 30.9M 13s 2024-03-30T13:13:50.568 INFO:teuthology.orchestra.run.smithi044.stderr: 71650K .......... .......... .......... .......... .......... 42% 28.3M 13s 2024-03-30T13:13:50.574 INFO:teuthology.orchestra.run.smithi044.stderr: 71700K .......... .......... .......... .......... .......... 42% 8.73M 12s 2024-03-30T13:13:50.577 INFO:teuthology.orchestra.run.smithi044.stderr: 71750K .......... .......... .......... .......... .......... 42% 16.2M 12s 2024-03-30T13:13:50.594 INFO:teuthology.orchestra.run.smithi044.stderr: 71800K .......... .......... .......... .......... .......... 42% 2.81M 12s 2024-03-30T13:13:50.597 INFO:teuthology.orchestra.run.smithi044.stderr: 71850K .......... .......... .......... .......... .......... 42% 15.0M 12s 2024-03-30T13:13:50.599 INFO:teuthology.orchestra.run.smithi044.stderr: 71900K .......... .......... .......... .......... .......... 42% 32.6M 12s 2024-03-30T13:13:50.606 INFO:teuthology.orchestra.run.smithi044.stderr: 71950K .......... .......... .......... .......... .......... 42% 6.78M 12s 2024-03-30T13:13:50.608 INFO:teuthology.orchestra.run.smithi044.stderr: 72000K .......... .......... .......... .......... .......... 42% 29.0M 12s 2024-03-30T13:13:50.614 INFO:teuthology.orchestra.run.smithi044.stderr: 72050K .......... .......... .......... .......... .......... 42% 8.75M 12s 2024-03-30T13:13:50.616 INFO:teuthology.orchestra.run.smithi044.stderr: 72100K .......... .......... .......... .......... .......... 42% 21.7M 12s 2024-03-30T13:13:50.634 INFO:teuthology.orchestra.run.smithi044.stderr: 72150K .......... .......... .......... .......... .......... 42% 2.71M 12s 2024-03-30T13:13:50.636 INFO:teuthology.orchestra.run.smithi044.stderr: 72200K .......... .......... .......... .......... .......... 42% 19.2M 12s 2024-03-30T13:13:50.639 INFO:teuthology.orchestra.run.smithi044.stderr: 72250K .......... .......... .......... .......... .......... 42% 21.4M 12s 2024-03-30T13:13:50.643 INFO:teuthology.orchestra.run.smithi044.stderr: 72300K .......... .......... .......... .......... .......... 42% 11.6M 12s 2024-03-30T13:13:50.644 INFO:teuthology.orchestra.run.smithi044.stderr: 72350K .......... .......... .......... .......... .......... 42% 30.8M 12s 2024-03-30T13:13:50.646 INFO:teuthology.orchestra.run.smithi044.stderr: 72400K .......... .......... .......... .......... .......... 42% 31.7M 12s 2024-03-30T13:13:50.650 INFO:teuthology.orchestra.run.smithi044.stderr: 72450K .......... .......... .......... .......... .......... 43% 12.0M 12s 2024-03-30T13:13:50.653 INFO:teuthology.orchestra.run.smithi044.stderr: 72500K .......... .......... .......... .......... .......... 43% 16.3M 12s 2024-03-30T13:13:50.672 INFO:teuthology.orchestra.run.smithi044.stderr: 72550K .......... .......... .......... .......... .......... 43% 2.62M 12s 2024-03-30T13:13:50.674 INFO:teuthology.orchestra.run.smithi044.stderr: 72600K .......... .......... .......... .......... .......... 43% 24.7M 12s 2024-03-30T13:13:50.675 INFO:teuthology.orchestra.run.smithi044.stderr: 72650K .......... .......... .......... .......... .......... 43% 42.7M 12s 2024-03-30T13:13:50.680 INFO:teuthology.orchestra.run.smithi044.stderr: 72700K .......... .......... .......... .......... .......... 43% 10.5M 12s 2024-03-30T13:13:50.681 INFO:teuthology.orchestra.run.smithi044.stderr: 72750K .......... .......... .......... .......... .......... 43% 39.7M 12s 2024-03-30T13:13:50.685 INFO:teuthology.orchestra.run.smithi044.stderr: 72800K .......... .......... .......... .......... .......... 43% 11.3M 12s 2024-03-30T13:13:50.690 INFO:teuthology.orchestra.run.smithi044.stderr: 72850K .......... .......... .......... .......... .......... 43% 13.8M 12s 2024-03-30T13:13:50.705 INFO:teuthology.orchestra.run.smithi044.stderr: 72900K .......... .......... .......... .......... .......... 43% 2.85M 12s 2024-03-30T13:13:50.708 INFO:teuthology.orchestra.run.smithi044.stderr: 72950K .......... .......... .......... .......... .......... 43% 23.6M 12s 2024-03-30T13:13:50.709 INFO:teuthology.orchestra.run.smithi044.stderr: 73000K .......... .......... .......... .......... .......... 43% 25.0M 12s 2024-03-30T13:13:50.714 INFO:teuthology.orchestra.run.smithi044.stderr: 73050K .......... .......... .......... .......... .......... 43% 10.7M 12s 2024-03-30T13:13:50.716 INFO:teuthology.orchestra.run.smithi044.stderr: 73100K .......... .......... .......... .......... .......... 43% 32.3M 12s 2024-03-30T13:13:50.717 INFO:teuthology.orchestra.run.smithi044.stderr: 73150K .......... .......... .......... .......... .......... 43% 31.3M 12s 2024-03-30T13:13:50.722 INFO:teuthology.orchestra.run.smithi044.stderr: 73200K .......... .......... .......... .......... .......... 43% 9.31M 12s 2024-03-30T13:13:50.725 INFO:teuthology.orchestra.run.smithi044.stderr: 73250K .......... .......... .......... .......... .......... 43% 22.4M 12s 2024-03-30T13:13:50.748 INFO:teuthology.orchestra.run.smithi044.stderr: 73300K .......... .......... .......... .......... .......... 43% 2.14M 12s 2024-03-30T13:13:50.752 INFO:teuthology.orchestra.run.smithi044.stderr: 73350K .......... .......... .......... .......... .......... 43% 14.3M 12s 2024-03-30T13:13:50.754 INFO:teuthology.orchestra.run.smithi044.stderr: 73400K .......... .......... .......... .......... .......... 43% 14.9M 12s 2024-03-30T13:13:50.763 INFO:teuthology.orchestra.run.smithi044.stderr: 73450K .......... .......... .......... .......... .......... 43% 5.46M 12s 2024-03-30T13:13:50.767 INFO:teuthology.orchestra.run.smithi044.stderr: 73500K .......... .......... .......... .......... .......... 43% 15.3M 12s 2024-03-30T13:13:50.774 INFO:teuthology.orchestra.run.smithi044.stderr: 73550K .......... .......... .......... .......... .......... 43% 6.53M 12s 2024-03-30T13:13:50.780 INFO:teuthology.orchestra.run.smithi044.stderr: 73600K .......... .......... .......... .......... .......... 43% 8.65M 12s 2024-03-30T13:13:50.803 INFO:teuthology.orchestra.run.smithi044.stderr: 73650K .......... .......... .......... .......... .......... 43% 2.06M 12s 2024-03-30T13:13:50.805 INFO:teuthology.orchestra.run.smithi044.stderr: 73700K .......... .......... .......... .......... .......... 43% 27.7M 12s 2024-03-30T13:13:50.808 INFO:teuthology.orchestra.run.smithi044.stderr: 73750K .......... .......... .......... .......... .......... 43% 17.1M 12s 2024-03-30T13:13:50.813 INFO:teuthology.orchestra.run.smithi044.stderr: 73800K .......... .......... .......... .......... .......... 43% 11.1M 12s 2024-03-30T13:13:50.814 INFO:teuthology.orchestra.run.smithi044.stderr: 73850K .......... .......... .......... .......... .......... 43% 29.7M 12s 2024-03-30T13:13:50.816 INFO:teuthology.orchestra.run.smithi044.stderr: 73900K .......... .......... .......... .......... .......... 43% 23.7M 12s 2024-03-30T13:13:50.821 INFO:teuthology.orchestra.run.smithi044.stderr: 73950K .......... .......... .......... .......... .......... 43% 9.57M 12s 2024-03-30T13:13:50.823 INFO:teuthology.orchestra.run.smithi044.stderr: 74000K .......... .......... .......... .......... .......... 43% 22.5M 12s 2024-03-30T13:13:50.840 INFO:teuthology.orchestra.run.smithi044.stderr: 74050K .......... .......... .......... .......... .......... 43% 2.86M 12s 2024-03-30T13:13:50.842 INFO:teuthology.orchestra.run.smithi044.stderr: 74100K .......... .......... .......... .......... .......... 43% 22.3M 12s 2024-03-30T13:13:50.845 INFO:teuthology.orchestra.run.smithi044.stderr: 74150K .......... .......... .......... .......... .......... 44% 21.0M 12s 2024-03-30T13:13:50.848 INFO:teuthology.orchestra.run.smithi044.stderr: 74200K .......... .......... .......... .......... .......... 44% 13.8M 12s 2024-03-30T13:13:50.851 INFO:teuthology.orchestra.run.smithi044.stderr: 74250K .......... .......... .......... .......... .......... 44% 20.8M 12s 2024-03-30T13:13:50.855 INFO:teuthology.orchestra.run.smithi044.stderr: 74300K .......... .......... .......... .......... .......... 44% 10.1M 12s 2024-03-30T13:13:50.859 INFO:teuthology.orchestra.run.smithi044.stderr: 74350K .......... .......... .......... .......... .......... 44% 17.3M 12s 2024-03-30T13:13:50.876 INFO:teuthology.orchestra.run.smithi044.stderr: 74400K .......... .......... .......... .......... .......... 44% 3.01M 12s 2024-03-30T13:13:50.876 INFO:teuthology.orchestra.run.smithi044.stderr: 74450K .......... .......... .......... .......... .......... 44% 31.3M 12s 2024-03-30T13:13:50.879 INFO:teuthology.orchestra.run.smithi044.stderr: 74500K .......... .......... .......... .......... .......... 44% 18.5M 12s 2024-03-30T13:13:50.883 INFO:teuthology.orchestra.run.smithi044.stderr: 74550K .......... .......... .......... .......... .......... 44% 10.6M 12s 2024-03-30T13:13:50.885 INFO:teuthology.orchestra.run.smithi044.stderr: 74600K .......... .......... .......... .......... .......... 44% 35.9M 12s 2024-03-30T13:13:50.887 INFO:teuthology.orchestra.run.smithi044.stderr: 74650K .......... .......... .......... .......... .......... 44% 19.0M 12s 2024-03-30T13:13:50.892 INFO:teuthology.orchestra.run.smithi044.stderr: 74700K .......... .......... .......... .......... .......... 44% 9.87M 12s 2024-03-30T13:13:50.894 INFO:teuthology.orchestra.run.smithi044.stderr: 74750K .......... .......... .......... .......... .......... 44% 25.5M 12s 2024-03-30T13:13:50.912 INFO:teuthology.orchestra.run.smithi044.stderr: 74800K .......... .......... .......... .......... .......... 44% 2.82M 12s 2024-03-30T13:13:50.914 INFO:teuthology.orchestra.run.smithi044.stderr: 74850K .......... .......... .......... .......... .......... 44% 22.4M 12s 2024-03-30T13:13:50.916 INFO:teuthology.orchestra.run.smithi044.stderr: 74900K .......... .......... .......... .......... .......... 44% 18.9M 12s 2024-03-30T13:13:50.919 INFO:teuthology.orchestra.run.smithi044.stderr: 74950K .......... .......... .......... .......... .......... 44% 14.4M 12s 2024-03-30T13:13:50.922 INFO:teuthology.orchestra.run.smithi044.stderr: 75000K .......... .......... .......... .......... .......... 44% 22.6M 12s 2024-03-30T13:13:50.926 INFO:teuthology.orchestra.run.smithi044.stderr: 75050K .......... .......... .......... .......... .......... 44% 10.0M 12s 2024-03-30T13:13:50.930 INFO:teuthology.orchestra.run.smithi044.stderr: 75100K .......... .......... .......... .......... .......... 44% 17.9M 12s 2024-03-30T13:13:50.946 INFO:teuthology.orchestra.run.smithi044.stderr: 75150K .......... .......... .......... .......... .......... 44% 2.97M 12s 2024-03-30T13:13:50.947 INFO:teuthology.orchestra.run.smithi044.stderr: 75200K .......... .......... .......... .......... .......... 44% 34.7M 12s 2024-03-30T13:13:50.950 INFO:teuthology.orchestra.run.smithi044.stderr: 75250K .......... .......... .......... .......... .......... 44% 17.0M 12s 2024-03-30T13:13:50.954 INFO:teuthology.orchestra.run.smithi044.stderr: 75300K .......... .......... .......... .......... .......... 44% 11.9M 12s 2024-03-30T13:13:50.956 INFO:teuthology.orchestra.run.smithi044.stderr: 75350K .......... .......... .......... .......... .......... 44% 32.1M 12s 2024-03-30T13:13:50.958 INFO:teuthology.orchestra.run.smithi044.stderr: 75400K .......... .......... .......... .......... .......... 44% 16.8M 12s 2024-03-30T13:13:50.963 INFO:teuthology.orchestra.run.smithi044.stderr: 75450K .......... .......... .......... .......... .......... 44% 10.4M 12s 2024-03-30T13:13:50.965 INFO:teuthology.orchestra.run.smithi044.stderr: 75500K .......... .......... .......... .......... .......... 44% 24.9M 12s 2024-03-30T13:13:50.983 INFO:teuthology.orchestra.run.smithi044.stderr: 75550K .......... .......... .......... .......... .......... 44% 2.84M 12s 2024-03-30T13:13:50.984 INFO:teuthology.orchestra.run.smithi044.stderr: 75600K .......... .......... .......... .......... .......... 44% 23.7M 12s 2024-03-30T13:13:50.987 INFO:teuthology.orchestra.run.smithi044.stderr: 75650K .......... .......... .......... .......... .......... 44% 16.4M 12s 2024-03-30T13:13:50.991 INFO:teuthology.orchestra.run.smithi044.stderr: 75700K .......... .......... .......... .......... .......... 44% 15.4M 12s 2024-03-30T13:13:50.993 INFO:teuthology.orchestra.run.smithi044.stderr: 75750K .......... .......... .......... .......... .......... 44% 23.2M 12s 2024-03-30T13:13:50.998 INFO:teuthology.orchestra.run.smithi044.stderr: 75800K .......... .......... .......... .......... .......... 44% 9.62M 12s 2024-03-30T13:13:51.001 INFO:teuthology.orchestra.run.smithi044.stderr: 75850K .......... .......... .......... .......... .......... 45% 18.0M 12s 2024-03-30T13:13:51.017 INFO:teuthology.orchestra.run.smithi044.stderr: 75900K .......... .......... .......... .......... .......... 45% 3.01M 12s 2024-03-30T13:13:51.018 INFO:teuthology.orchestra.run.smithi044.stderr: 75950K .......... .......... .......... .......... .......... 45% 31.6M 12s 2024-03-30T13:13:51.021 INFO:teuthology.orchestra.run.smithi044.stderr: 76000K .......... .......... .......... .......... .......... 45% 17.2M 12s 2024-03-30T13:13:51.025 INFO:teuthology.orchestra.run.smithi044.stderr: 76050K .......... .......... .......... .......... .......... 45% 12.5M 12s 2024-03-30T13:13:51.026 INFO:teuthology.orchestra.run.smithi044.stderr: 76100K .......... .......... .......... .......... .......... 45% 36.3M 12s 2024-03-30T13:13:51.029 INFO:teuthology.orchestra.run.smithi044.stderr: 76150K .......... .......... .......... .......... .......... 45% 16.0M 12s 2024-03-30T13:13:51.034 INFO:teuthology.orchestra.run.smithi044.stderr: 76200K .......... .......... .......... .......... .......... 45% 9.58M 12s 2024-03-30T13:13:51.036 INFO:teuthology.orchestra.run.smithi044.stderr: 76250K .......... .......... .......... .......... .......... 45% 28.2M 12s 2024-03-30T13:13:51.054 INFO:teuthology.orchestra.run.smithi044.stderr: 76300K .......... .......... .......... .......... .......... 45% 2.80M 12s 2024-03-30T13:13:51.057 INFO:teuthology.orchestra.run.smithi044.stderr: 76350K .......... .......... .......... .......... .......... 45% 27.3M 12s 2024-03-30T13:13:51.059 INFO:teuthology.orchestra.run.smithi044.stderr: 76400K .......... .......... .......... .......... .......... 45% 16.6M 12s 2024-03-30T13:13:51.062 INFO:teuthology.orchestra.run.smithi044.stderr: 76450K .......... .......... .......... .......... .......... 45% 15.0M 12s 2024-03-30T13:13:51.064 INFO:teuthology.orchestra.run.smithi044.stderr: 76500K .......... .......... .......... .......... .......... 45% 22.5M 12s 2024-03-30T13:13:51.069 INFO:teuthology.orchestra.run.smithi044.stderr: 76550K .......... .......... .......... .......... .......... 45% 9.39M 12s 2024-03-30T13:13:51.072 INFO:teuthology.orchestra.run.smithi044.stderr: 76600K .......... .......... .......... .......... .......... 45% 20.2M 12s 2024-03-30T13:13:51.088 INFO:teuthology.orchestra.run.smithi044.stderr: 76650K .......... .......... .......... .......... .......... 45% 2.96M 12s 2024-03-30T13:13:51.091 INFO:teuthology.orchestra.run.smithi044.stderr: 76700K .......... .......... .......... .......... .......... 45% 29.6M 12s 2024-03-30T13:13:51.094 INFO:teuthology.orchestra.run.smithi044.stderr: 76750K .......... .......... .......... .......... .......... 45% 20.1M 12s 2024-03-30T13:13:51.097 INFO:teuthology.orchestra.run.smithi044.stderr: 76800K .......... .......... .......... .......... .......... 45% 11.7M 12s 2024-03-30T13:13:51.099 INFO:teuthology.orchestra.run.smithi044.stderr: 76850K .......... .......... .......... .......... .......... 45% 19.3M 12s 2024-03-30T13:13:51.102 INFO:teuthology.orchestra.run.smithi044.stderr: 76900K .......... .......... .......... .......... .......... 45% 17.1M 12s 2024-03-30T13:13:51.107 INFO:teuthology.orchestra.run.smithi044.stderr: 76950K .......... .......... .......... .......... .......... 45% 10.1M 12s 2024-03-30T13:13:51.121 INFO:teuthology.orchestra.run.smithi044.stderr: 77000K .......... .......... .......... .......... .......... 45% 48.5M 12s 2024-03-30T13:13:51.128 INFO:teuthology.orchestra.run.smithi044.stderr: 77050K .......... .......... .......... .......... .......... 45% 2.55M 12s 2024-03-30T13:13:51.129 INFO:teuthology.orchestra.run.smithi044.stderr: 77100K .......... .......... .......... .......... .......... 45% 57.2M 12s 2024-03-30T13:13:51.130 INFO:teuthology.orchestra.run.smithi044.stderr: 77150K .......... .......... .......... .......... .......... 45% 25.0M 12s 2024-03-30T13:13:51.132 INFO:teuthology.orchestra.run.smithi044.stderr: 77200K .......... .......... .......... .......... .......... 45% 15.1M 12s 2024-03-30T13:13:51.136 INFO:teuthology.orchestra.run.smithi044.stderr: 77250K .......... .......... .......... .......... .......... 45% 20.6M 12s 2024-03-30T13:13:51.140 INFO:teuthology.orchestra.run.smithi044.stderr: 77300K .......... .......... .......... .......... .......... 45% 9.52M 12s 2024-03-30T13:13:51.143 INFO:teuthology.orchestra.run.smithi044.stderr: 77350K .......... .......... .......... .......... .......... 45% 19.5M 12s 2024-03-30T13:13:51.162 INFO:teuthology.orchestra.run.smithi044.stderr: 77400K .......... .......... .......... .......... .......... 45% 2.57M 12s 2024-03-30T13:13:51.164 INFO:teuthology.orchestra.run.smithi044.stderr: 77450K .......... .......... .......... .......... .......... 45% 30.9M 12s 2024-03-30T13:13:51.164 INFO:teuthology.orchestra.run.smithi044.stderr: 77500K .......... .......... .......... .......... .......... 46% 39.2M 12s 2024-03-30T13:13:51.168 INFO:teuthology.orchestra.run.smithi044.stderr: 77550K .......... .......... .......... .......... .......... 46% 18.9M 12s 2024-03-30T13:13:51.170 INFO:teuthology.orchestra.run.smithi044.stderr: 77600K .......... .......... .......... .......... .......... 46% 17.6M 12s 2024-03-30T13:13:51.173 INFO:teuthology.orchestra.run.smithi044.stderr: 77650K .......... .......... .......... .......... .......... 46% 16.9M 12s 2024-03-30T13:13:51.178 INFO:teuthology.orchestra.run.smithi044.stderr: 77700K .......... .......... .......... .......... .......... 46% 10.8M 12s 2024-03-30T13:13:51.192 INFO:teuthology.orchestra.run.smithi044.stderr: 77750K .......... .......... .......... .......... .......... 46% 3.35M 12s 2024-03-30T13:13:51.198 INFO:teuthology.orchestra.run.smithi044.stderr: 77800K .......... .......... .......... .......... .......... 46% 8.32M 12s 2024-03-30T13:13:51.200 INFO:teuthology.orchestra.run.smithi044.stderr: 77850K .......... .......... .......... .......... .......... 46% 37.4M 12s 2024-03-30T13:13:51.201 INFO:teuthology.orchestra.run.smithi044.stderr: 77900K .......... .......... .......... .......... .......... 46% 33.6M 11s 2024-03-30T13:13:51.203 INFO:teuthology.orchestra.run.smithi044.stderr: 77950K .......... .......... .......... .......... .......... 46% 18.5M 11s 2024-03-30T13:13:51.206 INFO:teuthology.orchestra.run.smithi044.stderr: 78000K .......... .......... .......... .......... .......... 46% 19.2M 11s 2024-03-30T13:13:51.212 INFO:teuthology.orchestra.run.smithi044.stderr: 78050K .......... .......... .......... .......... .......... 46% 9.56M 11s 2024-03-30T13:13:51.213 INFO:teuthology.orchestra.run.smithi044.stderr: 78100K .......... .......... .......... .......... .......... 46% 18.2M 11s 2024-03-30T13:13:51.228 INFO:teuthology.orchestra.run.smithi044.stderr: 78150K .......... .......... .......... .......... .......... 46% 3.44M 11s 2024-03-30T13:13:51.234 INFO:teuthology.orchestra.run.smithi044.stderr: 78200K .......... .......... .......... .......... .......... 46% 8.68M 11s 2024-03-30T13:13:51.234 INFO:teuthology.orchestra.run.smithi044.stderr: 78250K .......... .......... .......... .......... .......... 46% 50.9M 11s 2024-03-30T13:13:51.236 INFO:teuthology.orchestra.run.smithi044.stderr: 78300K .......... .......... .......... .......... .......... 46% 21.4M 11s 2024-03-30T13:13:51.239 INFO:teuthology.orchestra.run.smithi044.stderr: 78350K .......... .......... .......... .......... .......... 46% 21.2M 11s 2024-03-30T13:13:51.242 INFO:teuthology.orchestra.run.smithi044.stderr: 78400K .......... .......... .......... .......... .......... 46% 18.1M 11s 2024-03-30T13:13:51.247 INFO:teuthology.orchestra.run.smithi044.stderr: 78450K .......... .......... .......... .......... .......... 46% 9.54M 11s 2024-03-30T13:13:51.250 INFO:teuthology.orchestra.run.smithi044.stderr: 78500K .......... .......... .......... .......... .......... 46% 17.0M 11s 2024-03-30T13:13:51.269 INFO:teuthology.orchestra.run.smithi044.stderr: 78550K .......... .......... .......... .......... .......... 46% 2.62M 11s 2024-03-30T13:13:51.270 INFO:teuthology.orchestra.run.smithi044.stderr: 78600K .......... .......... .......... .......... .......... 46% 54.6M 11s 2024-03-30T13:13:51.270 INFO:teuthology.orchestra.run.smithi044.stderr: 78650K .......... .......... .......... .......... .......... 46% 64.0M 11s 2024-03-30T13:13:51.274 INFO:teuthology.orchestra.run.smithi044.stderr: 78700K .......... .......... .......... .......... .......... 46% 12.3M 11s 2024-03-30T13:13:51.275 INFO:teuthology.orchestra.run.smithi044.stderr: 78750K .......... .......... .......... .......... .......... 46% 44.1M 11s 2024-03-30T13:13:51.278 INFO:teuthology.orchestra.run.smithi044.stderr: 78800K .......... .......... .......... .......... .......... 46% 16.2M 11s 2024-03-30T13:13:51.283 INFO:teuthology.orchestra.run.smithi044.stderr: 78850K .......... .......... .......... .......... .......... 46% 9.92M 11s 2024-03-30T13:13:51.285 INFO:teuthology.orchestra.run.smithi044.stderr: 78900K .......... .......... .......... .......... .......... 46% 20.1M 11s 2024-03-30T13:13:51.304 INFO:teuthology.orchestra.run.smithi044.stderr: 78950K .......... .......... .......... .......... .......... 46% 2.59M 11s 2024-03-30T13:13:51.306 INFO:teuthology.orchestra.run.smithi044.stderr: 79000K .......... .......... .......... .......... .......... 46% 61.6M 11s 2024-03-30T13:13:51.306 INFO:teuthology.orchestra.run.smithi044.stderr: 79050K .......... .......... .......... .......... .......... 46% 34.9M 11s 2024-03-30T13:13:51.310 INFO:teuthology.orchestra.run.smithi044.stderr: 79100K .......... .......... .......... .......... .......... 46% 15.3M 11s 2024-03-30T13:13:51.312 INFO:teuthology.orchestra.run.smithi044.stderr: 79150K .......... .......... .......... .......... .......... 46% 17.9M 11s 2024-03-30T13:13:51.318 INFO:teuthology.orchestra.run.smithi044.stderr: 79200K .......... .......... .......... .......... .......... 47% 9.40M 11s 2024-03-30T13:13:51.320 INFO:teuthology.orchestra.run.smithi044.stderr: 79250K .......... .......... .......... .......... .......... 47% 19.4M 11s 2024-03-30T13:13:51.334 INFO:teuthology.orchestra.run.smithi044.stderr: 79300K .......... .......... .......... .......... .......... 47% 3.44M 11s 2024-03-30T13:13:51.340 INFO:teuthology.orchestra.run.smithi044.stderr: 79350K .......... .......... .......... .......... .......... 47% 8.51M 11s 2024-03-30T13:13:51.341 INFO:teuthology.orchestra.run.smithi044.stderr: 79400K .......... .......... .......... .......... .......... 47% 65.2M 11s 2024-03-30T13:13:51.342 INFO:teuthology.orchestra.run.smithi044.stderr: 79450K .......... .......... .......... .......... .......... 47% 22.8M 11s 2024-03-30T13:13:51.345 INFO:teuthology.orchestra.run.smithi044.stderr: 79500K .......... .......... .......... .......... .......... 47% 19.7M 11s 2024-03-30T13:13:51.348 INFO:teuthology.orchestra.run.smithi044.stderr: 79550K .......... .......... .......... .......... .......... 47% 18.2M 11s 2024-03-30T13:13:51.353 INFO:teuthology.orchestra.run.smithi044.stderr: 79600K .......... .......... .......... .......... .......... 47% 9.30M 11s 2024-03-30T13:13:51.357 INFO:teuthology.orchestra.run.smithi044.stderr: 79650K .......... .......... .......... .......... .......... 47% 14.8M 11s 2024-03-30T13:13:51.375 INFO:teuthology.orchestra.run.smithi044.stderr: 79700K .......... .......... .......... .......... .......... 47% 2.65M 11s 2024-03-30T13:13:51.377 INFO:teuthology.orchestra.run.smithi044.stderr: 79750K .......... .......... .......... .......... .......... 47% 58.2M 11s 2024-03-30T13:13:51.377 INFO:teuthology.orchestra.run.smithi044.stderr: 79800K .......... .......... .......... .......... .......... 47% 56.0M 11s 2024-03-30T13:13:51.379 INFO:teuthology.orchestra.run.smithi044.stderr: 79850K .......... .......... .......... .......... .......... 47% 24.6M 11s 2024-03-30T13:13:51.381 INFO:teuthology.orchestra.run.smithi044.stderr: 79900K .......... .......... .......... .......... .......... 47% 19.7M 11s 2024-03-30T13:13:51.385 INFO:teuthology.orchestra.run.smithi044.stderr: 79950K .......... .......... .......... .......... .......... 47% 14.4M 11s 2024-03-30T13:13:51.389 INFO:teuthology.orchestra.run.smithi044.stderr: 80000K .......... .......... .......... .......... .......... 47% 10.5M 11s 2024-03-30T13:13:51.393 INFO:teuthology.orchestra.run.smithi044.stderr: 80050K .......... .......... .......... .......... .......... 47% 14.6M 11s 2024-03-30T13:13:51.411 INFO:teuthology.orchestra.run.smithi044.stderr: 80100K .......... .......... .......... .......... .......... 47% 2.66M 11s 2024-03-30T13:13:51.413 INFO:teuthology.orchestra.run.smithi044.stderr: 80150K .......... .......... .......... .......... .......... 47% 33.9M 11s 2024-03-30T13:13:51.414 INFO:teuthology.orchestra.run.smithi044.stderr: 80200K .......... .......... .......... .......... .......... 47% 32.7M 11s 2024-03-30T13:13:51.419 INFO:teuthology.orchestra.run.smithi044.stderr: 80250K .......... .......... .......... .......... .......... 47% 11.9M 11s 2024-03-30T13:13:51.419 INFO:teuthology.orchestra.run.smithi044.stderr: 80300K .......... .......... .......... .......... .......... 47% 51.9M 11s 2024-03-30T13:13:51.424 INFO:teuthology.orchestra.run.smithi044.stderr: 80350K .......... .......... .......... .......... .......... 47% 11.8M 11s 2024-03-30T13:13:51.431 INFO:teuthology.orchestra.run.smithi044.stderr: 80400K .......... .......... .......... .......... .......... 47% 5.98M 11s 2024-03-30T13:13:51.433 INFO:teuthology.orchestra.run.smithi044.stderr: 80450K .......... .......... .......... .......... .......... 47% 24.7M 11s 2024-03-30T13:13:51.460 INFO:teuthology.orchestra.run.smithi044.stderr: 80500K .......... .......... .......... .......... .......... 47% 1.78M 11s 2024-03-30T13:13:51.462 INFO:teuthology.orchestra.run.smithi044.stderr: 80550K .......... .......... .......... .......... .......... 47% 32.8M 11s 2024-03-30T13:13:51.466 INFO:teuthology.orchestra.run.smithi044.stderr: 80600K .......... .......... .......... .......... .......... 47% 26.9M 11s 2024-03-30T13:13:51.470 INFO:teuthology.orchestra.run.smithi044.stderr: 80650K .......... .......... .......... .......... .......... 47% 8.43M 11s 2024-03-30T13:13:51.473 INFO:teuthology.orchestra.run.smithi044.stderr: 80700K .......... .......... .......... .......... .......... 47% 16.4M 11s 2024-03-30T13:13:51.477 INFO:teuthology.orchestra.run.smithi044.stderr: 80750K .......... .......... .......... .......... .......... 47% 9.92M 11s 2024-03-30T13:13:51.484 INFO:teuthology.orchestra.run.smithi044.stderr: 80800K .......... .......... .......... .......... .......... 47% 8.54M 11s 2024-03-30T13:13:51.500 INFO:teuthology.orchestra.run.smithi044.stderr: 80850K .......... .......... .......... .......... .......... 47% 3.50M 11s 2024-03-30T13:13:51.501 INFO:teuthology.orchestra.run.smithi044.stderr: 80900K .......... .......... .......... .......... .......... 48% 50.5M 11s 2024-03-30T13:13:51.501 INFO:teuthology.orchestra.run.smithi044.stderr: 80950K .......... .......... .......... .......... .......... 48% 55.0M 11s 2024-03-30T13:13:51.502 INFO:teuthology.orchestra.run.smithi044.stderr: 81000K .......... .......... .......... .......... .......... 48% 25.3M 11s 2024-03-30T13:13:51.506 INFO:teuthology.orchestra.run.smithi044.stderr: 81050K .......... .......... .......... .......... .......... 48% 11.3M 11s 2024-03-30T13:13:51.508 INFO:teuthology.orchestra.run.smithi044.stderr: 81100K .......... .......... .......... .......... .......... 48% 16.5M 11s 2024-03-30T13:13:51.516 INFO:teuthology.orchestra.run.smithi044.stderr: 81150K .......... .......... .......... .......... .......... 48% 6.12M 11s 2024-03-30T13:13:51.519 INFO:teuthology.orchestra.run.smithi044.stderr: 81200K .......... .......... .......... .......... .......... 48% 16.5M 11s 2024-03-30T13:13:51.537 INFO:teuthology.orchestra.run.smithi044.stderr: 81250K .......... .......... .......... .......... .......... 48% 3.52M 11s 2024-03-30T13:13:51.537 INFO:teuthology.orchestra.run.smithi044.stderr: 81300K .......... .......... .......... .......... .......... 48% 49.9M 11s 2024-03-30T13:13:51.537 INFO:teuthology.orchestra.run.smithi044.stderr: 81350K .......... .......... .......... .......... .......... 48% 61.5M 11s 2024-03-30T13:13:51.537 INFO:teuthology.orchestra.run.smithi044.stderr: 81400K .......... .......... .......... .......... .......... 48% 22.2M 11s 2024-03-30T13:13:51.541 INFO:teuthology.orchestra.run.smithi044.stderr: 81450K .......... .......... .......... .......... .......... 48% 11.8M 11s 2024-03-30T13:13:51.546 INFO:teuthology.orchestra.run.smithi044.stderr: 81500K .......... .......... .......... .......... .......... 48% 11.1M 11s 2024-03-30T13:13:51.554 INFO:teuthology.orchestra.run.smithi044.stderr: 81550K .......... .......... .......... .......... .......... 48% 6.03M 11s 2024-03-30T13:13:51.560 INFO:teuthology.orchestra.run.smithi044.stderr: 81600K .......... .......... .......... .......... .......... 48% 7.87M 11s 2024-03-30T13:13:51.572 INFO:teuthology.orchestra.run.smithi044.stderr: 81650K .......... .......... .......... .......... .......... 48% 3.84M 11s 2024-03-30T13:13:51.577 INFO:teuthology.orchestra.run.smithi044.stderr: 81700K .......... .......... .......... .......... .......... 48% 39.8M 11s 2024-03-30T13:13:51.577 INFO:teuthology.orchestra.run.smithi044.stderr: 81750K .......... .......... .......... .......... .......... 48% 46.1M 11s 2024-03-30T13:13:51.577 INFO:teuthology.orchestra.run.smithi044.stderr: 81800K .......... .......... .......... .......... .......... 48% 41.6M 11s 2024-03-30T13:13:51.577 INFO:teuthology.orchestra.run.smithi044.stderr: 81850K .......... .......... .......... .......... .......... 48% 45.1M 11s 2024-03-30T13:13:51.583 INFO:teuthology.orchestra.run.smithi044.stderr: 81900K .......... .......... .......... .......... .......... 48% 8.63M 11s 2024-03-30T13:13:51.595 INFO:teuthology.orchestra.run.smithi044.stderr: 81950K .......... .......... .......... .......... .......... 48% 3.95M 11s 2024-03-30T13:13:51.621 INFO:teuthology.orchestra.run.smithi044.stderr: 82000K .......... .......... .......... .......... .......... 48% 2.50M 11s 2024-03-30T13:13:51.621 INFO:teuthology.orchestra.run.smithi044.stderr: 82050K .......... .......... .......... .......... .......... 48% 38.5M 11s 2024-03-30T13:13:51.621 INFO:teuthology.orchestra.run.smithi044.stderr: 82100K .......... .......... .......... .......... .......... 48% 44.2M 11s 2024-03-30T13:13:51.621 INFO:teuthology.orchestra.run.smithi044.stderr: 82150K .......... .......... .......... .......... .......... 48% 43.2M 11s 2024-03-30T13:13:51.621 INFO:teuthology.orchestra.run.smithi044.stderr: 82200K .......... .......... .......... .......... .......... 48% 39.4M 11s 2024-03-30T13:13:51.621 INFO:teuthology.orchestra.run.smithi044.stderr: 82250K .......... .......... .......... .......... .......... 48% 47.4M 11s 2024-03-30T13:13:51.622 INFO:teuthology.orchestra.run.smithi044.stderr: 82300K .......... .......... .......... .......... .......... 48% 22.3M 11s 2024-03-30T13:13:51.632 INFO:teuthology.orchestra.run.smithi044.stderr: 82350K .......... .......... .......... .......... .......... 48% 5.20M 11s 2024-03-30T13:13:51.654 INFO:teuthology.orchestra.run.smithi044.stderr: 82400K .......... .......... .......... .......... .......... 48% 2.67M 11s 2024-03-30T13:13:51.654 INFO:teuthology.orchestra.run.smithi044.stderr: 82450K .......... .......... .......... .......... .......... 48% 55.3M 11s 2024-03-30T13:13:51.655 INFO:teuthology.orchestra.run.smithi044.stderr: 82500K .......... .......... .......... .......... .......... 48% 68.4M 11s 2024-03-30T13:13:51.655 INFO:teuthology.orchestra.run.smithi044.stderr: 82550K .......... .......... .......... .......... .......... 49% 74.7M 11s 2024-03-30T13:13:51.655 INFO:teuthology.orchestra.run.smithi044.stderr: 82600K .......... .......... .......... .......... .......... 49% 76.8M 11s 2024-03-30T13:13:51.655 INFO:teuthology.orchestra.run.smithi044.stderr: 82650K .......... .......... .......... .......... .......... 49% 44.9M 11s 2024-03-30T13:13:51.658 INFO:teuthology.orchestra.run.smithi044.stderr: 82700K .......... .......... .......... .......... .......... 49% 11.1M 11s 2024-03-30T13:13:51.669 INFO:teuthology.orchestra.run.smithi044.stderr: 82750K .......... .......... .......... .......... .......... 49% 4.76M 11s 2024-03-30T13:13:51.687 INFO:teuthology.orchestra.run.smithi044.stderr: 82800K .......... .......... .......... .......... .......... 49% 2.79M 11s 2024-03-30T13:13:51.688 INFO:teuthology.orchestra.run.smithi044.stderr: 82850K .......... .......... .......... .......... .......... 49% 38.7M 11s 2024-03-30T13:13:51.689 INFO:teuthology.orchestra.run.smithi044.stderr: 82900K .......... .......... .......... .......... .......... 49% 34.9M 11s 2024-03-30T13:13:51.693 INFO:teuthology.orchestra.run.smithi044.stderr: 82950K .......... .......... .......... .......... .......... 49% 34.9M 11s 2024-03-30T13:13:51.693 INFO:teuthology.orchestra.run.smithi044.stderr: 83000K .......... .......... .......... .......... .......... 49% 62.4M 11s 2024-03-30T13:13:51.693 INFO:teuthology.orchestra.run.smithi044.stderr: 83050K .......... .......... .......... .......... .......... 49% 44.1M 11s 2024-03-30T13:13:51.695 INFO:teuthology.orchestra.run.smithi044.stderr: 83100K .......... .......... .......... .......... .......... 49% 17.0M 11s 2024-03-30T13:13:51.705 INFO:teuthology.orchestra.run.smithi044.stderr: 83150K .......... .......... .......... .......... .......... 49% 5.13M 11s 2024-03-30T13:13:51.723 INFO:teuthology.orchestra.run.smithi044.stderr: 83200K .......... .......... .......... .......... .......... 49% 2.74M 11s 2024-03-30T13:13:51.727 INFO:teuthology.orchestra.run.smithi044.stderr: 83250K .......... .......... .......... .......... .......... 49% 38.1M 11s 2024-03-30T13:13:51.727 INFO:teuthology.orchestra.run.smithi044.stderr: 83300K .......... .......... .......... .......... .......... 49% 70.6M 11s 2024-03-30T13:13:51.727 INFO:teuthology.orchestra.run.smithi044.stderr: 83350K .......... .......... .......... .......... .......... 49% 59.2M 11s 2024-03-30T13:13:51.727 INFO:teuthology.orchestra.run.smithi044.stderr: 83400K .......... .......... .......... .......... .......... 49% 84.7M 11s 2024-03-30T13:13:51.729 INFO:teuthology.orchestra.run.smithi044.stderr: 83450K .......... .......... .......... .......... .......... 49% 19.0M 11s 2024-03-30T13:13:51.735 INFO:teuthology.orchestra.run.smithi044.stderr: 83500K .......... .......... .......... .......... .......... 49% 7.76M 11s 2024-03-30T13:13:51.742 INFO:teuthology.orchestra.run.smithi044.stderr: 83550K .......... .......... .......... .......... .......... 49% 7.15M 11s 2024-03-30T13:13:51.762 INFO:teuthology.orchestra.run.smithi044.stderr: 83600K .......... .......... .......... .......... .......... 49% 2.96M 11s 2024-03-30T13:13:51.762 INFO:teuthology.orchestra.run.smithi044.stderr: 83650K .......... .......... .......... .......... .......... 49% 62.1M 11s 2024-03-30T13:13:51.762 INFO:teuthology.orchestra.run.smithi044.stderr: 83700K .......... .......... .......... .......... .......... 49% 66.8M 11s 2024-03-30T13:13:51.762 INFO:teuthology.orchestra.run.smithi044.stderr: 83750K .......... .......... .......... .......... .......... 49% 70.1M 11s 2024-03-30T13:13:51.762 INFO:teuthology.orchestra.run.smithi044.stderr: 83800K .......... .......... .......... .......... .......... 49% 63.1M 11s 2024-03-30T13:13:51.765 INFO:teuthology.orchestra.run.smithi044.stderr: 83850K .......... .......... .......... .......... .......... 49% 15.0M 11s 2024-03-30T13:13:51.773 INFO:teuthology.orchestra.run.smithi044.stderr: 83900K .......... .......... .......... .......... .......... 49% 5.59M 11s 2024-03-30T13:13:51.798 INFO:teuthology.orchestra.run.smithi044.stderr: 83950K .......... .......... .......... .......... .......... 49% 2.46M 11s 2024-03-30T13:13:51.798 INFO:teuthology.orchestra.run.smithi044.stderr: 84000K .......... .......... .......... .......... .......... 49% 58.1M 11s 2024-03-30T13:13:51.798 INFO:teuthology.orchestra.run.smithi044.stderr: 84050K .......... .......... .......... .......... .......... 49% 54.7M 11s 2024-03-30T13:13:51.798 INFO:teuthology.orchestra.run.smithi044.stderr: 84100K .......... .......... .......... .......... .......... 49% 67.4M 11s 2024-03-30T13:13:51.798 INFO:teuthology.orchestra.run.smithi044.stderr: 84150K .......... .......... .......... .......... .......... 49% 71.2M 11s 2024-03-30T13:13:51.798 INFO:teuthology.orchestra.run.smithi044.stderr: 84200K .......... .......... .......... .......... .......... 49% 72.6M 10s 2024-03-30T13:13:51.800 INFO:teuthology.orchestra.run.smithi044.stderr: 84250K .......... .......... .......... .......... .......... 50% 15.0M 10s 2024-03-30T13:13:51.809 INFO:teuthology.orchestra.run.smithi044.stderr: 84300K .......... .......... .......... .......... .......... 50% 5.16M 10s 2024-03-30T13:13:51.833 INFO:teuthology.orchestra.run.smithi044.stderr: 84350K .......... .......... .......... .......... .......... 50% 2.52M 10s 2024-03-30T13:13:51.833 INFO:teuthology.orchestra.run.smithi044.stderr: 84400K .......... .......... .......... .......... .......... 50% 60.3M 10s 2024-03-30T13:13:51.833 INFO:teuthology.orchestra.run.smithi044.stderr: 84450K .......... .......... .......... .......... .......... 50% 65.0M 10s 2024-03-30T13:13:51.833 INFO:teuthology.orchestra.run.smithi044.stderr: 84500K .......... .......... .......... .......... .......... 50% 63.7M 10s 2024-03-30T13:13:51.834 INFO:teuthology.orchestra.run.smithi044.stderr: 84550K .......... .......... .......... .......... .......... 50% 68.3M 10s 2024-03-30T13:13:51.834 INFO:teuthology.orchestra.run.smithi044.stderr: 84600K .......... .......... .......... .......... .......... 50% 74.4M 10s 2024-03-30T13:13:51.836 INFO:teuthology.orchestra.run.smithi044.stderr: 84650K .......... .......... .......... .......... .......... 50% 15.0M 10s 2024-03-30T13:13:51.846 INFO:teuthology.orchestra.run.smithi044.stderr: 84700K .......... .......... .......... .......... .......... 50% 5.22M 10s 2024-03-30T13:13:51.876 INFO:teuthology.orchestra.run.smithi044.stderr: 84750K .......... .......... .......... .......... .......... 50% 2.52M 10s 2024-03-30T13:13:51.877 INFO:teuthology.orchestra.run.smithi044.stderr: 84800K .......... .......... .......... .......... .......... 50% 75.6M 10s 2024-03-30T13:13:51.877 INFO:teuthology.orchestra.run.smithi044.stderr: 84850K .......... .......... .......... .......... .......... 50% 54.5M 10s 2024-03-30T13:13:51.877 INFO:teuthology.orchestra.run.smithi044.stderr: 84900K .......... .......... .......... .......... .......... 50% 71.3M 10s 2024-03-30T13:13:51.877 INFO:teuthology.orchestra.run.smithi044.stderr: 84950K .......... .......... .......... .......... .......... 50% 66.2M 10s 2024-03-30T13:13:51.877 INFO:teuthology.orchestra.run.smithi044.stderr: 85000K .......... .......... .......... .......... .......... 50% 14.4M 10s 2024-03-30T13:13:51.878 INFO:teuthology.orchestra.run.smithi044.stderr: 85050K .......... .......... .......... .......... .......... 50% 24.1M 10s 2024-03-30T13:13:51.883 INFO:teuthology.orchestra.run.smithi044.stderr: 85100K .......... .......... .......... .......... .......... 50% 4.90M 10s 2024-03-30T13:13:51.913 INFO:teuthology.orchestra.run.smithi044.stderr: 85150K .......... .......... .......... .......... .......... 50% 2.73M 10s 2024-03-30T13:13:51.913 INFO:teuthology.orchestra.run.smithi044.stderr: 85200K .......... .......... .......... .......... .......... 50% 77.1M 10s 2024-03-30T13:13:51.914 INFO:teuthology.orchestra.run.smithi044.stderr: 85250K .......... .......... .......... .......... .......... 50% 65.5M 10s 2024-03-30T13:13:51.914 INFO:teuthology.orchestra.run.smithi044.stderr: 85300K .......... .......... .......... .......... .......... 50% 58.3M 10s 2024-03-30T13:13:51.914 INFO:teuthology.orchestra.run.smithi044.stderr: 85350K .......... .......... .......... .......... .......... 50% 66.9M 10s 2024-03-30T13:13:51.914 INFO:teuthology.orchestra.run.smithi044.stderr: 85400K .......... .......... .......... .......... .......... 50% 16.3M 10s 2024-03-30T13:13:51.914 INFO:teuthology.orchestra.run.smithi044.stderr: 85450K .......... .......... .......... .......... .......... 50% 8.13M 10s 2024-03-30T13:13:51.919 INFO:teuthology.orchestra.run.smithi044.stderr: 85500K .......... .......... .......... .......... .......... 50% 8.58M 10s 2024-03-30T13:13:51.941 INFO:teuthology.orchestra.run.smithi044.stderr: 85550K .......... .......... .......... .......... .......... 50% 2.63M 10s 2024-03-30T13:13:51.941 INFO:teuthology.orchestra.run.smithi044.stderr: 85600K .......... .......... .......... .......... .......... 50% 39.8M 10s 2024-03-30T13:13:51.941 INFO:teuthology.orchestra.run.smithi044.stderr: 85650K .......... .......... .......... .......... .......... 50% 26.5M 10s 2024-03-30T13:13:51.946 INFO:teuthology.orchestra.run.smithi044.stderr: 85700K .......... .......... .......... .......... .......... 50% 29.6M 10s 2024-03-30T13:13:51.946 INFO:teuthology.orchestra.run.smithi044.stderr: 85750K .......... .......... .......... .......... .......... 50% 35.1M 10s 2024-03-30T13:13:51.948 INFO:teuthology.orchestra.run.smithi044.stderr: 85800K .......... .......... .......... .......... .......... 50% 13.4M 10s 2024-03-30T13:13:51.952 INFO:teuthology.orchestra.run.smithi044.stderr: 85850K .......... .......... .......... .......... .......... 50% 9.86M 10s 2024-03-30T13:13:51.954 INFO:teuthology.orchestra.run.smithi044.stderr: 85900K .......... .......... .......... .......... .......... 50% 20.7M 10s 2024-03-30T13:13:51.981 INFO:teuthology.orchestra.run.smithi044.stderr: 85950K .......... .......... .......... .......... .......... 51% 2.61M 10s 2024-03-30T13:13:51.982 INFO:teuthology.orchestra.run.smithi044.stderr: 86000K .......... .......... .......... .......... .......... 51% 42.4M 10s 2024-03-30T13:13:51.982 INFO:teuthology.orchestra.run.smithi044.stderr: 86050K .......... .......... .......... .......... .......... 51% 27.8M 10s 2024-03-30T13:13:51.982 INFO:teuthology.orchestra.run.smithi044.stderr: 86100K .......... .......... .......... .......... .......... 51% 28.9M 10s 2024-03-30T13:13:51.982 INFO:teuthology.orchestra.run.smithi044.stderr: 86150K .......... .......... .......... .......... .......... 51% 20.6M 10s 2024-03-30T13:13:51.984 INFO:teuthology.orchestra.run.smithi044.stderr: 86200K .......... .......... .......... .......... .......... 51% 18.5M 10s 2024-03-30T13:13:51.989 INFO:teuthology.orchestra.run.smithi044.stderr: 86250K .......... .......... .......... .......... .......... 51% 9.04M 10s 2024-03-30T13:13:51.992 INFO:teuthology.orchestra.run.smithi044.stderr: 86300K .......... .......... .......... .......... .......... 51% 14.0M 10s 2024-03-30T13:13:52.019 INFO:teuthology.orchestra.run.smithi044.stderr: 86350K .......... .......... .......... .......... .......... 51% 2.87M 10s 2024-03-30T13:13:52.020 INFO:teuthology.orchestra.run.smithi044.stderr: 86400K .......... .......... .......... .......... .......... 51% 27.1M 10s 2024-03-30T13:13:52.020 INFO:teuthology.orchestra.run.smithi044.stderr: 86450K .......... .......... .......... .......... .......... 51% 28.4M 10s 2024-03-30T13:13:52.020 INFO:teuthology.orchestra.run.smithi044.stderr: 86500K .......... .......... .......... .......... .......... 51% 46.1M 10s 2024-03-30T13:13:52.020 INFO:teuthology.orchestra.run.smithi044.stderr: 86550K .......... .......... .......... .......... .......... 51% 17.6M 10s 2024-03-30T13:13:52.020 INFO:teuthology.orchestra.run.smithi044.stderr: 86600K .......... .......... .......... .......... .......... 51% 20.5M 10s 2024-03-30T13:13:52.024 INFO:teuthology.orchestra.run.smithi044.stderr: 86650K .......... .......... .......... .......... .......... 51% 8.42M 10s 2024-03-30T13:13:52.029 INFO:teuthology.orchestra.run.smithi044.stderr: 86700K .......... .......... .......... .......... .......... 51% 10.3M 10s 2024-03-30T13:13:52.051 INFO:teuthology.orchestra.run.smithi044.stderr: 86750K .......... .......... .......... .......... .......... 51% 3.16M 10s 2024-03-30T13:13:52.051 INFO:teuthology.orchestra.run.smithi044.stderr: 86800K .......... .......... .......... .......... .......... 51% 33.7M 10s 2024-03-30T13:13:52.051 INFO:teuthology.orchestra.run.smithi044.stderr: 86850K .......... .......... .......... .......... .......... 51% 19.1M 10s 2024-03-30T13:13:52.051 INFO:teuthology.orchestra.run.smithi044.stderr: 86900K .......... .......... .......... .......... .......... 51% 43.4M 10s 2024-03-30T13:13:52.053 INFO:teuthology.orchestra.run.smithi044.stderr: 86950K .......... .......... .......... .......... .......... 51% 22.9M 10s 2024-03-30T13:13:52.055 INFO:teuthology.orchestra.run.smithi044.stderr: 87000K .......... .......... .......... .......... .......... 51% 16.1M 10s 2024-03-30T13:13:52.062 INFO:teuthology.orchestra.run.smithi044.stderr: 87050K .......... .......... .......... .......... .......... 51% 7.86M 10s 2024-03-30T13:13:52.082 INFO:teuthology.orchestra.run.smithi044.stderr: 87100K .......... .......... .......... .......... .......... 51% 9.52M 10s 2024-03-30T13:13:52.083 INFO:teuthology.orchestra.run.smithi044.stderr: 87150K .......... .......... .......... .......... .......... 51% 3.08M 10s 2024-03-30T13:13:52.085 INFO:teuthology.orchestra.run.smithi044.stderr: 87200K .......... .......... .......... .......... .......... 51% 15.2M 10s 2024-03-30T13:13:52.088 INFO:teuthology.orchestra.run.smithi044.stderr: 87250K .......... .......... .......... .......... .......... 51% 19.1M 10s 2024-03-30T13:13:52.091 INFO:teuthology.orchestra.run.smithi044.stderr: 87300K .......... .......... .......... .......... .......... 51% 26.2M 10s 2024-03-30T13:13:52.093 INFO:teuthology.orchestra.run.smithi044.stderr: 87350K .......... .......... .......... .......... .......... 51% 20.3M 10s 2024-03-30T13:13:52.095 INFO:teuthology.orchestra.run.smithi044.stderr: 87400K .......... .......... .......... .......... .......... 51% 15.3M 10s 2024-03-30T13:13:52.099 INFO:teuthology.orchestra.run.smithi044.stderr: 87450K .......... .......... .......... .......... .......... 51% 20.7M 10s 2024-03-30T13:13:52.101 INFO:teuthology.orchestra.run.smithi044.stderr: 87500K .......... .......... .......... .......... .......... 51% 11.9M 10s 2024-03-30T13:13:52.119 INFO:teuthology.orchestra.run.smithi044.stderr: 87550K .......... .......... .......... .......... .......... 51% 2.96M 10s 2024-03-30T13:13:52.125 INFO:teuthology.orchestra.run.smithi044.stderr: 87600K .......... .......... .......... .......... .......... 51% 7.10M 10s 2024-03-30T13:13:52.129 INFO:teuthology.orchestra.run.smithi044.stderr: 87650K .......... .......... .......... .......... .......... 52% 39.9M 10s 2024-03-30T13:13:52.129 INFO:teuthology.orchestra.run.smithi044.stderr: 87700K .......... .......... .......... .......... .......... 52% 63.2M 10s 2024-03-30T13:13:52.135 INFO:teuthology.orchestra.run.smithi044.stderr: 87750K .......... .......... .......... .......... .......... 52% 16.0M 10s 2024-03-30T13:13:52.136 INFO:teuthology.orchestra.run.smithi044.stderr: 87800K .......... .......... .......... .......... .......... 52% 31.2M 10s 2024-03-30T13:13:52.136 INFO:teuthology.orchestra.run.smithi044.stderr: 87850K .......... .......... .......... .......... .......... 52% 32.3M 10s 2024-03-30T13:13:52.138 INFO:teuthology.orchestra.run.smithi044.stderr: 87900K .......... .......... .......... .......... .......... 52% 10.8M 10s 2024-03-30T13:13:52.155 INFO:teuthology.orchestra.run.smithi044.stderr: 87950K .......... .......... .......... .......... .......... 52% 2.99M 10s 2024-03-30T13:13:52.165 INFO:teuthology.orchestra.run.smithi044.stderr: 88000K .......... .......... .......... .......... .......... 52% 6.51M 10s 2024-03-30T13:13:52.165 INFO:teuthology.orchestra.run.smithi044.stderr: 88050K .......... .......... .......... .......... .......... 52% 56.6M 10s 2024-03-30T13:13:52.165 INFO:teuthology.orchestra.run.smithi044.stderr: 88100K .......... .......... .......... .......... .......... 52% 52.7M 10s 2024-03-30T13:13:52.171 INFO:teuthology.orchestra.run.smithi044.stderr: 88150K .......... .......... .......... .......... .......... 52% 17.2M 10s 2024-03-30T13:13:52.171 INFO:teuthology.orchestra.run.smithi044.stderr: 88200K .......... .......... .......... .......... .......... 52% 34.2M 10s 2024-03-30T13:13:52.171 INFO:teuthology.orchestra.run.smithi044.stderr: 88250K .......... .......... .......... .......... .......... 52% 31.4M 10s 2024-03-30T13:13:52.174 INFO:teuthology.orchestra.run.smithi044.stderr: 88300K .......... .......... .......... .......... .......... 52% 10.7M 10s 2024-03-30T13:13:52.190 INFO:teuthology.orchestra.run.smithi044.stderr: 88350K .......... .......... .......... .......... .......... 52% 3.00M 10s 2024-03-30T13:13:52.208 INFO:teuthology.orchestra.run.smithi044.stderr: 88400K .......... .......... .......... .......... .......... 52% 6.84M 10s 2024-03-30T13:13:52.208 INFO:teuthology.orchestra.run.smithi044.stderr: 88450K .......... .......... .......... .......... .......... 52% 28.1M 10s 2024-03-30T13:13:52.208 INFO:teuthology.orchestra.run.smithi044.stderr: 88500K .......... .......... .......... .......... .......... 52% 50.4M 10s 2024-03-30T13:13:52.208 INFO:teuthology.orchestra.run.smithi044.stderr: 88550K .......... .......... .......... .......... .......... 52% 25.7M 10s 2024-03-30T13:13:52.209 INFO:teuthology.orchestra.run.smithi044.stderr: 88600K .......... .......... .......... .......... .......... 52% 31.9M 10s 2024-03-30T13:13:52.209 INFO:teuthology.orchestra.run.smithi044.stderr: 88650K .......... .......... .......... .......... .......... 52% 20.9M 10s 2024-03-30T13:13:52.210 INFO:teuthology.orchestra.run.smithi044.stderr: 88700K .......... .......... .......... .......... .......... 52% 11.9M 10s 2024-03-30T13:13:52.226 INFO:teuthology.orchestra.run.smithi044.stderr: 88750K .......... .......... .......... .......... .......... 52% 3.10M 10s 2024-03-30T13:13:52.242 INFO:teuthology.orchestra.run.smithi044.stderr: 88800K .......... .......... .......... .......... .......... 52% 6.71M 10s 2024-03-30T13:13:52.242 INFO:teuthology.orchestra.run.smithi044.stderr: 88850K .......... .......... .......... .......... .......... 52% 31.3M 10s 2024-03-30T13:13:52.242 INFO:teuthology.orchestra.run.smithi044.stderr: 88900K .......... .......... .......... .......... .......... 52% 47.3M 10s 2024-03-30T13:13:52.243 INFO:teuthology.orchestra.run.smithi044.stderr: 88950K .......... .......... .......... .......... .......... 52% 26.8M 10s 2024-03-30T13:13:52.243 INFO:teuthology.orchestra.run.smithi044.stderr: 89000K .......... .......... .......... .......... .......... 52% 29.2M 10s 2024-03-30T13:13:52.243 INFO:teuthology.orchestra.run.smithi044.stderr: 89050K .......... .......... .......... .......... .......... 52% 19.0M 10s 2024-03-30T13:13:52.245 INFO:teuthology.orchestra.run.smithi044.stderr: 89100K .......... .......... .......... .......... .......... 52% 12.9M 10s 2024-03-30T13:13:52.261 INFO:teuthology.orchestra.run.smithi044.stderr: 89150K .......... .......... .......... .......... .......... 52% 3.11M 10s 2024-03-30T13:13:52.268 INFO:teuthology.orchestra.run.smithi044.stderr: 89200K .......... .......... .......... .......... .......... 52% 6.59M 10s 2024-03-30T13:13:52.276 INFO:teuthology.orchestra.run.smithi044.stderr: 89250K .......... .......... .......... .......... .......... 52% 35.3M 10s 2024-03-30T13:13:52.276 INFO:teuthology.orchestra.run.smithi044.stderr: 89300K .......... .......... .......... .......... .......... 53% 32.7M 10s 2024-03-30T13:13:52.276 INFO:teuthology.orchestra.run.smithi044.stderr: 89350K .......... .......... .......... .......... .......... 53% 33.8M 10s 2024-03-30T13:13:52.276 INFO:teuthology.orchestra.run.smithi044.stderr: 89400K .......... .......... .......... .......... .......... 53% 26.7M 10s 2024-03-30T13:13:52.279 INFO:teuthology.orchestra.run.smithi044.stderr: 89450K .......... .......... .......... .......... .......... 53% 19.5M 10s 2024-03-30T13:13:52.281 INFO:teuthology.orchestra.run.smithi044.stderr: 89500K .......... .......... .......... .......... .......... 53% 13.2M 10s 2024-03-30T13:13:52.297 INFO:teuthology.orchestra.run.smithi044.stderr: 89550K .......... .......... .......... .......... .......... 53% 3.04M 10s 2024-03-30T13:13:52.304 INFO:teuthology.orchestra.run.smithi044.stderr: 89600K .......... .......... .......... .......... .......... 53% 6.84M 10s 2024-03-30T13:13:52.311 INFO:teuthology.orchestra.run.smithi044.stderr: 89650K .......... .......... .......... .......... .......... 53% 26.9M 10s 2024-03-30T13:13:52.312 INFO:teuthology.orchestra.run.smithi044.stderr: 89700K .......... .......... .......... .......... .......... 53% 36.1M 10s 2024-03-30T13:13:52.312 INFO:teuthology.orchestra.run.smithi044.stderr: 89750K .......... .......... .......... .......... .......... 53% 39.6M 10s 2024-03-30T13:13:52.312 INFO:teuthology.orchestra.run.smithi044.stderr: 89800K .......... .......... .......... .......... .......... 53% 30.3M 10s 2024-03-30T13:13:52.314 INFO:teuthology.orchestra.run.smithi044.stderr: 89850K .......... .......... .......... .......... .......... 53% 19.8M 10s 2024-03-30T13:13:52.316 INFO:teuthology.orchestra.run.smithi044.stderr: 89900K .......... .......... .......... .......... .......... 53% 12.5M 10s 2024-03-30T13:13:52.332 INFO:teuthology.orchestra.run.smithi044.stderr: 89950K .......... .......... .......... .......... .......... 53% 3.07M 10s 2024-03-30T13:13:52.341 INFO:teuthology.orchestra.run.smithi044.stderr: 90000K .......... .......... .......... .......... .......... 53% 5.36M 10s 2024-03-30T13:13:52.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90050K .......... .......... .......... .......... .......... 53% 39.3M 10s 2024-03-30T13:13:52.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90100K .......... .......... .......... .......... .......... 53% 50.7M 10s 2024-03-30T13:13:52.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90150K .......... .......... .......... .......... .......... 53% 38.3M 10s 2024-03-30T13:13:52.347 INFO:teuthology.orchestra.run.smithi044.stderr: 90200K .......... .......... .......... .......... .......... 53% 40.2M 10s 2024-03-30T13:13:52.348 INFO:teuthology.orchestra.run.smithi044.stderr: 90250K .......... .......... .......... .......... .......... 53% 26.8M 10s 2024-03-30T13:13:52.351 INFO:teuthology.orchestra.run.smithi044.stderr: 90300K .......... .......... .......... .......... .......... 53% 13.3M 10s 2024-03-30T13:13:52.367 INFO:teuthology.orchestra.run.smithi044.stderr: 90350K .......... .......... .......... .......... .......... 53% 3.02M 10s 2024-03-30T13:13:52.376 INFO:teuthology.orchestra.run.smithi044.stderr: 90400K .......... .......... .......... .......... .......... 53% 5.29M 10s 2024-03-30T13:13:52.379 INFO:teuthology.orchestra.run.smithi044.stderr: 90450K .......... .......... .......... .......... .......... 53% 29.6M 10s 2024-03-30T13:13:52.379 INFO:teuthology.orchestra.run.smithi044.stderr: 90500K .......... .......... .......... .......... .......... 53% 54.6M 10s 2024-03-30T13:13:52.382 INFO:teuthology.orchestra.run.smithi044.stderr: 90550K .......... .......... .......... .......... .......... 53% 52.6M 10s 2024-03-30T13:13:52.382 INFO:teuthology.orchestra.run.smithi044.stderr: 90600K .......... .......... .......... .......... .......... 53% 40.2M 10s 2024-03-30T13:13:52.383 INFO:teuthology.orchestra.run.smithi044.stderr: 90650K .......... .......... .......... .......... .......... 53% 28.7M 10s 2024-03-30T13:13:52.388 INFO:teuthology.orchestra.run.smithi044.stderr: 90700K .......... .......... .......... .......... .......... 53% 9.63M 9s 2024-03-30T13:13:52.403 INFO:teuthology.orchestra.run.smithi044.stderr: 90750K .......... .......... .......... .......... .......... 53% 3.28M 9s 2024-03-30T13:13:52.412 INFO:teuthology.orchestra.run.smithi044.stderr: 90800K .......... .......... .......... .......... .......... 53% 5.10M 9s 2024-03-30T13:13:52.416 INFO:teuthology.orchestra.run.smithi044.stderr: 90850K .......... .......... .......... .......... .......... 53% 34.1M 9s 2024-03-30T13:13:52.416 INFO:teuthology.orchestra.run.smithi044.stderr: 90900K .......... .......... .......... .......... .......... 53% 54.8M 9s 2024-03-30T13:13:52.416 INFO:teuthology.orchestra.run.smithi044.stderr: 90950K .......... .......... .......... .......... .......... 53% 61.5M 9s 2024-03-30T13:13:52.417 INFO:teuthology.orchestra.run.smithi044.stderr: 91000K .......... .......... .......... .......... .......... 54% 41.1M 9s 2024-03-30T13:13:52.418 INFO:teuthology.orchestra.run.smithi044.stderr: 91050K .......... .......... .......... .......... .......... 54% 27.6M 9s 2024-03-30T13:13:52.423 INFO:teuthology.orchestra.run.smithi044.stderr: 91100K .......... .......... .......... .......... .......... 54% 9.41M 9s 2024-03-30T13:13:52.439 INFO:teuthology.orchestra.run.smithi044.stderr: 91150K .......... .......... .......... .......... .......... 54% 3.24M 9s 2024-03-30T13:13:52.442 INFO:teuthology.orchestra.run.smithi044.stderr: 91200K .......... .......... .......... .......... .......... 54% 12.1M 9s 2024-03-30T13:13:52.452 INFO:teuthology.orchestra.run.smithi044.stderr: 91250K .......... .......... .......... .......... .......... 54% 7.05M 9s 2024-03-30T13:13:52.452 INFO:teuthology.orchestra.run.smithi044.stderr: 91300K .......... .......... .......... .......... .......... 54% 49.9M 9s 2024-03-30T13:13:52.452 INFO:teuthology.orchestra.run.smithi044.stderr: 91350K .......... .......... .......... .......... .......... 54% 54.0M 9s 2024-03-30T13:13:52.453 INFO:teuthology.orchestra.run.smithi044.stderr: 91400K .......... .......... .......... .......... .......... 54% 31.5M 9s 2024-03-30T13:13:52.455 INFO:teuthology.orchestra.run.smithi044.stderr: 91450K .......... .......... .......... .......... .......... 54% 29.2M 9s 2024-03-30T13:13:52.456 INFO:teuthology.orchestra.run.smithi044.stderr: 91500K .......... .......... .......... .......... .......... 54% 31.3M 9s 2024-03-30T13:13:52.474 INFO:teuthology.orchestra.run.smithi044.stderr: 91550K .......... .......... .......... .......... .......... 54% 2.73M 9s 2024-03-30T13:13:52.480 INFO:teuthology.orchestra.run.smithi044.stderr: 91600K .......... .......... .......... .......... .......... 54% 8.46M 9s 2024-03-30T13:13:52.489 INFO:teuthology.orchestra.run.smithi044.stderr: 91650K .......... .......... .......... .......... .......... 54% 8.63M 9s 2024-03-30T13:13:52.489 INFO:teuthology.orchestra.run.smithi044.stderr: 91700K .......... .......... .......... .......... .......... 54% 46.1M 9s 2024-03-30T13:13:52.489 INFO:teuthology.orchestra.run.smithi044.stderr: 91750K .......... .......... .......... .......... .......... 54% 73.8M 9s 2024-03-30T13:13:52.489 INFO:teuthology.orchestra.run.smithi044.stderr: 91800K .......... .......... .......... .......... .......... 54% 41.9M 9s 2024-03-30T13:13:52.491 INFO:teuthology.orchestra.run.smithi044.stderr: 91850K .......... .......... .......... .......... .......... 54% 21.8M 9s 2024-03-30T13:13:52.492 INFO:teuthology.orchestra.run.smithi044.stderr: 91900K .......... .......... .......... .......... .......... 54% 39.4M 9s 2024-03-30T13:13:52.511 INFO:teuthology.orchestra.run.smithi044.stderr: 91950K .......... .......... .......... .......... .......... 54% 2.74M 9s 2024-03-30T13:13:52.515 INFO:teuthology.orchestra.run.smithi044.stderr: 92000K .......... .......... .......... .......... .......... 54% 9.05M 9s 2024-03-30T13:13:52.523 INFO:teuthology.orchestra.run.smithi044.stderr: 92050K .......... .......... .......... .......... .......... 54% 7.98M 9s 2024-03-30T13:13:52.523 INFO:teuthology.orchestra.run.smithi044.stderr: 92100K .......... .......... .......... .......... .......... 54% 40.5M 9s 2024-03-30T13:13:52.524 INFO:teuthology.orchestra.run.smithi044.stderr: 92150K .......... .......... .......... .......... .......... 54% 65.6M 9s 2024-03-30T13:13:52.528 INFO:teuthology.orchestra.run.smithi044.stderr: 92200K .......... .......... .......... .......... .......... 54% 29.8M 9s 2024-03-30T13:13:52.528 INFO:teuthology.orchestra.run.smithi044.stderr: 92250K .......... .......... .......... .......... .......... 54% 24.9M 9s 2024-03-30T13:13:52.528 INFO:teuthology.orchestra.run.smithi044.stderr: 92300K .......... .......... .......... .......... .......... 54% 53.1M 9s 2024-03-30T13:13:52.545 INFO:teuthology.orchestra.run.smithi044.stderr: 92350K .......... .......... .......... .......... .......... 54% 2.81M 9s 2024-03-30T13:13:52.548 INFO:teuthology.orchestra.run.smithi044.stderr: 92400K .......... .......... .......... .......... .......... 54% 29.1M 9s 2024-03-30T13:13:52.559 INFO:teuthology.orchestra.run.smithi044.stderr: 92450K .......... .......... .......... .......... .......... 54% 4.90M 9s 2024-03-30T13:13:52.560 INFO:teuthology.orchestra.run.smithi044.stderr: 92500K .......... .......... .......... .......... .......... 54% 32.1M 9s 2024-03-30T13:13:52.560 INFO:teuthology.orchestra.run.smithi044.stderr: 92550K .......... .......... .......... .......... .......... 54% 62.6M 9s 2024-03-30T13:13:52.561 INFO:teuthology.orchestra.run.smithi044.stderr: 92600K .......... .......... .......... .......... .......... 54% 44.9M 9s 2024-03-30T13:13:52.563 INFO:teuthology.orchestra.run.smithi044.stderr: 92650K .......... .......... .......... .......... .......... 54% 33.4M 9s 2024-03-30T13:13:52.563 INFO:teuthology.orchestra.run.smithi044.stderr: 92700K .......... .......... .......... .......... .......... 55% 31.9M 9s 2024-03-30T13:13:52.581 INFO:teuthology.orchestra.run.smithi044.stderr: 92750K .......... .......... .......... .......... .......... 55% 2.79M 9s 2024-03-30T13:13:52.582 INFO:teuthology.orchestra.run.smithi044.stderr: 92800K .......... .......... .......... .......... .......... 55% 28.6M 9s 2024-03-30T13:13:52.593 INFO:teuthology.orchestra.run.smithi044.stderr: 92850K .......... .......... .......... .......... .......... 55% 4.89M 9s 2024-03-30T13:13:52.596 INFO:teuthology.orchestra.run.smithi044.stderr: 92900K .......... .......... .......... .......... .......... 55% 34.3M 9s 2024-03-30T13:13:52.596 INFO:teuthology.orchestra.run.smithi044.stderr: 92950K .......... .......... .......... .......... .......... 55% 58.0M 9s 2024-03-30T13:13:52.596 INFO:teuthology.orchestra.run.smithi044.stderr: 93000K .......... .......... .......... .......... .......... 55% 58.1M 9s 2024-03-30T13:13:52.597 INFO:teuthology.orchestra.run.smithi044.stderr: 93050K .......... .......... .......... .......... .......... 55% 26.0M 9s 2024-03-30T13:13:52.599 INFO:teuthology.orchestra.run.smithi044.stderr: 93100K .......... .......... .......... .......... .......... 55% 27.2M 9s 2024-03-30T13:13:52.617 INFO:teuthology.orchestra.run.smithi044.stderr: 93150K .......... .......... .......... .......... .......... 55% 2.85M 9s 2024-03-30T13:13:52.618 INFO:teuthology.orchestra.run.smithi044.stderr: 93200K .......... .......... .......... .......... .......... 55% 31.0M 9s 2024-03-30T13:13:52.628 INFO:teuthology.orchestra.run.smithi044.stderr: 93250K .......... .......... .......... .......... .......... 55% 4.91M 9s 2024-03-30T13:13:52.631 INFO:teuthology.orchestra.run.smithi044.stderr: 93300K .......... .......... .......... .......... .......... 55% 37.3M 9s 2024-03-30T13:13:52.632 INFO:teuthology.orchestra.run.smithi044.stderr: 93350K .......... .......... .......... .......... .......... 55% 65.1M 9s 2024-03-30T13:13:52.632 INFO:teuthology.orchestra.run.smithi044.stderr: 93400K .......... .......... .......... .......... .......... 55% 49.0M 9s 2024-03-30T13:13:52.633 INFO:teuthology.orchestra.run.smithi044.stderr: 93450K .......... .......... .......... .......... .......... 55% 25.5M 9s 2024-03-30T13:13:52.635 INFO:teuthology.orchestra.run.smithi044.stderr: 93500K .......... .......... .......... .......... .......... 55% 28.2M 9s 2024-03-30T13:13:52.638 INFO:teuthology.orchestra.run.smithi044.stderr: 93550K .......... .......... .......... .......... .......... 55% 14.8M 9s 2024-03-30T13:13:52.653 INFO:teuthology.orchestra.run.smithi044.stderr: 93600K .......... .......... .......... .......... .......... 55% 3.16M 9s 2024-03-30T13:13:52.663 INFO:teuthology.orchestra.run.smithi044.stderr: 93650K .......... .......... .......... .......... .......... 55% 4.91M 9s 2024-03-30T13:13:52.664 INFO:teuthology.orchestra.run.smithi044.stderr: 93700K .......... .......... .......... .......... .......... 55% 36.6M 9s 2024-03-30T13:13:52.667 INFO:teuthology.orchestra.run.smithi044.stderr: 93750K .......... .......... .......... .......... .......... 55% 43.8M 9s 2024-03-30T13:13:52.667 INFO:teuthology.orchestra.run.smithi044.stderr: 93800K .......... .......... .......... .......... .......... 55% 61.6M 9s 2024-03-30T13:13:52.669 INFO:teuthology.orchestra.run.smithi044.stderr: 93850K .......... .......... .......... .......... .......... 55% 31.1M 9s 2024-03-30T13:13:52.670 INFO:teuthology.orchestra.run.smithi044.stderr: 93900K .......... .......... .......... .......... .......... 55% 28.2M 9s 2024-03-30T13:13:52.673 INFO:teuthology.orchestra.run.smithi044.stderr: 93950K .......... .......... .......... .......... .......... 55% 13.9M 9s 2024-03-30T13:13:52.689 INFO:teuthology.orchestra.run.smithi044.stderr: 94000K .......... .......... .......... .......... .......... 55% 3.32M 9s 2024-03-30T13:13:52.693 INFO:teuthology.orchestra.run.smithi044.stderr: 94050K .......... .......... .......... .......... .......... 55% 10.2M 9s 2024-03-30T13:13:52.704 INFO:teuthology.orchestra.run.smithi044.stderr: 94100K .......... .......... .......... .......... .......... 55% 6.98M 9s 2024-03-30T13:13:52.704 INFO:teuthology.orchestra.run.smithi044.stderr: 94150K .......... .......... .......... .......... .......... 55% 39.8M 9s 2024-03-30T13:13:52.704 INFO:teuthology.orchestra.run.smithi044.stderr: 94200K .......... .......... .......... .......... .......... 55% 59.0M 9s 2024-03-30T13:13:52.704 INFO:teuthology.orchestra.run.smithi044.stderr: 94250K .......... .......... .......... .......... .......... 55% 67.7M 9s 2024-03-30T13:13:52.706 INFO:teuthology.orchestra.run.smithi044.stderr: 94300K .......... .......... .......... .......... .......... 55% 18.6M 9s 2024-03-30T13:13:52.709 INFO:teuthology.orchestra.run.smithi044.stderr: 94350K .......... .......... .......... .......... .......... 56% 14.6M 9s 2024-03-30T13:13:52.723 INFO:teuthology.orchestra.run.smithi044.stderr: 94400K .......... .......... .......... .......... .......... 56% 3.28M 9s 2024-03-30T13:13:52.726 INFO:teuthology.orchestra.run.smithi044.stderr: 94450K .......... .......... .......... .......... .......... 56% 36.7M 9s 2024-03-30T13:13:52.736 INFO:teuthology.orchestra.run.smithi044.stderr: 94500K .......... .......... .......... .......... .......... 56% 4.64M 9s 2024-03-30T13:13:52.737 INFO:teuthology.orchestra.run.smithi044.stderr: 94550K .......... .......... .......... .......... .......... 56% 47.3M 9s 2024-03-30T13:13:52.738 INFO:teuthology.orchestra.run.smithi044.stderr: 94600K .......... .......... .......... .......... .......... 56% 57.3M 9s 2024-03-30T13:13:52.738 INFO:teuthology.orchestra.run.smithi044.stderr: 94650K .......... .......... .......... .......... .......... 56% 69.3M 9s 2024-03-30T13:13:52.740 INFO:teuthology.orchestra.run.smithi044.stderr: 94700K .......... .......... .......... .......... .......... 56% 23.7M 9s 2024-03-30T13:13:52.741 INFO:teuthology.orchestra.run.smithi044.stderr: 94750K .......... .......... .......... .......... .......... 56% 33.1M 9s 2024-03-30T13:13:52.760 INFO:teuthology.orchestra.run.smithi044.stderr: 94800K .......... .......... .......... .......... .......... 56% 2.81M 9s 2024-03-30T13:13:52.760 INFO:teuthology.orchestra.run.smithi044.stderr: 94850K .......... .......... .......... .......... .......... 56% 38.0M 9s 2024-03-30T13:13:52.774 INFO:teuthology.orchestra.run.smithi044.stderr: 94900K .......... .......... .......... .......... .......... 56% 4.82M 9s 2024-03-30T13:13:52.774 INFO:teuthology.orchestra.run.smithi044.stderr: 94950K .......... .......... .......... .......... .......... 56% 35.8M 9s 2024-03-30T13:13:52.774 INFO:teuthology.orchestra.run.smithi044.stderr: 95000K .......... .......... .......... .......... .......... 56% 58.6M 9s 2024-03-30T13:13:52.774 INFO:teuthology.orchestra.run.smithi044.stderr: 95050K .......... .......... .......... .......... .......... 56% 67.4M 9s 2024-03-30T13:13:52.775 INFO:teuthology.orchestra.run.smithi044.stderr: 95100K .......... .......... .......... .......... .......... 56% 27.6M 9s 2024-03-30T13:13:52.777 INFO:teuthology.orchestra.run.smithi044.stderr: 95150K .......... .......... .......... .......... .......... 56% 26.0M 9s 2024-03-30T13:13:52.794 INFO:teuthology.orchestra.run.smithi044.stderr: 95200K .......... .......... .......... .......... .......... 56% 2.83M 9s 2024-03-30T13:13:52.795 INFO:teuthology.orchestra.run.smithi044.stderr: 95250K .......... .......... .......... .......... .......... 56% 33.4M 9s 2024-03-30T13:13:52.805 INFO:teuthology.orchestra.run.smithi044.stderr: 95300K .......... .......... .......... .......... .......... 56% 4.93M 9s 2024-03-30T13:13:52.807 INFO:teuthology.orchestra.run.smithi044.stderr: 95350K .......... .......... .......... .......... .......... 56% 33.4M 9s 2024-03-30T13:13:52.809 INFO:teuthology.orchestra.run.smithi044.stderr: 95400K .......... .......... .......... .......... .......... 56% 55.9M 9s 2024-03-30T13:13:52.809 INFO:teuthology.orchestra.run.smithi044.stderr: 95450K .......... .......... .......... .......... .......... 56% 57.8M 9s 2024-03-30T13:13:52.811 INFO:teuthology.orchestra.run.smithi044.stderr: 95500K .......... .......... .......... .......... .......... 56% 29.4M 9s 2024-03-30T13:13:52.812 INFO:teuthology.orchestra.run.smithi044.stderr: 95550K .......... .......... .......... .......... .......... 56% 26.8M 9s 2024-03-30T13:13:52.815 INFO:teuthology.orchestra.run.smithi044.stderr: 95600K .......... .......... .......... .......... .......... 56% 14.2M 9s 2024-03-30T13:13:52.831 INFO:teuthology.orchestra.run.smithi044.stderr: 95650K .......... .......... .......... .......... .......... 56% 3.21M 9s 2024-03-30T13:13:52.835 INFO:teuthology.orchestra.run.smithi044.stderr: 95700K .......... .......... .......... .......... .......... 56% 11.0M 9s 2024-03-30T13:13:52.842 INFO:teuthology.orchestra.run.smithi044.stderr: 95750K .......... .......... .......... .......... .......... 56% 7.15M 9s 2024-03-30T13:13:52.845 INFO:teuthology.orchestra.run.smithi044.stderr: 95800K .......... .......... .......... .......... .......... 56% 45.8M 9s 2024-03-30T13:13:52.845 INFO:teuthology.orchestra.run.smithi044.stderr: 95850K .......... .......... .......... .......... .......... 56% 58.5M 9s 2024-03-30T13:13:52.845 INFO:teuthology.orchestra.run.smithi044.stderr: 95900K .......... .......... .......... .......... .......... 56% 70.9M 9s 2024-03-30T13:13:52.848 INFO:teuthology.orchestra.run.smithi044.stderr: 95950K .......... .......... .......... .......... .......... 56% 18.1M 9s 2024-03-30T13:13:52.851 INFO:teuthology.orchestra.run.smithi044.stderr: 96000K .......... .......... .......... .......... .......... 56% 14.8M 9s 2024-03-30T13:13:52.865 INFO:teuthology.orchestra.run.smithi044.stderr: 96050K .......... .......... .......... .......... .......... 57% 3.23M 9s 2024-03-30T13:13:52.868 INFO:teuthology.orchestra.run.smithi044.stderr: 96100K .......... .......... .......... .......... .......... 57% 22.2M 9s 2024-03-30T13:13:52.880 INFO:teuthology.orchestra.run.smithi044.stderr: 96150K .......... .......... .......... .......... .......... 57% 5.05M 9s 2024-03-30T13:13:52.880 INFO:teuthology.orchestra.run.smithi044.stderr: 96200K .......... .......... .......... .......... .......... 57% 51.7M 9s 2024-03-30T13:13:52.880 INFO:teuthology.orchestra.run.smithi044.stderr: 96250K .......... .......... .......... .......... .......... 57% 56.1M 9s 2024-03-30T13:13:52.880 INFO:teuthology.orchestra.run.smithi044.stderr: 96300K .......... .......... .......... .......... .......... 57% 69.8M 9s 2024-03-30T13:13:52.882 INFO:teuthology.orchestra.run.smithi044.stderr: 96350K .......... .......... .......... .......... .......... 57% 25.8M 9s 2024-03-30T13:13:52.883 INFO:teuthology.orchestra.run.smithi044.stderr: 96400K .......... .......... .......... .......... .......... 57% 32.0M 9s 2024-03-30T13:13:52.901 INFO:teuthology.orchestra.run.smithi044.stderr: 96450K .......... .......... .......... .......... .......... 57% 2.78M 9s 2024-03-30T13:13:52.902 INFO:teuthology.orchestra.run.smithi044.stderr: 96500K .......... .......... .......... .......... .......... 57% 35.9M 9s 2024-03-30T13:13:52.912 INFO:teuthology.orchestra.run.smithi044.stderr: 96550K .......... .......... .......... .......... .......... 57% 4.93M 9s 2024-03-30T13:13:52.916 INFO:teuthology.orchestra.run.smithi044.stderr: 96600K .......... .......... .......... .......... .......... 57% 34.5M 9s 2024-03-30T13:13:52.916 INFO:teuthology.orchestra.run.smithi044.stderr: 96650K .......... .......... .......... .......... .......... 57% 62.0M 9s 2024-03-30T13:13:52.916 INFO:teuthology.orchestra.run.smithi044.stderr: 96700K .......... .......... .......... .......... .......... 57% 69.7M 9s 2024-03-30T13:13:52.917 INFO:teuthology.orchestra.run.smithi044.stderr: 96750K .......... .......... .......... .......... .......... 57% 25.9M 9s 2024-03-30T13:13:52.919 INFO:teuthology.orchestra.run.smithi044.stderr: 96800K .......... .......... .......... .......... .......... 57% 30.4M 9s 2024-03-30T13:13:52.937 INFO:teuthology.orchestra.run.smithi044.stderr: 96850K .......... .......... .......... .......... .......... 57% 2.74M 9s 2024-03-30T13:13:52.938 INFO:teuthology.orchestra.run.smithi044.stderr: 96900K .......... .......... .......... .......... .......... 57% 40.3M 9s 2024-03-30T13:13:52.949 INFO:teuthology.orchestra.run.smithi044.stderr: 96950K .......... .......... .......... .......... .......... 57% 4.88M 9s 2024-03-30T13:13:52.949 INFO:teuthology.orchestra.run.smithi044.stderr: 97000K .......... .......... .......... .......... .......... 57% 40.8M 9s 2024-03-30T13:13:52.953 INFO:teuthology.orchestra.run.smithi044.stderr: 97050K .......... .......... .......... .......... .......... 57% 54.8M 9s 2024-03-30T13:13:52.953 INFO:teuthology.orchestra.run.smithi044.stderr: 97100K .......... .......... .......... .......... .......... 57% 56.0M 9s 2024-03-30T13:13:52.953 INFO:teuthology.orchestra.run.smithi044.stderr: 97150K .......... .......... .......... .......... .......... 57% 31.4M 9s 2024-03-30T13:13:52.954 INFO:teuthology.orchestra.run.smithi044.stderr: 97200K .......... .......... .......... .......... .......... 57% 27.2M 9s 2024-03-30T13:13:52.958 INFO:teuthology.orchestra.run.smithi044.stderr: 97250K .......... .......... .......... .......... .......... 57% 14.1M 9s 2024-03-30T13:13:52.977 INFO:teuthology.orchestra.run.smithi044.stderr: 97300K .......... .......... .......... .......... .......... 57% 2.60M 9s 2024-03-30T13:13:52.977 INFO:teuthology.orchestra.run.smithi044.stderr: 97350K .......... .......... .......... .......... .......... 57% 39.2M 9s 2024-03-30T13:13:52.991 INFO:teuthology.orchestra.run.smithi044.stderr: 97400K .......... .......... .......... .......... .......... 57% 4.87M 9s 2024-03-30T13:13:52.991 INFO:teuthology.orchestra.run.smithi044.stderr: 97450K .......... .......... .......... .......... .......... 57% 65.9M 9s 2024-03-30T13:13:52.991 INFO:teuthology.orchestra.run.smithi044.stderr: 97500K .......... .......... .......... .......... .......... 57% 70.0M 8s 2024-03-30T13:13:52.991 INFO:teuthology.orchestra.run.smithi044.stderr: 97550K .......... .......... .......... .......... .......... 57% 66.3M 8s 2024-03-30T13:13:52.991 INFO:teuthology.orchestra.run.smithi044.stderr: 97600K .......... .......... .......... .......... .......... 57% 62.8M 8s 2024-03-30T13:13:52.993 INFO:teuthology.orchestra.run.smithi044.stderr: 97650K .......... .......... .......... .......... .......... 57% 19.5M 8s 2024-03-30T13:13:53.014 INFO:teuthology.orchestra.run.smithi044.stderr: 97700K .......... .......... .......... .......... .......... 57% 2.52M 8s 2024-03-30T13:13:53.016 INFO:teuthology.orchestra.run.smithi044.stderr: 97750K .......... .......... .......... .......... .......... 58% 12.3M 8s 2024-03-30T13:13:53.039 INFO:teuthology.orchestra.run.smithi044.stderr: 97800K .......... .......... .......... .......... .......... 58% 2.75M 8s 2024-03-30T13:13:53.039 INFO:teuthology.orchestra.run.smithi044.stderr: 97850K .......... .......... .......... .......... .......... 58% 62.7M 8s 2024-03-30T13:13:53.040 INFO:teuthology.orchestra.run.smithi044.stderr: 97900K .......... .......... .......... .......... .......... 58% 65.6M 8s 2024-03-30T13:13:53.040 INFO:teuthology.orchestra.run.smithi044.stderr: 97950K .......... .......... .......... .......... .......... 58% 68.2M 8s 2024-03-30T13:13:53.040 INFO:teuthology.orchestra.run.smithi044.stderr: 98000K .......... .......... .......... .......... .......... 58% 66.2M 8s 2024-03-30T13:13:53.040 INFO:teuthology.orchestra.run.smithi044.stderr: 98050K .......... .......... .......... .......... .......... 58% 79.9M 8s 2024-03-30T13:13:53.048 INFO:teuthology.orchestra.run.smithi044.stderr: 98100K .......... .......... .......... .......... .......... 58% 4.98M 8s 2024-03-30T13:13:53.052 INFO:teuthology.orchestra.run.smithi044.stderr: 98150K .......... .......... .......... .......... .......... 58% 11.4M 8s 2024-03-30T13:13:53.076 INFO:teuthology.orchestra.run.smithi044.stderr: 98200K .......... .......... .......... .......... .......... 58% 2.78M 8s 2024-03-30T13:13:53.076 INFO:teuthology.orchestra.run.smithi044.stderr: 98250K .......... .......... .......... .......... .......... 58% 58.8M 8s 2024-03-30T13:13:53.076 INFO:teuthology.orchestra.run.smithi044.stderr: 98300K .......... .......... .......... .......... .......... 58% 55.4M 8s 2024-03-30T13:13:53.076 INFO:teuthology.orchestra.run.smithi044.stderr: 98350K .......... .......... .......... .......... .......... 58% 66.3M 8s 2024-03-30T13:13:53.076 INFO:teuthology.orchestra.run.smithi044.stderr: 98400K .......... .......... .......... .......... .......... 58% 71.7M 8s 2024-03-30T13:13:53.076 INFO:teuthology.orchestra.run.smithi044.stderr: 98450K .......... .......... .......... .......... .......... 58% 85.5M 8s 2024-03-30T13:13:53.076 INFO:teuthology.orchestra.run.smithi044.stderr: 98500K .......... .......... .......... .......... .......... 58% 71.5M 8s 2024-03-30T13:13:53.085 INFO:teuthology.orchestra.run.smithi044.stderr: 98550K .......... .......... .......... .......... .......... 58% 4.45M 8s 2024-03-30T13:13:53.100 INFO:teuthology.orchestra.run.smithi044.stderr: 98600K .......... .......... .......... .......... .......... 58% 3.24M 8s 2024-03-30T13:13:53.109 INFO:teuthology.orchestra.run.smithi044.stderr: 98650K .......... .......... .......... .......... .......... 58% 8.65M 8s 2024-03-30T13:13:53.109 INFO:teuthology.orchestra.run.smithi044.stderr: 98700K .......... .......... .......... .......... .......... 58% 56.1M 8s 2024-03-30T13:13:53.109 INFO:teuthology.orchestra.run.smithi044.stderr: 98750K .......... .......... .......... .......... .......... 58% 66.3M 8s 2024-03-30T13:13:53.109 INFO:teuthology.orchestra.run.smithi044.stderr: 98800K .......... .......... .......... .......... .......... 58% 66.3M 8s 2024-03-30T13:13:53.110 INFO:teuthology.orchestra.run.smithi044.stderr: 98850K .......... .......... .......... .......... .......... 58% 82.9M 8s 2024-03-30T13:13:53.110 INFO:teuthology.orchestra.run.smithi044.stderr: 98900K .......... .......... .......... .......... .......... 58% 70.8M 8s 2024-03-30T13:13:53.120 INFO:teuthology.orchestra.run.smithi044.stderr: 98950K .......... .......... .......... .......... .......... 58% 4.42M 8s 2024-03-30T13:13:53.126 INFO:teuthology.orchestra.run.smithi044.stderr: 99000K .......... .......... .......... .......... .......... 58% 8.29M 8s 2024-03-30T13:13:53.147 INFO:teuthology.orchestra.run.smithi044.stderr: 99050K .......... .......... .......... .......... .......... 58% 3.30M 8s 2024-03-30T13:13:53.147 INFO:teuthology.orchestra.run.smithi044.stderr: 99100K .......... .......... .......... .......... .......... 58% 55.3M 8s 2024-03-30T13:13:53.147 INFO:teuthology.orchestra.run.smithi044.stderr: 99150K .......... .......... .......... .......... .......... 58% 68.3M 8s 2024-03-30T13:13:53.147 INFO:teuthology.orchestra.run.smithi044.stderr: 99200K .......... .......... .......... .......... .......... 58% 51.8M 8s 2024-03-30T13:13:53.147 INFO:teuthology.orchestra.run.smithi044.stderr: 99250K .......... .......... .......... .......... .......... 58% 75.2M 8s 2024-03-30T13:13:53.147 INFO:teuthology.orchestra.run.smithi044.stderr: 99300K .......... .......... .......... .......... .......... 58% 63.2M 8s 2024-03-30T13:13:53.153 INFO:teuthology.orchestra.run.smithi044.stderr: 99350K .......... .......... .......... .......... .......... 58% 85.0M 8s 2024-03-30T13:13:53.162 INFO:teuthology.orchestra.run.smithi044.stderr: 99400K .......... .......... .......... .......... .......... 58% 2.89M 8s 2024-03-30T13:13:53.181 INFO:teuthology.orchestra.run.smithi044.stderr: 99450K .......... .......... .......... .......... .......... 59% 3.51M 8s 2024-03-30T13:13:53.181 INFO:teuthology.orchestra.run.smithi044.stderr: 99500K .......... .......... .......... .......... .......... 59% 54.1M 8s 2024-03-30T13:13:53.181 INFO:teuthology.orchestra.run.smithi044.stderr: 99550K .......... .......... .......... .......... .......... 59% 67.4M 8s 2024-03-30T13:13:53.181 INFO:teuthology.orchestra.run.smithi044.stderr: 99600K .......... .......... .......... .......... .......... 59% 57.3M 8s 2024-03-30T13:13:53.181 INFO:teuthology.orchestra.run.smithi044.stderr: 99650K .......... .......... .......... .......... .......... 59% 73.4M 8s 2024-03-30T13:13:53.181 INFO:teuthology.orchestra.run.smithi044.stderr: 99700K .......... .......... .......... .......... .......... 59% 81.7M 8s 2024-03-30T13:13:53.182 INFO:teuthology.orchestra.run.smithi044.stderr: 99750K .......... .......... .......... .......... .......... 59% 84.0M 8s 2024-03-30T13:13:53.191 INFO:teuthology.orchestra.run.smithi044.stderr: 99800K .......... .......... .......... .......... .......... 59% 4.42M 8s 2024-03-30T13:13:53.207 INFO:teuthology.orchestra.run.smithi044.stderr: 99850K .......... .......... .......... .......... .......... 59% 3.31M 8s 2024-03-30T13:13:53.217 INFO:teuthology.orchestra.run.smithi044.stderr: 99900K .......... .......... .......... .......... .......... 59% 7.99M 8s 2024-03-30T13:13:53.217 INFO:teuthology.orchestra.run.smithi044.stderr: 99950K .......... .......... .......... .......... .......... 59% 68.9M 8s 2024-03-30T13:13:53.217 INFO:teuthology.orchestra.run.smithi044.stderr:100000K .......... .......... .......... .......... .......... 59% 64.9M 8s 2024-03-30T13:13:53.217 INFO:teuthology.orchestra.run.smithi044.stderr:100050K .......... .......... .......... .......... .......... 59% 47.9M 8s 2024-03-30T13:13:53.217 INFO:teuthology.orchestra.run.smithi044.stderr:100100K .......... .......... .......... .......... .......... 59% 70.4M 8s 2024-03-30T13:13:53.218 INFO:teuthology.orchestra.run.smithi044.stderr:100150K .......... .......... .......... .......... .......... 59% 83.3M 8s 2024-03-30T13:13:53.225 INFO:teuthology.orchestra.run.smithi044.stderr:100200K .......... .......... .......... .......... .......... 59% 5.62M 8s 2024-03-30T13:13:53.233 INFO:teuthology.orchestra.run.smithi044.stderr:100250K .......... .......... .......... .......... .......... 59% 5.76M 8s 2024-03-30T13:13:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:100300K .......... .......... .......... .......... .......... 59% 3.43M 8s 2024-03-30T13:13:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:100350K .......... .......... .......... .......... .......... 59% 61.0M 8s 2024-03-30T13:13:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:100400K .......... .......... .......... .......... .......... 59% 56.6M 8s 2024-03-30T13:13:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:100450K .......... .......... .......... .......... .......... 59% 64.0M 8s 2024-03-30T13:13:53.252 INFO:teuthology.orchestra.run.smithi044.stderr:100500K .......... .......... .......... .......... .......... 59% 71.1M 8s 2024-03-30T13:13:53.253 INFO:teuthology.orchestra.run.smithi044.stderr:100550K .......... .......... .......... .......... .......... 59% 83.3M 8s 2024-03-30T13:13:53.253 INFO:teuthology.orchestra.run.smithi044.stderr:100600K .......... .......... .......... .......... .......... 59% 70.1M 8s 2024-03-30T13:13:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:100650K .......... .......... .......... .......... .......... 59% 4.58M 8s 2024-03-30T13:13:53.277 INFO:teuthology.orchestra.run.smithi044.stderr:100700K .......... .......... .......... .......... .......... 59% 3.33M 8s 2024-03-30T13:13:53.288 INFO:teuthology.orchestra.run.smithi044.stderr:100750K .......... .......... .......... .......... .......... 59% 7.83M 8s 2024-03-30T13:13:53.288 INFO:teuthology.orchestra.run.smithi044.stderr:100800K .......... .......... .......... .......... .......... 59% 62.8M 8s 2024-03-30T13:13:53.289 INFO:teuthology.orchestra.run.smithi044.stderr:100850K .......... .......... .......... .......... .......... 59% 64.3M 8s 2024-03-30T13:13:53.289 INFO:teuthology.orchestra.run.smithi044.stderr:100900K .......... .......... .......... .......... .......... 59% 67.5M 8s 2024-03-30T13:13:53.289 INFO:teuthology.orchestra.run.smithi044.stderr:100950K .......... .......... .......... .......... .......... 59% 66.2M 8s 2024-03-30T13:13:53.289 INFO:teuthology.orchestra.run.smithi044.stderr:101000K .......... .......... .......... .......... .......... 59% 72.1M 8s 2024-03-30T13:13:53.296 INFO:teuthology.orchestra.run.smithi044.stderr:101050K .......... .......... .......... .......... .......... 59% 5.50M 8s 2024-03-30T13:13:53.304 INFO:teuthology.orchestra.run.smithi044.stderr:101100K .......... .......... .......... .......... .......... 60% 5.75M 8s 2024-03-30T13:13:53.324 INFO:teuthology.orchestra.run.smithi044.stderr:101150K .......... .......... .......... .......... .......... 60% 3.44M 8s 2024-03-30T13:13:53.324 INFO:teuthology.orchestra.run.smithi044.stderr:101200K .......... .......... .......... .......... .......... 60% 68.3M 8s 2024-03-30T13:13:53.324 INFO:teuthology.orchestra.run.smithi044.stderr:101250K .......... .......... .......... .......... .......... 60% 58.0M 8s 2024-03-30T13:13:53.324 INFO:teuthology.orchestra.run.smithi044.stderr:101300K .......... .......... .......... .......... .......... 60% 68.9M 8s 2024-03-30T13:13:53.324 INFO:teuthology.orchestra.run.smithi044.stderr:101350K .......... .......... .......... .......... .......... 60% 65.7M 8s 2024-03-30T13:13:53.324 INFO:teuthology.orchestra.run.smithi044.stderr:101400K .......... .......... .......... .......... .......... 60% 83.9M 8s 2024-03-30T13:13:53.325 INFO:teuthology.orchestra.run.smithi044.stderr:101450K .......... .......... .......... .......... .......... 60% 69.4M 8s 2024-03-30T13:13:53.333 INFO:teuthology.orchestra.run.smithi044.stderr:101500K .......... .......... .......... .......... .......... 60% 4.60M 8s 2024-03-30T13:13:53.359 INFO:teuthology.orchestra.run.smithi044.stderr:101550K .......... .......... .......... .......... .......... 60% 2.41M 8s 2024-03-30T13:13:53.359 INFO:teuthology.orchestra.run.smithi044.stderr:101600K .......... .......... .......... .......... .......... 60% 57.1M 8s 2024-03-30T13:13:53.360 INFO:teuthology.orchestra.run.smithi044.stderr:101650K .......... .......... .......... .......... .......... 60% 56.9M 8s 2024-03-30T13:13:53.360 INFO:teuthology.orchestra.run.smithi044.stderr:101700K .......... .......... .......... .......... .......... 60% 65.4M 8s 2024-03-30T13:13:53.360 INFO:teuthology.orchestra.run.smithi044.stderr:101750K .......... .......... .......... .......... .......... 60% 69.0M 8s 2024-03-30T13:13:53.360 INFO:teuthology.orchestra.run.smithi044.stderr:101800K .......... .......... .......... .......... .......... 60% 76.3M 8s 2024-03-30T13:13:53.360 INFO:teuthology.orchestra.run.smithi044.stderr:101850K .......... .......... .......... .......... .......... 60% 72.5M 8s 2024-03-30T13:13:53.367 INFO:teuthology.orchestra.run.smithi044.stderr:101900K .......... .......... .......... .......... .......... 60% 5.54M 8s 2024-03-30T13:13:53.375 INFO:teuthology.orchestra.run.smithi044.stderr:101950K .......... .......... .......... .......... .......... 60% 5.84M 8s 2024-03-30T13:13:53.391 INFO:teuthology.orchestra.run.smithi044.stderr:102000K .......... .......... .......... .......... .......... 60% 3.36M 8s 2024-03-30T13:13:53.391 INFO:teuthology.orchestra.run.smithi044.stderr:102050K .......... .......... .......... .......... .......... 60% 65.0M 8s 2024-03-30T13:13:53.395 INFO:teuthology.orchestra.run.smithi044.stderr:102100K .......... .......... .......... .......... .......... 60% 67.7M 8s 2024-03-30T13:13:53.395 INFO:teuthology.orchestra.run.smithi044.stderr:102150K .......... .......... .......... .......... .......... 60% 35.9M 8s 2024-03-30T13:13:53.395 INFO:teuthology.orchestra.run.smithi044.stderr:102200K .......... .......... .......... .......... .......... 60% 61.6M 8s 2024-03-30T13:13:53.395 INFO:teuthology.orchestra.run.smithi044.stderr:102250K .......... .......... .......... .......... .......... 60% 69.5M 8s 2024-03-30T13:13:53.395 INFO:teuthology.orchestra.run.smithi044.stderr:102300K .......... .......... .......... .......... .......... 60% 81.9M 8s 2024-03-30T13:13:53.404 INFO:teuthology.orchestra.run.smithi044.stderr:102350K .......... .......... .......... .......... .......... 60% 5.01M 8s 2024-03-30T13:13:53.427 INFO:teuthology.orchestra.run.smithi044.stderr:102400K .......... .......... .......... .......... .......... 60% 2.37M 8s 2024-03-30T13:13:53.427 INFO:teuthology.orchestra.run.smithi044.stderr:102450K .......... .......... .......... .......... .......... 60% 65.4M 8s 2024-03-30T13:13:53.427 INFO:teuthology.orchestra.run.smithi044.stderr:102500K .......... .......... .......... .......... .......... 60% 62.1M 8s 2024-03-30T13:13:53.431 INFO:teuthology.orchestra.run.smithi044.stderr:102550K .......... .......... .......... .......... .......... 60% 41.7M 8s 2024-03-30T13:13:53.431 INFO:teuthology.orchestra.run.smithi044.stderr:102600K .......... .......... .......... .......... .......... 60% 63.1M 8s 2024-03-30T13:13:53.431 INFO:teuthology.orchestra.run.smithi044.stderr:102650K .......... .......... .......... .......... .......... 60% 57.9M 8s 2024-03-30T13:13:53.431 INFO:teuthology.orchestra.run.smithi044.stderr:102700K .......... .......... .......... .......... .......... 60% 79.1M 8s 2024-03-30T13:13:53.438 INFO:teuthology.orchestra.run.smithi044.stderr:102750K .......... .......... .......... .......... .......... 60% 6.15M 8s 2024-03-30T13:13:53.446 INFO:teuthology.orchestra.run.smithi044.stderr:102800K .......... .......... .......... .......... .......... 61% 5.82M 8s 2024-03-30T13:13:53.468 INFO:teuthology.orchestra.run.smithi044.stderr:102850K .......... .......... .......... .......... .......... 61% 3.36M 8s 2024-03-30T13:13:53.468 INFO:teuthology.orchestra.run.smithi044.stderr:102900K .......... .......... .......... .......... .......... 61% 62.9M 8s 2024-03-30T13:13:53.468 INFO:teuthology.orchestra.run.smithi044.stderr:102950K .......... .......... .......... .......... .......... 61% 63.2M 8s 2024-03-30T13:13:53.468 INFO:teuthology.orchestra.run.smithi044.stderr:103000K .......... .......... .......... .......... .......... 61% 34.7M 8s 2024-03-30T13:13:53.468 INFO:teuthology.orchestra.run.smithi044.stderr:103050K .......... .......... .......... .......... .......... 61% 63.0M 8s 2024-03-30T13:13:53.468 INFO:teuthology.orchestra.run.smithi044.stderr:103100K .......... .......... .......... .......... .......... 61% 63.9M 8s 2024-03-30T13:13:53.468 INFO:teuthology.orchestra.run.smithi044.stderr:103150K .......... .......... .......... .......... .......... 61% 81.5M 8s 2024-03-30T13:13:53.476 INFO:teuthology.orchestra.run.smithi044.stderr:103200K .......... .......... .......... .......... .......... 61% 5.02M 8s 2024-03-30T13:13:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:103250K .......... .......... .......... .......... .......... 61% 2.39M 8s 2024-03-30T13:13:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:103300K .......... .......... .......... .......... .......... 61% 57.0M 8s 2024-03-30T13:13:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:103350K .......... .......... .......... .......... .......... 61% 68.5M 8s 2024-03-30T13:13:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:103400K .......... .......... .......... .......... .......... 61% 51.2M 8s 2024-03-30T13:13:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:103450K .......... .......... .......... .......... .......... 61% 53.2M 8s 2024-03-30T13:13:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:103500K .......... .......... .......... .......... .......... 61% 57.1M 8s 2024-03-30T13:13:53.502 INFO:teuthology.orchestra.run.smithi044.stderr:103550K .......... .......... .......... .......... .......... 61% 83.1M 8s 2024-03-30T13:13:53.509 INFO:teuthology.orchestra.run.smithi044.stderr:103600K .......... .......... .......... .......... .......... 61% 6.08M 8s 2024-03-30T13:13:53.517 INFO:teuthology.orchestra.run.smithi044.stderr:103650K .......... .......... .......... .......... .......... 61% 5.87M 8s 2024-03-30T13:13:53.534 INFO:teuthology.orchestra.run.smithi044.stderr:103700K .......... .......... .......... .......... .......... 61% 3.36M 8s 2024-03-30T13:13:53.534 INFO:teuthology.orchestra.run.smithi044.stderr:103750K .......... .......... .......... .......... .......... 61% 56.6M 8s 2024-03-30T13:13:53.534 INFO:teuthology.orchestra.run.smithi044.stderr:103800K .......... .......... .......... .......... .......... 61% 51.6M 8s 2024-03-30T13:13:53.537 INFO:teuthology.orchestra.run.smithi044.stderr:103850K .......... .......... .......... .......... .......... 61% 42.1M 8s 2024-03-30T13:13:53.537 INFO:teuthology.orchestra.run.smithi044.stderr:103900K .......... .......... .......... .......... .......... 61% 64.5M 8s 2024-03-30T13:13:53.537 INFO:teuthology.orchestra.run.smithi044.stderr:103950K .......... .......... .......... .......... .......... 61% 64.6M 8s 2024-03-30T13:13:53.546 INFO:teuthology.orchestra.run.smithi044.stderr:104000K .......... .......... .......... .......... .......... 61% 6.15M 8s 2024-03-30T13:13:53.553 INFO:teuthology.orchestra.run.smithi044.stderr:104050K .......... .......... .......... .......... .......... 61% 6.02M 8s 2024-03-30T13:13:53.567 INFO:teuthology.orchestra.run.smithi044.stderr:104100K .......... .......... .......... .......... .......... 61% 3.34M 8s 2024-03-30T13:13:53.568 INFO:teuthology.orchestra.run.smithi044.stderr:104150K .......... .......... .......... .......... .......... 61% 63.4M 8s 2024-03-30T13:13:53.569 INFO:teuthology.orchestra.run.smithi044.stderr:104200K .......... .......... .......... .......... .......... 61% 40.4M 8s 2024-03-30T13:13:53.573 INFO:teuthology.orchestra.run.smithi044.stderr:104250K .......... .......... .......... .......... .......... 61% 43.9M 8s 2024-03-30T13:13:53.573 INFO:teuthology.orchestra.run.smithi044.stderr:104300K .......... .......... .......... .......... .......... 61% 60.4M 8s 2024-03-30T13:13:53.573 INFO:teuthology.orchestra.run.smithi044.stderr:104350K .......... .......... .......... .......... .......... 61% 66.3M 8s 2024-03-30T13:13:53.573 INFO:teuthology.orchestra.run.smithi044.stderr:104400K .......... .......... .......... .......... .......... 61% 70.5M 8s 2024-03-30T13:13:53.581 INFO:teuthology.orchestra.run.smithi044.stderr:104450K .......... .......... .......... .......... .......... 61% 5.43M 8s 2024-03-30T13:13:53.597 INFO:teuthology.orchestra.run.smithi044.stderr:104500K .......... .......... .......... .......... .......... 62% 3.21M 8s 2024-03-30T13:13:53.604 INFO:teuthology.orchestra.run.smithi044.stderr:104550K .......... .......... .......... .......... .......... 62% 7.54M 8s 2024-03-30T13:13:53.604 INFO:teuthology.orchestra.run.smithi044.stderr:104600K .......... .......... .......... .......... .......... 62% 60.5M 8s 2024-03-30T13:13:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:104650K .......... .......... .......... .......... .......... 62% 35.3M 7s 2024-03-30T13:13:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:104700K .......... .......... .......... .......... .......... 62% 54.2M 7s 2024-03-30T13:13:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:104750K .......... .......... .......... .......... .......... 62% 64.0M 7s 2024-03-30T13:13:53.608 INFO:teuthology.orchestra.run.smithi044.stderr:104800K .......... .......... .......... .......... .......... 62% 68.3M 7s 2024-03-30T13:13:53.616 INFO:teuthology.orchestra.run.smithi044.stderr:104850K .......... .......... .......... .......... .......... 62% 6.36M 7s 2024-03-30T13:13:53.624 INFO:teuthology.orchestra.run.smithi044.stderr:104900K .......... .......... .......... .......... .......... 62% 5.92M 7s 2024-03-30T13:13:53.640 INFO:teuthology.orchestra.run.smithi044.stderr:104950K .......... .......... .......... .......... .......... 62% 3.25M 7s 2024-03-30T13:13:53.641 INFO:teuthology.orchestra.run.smithi044.stderr:105000K .......... .......... .......... .......... .......... 62% 65.9M 7s 2024-03-30T13:13:53.641 INFO:teuthology.orchestra.run.smithi044.stderr:105050K .......... .......... .......... .......... .......... 62% 79.2M 7s 2024-03-30T13:13:53.644 INFO:teuthology.orchestra.run.smithi044.stderr:105100K .......... .......... .......... .......... .......... 62% 30.9M 7s 2024-03-30T13:13:53.645 INFO:teuthology.orchestra.run.smithi044.stderr:105150K .......... .......... .......... .......... .......... 62% 50.2M 7s 2024-03-30T13:13:53.645 INFO:teuthology.orchestra.run.smithi044.stderr:105200K .......... .......... .......... .......... .......... 62% 55.0M 7s 2024-03-30T13:13:53.645 INFO:teuthology.orchestra.run.smithi044.stderr:105250K .......... .......... .......... .......... .......... 62% 82.7M 7s 2024-03-30T13:13:53.652 INFO:teuthology.orchestra.run.smithi044.stderr:105300K .......... .......... .......... .......... .......... 62% 5.81M 7s 2024-03-30T13:13:53.668 INFO:teuthology.orchestra.run.smithi044.stderr:105350K .......... .......... .......... .......... .......... 62% 3.18M 7s 2024-03-30T13:13:53.676 INFO:teuthology.orchestra.run.smithi044.stderr:105400K .......... .......... .......... .......... .......... 62% 7.29M 7s 2024-03-30T13:13:53.676 INFO:teuthology.orchestra.run.smithi044.stderr:105450K .......... .......... .......... .......... .......... 62% 65.3M 7s 2024-03-30T13:13:53.680 INFO:teuthology.orchestra.run.smithi044.stderr:105500K .......... .......... .......... .......... .......... 62% 42.3M 7s 2024-03-30T13:13:53.680 INFO:teuthology.orchestra.run.smithi044.stderr:105550K .......... .......... .......... .......... .......... 62% 62.7M 7s 2024-03-30T13:13:53.680 INFO:teuthology.orchestra.run.smithi044.stderr:105600K .......... .......... .......... .......... .......... 62% 58.3M 7s 2024-03-30T13:13:53.680 INFO:teuthology.orchestra.run.smithi044.stderr:105650K .......... .......... .......... .......... .......... 62% 66.3M 7s 2024-03-30T13:13:53.687 INFO:teuthology.orchestra.run.smithi044.stderr:105700K .......... .......... .......... .......... .......... 62% 6.26M 7s 2024-03-30T13:13:53.695 INFO:teuthology.orchestra.run.smithi044.stderr:105750K .......... .......... .......... .......... .......... 62% 5.85M 7s 2024-03-30T13:13:53.716 INFO:teuthology.orchestra.run.smithi044.stderr:105800K .......... .......... .......... .......... .......... 62% 3.31M 7s 2024-03-30T13:13:53.716 INFO:teuthology.orchestra.run.smithi044.stderr:105850K .......... .......... .......... .......... .......... 62% 55.7M 7s 2024-03-30T13:13:53.716 INFO:teuthology.orchestra.run.smithi044.stderr:105900K .......... .......... .......... .......... .......... 62% 73.3M 7s 2024-03-30T13:13:53.716 INFO:teuthology.orchestra.run.smithi044.stderr:105950K .......... .......... .......... .......... .......... 62% 39.8M 7s 2024-03-30T13:13:53.716 INFO:teuthology.orchestra.run.smithi044.stderr:106000K .......... .......... .......... .......... .......... 62% 64.0M 7s 2024-03-30T13:13:53.716 INFO:teuthology.orchestra.run.smithi044.stderr:106050K .......... .......... .......... .......... .......... 62% 54.3M 7s 2024-03-30T13:13:53.717 INFO:teuthology.orchestra.run.smithi044.stderr:106100K .......... .......... .......... .......... .......... 62% 56.6M 7s 2024-03-30T13:13:53.724 INFO:teuthology.orchestra.run.smithi044.stderr:106150K .......... .......... .......... .......... .......... 63% 5.68M 7s 2024-03-30T13:13:53.739 INFO:teuthology.orchestra.run.smithi044.stderr:106200K .......... .......... .......... .......... .......... 63% 3.14M 7s 2024-03-30T13:13:53.753 INFO:teuthology.orchestra.run.smithi044.stderr:106250K .......... .......... .......... .......... .......... 63% 7.28M 7s 2024-03-30T13:13:53.753 INFO:teuthology.orchestra.run.smithi044.stderr:106300K .......... .......... .......... .......... .......... 63% 65.8M 7s 2024-03-30T13:13:53.753 INFO:teuthology.orchestra.run.smithi044.stderr:106350K .......... .......... .......... .......... .......... 63% 78.0M 7s 2024-03-30T13:13:53.753 INFO:teuthology.orchestra.run.smithi044.stderr:106400K .......... .......... .......... .......... .......... 63% 44.4M 7s 2024-03-30T13:13:53.753 INFO:teuthology.orchestra.run.smithi044.stderr:106450K .......... .......... .......... .......... .......... 63% 45.1M 7s 2024-03-30T13:13:53.753 INFO:teuthology.orchestra.run.smithi044.stderr:106500K .......... .......... .......... .......... .......... 63% 33.9M 7s 2024-03-30T13:13:53.754 INFO:teuthology.orchestra.run.smithi044.stderr:106550K .......... .......... .......... .......... .......... 63% 56.8M 7s 2024-03-30T13:13:53.763 INFO:teuthology.orchestra.run.smithi044.stderr:106600K .......... .......... .......... .......... .......... 63% 5.97M 7s 2024-03-30T13:13:53.785 INFO:teuthology.orchestra.run.smithi044.stderr:106650K .......... .......... .......... .......... .......... 63% 2.31M 7s 2024-03-30T13:13:53.785 INFO:teuthology.orchestra.run.smithi044.stderr:106700K .......... .......... .......... .......... .......... 63% 64.9M 7s 2024-03-30T13:13:53.785 INFO:teuthology.orchestra.run.smithi044.stderr:106750K .......... .......... .......... .......... .......... 63% 65.5M 7s 2024-03-30T13:13:53.785 INFO:teuthology.orchestra.run.smithi044.stderr:106800K .......... .......... .......... .......... .......... 63% 83.5M 7s 2024-03-30T13:13:53.785 INFO:teuthology.orchestra.run.smithi044.stderr:106850K .......... .......... .......... .......... .......... 63% 46.4M 7s 2024-03-30T13:13:53.787 INFO:teuthology.orchestra.run.smithi044.stderr:106900K .......... .......... .......... .......... .......... 63% 37.3M 7s 2024-03-30T13:13:53.787 INFO:teuthology.orchestra.run.smithi044.stderr:106950K .......... .......... .......... .......... .......... 63% 37.6M 7s 2024-03-30T13:13:53.793 INFO:teuthology.orchestra.run.smithi044.stderr:107000K .......... .......... .......... .......... .......... 63% 7.45M 7s 2024-03-30T13:13:53.803 INFO:teuthology.orchestra.run.smithi044.stderr:107050K .......... .......... .......... .......... .......... 63% 5.49M 7s 2024-03-30T13:13:53.821 INFO:teuthology.orchestra.run.smithi044.stderr:107100K .......... .......... .......... .......... .......... 63% 3.36M 7s 2024-03-30T13:13:53.821 INFO:teuthology.orchestra.run.smithi044.stderr:107150K .......... .......... .......... .......... .......... 63% 58.8M 7s 2024-03-30T13:13:53.822 INFO:teuthology.orchestra.run.smithi044.stderr:107200K .......... .......... .......... .......... .......... 63% 71.4M 7s 2024-03-30T13:13:53.822 INFO:teuthology.orchestra.run.smithi044.stderr:107250K .......... .......... .......... .......... .......... 63% 67.5M 7s 2024-03-30T13:13:53.822 INFO:teuthology.orchestra.run.smithi044.stderr:107300K .......... .......... .......... .......... .......... 63% 58.8M 7s 2024-03-30T13:13:53.822 INFO:teuthology.orchestra.run.smithi044.stderr:107350K .......... .......... .......... .......... .......... 63% 35.9M 7s 2024-03-30T13:13:53.823 INFO:teuthology.orchestra.run.smithi044.stderr:107400K .......... .......... .......... .......... .......... 63% 35.8M 7s 2024-03-30T13:13:53.830 INFO:teuthology.orchestra.run.smithi044.stderr:107450K .......... .......... .......... .......... .......... 63% 6.08M 7s 2024-03-30T13:13:53.838 INFO:teuthology.orchestra.run.smithi044.stderr:107500K .......... .......... .......... .......... .......... 63% 6.59M 7s 2024-03-30T13:13:53.857 INFO:teuthology.orchestra.run.smithi044.stderr:107550K .......... .......... .......... .......... .......... 63% 3.37M 7s 2024-03-30T13:13:53.857 INFO:teuthology.orchestra.run.smithi044.stderr:107600K .......... .......... .......... .......... .......... 63% 67.6M 7s 2024-03-30T13:13:53.857 INFO:teuthology.orchestra.run.smithi044.stderr:107650K .......... .......... .......... .......... .......... 63% 72.0M 7s 2024-03-30T13:13:53.858 INFO:teuthology.orchestra.run.smithi044.stderr:107700K .......... .......... .......... .......... .......... 63% 55.9M 7s 2024-03-30T13:13:53.858 INFO:teuthology.orchestra.run.smithi044.stderr:107750K .......... .......... .......... .......... .......... 63% 48.5M 7s 2024-03-30T13:13:53.858 INFO:teuthology.orchestra.run.smithi044.stderr:107800K .......... .......... .......... .......... .......... 63% 38.4M 7s 2024-03-30T13:13:53.859 INFO:teuthology.orchestra.run.smithi044.stderr:107850K .......... .......... .......... .......... .......... 64% 34.9M 7s 2024-03-30T13:13:53.866 INFO:teuthology.orchestra.run.smithi044.stderr:107900K .......... .......... .......... .......... .......... 64% 6.14M 7s 2024-03-30T13:13:53.888 INFO:teuthology.orchestra.run.smithi044.stderr:107950K .......... .......... .......... .......... .......... 64% 2.31M 7s 2024-03-30T13:13:53.892 INFO:teuthology.orchestra.run.smithi044.stderr:108000K .......... .......... .......... .......... .......... 64% 57.1M 7s 2024-03-30T13:13:53.893 INFO:teuthology.orchestra.run.smithi044.stderr:108050K .......... .......... .......... .......... .......... 64% 61.9M 7s 2024-03-30T13:13:53.893 INFO:teuthology.orchestra.run.smithi044.stderr:108100K .......... .......... .......... .......... .......... 64% 75.8M 7s 2024-03-30T13:13:53.893 INFO:teuthology.orchestra.run.smithi044.stderr:108150K .......... .......... .......... .......... .......... 64% 60.4M 7s 2024-03-30T13:13:53.893 INFO:teuthology.orchestra.run.smithi044.stderr:108200K .......... .......... .......... .......... .......... 64% 44.6M 7s 2024-03-30T13:13:53.894 INFO:teuthology.orchestra.run.smithi044.stderr:108250K .......... .......... .......... .......... .......... 64% 30.5M 7s 2024-03-30T13:13:53.900 INFO:teuthology.orchestra.run.smithi044.stderr:108300K .......... .......... .......... .......... .......... 64% 53.8M 7s 2024-03-30T13:13:53.909 INFO:teuthology.orchestra.run.smithi044.stderr:108350K .......... .......... .......... .......... .......... 64% 3.37M 7s 2024-03-30T13:13:53.928 INFO:teuthology.orchestra.run.smithi044.stderr:108400K .......... .......... .......... .......... .......... 64% 3.31M 7s 2024-03-30T13:13:53.928 INFO:teuthology.orchestra.run.smithi044.stderr:108450K .......... .......... .......... .......... .......... 64% 68.7M 7s 2024-03-30T13:13:53.928 INFO:teuthology.orchestra.run.smithi044.stderr:108500K .......... .......... .......... .......... .......... 64% 61.7M 7s 2024-03-30T13:13:53.928 INFO:teuthology.orchestra.run.smithi044.stderr:108550K .......... .......... .......... .......... .......... 64% 75.2M 7s 2024-03-30T13:13:53.928 INFO:teuthology.orchestra.run.smithi044.stderr:108600K .......... .......... .......... .......... .......... 64% 50.4M 7s 2024-03-30T13:13:53.928 INFO:teuthology.orchestra.run.smithi044.stderr:108650K .......... .......... .......... .......... .......... 64% 44.9M 7s 2024-03-30T13:13:53.930 INFO:teuthology.orchestra.run.smithi044.stderr:108700K .......... .......... .......... .......... .......... 64% 34.6M 7s 2024-03-30T13:13:53.936 INFO:teuthology.orchestra.run.smithi044.stderr:108750K .......... .......... .......... .......... .......... 64% 7.47M 7s 2024-03-30T13:13:53.944 INFO:teuthology.orchestra.run.smithi044.stderr:108800K .......... .......... .......... .......... .......... 64% 5.58M 7s 2024-03-30T13:13:53.965 INFO:teuthology.orchestra.run.smithi044.stderr:108850K .......... .......... .......... .......... .......... 64% 3.26M 7s 2024-03-30T13:13:53.966 INFO:teuthology.orchestra.run.smithi044.stderr:108900K .......... .......... .......... .......... .......... 64% 64.1M 7s 2024-03-30T13:13:53.966 INFO:teuthology.orchestra.run.smithi044.stderr:108950K .......... .......... .......... .......... .......... 64% 60.9M 7s 2024-03-30T13:13:53.966 INFO:teuthology.orchestra.run.smithi044.stderr:109000K .......... .......... .......... .......... .......... 64% 78.3M 7s 2024-03-30T13:13:53.966 INFO:teuthology.orchestra.run.smithi044.stderr:109050K .......... .......... .......... .......... .......... 64% 67.7M 7s 2024-03-30T13:13:53.966 INFO:teuthology.orchestra.run.smithi044.stderr:109100K .......... .......... .......... .......... .......... 64% 40.4M 7s 2024-03-30T13:13:53.966 INFO:teuthology.orchestra.run.smithi044.stderr:109150K .......... .......... .......... .......... .......... 64% 33.1M 7s 2024-03-30T13:13:53.972 INFO:teuthology.orchestra.run.smithi044.stderr:109200K .......... .......... .......... .......... .......... 64% 7.46M 7s 2024-03-30T13:13:53.988 INFO:teuthology.orchestra.run.smithi044.stderr:109250K .......... .......... .......... .......... .......... 64% 2.99M 7s 2024-03-30T13:13:53.998 INFO:teuthology.orchestra.run.smithi044.stderr:109300K .......... .......... .......... .......... .......... 64% 6.57M 7s 2024-03-30T13:13:53.998 INFO:teuthology.orchestra.run.smithi044.stderr:109350K .......... .......... .......... .......... .......... 64% 67.5M 7s 2024-03-30T13:13:53.998 INFO:teuthology.orchestra.run.smithi044.stderr:109400K .......... .......... .......... .......... .......... 64% 73.9M 7s 2024-03-30T13:13:53.999 INFO:teuthology.orchestra.run.smithi044.stderr:109450K .......... .......... .......... .......... .......... 64% 72.8M 7s 2024-03-30T13:13:53.999 INFO:teuthology.orchestra.run.smithi044.stderr:109500K .......... .......... .......... .......... .......... 64% 49.8M 7s 2024-03-30T13:13:54.000 INFO:teuthology.orchestra.run.smithi044.stderr:109550K .......... .......... .......... .......... .......... 65% 35.9M 7s 2024-03-30T13:13:54.001 INFO:teuthology.orchestra.run.smithi044.stderr:109600K .......... .......... .......... .......... .......... 65% 45.4M 7s 2024-03-30T13:13:54.008 INFO:teuthology.orchestra.run.smithi044.stderr:109650K .......... .......... .......... .......... .......... 65% 6.16M 7s 2024-03-30T13:13:54.035 INFO:teuthology.orchestra.run.smithi044.stderr:109700K .......... .......... .......... .......... .......... 65% 2.28M 7s 2024-03-30T13:13:54.035 INFO:teuthology.orchestra.run.smithi044.stderr:109750K .......... .......... .......... .......... .......... 65% 51.3M 7s 2024-03-30T13:13:54.035 INFO:teuthology.orchestra.run.smithi044.stderr:109800K .......... .......... .......... .......... .......... 65% 67.6M 7s 2024-03-30T13:13:54.035 INFO:teuthology.orchestra.run.smithi044.stderr:109850K .......... .......... .......... .......... .......... 65% 80.7M 7s 2024-03-30T13:13:54.035 INFO:teuthology.orchestra.run.smithi044.stderr:109900K .......... .......... .......... .......... .......... 65% 67.2M 7s 2024-03-30T13:13:54.035 INFO:teuthology.orchestra.run.smithi044.stderr:109950K .......... .......... .......... .......... .......... 65% 43.8M 7s 2024-03-30T13:13:54.036 INFO:teuthology.orchestra.run.smithi044.stderr:110000K .......... .......... .......... .......... .......... 65% 32.6M 7s 2024-03-30T13:13:54.042 INFO:teuthology.orchestra.run.smithi044.stderr:110050K .......... .......... .......... .......... .......... 65% 7.55M 7s 2024-03-30T13:13:54.051 INFO:teuthology.orchestra.run.smithi044.stderr:110100K .......... .......... .......... .......... .......... 65% 5.60M 7s 2024-03-30T13:13:54.066 INFO:teuthology.orchestra.run.smithi044.stderr:110150K .......... .......... .......... .......... .......... 65% 3.24M 7s 2024-03-30T13:13:54.072 INFO:teuthology.orchestra.run.smithi044.stderr:110200K .......... .......... .......... .......... .......... 65% 33.5M 7s 2024-03-30T13:13:54.072 INFO:teuthology.orchestra.run.smithi044.stderr:110250K .......... .......... .......... .......... .......... 65% 70.6M 7s 2024-03-30T13:13:54.072 INFO:teuthology.orchestra.run.smithi044.stderr:110300K .......... .......... .......... .......... .......... 65% 58.4M 7s 2024-03-30T13:13:54.072 INFO:teuthology.orchestra.run.smithi044.stderr:110350K .......... .......... .......... .......... .......... 65% 78.3M 7s 2024-03-30T13:13:54.072 INFO:teuthology.orchestra.run.smithi044.stderr:110400K .......... .......... .......... .......... .......... 65% 74.8M 7s 2024-03-30T13:13:54.072 INFO:teuthology.orchestra.run.smithi044.stderr:110450K .......... .......... .......... .......... .......... 65% 36.5M 7s 2024-03-30T13:13:54.078 INFO:teuthology.orchestra.run.smithi044.stderr:110500K .......... .......... .......... .......... .......... 65% 7.49M 7s 2024-03-30T13:13:54.087 INFO:teuthology.orchestra.run.smithi044.stderr:110550K .......... .......... .......... .......... .......... 65% 5.55M 7s 2024-03-30T13:13:54.101 INFO:teuthology.orchestra.run.smithi044.stderr:110600K .......... .......... .......... .......... .......... 65% 3.34M 7s 2024-03-30T13:13:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:110650K .......... .......... .......... .......... .......... 65% 32.2M 7s 2024-03-30T13:13:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:110700K .......... .......... .......... .......... .......... 65% 71.4M 7s 2024-03-30T13:13:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:110750K .......... .......... .......... .......... .......... 65% 61.0M 7s 2024-03-30T13:13:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:110800K .......... .......... .......... .......... .......... 65% 76.5M 7s 2024-03-30T13:13:54.106 INFO:teuthology.orchestra.run.smithi044.stderr:110850K .......... .......... .......... .......... .......... 65% 75.0M 7s 2024-03-30T13:13:54.108 INFO:teuthology.orchestra.run.smithi044.stderr:110900K .......... .......... .......... .......... .......... 65% 31.5M 7s 2024-03-30T13:13:54.114 INFO:teuthology.orchestra.run.smithi044.stderr:110950K .......... .......... .......... .......... .......... 65% 6.56M 7s 2024-03-30T13:13:54.130 INFO:teuthology.orchestra.run.smithi044.stderr:111000K .......... .......... .......... .......... .......... 65% 3.16M 7s 2024-03-30T13:13:54.137 INFO:teuthology.orchestra.run.smithi044.stderr:111050K .......... .......... .......... .......... .......... 65% 6.89M 7s 2024-03-30T13:13:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:111100K .......... .......... .......... .......... .......... 65% 31.1M 7s 2024-03-30T13:13:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:111150K .......... .......... .......... .......... .......... 65% 67.4M 7s 2024-03-30T13:13:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:111200K .......... .......... .......... .......... .......... 65% 58.3M 7s 2024-03-30T13:13:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:111250K .......... .......... .......... .......... .......... 66% 63.2M 7s 2024-03-30T13:13:54.142 INFO:teuthology.orchestra.run.smithi044.stderr:111300K .......... .......... .......... .......... .......... 66% 61.7M 7s 2024-03-30T13:13:54.143 INFO:teuthology.orchestra.run.smithi044.stderr:111350K .......... .......... .......... .......... .......... 66% 51.3M 7s 2024-03-30T13:13:54.151 INFO:teuthology.orchestra.run.smithi044.stderr:111400K .......... .......... .......... .......... .......... 66% 6.09M 7s 2024-03-30T13:13:54.173 INFO:teuthology.orchestra.run.smithi044.stderr:111450K .......... .......... .......... .......... .......... 66% 2.27M 7s 2024-03-30T13:13:54.178 INFO:teuthology.orchestra.run.smithi044.stderr:111500K .......... .......... .......... .......... .......... 66% 39.9M 7s 2024-03-30T13:13:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:111550K .......... .......... .......... .......... .......... 66% 56.3M 7s 2024-03-30T13:13:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:111600K .......... .......... .......... .......... .......... 66% 66.4M 7s 2024-03-30T13:13:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:111650K .......... .......... .......... .......... .......... 66% 58.3M 7s 2024-03-30T13:13:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:111700K .......... .......... .......... .......... .......... 66% 73.0M 7s 2024-03-30T13:13:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:111750K .......... .......... .......... .......... .......... 66% 40.4M 7s 2024-03-30T13:13:54.185 INFO:teuthology.orchestra.run.smithi044.stderr:111800K .......... .......... .......... .......... .......... 66% 7.42M 7s 2024-03-30T13:13:54.196 INFO:teuthology.orchestra.run.smithi044.stderr:111850K .......... .......... .......... .......... .......... 66% 4.20M 7s 2024-03-30T13:13:54.208 INFO:teuthology.orchestra.run.smithi044.stderr:111900K .......... .......... .......... .......... .......... 66% 4.06M 7s 2024-03-30T13:13:54.213 INFO:teuthology.orchestra.run.smithi044.stderr:111950K .......... .......... .......... .......... .......... 66% 34.4M 7s 2024-03-30T13:13:54.213 INFO:teuthology.orchestra.run.smithi044.stderr:112000K .......... .......... .......... .......... .......... 66% 72.9M 7s 2024-03-30T13:13:54.213 INFO:teuthology.orchestra.run.smithi044.stderr:112050K .......... .......... .......... .......... .......... 66% 68.4M 6s 2024-03-30T13:13:54.213 INFO:teuthology.orchestra.run.smithi044.stderr:112100K .......... .......... .......... .......... .......... 66% 59.1M 6s 2024-03-30T13:13:54.213 INFO:teuthology.orchestra.run.smithi044.stderr:112150K .......... .......... .......... .......... .......... 66% 77.6M 6s 2024-03-30T13:13:54.214 INFO:teuthology.orchestra.run.smithi044.stderr:112200K .......... .......... .......... .......... .......... 66% 35.8M 6s 2024-03-30T13:13:54.220 INFO:teuthology.orchestra.run.smithi044.stderr:112250K .......... .......... .......... .......... .......... 66% 7.51M 6s 2024-03-30T13:13:54.232 INFO:teuthology.orchestra.run.smithi044.stderr:112300K .......... .......... .......... .......... .......... 66% 4.23M 6s 2024-03-30T13:13:54.244 INFO:teuthology.orchestra.run.smithi044.stderr:112350K .......... .......... .......... .......... .......... 66% 4.06M 6s 2024-03-30T13:13:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:112400K .......... .......... .......... .......... .......... 66% 37.9M 6s 2024-03-30T13:13:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:112450K .......... .......... .......... .......... .......... 66% 65.4M 6s 2024-03-30T13:13:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:112500K .......... .......... .......... .......... .......... 66% 66.6M 6s 2024-03-30T13:13:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:112550K .......... .......... .......... .......... .......... 66% 69.4M 6s 2024-03-30T13:13:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:112600K .......... .......... .......... .......... .......... 66% 64.0M 6s 2024-03-30T13:13:54.250 INFO:teuthology.orchestra.run.smithi044.stderr:112650K .......... .......... .......... .......... .......... 66% 35.0M 6s 2024-03-30T13:13:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:112700K .......... .......... .......... .......... .......... 66% 6.63M 6s 2024-03-30T13:13:54.267 INFO:teuthology.orchestra.run.smithi044.stderr:112750K .......... .......... .......... .......... .......... 66% 4.65M 6s 2024-03-30T13:13:54.280 INFO:teuthology.orchestra.run.smithi044.stderr:112800K .......... .......... .......... .......... .......... 66% 3.96M 6s 2024-03-30T13:13:54.286 INFO:teuthology.orchestra.run.smithi044.stderr:112850K .......... .......... .......... .......... .......... 66% 45.3M 6s 2024-03-30T13:13:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:112900K .......... .......... .......... .......... .......... 67% 68.0M 6s 2024-03-30T13:13:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:112950K .......... .......... .......... .......... .......... 67% 58.7M 6s 2024-03-30T13:13:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:113000K .......... .......... .......... .......... .......... 67% 72.4M 6s 2024-03-30T13:13:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:113050K .......... .......... .......... .......... .......... 67% 77.8M 6s 2024-03-30T13:13:54.287 INFO:teuthology.orchestra.run.smithi044.stderr:113100K .......... .......... .......... .......... .......... 67% 28.3M 6s 2024-03-30T13:13:54.291 INFO:teuthology.orchestra.run.smithi044.stderr:113150K .......... .......... .......... .......... .......... 67% 8.00M 6s 2024-03-30T13:13:54.308 INFO:teuthology.orchestra.run.smithi044.stderr:113200K .......... .......... .......... .......... .......... 67% 2.99M 6s 2024-03-30T13:13:54.320 INFO:teuthology.orchestra.run.smithi044.stderr:113250K .......... .......... .......... .......... .......... 67% 6.59M 6s 2024-03-30T13:13:54.320 INFO:teuthology.orchestra.run.smithi044.stderr:113300K .......... .......... .......... .......... .......... 67% 46.6M 6s 2024-03-30T13:13:54.320 INFO:teuthology.orchestra.run.smithi044.stderr:113350K .......... .......... .......... .......... .......... 67% 64.6M 6s 2024-03-30T13:13:54.320 INFO:teuthology.orchestra.run.smithi044.stderr:113400K .......... .......... .......... .......... .......... 67% 66.3M 6s 2024-03-30T13:13:54.320 INFO:teuthology.orchestra.run.smithi044.stderr:113450K .......... .......... .......... .......... .......... 67% 53.9M 6s 2024-03-30T13:13:54.320 INFO:teuthology.orchestra.run.smithi044.stderr:113500K .......... .......... .......... .......... .......... 67% 81.8M 6s 2024-03-30T13:13:54.321 INFO:teuthology.orchestra.run.smithi044.stderr:113550K .......... .......... .......... .......... .......... 67% 31.0M 6s 2024-03-30T13:13:54.328 INFO:teuthology.orchestra.run.smithi044.stderr:113600K .......... .......... .......... .......... .......... 67% 7.97M 6s 2024-03-30T13:13:54.343 INFO:teuthology.orchestra.run.smithi044.stderr:113650K .......... .......... .......... .......... .......... 67% 4.20M 6s 2024-03-30T13:13:54.357 INFO:teuthology.orchestra.run.smithi044.stderr:113700K .......... .......... .......... .......... .......... 67% 3.98M 6s 2024-03-30T13:13:54.357 INFO:teuthology.orchestra.run.smithi044.stderr:113750K .......... .......... .......... .......... .......... 67% 54.4M 6s 2024-03-30T13:13:54.357 INFO:teuthology.orchestra.run.smithi044.stderr:113800K .......... .......... .......... .......... .......... 67% 58.9M 6s 2024-03-30T13:13:54.357 INFO:teuthology.orchestra.run.smithi044.stderr:113850K .......... .......... .......... .......... .......... 67% 70.3M 6s 2024-03-30T13:13:54.357 INFO:teuthology.orchestra.run.smithi044.stderr:113900K .......... .......... .......... .......... .......... 67% 71.0M 6s 2024-03-30T13:13:54.357 INFO:teuthology.orchestra.run.smithi044.stderr:113950K .......... .......... .......... .......... .......... 67% 72.8M 6s 2024-03-30T13:13:54.357 INFO:teuthology.orchestra.run.smithi044.stderr:114000K .......... .......... .......... .......... .......... 67% 29.0M 6s 2024-03-30T13:13:54.363 INFO:teuthology.orchestra.run.smithi044.stderr:114050K .......... .......... .......... .......... .......... 67% 6.80M 6s 2024-03-30T13:13:54.374 INFO:teuthology.orchestra.run.smithi044.stderr:114100K .......... .......... .......... .......... .......... 67% 4.66M 6s 2024-03-30T13:13:54.391 INFO:teuthology.orchestra.run.smithi044.stderr:114150K .......... .......... .......... .......... .......... 67% 3.92M 6s 2024-03-30T13:13:54.391 INFO:teuthology.orchestra.run.smithi044.stderr:114200K .......... .......... .......... .......... .......... 67% 55.8M 6s 2024-03-30T13:13:54.391 INFO:teuthology.orchestra.run.smithi044.stderr:114250K .......... .......... .......... .......... .......... 67% 65.2M 6s 2024-03-30T13:13:54.391 INFO:teuthology.orchestra.run.smithi044.stderr:114300K .......... .......... .......... .......... .......... 67% 65.9M 6s 2024-03-30T13:13:54.391 INFO:teuthology.orchestra.run.smithi044.stderr:114350K .......... .......... .......... .......... .......... 67% 70.2M 6s 2024-03-30T13:13:54.391 INFO:teuthology.orchestra.run.smithi044.stderr:114400K .......... .......... .......... .......... .......... 67% 62.1M 6s 2024-03-30T13:13:54.392 INFO:teuthology.orchestra.run.smithi044.stderr:114450K .......... .......... .......... .......... .......... 67% 30.0M 6s 2024-03-30T13:13:54.397 INFO:teuthology.orchestra.run.smithi044.stderr:114500K .......... .......... .......... .......... .......... 67% 8.23M 6s 2024-03-30T13:13:54.409 INFO:teuthology.orchestra.run.smithi044.stderr:114550K .......... .......... .......... .......... .......... 67% 18.9M 6s 2024-03-30T13:13:54.426 INFO:teuthology.orchestra.run.smithi044.stderr:114600K .......... .......... .......... .......... .......... 68% 2.27M 6s 2024-03-30T13:13:54.426 INFO:teuthology.orchestra.run.smithi044.stderr:114650K .......... .......... .......... .......... .......... 68% 56.6M 6s 2024-03-30T13:13:54.426 INFO:teuthology.orchestra.run.smithi044.stderr:114700K .......... .......... .......... .......... .......... 68% 67.9M 6s 2024-03-30T13:13:54.426 INFO:teuthology.orchestra.run.smithi044.stderr:114750K .......... .......... .......... .......... .......... 68% 69.4M 6s 2024-03-30T13:13:54.426 INFO:teuthology.orchestra.run.smithi044.stderr:114800K .......... .......... .......... .......... .......... 68% 62.6M 6s 2024-03-30T13:13:54.426 INFO:teuthology.orchestra.run.smithi044.stderr:114850K .......... .......... .......... .......... .......... 68% 71.6M 6s 2024-03-30T13:13:54.428 INFO:teuthology.orchestra.run.smithi044.stderr:114900K .......... .......... .......... .......... .......... 68% 31.0M 6s 2024-03-30T13:13:54.433 INFO:teuthology.orchestra.run.smithi044.stderr:114950K .......... .......... .......... .......... .......... 68% 7.91M 6s 2024-03-30T13:13:54.436 INFO:teuthology.orchestra.run.smithi044.stderr:115000K .......... .......... .......... .......... .......... 68% 21.0M 6s 2024-03-30T13:13:54.462 INFO:teuthology.orchestra.run.smithi044.stderr:115050K .......... .......... .......... .......... .......... 68% 2.26M 6s 2024-03-30T13:13:54.462 INFO:teuthology.orchestra.run.smithi044.stderr:115100K .......... .......... .......... .......... .......... 68% 57.0M 6s 2024-03-30T13:13:54.462 INFO:teuthology.orchestra.run.smithi044.stderr:115150K .......... .......... .......... .......... .......... 68% 56.2M 6s 2024-03-30T13:13:54.462 INFO:teuthology.orchestra.run.smithi044.stderr:115200K .......... .......... .......... .......... .......... 68% 61.2M 6s 2024-03-30T13:13:54.462 INFO:teuthology.orchestra.run.smithi044.stderr:115250K .......... .......... .......... .......... .......... 68% 75.8M 6s 2024-03-30T13:13:54.462 INFO:teuthology.orchestra.run.smithi044.stderr:115300K .......... .......... .......... .......... .......... 68% 70.7M 6s 2024-03-30T13:13:54.464 INFO:teuthology.orchestra.run.smithi044.stderr:115350K .......... .......... .......... .......... .......... 68% 29.3M 6s 2024-03-30T13:13:54.469 INFO:teuthology.orchestra.run.smithi044.stderr:115400K .......... .......... .......... .......... .......... 68% 8.15M 6s 2024-03-30T13:13:54.471 INFO:teuthology.orchestra.run.smithi044.stderr:115450K .......... .......... .......... .......... .......... 68% 20.6M 6s 2024-03-30T13:13:54.493 INFO:teuthology.orchestra.run.smithi044.stderr:115500K .......... .......... .......... .......... .......... 68% 2.27M 6s 2024-03-30T13:13:54.499 INFO:teuthology.orchestra.run.smithi044.stderr:115550K .......... .......... .......... .......... .......... 68% 51.7M 6s 2024-03-30T13:13:54.499 INFO:teuthology.orchestra.run.smithi044.stderr:115600K .......... .......... .......... .......... .......... 68% 57.0M 6s 2024-03-30T13:13:54.499 INFO:teuthology.orchestra.run.smithi044.stderr:115650K .......... .......... .......... .......... .......... 68% 72.1M 6s 2024-03-30T13:13:54.499 INFO:teuthology.orchestra.run.smithi044.stderr:115700K .......... .......... .......... .......... .......... 68% 70.1M 6s 2024-03-30T13:13:54.499 INFO:teuthology.orchestra.run.smithi044.stderr:115750K .......... .......... .......... .......... .......... 68% 64.4M 6s 2024-03-30T13:13:54.499 INFO:teuthology.orchestra.run.smithi044.stderr:115800K .......... .......... .......... .......... .......... 68% 67.0M 6s 2024-03-30T13:13:54.499 INFO:teuthology.orchestra.run.smithi044.stderr:115850K .......... .......... .......... .......... .......... 68% 32.2M 6s 2024-03-30T13:13:54.507 INFO:teuthology.orchestra.run.smithi044.stderr:115900K .......... .......... .......... .......... .......... 68% 6.45M 6s 2024-03-30T13:13:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:115950K .......... .......... .......... .......... .......... 68% 2.25M 6s 2024-03-30T13:13:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:116000K .......... .......... .......... .......... .......... 68% 54.7M 6s 2024-03-30T13:13:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:116050K .......... .......... .......... .......... .......... 68% 65.7M 6s 2024-03-30T13:13:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:116100K .......... .......... .......... .......... .......... 68% 66.1M 6s 2024-03-30T13:13:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:116150K .......... .......... .......... .......... .......... 68% 72.6M 6s 2024-03-30T13:13:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:116200K .......... .......... .......... .......... .......... 68% 60.2M 6s 2024-03-30T13:13:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:116250K .......... .......... .......... .......... .......... 68% 73.2M 6s 2024-03-30T13:13:54.535 INFO:teuthology.orchestra.run.smithi044.stderr:116300K .......... .......... .......... .......... .......... 69% 32.5M 6s 2024-03-30T13:13:54.541 INFO:teuthology.orchestra.run.smithi044.stderr:116350K .......... .......... .......... .......... .......... 69% 7.02M 6s 2024-03-30T13:13:54.553 INFO:teuthology.orchestra.run.smithi044.stderr:116400K .......... .......... .......... .......... .......... 69% 4.54M 6s 2024-03-30T13:13:54.571 INFO:teuthology.orchestra.run.smithi044.stderr:116450K .......... .......... .......... .......... .......... 69% 3.92M 6s 2024-03-30T13:13:54.571 INFO:teuthology.orchestra.run.smithi044.stderr:116500K .......... .......... .......... .......... .......... 69% 66.4M 6s 2024-03-30T13:13:54.571 INFO:teuthology.orchestra.run.smithi044.stderr:116550K .......... .......... .......... .......... .......... 69% 59.1M 6s 2024-03-30T13:13:54.571 INFO:teuthology.orchestra.run.smithi044.stderr:116600K .......... .......... .......... .......... .......... 69% 68.5M 6s 2024-03-30T13:13:54.571 INFO:teuthology.orchestra.run.smithi044.stderr:116650K .......... .......... .......... .......... .......... 69% 69.4M 6s 2024-03-30T13:13:54.571 INFO:teuthology.orchestra.run.smithi044.stderr:116700K .......... .......... .......... .......... .......... 69% 68.3M 6s 2024-03-30T13:13:54.571 INFO:teuthology.orchestra.run.smithi044.stderr:116750K .......... .......... .......... .......... .......... 69% 40.8M 6s 2024-03-30T13:13:54.576 INFO:teuthology.orchestra.run.smithi044.stderr:116800K .......... .......... .......... .......... .......... 69% 7.72M 6s 2024-03-30T13:13:54.587 INFO:teuthology.orchestra.run.smithi044.stderr:116850K .......... .......... .......... .......... .......... 69% 4.18M 6s 2024-03-30T13:13:54.602 INFO:teuthology.orchestra.run.smithi044.stderr:116900K .......... .......... .......... .......... .......... 69% 3.57M 6s 2024-03-30T13:13:54.603 INFO:teuthology.orchestra.run.smithi044.stderr:116950K .......... .......... .......... .......... .......... 69% 31.8M 6s 2024-03-30T13:13:54.604 INFO:teuthology.orchestra.run.smithi044.stderr:117000K .......... .......... .......... .......... .......... 69% 32.5M 6s 2024-03-30T13:13:54.606 INFO:teuthology.orchestra.run.smithi044.stderr:117050K .......... .......... .......... .......... .......... 69% 44.7M 6s 2024-03-30T13:13:54.607 INFO:teuthology.orchestra.run.smithi044.stderr:117100K .......... .......... .......... .......... .......... 69% 28.2M 6s 2024-03-30T13:13:54.608 INFO:teuthology.orchestra.run.smithi044.stderr:117150K .......... .......... .......... .......... .......... 69% 35.5M 6s 2024-03-30T13:13:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:117200K .......... .......... .......... .......... .......... 69% 23.9M 6s 2024-03-30T13:13:54.611 INFO:teuthology.orchestra.run.smithi044.stderr:117250K .......... .......... .......... .......... .......... 69% 61.6M 6s 2024-03-30T13:13:54.613 INFO:teuthology.orchestra.run.smithi044.stderr:117300K .......... .......... .......... .......... .......... 69% 23.1M 6s 2024-03-30T13:13:54.628 INFO:teuthology.orchestra.run.smithi044.stderr:117350K .......... .......... .......... .......... .......... 69% 3.30M 6s 2024-03-30T13:13:54.637 INFO:teuthology.orchestra.run.smithi044.stderr:117400K .......... .......... .......... .......... .......... 69% 5.30M 6s 2024-03-30T13:13:54.639 INFO:teuthology.orchestra.run.smithi044.stderr:117450K .......... .......... .......... .......... .......... 69% 29.3M 6s 2024-03-30T13:13:54.640 INFO:teuthology.orchestra.run.smithi044.stderr:117500K .......... .......... .......... .......... .......... 69% 43.0M 6s 2024-03-30T13:13:54.643 INFO:teuthology.orchestra.run.smithi044.stderr:117550K .......... .......... .......... .......... .......... 69% 23.9M 6s 2024-03-30T13:13:54.644 INFO:teuthology.orchestra.run.smithi044.stderr:117600K .......... .......... .......... .......... .......... 69% 46.2M 6s 2024-03-30T13:13:54.645 INFO:teuthology.orchestra.run.smithi044.stderr:117650K .......... .......... .......... .......... .......... 69% 29.4M 6s 2024-03-30T13:13:54.648 INFO:teuthology.orchestra.run.smithi044.stderr:117700K .......... .......... .......... .......... .......... 69% 27.0M 6s 2024-03-30T13:13:54.648 INFO:teuthology.orchestra.run.smithi044.stderr:117750K .......... .......... .......... .......... .......... 69% 42.4M 6s 2024-03-30T13:13:54.659 INFO:teuthology.orchestra.run.smithi044.stderr:117800K .......... .......... .......... .......... .......... 69% 4.35M 6s 2024-03-30T13:13:54.673 INFO:teuthology.orchestra.run.smithi044.stderr:117850K .......... .......... .......... .......... .......... 69% 3.67M 6s 2024-03-30T13:13:54.673 INFO:teuthology.orchestra.run.smithi044.stderr:117900K .......... .......... .......... .......... .......... 69% 34.3M 6s 2024-03-30T13:13:54.676 INFO:teuthology.orchestra.run.smithi044.stderr:117950K .......... .......... .......... .......... .......... 70% 31.6M 6s 2024-03-30T13:13:54.676 INFO:teuthology.orchestra.run.smithi044.stderr:118000K .......... .......... .......... .......... .......... 70% 56.1M 6s 2024-03-30T13:13:54.679 INFO:teuthology.orchestra.run.smithi044.stderr:118050K .......... .......... .......... .......... .......... 70% 27.1M 6s 2024-03-30T13:13:54.679 INFO:teuthology.orchestra.run.smithi044.stderr:118100K .......... .......... .......... .......... .......... 70% 32.1M 6s 2024-03-30T13:13:54.683 INFO:teuthology.orchestra.run.smithi044.stderr:118150K .......... .......... .......... .......... .......... 70% 22.2M 6s 2024-03-30T13:13:54.683 INFO:teuthology.orchestra.run.smithi044.stderr:118200K .......... .......... .......... .......... .......... 70% 68.1M 6s 2024-03-30T13:13:54.684 INFO:teuthology.orchestra.run.smithi044.stderr:118250K .......... .......... .......... .......... .......... 70% 26.4M 6s 2024-03-30T13:13:54.695 INFO:teuthology.orchestra.run.smithi044.stderr:118300K .......... .......... .......... .......... .......... 70% 4.58M 6s 2024-03-30T13:13:54.708 INFO:teuthology.orchestra.run.smithi044.stderr:118350K .......... .......... .......... .......... .......... 70% 3.65M 6s 2024-03-30T13:13:54.711 INFO:teuthology.orchestra.run.smithi044.stderr:118400K .......... .......... .......... .......... .......... 70% 26.3M 6s 2024-03-30T13:13:54.711 INFO:teuthology.orchestra.run.smithi044.stderr:118450K .......... .......... .......... .......... .......... 70% 48.4M 6s 2024-03-30T13:13:54.712 INFO:teuthology.orchestra.run.smithi044.stderr:118500K .......... .......... .......... .......... .......... 70% 35.8M 6s 2024-03-30T13:13:54.715 INFO:teuthology.orchestra.run.smithi044.stderr:118550K .......... .......... .......... .......... .......... 70% 34.3M 6s 2024-03-30T13:13:54.716 INFO:teuthology.orchestra.run.smithi044.stderr:118600K .......... .......... .......... .......... .......... 70% 21.9M 6s 2024-03-30T13:13:54.719 INFO:teuthology.orchestra.run.smithi044.stderr:118650K .......... .......... .......... .......... .......... 70% 27.5M 6s 2024-03-30T13:13:54.719 INFO:teuthology.orchestra.run.smithi044.stderr:118700K .......... .......... .......... .......... .......... 70% 45.2M 6s 2024-03-30T13:13:54.731 INFO:teuthology.orchestra.run.smithi044.stderr:118750K .......... .......... .......... .......... .......... 70% 4.17M 6s 2024-03-30T13:13:54.753 INFO:teuthology.orchestra.run.smithi044.stderr:118800K .......... .......... .......... .......... .......... 70% 2.21M 6s 2024-03-30T13:13:54.755 INFO:teuthology.orchestra.run.smithi044.stderr:118850K .......... .......... .......... .......... .......... 70% 23.2M 6s 2024-03-30T13:13:54.759 INFO:teuthology.orchestra.run.smithi044.stderr:118900K .......... .......... .......... .......... .......... 70% 11.1M 6s 2024-03-30T13:13:54.762 INFO:teuthology.orchestra.run.smithi044.stderr:118950K .......... .......... .......... .......... .......... 70% 15.6M 6s 2024-03-30T13:13:54.766 INFO:teuthology.orchestra.run.smithi044.stderr:119000K .......... .......... .......... .......... .......... 70% 14.0M 6s 2024-03-30T13:13:54.767 INFO:teuthology.orchestra.run.smithi044.stderr:119050K .......... .......... .......... .......... .......... 70% 37.7M 6s 2024-03-30T13:13:54.771 INFO:teuthology.orchestra.run.smithi044.stderr:119100K .......... .......... .......... .......... .......... 70% 14.9M 6s 2024-03-30T13:13:54.773 INFO:teuthology.orchestra.run.smithi044.stderr:119150K .......... .......... .......... .......... .......... 70% 21.4M 6s 2024-03-30T13:13:54.774 INFO:teuthology.orchestra.run.smithi044.stderr:119200K .......... .......... .......... .......... .......... 70% 27.9M 6s 2024-03-30T13:13:54.788 INFO:teuthology.orchestra.run.smithi044.stderr:119250K .......... .......... .......... .......... .......... 70% 3.60M 6s 2024-03-30T13:13:54.813 INFO:teuthology.orchestra.run.smithi044.stderr:119300K .......... .......... .......... .......... .......... 70% 2.27M 6s 2024-03-30T13:13:54.813 INFO:teuthology.orchestra.run.smithi044.stderr:119350K .......... .......... .......... .......... .......... 70% 51.2M 6s 2024-03-30T13:13:54.813 INFO:teuthology.orchestra.run.smithi044.stderr:119400K .......... .......... .......... .......... .......... 70% 61.9M 6s 2024-03-30T13:13:54.813 INFO:teuthology.orchestra.run.smithi044.stderr:119450K .......... .......... .......... .......... .......... 70% 67.7M 6s 2024-03-30T13:13:54.813 INFO:teuthology.orchestra.run.smithi044.stderr:119500K .......... .......... .......... .......... .......... 70% 66.8M 6s 2024-03-30T13:13:54.816 INFO:teuthology.orchestra.run.smithi044.stderr:119550K .......... .......... .......... .......... .......... 70% 72.5M 6s 2024-03-30T13:13:54.816 INFO:teuthology.orchestra.run.smithi044.stderr:119600K .......... .......... .......... .......... .......... 70% 56.6M 6s 2024-03-30T13:13:54.816 INFO:teuthology.orchestra.run.smithi044.stderr:119650K .......... .......... .......... .......... .......... 71% 67.5M 6s 2024-03-30T13:13:54.816 INFO:teuthology.orchestra.run.smithi044.stderr:119700K .......... .......... .......... .......... .......... 71% 82.2M 6s 2024-03-30T13:13:54.824 INFO:teuthology.orchestra.run.smithi044.stderr:119750K .......... .......... .......... .......... .......... 71% 6.00M 5s 2024-03-30T13:13:54.849 INFO:teuthology.orchestra.run.smithi044.stderr:119800K .......... .......... .......... .......... .......... 71% 2.26M 5s 2024-03-30T13:13:54.849 INFO:teuthology.orchestra.run.smithi044.stderr:119850K .......... .......... .......... .......... .......... 71% 58.5M 5s 2024-03-30T13:13:54.849 INFO:teuthology.orchestra.run.smithi044.stderr:119900K .......... .......... .......... .......... .......... 71% 68.7M 5s 2024-03-30T13:13:54.849 INFO:teuthology.orchestra.run.smithi044.stderr:119950K .......... .......... .......... .......... .......... 71% 67.9M 5s 2024-03-30T13:13:54.849 INFO:teuthology.orchestra.run.smithi044.stderr:120000K .......... .......... .......... .......... .......... 71% 62.7M 5s 2024-03-30T13:13:54.849 INFO:teuthology.orchestra.run.smithi044.stderr:120050K .......... .......... .......... .......... .......... 71% 59.9M 5s 2024-03-30T13:13:54.851 INFO:teuthology.orchestra.run.smithi044.stderr:120100K .......... .......... .......... .......... .......... 71% 64.7M 5s 2024-03-30T13:13:54.851 INFO:teuthology.orchestra.run.smithi044.stderr:120150K .......... .......... .......... .......... .......... 71% 68.5M 5s 2024-03-30T13:13:54.852 INFO:teuthology.orchestra.run.smithi044.stderr:120200K .......... .......... .......... .......... .......... 71% 84.7M 5s 2024-03-30T13:13:54.866 INFO:teuthology.orchestra.run.smithi044.stderr:120250K .......... .......... .......... .......... .......... 71% 3.27M 5s 2024-03-30T13:13:54.881 INFO:teuthology.orchestra.run.smithi044.stderr:120300K .......... .......... .......... .......... .......... 71% 3.30M 5s 2024-03-30T13:13:54.884 INFO:teuthology.orchestra.run.smithi044.stderr:120350K .......... .......... .......... .......... .......... 71% 60.6M 5s 2024-03-30T13:13:54.884 INFO:teuthology.orchestra.run.smithi044.stderr:120400K .......... .......... .......... .......... .......... 71% 59.8M 5s 2024-03-30T13:13:54.884 INFO:teuthology.orchestra.run.smithi044.stderr:120450K .......... .......... .......... .......... .......... 71% 74.9M 5s 2024-03-30T13:13:54.884 INFO:teuthology.orchestra.run.smithi044.stderr:120500K .......... .......... .......... .......... .......... 71% 67.2M 5s 2024-03-30T13:13:54.886 INFO:teuthology.orchestra.run.smithi044.stderr:120550K .......... .......... .......... .......... .......... 71% 42.3M 5s 2024-03-30T13:13:54.886 INFO:teuthology.orchestra.run.smithi044.stderr:120600K .......... .......... .......... .......... .......... 71% 54.5M 5s 2024-03-30T13:13:54.887 INFO:teuthology.orchestra.run.smithi044.stderr:120650K .......... .......... .......... .......... .......... 71% 57.8M 5s 2024-03-30T13:13:54.887 INFO:teuthology.orchestra.run.smithi044.stderr:120700K .......... .......... .......... .......... .......... 71% 84.6M 5s 2024-03-30T13:13:54.902 INFO:teuthology.orchestra.run.smithi044.stderr:120750K .......... .......... .......... .......... .......... 71% 3.39M 5s 2024-03-30T13:13:54.917 INFO:teuthology.orchestra.run.smithi044.stderr:120800K .......... .......... .......... .......... .......... 71% 3.31M 5s 2024-03-30T13:13:54.918 INFO:teuthology.orchestra.run.smithi044.stderr:120850K .......... .......... .......... .......... .......... 71% 60.0M 5s 2024-03-30T13:13:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:120900K .......... .......... .......... .......... .......... 71% 68.9M 5s 2024-03-30T13:13:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:120950K .......... .......... .......... .......... .......... 71% 54.8M 5s 2024-03-30T13:13:54.920 INFO:teuthology.orchestra.run.smithi044.stderr:121000K .......... .......... .......... .......... .......... 71% 59.7M 5s 2024-03-30T13:13:54.921 INFO:teuthology.orchestra.run.smithi044.stderr:121050K .......... .......... .......... .......... .......... 71% 31.6M 5s 2024-03-30T13:13:54.924 INFO:teuthology.orchestra.run.smithi044.stderr:121100K .......... .......... .......... .......... .......... 71% 44.5M 5s 2024-03-30T13:13:54.924 INFO:teuthology.orchestra.run.smithi044.stderr:121150K .......... .......... .......... .......... .......... 71% 64.9M 5s 2024-03-30T13:13:54.924 INFO:teuthology.orchestra.run.smithi044.stderr:121200K .......... .......... .......... .......... .......... 71% 68.8M 5s 2024-03-30T13:13:54.937 INFO:teuthology.orchestra.run.smithi044.stderr:121250K .......... .......... .......... .......... .......... 71% 3.58M 5s 2024-03-30T13:13:54.952 INFO:teuthology.orchestra.run.smithi044.stderr:121300K .......... .......... .......... .......... .......... 71% 3.35M 5s 2024-03-30T13:13:54.955 INFO:teuthology.orchestra.run.smithi044.stderr:121350K .......... .......... .......... .......... .......... 72% 21.5M 5s 2024-03-30T13:13:54.956 INFO:teuthology.orchestra.run.smithi044.stderr:121400K .......... .......... .......... .......... .......... 72% 26.3M 5s 2024-03-30T13:13:54.958 INFO:teuthology.orchestra.run.smithi044.stderr:121450K .......... .......... .......... .......... .......... 72% 23.6M 5s 2024-03-30T13:13:54.961 INFO:teuthology.orchestra.run.smithi044.stderr:121500K .......... .......... .......... .......... .......... 72% 24.1M 5s 2024-03-30T13:13:54.965 INFO:teuthology.orchestra.run.smithi044.stderr:121550K .......... .......... .......... .......... .......... 72% 29.7M 5s 2024-03-30T13:13:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:121600K .......... .......... .......... .......... .......... 72% 40.9M 5s 2024-03-30T13:13:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:121650K .......... .......... .......... .......... .......... 72% 41.7M 5s 2024-03-30T13:13:54.966 INFO:teuthology.orchestra.run.smithi044.stderr:121700K .......... .......... .......... .......... .......... 72% 40.9M 5s 2024-03-30T13:13:54.986 INFO:teuthology.orchestra.run.smithi044.stderr:121750K .......... .......... .......... .......... .......... 72% 2.33M 5s 2024-03-30T13:13:55.009 INFO:teuthology.orchestra.run.smithi044.stderr:121800K .......... .......... .......... .......... .......... 72% 2.25M 5s 2024-03-30T13:13:55.011 INFO:teuthology.orchestra.run.smithi044.stderr:121850K .......... .......... .......... .......... .......... 72% 22.2M 5s 2024-03-30T13:13:55.011 INFO:teuthology.orchestra.run.smithi044.stderr:121900K .......... .......... .......... .......... .......... 72% 38.7M 5s 2024-03-30T13:13:55.013 INFO:teuthology.orchestra.run.smithi044.stderr:121950K .......... .......... .......... .......... .......... 72% 46.6M 5s 2024-03-30T13:13:55.014 INFO:teuthology.orchestra.run.smithi044.stderr:122000K .......... .......... .......... .......... .......... 72% 41.1M 5s 2024-03-30T13:13:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:122050K .......... .......... .......... .......... .......... 72% 23.5M 5s 2024-03-30T13:13:55.017 INFO:teuthology.orchestra.run.smithi044.stderr:122100K .......... .......... .......... .......... .......... 72% 46.8M 5s 2024-03-30T13:13:55.019 INFO:teuthology.orchestra.run.smithi044.stderr:122150K .......... .......... .......... .......... .......... 72% 25.7M 5s 2024-03-30T13:13:55.020 INFO:teuthology.orchestra.run.smithi044.stderr:122200K .......... .......... .......... .......... .......... 72% 33.5M 5s 2024-03-30T13:13:55.032 INFO:teuthology.orchestra.run.smithi044.stderr:122250K .......... .......... .......... .......... .......... 72% 4.12M 5s 2024-03-30T13:13:55.054 INFO:teuthology.orchestra.run.smithi044.stderr:122300K .......... .......... .......... .......... .......... 72% 2.28M 5s 2024-03-30T13:13:55.057 INFO:teuthology.orchestra.run.smithi044.stderr:122350K .......... .......... .......... .......... .......... 72% 16.5M 5s 2024-03-30T13:13:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:122400K .......... .......... .......... .......... .......... 72% 32.8M 5s 2024-03-30T13:13:55.059 INFO:teuthology.orchestra.run.smithi044.stderr:122450K .......... .......... .......... .......... .......... 72% 38.4M 5s 2024-03-30T13:13:55.060 INFO:teuthology.orchestra.run.smithi044.stderr:122500K .......... .......... .......... .......... .......... 72% 38.2M 5s 2024-03-30T13:13:55.062 INFO:teuthology.orchestra.run.smithi044.stderr:122550K .......... .......... .......... .......... .......... 72% 32.1M 5s 2024-03-30T13:13:55.064 INFO:teuthology.orchestra.run.smithi044.stderr:122600K .......... .......... .......... .......... .......... 72% 26.2M 5s 2024-03-30T13:13:55.066 INFO:teuthology.orchestra.run.smithi044.stderr:122650K .......... .......... .......... .......... .......... 72% 27.1M 5s 2024-03-30T13:13:55.067 INFO:teuthology.orchestra.run.smithi044.stderr:122700K .......... .......... .......... .......... .......... 72% 26.3M 5s 2024-03-30T13:13:55.079 INFO:teuthology.orchestra.run.smithi044.stderr:122750K .......... .......... .......... .......... .......... 72% 4.28M 5s 2024-03-30T13:13:55.105 INFO:teuthology.orchestra.run.smithi044.stderr:122800K .......... .......... .......... .......... .......... 72% 1.90M 5s 2024-03-30T13:13:55.107 INFO:teuthology.orchestra.run.smithi044.stderr:122850K .......... .......... .......... .......... .......... 72% 20.8M 5s 2024-03-30T13:13:55.110 INFO:teuthology.orchestra.run.smithi044.stderr:122900K .......... .......... .......... .......... .......... 72% 13.6M 5s 2024-03-30T13:13:55.112 INFO:teuthology.orchestra.run.smithi044.stderr:122950K .......... .......... .......... .......... .......... 72% 32.6M 5s 2024-03-30T13:13:55.113 INFO:teuthology.orchestra.run.smithi044.stderr:123000K .......... .......... .......... .......... .......... 72% 30.5M 5s 2024-03-30T13:13:55.115 INFO:teuthology.orchestra.run.smithi044.stderr:123050K .......... .......... .......... .......... .......... 73% 30.4M 5s 2024-03-30T13:13:55.119 INFO:teuthology.orchestra.run.smithi044.stderr:123100K .......... .......... .......... .......... .......... 73% 16.1M 5s 2024-03-30T13:13:55.120 INFO:teuthology.orchestra.run.smithi044.stderr:123150K .......... .......... .......... .......... .......... 73% 20.8M 5s 2024-03-30T13:13:55.126 INFO:teuthology.orchestra.run.smithi044.stderr:123200K .......... .......... .......... .......... .......... 73% 9.51M 5s 2024-03-30T13:13:55.130 INFO:teuthology.orchestra.run.smithi044.stderr:123250K .......... .......... .......... .......... .......... 73% 10.1M 5s 2024-03-30T13:13:55.131 INFO:teuthology.orchestra.run.smithi044.stderr:123300K .......... .......... .......... .......... .......... 73% 64.5M 5s 2024-03-30T13:13:55.142 INFO:teuthology.orchestra.run.smithi044.stderr:123350K .......... .......... .......... .......... .......... 73% 4.60M 5s 2024-03-30T13:13:55.146 INFO:teuthology.orchestra.run.smithi044.stderr:123400K .......... .......... .......... .......... .......... 73% 13.1M 5s 2024-03-30T13:13:55.147 INFO:teuthology.orchestra.run.smithi044.stderr:123450K .......... .......... .......... .......... .......... 73% 30.2M 5s 2024-03-30T13:13:55.148 INFO:teuthology.orchestra.run.smithi044.stderr:123500K .......... .......... .......... .......... .......... 73% 48.5M 5s 2024-03-30T13:13:55.150 INFO:teuthology.orchestra.run.smithi044.stderr:123550K .......... .......... .......... .......... .......... 73% 29.7M 5s 2024-03-30T13:13:55.154 INFO:teuthology.orchestra.run.smithi044.stderr:123600K .......... .......... .......... .......... .......... 73% 13.7M 5s 2024-03-30T13:13:55.155 INFO:teuthology.orchestra.run.smithi044.stderr:123650K .......... .......... .......... .......... .......... 73% 31.9M 5s 2024-03-30T13:13:55.163 INFO:teuthology.orchestra.run.smithi044.stderr:123700K .......... .......... .......... .......... .......... 73% 7.10M 5s 2024-03-30T13:13:55.166 INFO:teuthology.orchestra.run.smithi044.stderr:123750K .......... .......... .......... .......... .......... 73% 12.9M 5s 2024-03-30T13:13:55.167 INFO:teuthology.orchestra.run.smithi044.stderr:123800K .......... .......... .......... .......... .......... 73% 57.4M 5s 2024-03-30T13:13:55.179 INFO:teuthology.orchestra.run.smithi044.stderr:123850K .......... .......... .......... .......... .......... 73% 4.57M 5s 2024-03-30T13:13:55.179 INFO:teuthology.orchestra.run.smithi044.stderr:123900K .......... .......... .......... .......... .......... 73% 63.6M 5s 2024-03-30T13:13:55.182 INFO:teuthology.orchestra.run.smithi044.stderr:123950K .......... .......... .......... .......... .......... 73% 13.0M 5s 2024-03-30T13:13:55.183 INFO:teuthology.orchestra.run.smithi044.stderr:124000K .......... .......... .......... .......... .......... 73% 30.1M 5s 2024-03-30T13:13:55.186 INFO:teuthology.orchestra.run.smithi044.stderr:124050K .......... .......... .......... .......... .......... 73% 26.3M 5s 2024-03-30T13:13:55.187 INFO:teuthology.orchestra.run.smithi044.stderr:124100K .......... .......... .......... .......... .......... 73% 25.0M 5s 2024-03-30T13:13:55.189 INFO:teuthology.orchestra.run.smithi044.stderr:124150K .......... .......... .......... .......... .......... 73% 20.7M 5s 2024-03-30T13:13:55.198 INFO:teuthology.orchestra.run.smithi044.stderr:124200K .......... .......... .......... .......... .......... 73% 7.60M 5s 2024-03-30T13:13:55.198 INFO:teuthology.orchestra.run.smithi044.stderr:124250K .......... .......... .......... .......... .......... 73% 25.7M 5s 2024-03-30T13:13:55.202 INFO:teuthology.orchestra.run.smithi044.stderr:124300K .......... .......... .......... .......... .......... 73% 12.8M 5s 2024-03-30T13:13:55.202 INFO:teuthology.orchestra.run.smithi044.stderr:124350K .......... .......... .......... .......... .......... 73% 60.3M 5s 2024-03-30T13:13:55.213 INFO:teuthology.orchestra.run.smithi044.stderr:124400K .......... .......... .......... .......... .......... 73% 4.59M 5s 2024-03-30T13:13:55.217 INFO:teuthology.orchestra.run.smithi044.stderr:124450K .......... .......... .......... .......... .......... 73% 12.9M 5s 2024-03-30T13:13:55.220 INFO:teuthology.orchestra.run.smithi044.stderr:124500K .......... .......... .......... .......... .......... 73% 31.4M 5s 2024-03-30T13:13:55.220 INFO:teuthology.orchestra.run.smithi044.stderr:124550K .......... .......... .......... .......... .......... 73% 62.1M 5s 2024-03-30T13:13:55.221 INFO:teuthology.orchestra.run.smithi044.stderr:124600K .......... .......... .......... .......... .......... 73% 27.9M 5s 2024-03-30T13:13:55.224 INFO:teuthology.orchestra.run.smithi044.stderr:124650K .......... .......... .......... .......... .......... 73% 17.8M 5s 2024-03-30T13:13:55.226 INFO:teuthology.orchestra.run.smithi044.stderr:124700K .......... .......... .......... .......... .......... 74% 18.6M 5s 2024-03-30T13:13:55.234 INFO:teuthology.orchestra.run.smithi044.stderr:124750K .......... .......... .......... .......... .......... 74% 7.29M 5s 2024-03-30T13:13:55.234 INFO:teuthology.orchestra.run.smithi044.stderr:124800K .......... .......... .......... .......... .......... 74% 59.8M 5s 2024-03-30T13:13:55.238 INFO:teuthology.orchestra.run.smithi044.stderr:124850K .......... .......... .......... .......... .......... 74% 13.1M 5s 2024-03-30T13:13:55.248 INFO:teuthology.orchestra.run.smithi044.stderr:124900K .......... .......... .......... .......... .......... 74% 4.54M 5s 2024-03-30T13:13:55.251 INFO:teuthology.orchestra.run.smithi044.stderr:124950K .......... .......... .......... .......... .......... 74% 21.5M 5s 2024-03-30T13:13:55.253 INFO:teuthology.orchestra.run.smithi044.stderr:125000K .......... .......... .......... .......... .......... 74% 21.8M 5s 2024-03-30T13:13:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:125050K .......... .......... .......... .......... .......... 74% 35.5M 5s 2024-03-30T13:13:55.255 INFO:teuthology.orchestra.run.smithi044.stderr:125100K .......... .......... .......... .......... .......... 74% 54.7M 5s 2024-03-30T13:13:55.257 INFO:teuthology.orchestra.run.smithi044.stderr:125150K .......... .......... .......... .......... .......... 74% 28.5M 5s 2024-03-30T13:13:55.260 INFO:teuthology.orchestra.run.smithi044.stderr:125200K .......... .......... .......... .......... .......... 74% 14.4M 5s 2024-03-30T13:13:55.267 INFO:teuthology.orchestra.run.smithi044.stderr:125250K .......... .......... .......... .......... .......... 74% 24.2M 5s 2024-03-30T13:13:55.270 INFO:teuthology.orchestra.run.smithi044.stderr:125300K .......... .......... .......... .......... .......... 74% 7.21M 5s 2024-03-30T13:13:55.272 INFO:teuthology.orchestra.run.smithi044.stderr:125350K .......... .......... .......... .......... .......... 74% 15.3M 5s 2024-03-30T13:13:55.274 INFO:teuthology.orchestra.run.smithi044.stderr:125400K .......... .......... .......... .......... .......... 74% 49.8M 5s 2024-03-30T13:13:55.284 INFO:teuthology.orchestra.run.smithi044.stderr:125450K .......... .......... .......... .......... .......... 74% 4.46M 5s 2024-03-30T13:13:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:125500K .......... .......... .......... .......... .......... 74% 12.8M 5s 2024-03-30T13:13:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:125550K .......... .......... .......... .......... .......... 74% 54.6M 5s 2024-03-30T13:13:55.290 INFO:teuthology.orchestra.run.smithi044.stderr:125600K .......... .......... .......... .......... .......... 74% 40.0M 5s 2024-03-30T13:13:55.293 INFO:teuthology.orchestra.run.smithi044.stderr:125650K .......... .......... .......... .......... .......... 74% 22.9M 5s 2024-03-30T13:13:55.295 INFO:teuthology.orchestra.run.smithi044.stderr:125700K .......... .......... .......... .......... .......... 74% 20.6M 5s 2024-03-30T13:13:55.296 INFO:teuthology.orchestra.run.smithi044.stderr:125750K .......... .......... .......... .......... .......... 74% 24.9M 5s 2024-03-30T13:13:55.305 INFO:teuthology.orchestra.run.smithi044.stderr:125800K .......... .......... .......... .......... .......... 74% 6.55M 5s 2024-03-30T13:13:55.305 INFO:teuthology.orchestra.run.smithi044.stderr:125850K .......... .......... .......... .......... .......... 74% 60.9M 5s 2024-03-30T13:13:55.309 INFO:teuthology.orchestra.run.smithi044.stderr:125900K .......... .......... .......... .......... .......... 74% 13.0M 5s 2024-03-30T13:13:55.318 INFO:teuthology.orchestra.run.smithi044.stderr:125950K .......... .......... .......... .......... .......... 74% 5.07M 5s 2024-03-30T13:13:55.320 INFO:teuthology.orchestra.run.smithi044.stderr:126000K .......... .......... .......... .......... .......... 74% 27.3M 5s 2024-03-30T13:13:55.325 INFO:teuthology.orchestra.run.smithi044.stderr:126050K .......... .......... .......... .......... .......... 74% 12.3M 5s 2024-03-30T13:13:55.325 INFO:teuthology.orchestra.run.smithi044.stderr:126100K .......... .......... .......... .......... .......... 74% 64.4M 5s 2024-03-30T13:13:55.326 INFO:teuthology.orchestra.run.smithi044.stderr:126150K .......... .......... .......... .......... .......... 74% 44.9M 5s 2024-03-30T13:13:55.328 INFO:teuthology.orchestra.run.smithi044.stderr:126200K .......... .......... .......... .......... .......... 74% 26.0M 5s 2024-03-30T13:13:55.330 INFO:teuthology.orchestra.run.smithi044.stderr:126250K .......... .......... .......... .......... .......... 74% 17.3M 5s 2024-03-30T13:13:55.333 INFO:teuthology.orchestra.run.smithi044.stderr:126300K .......... .......... .......... .......... .......... 74% 18.6M 5s 2024-03-30T13:13:55.342 INFO:teuthology.orchestra.run.smithi044.stderr:126350K .......... .......... .......... .......... .......... 74% 7.08M 5s 2024-03-30T13:13:55.342 INFO:teuthology.orchestra.run.smithi044.stderr:126400K .......... .......... .......... .......... .......... 75% 72.3M 5s 2024-03-30T13:13:55.344 INFO:teuthology.orchestra.run.smithi044.stderr:126450K .......... .......... .......... .......... .......... 75% 14.0M 5s 2024-03-30T13:13:55.354 INFO:teuthology.orchestra.run.smithi044.stderr:126500K .......... .......... .......... .......... .......... 75% 4.89M 5s 2024-03-30T13:13:55.357 INFO:teuthology.orchestra.run.smithi044.stderr:126550K .......... .......... .......... .......... .......... 75% 16.1M 5s 2024-03-30T13:13:55.360 INFO:teuthology.orchestra.run.smithi044.stderr:126600K .......... .......... .......... .......... .......... 75% 19.7M 5s 2024-03-30T13:13:55.362 INFO:teuthology.orchestra.run.smithi044.stderr:126650K .......... .......... .......... .......... .......... 75% 41.6M 5s 2024-03-30T13:13:55.362 INFO:teuthology.orchestra.run.smithi044.stderr:126700K .......... .......... .......... .......... .......... 75% 60.2M 5s 2024-03-30T13:13:55.364 INFO:teuthology.orchestra.run.smithi044.stderr:126750K .......... .......... .......... .......... .......... 75% 26.8M 5s 2024-03-30T13:13:55.367 INFO:teuthology.orchestra.run.smithi044.stderr:126800K .......... .......... .......... .......... .......... 75% 14.3M 5s 2024-03-30T13:13:55.369 INFO:teuthology.orchestra.run.smithi044.stderr:126850K .......... .......... .......... .......... .......... 75% 25.6M 5s 2024-03-30T13:13:55.376 INFO:teuthology.orchestra.run.smithi044.stderr:126900K .......... .......... .......... .......... .......... 75% 7.20M 5s 2024-03-30T13:13:55.377 INFO:teuthology.orchestra.run.smithi044.stderr:126950K .......... .......... .......... .......... .......... 75% 64.4M 5s 2024-03-30T13:13:55.382 INFO:teuthology.orchestra.run.smithi044.stderr:127000K .......... .......... .......... .......... .......... 75% 13.7M 5s 2024-03-30T13:13:55.390 INFO:teuthology.orchestra.run.smithi044.stderr:127050K .......... .......... .......... .......... .......... 75% 4.93M 5s 2024-03-30T13:13:55.393 INFO:teuthology.orchestra.run.smithi044.stderr:127100K .......... .......... .......... .......... .......... 75% 16.1M 5s 2024-03-30T13:13:55.395 INFO:teuthology.orchestra.run.smithi044.stderr:127150K .......... .......... .......... .......... .......... 75% 21.9M 5s 2024-03-30T13:13:55.397 INFO:teuthology.orchestra.run.smithi044.stderr:127200K .......... .......... .......... .......... .......... 75% 35.4M 5s 2024-03-30T13:13:55.397 INFO:teuthology.orchestra.run.smithi044.stderr:127250K .......... .......... .......... .......... .......... 75% 55.8M 5s 2024-03-30T13:13:55.399 INFO:teuthology.orchestra.run.smithi044.stderr:127300K .......... .......... .......... .......... .......... 75% 29.0M 5s 2024-03-30T13:13:55.403 INFO:teuthology.orchestra.run.smithi044.stderr:127350K .......... .......... .......... .......... .......... 75% 13.9M 5s 2024-03-30T13:13:55.404 INFO:teuthology.orchestra.run.smithi044.stderr:127400K .......... .......... .......... .......... .......... 75% 26.2M 5s 2024-03-30T13:13:55.412 INFO:teuthology.orchestra.run.smithi044.stderr:127450K .......... .......... .......... .......... .......... 75% 7.24M 5s 2024-03-30T13:13:55.412 INFO:teuthology.orchestra.run.smithi044.stderr:127500K .......... .......... .......... .......... .......... 75% 70.2M 5s 2024-03-30T13:13:55.416 INFO:teuthology.orchestra.run.smithi044.stderr:127550K .......... .......... .......... .......... .......... 75% 13.1M 5s 2024-03-30T13:13:55.427 INFO:teuthology.orchestra.run.smithi044.stderr:127600K .......... .......... .......... .......... .......... 75% 4.61M 5s 2024-03-30T13:13:55.429 INFO:teuthology.orchestra.run.smithi044.stderr:127650K .......... .......... .......... .......... .......... 75% 21.1M 5s 2024-03-30T13:13:55.431 INFO:teuthology.orchestra.run.smithi044.stderr:127700K .......... .......... .......... .......... .......... 75% 21.7M 5s 2024-03-30T13:13:55.432 INFO:teuthology.orchestra.run.smithi044.stderr:127750K .......... .......... .......... .......... .......... 75% 38.7M 5s 2024-03-30T13:13:55.433 INFO:teuthology.orchestra.run.smithi044.stderr:127800K .......... .......... .......... .......... .......... 75% 53.2M 4s 2024-03-30T13:13:55.434 INFO:teuthology.orchestra.run.smithi044.stderr:127850K .......... .......... .......... .......... .......... 75% 30.4M 4s 2024-03-30T13:13:55.438 INFO:teuthology.orchestra.run.smithi044.stderr:127900K .......... .......... .......... .......... .......... 75% 14.1M 4s 2024-03-30T13:13:55.440 INFO:teuthology.orchestra.run.smithi044.stderr:127950K .......... .......... .......... .......... .......... 75% 22.4M 4s 2024-03-30T13:13:55.448 INFO:teuthology.orchestra.run.smithi044.stderr:128000K .......... .......... .......... .......... .......... 75% 7.33M 4s 2024-03-30T13:13:55.448 INFO:teuthology.orchestra.run.smithi044.stderr:128050K .......... .......... .......... .......... .......... 75% 63.5M 4s 2024-03-30T13:13:55.451 INFO:teuthology.orchestra.run.smithi044.stderr:128100K .......... .......... .......... .......... .......... 76% 14.4M 4s 2024-03-30T13:13:55.462 INFO:teuthology.orchestra.run.smithi044.stderr:128150K .......... .......... .......... .......... .......... 76% 4.42M 4s 2024-03-30T13:13:55.464 INFO:teuthology.orchestra.run.smithi044.stderr:128200K .......... .......... .......... .......... .......... 76% 23.7M 4s 2024-03-30T13:13:55.467 INFO:teuthology.orchestra.run.smithi044.stderr:128250K .......... .......... .......... .......... .......... 76% 20.5M 4s 2024-03-30T13:13:55.468 INFO:teuthology.orchestra.run.smithi044.stderr:128300K .......... .......... .......... .......... .......... 76% 45.8M 4s 2024-03-30T13:13:55.469 INFO:teuthology.orchestra.run.smithi044.stderr:128350K .......... .......... .......... .......... .......... 76% 55.1M 4s 2024-03-30T13:13:55.470 INFO:teuthology.orchestra.run.smithi044.stderr:128400K .......... .......... .......... .......... .......... 76% 29.3M 4s 2024-03-30T13:13:55.474 INFO:teuthology.orchestra.run.smithi044.stderr:128450K .......... .......... .......... .......... .......... 76% 13.0M 4s 2024-03-30T13:13:55.476 INFO:teuthology.orchestra.run.smithi044.stderr:128500K .......... .......... .......... .......... .......... 76% 26.3M 4s 2024-03-30T13:13:55.483 INFO:teuthology.orchestra.run.smithi044.stderr:128550K .......... .......... .......... .......... .......... 76% 6.98M 4s 2024-03-30T13:13:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:128600K .......... .......... .......... .......... .......... 76% 18.1M 4s 2024-03-30T13:13:55.487 INFO:teuthology.orchestra.run.smithi044.stderr:128650K .......... .......... .......... .......... .......... 76% 35.2M 4s 2024-03-30T13:13:55.500 INFO:teuthology.orchestra.run.smithi044.stderr:128700K .......... .......... .......... .......... .......... 76% 3.74M 4s 2024-03-30T13:13:55.502 INFO:teuthology.orchestra.run.smithi044.stderr:128750K .......... .......... .......... .......... .......... 76% 25.7M 4s 2024-03-30T13:13:55.504 INFO:teuthology.orchestra.run.smithi044.stderr:128800K .......... .......... .......... .......... .......... 76% 23.7M 4s 2024-03-30T13:13:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:128850K .......... .......... .......... .......... .......... 76% 30.6M 4s 2024-03-30T13:13:55.506 INFO:teuthology.orchestra.run.smithi044.stderr:128900K .......... .......... .......... .......... .......... 76% 47.5M 4s 2024-03-30T13:13:55.508 INFO:teuthology.orchestra.run.smithi044.stderr:128950K .......... .......... .......... .......... .......... 76% 35.3M 4s 2024-03-30T13:13:55.511 INFO:teuthology.orchestra.run.smithi044.stderr:129000K .......... .......... .......... .......... .......... 76% 16.5M 4s 2024-03-30T13:13:55.514 INFO:teuthology.orchestra.run.smithi044.stderr:129050K .......... .......... .......... .......... .......... 76% 16.7M 4s 2024-03-30T13:13:55.522 INFO:teuthology.orchestra.run.smithi044.stderr:129100K .......... .......... .......... .......... .......... 76% 6.56M 4s 2024-03-30T13:13:55.523 INFO:teuthology.orchestra.run.smithi044.stderr:129150K .......... .......... .......... .......... .......... 76% 33.6M 4s 2024-03-30T13:13:55.527 INFO:teuthology.orchestra.run.smithi044.stderr:129200K .......... .......... .......... .......... .......... 76% 13.0M 4s 2024-03-30T13:13:55.553 INFO:teuthology.orchestra.run.smithi044.stderr:129250K .......... .......... .......... .......... .......... 76% 2.06M 4s 2024-03-30T13:13:55.557 INFO:teuthology.orchestra.run.smithi044.stderr:129300K .......... .......... .......... .......... .......... 76% 7.87M 4s 2024-03-30T13:13:55.560 INFO:teuthology.orchestra.run.smithi044.stderr:129350K .......... .......... .......... .......... .......... 76% 18.3M 4s 2024-03-30T13:13:55.561 INFO:teuthology.orchestra.run.smithi044.stderr:129400K .......... .......... .......... .......... .......... 76% 35.2M 4s 2024-03-30T13:13:55.563 INFO:teuthology.orchestra.run.smithi044.stderr:129450K .......... .......... .......... .......... .......... 76% 27.0M 4s 2024-03-30T13:13:55.564 INFO:teuthology.orchestra.run.smithi044.stderr:129500K .......... .......... .......... .......... .......... 76% 30.1M 4s 2024-03-30T13:13:55.566 INFO:teuthology.orchestra.run.smithi044.stderr:129550K .......... .......... .......... .......... .......... 76% 24.0M 4s 2024-03-30T13:13:55.567 INFO:teuthology.orchestra.run.smithi044.stderr:129600K .......... .......... .......... .......... .......... 76% 36.4M 4s 2024-03-30T13:13:55.582 INFO:teuthology.orchestra.run.smithi044.stderr:129650K .......... .......... .......... .......... .......... 76% 4.46M 4s 2024-03-30T13:13:55.583 INFO:teuthology.orchestra.run.smithi044.stderr:129700K .......... .......... .......... .......... .......... 76% 30.8M 4s 2024-03-30T13:13:55.584 INFO:teuthology.orchestra.run.smithi044.stderr:129750K .......... .......... .......... .......... .......... 77% 15.6M 4s 2024-03-30T13:13:55.607 INFO:teuthology.orchestra.run.smithi044.stderr:129800K .......... .......... .......... .......... .......... 77% 2.19M 4s 2024-03-30T13:13:55.607 INFO:teuthology.orchestra.run.smithi044.stderr:129850K .......... .......... .......... .......... .......... 77% 35.5M 4s 2024-03-30T13:13:55.615 INFO:teuthology.orchestra.run.smithi044.stderr:129900K .......... .......... .......... .......... .......... 77% 5.60M 4s 2024-03-30T13:13:55.619 INFO:teuthology.orchestra.run.smithi044.stderr:129950K .......... .......... .......... .......... .......... 77% 14.3M 4s 2024-03-30T13:13:55.622 INFO:teuthology.orchestra.run.smithi044.stderr:130000K .......... .......... .......... .......... .......... 77% 18.1M 4s 2024-03-30T13:13:55.623 INFO:teuthology.orchestra.run.smithi044.stderr:130050K .......... .......... .......... .......... .......... 77% 30.0M 4s 2024-03-30T13:13:55.626 INFO:teuthology.orchestra.run.smithi044.stderr:130100K .......... .......... .......... .......... .......... 77% 15.9M 4s 2024-03-30T13:13:55.628 INFO:teuthology.orchestra.run.smithi044.stderr:130150K .......... .......... .......... .......... .......... 77% 27.9M 4s 2024-03-30T13:13:55.637 INFO:teuthology.orchestra.run.smithi044.stderr:130200K .......... .......... .......... .......... .......... 77% 5.54M 4s 2024-03-30T13:13:55.644 INFO:teuthology.orchestra.run.smithi044.stderr:130250K .......... .......... .......... .......... .......... 77% 7.56M 4s 2024-03-30T13:13:55.645 INFO:teuthology.orchestra.run.smithi044.stderr:130300K .......... .......... .......... .......... .......... 77% 23.8M 4s 2024-03-30T13:13:55.647 INFO:teuthology.orchestra.run.smithi044.stderr:130350K .......... .......... .......... .......... .......... 77% 21.6M 4s 2024-03-30T13:13:55.669 INFO:teuthology.orchestra.run.smithi044.stderr:130400K .......... .......... .......... .......... .......... 77% 2.30M 4s 2024-03-30T13:13:55.673 INFO:teuthology.orchestra.run.smithi044.stderr:130450K .......... .......... .......... .......... .......... 77% 9.66M 4s 2024-03-30T13:13:55.680 INFO:teuthology.orchestra.run.smithi044.stderr:130500K .......... .......... .......... .......... .......... 77% 7.83M 4s 2024-03-30T13:13:55.684 INFO:teuthology.orchestra.run.smithi044.stderr:130550K .......... .......... .......... .......... .......... 77% 12.3M 4s 2024-03-30T13:13:55.686 INFO:teuthology.orchestra.run.smithi044.stderr:130600K .......... .......... .......... .......... .......... 77% 24.0M 4s 2024-03-30T13:13:55.690 INFO:teuthology.orchestra.run.smithi044.stderr:130650K .......... .......... .......... .......... .......... 77% 10.9M 4s 2024-03-30T13:13:55.696 INFO:teuthology.orchestra.run.smithi044.stderr:130700K .......... .......... .......... .......... .......... 77% 9.73M 4s 2024-03-30T13:13:55.698 INFO:teuthology.orchestra.run.smithi044.stderr:130750K .......... .......... .......... .......... .......... 77% 24.2M 4s 2024-03-30T13:13:55.702 INFO:teuthology.orchestra.run.smithi044.stderr:130800K .......... .......... .......... .......... .......... 77% 11.4M 4s 2024-03-30T13:13:55.705 INFO:teuthology.orchestra.run.smithi044.stderr:130850K .......... .......... .......... .......... .......... 77% 34.3M 4s 2024-03-30T13:13:55.705 INFO:teuthology.orchestra.run.smithi044.stderr:130900K .......... .......... .......... .......... .......... 77% 39.5M 4s 2024-03-30T13:13:55.719 INFO:teuthology.orchestra.run.smithi044.stderr:130950K .......... .......... .......... .......... .......... 77% 4.20M 4s 2024-03-30T13:13:55.719 INFO:teuthology.orchestra.run.smithi044.stderr:131000K .......... .......... .......... .......... .......... 77% 28.1M 4s 2024-03-30T13:13:55.723 INFO:teuthology.orchestra.run.smithi044.stderr:131050K .......... .......... .......... .......... .......... 77% 10.7M 4s 2024-03-30T13:13:55.731 INFO:teuthology.orchestra.run.smithi044.stderr:131100K .......... .......... .......... .......... .......... 77% 12.9M 4s 2024-03-30T13:13:55.731 INFO:teuthology.orchestra.run.smithi044.stderr:131150K .......... .......... .......... .......... .......... 77% 19.8M 4s 2024-03-30T13:13:55.731 INFO:teuthology.orchestra.run.smithi044.stderr:131200K .......... .......... .......... .......... .......... 77% 21.7M 4s 2024-03-30T13:13:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:131250K .......... .......... .......... .......... .......... 77% 6.56M 4s 2024-03-30T13:13:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:131300K .......... .......... .......... .......... .......... 77% 31.2M 4s 2024-03-30T13:13:55.743 INFO:teuthology.orchestra.run.smithi044.stderr:131350K .......... .......... .......... .......... .......... 77% 30.7M 4s 2024-03-30T13:13:55.748 INFO:teuthology.orchestra.run.smithi044.stderr:131400K .......... .......... .......... .......... .......... 77% 17.1M 4s 2024-03-30T13:13:55.748 INFO:teuthology.orchestra.run.smithi044.stderr:131450K .......... .......... .......... .......... .......... 78% 34.3M 4s 2024-03-30T13:13:55.748 INFO:teuthology.orchestra.run.smithi044.stderr:131500K .......... .......... .......... .......... .......... 78% 36.8M 4s 2024-03-30T13:13:55.767 INFO:teuthology.orchestra.run.smithi044.stderr:131550K .......... .......... .......... .......... .......... 78% 2.46M 4s 2024-03-30T13:13:55.771 INFO:teuthology.orchestra.run.smithi044.stderr:131600K .......... .......... .......... .......... .......... 78% 12.1M 4s 2024-03-30T13:13:55.776 INFO:teuthology.orchestra.run.smithi044.stderr:131650K .......... .......... .......... .......... .......... 78% 9.35M 4s 2024-03-30T13:13:55.782 INFO:teuthology.orchestra.run.smithi044.stderr:131700K .......... .......... .......... .......... .......... 78% 9.93M 4s 2024-03-30T13:13:55.785 INFO:teuthology.orchestra.run.smithi044.stderr:131750K .......... .......... .......... .......... .......... 78% 11.6M 4s 2024-03-30T13:13:55.790 INFO:teuthology.orchestra.run.smithi044.stderr:131800K .......... .......... .......... .......... .......... 78% 11.4M 4s 2024-03-30T13:13:55.797 INFO:teuthology.orchestra.run.smithi044.stderr:131850K .......... .......... .......... .......... .......... 78% 9.49M 4s 2024-03-30T13:13:55.797 INFO:teuthology.orchestra.run.smithi044.stderr:131900K .......... .......... .......... .......... .......... 78% 37.0M 4s 2024-03-30T13:13:55.801 INFO:teuthology.orchestra.run.smithi044.stderr:131950K .......... .......... .......... .......... .......... 78% 27.7M 4s 2024-03-30T13:13:55.801 INFO:teuthology.orchestra.run.smithi044.stderr:132000K .......... .......... .......... .......... .......... 78% 70.6M 4s 2024-03-30T13:13:55.801 INFO:teuthology.orchestra.run.smithi044.stderr:132050K .......... .......... .......... .......... .......... 78% 24.9M 4s 2024-03-30T13:13:55.807 INFO:teuthology.orchestra.run.smithi044.stderr:132100K .......... .......... .......... .......... .......... 78% 7.66M 4s 2024-03-30T13:13:55.852 INFO:teuthology.orchestra.run.smithi044.stderr:132150K .......... .......... .......... .......... .......... 78% 1.14M 4s 2024-03-30T13:13:55.852 INFO:teuthology.orchestra.run.smithi044.stderr:132200K .......... .......... .......... .......... .......... 78% 39.3M 4s 2024-03-30T13:13:55.852 INFO:teuthology.orchestra.run.smithi044.stderr:132250K .......... .......... .......... .......... .......... 78% 47.7M 4s 2024-03-30T13:13:55.854 INFO:teuthology.orchestra.run.smithi044.stderr:132300K .......... .......... .......... .......... .......... 78% 29.0M 4s 2024-03-30T13:13:55.857 INFO:teuthology.orchestra.run.smithi044.stderr:132350K .......... .......... .......... .......... .......... 78% 17.6M 4s 2024-03-30T13:13:55.859 INFO:teuthology.orchestra.run.smithi044.stderr:132400K .......... .......... .......... .......... .......... 78% 14.6M 4s 2024-03-30T13:13:55.866 INFO:teuthology.orchestra.run.smithi044.stderr:132450K .......... .......... .......... .......... .......... 78% 11.2M 4s 2024-03-30T13:13:55.866 INFO:teuthology.orchestra.run.smithi044.stderr:132500K .......... .......... .......... .......... .......... 78% 48.6M 4s 2024-03-30T13:13:55.866 INFO:teuthology.orchestra.run.smithi044.stderr:132550K .......... .......... .......... .......... .......... 78% 34.5M 4s 2024-03-30T13:13:55.868 INFO:teuthology.orchestra.run.smithi044.stderr:132600K .......... .......... .......... .......... .......... 78% 30.1M 4s 2024-03-30T13:13:55.870 INFO:teuthology.orchestra.run.smithi044.stderr:132650K .......... .......... .......... .......... .......... 78% 28.0M 4s 2024-03-30T13:13:55.898 INFO:teuthology.orchestra.run.smithi044.stderr:132700K .......... .......... .......... .......... .......... 78% 1.76M 4s 2024-03-30T13:13:55.904 INFO:teuthology.orchestra.run.smithi044.stderr:132750K .......... .......... .......... .......... .......... 78% 21.7M 4s 2024-03-30T13:13:55.904 INFO:teuthology.orchestra.run.smithi044.stderr:132800K .......... .......... .......... .......... .......... 78% 33.7M 4s 2024-03-30T13:13:55.904 INFO:teuthology.orchestra.run.smithi044.stderr:132850K .......... .......... .......... .......... .......... 78% 51.6M 4s 2024-03-30T13:13:55.904 INFO:teuthology.orchestra.run.smithi044.stderr:132900K .......... .......... .......... .......... .......... 78% 42.7M 4s 2024-03-30T13:13:55.908 INFO:teuthology.orchestra.run.smithi044.stderr:132950K .......... .......... .......... .......... .......... 78% 11.9M 4s 2024-03-30T13:13:55.913 INFO:teuthology.orchestra.run.smithi044.stderr:133000K .......... .......... .......... .......... .......... 78% 9.49M 4s 2024-03-30T13:13:55.928 INFO:teuthology.orchestra.run.smithi044.stderr:133050K .......... .......... .......... .......... .......... 78% 3.14M 4s 2024-03-30T13:13:55.932 INFO:teuthology.orchestra.run.smithi044.stderr:133100K .......... .......... .......... .......... .......... 78% 13.2M 4s 2024-03-30T13:13:55.936 INFO:teuthology.orchestra.run.smithi044.stderr:133150K .......... .......... .......... .......... .......... 79% 12.9M 4s 2024-03-30T13:13:55.940 INFO:teuthology.orchestra.run.smithi044.stderr:133200K .......... .......... .......... .......... .......... 79% 11.3M 4s 2024-03-30T13:13:55.944 INFO:teuthology.orchestra.run.smithi044.stderr:133250K .......... .......... .......... .......... .......... 79% 11.6M 4s 2024-03-30T13:13:55.975 INFO:teuthology.orchestra.run.smithi044.stderr:133300K .......... .......... .......... .......... .......... 79% 1.57M 4s 2024-03-30T13:13:55.977 INFO:teuthology.orchestra.run.smithi044.stderr:133350K .......... .......... .......... .......... .......... 79% 23.2M 4s 2024-03-30T13:13:55.979 INFO:teuthology.orchestra.run.smithi044.stderr:133400K .......... .......... .......... .......... .......... 79% 39.0M 4s 2024-03-30T13:13:55.980 INFO:teuthology.orchestra.run.smithi044.stderr:133450K .......... .......... .......... .......... .......... 79% 29.2M 4s 2024-03-30T13:13:55.983 INFO:teuthology.orchestra.run.smithi044.stderr:133500K .......... .......... .......... .......... .......... 79% 22.8M 4s 2024-03-30T13:13:55.985 INFO:teuthology.orchestra.run.smithi044.stderr:133550K .......... .......... .......... .......... .......... 79% 16.7M 4s 2024-03-30T13:13:55.991 INFO:teuthology.orchestra.run.smithi044.stderr:133600K .......... .......... .......... .......... .......... 79% 8.62M 4s 2024-03-30T13:13:56.084 INFO:teuthology.orchestra.run.smithi044.stderr:133650K .......... .......... .......... .......... .......... 79% 632K 4s 2024-03-30T13:13:56.084 INFO:teuthology.orchestra.run.smithi044.stderr:133700K .......... .......... .......... .......... .......... 79% 44.0M 4s 2024-03-30T13:13:56.084 INFO:teuthology.orchestra.run.smithi044.stderr:133750K .......... .......... .......... .......... .......... 79% 53.3M 4s 2024-03-30T13:13:56.084 INFO:teuthology.orchestra.run.smithi044.stderr:133800K .......... .......... .......... .......... .......... 79% 70.4M 4s 2024-03-30T13:13:56.084 INFO:teuthology.orchestra.run.smithi044.stderr:133850K .......... .......... .......... .......... .......... 79% 77.6M 4s 2024-03-30T13:13:56.084 INFO:teuthology.orchestra.run.smithi044.stderr:133900K .......... .......... .......... .......... .......... 79% 83.9M 4s 2024-03-30T13:13:56.084 INFO:teuthology.orchestra.run.smithi044.stderr:133950K .......... .......... .......... .......... .......... 79% 71.3M 4s 2024-03-30T13:13:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:134000K .......... .......... .......... .......... .......... 79% 80.0M 4s 2024-03-30T13:13:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:134050K .......... .......... .......... .......... .......... 79% 83.9M 4s 2024-03-30T13:13:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:134100K .......... .......... .......... .......... .......... 79% 79.9M 4s 2024-03-30T13:13:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:134150K .......... .......... .......... .......... .......... 79% 69.1M 4s 2024-03-30T13:13:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:134200K .......... .......... .......... .......... .......... 79% 84.0M 4s 2024-03-30T13:13:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:134250K .......... .......... .......... .......... .......... 79% 80.9M 4s 2024-03-30T13:13:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:134300K .......... .......... .......... .......... .......... 79% 84.9M 4s 2024-03-30T13:13:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:134350K .......... .......... .......... .......... .......... 79% 67.8M 4s 2024-03-30T13:13:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:134400K .......... .......... .......... .......... .......... 79% 78.4M 4s 2024-03-30T13:13:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:134450K .......... .......... .......... .......... .......... 79% 62.9M 4s 2024-03-30T13:13:56.093 INFO:teuthology.orchestra.run.smithi044.stderr:134500K .......... .......... .......... .......... .......... 79% 4.48M 4s 2024-03-30T13:13:56.096 INFO:teuthology.orchestra.run.smithi044.stderr:134550K .......... .......... .......... .......... .......... 79% 14.1M 4s 2024-03-30T13:13:56.106 INFO:teuthology.orchestra.run.smithi044.stderr:134600K .......... .......... .......... .......... .......... 79% 4.69M 4s 2024-03-30T13:13:56.118 INFO:teuthology.orchestra.run.smithi044.stderr:134650K .......... .......... .......... .......... .......... 79% 4.38M 4s 2024-03-30T13:13:56.118 INFO:teuthology.orchestra.run.smithi044.stderr:134700K .......... .......... .......... .......... .......... 79% 55.1M 4s 2024-03-30T13:13:56.132 INFO:teuthology.orchestra.run.smithi044.stderr:134750K .......... .......... .......... .......... .......... 79% 3.73M 4s 2024-03-30T13:13:56.133 INFO:teuthology.orchestra.run.smithi044.stderr:134800K .......... .......... .......... .......... .......... 79% 58.1M 4s 2024-03-30T13:13:56.155 INFO:teuthology.orchestra.run.smithi044.stderr:134850K .......... .......... .......... .......... .......... 80% 2.14M 4s 2024-03-30T13:13:56.159 INFO:teuthology.orchestra.run.smithi044.stderr:134900K .......... .......... .......... .......... .......... 80% 12.4M 4s 2024-03-30T13:13:56.169 INFO:teuthology.orchestra.run.smithi044.stderr:134950K .......... .......... .......... .......... .......... 80% 4.76M 4s 2024-03-30T13:13:56.171 INFO:teuthology.orchestra.run.smithi044.stderr:135000K .......... .......... .......... .......... .......... 80% 30.4M 4s 2024-03-30T13:13:56.182 INFO:teuthology.orchestra.run.smithi044.stderr:135050K .......... .......... .......... .......... .......... 80% 4.47M 4s 2024-03-30T13:13:56.190 INFO:teuthology.orchestra.run.smithi044.stderr:135100K .......... .......... .......... .......... .......... 80% 6.29M 4s 2024-03-30T13:13:56.195 INFO:teuthology.orchestra.run.smithi044.stderr:135150K .......... .......... .......... .......... .......... 80% 8.07M 4s 2024-03-30T13:13:56.201 INFO:teuthology.orchestra.run.smithi044.stderr:135200K .......... .......... .......... .......... .......... 80% 19.4M 4s 2024-03-30T13:13:56.202 INFO:teuthology.orchestra.run.smithi044.stderr:135250K .......... .......... .......... .......... .......... 80% 36.0M 4s 2024-03-30T13:13:56.223 INFO:teuthology.orchestra.run.smithi044.stderr:135300K .......... .......... .......... .......... .......... 80% 2.03M 4s 2024-03-30T13:13:56.229 INFO:teuthology.orchestra.run.smithi044.stderr:135350K .......... .......... .......... .......... .......... 80% 9.16M 4s 2024-03-30T13:13:56.241 INFO:teuthology.orchestra.run.smithi044.stderr:135400K .......... .......... .......... .......... .......... 80% 4.12M 4s 2024-03-30T13:13:56.244 INFO:teuthology.orchestra.run.smithi044.stderr:135450K .......... .......... .......... .......... .......... 80% 13.6M 4s 2024-03-30T13:13:56.256 INFO:teuthology.orchestra.run.smithi044.stderr:135500K .......... .......... .......... .......... .......... 80% 3.88M 4s 2024-03-30T13:13:56.263 INFO:teuthology.orchestra.run.smithi044.stderr:135550K .......... .......... .......... .......... .......... 80% 8.00M 4s 2024-03-30T13:13:56.273 INFO:teuthology.orchestra.run.smithi044.stderr:135600K .......... .......... .......... .......... .......... 80% 4.91M 4s 2024-03-30T13:13:56.275 INFO:teuthology.orchestra.run.smithi044.stderr:135650K .......... .......... .......... .......... .......... 80% 27.7M 4s 2024-03-30T13:13:56.280 INFO:teuthology.orchestra.run.smithi044.stderr:135700K .......... .......... .......... .......... .......... 80% 8.26M 4s 2024-03-30T13:13:56.301 INFO:teuthology.orchestra.run.smithi044.stderr:135750K .......... .......... .......... .......... .......... 80% 2.40M 4s 2024-03-30T13:13:56.311 INFO:teuthology.orchestra.run.smithi044.stderr:135800K .......... .......... .......... .......... .......... 80% 4.92M 4s 2024-03-30T13:13:56.314 INFO:teuthology.orchestra.run.smithi044.stderr:135850K .......... .......... .......... .......... .......... 80% 13.7M 4s 2024-03-30T13:13:56.319 INFO:teuthology.orchestra.run.smithi044.stderr:135900K .......... .......... .......... .......... .......... 80% 9.13M 4s 2024-03-30T13:13:56.336 INFO:teuthology.orchestra.run.smithi044.stderr:135950K .......... .......... .......... .......... .......... 80% 2.89M 4s 2024-03-30T13:13:56.339 INFO:teuthology.orchestra.run.smithi044.stderr:136000K .......... .......... .......... .......... .......... 80% 23.9M 4s 2024-03-30T13:13:56.344 INFO:teuthology.orchestra.run.smithi044.stderr:136050K .......... .......... .......... .......... .......... 80% 8.26M 4s 2024-03-30T13:13:56.346 INFO:teuthology.orchestra.run.smithi044.stderr:136100K .......... .......... .......... .......... .......... 80% 25.5M 4s 2024-03-30T13:13:56.373 INFO:teuthology.orchestra.run.smithi044.stderr:136150K .......... .......... .......... .......... .......... 80% 1.91M 4s 2024-03-30T13:13:56.374 INFO:teuthology.orchestra.run.smithi044.stderr:136200K .......... .......... .......... .......... .......... 80% 30.6M 4s 2024-03-30T13:13:56.387 INFO:teuthology.orchestra.run.smithi044.stderr:136250K .......... .......... .......... .......... .......... 80% 3.62M 4s 2024-03-30T13:13:56.391 INFO:teuthology.orchestra.run.smithi044.stderr:136300K .......... .......... .......... .......... .......... 80% 12.4M 4s 2024-03-30T13:13:56.399 INFO:teuthology.orchestra.run.smithi044.stderr:136350K .......... .......... .......... .......... .......... 80% 8.47M 4s 2024-03-30T13:13:56.410 INFO:teuthology.orchestra.run.smithi044.stderr:136400K .......... .......... .......... .......... .......... 80% 3.60M 4s 2024-03-30T13:13:56.413 INFO:teuthology.orchestra.run.smithi044.stderr:136450K .......... .......... .......... .......... .......... 80% 21.9M 4s 2024-03-30T13:13:56.419 INFO:teuthology.orchestra.run.smithi044.stderr:136500K .......... .......... .......... .......... .......... 81% 7.30M 4s 2024-03-30T13:13:56.421 INFO:teuthology.orchestra.run.smithi044.stderr:136550K .......... .......... .......... .......... .......... 81% 29.4M 4s 2024-03-30T13:13:56.447 INFO:teuthology.orchestra.run.smithi044.stderr:136600K .......... .......... .......... .......... .......... 81% 1.85M 4s 2024-03-30T13:13:56.449 INFO:teuthology.orchestra.run.smithi044.stderr:136650K .......... .......... .......... .......... .......... 81% 31.8M 4s 2024-03-30T13:13:56.458 INFO:teuthology.orchestra.run.smithi044.stderr:136700K .......... .......... .......... .......... .......... 81% 5.65M 4s 2024-03-30T13:13:56.460 INFO:teuthology.orchestra.run.smithi044.stderr:136750K .......... .......... .......... .......... .......... 81% 18.1M 4s 2024-03-30T13:13:56.465 INFO:teuthology.orchestra.run.smithi044.stderr:136800K .......... .......... .......... .......... .......... 81% 9.09M 4s 2024-03-30T13:13:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:136850K .......... .......... .......... .......... .......... 81% 2.44M 4s 2024-03-30T13:13:56.488 INFO:teuthology.orchestra.run.smithi044.stderr:136900K .......... .......... .......... .......... .......... 81% 17.3M 4s 2024-03-30T13:13:56.496 INFO:teuthology.orchestra.run.smithi044.stderr:136950K .......... .......... .......... .......... .......... 81% 6.47M 3s 2024-03-30T13:13:56.498 INFO:teuthology.orchestra.run.smithi044.stderr:137000K .......... .......... .......... .......... .......... 81% 28.8M 3s 2024-03-30T13:13:56.506 INFO:teuthology.orchestra.run.smithi044.stderr:137050K .......... .......... .......... .......... .......... 81% 5.68M 3s 2024-03-30T13:13:56.522 INFO:teuthology.orchestra.run.smithi044.stderr:137100K .......... .......... .......... .......... .......... 81% 3.24M 3s 2024-03-30T13:13:56.531 INFO:teuthology.orchestra.run.smithi044.stderr:137150K .......... .......... .......... .......... .......... 81% 5.05M 3s 2024-03-30T13:13:56.533 INFO:teuthology.orchestra.run.smithi044.stderr:137200K .......... .......... .......... .......... .......... 81% 28.8M 3s 2024-03-30T13:13:56.537 INFO:teuthology.orchestra.run.smithi044.stderr:137250K .......... .......... .......... .......... .......... 81% 12.0M 3s 2024-03-30T13:13:56.556 INFO:teuthology.orchestra.run.smithi044.stderr:137300K .......... .......... .......... .......... .......... 81% 3.36M 3s 2024-03-30T13:13:56.559 INFO:teuthology.orchestra.run.smithi044.stderr:137350K .......... .......... .......... .......... .......... 81% 6.34M 3s 2024-03-30T13:13:56.566 INFO:teuthology.orchestra.run.smithi044.stderr:137400K .......... .......... .......... .......... .......... 81% 7.24M 3s 2024-03-30T13:13:56.568 INFO:teuthology.orchestra.run.smithi044.stderr:137450K .......... .......... .......... .......... .......... 81% 26.8M 3s 2024-03-30T13:13:56.571 INFO:teuthology.orchestra.run.smithi044.stderr:137500K .......... .......... .......... .......... .......... 81% 13.6M 3s 2024-03-30T13:13:56.594 INFO:teuthology.orchestra.run.smithi044.stderr:137550K .......... .......... .......... .......... .......... 81% 2.14M 3s 2024-03-30T13:13:56.602 INFO:teuthology.orchestra.run.smithi044.stderr:137600K .......... .......... .......... .......... .......... 81% 6.20M 3s 2024-03-30T13:13:56.611 INFO:teuthology.orchestra.run.smithi044.stderr:137650K .......... .......... .......... .......... .......... 81% 5.96M 3s 2024-03-30T13:13:56.615 INFO:teuthology.orchestra.run.smithi044.stderr:137700K .......... .......... .......... .......... .......... 81% 10.2M 3s 2024-03-30T13:13:56.620 INFO:teuthology.orchestra.run.smithi044.stderr:137750K .......... .......... .......... .......... .......... 81% 8.27M 3s 2024-03-30T13:13:56.632 INFO:teuthology.orchestra.run.smithi044.stderr:137800K .......... .......... .......... .......... .......... 81% 4.25M 3s 2024-03-30T13:13:56.638 INFO:teuthology.orchestra.run.smithi044.stderr:137850K .......... .......... .......... .......... .......... 81% 7.98M 3s 2024-03-30T13:13:56.640 INFO:teuthology.orchestra.run.smithi044.stderr:137900K .......... .......... .......... .......... .......... 81% 25.6M 3s 2024-03-30T13:13:56.641 INFO:teuthology.orchestra.run.smithi044.stderr:137950K .......... .......... .......... .......... .......... 81% 38.0M 3s 2024-03-30T13:13:56.665 INFO:teuthology.orchestra.run.smithi044.stderr:138000K .......... .......... .......... .......... .......... 81% 2.15M 3s 2024-03-30T13:13:56.672 INFO:teuthology.orchestra.run.smithi044.stderr:138050K .......... .......... .......... .......... .......... 81% 6.40M 3s 2024-03-30T13:13:56.680 INFO:teuthology.orchestra.run.smithi044.stderr:138100K .......... .......... .......... .......... .......... 81% 6.73M 3s 2024-03-30T13:13:56.680 INFO:teuthology.orchestra.run.smithi044.stderr:138150K .......... .......... .......... .......... .......... 81% 46.4M 3s 2024-03-30T13:13:56.688 INFO:teuthology.orchestra.run.smithi044.stderr:138200K .......... .......... .......... .......... .......... 82% 8.61M 3s 2024-03-30T13:13:56.703 INFO:teuthology.orchestra.run.smithi044.stderr:138250K .......... .......... .......... .......... .......... 82% 3.00M 3s 2024-03-30T13:13:56.703 INFO:teuthology.orchestra.run.smithi044.stderr:138300K .......... .......... .......... .......... .......... 82% 32.7M 3s 2024-03-30T13:13:56.711 INFO:teuthology.orchestra.run.smithi044.stderr:138350K .......... .......... .......... .......... .......... 82% 6.43M 3s 2024-03-30T13:13:56.714 INFO:teuthology.orchestra.run.smithi044.stderr:138400K .......... .......... .......... .......... .......... 82% 19.7M 3s 2024-03-30T13:13:56.738 INFO:teuthology.orchestra.run.smithi044.stderr:138450K .......... .......... .......... .......... .......... 82% 7.04M 3s 2024-03-30T13:13:56.740 INFO:teuthology.orchestra.run.smithi044.stderr:138500K .......... .......... .......... .......... .......... 82% 2.58M 3s 2024-03-30T13:13:56.751 INFO:teuthology.orchestra.run.smithi044.stderr:138550K .......... .......... .......... .......... .......... 82% 4.07M 3s 2024-03-30T13:13:56.753 INFO:teuthology.orchestra.run.smithi044.stderr:138600K .......... .......... .......... .......... .......... 82% 40.5M 3s 2024-03-30T13:13:56.757 INFO:teuthology.orchestra.run.smithi044.stderr:138650K .......... .......... .......... .......... .......... 82% 12.3M 3s 2024-03-30T13:13:56.763 INFO:teuthology.orchestra.run.smithi044.stderr:138700K .......... .......... .......... .......... .......... 82% 7.47M 3s 2024-03-30T13:13:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:138750K .......... .......... .......... .......... .......... 82% 2.78M 3s 2024-03-30T13:13:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:138800K .......... .......... .......... .......... .......... 82% 8.92M 3s 2024-03-30T13:13:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:138850K .......... .......... .......... .......... .......... 82% 15.4M 3s 2024-03-30T13:13:56.793 INFO:teuthology.orchestra.run.smithi044.stderr:138900K .......... .......... .......... .......... .......... 82% 15.7M 3s 2024-03-30T13:13:56.815 INFO:teuthology.orchestra.run.smithi044.stderr:138950K .......... .......... .......... .......... .......... 82% 2.62M 3s 2024-03-30T13:13:56.817 INFO:teuthology.orchestra.run.smithi044.stderr:139000K .......... .......... .......... .......... .......... 82% 8.58M 3s 2024-03-30T13:13:56.825 INFO:teuthology.orchestra.run.smithi044.stderr:139050K .......... .......... .......... .......... .......... 82% 5.58M 3s 2024-03-30T13:13:56.829 INFO:teuthology.orchestra.run.smithi044.stderr:139100K .......... .......... .......... .......... .......... 82% 14.0M 3s 2024-03-30T13:13:56.836 INFO:teuthology.orchestra.run.smithi044.stderr:139150K .......... .......... .......... .......... .......... 82% 7.50M 3s 2024-03-30T13:13:56.853 INFO:teuthology.orchestra.run.smithi044.stderr:139200K .......... .......... .......... .......... .......... 82% 3.30M 3s 2024-03-30T13:13:56.853 INFO:teuthology.orchestra.run.smithi044.stderr:139250K .......... .......... .......... .......... .......... 82% 31.8M 3s 2024-03-30T13:13:56.856 INFO:teuthology.orchestra.run.smithi044.stderr:139300K .......... .......... .......... .......... .......... 82% 10.8M 3s 2024-03-30T13:13:56.861 INFO:teuthology.orchestra.run.smithi044.stderr:139350K .......... .......... .......... .......... .......... 82% 11.7M 3s 2024-03-30T13:13:56.885 INFO:teuthology.orchestra.run.smithi044.stderr:139400K .......... .......... .......... .......... .......... 82% 2.01M 3s 2024-03-30T13:13:56.887 INFO:teuthology.orchestra.run.smithi044.stderr:139450K .......... .......... .......... .......... .......... 82% 24.8M 3s 2024-03-30T13:13:56.903 INFO:teuthology.orchestra.run.smithi044.stderr:139500K .......... .......... .......... .......... .......... 82% 4.72M 3s 2024-03-30T13:13:56.903 INFO:teuthology.orchestra.run.smithi044.stderr:139550K .......... .......... .......... .......... .......... 82% 42.2M 3s 2024-03-30T13:13:56.903 INFO:teuthology.orchestra.run.smithi044.stderr:139600K .......... .......... .......... .......... .......... 82% 41.0M 3s 2024-03-30T13:13:56.903 INFO:teuthology.orchestra.run.smithi044.stderr:139650K .......... .......... .......... .......... .......... 82% 40.6M 3s 2024-03-30T13:13:56.915 INFO:teuthology.orchestra.run.smithi044.stderr:139700K .......... .......... .......... .......... .......... 82% 3.62M 3s 2024-03-30T13:13:56.918 INFO:teuthology.orchestra.run.smithi044.stderr:139750K .......... .......... .......... .......... .......... 82% 11.9M 3s 2024-03-30T13:13:56.922 INFO:teuthology.orchestra.run.smithi044.stderr:139800K .......... .......... .......... .......... .......... 82% 15.4M 3s 2024-03-30T13:13:56.924 INFO:teuthology.orchestra.run.smithi044.stderr:139850K .......... .......... .......... .......... .......... 82% 19.8M 3s 2024-03-30T13:13:56.938 INFO:teuthology.orchestra.run.smithi044.stderr:139900K .......... .......... .......... .......... .......... 83% 3.63M 3s 2024-03-30T13:13:56.939 INFO:teuthology.orchestra.run.smithi044.stderr:139950K .......... .......... .......... .......... .......... 83% 50.6M 3s 2024-03-30T13:13:56.946 INFO:teuthology.orchestra.run.smithi044.stderr:140000K .......... .......... .......... .......... .......... 83% 6.00M 3s 2024-03-30T13:13:56.948 INFO:teuthology.orchestra.run.smithi044.stderr:140050K .......... .......... .......... .......... .......... 83% 29.6M 3s 2024-03-30T13:13:56.950 INFO:teuthology.orchestra.run.smithi044.stderr:140100K .......... .......... .......... .......... .......... 83% 36.2M 3s 2024-03-30T13:13:56.951 INFO:teuthology.orchestra.run.smithi044.stderr:140150K .......... .......... .......... .......... .......... 83% 27.3M 3s 2024-03-30T13:13:56.955 INFO:teuthology.orchestra.run.smithi044.stderr:140200K .......... .......... .......... .......... .......... 83% 16.9M 3s 2024-03-30T13:13:56.956 INFO:teuthology.orchestra.run.smithi044.stderr:140250K .......... .......... .......... .......... .......... 83% 32.0M 3s 2024-03-30T13:13:56.957 INFO:teuthology.orchestra.run.smithi044.stderr:140300K .......... .......... .......... .......... .......... 83% 29.7M 3s 2024-03-30T13:13:56.961 INFO:teuthology.orchestra.run.smithi044.stderr:140350K .......... .......... .......... .......... .......... 83% 14.4M 3s 2024-03-30T13:13:56.973 INFO:teuthology.orchestra.run.smithi044.stderr:140400K .......... .......... .......... .......... .......... 83% 3.97M 3s 2024-03-30T13:13:56.979 INFO:teuthology.orchestra.run.smithi044.stderr:140450K .......... .......... .......... .......... .......... 83% 8.53M 3s 2024-03-30T13:13:56.983 INFO:teuthology.orchestra.run.smithi044.stderr:140500K .......... .......... .......... .......... .......... 83% 12.9M 3s 2024-03-30T13:13:56.985 INFO:teuthology.orchestra.run.smithi044.stderr:140550K .......... .......... .......... .......... .......... 83% 30.2M 3s 2024-03-30T13:13:56.986 INFO:teuthology.orchestra.run.smithi044.stderr:140600K .......... .......... .......... .......... .......... 83% 29.7M 3s 2024-03-30T13:13:56.989 INFO:teuthology.orchestra.run.smithi044.stderr:140650K .......... .......... .......... .......... .......... 83% 17.4M 3s 2024-03-30T13:13:56.990 INFO:teuthology.orchestra.run.smithi044.stderr:140700K .......... .......... .......... .......... .......... 83% 43.4M 3s 2024-03-30T13:13:56.992 INFO:teuthology.orchestra.run.smithi044.stderr:140750K .......... .......... .......... .......... .......... 83% 24.6M 3s 2024-03-30T13:13:56.994 INFO:teuthology.orchestra.run.smithi044.stderr:140800K .......... .......... .......... .......... .......... 83% 41.1M 3s 2024-03-30T13:13:57.001 INFO:teuthology.orchestra.run.smithi044.stderr:140850K .......... .......... .......... .......... .......... 83% 6.17M 3s 2024-03-30T13:13:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:140900K .......... .......... .......... .......... .......... 83% 6.23M 3s 2024-03-30T13:13:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:140950K .......... .......... .......... .......... .......... 83% 8.16M 3s 2024-03-30T13:13:57.019 INFO:teuthology.orchestra.run.smithi044.stderr:141000K .......... .......... .......... .......... .......... 83% 12.8M 3s 2024-03-30T13:13:57.020 INFO:teuthology.orchestra.run.smithi044.stderr:141050K .......... .......... .......... .......... .......... 83% 33.9M 3s 2024-03-30T13:13:57.022 INFO:teuthology.orchestra.run.smithi044.stderr:141100K .......... .......... .......... .......... .......... 83% 26.2M 3s 2024-03-30T13:13:57.025 INFO:teuthology.orchestra.run.smithi044.stderr:141150K .......... .......... .......... .......... .......... 83% 17.0M 3s 2024-03-30T13:13:57.025 INFO:teuthology.orchestra.run.smithi044.stderr:141200K .......... .......... .......... .......... .......... 83% 56.4M 3s 2024-03-30T13:13:57.028 INFO:teuthology.orchestra.run.smithi044.stderr:141250K .......... .......... .......... .......... .......... 83% 19.5M 3s 2024-03-30T13:13:57.031 INFO:teuthology.orchestra.run.smithi044.stderr:141300K .......... .......... .......... .......... .......... 83% 20.4M 3s 2024-03-30T13:13:57.044 INFO:teuthology.orchestra.run.smithi044.stderr:141350K .......... .......... .......... .......... .......... 83% 3.71M 3s 2024-03-30T13:13:57.045 INFO:teuthology.orchestra.run.smithi044.stderr:141400K .......... .......... .......... .......... .......... 83% 43.3M 3s 2024-03-30T13:13:57.052 INFO:teuthology.orchestra.run.smithi044.stderr:141450K .......... .......... .......... .......... .......... 83% 7.27M 3s 2024-03-30T13:13:57.055 INFO:teuthology.orchestra.run.smithi044.stderr:141500K .......... .......... .......... .......... .......... 83% 15.4M 3s 2024-03-30T13:13:57.056 INFO:teuthology.orchestra.run.smithi044.stderr:141550K .......... .......... .......... .......... .......... 84% 33.2M 3s 2024-03-30T13:13:57.060 INFO:teuthology.orchestra.run.smithi044.stderr:141600K .......... .......... .......... .......... .......... 84% 16.3M 3s 2024-03-30T13:13:57.062 INFO:teuthology.orchestra.run.smithi044.stderr:141650K .......... .......... .......... .......... .......... 84% 15.7M 3s 2024-03-30T13:13:57.063 INFO:teuthology.orchestra.run.smithi044.stderr:141700K .......... .......... .......... .......... .......... 84% 46.6M 3s 2024-03-30T13:13:57.066 INFO:teuthology.orchestra.run.smithi044.stderr:141750K .......... .......... .......... .......... .......... 84% 21.7M 3s 2024-03-30T13:13:57.067 INFO:teuthology.orchestra.run.smithi044.stderr:141800K .......... .......... .......... .......... .......... 84% 23.5M 3s 2024-03-30T13:13:57.079 INFO:teuthology.orchestra.run.smithi044.stderr:141850K .......... .......... .......... .......... .......... 84% 4.20M 3s 2024-03-30T13:13:57.081 INFO:teuthology.orchestra.run.smithi044.stderr:141900K .......... .......... .......... .......... .......... 84% 35.2M 3s 2024-03-30T13:13:57.089 INFO:teuthology.orchestra.run.smithi044.stderr:141950K .......... .......... .......... .......... .......... 84% 5.85M 3s 2024-03-30T13:13:57.090 INFO:teuthology.orchestra.run.smithi044.stderr:142000K .......... .......... .......... .......... .......... 84% 27.1M 3s 2024-03-30T13:13:57.093 INFO:teuthology.orchestra.run.smithi044.stderr:142050K .......... .......... .......... .......... .......... 84% 22.7M 3s 2024-03-30T13:13:57.097 INFO:teuthology.orchestra.run.smithi044.stderr:142100K .......... .......... .......... .......... .......... 84% 14.7M 3s 2024-03-30T13:13:57.100 INFO:teuthology.orchestra.run.smithi044.stderr:142150K .......... .......... .......... .......... .......... 84% 12.9M 3s 2024-03-30T13:13:57.102 INFO:teuthology.orchestra.run.smithi044.stderr:142200K .......... .......... .......... .......... .......... 84% 47.0M 3s 2024-03-30T13:13:57.104 INFO:teuthology.orchestra.run.smithi044.stderr:142250K .......... .......... .......... .......... .......... 84% 23.1M 3s 2024-03-30T13:13:57.105 INFO:teuthology.orchestra.run.smithi044.stderr:142300K .......... .......... .......... .......... .......... 84% 29.8M 3s 2024-03-30T13:13:57.115 INFO:teuthology.orchestra.run.smithi044.stderr:142350K .......... .......... .......... .......... .......... 84% 4.81M 3s 2024-03-30T13:13:57.116 INFO:teuthology.orchestra.run.smithi044.stderr:142400K .......... .......... .......... .......... .......... 84% 35.5M 3s 2024-03-30T13:13:57.124 INFO:teuthology.orchestra.run.smithi044.stderr:142450K .......... .......... .......... .......... .......... 84% 6.50M 3s 2024-03-30T13:13:57.127 INFO:teuthology.orchestra.run.smithi044.stderr:142500K .......... .......... .......... .......... .......... 84% 16.8M 3s 2024-03-30T13:13:57.129 INFO:teuthology.orchestra.run.smithi044.stderr:142550K .......... .......... .......... .......... .......... 84% 21.7M 3s 2024-03-30T13:13:57.132 INFO:teuthology.orchestra.run.smithi044.stderr:142600K .......... .......... .......... .......... .......... 84% 15.1M 3s 2024-03-30T13:13:57.136 INFO:teuthology.orchestra.run.smithi044.stderr:142650K .......... .......... .......... .......... .......... 84% 11.4M 3s 2024-03-30T13:13:57.138 INFO:teuthology.orchestra.run.smithi044.stderr:142700K .......... .......... .......... .......... .......... 84% 35.1M 3s 2024-03-30T13:13:57.140 INFO:teuthology.orchestra.run.smithi044.stderr:142750K .......... .......... .......... .......... .......... 84% 22.8M 3s 2024-03-30T13:13:57.141 INFO:teuthology.orchestra.run.smithi044.stderr:142800K .......... .......... .......... .......... .......... 84% 34.1M 3s 2024-03-30T13:13:57.151 INFO:teuthology.orchestra.run.smithi044.stderr:142850K .......... .......... .......... .......... .......... 84% 4.98M 3s 2024-03-30T13:13:57.153 INFO:teuthology.orchestra.run.smithi044.stderr:142900K .......... .......... .......... .......... .......... 84% 21.9M 3s 2024-03-30T13:13:57.164 INFO:teuthology.orchestra.run.smithi044.stderr:142950K .......... .......... .......... .......... .......... 84% 4.70M 3s 2024-03-30T13:13:57.168 INFO:teuthology.orchestra.run.smithi044.stderr:143000K .......... .......... .......... .......... .......... 84% 18.7M 3s 2024-03-30T13:13:57.168 INFO:teuthology.orchestra.run.smithi044.stderr:143050K .......... .......... .......... .......... .......... 84% 58.5M 3s 2024-03-30T13:13:57.170 INFO:teuthology.orchestra.run.smithi044.stderr:143100K .......... .......... .......... .......... .......... 84% 18.6M 3s 2024-03-30T13:13:57.173 INFO:teuthology.orchestra.run.smithi044.stderr:143150K .......... .......... .......... .......... .......... 84% 16.3M 3s 2024-03-30T13:13:57.174 INFO:teuthology.orchestra.run.smithi044.stderr:143200K .......... .......... .......... .......... .......... 84% 64.2M 3s 2024-03-30T13:13:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:143250K .......... .......... .......... .......... .......... 85% 25.7M 3s 2024-03-30T13:13:57.177 INFO:teuthology.orchestra.run.smithi044.stderr:143300K .......... .......... .......... .......... .......... 85% 36.6M 3s 2024-03-30T13:13:57.187 INFO:teuthology.orchestra.run.smithi044.stderr:143350K .......... .......... .......... .......... .......... 85% 4.93M 3s 2024-03-30T13:13:57.189 INFO:teuthology.orchestra.run.smithi044.stderr:143400K .......... .......... .......... .......... .......... 85% 22.3M 3s 2024-03-30T13:13:57.200 INFO:teuthology.orchestra.run.smithi044.stderr:143450K .......... .......... .......... .......... .......... 85% 4.70M 3s 2024-03-30T13:13:57.202 INFO:teuthology.orchestra.run.smithi044.stderr:143500K .......... .......... .......... .......... .......... 85% 19.0M 3s 2024-03-30T13:13:57.203 INFO:teuthology.orchestra.run.smithi044.stderr:143550K .......... .......... .......... .......... .......... 85% 50.1M 3s 2024-03-30T13:13:57.206 INFO:teuthology.orchestra.run.smithi044.stderr:143600K .......... .......... .......... .......... .......... 85% 17.3M 3s 2024-03-30T13:13:57.211 INFO:teuthology.orchestra.run.smithi044.stderr:143650K .......... .......... .......... .......... .......... 85% 14.7M 3s 2024-03-30T13:13:57.211 INFO:teuthology.orchestra.run.smithi044.stderr:143700K .......... .......... .......... .......... .......... 85% 56.2M 3s 2024-03-30T13:13:57.212 INFO:teuthology.orchestra.run.smithi044.stderr:143750K .......... .......... .......... .......... .......... 85% 38.4M 3s 2024-03-30T13:13:57.212 INFO:teuthology.orchestra.run.smithi044.stderr:143800K .......... .......... .......... .......... .......... 85% 42.0M 3s 2024-03-30T13:13:57.222 INFO:teuthology.orchestra.run.smithi044.stderr:143850K .......... .......... .......... .......... .......... 85% 4.79M 3s 2024-03-30T13:13:57.226 INFO:teuthology.orchestra.run.smithi044.stderr:143900K .......... .......... .......... .......... .......... 85% 22.7M 3s 2024-03-30T13:13:57.235 INFO:teuthology.orchestra.run.smithi044.stderr:143950K .......... .......... .......... .......... .......... 85% 4.79M 3s 2024-03-30T13:13:57.237 INFO:teuthology.orchestra.run.smithi044.stderr:144000K .......... .......... .......... .......... .......... 85% 18.8M 3s 2024-03-30T13:13:57.240 INFO:teuthology.orchestra.run.smithi044.stderr:144050K .......... .......... .......... .......... .......... 85% 28.2M 3s 2024-03-30T13:13:57.242 INFO:teuthology.orchestra.run.smithi044.stderr:144100K .......... .......... .......... .......... .......... 85% 16.6M 3s 2024-03-30T13:13:57.245 INFO:teuthology.orchestra.run.smithi044.stderr:144150K .......... .......... .......... .......... .......... 85% 16.4M 3s 2024-03-30T13:13:57.247 INFO:teuthology.orchestra.run.smithi044.stderr:144200K .......... .......... .......... .......... .......... 85% 47.1M 3s 2024-03-30T13:13:57.248 INFO:teuthology.orchestra.run.smithi044.stderr:144250K .......... .......... .......... .......... .......... 85% 44.6M 3s 2024-03-30T13:13:57.248 INFO:teuthology.orchestra.run.smithi044.stderr:144300K .......... .......... .......... .......... .......... 85% 47.8M 3s 2024-03-30T13:13:57.258 INFO:teuthology.orchestra.run.smithi044.stderr:144350K .......... .......... .......... .......... .......... 85% 4.91M 3s 2024-03-30T13:13:57.260 INFO:teuthology.orchestra.run.smithi044.stderr:144400K .......... .......... .......... .......... .......... 85% 25.0M 3s 2024-03-30T13:13:57.270 INFO:teuthology.orchestra.run.smithi044.stderr:144450K .......... .......... .......... .......... .......... 85% 4.79M 3s 2024-03-30T13:13:57.274 INFO:teuthology.orchestra.run.smithi044.stderr:144500K .......... .......... .......... .......... .......... 85% 16.2M 3s 2024-03-30T13:13:57.275 INFO:teuthology.orchestra.run.smithi044.stderr:144550K .......... .......... .......... .......... .......... 85% 34.9M 3s 2024-03-30T13:13:57.279 INFO:teuthology.orchestra.run.smithi044.stderr:144600K .......... .......... .......... .......... .......... 85% 12.2M 3s 2024-03-30T13:13:57.282 INFO:teuthology.orchestra.run.smithi044.stderr:144650K .......... .......... .......... .......... .......... 85% 15.0M 3s 2024-03-30T13:13:57.284 INFO:teuthology.orchestra.run.smithi044.stderr:144700K .......... .......... .......... .......... .......... 85% 34.7M 3s 2024-03-30T13:13:57.285 INFO:teuthology.orchestra.run.smithi044.stderr:144750K .......... .......... .......... .......... .......... 85% 42.7M 3s 2024-03-30T13:13:57.286 INFO:teuthology.orchestra.run.smithi044.stderr:144800K .......... .......... .......... .......... .......... 85% 38.4M 3s 2024-03-30T13:13:57.294 INFO:teuthology.orchestra.run.smithi044.stderr:144850K .......... .......... .......... .......... .......... 85% 6.18M 3s 2024-03-30T13:13:57.300 INFO:teuthology.orchestra.run.smithi044.stderr:144900K .......... .......... .......... .......... .......... 85% 21.3M 3s 2024-03-30T13:13:57.307 INFO:teuthology.orchestra.run.smithi044.stderr:144950K .......... .......... .......... .......... .......... 86% 4.82M 3s 2024-03-30T13:13:57.310 INFO:teuthology.orchestra.run.smithi044.stderr:145000K .......... .......... .......... .......... .......... 86% 17.3M 3s 2024-03-30T13:13:57.311 INFO:teuthology.orchestra.run.smithi044.stderr:145050K .......... .......... .......... .......... .......... 86% 30.2M 3s 2024-03-30T13:13:57.315 INFO:teuthology.orchestra.run.smithi044.stderr:145100K .......... .......... .......... .......... .......... 86% 12.8M 3s 2024-03-30T13:13:57.319 INFO:teuthology.orchestra.run.smithi044.stderr:145150K .......... .......... .......... .......... .......... 86% 13.5M 3s 2024-03-30T13:13:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:145200K .......... .......... .......... .......... .......... 86% 25.8M 3s 2024-03-30T13:13:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:145250K .......... .......... .......... .......... .......... 86% 41.6M 3s 2024-03-30T13:13:57.323 INFO:teuthology.orchestra.run.smithi044.stderr:145300K .......... .......... .......... .......... .......... 86% 52.6M 3s 2024-03-30T13:13:57.324 INFO:teuthology.orchestra.run.smithi044.stderr:145350K .......... .......... .......... .......... .......... 86% 21.1M 3s 2024-03-30T13:13:57.335 INFO:teuthology.orchestra.run.smithi044.stderr:145400K .......... .......... .......... .......... .......... 86% 4.54M 3s 2024-03-30T13:13:57.340 INFO:teuthology.orchestra.run.smithi044.stderr:145450K .......... .......... .......... .......... .......... 86% 9.54M 3s 2024-03-30T13:13:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:145500K .......... .......... .......... .......... .......... 86% 13.9M 3s 2024-03-30T13:13:57.345 INFO:teuthology.orchestra.run.smithi044.stderr:145550K .......... .......... .......... .......... .......... 86% 36.0M 3s 2024-03-30T13:13:57.350 INFO:teuthology.orchestra.run.smithi044.stderr:145600K .......... .......... .......... .......... .......... 86% 10.5M 3s 2024-03-30T13:13:57.354 INFO:teuthology.orchestra.run.smithi044.stderr:145650K .......... .......... .......... .......... .......... 86% 12.9M 3s 2024-03-30T13:13:57.358 INFO:teuthology.orchestra.run.smithi044.stderr:145700K .......... .......... .......... .......... .......... 86% 31.4M 3s 2024-03-30T13:13:57.358 INFO:teuthology.orchestra.run.smithi044.stderr:145750K .......... .......... .......... .......... .......... 86% 45.9M 3s 2024-03-30T13:13:57.358 INFO:teuthology.orchestra.run.smithi044.stderr:145800K .......... .......... .......... .......... .......... 86% 49.9M 2s 2024-03-30T13:13:57.360 INFO:teuthology.orchestra.run.smithi044.stderr:145850K .......... .......... .......... .......... .......... 86% 18.2M 2s 2024-03-30T13:13:57.367 INFO:teuthology.orchestra.run.smithi044.stderr:145900K .......... .......... .......... .......... .......... 86% 6.88M 2s 2024-03-30T13:13:57.376 INFO:teuthology.orchestra.run.smithi044.stderr:145950K .......... .......... .......... .......... .......... 86% 5.68M 2s 2024-03-30T13:13:57.379 INFO:teuthology.orchestra.run.smithi044.stderr:146000K .......... .......... .......... .......... .......... 86% 13.5M 2s 2024-03-30T13:13:57.381 INFO:teuthology.orchestra.run.smithi044.stderr:146050K .......... .......... .......... .......... .......... 86% 35.3M 2s 2024-03-30T13:13:57.384 INFO:teuthology.orchestra.run.smithi044.stderr:146100K .......... .......... .......... .......... .......... 86% 15.3M 2s 2024-03-30T13:13:57.390 INFO:teuthology.orchestra.run.smithi044.stderr:146150K .......... .......... .......... .......... .......... 86% 9.53M 2s 2024-03-30T13:13:57.390 INFO:teuthology.orchestra.run.smithi044.stderr:146200K .......... .......... .......... .......... .......... 86% 66.5M 2s 2024-03-30T13:13:57.393 INFO:teuthology.orchestra.run.smithi044.stderr:146250K .......... .......... .......... .......... .......... 86% 27.8M 2s 2024-03-30T13:13:57.393 INFO:teuthology.orchestra.run.smithi044.stderr:146300K .......... .......... .......... .......... .......... 86% 48.4M 2s 2024-03-30T13:13:57.393 INFO:teuthology.orchestra.run.smithi044.stderr:146350K .......... .......... .......... .......... .......... 86% 58.1M 2s 2024-03-30T13:13:57.403 INFO:teuthology.orchestra.run.smithi044.stderr:146400K .......... .......... .......... .......... .......... 86% 5.24M 2s 2024-03-30T13:13:57.411 INFO:teuthology.orchestra.run.smithi044.stderr:146450K .......... .......... .......... .......... .......... 86% 5.86M 2s 2024-03-30T13:13:57.413 INFO:teuthology.orchestra.run.smithi044.stderr:146500K .......... .......... .......... .......... .......... 86% 20.4M 2s 2024-03-30T13:13:57.417 INFO:teuthology.orchestra.run.smithi044.stderr:146550K .......... .......... .......... .......... .......... 86% 18.9M 2s 2024-03-30T13:13:57.419 INFO:teuthology.orchestra.run.smithi044.stderr:146600K .......... .......... .......... .......... .......... 86% 14.8M 2s 2024-03-30T13:13:57.432 INFO:teuthology.orchestra.run.smithi044.stderr:146650K .......... .......... .......... .......... .......... 87% 9.72M 2s 2024-03-30T13:13:57.432 INFO:teuthology.orchestra.run.smithi044.stderr:146700K .......... .......... .......... .......... .......... 87% 60.6M 2s 2024-03-30T13:13:57.432 INFO:teuthology.orchestra.run.smithi044.stderr:146750K .......... .......... .......... .......... .......... 87% 29.4M 2s 2024-03-30T13:13:57.433 INFO:teuthology.orchestra.run.smithi044.stderr:146800K .......... .......... .......... .......... .......... 87% 43.0M 2s 2024-03-30T13:13:57.433 INFO:teuthology.orchestra.run.smithi044.stderr:146850K .......... .......... .......... .......... .......... 87% 62.8M 2s 2024-03-30T13:13:57.438 INFO:teuthology.orchestra.run.smithi044.stderr:146900K .......... .......... .......... .......... .......... 87% 5.39M 2s 2024-03-30T13:13:57.442 INFO:teuthology.orchestra.run.smithi044.stderr:146950K .......... .......... .......... .......... .......... 87% 12.6M 2s 2024-03-30T13:13:57.447 INFO:teuthology.orchestra.run.smithi044.stderr:147000K .......... .......... .......... .......... .......... 87% 8.93M 2s 2024-03-30T13:13:57.452 INFO:teuthology.orchestra.run.smithi044.stderr:147050K .......... .......... .......... .......... .......... 87% 11.1M 2s 2024-03-30T13:13:57.455 INFO:teuthology.orchestra.run.smithi044.stderr:147100K .......... .......... .......... .......... .......... 87% 15.5M 2s 2024-03-30T13:13:57.457 INFO:teuthology.orchestra.run.smithi044.stderr:147150K .......... .......... .......... .......... .......... 87% 22.3M 2s 2024-03-30T13:13:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:147200K .......... .......... .......... .......... .......... 87% 10.3M 2s 2024-03-30T13:13:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:147250K .......... .......... .......... .......... .......... 87% 61.7M 2s 2024-03-30T13:13:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:147300K .......... .......... .......... .......... .......... 87% 58.7M 2s 2024-03-30T13:13:57.465 INFO:teuthology.orchestra.run.smithi044.stderr:147350K .......... .......... .......... .......... .......... 87% 68.1M 2s 2024-03-30T13:13:57.473 INFO:teuthology.orchestra.run.smithi044.stderr:147400K .......... .......... .......... .......... .......... 87% 5.57M 2s 2024-03-30T13:13:57.474 INFO:teuthology.orchestra.run.smithi044.stderr:147450K .......... .......... .......... .......... .......... 87% 25.9M 2s 2024-03-30T13:13:57.485 INFO:teuthology.orchestra.run.smithi044.stderr:147500K .......... .......... .......... .......... .......... 87% 4.73M 2s 2024-03-30T13:13:57.491 INFO:teuthology.orchestra.run.smithi044.stderr:147550K .......... .......... .......... .......... .......... 87% 8.68M 2s 2024-03-30T13:13:57.492 INFO:teuthology.orchestra.run.smithi044.stderr:147600K .......... .......... .......... .......... .......... 87% 63.8M 2s 2024-03-30T13:13:57.494 INFO:teuthology.orchestra.run.smithi044.stderr:147650K .......... .......... .......... .......... .......... 87% 18.5M 2s 2024-03-30T13:13:57.500 INFO:teuthology.orchestra.run.smithi044.stderr:147700K .......... .......... .......... .......... .......... 87% 16.3M 2s 2024-03-30T13:13:57.500 INFO:teuthology.orchestra.run.smithi044.stderr:147750K .......... .......... .......... .......... .......... 87% 66.2M 2s 2024-03-30T13:13:57.500 INFO:teuthology.orchestra.run.smithi044.stderr:147800K .......... .......... .......... .......... .......... 87% 66.4M 2s 2024-03-30T13:13:57.501 INFO:teuthology.orchestra.run.smithi044.stderr:147850K .......... .......... .......... .......... .......... 87% 41.1M 2s 2024-03-30T13:13:57.501 INFO:teuthology.orchestra.run.smithi044.stderr:147900K .......... .......... .......... .......... .......... 87% 32.9M 2s 2024-03-30T13:13:57.510 INFO:teuthology.orchestra.run.smithi044.stderr:147950K .......... .......... .......... .......... .......... 87% 5.49M 2s 2024-03-30T13:13:57.521 INFO:teuthology.orchestra.run.smithi044.stderr:148000K .......... .......... .......... .......... .......... 87% 6.29M 2s 2024-03-30T13:13:57.527 INFO:teuthology.orchestra.run.smithi044.stderr:148050K .......... .......... .......... .......... .......... 87% 6.62M 2s 2024-03-30T13:13:57.527 INFO:teuthology.orchestra.run.smithi044.stderr:148100K .......... .......... .......... .......... .......... 87% 33.2M 2s 2024-03-30T13:13:57.529 INFO:teuthology.orchestra.run.smithi044.stderr:148150K .......... .......... .......... .......... .......... 87% 22.0M 2s 2024-03-30T13:13:57.536 INFO:teuthology.orchestra.run.smithi044.stderr:148200K .......... .......... .......... .......... .......... 87% 14.4M 2s 2024-03-30T13:13:57.536 INFO:teuthology.orchestra.run.smithi044.stderr:148250K .......... .......... .......... .......... .......... 87% 64.0M 2s 2024-03-30T13:13:57.536 INFO:teuthology.orchestra.run.smithi044.stderr:148300K .......... .......... .......... .......... .......... 88% 69.7M 2s 2024-03-30T13:13:57.536 INFO:teuthology.orchestra.run.smithi044.stderr:148350K .......... .......... .......... .......... .......... 88% 68.4M 2s 2024-03-30T13:13:57.536 INFO:teuthology.orchestra.run.smithi044.stderr:148400K .......... .......... .......... .......... .......... 88% 44.5M 2s 2024-03-30T13:13:57.546 INFO:teuthology.orchestra.run.smithi044.stderr:148450K .......... .......... .......... .......... .......... 88% 4.86M 2s 2024-03-30T13:13:57.548 INFO:teuthology.orchestra.run.smithi044.stderr:148500K .......... .......... .......... .......... .......... 88% 17.8M 2s 2024-03-30T13:13:57.561 INFO:teuthology.orchestra.run.smithi044.stderr:148550K .......... .......... .......... .......... .......... 88% 4.01M 2s 2024-03-30T13:13:57.562 INFO:teuthology.orchestra.run.smithi044.stderr:148600K .......... .......... .......... .......... .......... 88% 37.8M 2s 2024-03-30T13:13:57.564 INFO:teuthology.orchestra.run.smithi044.stderr:148650K .......... .......... .......... .......... .......... 88% 20.8M 2s 2024-03-30T13:13:57.565 INFO:teuthology.orchestra.run.smithi044.stderr:148700K .......... .......... .......... .......... .......... 88% 33.6M 2s 2024-03-30T13:13:57.571 INFO:teuthology.orchestra.run.smithi044.stderr:148750K .......... .......... .......... .......... .......... 88% 18.8M 2s 2024-03-30T13:13:57.571 INFO:teuthology.orchestra.run.smithi044.stderr:148800K .......... .......... .......... .......... .......... 88% 59.4M 2s 2024-03-30T13:13:57.571 INFO:teuthology.orchestra.run.smithi044.stderr:148850K .......... .......... .......... .......... .......... 88% 68.6M 2s 2024-03-30T13:13:57.571 INFO:teuthology.orchestra.run.smithi044.stderr:148900K .......... .......... .......... .......... .......... 88% 44.3M 2s 2024-03-30T13:13:57.573 INFO:teuthology.orchestra.run.smithi044.stderr:148950K .......... .......... .......... .......... .......... 88% 17.3M 2s 2024-03-30T13:13:57.581 INFO:teuthology.orchestra.run.smithi044.stderr:149000K .......... .......... .......... .......... .......... 88% 6.26M 2s 2024-03-30T13:13:57.592 INFO:teuthology.orchestra.run.smithi044.stderr:149050K .......... .......... .......... .......... .......... 88% 4.71M 2s 2024-03-30T13:13:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:149100K .......... .......... .......... .......... .......... 88% 9.24M 2s 2024-03-30T13:13:57.598 INFO:teuthology.orchestra.run.smithi044.stderr:149150K .......... .......... .......... .......... .......... 88% 64.5M 2s 2024-03-30T13:13:57.600 INFO:teuthology.orchestra.run.smithi044.stderr:149200K .......... .......... .......... .......... .......... 88% 22.7M 2s 2024-03-30T13:13:57.607 INFO:teuthology.orchestra.run.smithi044.stderr:149250K .......... .......... .......... .......... .......... 88% 14.0M 2s 2024-03-30T13:13:57.607 INFO:teuthology.orchestra.run.smithi044.stderr:149300K .......... .......... .......... .......... .......... 88% 55.0M 2s 2024-03-30T13:13:57.607 INFO:teuthology.orchestra.run.smithi044.stderr:149350K .......... .......... .......... .......... .......... 88% 73.4M 2s 2024-03-30T13:13:57.607 INFO:teuthology.orchestra.run.smithi044.stderr:149400K .......... .......... .......... .......... .......... 88% 61.9M 2s 2024-03-30T13:13:57.607 INFO:teuthology.orchestra.run.smithi044.stderr:149450K .......... .......... .......... .......... .......... 88% 53.5M 2s 2024-03-30T13:13:57.617 INFO:teuthology.orchestra.run.smithi044.stderr:149500K .......... .......... .......... .......... .......... 88% 4.87M 2s 2024-03-30T13:13:57.624 INFO:teuthology.orchestra.run.smithi044.stderr:149550K .......... .......... .......... .......... .......... 88% 6.49M 2s 2024-03-30T13:13:57.634 INFO:teuthology.orchestra.run.smithi044.stderr:149600K .......... .......... .......... .......... .......... 88% 6.64M 2s 2024-03-30T13:13:57.635 INFO:teuthology.orchestra.run.smithi044.stderr:149650K .......... .......... .......... .......... .......... 88% 32.0M 2s 2024-03-30T13:13:57.636 INFO:teuthology.orchestra.run.smithi044.stderr:149700K .......... .......... .......... .......... .......... 88% 19.1M 2s 2024-03-30T13:13:57.639 INFO:teuthology.orchestra.run.smithi044.stderr:149750K .......... .......... .......... .......... .......... 88% 14.6M 2s 2024-03-30T13:13:57.640 INFO:teuthology.orchestra.run.smithi044.stderr:149800K .......... .......... .......... .......... .......... 88% 58.8M 2s 2024-03-30T13:13:57.641 INFO:teuthology.orchestra.run.smithi044.stderr:149850K .......... .......... .......... .......... .......... 88% 79.4M 2s 2024-03-30T13:13:57.642 INFO:teuthology.orchestra.run.smithi044.stderr:149900K .......... .......... .......... .......... .......... 88% 52.9M 2s 2024-03-30T13:13:57.642 INFO:teuthology.orchestra.run.smithi044.stderr:149950K .......... .......... .......... .......... .......... 88% 70.6M 2s 2024-03-30T13:13:57.651 INFO:teuthology.orchestra.run.smithi044.stderr:150000K .......... .......... .......... .......... .......... 89% 5.74M 2s 2024-03-30T13:13:57.653 INFO:teuthology.orchestra.run.smithi044.stderr:150050K .......... .......... .......... .......... .......... 89% 23.3M 2s 2024-03-30T13:13:57.663 INFO:teuthology.orchestra.run.smithi044.stderr:150100K .......... .......... .......... .......... .......... 89% 4.67M 2s 2024-03-30T13:13:57.669 INFO:teuthology.orchestra.run.smithi044.stderr:150150K .......... .......... .......... .......... .......... 89% 9.60M 2s 2024-03-30T13:13:57.671 INFO:teuthology.orchestra.run.smithi044.stderr:150200K .......... .......... .......... .......... .......... 89% 59.9M 2s 2024-03-30T13:13:57.672 INFO:teuthology.orchestra.run.smithi044.stderr:150250K .......... .......... .......... .......... .......... 89% 16.2M 2s 2024-03-30T13:13:57.676 INFO:teuthology.orchestra.run.smithi044.stderr:150300K .......... .......... .......... .......... .......... 89% 17.8M 2s 2024-03-30T13:13:57.676 INFO:teuthology.orchestra.run.smithi044.stderr:150350K .......... .......... .......... .......... .......... 89% 65.4M 2s 2024-03-30T13:13:57.678 INFO:teuthology.orchestra.run.smithi044.stderr:150400K .......... .......... .......... .......... .......... 89% 65.1M 2s 2024-03-30T13:13:57.678 INFO:teuthology.orchestra.run.smithi044.stderr:150450K .......... .......... .......... .......... .......... 89% 68.9M 2s 2024-03-30T13:13:57.678 INFO:teuthology.orchestra.run.smithi044.stderr:150500K .......... .......... .......... .......... .......... 89% 56.2M 2s 2024-03-30T13:13:57.688 INFO:teuthology.orchestra.run.smithi044.stderr:150550K .......... .......... .......... .......... .......... 89% 4.90M 2s 2024-03-30T13:13:57.695 INFO:teuthology.orchestra.run.smithi044.stderr:150600K .......... .......... .......... .......... .......... 89% 17.0M 2s 2024-03-30T13:13:57.699 INFO:teuthology.orchestra.run.smithi044.stderr:150650K .......... .......... .......... .......... .......... 89% 5.93M 2s 2024-03-30T13:13:57.704 INFO:teuthology.orchestra.run.smithi044.stderr:150700K .......... .......... .......... .......... .......... 89% 9.26M 2s 2024-03-30T13:13:57.706 INFO:teuthology.orchestra.run.smithi044.stderr:150750K .......... .......... .......... .......... .......... 89% 20.4M 2s 2024-03-30T13:13:57.710 INFO:teuthology.orchestra.run.smithi044.stderr:150800K .......... .......... .......... .......... .......... 89% 15.4M 2s 2024-03-30T13:13:57.712 INFO:teuthology.orchestra.run.smithi044.stderr:150850K .......... .......... .......... .......... .......... 89% 69.2M 2s 2024-03-30T13:13:57.712 INFO:teuthology.orchestra.run.smithi044.stderr:150900K .......... .......... .......... .......... .......... 89% 49.1M 2s 2024-03-30T13:13:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:150950K .......... .......... .......... .......... .......... 89% 66.8M 2s 2024-03-30T13:13:57.713 INFO:teuthology.orchestra.run.smithi044.stderr:151000K .......... .......... .......... .......... .......... 89% 72.9M 2s 2024-03-30T13:13:57.714 INFO:teuthology.orchestra.run.smithi044.stderr:151050K .......... .......... .......... .......... .......... 89% 31.9M 2s 2024-03-30T13:13:57.724 INFO:teuthology.orchestra.run.smithi044.stderr:151100K .......... .......... .......... .......... .......... 89% 5.14M 2s 2024-03-30T13:13:57.734 INFO:teuthology.orchestra.run.smithi044.stderr:151150K .......... .......... .......... .......... .......... 89% 4.89M 2s 2024-03-30T13:13:57.740 INFO:teuthology.orchestra.run.smithi044.stderr:151200K .......... .......... .......... .......... .......... 89% 9.23M 2s 2024-03-30T13:13:57.740 INFO:teuthology.orchestra.run.smithi044.stderr:151250K .......... .......... .......... .......... .......... 89% 65.6M 2s 2024-03-30T13:13:57.743 INFO:teuthology.orchestra.run.smithi044.stderr:151300K .......... .......... .......... .......... .......... 89% 13.4M 2s 2024-03-30T13:13:57.746 INFO:teuthology.orchestra.run.smithi044.stderr:151350K .......... .......... .......... .......... .......... 89% 22.7M 2s 2024-03-30T13:13:57.747 INFO:teuthology.orchestra.run.smithi044.stderr:151400K .......... .......... .......... .......... .......... 89% 63.8M 2s 2024-03-30T13:13:57.747 INFO:teuthology.orchestra.run.smithi044.stderr:151450K .......... .......... .......... .......... .......... 89% 66.8M 2s 2024-03-30T13:13:57.748 INFO:teuthology.orchestra.run.smithi044.stderr:151500K .......... .......... .......... .......... .......... 89% 59.8M 2s 2024-03-30T13:13:57.749 INFO:teuthology.orchestra.run.smithi044.stderr:151550K .......... .......... .......... .......... .......... 89% 56.1M 2s 2024-03-30T13:13:57.757 INFO:teuthology.orchestra.run.smithi044.stderr:151600K .......... .......... .......... .......... .......... 89% 5.69M 2s 2024-03-30T13:13:57.759 INFO:teuthology.orchestra.run.smithi044.stderr:151650K .......... .......... .......... .......... .......... 89% 21.8M 2s 2024-03-30T13:13:57.770 INFO:teuthology.orchestra.run.smithi044.stderr:151700K .......... .......... .......... .......... .......... 90% 4.85M 2s 2024-03-30T13:13:57.775 INFO:teuthology.orchestra.run.smithi044.stderr:151750K .......... .......... .......... .......... .......... 90% 9.43M 2s 2024-03-30T13:13:57.778 INFO:teuthology.orchestra.run.smithi044.stderr:151800K .......... .......... .......... .......... .......... 90% 20.3M 2s 2024-03-30T13:13:57.781 INFO:teuthology.orchestra.run.smithi044.stderr:151850K .......... .......... .......... .......... .......... 90% 14.2M 2s 2024-03-30T13:13:57.781 INFO:teuthology.orchestra.run.smithi044.stderr:151900K .......... .......... .......... .......... .......... 90% 60.1M 2s 2024-03-30T13:13:57.783 INFO:teuthology.orchestra.run.smithi044.stderr:151950K .......... .......... .......... .......... .......... 90% 68.9M 2s 2024-03-30T13:13:57.784 INFO:teuthology.orchestra.run.smithi044.stderr:152000K .......... .......... .......... .......... .......... 90% 63.0M 2s 2024-03-30T13:13:57.784 INFO:teuthology.orchestra.run.smithi044.stderr:152050K .......... .......... .......... .......... .......... 90% 66.2M 2s 2024-03-30T13:13:57.784 INFO:teuthology.orchestra.run.smithi044.stderr:152100K .......... .......... .......... .......... .......... 90% 59.4M 2s 2024-03-30T13:13:57.795 INFO:teuthology.orchestra.run.smithi044.stderr:152150K .......... .......... .......... .......... .......... 90% 4.74M 2s 2024-03-30T13:13:57.802 INFO:teuthology.orchestra.run.smithi044.stderr:152200K .......... .......... .......... .......... .......... 90% 6.83M 2s 2024-03-30T13:13:57.805 INFO:teuthology.orchestra.run.smithi044.stderr:152250K .......... .......... .......... .......... .......... 90% 14.5M 2s 2024-03-30T13:13:57.811 INFO:teuthology.orchestra.run.smithi044.stderr:152300K .......... .......... .......... .......... .......... 90% 8.71M 2s 2024-03-30T13:13:57.813 INFO:teuthology.orchestra.run.smithi044.stderr:152350K .......... .......... .......... .......... .......... 90% 22.1M 2s 2024-03-30T13:13:57.821 INFO:teuthology.orchestra.run.smithi044.stderr:152400K .......... .......... .......... .......... .......... 90% 14.8M 2s 2024-03-30T13:13:57.821 INFO:teuthology.orchestra.run.smithi044.stderr:152450K .......... .......... .......... .......... .......... 90% 67.9M 2s 2024-03-30T13:13:57.821 INFO:teuthology.orchestra.run.smithi044.stderr:152500K .......... .......... .......... .......... .......... 90% 66.9M 2s 2024-03-30T13:13:57.821 INFO:teuthology.orchestra.run.smithi044.stderr:152550K .......... .......... .......... .......... .......... 90% 64.1M 2s 2024-03-30T13:13:57.821 INFO:teuthology.orchestra.run.smithi044.stderr:152600K .......... .......... .......... .......... .......... 90% 67.6M 2s 2024-03-30T13:13:57.822 INFO:teuthology.orchestra.run.smithi044.stderr:152650K .......... .......... .......... .......... .......... 90% 30.3M 2s 2024-03-30T13:13:57.831 INFO:teuthology.orchestra.run.smithi044.stderr:152700K .......... .......... .......... .......... .......... 90% 5.15M 2s 2024-03-30T13:13:57.841 INFO:teuthology.orchestra.run.smithi044.stderr:152750K .......... .......... .......... .......... .......... 90% 4.88M 2s 2024-03-30T13:13:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:152800K .......... .......... .......... .......... .......... 90% 8.51M 2s 2024-03-30T13:13:57.847 INFO:teuthology.orchestra.run.smithi044.stderr:152850K .......... .......... .......... .......... .......... 90% 62.1M 2s 2024-03-30T13:13:57.850 INFO:teuthology.orchestra.run.smithi044.stderr:152900K .......... .......... .......... .......... .......... 90% 16.1M 2s 2024-03-30T13:13:57.856 INFO:teuthology.orchestra.run.smithi044.stderr:152950K .......... .......... .......... .......... .......... 90% 21.6M 2s 2024-03-30T13:13:57.857 INFO:teuthology.orchestra.run.smithi044.stderr:153000K .......... .......... .......... .......... .......... 90% 69.4M 2s 2024-03-30T13:13:57.857 INFO:teuthology.orchestra.run.smithi044.stderr:153050K .......... .......... .......... .......... .......... 90% 69.5M 2s 2024-03-30T13:13:57.857 INFO:teuthology.orchestra.run.smithi044.stderr:153100K .......... .......... .......... .......... .......... 90% 57.9M 2s 2024-03-30T13:13:57.857 INFO:teuthology.orchestra.run.smithi044.stderr:153150K .......... .......... .......... .......... .......... 90% 68.4M 2s 2024-03-30T13:13:57.864 INFO:teuthology.orchestra.run.smithi044.stderr:153200K .......... .......... .......... .......... .......... 90% 5.70M 2s 2024-03-30T13:13:57.866 INFO:teuthology.orchestra.run.smithi044.stderr:153250K .......... .......... .......... .......... .......... 90% 22.2M 2s 2024-03-30T13:13:57.876 INFO:teuthology.orchestra.run.smithi044.stderr:153300K .......... .......... .......... .......... .......... 90% 4.77M 2s 2024-03-30T13:13:57.883 INFO:teuthology.orchestra.run.smithi044.stderr:153350K .......... .......... .......... .......... .......... 91% 7.99M 2s 2024-03-30T13:13:57.884 INFO:teuthology.orchestra.run.smithi044.stderr:153400K .......... .......... .......... .......... .......... 91% 27.3M 2s 2024-03-30T13:13:57.892 INFO:teuthology.orchestra.run.smithi044.stderr:153450K .......... .......... .......... .......... .......... 91% 13.5M 2s 2024-03-30T13:13:57.892 INFO:teuthology.orchestra.run.smithi044.stderr:153500K .......... .......... .......... .......... .......... 91% 55.1M 2s 2024-03-30T13:13:57.892 INFO:teuthology.orchestra.run.smithi044.stderr:153550K .......... .......... .......... .......... .......... 91% 66.8M 2s 2024-03-30T13:13:57.893 INFO:teuthology.orchestra.run.smithi044.stderr:153600K .......... .......... .......... .......... .......... 91% 64.5M 2s 2024-03-30T13:13:57.893 INFO:teuthology.orchestra.run.smithi044.stderr:153650K .......... .......... .......... .......... .......... 91% 66.8M 2s 2024-03-30T13:13:57.893 INFO:teuthology.orchestra.run.smithi044.stderr:153700K .......... .......... .......... .......... .......... 91% 53.7M 2s 2024-03-30T13:13:57.902 INFO:teuthology.orchestra.run.smithi044.stderr:153750K .......... .......... .......... .......... .......... 91% 5.28M 2s 2024-03-30T13:13:57.909 INFO:teuthology.orchestra.run.smithi044.stderr:153800K .......... .......... .......... .......... .......... 91% 6.43M 2s 2024-03-30T13:13:57.918 INFO:teuthology.orchestra.run.smithi044.stderr:153850K .......... .......... .......... .......... .......... 91% 5.49M 2s 2024-03-30T13:13:57.919 INFO:teuthology.orchestra.run.smithi044.stderr:153900K .......... .......... .......... .......... .......... 91% 68.5M 2s 2024-03-30T13:13:57.920 INFO:teuthology.orchestra.run.smithi044.stderr:153950K .......... .......... .......... .......... .......... 91% 31.3M 2s 2024-03-30T13:13:57.929 INFO:teuthology.orchestra.run.smithi044.stderr:154000K .......... .......... .......... .......... .......... 91% 12.5M 2s 2024-03-30T13:13:57.929 INFO:teuthology.orchestra.run.smithi044.stderr:154050K .......... .......... .......... .......... .......... 91% 64.2M 2s 2024-03-30T13:13:57.929 INFO:teuthology.orchestra.run.smithi044.stderr:154100K .......... .......... .......... .......... .......... 91% 58.2M 2s 2024-03-30T13:13:57.929 INFO:teuthology.orchestra.run.smithi044.stderr:154150K .......... .......... .......... .......... .......... 91% 66.8M 2s 2024-03-30T13:13:57.929 INFO:teuthology.orchestra.run.smithi044.stderr:154200K .......... .......... .......... .......... .......... 91% 75.2M 2s 2024-03-30T13:13:57.929 INFO:teuthology.orchestra.run.smithi044.stderr:154250K .......... .......... .......... .......... .......... 91% 54.6M 2s 2024-03-30T13:13:57.937 INFO:teuthology.orchestra.run.smithi044.stderr:154300K .......... .......... .......... .......... .......... 91% 5.24M 2s 2024-03-30T13:13:57.945 INFO:teuthology.orchestra.run.smithi044.stderr:154350K .......... .......... .......... .......... .......... 91% 6.51M 2s 2024-03-30T13:13:57.954 INFO:teuthology.orchestra.run.smithi044.stderr:154400K .......... .......... .......... .......... .......... 91% 5.28M 2s 2024-03-30T13:13:57.955 INFO:teuthology.orchestra.run.smithi044.stderr:154450K .......... .......... .......... .......... .......... 91% 74.9M 2s 2024-03-30T13:13:57.956 INFO:teuthology.orchestra.run.smithi044.stderr:154500K .......... .......... .......... .......... .......... 91% 29.6M 2s 2024-03-30T13:13:57.964 INFO:teuthology.orchestra.run.smithi044.stderr:154550K .......... .......... .......... .......... .......... 91% 14.8M 2s 2024-03-30T13:13:57.964 INFO:teuthology.orchestra.run.smithi044.stderr:154600K .......... .......... .......... .......... .......... 91% 56.7M 1s 2024-03-30T13:13:57.964 INFO:teuthology.orchestra.run.smithi044.stderr:154650K .......... .......... .......... .......... .......... 91% 71.9M 1s 2024-03-30T13:13:57.964 INFO:teuthology.orchestra.run.smithi044.stderr:154700K .......... .......... .......... .......... .......... 91% 64.2M 1s 2024-03-30T13:13:57.964 INFO:teuthology.orchestra.run.smithi044.stderr:154750K .......... .......... .......... .......... .......... 91% 76.6M 1s 2024-03-30T13:13:57.964 INFO:teuthology.orchestra.run.smithi044.stderr:154800K .......... .......... .......... .......... .......... 91% 27.8M 1s 2024-03-30T13:13:57.973 INFO:teuthology.orchestra.run.smithi044.stderr:154850K .......... .......... .......... .......... .......... 91% 5.51M 1s 2024-03-30T13:13:57.983 INFO:teuthology.orchestra.run.smithi044.stderr:154900K .......... .......... .......... .......... .......... 91% 6.80M 1s 2024-03-30T13:13:57.990 INFO:teuthology.orchestra.run.smithi044.stderr:154950K .......... .......... .......... .......... .......... 91% 5.24M 1s 2024-03-30T13:13:57.990 INFO:teuthology.orchestra.run.smithi044.stderr:155000K .......... .......... .......... .......... .......... 91% 71.6M 1s 2024-03-30T13:13:57.992 INFO:teuthology.orchestra.run.smithi044.stderr:155050K .......... .......... .......... .......... .......... 92% 21.3M 1s 2024-03-30T13:13:57.999 INFO:teuthology.orchestra.run.smithi044.stderr:155100K .......... .......... .......... .......... .......... 92% 17.8M 1s 2024-03-30T13:13:57.999 INFO:teuthology.orchestra.run.smithi044.stderr:155150K .......... .......... .......... .......... .......... 92% 60.7M 1s 2024-03-30T13:13:57.999 INFO:teuthology.orchestra.run.smithi044.stderr:155200K .......... .......... .......... .......... .......... 92% 72.0M 1s 2024-03-30T13:13:57.999 INFO:teuthology.orchestra.run.smithi044.stderr:155250K .......... .......... .......... .......... .......... 92% 49.8M 1s 2024-03-30T13:13:57.999 INFO:teuthology.orchestra.run.smithi044.stderr:155300K .......... .......... .......... .......... .......... 92% 79.2M 1s 2024-03-30T13:13:58.007 INFO:teuthology.orchestra.run.smithi044.stderr:155350K .......... .......... .......... .......... .......... 92% 5.86M 1s 2024-03-30T13:13:58.009 INFO:teuthology.orchestra.run.smithi044.stderr:155400K .......... .......... .......... .......... .......... 92% 23.3M 1s 2024-03-30T13:13:58.018 INFO:teuthology.orchestra.run.smithi044.stderr:155450K .......... .......... .......... .......... .......... 92% 5.07M 1s 2024-03-30T13:13:58.025 INFO:teuthology.orchestra.run.smithi044.stderr:155500K .......... .......... .......... .......... .......... 92% 7.27M 1s 2024-03-30T13:13:58.027 INFO:teuthology.orchestra.run.smithi044.stderr:155550K .......... .......... .......... .......... .......... 92% 30.3M 1s 2024-03-30T13:13:58.035 INFO:teuthology.orchestra.run.smithi044.stderr:155600K .......... .......... .......... .......... .......... 92% 14.1M 1s 2024-03-30T13:13:58.035 INFO:teuthology.orchestra.run.smithi044.stderr:155650K .......... .......... .......... .......... .......... 92% 58.4M 1s 2024-03-30T13:13:58.035 INFO:teuthology.orchestra.run.smithi044.stderr:155700K .......... .......... .......... .......... .......... 92% 68.9M 1s 2024-03-30T13:13:58.035 INFO:teuthology.orchestra.run.smithi044.stderr:155750K .......... .......... .......... .......... .......... 92% 77.7M 1s 2024-03-30T13:13:58.035 INFO:teuthology.orchestra.run.smithi044.stderr:155800K .......... .......... .......... .......... .......... 92% 59.1M 1s 2024-03-30T13:13:58.036 INFO:teuthology.orchestra.run.smithi044.stderr:155850K .......... .......... .......... .......... .......... 92% 59.5M 1s 2024-03-30T13:13:58.044 INFO:teuthology.orchestra.run.smithi044.stderr:155900K .......... .......... .......... .......... .......... 92% 4.92M 1s 2024-03-30T13:13:58.046 INFO:teuthology.orchestra.run.smithi044.stderr:155950K .......... .......... .......... .......... .......... 92% 71.2M 1s 2024-03-30T13:13:58.054 INFO:teuthology.orchestra.run.smithi044.stderr:156000K .......... .......... .......... .......... .......... 92% 5.14M 1s 2024-03-30T13:13:58.061 INFO:teuthology.orchestra.run.smithi044.stderr:156050K .......... .......... .......... .......... .......... 92% 6.98M 1s 2024-03-30T13:13:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:156100K .......... .......... .......... .......... .......... 92% 34.6M 1s 2024-03-30T13:13:58.070 INFO:teuthology.orchestra.run.smithi044.stderr:156150K .......... .......... .......... .......... .......... 92% 14.9M 1s 2024-03-30T13:13:58.178 INFO:teuthology.orchestra.run.smithi044.stderr:156200K .......... .......... .......... .......... .......... 92% 67.5M 1s 2024-03-30T13:13:58.179 INFO:teuthology.orchestra.run.smithi044.stderr:156250K .......... .......... .......... .......... .......... 92% 65.5M 1s 2024-03-30T13:13:58.179 INFO:teuthology.orchestra.run.smithi044.stderr:156300K .......... .......... .......... .......... .......... 92% 70.6M 1s 2024-03-30T13:13:58.179 INFO:teuthology.orchestra.run.smithi044.stderr:156350K .......... .......... .......... .......... .......... 92% 59.1M 1s 2024-03-30T13:13:58.179 INFO:teuthology.orchestra.run.smithi044.stderr:156400K .......... .......... .......... .......... .......... 92% 56.2M 1s 2024-03-30T13:13:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:156450K .......... .......... .......... .......... .......... 92% 4.95M 1s 2024-03-30T13:13:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:156500K .......... .......... .......... .......... .......... 92% 45.9M 1s 2024-03-30T13:13:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:156550K .......... .......... .......... .......... .......... 92% 5.31M 1s 2024-03-30T13:13:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:156600K .......... .......... .......... .......... .......... 92% 7.01M 1s 2024-03-30T13:13:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:156650K .......... .......... .......... .......... .......... 92% 35.8M 1s 2024-03-30T13:13:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:156700K .......... .......... .......... .......... .......... 92% 15.1M 1s 2024-03-30T13:13:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:156750K .......... .......... .......... .......... .......... 93% 63.2M 1s 2024-03-30T13:13:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:156800K .......... .......... .......... .......... .......... 93% 67.8M 1s 2024-03-30T13:13:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:156850K .......... .......... .......... .......... .......... 93% 61.8M 1s 2024-03-30T13:13:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:156900K .......... .......... .......... .......... .......... 93% 68.4M 1s 2024-03-30T13:13:58.206 INFO:teuthology.orchestra.run.smithi044.stderr:156950K .......... .......... .......... .......... .......... 93% 37.1M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157000K .......... .......... .......... .......... .......... 93% 5.11M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157050K .......... .......... .......... .......... .......... 93% 59.5M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157100K .......... .......... .......... .......... .......... 93% 5.22M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157150K .......... .......... .......... .......... .......... 93% 6.92M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157200K .......... .......... .......... .......... .......... 93% 30.2M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157250K .......... .......... .......... .......... .......... 93% 15.5M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157300K .......... .......... .......... .......... .......... 93% 54.7M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157350K .......... .......... .......... .......... .......... 93% 67.1M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157400K .......... .......... .......... .......... .......... 93% 54.0M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157450K .......... .......... .......... .......... .......... 93% 27.9M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157500K .......... .......... .......... .......... .......... 93% 6.90M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157550K .......... .......... .......... .......... .......... 93% 20.9M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157600K .......... .......... .......... .......... .......... 93% 69.7M 1s 2024-03-30T13:13:58.207 INFO:teuthology.orchestra.run.smithi044.stderr:157650K .......... .......... .......... .......... .......... 93% 5.25M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:157700K .......... .......... .......... .......... .......... 93% 6.76M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:157750K .......... .......... .......... .......... .......... 93% 35.1M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:157800K .......... .......... .......... .......... .......... 93% 14.5M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:157850K .......... .......... .......... .......... .......... 93% 55.3M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:157900K .......... .......... .......... .......... .......... 93% 75.4M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:157950K .......... .......... .......... .......... .......... 93% 34.3M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:158000K .......... .......... .......... .......... .......... 93% 36.7M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:158050K .......... .......... .......... .......... .......... 93% 7.03M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:158100K .......... .......... .......... .......... .......... 93% 20.3M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:158150K .......... .......... .......... .......... .......... 93% 66.1M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:158200K .......... .......... .......... .......... .......... 93% 3.02M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:158250K .......... .......... .......... .......... .......... 93% 64.7M 1s 2024-03-30T13:13:58.208 INFO:teuthology.orchestra.run.smithi044.stderr:158300K .......... .......... .......... .......... .......... 93% 29.5M 1s 2024-03-30T13:13:58.210 INFO:teuthology.orchestra.run.smithi044.stderr:158350K .......... .......... .......... .......... .......... 93% 10.7M 1s 2024-03-30T13:13:58.212 INFO:teuthology.orchestra.run.smithi044.stderr:158400K .......... .......... .......... .......... .......... 93% 50.7M 1s 2024-03-30T13:13:58.213 INFO:teuthology.orchestra.run.smithi044.stderr:158450K .......... .......... .......... .......... .......... 94% 54.9M 1s 2024-03-30T13:13:58.218 INFO:teuthology.orchestra.run.smithi044.stderr:158500K .......... .......... .......... .......... .......... 94% 10.3M 1s 2024-03-30T13:13:58.218 INFO:teuthology.orchestra.run.smithi044.stderr:158550K .......... .......... .......... .......... .......... 94% 43.4M 1s 2024-03-30T13:13:58.222 INFO:teuthology.orchestra.run.smithi044.stderr:158600K .......... .......... .......... .......... .......... 94% 12.8M 1s 2024-03-30T13:13:58.223 INFO:teuthology.orchestra.run.smithi044.stderr:158650K .......... .......... .......... .......... .......... 94% 56.0M 1s 2024-03-30T13:13:58.231 INFO:teuthology.orchestra.run.smithi044.stderr:158700K .......... .......... .......... .......... .......... 94% 5.95M 1s 2024-03-30T13:13:58.240 INFO:teuthology.orchestra.run.smithi044.stderr:158750K .......... .......... .......... .......... .......... 94% 6.15M 1s 2024-03-30T13:13:58.240 INFO:teuthology.orchestra.run.smithi044.stderr:158800K .......... .......... .......... .......... .......... 94% 56.2M 1s 2024-03-30T13:13:58.241 INFO:teuthology.orchestra.run.smithi044.stderr:158850K .......... .......... .......... .......... .......... 94% 30.9M 1s 2024-03-30T13:13:58.247 INFO:teuthology.orchestra.run.smithi044.stderr:158900K .......... .......... .......... .......... .......... 94% 10.3M 1s 2024-03-30T13:13:58.248 INFO:teuthology.orchestra.run.smithi044.stderr:158950K .......... .......... .......... .......... .......... 94% 62.6M 1s 2024-03-30T13:13:58.248 INFO:teuthology.orchestra.run.smithi044.stderr:159000K .......... .......... .......... .......... .......... 94% 51.1M 1s 2024-03-30T13:13:58.252 INFO:teuthology.orchestra.run.smithi044.stderr:159050K .......... .......... .......... .......... .......... 94% 14.9M 1s 2024-03-30T13:13:58.253 INFO:teuthology.orchestra.run.smithi044.stderr:159100K .......... .......... .......... .......... .......... 94% 21.0M 1s 2024-03-30T13:13:58.257 INFO:teuthology.orchestra.run.smithi044.stderr:159150K .......... .......... .......... .......... .......... 94% 13.1M 1s 2024-03-30T13:13:58.259 INFO:teuthology.orchestra.run.smithi044.stderr:159200K .......... .......... .......... .......... .......... 94% 41.3M 1s 2024-03-30T13:13:58.267 INFO:teuthology.orchestra.run.smithi044.stderr:159250K .......... .......... .......... .......... .......... 94% 5.88M 1s 2024-03-30T13:13:58.275 INFO:teuthology.orchestra.run.smithi044.stderr:159300K .......... .......... .......... .......... .......... 94% 6.24M 1s 2024-03-30T13:13:58.275 INFO:teuthology.orchestra.run.smithi044.stderr:159350K .......... .......... .......... .......... .......... 94% 63.6M 1s 2024-03-30T13:13:58.277 INFO:teuthology.orchestra.run.smithi044.stderr:159400K .......... .......... .......... .......... .......... 94% 27.6M 1s 2024-03-30T13:13:58.281 INFO:teuthology.orchestra.run.smithi044.stderr:159450K .......... .......... .......... .......... .......... 94% 10.5M 1s 2024-03-30T13:13:58.282 INFO:teuthology.orchestra.run.smithi044.stderr:159500K .......... .......... .......... .......... .......... 94% 64.4M 1s 2024-03-30T13:13:58.283 INFO:teuthology.orchestra.run.smithi044.stderr:159550K .......... .......... .......... .......... .......... 94% 47.7M 1s 2024-03-30T13:13:58.287 INFO:teuthology.orchestra.run.smithi044.stderr:159600K .......... .......... .......... .......... .......... 94% 14.6M 1s 2024-03-30T13:13:58.289 INFO:teuthology.orchestra.run.smithi044.stderr:159650K .......... .......... .......... .......... .......... 94% 21.9M 1s 2024-03-30T13:13:58.293 INFO:teuthology.orchestra.run.smithi044.stderr:159700K .......... .......... .......... .......... .......... 94% 12.9M 1s 2024-03-30T13:13:58.294 INFO:teuthology.orchestra.run.smithi044.stderr:159750K .......... .......... .......... .......... .......... 94% 40.6M 1s 2024-03-30T13:13:58.302 INFO:teuthology.orchestra.run.smithi044.stderr:159800K .......... .......... .......... .......... .......... 94% 6.15M 1s 2024-03-30T13:13:58.311 INFO:teuthology.orchestra.run.smithi044.stderr:159850K .......... .......... .......... .......... .......... 94% 5.85M 1s 2024-03-30T13:13:58.312 INFO:teuthology.orchestra.run.smithi044.stderr:159900K .......... .......... .......... .......... .......... 94% 69.7M 1s 2024-03-30T13:13:58.313 INFO:teuthology.orchestra.run.smithi044.stderr:159950K .......... .......... .......... .......... .......... 94% 19.1M 1s 2024-03-30T13:13:58.317 INFO:teuthology.orchestra.run.smithi044.stderr:160000K .......... .......... .......... .......... .......... 94% 12.9M 1s 2024-03-30T13:13:58.319 INFO:teuthology.orchestra.run.smithi044.stderr:160050K .......... .......... .......... .......... .......... 94% 26.8M 1s 2024-03-30T13:13:58.322 INFO:teuthology.orchestra.run.smithi044.stderr:160100K .......... .......... .......... .......... .......... 95% 17.0M 1s 2024-03-30T13:13:58.325 INFO:teuthology.orchestra.run.smithi044.stderr:160150K .......... .......... .......... .......... .......... 95% 19.3M 1s 2024-03-30T13:13:58.326 INFO:teuthology.orchestra.run.smithi044.stderr:160200K .......... .......... .......... .......... .......... 95% 41.5M 1s 2024-03-30T13:13:58.329 INFO:teuthology.orchestra.run.smithi044.stderr:160250K .......... .......... .......... .......... .......... 95% 16.7M 1s 2024-03-30T13:13:58.330 INFO:teuthology.orchestra.run.smithi044.stderr:160300K .......... .......... .......... .......... .......... 95% 59.3M 1s 2024-03-30T13:13:58.337 INFO:teuthology.orchestra.run.smithi044.stderr:160350K .......... .......... .......... .......... .......... 95% 5.97M 1s 2024-03-30T13:13:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:160400K .......... .......... .......... .......... .......... 95% 5.92M 1s 2024-03-30T13:13:58.346 INFO:teuthology.orchestra.run.smithi044.stderr:160450K .......... .......... .......... .......... .......... 95% 63.7M 1s 2024-03-30T13:13:58.348 INFO:teuthology.orchestra.run.smithi044.stderr:160500K .......... .......... .......... .......... .......... 95% 32.3M 1s 2024-03-30T13:13:58.353 INFO:teuthology.orchestra.run.smithi044.stderr:160550K .......... .......... .......... .......... .......... 95% 9.97M 1s 2024-03-30T13:13:58.354 INFO:teuthology.orchestra.run.smithi044.stderr:160600K .......... .......... .......... .......... .......... 95% 36.0M 1s 2024-03-30T13:13:58.358 INFO:teuthology.orchestra.run.smithi044.stderr:160650K .......... .......... .......... .......... .......... 95% 15.1M 1s 2024-03-30T13:13:58.359 INFO:teuthology.orchestra.run.smithi044.stderr:160700K .......... .......... .......... .......... .......... 95% 28.8M 1s 2024-03-30T13:13:58.360 INFO:teuthology.orchestra.run.smithi044.stderr:160750K .......... .......... .......... .......... .......... 95% 32.0M 1s 2024-03-30T13:13:58.364 INFO:teuthology.orchestra.run.smithi044.stderr:160800K .......... .......... .......... .......... .......... 95% 33.5M 1s 2024-03-30T13:13:58.365 INFO:teuthology.orchestra.run.smithi044.stderr:160850K .......... .......... .......... .......... .......... 95% 17.6M 1s 2024-03-30T13:13:58.373 INFO:teuthology.orchestra.run.smithi044.stderr:160900K .......... .......... .......... .......... .......... 95% 6.19M 1s 2024-03-30T13:13:58.374 INFO:teuthology.orchestra.run.smithi044.stderr:160950K .......... .......... .......... .......... .......... 95% 51.4M 1s 2024-03-30T13:13:58.382 INFO:teuthology.orchestra.run.smithi044.stderr:161000K .......... .......... .......... .......... .......... 95% 6.01M 1s 2024-03-30T13:13:58.383 INFO:teuthology.orchestra.run.smithi044.stderr:161050K .......... .......... .......... .......... .......... 95% 31.0M 1s 2024-03-30T13:13:58.388 INFO:teuthology.orchestra.run.smithi044.stderr:161100K .......... .......... .......... .......... .......... 95% 9.99M 1s 2024-03-30T13:13:58.390 INFO:teuthology.orchestra.run.smithi044.stderr:161150K .......... .......... .......... .......... .......... 95% 35.3M 1s 2024-03-30T13:13:58.393 INFO:teuthology.orchestra.run.smithi044.stderr:161200K .......... .......... .......... .......... .......... 95% 15.9M 1s 2024-03-30T13:13:58.394 INFO:teuthology.orchestra.run.smithi044.stderr:161250K .......... .......... .......... .......... .......... 95% 44.1M 1s 2024-03-30T13:13:58.396 INFO:teuthology.orchestra.run.smithi044.stderr:161300K .......... .......... .......... .......... .......... 95% 20.9M 1s 2024-03-30T13:13:58.398 INFO:teuthology.orchestra.run.smithi044.stderr:161350K .......... .......... .......... .......... .......... 95% 30.5M 1s 2024-03-30T13:13:58.401 INFO:teuthology.orchestra.run.smithi044.stderr:161400K .......... .......... .......... .......... .......... 95% 17.1M 1s 2024-03-30T13:13:58.402 INFO:teuthology.orchestra.run.smithi044.stderr:161450K .......... .......... .......... .......... .......... 95% 51.1M 1s 2024-03-30T13:13:58.409 INFO:teuthology.orchestra.run.smithi044.stderr:161500K .......... .......... .......... .......... .......... 95% 6.57M 1s 2024-03-30T13:13:58.418 INFO:teuthology.orchestra.run.smithi044.stderr:161550K .......... .......... .......... .......... .......... 95% 5.54M 1s 2024-03-30T13:13:58.420 INFO:teuthology.orchestra.run.smithi044.stderr:161600K .......... .......... .......... .......... .......... 95% 24.8M 1s 2024-03-30T13:13:58.424 INFO:teuthology.orchestra.run.smithi044.stderr:161650K .......... .......... .......... .......... .......... 95% 12.7M 1s 2024-03-30T13:13:58.425 INFO:teuthology.orchestra.run.smithi044.stderr:161700K .......... .......... .......... .......... .......... 95% 49.1M 1s 2024-03-30T13:13:58.428 INFO:teuthology.orchestra.run.smithi044.stderr:161750K .......... .......... .......... .......... .......... 95% 13.8M 1s 2024-03-30T13:13:58.429 INFO:teuthology.orchestra.run.smithi044.stderr:161800K .......... .......... .......... .......... .......... 96% 44.9M 1s 2024-03-30T13:13:58.432 INFO:teuthology.orchestra.run.smithi044.stderr:161850K .......... .......... .......... .......... .......... 96% 20.5M 1s 2024-03-30T13:13:58.434 INFO:teuthology.orchestra.run.smithi044.stderr:161900K .......... .......... .......... .......... .......... 96% 28.7M 1s 2024-03-30T13:13:58.437 INFO:teuthology.orchestra.run.smithi044.stderr:161950K .......... .......... .......... .......... .......... 96% 17.3M 1s 2024-03-30T13:13:58.437 INFO:teuthology.orchestra.run.smithi044.stderr:162000K .......... .......... .......... .......... .......... 96% 65.4M 1s 2024-03-30T13:13:58.444 INFO:teuthology.orchestra.run.smithi044.stderr:162050K .......... .......... .......... .......... .......... 96% 6.52M 1s 2024-03-30T13:13:58.454 INFO:teuthology.orchestra.run.smithi044.stderr:162100K .......... .......... .......... .......... .......... 96% 5.40M 1s 2024-03-30T13:13:58.455 INFO:teuthology.orchestra.run.smithi044.stderr:162150K .......... .......... .......... .......... .......... 96% 31.6M 1s 2024-03-30T13:13:58.460 INFO:teuthology.orchestra.run.smithi044.stderr:162200K .......... .......... .......... .......... .......... 96% 11.4M 1s 2024-03-30T13:13:58.460 INFO:teuthology.orchestra.run.smithi044.stderr:162250K .......... .......... .......... .......... .......... 96% 66.5M 1s 2024-03-30T13:13:58.464 INFO:teuthology.orchestra.run.smithi044.stderr:162300K .......... .......... .......... .......... .......... 96% 13.4M 1s 2024-03-30T13:13:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:162350K .......... .......... .......... .......... .......... 96% 61.1M 1s 2024-03-30T13:13:58.467 INFO:teuthology.orchestra.run.smithi044.stderr:162400K .......... .......... .......... .......... .......... 96% 18.8M 1s 2024-03-30T13:13:58.468 INFO:teuthology.orchestra.run.smithi044.stderr:162450K .......... .......... .......... .......... .......... 96% 40.8M 1s 2024-03-30T13:13:58.471 INFO:teuthology.orchestra.run.smithi044.stderr:162500K .......... .......... .......... .......... .......... 96% 21.2M 1s 2024-03-30T13:13:58.473 INFO:teuthology.orchestra.run.smithi044.stderr:162550K .......... .......... .......... .......... .......... 96% 28.6M 1s 2024-03-30T13:13:58.481 INFO:teuthology.orchestra.run.smithi044.stderr:162600K .......... .......... .......... .......... .......... 96% 6.48M 1s 2024-03-30T13:13:58.490 INFO:teuthology.orchestra.run.smithi044.stderr:162650K .......... .......... .......... .......... .......... 96% 5.39M 1s 2024-03-30T13:13:58.490 INFO:teuthology.orchestra.run.smithi044.stderr:162700K .......... .......... .......... .......... .......... 96% 55.6M 1s 2024-03-30T13:13:58.492 INFO:teuthology.orchestra.run.smithi044.stderr:162750K .......... .......... .......... .......... .......... 96% 21.7M 1s 2024-03-30T13:13:58.496 INFO:teuthology.orchestra.run.smithi044.stderr:162800K .......... .......... .......... .......... .......... 96% 14.7M 1s 2024-03-30T13:13:58.497 INFO:teuthology.orchestra.run.smithi044.stderr:162850K .......... .......... .......... .......... .......... 96% 25.7M 1s 2024-03-30T13:13:58.500 INFO:teuthology.orchestra.run.smithi044.stderr:162900K .......... .......... .......... .......... .......... 96% 18.1M 1s 2024-03-30T13:13:58.503 INFO:teuthology.orchestra.run.smithi044.stderr:162950K .......... .......... .......... .......... .......... 96% 18.2M 1s 2024-03-30T13:13:58.504 INFO:teuthology.orchestra.run.smithi044.stderr:163000K .......... .......... .......... .......... .......... 96% 74.8M 1s 2024-03-30T13:13:58.506 INFO:teuthology.orchestra.run.smithi044.stderr:163050K .......... .......... .......... .......... .......... 96% 19.9M 1s 2024-03-30T13:13:58.508 INFO:teuthology.orchestra.run.smithi044.stderr:163100K .......... .......... .......... .......... .......... 96% 25.8M 1s 2024-03-30T13:13:58.516 INFO:teuthology.orchestra.run.smithi044.stderr:163150K .......... .......... .......... .......... .......... 96% 6.49M 1s 2024-03-30T13:13:58.516 INFO:teuthology.orchestra.run.smithi044.stderr:163200K .......... .......... .......... .......... .......... 96% 52.4M 1s 2024-03-30T13:13:58.525 INFO:teuthology.orchestra.run.smithi044.stderr:163250K .......... .......... .......... .......... .......... 96% 5.28M 1s 2024-03-30T13:13:58.527 INFO:teuthology.orchestra.run.smithi044.stderr:163300K .......... .......... .......... .......... .......... 96% 23.0M 1s 2024-03-30T13:13:58.531 INFO:teuthology.orchestra.run.smithi044.stderr:163350K .......... .......... .......... .......... .......... 96% 15.2M 1s 2024-03-30T13:13:58.533 INFO:teuthology.orchestra.run.smithi044.stderr:163400K .......... .......... .......... .......... .......... 96% 29.1M 1s 2024-03-30T13:13:58.536 INFO:teuthology.orchestra.run.smithi044.stderr:163450K .......... .......... .......... .......... .......... 96% 16.4M 1s 2024-03-30T13:13:58.538 INFO:teuthology.orchestra.run.smithi044.stderr:163500K .......... .......... .......... .......... .......... 97% 18.7M 1s 2024-03-30T13:13:58.539 INFO:teuthology.orchestra.run.smithi044.stderr:163550K .......... .......... .......... .......... .......... 97% 58.8M 1s 2024-03-30T13:13:58.541 INFO:teuthology.orchestra.run.smithi044.stderr:163600K .......... .......... .......... .......... .......... 97% 26.7M 1s 2024-03-30T13:13:58.544 INFO:teuthology.orchestra.run.smithi044.stderr:163650K .......... .......... .......... .......... .......... 97% 19.1M 1s 2024-03-30T13:13:58.544 INFO:teuthology.orchestra.run.smithi044.stderr:163700K .......... .......... .......... .......... .......... 97% 69.1M 1s 2024-03-30T13:13:58.551 INFO:teuthology.orchestra.run.smithi044.stderr:163750K .......... .......... .......... .......... .......... 97% 6.46M 1s 2024-03-30T13:13:58.561 INFO:teuthology.orchestra.run.smithi044.stderr:163800K .......... .......... .......... .......... .......... 97% 5.27M 0s 2024-03-30T13:13:58.562 INFO:teuthology.orchestra.run.smithi044.stderr:163850K .......... .......... .......... .......... .......... 97% 35.9M 0s 2024-03-30T13:13:58.567 INFO:teuthology.orchestra.run.smithi044.stderr:163900K .......... .......... .......... .......... .......... 97% 12.5M 0s 2024-03-30T13:13:58.567 INFO:teuthology.orchestra.run.smithi044.stderr:163950K .......... .......... .......... .......... .......... 97% 56.2M 0s 2024-03-30T13:13:58.571 INFO:teuthology.orchestra.run.smithi044.stderr:164000K .......... .......... .......... .......... .......... 97% 12.5M 0s 2024-03-30T13:13:58.572 INFO:teuthology.orchestra.run.smithi044.stderr:164050K .......... .......... .......... .......... .......... 97% 46.8M 0s 2024-03-30T13:13:58.574 INFO:teuthology.orchestra.run.smithi044.stderr:164100K .......... .......... .......... .......... .......... 97% 21.6M 0s 2024-03-30T13:13:58.576 INFO:teuthology.orchestra.run.smithi044.stderr:164150K .......... .......... .......... .......... .......... 97% 25.2M 0s 2024-03-30T13:13:58.577 INFO:teuthology.orchestra.run.smithi044.stderr:164200K .......... .......... .......... .......... .......... 97% 32.8M 0s 2024-03-30T13:13:58.579 INFO:teuthology.orchestra.run.smithi044.stderr:164250K .......... .......... .......... .......... .......... 97% 27.9M 0s 2024-03-30T13:13:58.587 INFO:teuthology.orchestra.run.smithi044.stderr:164300K .......... .......... .......... .......... .......... 97% 6.42M 0s 2024-03-30T13:13:58.596 INFO:teuthology.orchestra.run.smithi044.stderr:164350K .......... .......... .......... .......... .......... 97% 5.36M 0s 2024-03-30T13:13:58.598 INFO:teuthology.orchestra.run.smithi044.stderr:164400K .......... .......... .......... .......... .......... 97% 31.6M 0s 2024-03-30T13:13:58.602 INFO:teuthology.orchestra.run.smithi044.stderr:164450K .......... .......... .......... .......... .......... 97% 11.7M 0s 2024-03-30T13:13:58.602 INFO:teuthology.orchestra.run.smithi044.stderr:164500K .......... .......... .......... .......... .......... 97% 75.2M 0s 2024-03-30T13:13:58.607 INFO:teuthology.orchestra.run.smithi044.stderr:164550K .......... .......... .......... .......... .......... 97% 12.6M 0s 2024-03-30T13:13:58.607 INFO:teuthology.orchestra.run.smithi044.stderr:164600K .......... .......... .......... .......... .......... 97% 66.0M 0s 2024-03-30T13:13:58.610 INFO:teuthology.orchestra.run.smithi044.stderr:164650K .......... .......... .......... .......... .......... 97% 17.7M 0s 2024-03-30T13:13:58.610 INFO:teuthology.orchestra.run.smithi044.stderr:164700K .......... .......... .......... .......... .......... 97% 56.7M 0s 2024-03-30T13:13:58.613 INFO:teuthology.orchestra.run.smithi044.stderr:164750K .......... .......... .......... .......... .......... 97% 22.1M 0s 2024-03-30T13:13:58.615 INFO:teuthology.orchestra.run.smithi044.stderr:164800K .......... .......... .......... .......... .......... 97% 26.3M 0s 2024-03-30T13:13:58.623 INFO:teuthology.orchestra.run.smithi044.stderr:164850K .......... .......... .......... .......... .......... 97% 6.45M 0s 2024-03-30T13:13:58.632 INFO:teuthology.orchestra.run.smithi044.stderr:164900K .......... .......... .......... .......... .......... 97% 5.18M 0s 2024-03-30T13:13:58.633 INFO:teuthology.orchestra.run.smithi044.stderr:164950K .......... .......... .......... .......... .......... 97% 74.7M 0s 2024-03-30T13:13:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:165000K .......... .......... .......... .......... .......... 97% 10.3M 0s 2024-03-30T13:13:58.638 INFO:teuthology.orchestra.run.smithi044.stderr:165050K .......... .......... .......... .......... .......... 97% 66.3M 0s 2024-03-30T13:13:58.639 INFO:teuthology.orchestra.run.smithi044.stderr:165100K .......... .......... .......... .......... .......... 97% 30.2M 0s 2024-03-30T13:13:58.643 INFO:teuthology.orchestra.run.smithi044.stderr:165150K .......... .......... .......... .......... .......... 98% 16.8M 0s 2024-03-30T13:13:58.646 INFO:teuthology.orchestra.run.smithi044.stderr:165200K .......... .......... .......... .......... .......... 98% 18.8M 0s 2024-03-30T13:13:58.646 INFO:teuthology.orchestra.run.smithi044.stderr:165250K .......... .......... .......... .......... .......... 98% 48.8M 0s 2024-03-30T13:13:58.648 INFO:teuthology.orchestra.run.smithi044.stderr:165300K .......... .......... .......... .......... .......... 98% 21.7M 0s 2024-03-30T13:13:58.650 INFO:teuthology.orchestra.run.smithi044.stderr:165350K .......... .......... .......... .......... .......... 98% 27.3M 0s 2024-03-30T13:13:58.658 INFO:teuthology.orchestra.run.smithi044.stderr:165400K .......... .......... .......... .......... .......... 98% 6.23M 0s 2024-03-30T13:13:58.668 INFO:teuthology.orchestra.run.smithi044.stderr:165450K .......... .......... .......... .......... .......... 98% 5.24M 0s 2024-03-30T13:13:58.668 INFO:teuthology.orchestra.run.smithi044.stderr:165500K .......... .......... .......... .......... .......... 98% 61.7M 0s 2024-03-30T13:13:58.670 INFO:teuthology.orchestra.run.smithi044.stderr:165550K .......... .......... .......... .......... .......... 98% 24.1M 0s 2024-03-30T13:13:58.673 INFO:teuthology.orchestra.run.smithi044.stderr:165600K .......... .......... .......... .......... .......... 98% 14.9M 0s 2024-03-30T13:13:58.675 INFO:teuthology.orchestra.run.smithi044.stderr:165650K .......... .......... .......... .......... .......... 98% 33.7M 0s 2024-03-30T13:13:58.678 INFO:teuthology.orchestra.run.smithi044.stderr:165700K .......... .......... .......... .......... .......... 98% 15.6M 0s 2024-03-30T13:13:58.682 INFO:teuthology.orchestra.run.smithi044.stderr:165750K .......... .......... .......... .......... .......... 98% 19.7M 0s 2024-03-30T13:13:58.682 INFO:teuthology.orchestra.run.smithi044.stderr:165800K .......... .......... .......... .......... .......... 98% 45.4M 0s 2024-03-30T13:13:58.684 INFO:teuthology.orchestra.run.smithi044.stderr:165850K .......... .......... .......... .......... .......... 98% 35.4M 0s 2024-03-30T13:13:58.686 INFO:teuthology.orchestra.run.smithi044.stderr:165900K .......... .......... .......... .......... .......... 98% 17.6M 0s 2024-03-30T13:13:58.694 INFO:teuthology.orchestra.run.smithi044.stderr:165950K .......... .......... .......... .......... .......... 98% 6.17M 0s 2024-03-30T13:13:58.694 INFO:teuthology.orchestra.run.smithi044.stderr:166000K .......... .......... .......... .......... .......... 98% 64.3M 0s 2024-03-30T13:13:58.704 INFO:teuthology.orchestra.run.smithi044.stderr:166050K .......... .......... .......... .......... .......... 98% 5.40M 0s 2024-03-30T13:13:58.705 INFO:teuthology.orchestra.run.smithi044.stderr:166100K .......... .......... .......... .......... .......... 98% 52.6M 0s 2024-03-30T13:13:58.709 INFO:teuthology.orchestra.run.smithi044.stderr:166150K .......... .......... .......... .......... .......... 98% 11.0M 0s 2024-03-30T13:13:58.710 INFO:teuthology.orchestra.run.smithi044.stderr:166200K .......... .......... .......... .......... .......... 98% 35.4M 0s 2024-03-30T13:13:58.714 INFO:teuthology.orchestra.run.smithi044.stderr:166250K .......... .......... .......... .......... .......... 98% 15.3M 0s 2024-03-30T13:13:58.714 INFO:teuthology.orchestra.run.smithi044.stderr:166300K .......... .......... .......... .......... .......... 98% 58.5M 0s 2024-03-30T13:13:58.718 INFO:teuthology.orchestra.run.smithi044.stderr:166350K .......... .......... .......... .......... .......... 98% 17.8M 0s 2024-03-30T13:13:58.718 INFO:teuthology.orchestra.run.smithi044.stderr:166400K .......... .......... .......... .......... .......... 98% 43.8M 0s 2024-03-30T13:13:58.722 INFO:teuthology.orchestra.run.smithi044.stderr:166450K .......... .......... .......... .......... .......... 98% 16.0M 0s 2024-03-30T13:13:58.722 INFO:teuthology.orchestra.run.smithi044.stderr:166500K .......... .......... .......... .......... .......... 98% 60.3M 0s 2024-03-30T13:13:58.730 INFO:teuthology.orchestra.run.smithi044.stderr:166550K .......... .......... .......... .......... .......... 98% 6.20M 0s 2024-03-30T13:13:58.740 INFO:teuthology.orchestra.run.smithi044.stderr:166600K .......... .......... .......... .......... .......... 98% 5.41M 0s 2024-03-30T13:13:58.740 INFO:teuthology.orchestra.run.smithi044.stderr:166650K .......... .......... .......... .......... .......... 98% 61.9M 0s 2024-03-30T13:13:58.745 INFO:teuthology.orchestra.run.smithi044.stderr:166700K .......... .......... .......... .......... .......... 98% 10.8M 0s 2024-03-30T13:13:58.745 INFO:teuthology.orchestra.run.smithi044.stderr:166750K .......... .......... .......... .......... .......... 98% 67.0M 0s 2024-03-30T13:13:58.749 INFO:teuthology.orchestra.run.smithi044.stderr:166800K .......... .......... .......... .......... .......... 98% 12.6M 0s 2024-03-30T13:13:58.749 INFO:teuthology.orchestra.run.smithi044.stderr:166850K .......... .......... .......... .......... .......... 99% 57.4M 0s 2024-03-30T13:13:58.753 INFO:teuthology.orchestra.run.smithi044.stderr:166900K .......... .......... .......... .......... .......... 99% 18.8M 0s 2024-03-30T13:13:58.753 INFO:teuthology.orchestra.run.smithi044.stderr:166950K .......... .......... .......... .......... .......... 99% 44.2M 0s 2024-03-30T13:13:58.758 INFO:teuthology.orchestra.run.smithi044.stderr:167000K .......... .......... .......... .......... .......... 99% 8.70M 0s 2024-03-30T13:13:58.760 INFO:teuthology.orchestra.run.smithi044.stderr:167050K .......... .......... .......... .......... .......... 99% 27.8M 0s 2024-03-30T13:13:58.766 INFO:teuthology.orchestra.run.smithi044.stderr:167100K .......... .......... .......... .......... .......... 99% 9.16M 0s 2024-03-30T13:13:58.775 INFO:teuthology.orchestra.run.smithi044.stderr:167150K .......... .......... .......... .......... .......... 99% 5.86M 0s 2024-03-30T13:13:58.775 INFO:teuthology.orchestra.run.smithi044.stderr:167200K .......... .......... .......... .......... .......... 99% 70.0M 0s 2024-03-30T13:13:58.780 INFO:teuthology.orchestra.run.smithi044.stderr:167250K .......... .......... .......... .......... .......... 99% 10.9M 0s 2024-03-30T13:13:58.780 INFO:teuthology.orchestra.run.smithi044.stderr:167300K .......... .......... .......... .......... .......... 99% 68.0M 0s 2024-03-30T13:13:58.785 INFO:teuthology.orchestra.run.smithi044.stderr:167350K .......... .......... .......... .......... .......... 99% 12.4M 0s 2024-03-30T13:13:58.785 INFO:teuthology.orchestra.run.smithi044.stderr:167400K .......... .......... .......... .......... .......... 99% 59.7M 0s 2024-03-30T13:13:58.789 INFO:teuthology.orchestra.run.smithi044.stderr:167450K .......... .......... .......... .......... .......... 99% 17.3M 0s 2024-03-30T13:13:58.789 INFO:teuthology.orchestra.run.smithi044.stderr:167500K .......... .......... .......... .......... .......... 99% 68.8M 0s 2024-03-30T13:13:58.794 INFO:teuthology.orchestra.run.smithi044.stderr:167550K .......... .......... .......... .......... .......... 99% 9.05M 0s 2024-03-30T13:13:58.796 INFO:teuthology.orchestra.run.smithi044.stderr:167600K .......... .......... .......... .......... .......... 99% 23.7M 0s 2024-03-30T13:13:58.802 INFO:teuthology.orchestra.run.smithi044.stderr:167650K .......... .......... .......... .......... .......... 99% 8.79M 0s 2024-03-30T13:13:58.811 INFO:teuthology.orchestra.run.smithi044.stderr:167700K .......... .......... .......... .......... .......... 99% 6.06M 0s 2024-03-30T13:13:58.811 INFO:teuthology.orchestra.run.smithi044.stderr:167750K .......... .......... .......... .......... .......... 99% 63.8M 0s 2024-03-30T13:13:58.812 INFO:teuthology.orchestra.run.smithi044.stderr:167800K .......... .......... .......... .......... .......... 99% 27.7M 0s 2024-03-30T13:13:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:167850K .......... .......... .......... .......... .......... 99% 15.0M 0s 2024-03-30T13:13:58.816 INFO:teuthology.orchestra.run.smithi044.stderr:167900K .......... .......... .......... .......... .......... 99% 35.9M 0s 2024-03-30T13:13:58.820 INFO:teuthology.orchestra.run.smithi044.stderr:167950K .......... .......... .......... .......... .......... 99% 13.7M 0s 2024-03-30T13:13:58.824 INFO:teuthology.orchestra.run.smithi044.stderr:168000K .......... .......... .......... .......... .......... 99% 18.7M 0s 2024-03-30T13:13:58.824 INFO:teuthology.orchestra.run.smithi044.stderr:168050K .......... .......... .......... .......... .......... 99% 51.4M 0s 2024-03-30T13:13:58.829 INFO:teuthology.orchestra.run.smithi044.stderr:168100K .......... .......... .......... .......... .......... 99% 9.04M 0s 2024-03-30T13:13:58.831 INFO:teuthology.orchestra.run.smithi044.stderr:168150K .......... .......... .......... .......... .......... 99% 24.4M 0s 2024-03-30T13:13:58.837 INFO:teuthology.orchestra.run.smithi044.stderr:168200K .......... .......... .......... .......... .......... 99% 8.63M 0s 2024-03-30T13:13:58.837 INFO:teuthology.orchestra.run.smithi044.stderr:168250K .......... .......... .......... .......... .......... 99% 68.3M 0s 2024-03-30T13:13:58.846 INFO:teuthology.orchestra.run.smithi044.stderr:168300K .......... .......... .......... .......... .......... 99% 6.01M 0s 2024-03-30T13:13:58.847 INFO:teuthology.orchestra.run.smithi044.stderr:168350K .......... .......... .......... .......... .......... 99% 30.8M 0s 2024-03-30T13:13:58.851 INFO:teuthology.orchestra.run.smithi044.stderr:168400K .......... .......... .......... .......... .......... 99% 14.8M 0s 2024-03-30T13:13:58.851 INFO:teuthology.orchestra.run.smithi044.stderr:168450K .......... .......... .......... .......... .......... 99% 66.4M 0s 2024-03-30T13:13:58.856 INFO:teuthology.orchestra.run.smithi044.stderr:168500K .......... .......... .......... .......... .......... 99% 11.6M 0s 2024-03-30T13:13:58.856 INFO:teuthology.orchestra.run.smithi044.stderr:168550K .......... .......... . 100% 54.2M=18s 2024-03-30T13:13:58.856 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-03-30T13:13:58.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30 13:13:58 (9.39 MB/s) - ‘linux-5.4.tar.gz’ saved [172616875/172616875] 2024-03-30T13:13:58.856 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-03-30T13:13:58.859 INFO:tasks.cephfs.test_uninlining:Running Data Uninlining test with: without clearing cache, without unmount client, without mount.open_background, without multimds, without snapshots 2024-03-30T13:13:58.859 DEBUG:tasks.cephfs.test_uninlining:setting max_mds:1 2024-03-30T13:13:58.859 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-03-30T13:13:59.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.118+0000 7fb01da00640 1 Processor -- start 2024-03-30T13:13:59.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.118+0000 7fb01da00640 1 -- start start 2024-03-30T13:13:59.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.120+0000 7fb01da00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb01815e400 0x7fb0180d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.120+0000 7fb01da00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb0180d1920 0x7fb0180d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.120+0000 7fb01da00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0180cfea0 0x7fb0180d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.120+0000 7fb01da00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb01815e7e0 con 0x7fb0180d1920 2024-03-30T13:13:59.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.120+0000 7fb01da00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fb0180cf0e0 con 0x7fb01815e400 2024-03-30T13:13:59.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.120+0000 7fb01da00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb0180cf3c0 con 0x7fb0180cfea0 2024-03-30T13:13:59.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.120+0000 7fb017400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb0180d1920 0x7fb0180d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.120+0000 7fb017400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb0180d1920 0x7fb0180d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51988/0 (socket says 172.21.15.44:51988) 2024-03-30T13:13:59.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.120+0000 7fb017400640 1 -- 172.21.15.44:0/107975333 learned_addr learned my addr 172.21.15.44:0/107975333 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:59.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.121+0000 7fb01d000640 1 --2- 172.21.15.44:0/107975333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0180cfea0 0x7fb0180d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.121+0000 7fb017e00640 1 --2- 172.21.15.44:0/107975333 >> v2:172.21.15.151:3300/0 conn(0x7fb01815e400 0x7fb0180d1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.121+0000 7fb017400640 1 -- 172.21.15.44:0/107975333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0180cfea0 msgr2=0x7fb0180d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.121+0000 7fb017400640 1 --2- 172.21.15.44:0/107975333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0180cfea0 0x7fb0180d2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.121+0000 7fb017400640 1 -- 172.21.15.44:0/107975333 >> v2:172.21.15.151:3300/0 conn(0x7fb01815e400 msgr2=0x7fb0180d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:13:59.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.121+0000 7fb017400640 1 --2- 172.21.15.44:0/107975333 >> v2:172.21.15.151:3300/0 conn(0x7fb01815e400 0x7fb0180d1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.121+0000 7fb017400640 1 -- 172.21.15.44:0/107975333 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0180cf6a0 con 0x7fb0180d1920 2024-03-30T13:13:59.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.121+0000 7fb01d000640 1 --2- 172.21.15.44:0/107975333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0180cfea0 0x7fb0180d2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:59.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.121+0000 7fb017e00640 1 --2- 172.21.15.44:0/107975333 >> v2:172.21.15.151:3300/0 conn(0x7fb01815e400 0x7fb0180d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:13:59.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.122+0000 7fb017400640 1 --2- 172.21.15.44:0/107975333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0180d1920 0x7fb0180d2740 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb01808e400 tx=0x7fb00802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1b6e45095c839c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.123+0000 7fb016a00640 1 -- 172.21.15.44:0/107975333 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00802ca80 con 0x7fb0180d1920 2024-03-30T13:13:59.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.123+0000 7fb016a00640 1 -- 172.21.15.44:0/107975333 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00802cc20 con 0x7fb0180d1920 2024-03-30T13:13:59.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.123+0000 7fb016a00640 1 -- 172.21.15.44:0/107975333 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0080343f0 con 0x7fb0180d1920 2024-03-30T13:13:59.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.123+0000 7fb01da00640 1 -- 172.21.15.44:0/107975333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0180d1920 msgr2=0x7fb0180d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.123+0000 7fb01da00640 1 --2- 172.21.15.44:0/107975333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0180d1920 0x7fb0180d2740 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb01808e400 tx=0x7fb00802bee0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.124+0000 7fb01da00640 1 -- 172.21.15.44:0/107975333 shutdown_connections 2024-03-30T13:13:59.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.124+0000 7fb01da00640 1 --2- 172.21.15.44:0/107975333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0180cfea0 0x7fb0180d2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.124+0000 7fb01da00640 1 --2- 172.21.15.44:0/107975333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0180d1920 0x7fb0180d2740 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.124+0000 7fb01da00640 1 --2- 172.21.15.44:0/107975333 >> v2:172.21.15.151:3300/0 conn(0x7fb01815e400 0x7fb0180d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.124+0000 7fb01da00640 1 -- 172.21.15.44:0/107975333 >> 172.21.15.44:0/107975333 conn(0x7fb01809d4c0 msgr2=0x7fb0180d4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:13:59.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.124+0000 7fb01da00640 1 -- 172.21.15.44:0/107975333 shutdown_connections 2024-03-30T13:13:59.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.124+0000 7fb01da00640 1 -- 172.21.15.44:0/107975333 wait complete. 2024-03-30T13:13:59.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.125+0000 7fb01da00640 1 Processor -- start 2024-03-30T13:13:59.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.126+0000 7fb01da00640 1 -- start start 2024-03-30T13:13:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.126+0000 7fb01da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0180cfea0 0x7fb0180c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.126+0000 7fb01da00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0180d1920 0x7fb018159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.126+0000 7fb01da00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb01815e400 0x7fb0180cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.126+0000 7fb01da00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb0180cee80 con 0x7fb0180cfea0 2024-03-30T13:13:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.126+0000 7fb01da00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb0180ced00 con 0x7fb01815e400 2024-03-30T13:13:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.126+0000 7fb01da00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb0180d2290 con 0x7fb0180d1920 2024-03-30T13:13:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.127+0000 7fb017e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0180cfea0 0x7fb0180c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.127+0000 7fb017e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0180cfea0 0x7fb0180c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51992/0 (socket says 172.21.15.44:51992) 2024-03-30T13:13:59.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.127+0000 7fb017e00640 1 -- 172.21.15.44:0/1555911565 learned_addr learned my addr 172.21.15.44:0/1555911565 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:13:59.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.127+0000 7fb017400640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0180d1920 0x7fb018159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.127+0000 7fb017e00640 1 -- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0180d1920 msgr2=0x7fb018159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.127+0000 7fb017e00640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0180d1920 0x7fb018159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.127+0000 7fb017e00640 1 -- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb01815e400 msgr2=0x7fb0180cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:13:59.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.127+0000 7fb017e00640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb01815e400 0x7fb0180cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:13:59.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.127+0000 7fb017e00640 1 -- 172.21.15.44:0/1555911565 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0180c7e80 con 0x7fb0180cfea0 2024-03-30T13:13:59.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.128+0000 7fb017e00640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0180cfea0 0x7fb0180c78a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb00000c820 tx=0x7fb00000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.128+0000 7fb00fe00640 1 -- 172.21.15.44:0/1555911565 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb000015070 con 0x7fb0180cfea0 2024-03-30T13:13:59.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.128+0000 7fb00fe00640 1 -- 172.21.15.44:0/1555911565 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb000007a30 con 0x7fb0180cfea0 2024-03-30T13:13:59.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.128+0000 7fb00fe00640 1 -- 172.21.15.44:0/1555911565 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb000007de0 con 0x7fb0180cfea0 2024-03-30T13:13:59.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.128+0000 7fb01da00640 1 -- 172.21.15.44:0/1555911565 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0180c8160 con 0x7fb0180cfea0 2024-03-30T13:13:59.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.128+0000 7fb01da00640 1 -- 172.21.15.44:0/1555911565 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0180c8720 con 0x7fb0180cfea0 2024-03-30T13:13:59.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.130+0000 7fb01da00640 1 -- 172.21.15.44:0/1555911565 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb018075890 con 0x7fb0180cfea0 2024-03-30T13:13:59.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.130+0000 7fb00fe00640 1 -- 172.21.15.44:0/1555911565 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb000018070 con 0x7fb0180cfea0 2024-03-30T13:13:59.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.132+0000 7fb00fe00640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faff406c530 0x7faff406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:13:59.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.132+0000 7fb00fe00640 1 -- 172.21.15.44:0/1555911565 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7fb00008b840 con 0x7fb0180cfea0 2024-03-30T13:13:59.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.133+0000 7fb017400640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faff406c530 0x7faff406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:13:59.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.134+0000 7fb017400640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faff406c530 0x7faff406e9f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb008035000 tx=0x7fb008030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:13:59.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.136+0000 7fb00fe00640 1 -- 172.21.15.44:0/1555911565 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb000059c30 con 0x7fb0180cfea0 2024-03-30T13:13:59.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:13:59.386+0000 7fb01da00640 1 -- 172.21.15.44:0/1555911565 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7fb0180d4890 con 0x7fb0180cfea0 2024-03-30T13:14:00.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.168+0000 7fb00fe00640 1 -- 172.21.15.44:0/1555911565 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fb000059530 con 0x7fb0180cfea0 2024-03-30T13:14:00.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.171+0000 7fb01da00640 1 -- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faff406c530 msgr2=0x7faff406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.171+0000 7fb01da00640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faff406c530 0x7faff406e9f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb008035000 tx=0x7fb008030000 comp rx=0 tx=0).stop 2024-03-30T13:14:00.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.171+0000 7fb01da00640 1 -- 172.21.15.44:0/1555911565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0180cfea0 msgr2=0x7fb0180c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:00.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.171+0000 7fb01da00640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0180cfea0 0x7fb0180c78a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb00000c820 tx=0x7fb00000cce0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.171+0000 7fb01da00640 1 -- 172.21.15.44:0/1555911565 shutdown_connections 2024-03-30T13:14:00.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.171+0000 7fb01da00640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7faff406c530 0x7faff406e9f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.171+0000 7fb01da00640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb01815e400 0x7fb0180cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.171+0000 7fb01da00640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0180d1920 0x7fb018159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.171+0000 7fb01da00640 1 --2- 172.21.15.44:0/1555911565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb0180cfea0 0x7fb0180c78a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:00.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.171+0000 7fb01da00640 1 -- 172.21.15.44:0/1555911565 >> 172.21.15.44:0/1555911565 conn(0x7fb01809d4c0 msgr2=0x7fb0181611c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:00.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.172+0000 7fb01da00640 1 -- 172.21.15.44:0/1555911565 shutdown_connections 2024-03-30T13:14:00.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:00.172+0000 7fb01da00640 1 -- 172.21.15.44:0/1555911565 wait complete. 2024-03-30T13:14:00.200 DEBUG:tasks.cephfs.test_uninlining:getting client_max_inline_size 2024-03-30T13:14:00.200 DEBUG:tasks.cephfs.test_uninlining:got client_max_inline_size:4096 2024-03-30T13:14:00.200 DEBUG:tasks.cephfs.test_uninlining:extracting tarball 2024-03-30T13:14:00.201 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && tar -x -z -f linux-5.4.tar.gz linux-5.4/fs/ceph linux-5.4/fs/orangefs linux-5.4/fs/ext2 2024-03-30T13:14:00.269 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:14:00.276 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:14:05.408 DEBUG:tasks.cephfs.test_uninlining:fetching dir list 2024-03-30T13:14:05.408 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -mindepth 2 -maxdepth 2 -type d 2024-03-30T13:14:05.525 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph 2024-03-30T13:14:05.526 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2 2024-03-30T13:14:05.526 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs 2024-03-30T13:14:05.527 DEBUG:tasks.cephfs.test_uninlining:distributing dir pins 2024-03-30T13:14:05.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:05.527 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ceph) 2024-03-30T13:14:05.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:05.579 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ext2) 2024-03-30T13:14:05.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:05.677 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/orangefs) 2024-03-30T13:14:05.729 DEBUG:tasks.cephfs.test_uninlining:listing files with size <= 4096 2024-03-30T13:14:05.729 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -type f -size -4097c 2024-03-30T13:14:05.801 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:14:05.801 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/Makefile 2024-03-30T13:14:05.801 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:14:05.801 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/io.h 2024-03-30T13:14:05.801 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:14:05.801 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:14:05.801 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/Makefile 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/acl.h 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:14:05.802 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:14:05.803 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:14:05.803 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:14:05.803 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:14:05.803 INFO:tasks.cephfs.test_uninlining:Found 23 inlined files 2024-03-30T13:14:05.803 DEBUG:tasks.cephfs.test_uninlining:starting scrub 2024-03-30T13:14:05.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:05.803 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive 2024-03-30T13:14:06.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.021+0000 7f661ac00640 1 Processor -- start 2024-03-30T13:14:06.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.021+0000 7f661ac00640 1 -- start start 2024-03-30T13:14:06.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.023+0000 7f661ac00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6614158a70 0x7f6614071e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.023+0000 7f661ac00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f66140d04d0 0x7f6614162070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.024+0000 7f661ac00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f661415ed40 con 0x7f66140723b0 2024-03-30T13:14:06.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.024+0000 7f661ac00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f6614071790 con 0x7f66140d04d0 2024-03-30T13:14:06.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.024+0000 7f661ac00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f661415f670 con 0x7f6614158a70 2024-03-30T13:14:06.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.024+0000 7f6618c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f66140d04d0 0x7f6614162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.024+0000 7f6618c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f66140d04d0 0x7f6614162070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52008/0 (socket says 172.21.15.44:52008) 2024-03-30T13:14:06.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.024+0000 7f6618c00640 1 -- 172.21.15.44:0/629394712 learned_addr learned my addr 172.21.15.44:0/629394712 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:06.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.024+0000 7f6613e00640 1 --2- 172.21.15.44:0/629394712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6614158a70 0x7f6614071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.024+0000 7f6618c00640 1 -- 172.21.15.44:0/629394712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6614158a70 msgr2=0x7f6614071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.024+0000 7f6618c00640 1 --2- 172.21.15.44:0/629394712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6614158a70 0x7f6614071e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.025+0000 7f6618c00640 1 -- 172.21.15.44:0/629394712 >> v1:172.21.15.44:6789/0 conn(0x7f66140723b0 legacy=0x7f66140cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.025+0000 7f6618c00640 1 -- 172.21.15.44:0/629394712 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661415f020 con 0x7f66140d04d0 2024-03-30T13:14:06.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.025+0000 7f6613e00640 1 --2- 172.21.15.44:0/629394712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6614158a70 0x7f6614071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:06.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.026+0000 7f6618c00640 1 --2- 172.21.15.44:0/629394712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66140d04d0 0x7f6614162070 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f660c009e50 tx=0x7f660c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71dc73edb90e09d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.026+0000 7f6613400640 1 -- 172.21.15.44:0/629394712 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c02cb00 con 0x7f66140d04d0 2024-03-30T13:14:06.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.026+0000 7f6613400640 1 -- 172.21.15.44:0/629394712 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660c02cca0 con 0x7f66140d04d0 2024-03-30T13:14:06.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.026+0000 7f6613400640 1 -- 172.21.15.44:0/629394712 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c034610 con 0x7f66140d04d0 2024-03-30T13:14:06.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.027+0000 7f661ac00640 1 -- 172.21.15.44:0/629394712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66140d04d0 msgr2=0x7f6614162070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.027+0000 7f661ac00640 1 --2- 172.21.15.44:0/629394712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66140d04d0 0x7f6614162070 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f660c009e50 tx=0x7f660c02bf60 comp rx=0 tx=0).stop 2024-03-30T13:14:06.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.027+0000 7f661ac00640 1 -- 172.21.15.44:0/629394712 shutdown_connections 2024-03-30T13:14:06.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.027+0000 7f661ac00640 1 --2- 172.21.15.44:0/629394712 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66140d04d0 0x7f6614162070 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.027+0000 7f661ac00640 1 --2- 172.21.15.44:0/629394712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6614158a70 0x7f6614071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.027+0000 7f661ac00640 1 -- 172.21.15.44:0/629394712 >> 172.21.15.44:0/629394712 conn(0x7f661406f060 msgr2=0x7f661406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.027+0000 7f661ac00640 1 -- 172.21.15.44:0/629394712 shutdown_connections 2024-03-30T13:14:06.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.027+0000 7f661ac00640 1 -- 172.21.15.44:0/629394712 wait complete. 2024-03-30T13:14:06.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.029+0000 7f661ac00640 1 Processor -- start 2024-03-30T13:14:06.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.029+0000 7f661ac00640 1 -- start start 2024-03-30T13:14:06.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.030+0000 7f661ac00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66140723b0 0x7f661414ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.030+0000 7f661ac00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66140d04d0 0x7f66141599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.030+0000 7f661ac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6614158a70 0x7f66140afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.030+0000 7f661ac00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6614158e50 con 0x7f6614158a70 2024-03-30T13:14:06.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.030+0000 7f661ac00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f661415ea20 con 0x7f66140723b0 2024-03-30T13:14:06.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.030+0000 7f661ac00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f66140b3250 con 0x7f66140d04d0 2024-03-30T13:14:06.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.030+0000 7f6618c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6614158a70 0x7f66140afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.031+0000 7f6618c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6614158a70 0x7f66140afb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52012/0 (socket says 172.21.15.44:52012) 2024-03-30T13:14:06.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.031+0000 7f6618c00640 1 -- 172.21.15.44:0/3211189316 learned_addr learned my addr 172.21.15.44:0/3211189316 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:06.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.031+0000 7f6613e00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66140723b0 0x7f661414ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.031+0000 7f660be00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66140d04d0 0x7f66141599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.031+0000 7f6618c00640 1 -- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66140d04d0 msgr2=0x7f66141599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.031+0000 7f6618c00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66140d04d0 0x7f66141599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.031+0000 7f6618c00640 1 -- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66140723b0 msgr2=0x7f661414ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.031+0000 7f6618c00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66140723b0 0x7f661414ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.031+0000 7f6618c00640 1 -- 172.21.15.44:0/3211189316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661415aad0 con 0x7f6614158a70 2024-03-30T13:14:06.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.031+0000 7f6613e00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66140723b0 0x7f661414ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:06.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.031+0000 7f6618c00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6614158a70 0x7f66140afb70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f660c009f70 tx=0x7f660c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.032+0000 7f6610c00640 1 -- 172.21.15.44:0/3211189316 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c043020 con 0x7f6614158a70 2024-03-30T13:14:06.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.032+0000 7f6610c00640 1 -- 172.21.15.44:0/3211189316 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660c02ce50 con 0x7f6614158a70 2024-03-30T13:14:06.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.032+0000 7f6610c00640 1 -- 172.21.15.44:0/3211189316 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c009510 con 0x7f6614158a70 2024-03-30T13:14:06.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.032+0000 7f661ac00640 1 -- 172.21.15.44:0/3211189316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f661415a230 con 0x7f6614158a70 2024-03-30T13:14:06.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.032+0000 7f661ac00640 1 -- 172.21.15.44:0/3211189316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f661415a7f0 con 0x7f6614158a70 2024-03-30T13:14:06.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.035+0000 7f6610c00640 1 -- 172.21.15.44:0/3211189316 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f660c046020 con 0x7f6614158a70 2024-03-30T13:14:06.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.036+0000 7f6610c00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f65f006c560 0x7f65f006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.036+0000 7f6610c00640 1 -- 172.21.15.44:0/3211189316 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f660c0adeb0 con 0x7f6614158a70 2024-03-30T13:14:06.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.037+0000 7f661d96f740 1 Processor -- start 2024-03-30T13:14:06.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.037+0000 7f661d96f740 1 -- start start 2024-03-30T13:14:06.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.037+0000 7f6613e00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f65f006c560 0x7f65f006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.038+0000 7f661d96f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 0x5627d8f20cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.038+0000 7f661d96f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 0x5627d8f50ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.038+0000 7f661d96f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f21230 0x5627d8f51020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.038+0000 7f661d96f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5627d8e8a350 con 0x5627d8f4dd50 2024-03-30T13:14:06.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.038+0000 7f661d96f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5627d8e32530 con 0x5627d8f4e130 2024-03-30T13:14:06.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.038+0000 7f661d96f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5627d8e86300 con 0x5627d8f21230 2024-03-30T13:14:06.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.038+0000 7f6613e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 0x5627d8f20cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.038+0000 7f6613e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 0x5627d8f20cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52020/0 (socket says 172.21.15.44:52020) 2024-03-30T13:14:06.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.038+0000 7f6613e00640 1 -- 172.21.15.44:0/4040426788 learned_addr learned my addr 172.21.15.44:0/4040426788 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:06.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.038+0000 7f660be00640 1 --2- 172.21.15.44:0/4040426788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 0x5627d8f50ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.038+0000 7f6618c00640 1 --2- 172.21.15.44:0/4040426788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f21230 0x5627d8f51020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.039+0000 7f6613e00640 1 -- 172.21.15.44:0/4040426788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f21230 msgr2=0x5627d8f51020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.039+0000 7f6613e00640 1 --2- 172.21.15.44:0/4040426788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f21230 0x5627d8f51020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.039+0000 7f6613e00640 1 -- 172.21.15.44:0/4040426788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 msgr2=0x5627d8f50ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.039+0000 7f6613e00640 1 --2- 172.21.15.44:0/4040426788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 0x5627d8f50ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.039+0000 7f6613e00640 1 -- 172.21.15.44:0/4040426788 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627d8e491d0 con 0x5627d8f4dd50 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.039+0000 7f660be00640 1 --2- 172.21.15.44:0/4040426788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 0x5627d8f50ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.039+0000 7f6613e00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f65f006c560 0x7f65f006ea20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6614160e50 tx=0x7f6604007e10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.039+0000 7f6613e00640 1 --2- 172.21.15.44:0/4040426788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 0x5627d8f20cf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f660400fa10 tx=0x7f660401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5a3c9ebf1e036b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.039+0000 7f6603e00640 1 -- 172.21.15.44:0/4040426788 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660401c040 con 0x5627d8f4dd50 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.039+0000 7f6603e00640 1 -- 172.21.15.44:0/4040426788 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6604025070 con 0x5627d8f4dd50 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.039+0000 7f6603e00640 1 -- 172.21.15.44:0/4040426788 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604018e00 con 0x5627d8f4dd50 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.040+0000 7f661d96f740 1 -- 172.21.15.44:0/4040426788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 msgr2=0x5627d8f20cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.040+0000 7f661d96f740 1 --2- 172.21.15.44:0/4040426788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 0x5627d8f20cf0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f660400fa10 tx=0x7f660401a000 comp rx=0 tx=0).stop 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.040+0000 7f661d96f740 1 -- 172.21.15.44:0/4040426788 shutdown_connections 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.040+0000 7f661d96f740 1 --2- 172.21.15.44:0/4040426788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f21230 0x5627d8f51020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.040+0000 7f661d96f740 1 --2- 172.21.15.44:0/4040426788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 0x5627d8f50ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.040+0000 7f661d96f740 1 --2- 172.21.15.44:0/4040426788 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 0x5627d8f20cf0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.040+0000 7f661d96f740 1 -- 172.21.15.44:0/4040426788 >> 172.21.15.44:0/4040426788 conn(0x5627d8f22f60 msgr2=0x5627d8f6bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.040+0000 7f661d96f740 1 -- 172.21.15.44:0/4040426788 shutdown_connections 2024-03-30T13:14:06.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.040+0000 7f661d96f740 1 -- 172.21.15.44:0/4040426788 wait complete. 2024-03-30T13:14:06.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.041+0000 7f661d96f740 1 -- start start 2024-03-30T13:14:06.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.041+0000 7f661d96f740 1 Processor -- start 2024-03-30T13:14:06.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.042+0000 7f661d96f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 0x5627d8f4e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.042+0000 7f661d96f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 0x5627d8f547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.042+0000 7f661d96f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f3b190 0x5627d8f51eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.042+0000 7f661d96f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5627d8f25600 con 0x5627d8f4dd50 2024-03-30T13:14:06.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.042+0000 7f661d96f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5627d8e458f0 con 0x5627d8f4e130 2024-03-30T13:14:06.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.042+0000 7f661d96f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5627d8f27e40 con 0x5627d8f3b190 2024-03-30T13:14:06.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.042+0000 7f661d96f740 10 client.0 _ll_register_callbacks cb 0x5627d8e4a0c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:06.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.042+0000 7f6613e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 0x5627d8f4e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.043+0000 7f6613e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 0x5627d8f4e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52032/0 (socket says 172.21.15.44:52032) 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.043+0000 7f6613e00640 1 -- 172.21.15.44:0/3999684126 learned_addr learned my addr 172.21.15.44:0/3999684126 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.043+0000 7f660be00640 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 0x5627d8f547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.043+0000 7f6618c00640 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f3b190 0x5627d8f51eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.043+0000 7f6613e00640 1 -- 172.21.15.44:0/3999684126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f3b190 msgr2=0x5627d8f51eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.043+0000 7f6613e00640 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f3b190 0x5627d8f51eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.043+0000 7f6613e00640 1 -- 172.21.15.44:0/3999684126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 msgr2=0x5627d8f547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.043+0000 7f6613e00640 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 0x5627d8f547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.043+0000 7f6613e00640 1 -- 172.21.15.44:0/3999684126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627d8c6a7b0 con 0x5627d8f4dd50 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.044+0000 7f6613e00640 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 0x5627d8f4e880 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f660400f5d0 tx=0x7f6604004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a5b3db18efb62b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.044+0000 7f6600c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.044+0000 7f6600c00640 1 -- 172.21.15.44:0/3999684126 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660402e070 con 0x5627d8f4dd50 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.044+0000 7f661d96f740 1 -- 172.21.15.44:0/3999684126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6604025070 con 0x5627d8f4dd50 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.044+0000 7f6600c00640 1 -- 172.21.15.44:0/3999684126 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f6604033660 con 0x5627d8f4dd50 2024-03-30T13:14:06.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.044+0000 7f6600c00640 1 -- 172.21.15.44:0/3999684126 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f660401c040 con 0x5627d8f4dd50 2024-03-30T13:14:06.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.044+0000 7f661d96f740 10 client.5553 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:06.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.044+0000 7f661d96f740 1 -- 172.21.15.44:0/3999684126 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5627d8ccaf40 con 0x5627d8f4dd50 2024-03-30T13:14:06.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.044+0000 7f6600c00640 1 -- 172.21.15.44:0/3999684126 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6604025070 con 0x5627d8f4dd50 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.045+0000 7f6600c00640 1 -- 172.21.15.44:0/3999684126 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f660401f070 con 0x5627d8f4dd50 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.045+0000 7f661d96f740 10 client.5553 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.045+0000 7f661d96f740 10 client.5553 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.045+0000 7f661d96f740 20 client.5553 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.045+0000 7f661d96f740 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5627d8f486c0 0x5627d8f48b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.045+0000 7f661d96f740 4 client.5553 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.045+0000 7f661d96f740 1 -- 172.21.15.44:0/3999684126 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627d8e97890 con 0x5627d8f486c0 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.045+0000 7f660be00640 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5627d8f486c0 0x5627d8f48b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.046+0000 7f660be00640 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5627d8f486c0 0x5627d8f48b00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1451589f80048db server_cookie=d30db01603139156 in_seq=0 out_seq=0 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.046+0000 7f6600c00640 10 client.5553 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.046+0000 7f6600c00640 1 -- 172.21.15.44:0/3999684126 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5627d8e97890 con 0x5627d8f486c0 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.046+0000 7f6600c00640 10 client.5553 handle_command_reply: tid=0 2024-03-30T13:14:06.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f661d96f740 1 client.5553 shutdown 2024-03-30T13:14:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f661d96f740 1 -- 172.21.15.44:0/3999684126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 msgr2=0x5627d8f4e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f661d96f740 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 0x5627d8f4e880 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f660400f5d0 tx=0x7f6604004730 comp rx=0 tx=0).stop 2024-03-30T13:14:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f661d96f740 1 -- 172.21.15.44:0/3999684126 shutdown_connections 2024-03-30T13:14:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f661d96f740 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5627d8f486c0 0x5627d8f48b00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f661d96f740 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f3b190 0x5627d8f51eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f661d96f740 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 0x5627d8f547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f661d96f740 1 --2- 172.21.15.44:0/3999684126 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4dd50 0x5627d8f4e880 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f6600c00640 0 client.5553 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f661d96f740 1 -- 172.21.15.44:0/3999684126 >> 172.21.15.44:0/3999684126 conn(0x5627d8f21230 msgr2=0x5627d8f24cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f661d96f740 1 -- 172.21.15.44:0/3999684126 shutdown_connections 2024-03-30T13:14:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f661d96f740 1 -- 172.21.15.44:0/3999684126 wait complete. 2024-03-30T13:14:06.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.047+0000 7f661d96f740 20 client.5553 trim_cache size 0 max 16384 2024-03-30T13:14:06.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.088+0000 7f661d96f740 1 Processor -- start 2024-03-30T13:14:06.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.088+0000 7f661d96f740 1 -- start start 2024-03-30T13:14:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.089+0000 7f661d96f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f3b190 0x5627d8f496c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.089+0000 7f661d96f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f4dd50 0x5627d8f6eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.089+0000 7f661d96f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4e130 0x5627d8f6f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.089+0000 7f661d96f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6614201340 con 0x5627d8f4e130 2024-03-30T13:14:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.089+0000 7f661d96f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6614200320 con 0x5627d8f3b190 2024-03-30T13:14:06.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.089+0000 7f661d96f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6614152640 con 0x5627d8f4dd50 2024-03-30T13:14:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.090+0000 7f6618c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4e130 0x5627d8f6f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.090+0000 7f6618c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4e130 0x5627d8f6f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52036/0 (socket says 172.21.15.44:52036) 2024-03-30T13:14:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.090+0000 7f6618c00640 1 -- 172.21.15.44:0/3039446612 learned_addr learned my addr 172.21.15.44:0/3039446612 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.090+0000 7f6613e00640 1 --2- 172.21.15.44:0/3039446612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f3b190 0x5627d8f496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.090+0000 7f660be00640 1 --2- 172.21.15.44:0/3039446612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f4dd50 0x5627d8f6eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.090+0000 7f6618c00640 1 -- 172.21.15.44:0/3039446612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f4dd50 msgr2=0x5627d8f6eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.090+0000 7f6618c00640 1 --2- 172.21.15.44:0/3039446612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f4dd50 0x5627d8f6eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.090+0000 7f6618c00640 1 -- 172.21.15.44:0/3039446612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f3b190 msgr2=0x5627d8f496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.090+0000 7f6618c00640 1 --2- 172.21.15.44:0/3039446612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f3b190 0x5627d8f496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.090+0000 7f6618c00640 1 -- 172.21.15.44:0/3039446612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627d8b5e0a0 con 0x5627d8f4e130 2024-03-30T13:14:06.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.090+0000 7f6613e00640 1 --2- 172.21.15.44:0/3039446612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f3b190 0x5627d8f496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:06.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.091+0000 7f6618c00640 1 --2- 172.21.15.44:0/3039446612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4e130 0x5627d8f6f530 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f660c02c570 tx=0x7f660c009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9120c811bd948e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.091+0000 7f6603400640 1 -- 172.21.15.44:0/3039446612 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c07ff50 con 0x5627d8f4e130 2024-03-30T13:14:06.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.091+0000 7f6603400640 1 -- 172.21.15.44:0/3039446612 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660c084780 con 0x5627d8f4e130 2024-03-30T13:14:06.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.091+0000 7f6603400640 1 -- 172.21.15.44:0/3039446612 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c078210 con 0x5627d8f4e130 2024-03-30T13:14:06.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.092+0000 7f661d96f740 1 -- 172.21.15.44:0/3039446612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4e130 msgr2=0x5627d8f6f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.092+0000 7f661d96f740 1 --2- 172.21.15.44:0/3039446612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4e130 0x5627d8f6f530 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f660c02c570 tx=0x7f660c009af0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.092+0000 7f661d96f740 1 -- 172.21.15.44:0/3039446612 shutdown_connections 2024-03-30T13:14:06.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.092+0000 7f661d96f740 1 --2- 172.21.15.44:0/3039446612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f4e130 0x5627d8f6f530 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.092+0000 7f661d96f740 1 --2- 172.21.15.44:0/3039446612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f4dd50 0x5627d8f6eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.092+0000 7f661d96f740 1 --2- 172.21.15.44:0/3039446612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f3b190 0x5627d8f496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.092+0000 7f661d96f740 1 -- 172.21.15.44:0/3039446612 >> 172.21.15.44:0/3039446612 conn(0x5627d8f21230 msgr2=0x5627d8f3a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.092+0000 7f661d96f740 1 -- 172.21.15.44:0/3039446612 shutdown_connections 2024-03-30T13:14:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.092+0000 7f661d96f740 1 -- 172.21.15.44:0/3039446612 wait complete. 2024-03-30T13:14:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.093+0000 7f661d96f740 1 -- start start 2024-03-30T13:14:06.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.093+0000 7f661d96f740 1 Processor -- start 2024-03-30T13:14:06.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.095+0000 7f661d96f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f3b190 0x5627d8fe4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.095+0000 7f661d96f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f4dd50 0x5627d8f455c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.095+0000 7f661d96f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 0x5627d8f3a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.095+0000 7f661d96f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5627d8f274c0 con 0x5627d8f3b190 2024-03-30T13:14:06.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.095+0000 7f661d96f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f66141ffcc0 con 0x5627d8f4e130 2024-03-30T13:14:06.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.095+0000 7f661d96f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5627d8f4c250 con 0x5627d8f4dd50 2024-03-30T13:14:06.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.095+0000 7f661d96f740 10 client.0 _ll_register_callbacks cb 0x7f660400f960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:06.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.095+0000 7f6613e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f3b190 0x5627d8fe4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.095+0000 7f6613e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f3b190 0x5627d8fe4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52046/0 (socket says 172.21.15.44:52046) 2024-03-30T13:14:06.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.095+0000 7f6613e00640 1 -- 172.21.15.44:0/2717908766 learned_addr learned my addr 172.21.15.44:0/2717908766 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:06.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.096+0000 7f6613e00640 1 -- 172.21.15.44:0/2717908766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f4dd50 msgr2=0x5627d8f455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.096+0000 7f6613e00640 1 --2- 172.21.15.44:0/2717908766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f4dd50 0x5627d8f455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.096+0000 7f6613e00640 1 -- 172.21.15.44:0/2717908766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 msgr2=0x5627d8f3a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.096+0000 7f6613e00640 1 --2- 172.21.15.44:0/2717908766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 0x5627d8f3a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.096+0000 7f6613e00640 1 -- 172.21.15.44:0/2717908766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627d8f20fc0 con 0x5627d8f3b190 2024-03-30T13:14:06.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.096+0000 7f6613e00640 1 --2- 172.21.15.44:0/2717908766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f3b190 0x5627d8fe4330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6604018910 tx=0x7f660401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ba4e559df3d0ef server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.096+0000 7f6600c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.096+0000 7f6600c00640 1 -- 172.21.15.44:0/2717908766 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604044060 con 0x5627d8f3b190 2024-03-30T13:14:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.096+0000 7f6600c00640 1 -- 172.21.15.44:0/2717908766 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f6604020840 con 0x5627d8f3b190 2024-03-30T13:14:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.096+0000 7f661d96f740 1 -- 172.21.15.44:0/2717908766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f660c084780 con 0x5627d8f3b190 2024-03-30T13:14:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.097+0000 7f6600c00640 1 -- 172.21.15.44:0/2717908766 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f660402e040 con 0x5627d8f3b190 2024-03-30T13:14:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.097+0000 7f661d96f740 10 client.5559 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:06.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.097+0000 7f661d96f740 1 -- 172.21.15.44:0/2717908766 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5627d8fe6e60 con 0x5627d8f3b190 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.097+0000 7f6600c00640 1 -- 172.21.15.44:0/2717908766 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660c084780 con 0x5627d8f3b190 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.097+0000 7f6600c00640 1 -- 172.21.15.44:0/2717908766 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f660401f040 con 0x5627d8f3b190 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.097+0000 7f661d96f740 10 client.5559 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.097+0000 7f661d96f740 10 client.5559 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.097+0000 7f661d96f740 20 client.5559 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.097+0000 7f661d96f740 1 --2- 172.21.15.44:0/2717908766 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5627d8f3ab00 0x5627d8fea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.097+0000 7f661d96f740 4 client.5559 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.097+0000 7f661d96f740 1 -- 172.21.15.44:0/2717908766 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x5627d8e91be0 con 0x5627d8f3ab00 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.097+0000 7f660be00640 1 --2- 172.21.15.44:0/2717908766 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5627d8f3ab00 0x5627d8fea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.098+0000 7f660be00640 1 --2- 172.21.15.44:0/2717908766 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5627d8f3ab00 0x5627d8fea3f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d00c11a0d085e16f server_cookie=3bb289889dfd9d23 in_seq=0 out_seq=0 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.098+0000 7f6600c00640 10 client.5559 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.099+0000 7f6600c00640 1 -- 172.21.15.44:0/2717908766 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5627d8e91be0 con 0x5627d8f3ab00 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.099+0000 7f6600c00640 10 client.5559 handle_command_reply: tid=0 2024-03-30T13:14:06.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.099+0000 7f661d96f740 1 client.5559 shutdown 2024-03-30T13:14:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.100+0000 7f661d96f740 1 -- 172.21.15.44:0/2717908766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f3b190 msgr2=0x5627d8fe4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.100+0000 7f661d96f740 1 --2- 172.21.15.44:0/2717908766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f3b190 0x5627d8fe4330 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6604018910 tx=0x7f660401b000 comp rx=0 tx=0).stop 2024-03-30T13:14:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.100+0000 7f661d96f740 1 -- 172.21.15.44:0/2717908766 shutdown_connections 2024-03-30T13:14:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.100+0000 7f661d96f740 1 --2- 172.21.15.44:0/2717908766 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5627d8f3ab00 0x5627d8fea3f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.100+0000 7f661d96f740 1 --2- 172.21.15.44:0/2717908766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627d8f4e130 0x5627d8f3a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.100+0000 7f661d96f740 1 --2- 172.21.15.44:0/2717908766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5627d8f4dd50 0x5627d8f455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.100+0000 7f661d96f740 1 --2- 172.21.15.44:0/2717908766 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5627d8f3b190 0x5627d8fe4330 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.100+0000 7f661d96f740 1 -- 172.21.15.44:0/2717908766 >> 172.21.15.44:0/2717908766 conn(0x5627d8f21230 msgr2=0x5627d8f6f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.100+0000 7f6600c00640 0 client.5559 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.101+0000 7f661d96f740 1 -- 172.21.15.44:0/2717908766 shutdown_connections 2024-03-30T13:14:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.101+0000 7f661d96f740 1 -- 172.21.15.44:0/2717908766 wait complete. 2024-03-30T13:14:06.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.101+0000 7f661d96f740 20 client.5559 trim_cache size 0 max 16384 2024-03-30T13:14:06.107 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:06.107 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0, 2024-03-30T13:14:06.107 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_tag": "15729069-7252-4183-a34d-d65e02a27e24", 2024-03-30T13:14:06.107 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": "asynchronous" 2024-03-30T13:14:06.107 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:06.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.102+0000 7f661ac00640 1 -- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f65f006c560 msgr2=0x7f65f006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.102+0000 7f661ac00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f65f006c560 0x7f65f006ea20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6614160e50 tx=0x7f6604007e10 comp rx=0 tx=0).stop 2024-03-30T13:14:06.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.102+0000 7f661ac00640 1 -- 172.21.15.44:0/3211189316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6614158a70 msgr2=0x7f66140afb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.102+0000 7f661ac00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6614158a70 0x7f66140afb70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f660c009f70 tx=0x7f660c004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:06.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.103+0000 7f661ac00640 1 -- 172.21.15.44:0/3211189316 shutdown_connections 2024-03-30T13:14:06.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.103+0000 7f661ac00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6614158a70 0x7f66140afb70 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.103+0000 7f661ac00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66140d04d0 0x7f66141599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.103+0000 7f661ac00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f65f006c560 0x7f65f006ea20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.103+0000 7f661ac00640 1 --2- 172.21.15.44:0/3211189316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66140723b0 0x7f661414ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.103+0000 7f661ac00640 1 -- 172.21.15.44:0/3211189316 >> 172.21.15.44:0/3211189316 conn(0x7f661406f060 msgr2=0x7f661406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.103+0000 7f661ac00640 1 -- 172.21.15.44:0/3211189316 shutdown_connections 2024-03-30T13:14:06.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.103+0000 7f661ac00640 1 -- 172.21.15.44:0/3211189316 wait complete. 2024-03-30T13:14:06.131 DEBUG:tasks.cephfs.test_uninlining:scrub start response: {'return_code': 0, 'scrub_tag': '15729069-7252-4183-a34d-d65e02a27e24', 'mode': 'asynchronous'} 2024-03-30T13:14:06.131 DEBUG:tasks.cephfs.test_uninlining:waiting for scrub to complete 2024-03-30T13:14:06.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:06.131 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-30T13:14:06.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.388+0000 7f5201400640 1 Processor -- start 2024-03-30T13:14:06.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.388+0000 7f5201400640 1 -- start start 2024-03-30T13:14:06.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.389+0000 7f5201400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f51fc167120 0x7f51fc169510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.389+0000 7f5201400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51fc0d2ff0 con 0x7f51fc0ba090 2024-03-30T13:14:06.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.389+0000 7f5201400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51fc0d32d0 con 0x7f51fc0b5dc0 2024-03-30T13:14:06.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.389+0000 7f5201400640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f51fc0d2d90 con 0x7f51fc167120 2024-03-30T13:14:06.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.390+0000 7f51f9e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f51fc0ba090 0x7f51fc0d2680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:52888/0 (socket says 172.21.15.44:52888) 2024-03-30T13:14:06.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.390+0000 7f51f9e00640 1 -- 172.21.15.44:0/1986397652 learned_addr learned my addr 172.21.15.44:0/1986397652 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:06.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.390+0000 7f51fb200640 1 --2- 172.21.15.44:0/1986397652 >> v2:172.21.15.151:3300/0 conn(0x7f51fc167120 0x7f51fc169510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.390+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5093385 0 0) 0x7f51fc0d2ff0 con 0x7f51fc0ba090 2024-03-30T13:14:06.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.390+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e0003520 con 0x7f51fc0ba090 2024-03-30T13:14:06.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3778699591 0 0) 0x7f51e0003520 con 0x7f51fc0ba090 2024-03-30T13:14:06.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 >> v2:172.21.15.151:3300/0 conn(0x7f51fc167120 msgr2=0x7f51fc169510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 --2- 172.21.15.44:0/1986397652 >> v2:172.21.15.151:3300/0 conn(0x7f51fc167120 0x7f51fc169510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 >> v1:172.21.15.151:6789/0 conn(0x7f51fc0b5dc0 legacy=0x7f51fc0b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc0d35b0 con 0x7f51fc0ba090 2024-03-30T13:14:06.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f51e8001670 con 0x7f51fc0ba090 2024-03-30T13:14:06.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 >> v1:172.21.15.44:6789/0 conn(0x7f51fc0ba090 legacy=0x7f51fc0d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51e00039b0 0x7f51e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 0x7f51e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51e00051c0 0x7f51e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc0d2d90 con 0x7f51e0004800 2024-03-30T13:14:06.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51e000c060 con 0x7f51e00051c0 2024-03-30T13:14:06.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f51e000c260 con 0x7f51e00039b0 2024-03-30T13:14:06.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.391+0000 7f51f9e00640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 0x7f51e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.392+0000 7f51fa800640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51e00039b0 0x7f51e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.392+0000 7f51fb200640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51e00051c0 0x7f51e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.392+0000 7f51f9e00640 1 -- 172.21.15.44:0/1986397652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51e00039b0 msgr2=0x7f51e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.392+0000 7f51f9e00640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51e00039b0 0x7f51e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.392+0000 7f51f9e00640 1 -- 172.21.15.44:0/1986397652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51e00051c0 msgr2=0x7f51e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.392+0000 7f51f9e00640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51e00051c0 0x7f51e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.392+0000 7f51f9e00640 1 -- 172.21.15.44:0/1986397652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e0003520 con 0x7f51e0004800 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.392+0000 7f51fb200640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51e00051c0 0x7f51e000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.392+0000 7f51fb200640 1 -- 172.21.15.44:0/1986397652 reap_dead start 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.392+0000 7f51fa800640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51e00039b0 0x7f51e0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.393+0000 7f51f9e00640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 0x7f51e0004c80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c210 tx=0x7f51e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39447f8a9b4b2e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.393+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8007d10 con 0x7f51e0004800 2024-03-30T13:14:06.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.393+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e8030070 con 0x7f51e0004800 2024-03-30T13:14:06.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.393+0000 7f51f9400640 1 -- 172.21.15.44:0/1986397652 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8005d30 con 0x7f51e0004800 2024-03-30T13:14:06.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.394+0000 7f5201400640 1 -- 172.21.15.44:0/1986397652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 msgr2=0x7f51e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.394+0000 7f5201400640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 0x7f51e0004c80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c210 tx=0x7f51e0005830 comp rx=0 tx=0).stop 2024-03-30T13:14:06.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.394+0000 7f5201400640 1 -- 172.21.15.44:0/1986397652 shutdown_connections 2024-03-30T13:14:06.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.394+0000 7f5201400640 1 --2- 172.21.15.44:0/1986397652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 0x7f51e0004c80 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.394+0000 7f5201400640 1 -- 172.21.15.44:0/1986397652 >> 172.21.15.44:0/1986397652 conn(0x7f51fc0678f0 msgr2=0x7f51fc0d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.394+0000 7f5201400640 1 -- 172.21.15.44:0/1986397652 shutdown_connections 2024-03-30T13:14:06.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.394+0000 7f5201400640 1 -- 172.21.15.44:0/1986397652 wait complete. 2024-03-30T13:14:06.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.396+0000 7f5201400640 1 Processor -- start 2024-03-30T13:14:06.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.397+0000 7f5201400640 1 -- start start 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.398+0000 7f5201400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 0x7f51fc0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.398+0000 7f5201400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0cd300 0x7f51fc160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.398+0000 7f5201400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51fc0cd780 0x7f51fc161430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.398+0000 7f5201400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc0d4090 con 0x7f51e0004800 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.398+0000 7f5201400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc0d3b70 con 0x7f51fc0cd780 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.398+0000 7f5201400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc15e880 con 0x7f51fc0cd300 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.398+0000 7f51fa800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 0x7f51fc0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.398+0000 7f51fa800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 0x7f51fc0c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52068/0 (socket says 172.21.15.44:52068) 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.398+0000 7f51fa800640 1 -- 172.21.15.44:0/1439255556 learned_addr learned my addr 172.21.15.44:0/1439255556 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.399+0000 7f51fb200640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51fc0cd780 0x7f51fc161430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.399+0000 7f51fa800640 1 -- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0cd300 msgr2=0x7f51fc160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.399+0000 7f51fa800640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0cd300 0x7f51fc160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.399+0000 7f51fa800640 1 -- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51fc0cd780 msgr2=0x7f51fc161430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.399+0000 7f51fa800640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51fc0cd780 0x7f51fc161430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.399+0000 7f51fa800640 1 -- 172.21.15.44:0/1439255556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51fc0cc260 con 0x7f51e0004800 2024-03-30T13:14:06.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.399+0000 7f51fb200640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51fc0cd780 0x7f51fc161430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:06.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.399+0000 7f51fa800640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 0x7f51fc0c9ed0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00d4a0 tx=0x7f51ec00d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.399+0000 7f51f2a00640 1 -- 172.21.15.44:0/1439255556 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec019070 con 0x7f51e0004800 2024-03-30T13:14:06.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.400+0000 7f51f2a00640 1 -- 172.21.15.44:0/1439255556 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51ec005480 con 0x7f51e0004800 2024-03-30T13:14:06.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.400+0000 7f5201400640 1 -- 172.21.15.44:0/1439255556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51fc0cc540 con 0x7f51e0004800 2024-03-30T13:14:06.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.400+0000 7f51f2a00640 1 -- 172.21.15.44:0/1439255556 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec007230 con 0x7f51e0004800 2024-03-30T13:14:06.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.400+0000 7f5201400640 1 -- 172.21.15.44:0/1439255556 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51fc0ccb00 con 0x7f51e0004800 2024-03-30T13:14:06.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.402+0000 7f51f2a00640 1 -- 172.21.15.44:0/1439255556 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f51ec01c070 con 0x7f51e0004800 2024-03-30T13:14:06.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.403+0000 7f51f2a00640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f51dc06c530 0x7f51dc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.403+0000 7f51f2a00640 1 -- 172.21.15.44:0/1439255556 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f51ec08b040 con 0x7f51e0004800 2024-03-30T13:14:06.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.404+0000 7f5203ff5740 1 Processor -- start 2024-03-30T13:14:06.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.404+0000 7f51f9e00640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f51dc06c530 0x7f51dc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.404+0000 7f5203ff5740 1 -- start start 2024-03-30T13:14:06.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.405+0000 7f5203ff5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b2b5c0 0x558630afe560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.405+0000 7f5203ff5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b2e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.405+0000 7f5203ff5740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630afeaa0 0x558630b2e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.405+0000 7f5203ff5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558630a696d0 con 0x558630b2b9a0 2024-03-30T13:14:06.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.405+0000 7f5203ff5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558630a11770 con 0x558630b2b5c0 2024-03-30T13:14:06.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.405+0000 7f5203ff5740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x558630a65680 con 0x558630afeaa0 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.405+0000 7f51f9e00640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f51dc06c530 0x7f51dc06e9f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f51e8034000 tx=0x7f51e802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.405+0000 7f51f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b2e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.405+0000 7f51f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b2e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52072/0 (socket says 172.21.15.44:52072) 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.405+0000 7f51f9e00640 1 -- 172.21.15.44:0/1580989300 learned_addr learned my addr 172.21.15.44:0/1580989300 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.406+0000 7f51fa800640 1 --2- 172.21.15.44:0/1580989300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b2b5c0 0x558630afe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.406+0000 7f51fb200640 1 --2- 172.21.15.44:0/1580989300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630afeaa0 0x558630b2e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.406+0000 7f51f9e00640 1 -- 172.21.15.44:0/1580989300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630afeaa0 msgr2=0x558630b2e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.406+0000 7f51f9e00640 1 --2- 172.21.15.44:0/1580989300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630afeaa0 0x558630b2e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.406+0000 7f51f9e00640 1 -- 172.21.15.44:0/1580989300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b2b5c0 msgr2=0x558630afe560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.406+0000 7f51f9e00640 1 --2- 172.21.15.44:0/1580989300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b2b5c0 0x558630afe560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.406+0000 7f51f9e00640 1 -- 172.21.15.44:0/1580989300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586308477d0 con 0x558630b2b9a0 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.406+0000 7f51f9e00640 1 --2- 172.21.15.44:0/1580989300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b2e350 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c300 tx=0x7f51e8009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aef2a1debb0466c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.406+0000 7f51e7000640 1 -- 172.21.15.44:0/1580989300 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8004be0 con 0x558630b2b9a0 2024-03-30T13:14:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.406+0000 7f51e7000640 1 -- 172.21.15.44:0/1580989300 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e8004d80 con 0x558630b2b9a0 2024-03-30T13:14:06.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.406+0000 7f51e7000640 1 -- 172.21.15.44:0/1580989300 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e80072b0 con 0x558630b2b9a0 2024-03-30T13:14:06.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.407+0000 7f5203ff5740 1 -- 172.21.15.44:0/1580989300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 msgr2=0x558630b2e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.407+0000 7f5203ff5740 1 --2- 172.21.15.44:0/1580989300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b2e350 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c300 tx=0x7f51e8009030 comp rx=0 tx=0).stop 2024-03-30T13:14:06.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.407+0000 7f5203ff5740 1 -- 172.21.15.44:0/1580989300 shutdown_connections 2024-03-30T13:14:06.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.407+0000 7f5203ff5740 1 --2- 172.21.15.44:0/1580989300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630afeaa0 0x558630b2e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.407+0000 7f5203ff5740 1 --2- 172.21.15.44:0/1580989300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b2e350 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.407+0000 7f5203ff5740 1 --2- 172.21.15.44:0/1580989300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b2b5c0 0x558630afe560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.407+0000 7f5203ff5740 1 -- 172.21.15.44:0/1580989300 >> 172.21.15.44:0/1580989300 conn(0x558630b007d0 msgr2=0x558630b49350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.407+0000 7f5203ff5740 1 -- 172.21.15.44:0/1580989300 shutdown_connections 2024-03-30T13:14:06.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.407+0000 7f5203ff5740 1 -- 172.21.15.44:0/1580989300 wait complete. 2024-03-30T13:14:06.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.408+0000 7f5203ff5740 1 -- start start 2024-03-30T13:14:06.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.408+0000 7f5203ff5740 1 Processor -- start 2024-03-30T13:14:06.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.409+0000 7f5203ff5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b2b5c0 0x558630b2ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.409+0000 7f5203ff5740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b9a0 0x558630b31d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.409+0000 7f5203ff5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b322c0 0x558630b5aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.409+0000 7f5203ff5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558630b02e70 con 0x558630b322c0 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.409+0000 7f5203ff5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558630a24aa0 con 0x558630b2b5c0 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.409+0000 7f5203ff5740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x558630b056b0 con 0x558630b2b9a0 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.409+0000 7f5203ff5740 10 client.0 _ll_register_callbacks cb 0x558630a24490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.409+0000 7f51fb200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b322c0 0x558630b5aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51fb200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b322c0 0x558630b5aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52074/0 (socket says 172.21.15.44:52074) 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51fb200640 1 -- 172.21.15.44:0/218488221 learned_addr learned my addr 172.21.15.44:0/218488221 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51fa800640 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b2b5c0 0x558630b2ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51f9e00640 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b9a0 0x558630b31d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51fb200640 1 -- 172.21.15.44:0/218488221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b9a0 msgr2=0x558630b31d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51fb200640 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b9a0 0x558630b31d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51fb200640 1 -- 172.21.15.44:0/218488221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b2b5c0 msgr2=0x558630b2ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51fb200640 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b2b5c0 0x558630b2ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51fb200640 1 -- 172.21.15.44:0/218488221 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55863077d3f0 con 0x558630b322c0 2024-03-30T13:14:06.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51fa800640 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b2b5c0 0x558630b2ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:06.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51f9e00640 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b9a0 0x558630b31d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:06.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51fb200640 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b322c0 0x558630b5aa80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0ceb90 tx=0x7f51f40044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d0fe64cc98a52e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.410+0000 7f51db400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:06.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.411+0000 7f51db400640 1 -- 172.21.15.44:0/218488221 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f401a020 con 0x558630b322c0 2024-03-30T13:14:06.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.411+0000 7f51db400640 1 -- 172.21.15.44:0/218488221 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f51f40076e0 con 0x558630b322c0 2024-03-30T13:14:06.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.411+0000 7f5203ff5740 1 -- 172.21.15.44:0/218488221 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e8004d80 con 0x558630b322c0 2024-03-30T13:14:06.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.411+0000 7f51db400640 1 -- 172.21.15.44:0/218488221 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f51f4024050 con 0x558630b322c0 2024-03-30T13:14:06.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.411+0000 7f5203ff5740 10 client.5571 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:06.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.411+0000 7f5203ff5740 1 -- 172.21.15.44:0/218488221 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55863073d0f0 con 0x558630b322c0 2024-03-30T13:14:06.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.411+0000 7f51db400640 1 -- 172.21.15.44:0/218488221 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e8004d80 con 0x558630b322c0 2024-03-30T13:14:06.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.412+0000 7f51db400640 1 -- 172.21.15.44:0/218488221 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f51f4027020 con 0x558630b322c0 2024-03-30T13:14:06.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.412+0000 7f5203ff5740 10 client.5571 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:06.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.412+0000 7f5203ff5740 10 client.5571 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:06.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.412+0000 7f5203ff5740 20 client.5571 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:06.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.412+0000 7f5203ff5740 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558630b59d90 0x558630b5a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.412+0000 7f5203ff5740 4 client.5571 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:06.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.412+0000 7f5203ff5740 1 -- 172.21.15.44:0/218488221 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558630a76c10 con 0x558630b59d90 2024-03-30T13:14:06.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.412+0000 7f51fa800640 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558630b59d90 0x558630b5a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.413+0000 7f51fa800640 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558630b59d90 0x558630b5a210 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ceadb1b0a038cb6 server_cookie=d80defed95d4237 in_seq=0 out_seq=0 2024-03-30T13:14:06.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.413+0000 7f51db400640 10 client.5571 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:06.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f51db400640 1 -- 172.21.15.44:0/218488221 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x558630a76c10 con 0x558630b59d90 2024-03-30T13:14:06.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f51db400640 10 client.5571 handle_command_reply: tid=0 2024-03-30T13:14:06.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f5203ff5740 1 client.5571 shutdown 2024-03-30T13:14:06.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f5203ff5740 1 -- 172.21.15.44:0/218488221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b322c0 msgr2=0x558630b5aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f5203ff5740 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b322c0 0x558630b5aa80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0ceb90 tx=0x7f51f40044d0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f5203ff5740 1 -- 172.21.15.44:0/218488221 shutdown_connections 2024-03-30T13:14:06.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f5203ff5740 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558630b59d90 0x558630b5a210 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f5203ff5740 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b322c0 0x558630b5aa80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f5203ff5740 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b9a0 0x558630b31d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f5203ff5740 1 --2- 172.21.15.44:0/218488221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b2b5c0 0x558630b2ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f5203ff5740 1 -- 172.21.15.44:0/218488221 >> 172.21.15.44:0/218488221 conn(0x558630afeaa0 msgr2=0x558630b02470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f51db400640 0 client.5571 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:06.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f5203ff5740 1 -- 172.21.15.44:0/218488221 shutdown_connections 2024-03-30T13:14:06.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.414+0000 7f5203ff5740 1 -- 172.21.15.44:0/218488221 wait complete. 2024-03-30T13:14:06.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.415+0000 7f5203ff5740 20 client.5571 trim_cache size 0 max 16384 2024-03-30T13:14:06.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.434+0000 7f5203ff5740 1 Processor -- start 2024-03-30T13:14:06.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.434+0000 7f5203ff5740 1 -- start start 2024-03-30T13:14:06.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.435+0000 7f5203ff5740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b5c0 0x558630afda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.435+0000 7f5203ff5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b2bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.435+0000 7f5203ff5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b322c0 0x558630b2c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.435+0000 7f5203ff5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc201920 con 0x558630b2b9a0 2024-03-30T13:14:06.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.435+0000 7f5203ff5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc200920 con 0x558630b322c0 2024-03-30T13:14:06.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.435+0000 7f5203ff5740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f51fc15f8f0 con 0x558630b2b5c0 2024-03-30T13:14:06.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.435+0000 7f51f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b2bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.435+0000 7f51f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b2bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52080/0 (socket says 172.21.15.44:52080) 2024-03-30T13:14:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.435+0000 7f51f9e00640 1 -- 172.21.15.44:0/2819358441 learned_addr learned my addr 172.21.15.44:0/2819358441 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.436+0000 7f51fb200640 1 --2- 172.21.15.44:0/2819358441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b322c0 0x558630b2c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.436+0000 7f51f9e00640 1 -- 172.21.15.44:0/2819358441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b5c0 msgr2=0x558630afda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.436+0000 7f51f9e00640 1 --2- 172.21.15.44:0/2819358441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b5c0 0x558630afda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.436+0000 7f51f9e00640 1 -- 172.21.15.44:0/2819358441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b322c0 msgr2=0x558630b2c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.436+0000 7f51f9e00640 1 --2- 172.21.15.44:0/2819358441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b322c0 0x558630b2c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.436+0000 7f51f9e00640 1 -- 172.21.15.44:0/2819358441 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558630b004b0 con 0x558630b2b9a0 2024-03-30T13:14:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.436+0000 7f51fb200640 1 --2- 172.21.15.44:0/2819358441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b322c0 0x558630b2c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.436+0000 7f51f9e00640 1 --2- 172.21.15.44:0/2819358441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b2bde0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f51e8001050 tx=0x7f51e803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6258c75d5bafe501 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.437+0000 7f51e6600640 1 -- 172.21.15.44:0/2819358441 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8007070 con 0x558630b2b9a0 2024-03-30T13:14:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.437+0000 7f51e6600640 1 -- 172.21.15.44:0/2819358441 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e8050070 con 0x558630b2b9a0 2024-03-30T13:14:06.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.437+0000 7f51e6600640 1 -- 172.21.15.44:0/2819358441 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8007410 con 0x558630b2b9a0 2024-03-30T13:14:06.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.437+0000 7f5203ff5740 1 -- 172.21.15.44:0/2819358441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 msgr2=0x558630b2bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.437+0000 7f5203ff5740 1 --2- 172.21.15.44:0/2819358441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b2bde0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f51e8001050 tx=0x7f51e803d000 comp rx=0 tx=0).stop 2024-03-30T13:14:06.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.437+0000 7f5203ff5740 1 -- 172.21.15.44:0/2819358441 shutdown_connections 2024-03-30T13:14:06.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.437+0000 7f5203ff5740 1 --2- 172.21.15.44:0/2819358441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b322c0 0x558630b2c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.437+0000 7f5203ff5740 1 --2- 172.21.15.44:0/2819358441 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b2bde0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.437+0000 7f5203ff5740 1 --2- 172.21.15.44:0/2819358441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b5c0 0x558630afda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.437+0000 7f5203ff5740 1 -- 172.21.15.44:0/2819358441 >> 172.21.15.44:0/2819358441 conn(0x558630afeaa0 msgr2=0x558630b31b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.437+0000 7f5203ff5740 1 -- 172.21.15.44:0/2819358441 shutdown_connections 2024-03-30T13:14:06.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.437+0000 7f5203ff5740 1 -- 172.21.15.44:0/2819358441 wait complete. 2024-03-30T13:14:06.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.438+0000 7f5203ff5740 1 -- start start 2024-03-30T13:14:06.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.438+0000 7f5203ff5740 1 Processor -- start 2024-03-30T13:14:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.439+0000 7f5203ff5740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b5c0 0x558630bc5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.439+0000 7f5203ff5740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b5d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.439+0000 7f5203ff5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b322c0 0x558630b29be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.439+0000 7f5203ff5740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f51fc2002d0 con 0x558630b2b9a0 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.439+0000 7f5203ff5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558630b4ba40 con 0x558630b322c0 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.439+0000 7f5203ff5740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x558630bc66d0 con 0x558630b2b5c0 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.439+0000 7f5203ff5740 10 client.0 _ll_register_callbacks cb 0x7f51f4003e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.439+0000 7f51f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b5d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.439+0000 7f51f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b5d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52082/0 (socket says 172.21.15.44:52082) 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.439+0000 7f51f9e00640 1 -- 172.21.15.44:0/3616106769 learned_addr learned my addr 172.21.15.44:0/3616106769 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.440+0000 7f51fa800640 1 --2- 172.21.15.44:0/3616106769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b5c0 0x558630bc5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.440+0000 7f51f9e00640 1 -- 172.21.15.44:0/3616106769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b5c0 msgr2=0x558630bc5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.440+0000 7f51f9e00640 1 --2- 172.21.15.44:0/3616106769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b5c0 0x558630bc5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.440+0000 7f51f9e00640 1 -- 172.21.15.44:0/3616106769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b322c0 msgr2=0x558630b29be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.440+0000 7f51f9e00640 1 --2- 172.21.15.44:0/3616106769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b322c0 0x558630b29be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.440+0000 7f51f9e00640 1 -- 172.21.15.44:0/3616106769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558630b26580 con 0x558630b2b9a0 2024-03-30T13:14:06.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.440+0000 7f51f9e00640 1 --2- 172.21.15.44:0/3616106769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b5d590 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f51e8001050 tx=0x7f51e8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e8c57634572a67 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.440+0000 7f51db400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.440+0000 7f51db400640 1 -- 172.21.15.44:0/3616106769 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8035670 con 0x558630b2b9a0 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f51db400640 1 -- 172.21.15.44:0/3616106769 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(41..41 src has 1..41) ==== 6101+0+0 (secure 0 0 0) 0x7f51e8035810 con 0x558630b2b9a0 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f5203ff5740 1 -- 172.21.15.44:0/3616106769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e8050070 con 0x558630b2b9a0 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f51db400640 1 -- 172.21.15.44:0/3616106769 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f51e8066050 con 0x558630b2b9a0 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f5203ff5740 10 client.5577 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f5203ff5740 1 -- 172.21.15.44:0/3616106769 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x558630b5ac50 con 0x558630b2b9a0 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f51db400640 1 -- 172.21.15.44:0/3616106769 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51e8050070 con 0x558630b2b9a0 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f51db400640 1 -- 172.21.15.44:0/3616106769 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f51e8069020 con 0x558630b2b9a0 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f5203ff5740 10 client.5577 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f5203ff5740 10 client.5577 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f5203ff5740 20 client.5577 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f5203ff5740 1 --2- 172.21.15.44:0/3616106769 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558630b2a120 0x558630b4c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f5203ff5740 4 client.5577 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-30T13:14:06.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.441+0000 7f5203ff5740 1 -- 172.21.15.44:0/3616106769 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558630b31810 con 0x558630b2a120 2024-03-30T13:14:06.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.442+0000 7f51fa800640 1 --2- 172.21.15.44:0/3616106769 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558630b2a120 0x558630b4c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.442+0000 7f51fa800640 1 --2- 172.21.15.44:0/3616106769 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558630b2a120 0x558630b4c0c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f2db38d26507e3 server_cookie=ae9384d7f3a3bbf in_seq=0 out_seq=0 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.442+0000 7f51db400640 10 client.5577 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.442+0000 7f51db400640 1 -- 172.21.15.44:0/3616106769 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+564 (crc 0 0 0) 0x558630b31810 con 0x558630b2a120 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.442+0000 7f51db400640 10 client.5577 handle_command_reply: tid=0 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.442+0000 7f5203ff5740 1 client.5577 shutdown 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.443+0000 7f5203ff5740 1 -- 172.21.15.44:0/3616106769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 msgr2=0x558630b5d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.443+0000 7f5203ff5740 1 --2- 172.21.15.44:0/3616106769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b5d590 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f51e8001050 tx=0x7f51e8000fe0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.443+0000 7f5203ff5740 1 -- 172.21.15.44:0/3616106769 shutdown_connections 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.443+0000 7f5203ff5740 1 --2- 172.21.15.44:0/3616106769 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558630b2a120 0x558630b4c0c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.443+0000 7f5203ff5740 1 --2- 172.21.15.44:0/3616106769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558630b322c0 0x558630b29be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.443+0000 7f5203ff5740 1 --2- 172.21.15.44:0/3616106769 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558630b2b9a0 0x558630b5d590 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.443+0000 7f5203ff5740 1 --2- 172.21.15.44:0/3616106769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558630b2b5c0 0x558630bc5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.443+0000 7f51db400640 0 client.5577 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:06.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.443+0000 7f5203ff5740 1 -- 172.21.15.44:0/3616106769 >> 172.21.15.44:0/3616106769 conn(0x558630afeaa0 msgr2=0x558630afda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.443+0000 7f5203ff5740 1 -- 172.21.15.44:0/3616106769 shutdown_connections 2024-03-30T13:14:06.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.443+0000 7f5203ff5740 1 -- 172.21.15.44:0/3616106769 wait complete. 2024-03-30T13:14:06.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.443+0000 7f5203ff5740 20 client.5577 trim_cache size 0 max 16384 2024-03-30T13:14:06.450 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-30T13:14:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": { 2024-03-30T13:14:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: "15729069-7252-4183-a34d-d65e02a27e24": { 2024-03-30T13:14:06.450 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "tag": "15729069-7252-4183-a34d-d65e02a27e24", 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "options": "recursive" 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "15729069-7252-4183-a34d-d65e02a27e24": { 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-03-30T13:14:06.098229+0000", 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:06.451 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.444+0000 7f5201400640 1 -- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f51dc06c530 msgr2=0x7f51dc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.444+0000 7f5201400640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f51dc06c530 0x7f51dc06e9f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f51e8034000 tx=0x7f51e802e000 comp rx=0 tx=0).stop 2024-03-30T13:14:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.444+0000 7f5201400640 1 -- 172.21.15.44:0/1439255556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 msgr2=0x7f51fc0c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.444+0000 7f5201400640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 0x7f51fc0c9ed0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00d4a0 tx=0x7f51ec00d960 comp rx=0 tx=0).stop 2024-03-30T13:14:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.444+0000 7f5201400640 1 -- 172.21.15.44:0/1439255556 shutdown_connections 2024-03-30T13:14:06.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.444+0000 7f5201400640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f51dc06c530 0x7f51dc06e9f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.444+0000 7f5201400640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51fc0cd780 0x7f51fc161430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.444+0000 7f5201400640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51fc0cd300 0x7f51fc160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.444+0000 7f5201400640 1 --2- 172.21.15.44:0/1439255556 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f51e0004800 0x7f51fc0c9ed0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:06.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.444+0000 7f5201400640 1 -- 172.21.15.44:0/1439255556 >> 172.21.15.44:0/1439255556 conn(0x7f51fc0678f0 msgr2=0x7f51fc0ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:06.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.444+0000 7f5201400640 1 -- 172.21.15.44:0/1439255556 shutdown_connections 2024-03-30T13:14:06.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:06.444+0000 7f5201400640 1 -- 172.21.15.44:0/1439255556 wait complete. 2024-03-30T13:14:06.465 INFO:tasks.cephfs.filesystem:scrub status for tag:15729069-7252-4183-a34d-d65e02a27e24 - {'path': '/', 'tag': '15729069-7252-4183-a34d-d65e02a27e24', 'options': 'recursive'} 2024-03-30T13:14:30.434 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:14:30.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:14:36.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:36.466 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-30T13:14:36.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.694+0000 7f1bbb000640 1 Processor -- start 2024-03-30T13:14:36.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.694+0000 7f1bbb000640 1 -- start start 2024-03-30T13:14:36.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.696+0000 7f1bbb000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb40d18f0 0x7f1bb40d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.696+0000 7f1bbb000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1bb40d46b0 0x7f1bb40b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.696+0000 7f1bbb000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb40d32b0 con 0x7f1bb415c040 2024-03-30T13:14:36.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.696+0000 7f1bbb000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb415fa70 con 0x7f1bb40d46b0 2024-03-30T13:14:36.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.696+0000 7f1bbb000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb40d2210 con 0x7f1bb40d18f0 2024-03-30T13:14:36.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.696+0000 7f1bb9c00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1bb415c040 0x7f1bb415f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:35204/0 (socket says 172.21.15.44:35204) 2024-03-30T13:14:36.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.696+0000 7f1bb9c00640 1 -- 172.21.15.44:0/1101373986 learned_addr learned my addr 172.21.15.44:0/1101373986 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:36.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.697+0000 7f1bba600640 1 --2- 172.21.15.44:0/1101373986 >> v2:172.21.15.44:3300/0 conn(0x7f1bb40d46b0 0x7f1bb40b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.697+0000 7f1bb9200640 1 --2- 172.21.15.44:0/1101373986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb40d18f0 0x7f1bb40d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.697+0000 7f1bb3e00640 1 -- 172.21.15.44:0/1101373986 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475652085 0 0) 0x7f1bb40d32b0 con 0x7f1bb415c040 2024-03-30T13:14:36.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.697+0000 7f1bb3e00640 1 -- 172.21.15.44:0/1101373986 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b9c003520 con 0x7f1bb415c040 2024-03-30T13:14:36.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.697+0000 7f1bba600640 1 -- 172.21.15.44:0/1101373986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb40d18f0 msgr2=0x7f1bb40d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:36.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.697+0000 7f1bba600640 1 --2- 172.21.15.44:0/1101373986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb40d18f0 0x7f1bb40d4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.697+0000 7f1bba600640 1 -- 172.21.15.44:0/1101373986 >> v1:172.21.15.44:6789/0 conn(0x7f1bb415c040 legacy=0x7f1bb415f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.697+0000 7f1bba600640 1 -- 172.21.15.44:0/1101373986 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb40d24f0 con 0x7f1bb40d46b0 2024-03-30T13:14:36.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.699+0000 7f1bba600640 1 --2- 172.21.15.44:0/1101373986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb40d46b0 0x7f1bb40b4f10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009d90 tx=0x7f1bac02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844eed5aa2483eeb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.699+0000 7f1bb3e00640 1 -- 172.21.15.44:0/1101373986 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac039070 con 0x7f1bb40d46b0 2024-03-30T13:14:36.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.699+0000 7f1bb3e00640 1 -- 172.21.15.44:0/1101373986 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac02cbc0 con 0x7f1bb40d46b0 2024-03-30T13:14:36.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.699+0000 7f1bb3e00640 1 -- 172.21.15.44:0/1101373986 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac034440 con 0x7f1bb40d46b0 2024-03-30T13:14:36.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.699+0000 7f1bbb000640 1 -- 172.21.15.44:0/1101373986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb40d46b0 msgr2=0x7f1bb40b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.699+0000 7f1bbb000640 1 --2- 172.21.15.44:0/1101373986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb40d46b0 0x7f1bb40b4f10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009d90 tx=0x7f1bac02be10 comp rx=0 tx=0).stop 2024-03-30T13:14:36.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.700+0000 7f1bbb000640 1 -- 172.21.15.44:0/1101373986 shutdown_connections 2024-03-30T13:14:36.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.700+0000 7f1bbb000640 1 --2- 172.21.15.44:0/1101373986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb40d46b0 0x7f1bb40b4f10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.700+0000 7f1bbb000640 1 --2- 172.21.15.44:0/1101373986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb40d18f0 0x7f1bb40d4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.700+0000 7f1bbb000640 1 -- 172.21.15.44:0/1101373986 >> 172.21.15.44:0/1101373986 conn(0x7f1bb408dbf0 msgr2=0x7f1bb409d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:36.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.700+0000 7f1bbb000640 1 -- 172.21.15.44:0/1101373986 shutdown_connections 2024-03-30T13:14:36.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.700+0000 7f1bbb000640 1 -- 172.21.15.44:0/1101373986 wait complete. 2024-03-30T13:14:36.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.701+0000 7f1bbb000640 1 Processor -- start 2024-03-30T13:14:36.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.702+0000 7f1bbb000640 1 -- start start 2024-03-30T13:14:36.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bbb000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb40d18f0 0x7f1bb41523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bbb000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb40d46b0 0x7f1bb406d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bbb000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb415c040 0x7f1bb40b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bbb000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb40d2d90 con 0x7f1bb40d46b0 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bbb000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb40d2ab0 con 0x7f1bb40d18f0 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bbb000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb415c420 con 0x7f1bb415c040 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bb9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb40d46b0 0x7f1bb406d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bb9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb40d46b0 0x7f1bb406d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48978/0 (socket says 172.21.15.44:48978) 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bb9200640 1 -- 172.21.15.44:0/80632377 learned_addr learned my addr 172.21.15.44:0/80632377 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bb9c00640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb40d18f0 0x7f1bb41523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bb9200640 1 -- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb415c040 msgr2=0x7f1bb40b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bb9200640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb415c040 0x7f1bb40b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bb9200640 1 -- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb40d18f0 msgr2=0x7f1bb41523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bb9200640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb40d18f0 0x7f1bb41523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bb9200640 1 -- 172.21.15.44:0/80632377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb40cb450 con 0x7f1bb40d46b0 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.703+0000 7f1bb9c00640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb40d18f0 0x7f1bb41523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:36.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.704+0000 7f1bb9200640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb40d46b0 0x7f1bb406d850 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000e840 tx=0x7f1ba000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.704+0000 7f1bb1600640 1 -- 172.21.15.44:0/80632377 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0017070 con 0x7f1bb40d46b0 2024-03-30T13:14:36.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.704+0000 7f1bb1600640 1 -- 172.21.15.44:0/80632377 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba000c940 con 0x7f1bb40d46b0 2024-03-30T13:14:36.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.704+0000 7f1bb1600640 1 -- 172.21.15.44:0/80632377 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba000cd10 con 0x7f1bb40d46b0 2024-03-30T13:14:36.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.704+0000 7f1bbb000640 1 -- 172.21.15.44:0/80632377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb40cb730 con 0x7f1bb40d46b0 2024-03-30T13:14:36.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.704+0000 7f1bbb000640 1 -- 172.21.15.44:0/80632377 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb40cbcf0 con 0x7f1bb40d46b0 2024-03-30T13:14:36.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.707+0000 7f1bb1600640 1 -- 172.21.15.44:0/80632377 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1ba001a070 con 0x7f1bb40d46b0 2024-03-30T13:14:36.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.707+0000 7f1bb1600640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b9406c560 0x7f1b9406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.708+0000 7f1bb1600640 1 -- 172.21.15.44:0/80632377 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f1ba008ba80 con 0x7f1bb40d46b0 2024-03-30T13:14:36.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.708+0000 7f1bb9c00640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b9406c560 0x7f1b9406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.709+0000 7f1bb9c00640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b9406c560 0x7f1b9406ea20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8005880 tx=0x7f1ba8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.710+0000 7f1bbf396740 1 Processor -- start 2024-03-30T13:14:36.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.710+0000 7f1bbf396740 1 -- start start 2024-03-30T13:14:36.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.712+0000 7f1bbf396740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cb780 0x55959e09e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.712+0000 7f1bbf396740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cbb60 0x55959e0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.712+0000 7f1bbf396740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e09ec60 0x55959e0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.712+0000 7f1bbf396740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55959e0096d0 con 0x55959e09ec60 2024-03-30T13:14:36.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.712+0000 7f1bbf396740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55959dfb1770 con 0x55959e0cb780 2024-03-30T13:14:36.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.712+0000 7f1bbf396740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55959e005680 con 0x55959e0cbb60 2024-03-30T13:14:36.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.712+0000 7f1bba600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e09ec60 0x55959e0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.712+0000 7f1bba600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e09ec60 0x55959e0cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48982/0 (socket says 172.21.15.44:48982) 2024-03-30T13:14:36.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.712+0000 7f1bba600640 1 -- 172.21.15.44:0/1226588995 learned_addr learned my addr 172.21.15.44:0/1226588995 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:36.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.713+0000 7f1bba600640 1 -- 172.21.15.44:0/1226588995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cbb60 msgr2=0x55959e0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:36.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.713+0000 7f1bba600640 1 --2- 172.21.15.44:0/1226588995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cbb60 0x55959e0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.713+0000 7f1bba600640 1 -- 172.21.15.44:0/1226588995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cb780 msgr2=0x55959e09e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:36.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.713+0000 7f1bba600640 1 --2- 172.21.15.44:0/1226588995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cb780 0x55959e09e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.713+0000 7f1bba600640 1 -- 172.21.15.44:0/1226588995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55959dde77d0 con 0x55959e09ec60 2024-03-30T13:14:36.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.713+0000 7f1bba600640 1 --2- 172.21.15.44:0/1226588995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e09ec60 0x55959e0cea50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009eb0 tx=0x7f1bac02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7d7346ac45d87 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.713+0000 7f1ba6000640 1 -- 172.21.15.44:0/1226588995 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac039050 con 0x55959e09ec60 2024-03-30T13:14:36.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.713+0000 7f1ba6000640 1 -- 172.21.15.44:0/1226588995 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac045070 con 0x55959e09ec60 2024-03-30T13:14:36.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.713+0000 7f1ba6000640 1 -- 172.21.15.44:0/1226588995 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac02ce20 con 0x55959e09ec60 2024-03-30T13:14:36.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.714+0000 7f1bbf396740 1 -- 172.21.15.44:0/1226588995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e09ec60 msgr2=0x55959e0cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.714+0000 7f1bbf396740 1 --2- 172.21.15.44:0/1226588995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e09ec60 0x55959e0cea50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1bac009eb0 tx=0x7f1bac02e070 comp rx=0 tx=0).stop 2024-03-30T13:14:36.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.714+0000 7f1bbf396740 1 -- 172.21.15.44:0/1226588995 shutdown_connections 2024-03-30T13:14:36.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.714+0000 7f1bbf396740 1 --2- 172.21.15.44:0/1226588995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e09ec60 0x55959e0cea50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.714+0000 7f1bbf396740 1 --2- 172.21.15.44:0/1226588995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cbb60 0x55959e0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.714+0000 7f1bbf396740 1 --2- 172.21.15.44:0/1226588995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cb780 0x55959e09e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.714+0000 7f1bbf396740 1 -- 172.21.15.44:0/1226588995 >> 172.21.15.44:0/1226588995 conn(0x55959e0a0990 msgr2=0x55959e0e9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:36.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.715+0000 7f1bbf396740 1 -- 172.21.15.44:0/1226588995 shutdown_connections 2024-03-30T13:14:36.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.715+0000 7f1bbf396740 1 -- 172.21.15.44:0/1226588995 wait complete. 2024-03-30T13:14:36.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.716+0000 7f1bbf396740 1 -- start start 2024-03-30T13:14:36.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.716+0000 7f1bbf396740 1 Processor -- start 2024-03-30T13:14:36.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bbf396740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cb780 0x55959e0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bbf396740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 0x55959e0d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bbf396740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cad50 0x55959e0f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bbf396740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55959e0a3030 con 0x55959e0cbb60 2024-03-30T13:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bbf396740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55959dfc4aa0 con 0x55959e0cad50 2024-03-30T13:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bbf396740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55959e0a5870 con 0x55959e0cb780 2024-03-30T13:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bbf396740 10 client.0 _ll_register_callbacks cb 0x55959dfc4490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bb9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 0x55959e0d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bb9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 0x55959e0d09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48984/0 (socket says 172.21.15.44:48984) 2024-03-30T13:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bb9200640 1 -- 172.21.15.44:0/551143861 learned_addr learned my addr 172.21.15.44:0/551143861 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bb9c00640 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cb780 0x55959e0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bba600640 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cad50 0x55959e0f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bb9200640 1 -- 172.21.15.44:0/551143861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cb780 msgr2=0x55959e0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.718+0000 7f1bb9200640 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cb780 0x55959e0ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1bb9200640 1 -- 172.21.15.44:0/551143861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cad50 msgr2=0x55959e0f9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1bb9200640 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cad50 0x55959e0f9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1bb9200640 1 -- 172.21.15.44:0/551143861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55959dd1d3f0 con 0x55959e0cbb60 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1bb9c00640 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cb780 0x55959e0ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1bba600640 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cad50 0x55959e0f9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1bb9200640 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 0x55959e0d09a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0061e90 tx=0x7f1ba0059230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3388ab71d8b462 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1b9aa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1b9aa00640 1 -- 172.21.15.44:0/551143861 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0021070 con 0x55959e0cbb60 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1b9aa00640 1 -- 172.21.15.44:0/551143861 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f1ba0058e30 con 0x55959e0cbb60 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1bbf396740 1 -- 172.21.15.44:0/551143861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bac045070 con 0x55959e0cbb60 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1b9aa00640 1 -- 172.21.15.44:0/551143861 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1ba00600c0 con 0x55959e0cbb60 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1bbf396740 10 client.5592 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:36.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.719+0000 7f1bbf396740 1 -- 172.21.15.44:0/551143861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55959dcdd0f0 con 0x55959e0cbb60 2024-03-30T13:14:36.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.720+0000 7f1b9aa00640 1 -- 172.21.15.44:0/551143861 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac045070 con 0x55959e0cbb60 2024-03-30T13:14:36.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.720+0000 7f1b9aa00640 1 -- 172.21.15.44:0/551143861 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f1ba005ab10 con 0x55959e0cbb60 2024-03-30T13:14:36.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.720+0000 7f1bbf396740 10 client.5592 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:36.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.720+0000 7f1bbf396740 10 client.5592 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:36.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.720+0000 7f1bbf396740 20 client.5592 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:36.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.720+0000 7f1bbf396740 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55959e0d1d80 0x55959e0d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.720+0000 7f1bbf396740 4 client.5592 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:36.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.720+0000 7f1bbf396740 1 -- 172.21.15.44:0/551143861 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55959e016c10 con 0x55959e0d1d80 2024-03-30T13:14:36.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.720+0000 7f1bb9c00640 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55959e0d1d80 0x55959e0d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.721+0000 7f1bb9c00640 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55959e0d1d80 0x55959e0d21b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7182779c92ed656a server_cookie=7985b47f8c053040 in_seq=0 out_seq=0 2024-03-30T13:14:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.721+0000 7f1b9aa00640 10 client.5592 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1b9aa00640 1 -- 172.21.15.44:0/551143861 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55959e016c10 con 0x55959e0d1d80 2024-03-30T13:14:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1b9aa00640 10 client.5592 handle_command_reply: tid=0 2024-03-30T13:14:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1bbf396740 1 client.5592 shutdown 2024-03-30T13:14:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1bbf396740 1 -- 172.21.15.44:0/551143861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 msgr2=0x55959e0d09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1bbf396740 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 0x55959e0d09a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0061e90 tx=0x7f1ba0059230 comp rx=0 tx=0).stop 2024-03-30T13:14:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1bbf396740 1 -- 172.21.15.44:0/551143861 shutdown_connections 2024-03-30T13:14:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1bbf396740 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55959e0d1d80 0x55959e0d21b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1bbf396740 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cad50 0x55959e0f9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1bbf396740 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 0x55959e0d09a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1bbf396740 1 --2- 172.21.15.44:0/551143861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cb780 0x55959e0ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1b9aa00640 0 client.5592 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:36.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1bbf396740 1 -- 172.21.15.44:0/551143861 >> 172.21.15.44:0/551143861 conn(0x55959e09ec60 msgr2=0x55959e0a2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:36.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1bbf396740 1 -- 172.21.15.44:0/551143861 shutdown_connections 2024-03-30T13:14:36.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.722+0000 7f1bbf396740 1 -- 172.21.15.44:0/551143861 wait complete. 2024-03-30T13:14:36.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.723+0000 7f1bbf396740 20 client.5592 trim_cache size 0 max 16384 2024-03-30T13:14:36.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.742+0000 7f1bbf396740 1 Processor -- start 2024-03-30T13:14:36.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.742+0000 7f1bbf396740 1 -- start start 2024-03-30T13:14:36.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.743+0000 7f1bbf396740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cad50 0x55959e0d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.743+0000 7f1bbf396740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cb780 0x55959e09da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.743+0000 7f1bbf396740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cbb60 0x55959e0d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.743+0000 7f1bbf396740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb4200e40 con 0x55959e0cb780 2024-03-30T13:14:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.743+0000 7f1bbf396740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41ffed0 con 0x55959e0cad50 2024-03-30T13:14:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.743+0000 7f1bbf396740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb40c99b0 con 0x55959e0cbb60 2024-03-30T13:14:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.743+0000 7f1bb9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cb780 0x55959e09da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.743+0000 7f1bb9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cb780 0x55959e09da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48996/0 (socket says 172.21.15.44:48996) 2024-03-30T13:14:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.743+0000 7f1bb9200640 1 -- 172.21.15.44:0/1860304337 learned_addr learned my addr 172.21.15.44:0/1860304337 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.744+0000 7f1bb9c00640 1 --2- 172.21.15.44:0/1860304337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cad50 0x55959e0d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.744+0000 7f1bba600640 1 --2- 172.21.15.44:0/1860304337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cbb60 0x55959e0d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.744+0000 7f1bb9200640 1 -- 172.21.15.44:0/1860304337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cbb60 msgr2=0x55959e0d2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:36.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.744+0000 7f1bb9200640 1 --2- 172.21.15.44:0/1860304337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cbb60 0x55959e0d2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.744+0000 7f1bb9200640 1 -- 172.21.15.44:0/1860304337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cad50 msgr2=0x55959e0d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.744+0000 7f1bb9200640 1 --2- 172.21.15.44:0/1860304337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cad50 0x55959e0d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.744+0000 7f1bb9200640 1 -- 172.21.15.44:0/1860304337 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55959dfe7500 con 0x55959e0cb780 2024-03-30T13:14:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.744+0000 7f1bb9c00640 1 --2- 172.21.15.44:0/1860304337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cad50 0x55959e0d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.744+0000 7f1bb9200640 1 --2- 172.21.15.44:0/1860304337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cb780 0x55959e09da60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0057d10 tx=0x7f1ba005b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82861812594e226 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.744+0000 7f1ba5600640 1 -- 172.21.15.44:0/1860304337 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0058c30 con 0x55959e0cb780 2024-03-30T13:14:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.744+0000 7f1ba5600640 1 -- 172.21.15.44:0/1860304337 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba0058df0 con 0x55959e0cb780 2024-03-30T13:14:36.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.745+0000 7f1ba5600640 1 -- 172.21.15.44:0/1860304337 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0055770 con 0x55959e0cb780 2024-03-30T13:14:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.745+0000 7f1bbf396740 1 -- 172.21.15.44:0/1860304337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cb780 msgr2=0x55959e09da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.745+0000 7f1bbf396740 1 --2- 172.21.15.44:0/1860304337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cb780 0x55959e09da60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0057d10 tx=0x7f1ba005b000 comp rx=0 tx=0).stop 2024-03-30T13:14:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.745+0000 7f1bbf396740 1 -- 172.21.15.44:0/1860304337 shutdown_connections 2024-03-30T13:14:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.745+0000 7f1bbf396740 1 --2- 172.21.15.44:0/1860304337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cbb60 0x55959e0d2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.745+0000 7f1bbf396740 1 --2- 172.21.15.44:0/1860304337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cb780 0x55959e09da60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.745+0000 7f1bbf396740 1 --2- 172.21.15.44:0/1860304337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cad50 0x55959e0d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.745+0000 7f1bbf396740 1 -- 172.21.15.44:0/1860304337 >> 172.21.15.44:0/1860304337 conn(0x55959e09ec60 msgr2=0x55959e0ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:36.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.745+0000 7f1bbf396740 1 -- 172.21.15.44:0/1860304337 shutdown_connections 2024-03-30T13:14:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.745+0000 7f1bbf396740 1 -- 172.21.15.44:0/1860304337 wait complete. 2024-03-30T13:14:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.746+0000 7f1bbf396740 1 -- start start 2024-03-30T13:14:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.746+0000 7f1bbf396740 1 Processor -- start 2024-03-30T13:14:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.747+0000 7f1bbf396740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cad50 0x55959e1665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.747+0000 7f1bbf396740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cb780 0x55959e09de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.747+0000 7f1bbf396740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 0x55959e0df490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.747+0000 7f1bbf396740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55959e0e3400 con 0x55959e0cbb60 2024-03-30T13:14:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.747+0000 7f1bbf396740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb41ff920 con 0x55959e0cb780 2024-03-30T13:14:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.747+0000 7f1bbf396740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55959e09f350 con 0x55959e0cad50 2024-03-30T13:14:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.747+0000 7f1bbf396740 10 client.0 _ll_register_callbacks cb 0x7f1ba00593b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:36.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.747+0000 7f1bba600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 0x55959e0df490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.747+0000 7f1bba600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 0x55959e0df490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:49006/0 (socket says 172.21.15.44:49006) 2024-03-30T13:14:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.747+0000 7f1bba600640 1 -- 172.21.15.44:0/823880928 learned_addr learned my addr 172.21.15.44:0/823880928 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.748+0000 7f1bba600640 1 -- 172.21.15.44:0/823880928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cad50 msgr2=0x55959e1665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.748+0000 7f1bba600640 1 --2- 172.21.15.44:0/823880928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cad50 0x55959e1665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.748+0000 7f1bba600640 1 -- 172.21.15.44:0/823880928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cb780 msgr2=0x55959e09de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.748+0000 7f1bba600640 1 --2- 172.21.15.44:0/823880928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cb780 0x55959e09de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.748+0000 7f1bba600640 1 -- 172.21.15.44:0/823880928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55959e09e3a0 con 0x55959e0cbb60 2024-03-30T13:14:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.748+0000 7f1bba600640 1 --2- 172.21.15.44:0/823880928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 0x55959e0df490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1bac042040 tx=0x7f1bac004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2817f56cd9842349 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.748+0000 7f1b9aa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.748+0000 7f1b9aa00640 1 -- 172.21.15.44:0/823880928 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac003b90 con 0x55959e0cbb60 2024-03-30T13:14:36.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.748+0000 7f1b9aa00640 1 -- 172.21.15.44:0/823880928 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f1bac003d30 con 0x55959e0cbb60 2024-03-30T13:14:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.748+0000 7f1bbf396740 1 -- 172.21.15.44:0/823880928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ba0058df0 con 0x55959e0cbb60 2024-03-30T13:14:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.749+0000 7f1b9aa00640 1 -- 172.21.15.44:0/823880928 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1bac039020 con 0x55959e0cbb60 2024-03-30T13:14:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.749+0000 7f1bbf396740 10 client.5598 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.749+0000 7f1bbf396740 1 -- 172.21.15.44:0/823880928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55959e1005d0 con 0x55959e0cbb60 2024-03-30T13:14:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.749+0000 7f1b9aa00640 1 -- 172.21.15.44:0/823880928 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba0058df0 con 0x55959e0cbb60 2024-03-30T13:14:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.749+0000 7f1b9aa00640 1 -- 172.21.15.44:0/823880928 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f1bac004040 con 0x55959e0cbb60 2024-03-30T13:14:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.749+0000 7f1bbf396740 10 client.5598 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.749+0000 7f1bbf396740 10 client.5598 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.749+0000 7f1bbf396740 20 client.5598 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.749+0000 7f1bbf396740 1 --2- 172.21.15.44:0/823880928 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55959e0df9d0 0x55959e169090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:36.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.749+0000 7f1bbf396740 4 client.5598 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-30T13:14:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.749+0000 7f1bbf396740 1 -- 172.21.15.44:0/823880928 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55959e010f60 con 0x55959e0df9d0 2024-03-30T13:14:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.750+0000 7f1bb9c00640 1 --2- 172.21.15.44:0/823880928 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55959e0df9d0 0x55959e169090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.750+0000 7f1bb9c00640 1 --2- 172.21.15.44:0/823880928 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55959e0df9d0 0x55959e169090 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d863f546b36ba9fa server_cookie=3c5e02d40ea05026 in_seq=0 out_seq=0 2024-03-30T13:14:36.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.750+0000 7f1b9aa00640 10 client.5598 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.750+0000 7f1b9aa00640 1 -- 172.21.15.44:0/823880928 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+376 (crc 0 0 0) 0x55959e010f60 con 0x55959e0df9d0 2024-03-30T13:14:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.750+0000 7f1b9aa00640 10 client.5598 handle_command_reply: tid=0 2024-03-30T13:14:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.750+0000 7f1bbf396740 1 client.5598 shutdown 2024-03-30T13:14:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.751+0000 7f1bbf396740 1 -- 172.21.15.44:0/823880928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 msgr2=0x55959e0df490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.751+0000 7f1bbf396740 1 --2- 172.21.15.44:0/823880928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 0x55959e0df490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1bac042040 tx=0x7f1bac004ab0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.751+0000 7f1bbf396740 1 -- 172.21.15.44:0/823880928 shutdown_connections 2024-03-30T13:14:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.751+0000 7f1bbf396740 1 --2- 172.21.15.44:0/823880928 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55959e0df9d0 0x55959e169090 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.751+0000 7f1bbf396740 1 --2- 172.21.15.44:0/823880928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55959e0cbb60 0x55959e0df490 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.751+0000 7f1bbf396740 1 --2- 172.21.15.44:0/823880928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55959e0cb780 0x55959e09de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.751+0000 7f1bbf396740 1 --2- 172.21.15.44:0/823880928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55959e0cad50 0x55959e1665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.751+0000 7f1b9aa00640 0 client.5598 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:36.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.751+0000 7f1bbf396740 1 -- 172.21.15.44:0/823880928 >> 172.21.15.44:0/823880928 conn(0x55959e09ec60 msgr2=0x55959e0e3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:36.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.751+0000 7f1bbf396740 1 -- 172.21.15.44:0/823880928 shutdown_connections 2024-03-30T13:14:36.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.751+0000 7f1bbf396740 1 -- 172.21.15.44:0/823880928 wait complete. 2024-03-30T13:14:36.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.751+0000 7f1bbf396740 20 client.5598 trim_cache size 0 max 16384 2024-03-30T13:14:36.761 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "no active scrubs running", 2024-03-30T13:14:36.761 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": {}, 2024-03-30T13:14:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-03-30T13:14:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "15729069-7252-4183-a34d-d65e02a27e24": { 2024-03-30T13:14:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-03-30T13:14:06.098229+0000", 2024-03-30T13:14:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-03-30T13:14:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 75, 2024-03-30T13:14:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 75, 2024-03-30T13:14:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-03-30T13:14:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-03-30T13:14:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:36.762 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:36.762 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:36.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.752+0000 7f1bbb000640 1 -- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b9406c560 msgr2=0x7f1b9406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.752+0000 7f1bbb000640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b9406c560 0x7f1b9406ea20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8005880 tx=0x7f1ba8009040 comp rx=0 tx=0).stop 2024-03-30T13:14:36.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.752+0000 7f1bbb000640 1 -- 172.21.15.44:0/80632377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb40d46b0 msgr2=0x7f1bb406d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:36.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.752+0000 7f1bbb000640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb40d46b0 0x7f1bb406d850 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000e840 tx=0x7f1ba000ed00 comp rx=0 tx=0).stop 2024-03-30T13:14:36.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.752+0000 7f1bbb000640 1 -- 172.21.15.44:0/80632377 shutdown_connections 2024-03-30T13:14:36.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.752+0000 7f1bbb000640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bb415c040 0x7f1bb40b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.752+0000 7f1bbb000640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bb40d46b0 0x7f1bb406d850 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.752+0000 7f1bbb000640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1b9406c560 0x7f1b9406ea20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.752+0000 7f1bbb000640 1 --2- 172.21.15.44:0/80632377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bb40d18f0 0x7f1bb41523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:36.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.752+0000 7f1bbb000640 1 -- 172.21.15.44:0/80632377 >> 172.21.15.44:0/80632377 conn(0x7f1bb408dbf0 msgr2=0x7f1bb40b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:36.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.752+0000 7f1bbb000640 1 -- 172.21.15.44:0/80632377 shutdown_connections 2024-03-30T13:14:36.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:36.752+0000 7f1bbb000640 1 -- 172.21.15.44:0/80632377 wait complete. 2024-03-30T13:14:36.774 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-30T13:14:36.774 DEBUG:tasks.cephfs.test_uninlining:extracting inodes 2024-03-30T13:14:36.774 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:14:36.774 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Kconfig 2024-03-30T13:14:36.820 INFO:teuthology.orchestra.run.smithi044.stdout:1099511627780 linux-5.4/fs/ceph/Kconfig 2024-03-30T13:14:36.821 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Makefile 2024-03-30T13:14:36.821 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Makefile 2024-03-30T13:14:36.915 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628281 linux-5.4/fs/ceph/Makefile 2024-03-30T13:14:36.915 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:14:36.915 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:14:36.970 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628287 linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:14:36.970 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/io.h 2024-03-30T13:14:36.971 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/io.h 2024-03-30T13:14:37.019 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628294 linux-5.4/fs/ceph/io.h 2024-03-30T13:14:37.020 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:14:37.020 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:14:37.067 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628296 linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:14:37.067 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:14:37.067 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Kconfig 2024-03-30T13:14:37.115 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628308 linux-5.4/fs/ext2/Kconfig 2024-03-30T13:14:37.115 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:14:37.115 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:14:37.210 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628326 linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:14:37.210 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:14:37.210 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:14:37.258 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628324 linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:14:37.258 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Makefile 2024-03-30T13:14:37.258 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Makefile 2024-03-30T13:14:37.353 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628309 linux-5.4/fs/ext2/Makefile 2024-03-30T13:14:37.354 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:14:37.354 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/symlink.c 2024-03-30T13:14:37.400 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628321 linux-5.4/fs/ext2/symlink.c 2024-03-30T13:14:37.401 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/acl.h 2024-03-30T13:14:37.401 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/acl.h 2024-03-30T13:14:37.449 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628311 linux-5.4/fs/ext2/acl.h 2024-03-30T13:14:37.449 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:14:37.449 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:14:37.495 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628325 linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:14:37.495 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:14:37.495 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr.h 2024-03-30T13:14:37.591 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628323 linux-5.4/fs/ext2/xattr.h 2024-03-30T13:14:37.591 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:14:37.592 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:14:37.645 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628328 linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:14:37.645 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:14:37.645 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:14:37.697 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628341 linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:14:37.697 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:14:37.697 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:14:37.750 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628348 linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:14:37.750 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:14:37.750 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:14:37.803 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628331 linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:14:37.803 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:14:37.803 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:14:37.856 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628339 linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:14:37.857 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:14:37.857 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:14:37.913 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628343 linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:14:37.913 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:14:37.913 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:14:37.966 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628344 linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:14:37.966 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:14:37.966 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Makefile 2024-03-30T13:14:38.015 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628329 linux-5.4/fs/orangefs/Makefile 2024-03-30T13:14:38.015 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:14:38.015 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:14:38.063 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628352 linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:14:38.063 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:14:38.063 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:14:38.110 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628334 linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:14:38.110 DEBUG:tasks.cephfs.test_uninlining:getting inline data info 2024-03-30T13:14:38.110 DEBUG:tasks.cephfs.test_uninlining:getting inode info #1 of 23:1099511627780 2024-03-30T13:14:38.113 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511627780 2024-03-30T13:14:38.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511627780 2024-03-30T13:14:38.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.370+0000 7f080b400640 1 Processor -- start 2024-03-30T13:14:38.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.371+0000 7f080b400640 1 -- start start 2024-03-30T13:14:38.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.372+0000 7f080b400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08040b5dc0 0x7f08040b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.372+0000 7f080b400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08040b66e0 con 0x7f08040b73d0 2024-03-30T13:14:38.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.372+0000 7f080b400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08040d2ff0 con 0x7f08040ba090 2024-03-30T13:14:38.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.372+0000 7f080b400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f08040d2d90 con 0x7f08040b5dc0 2024-03-30T13:14:38.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.373+0000 7f0809400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f08040b73d0 0x7f08040b7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36772/0 (socket says 172.21.15.44:36772) 2024-03-30T13:14:38.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.373+0000 7f0809400640 1 -- 172.21.15.44:0/3336226317 learned_addr learned my addr 172.21.15.44:0/3336226317 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:38.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.373+0000 7f0808a00640 1 --2- 172.21.15.44:0/3336226317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08040b5dc0 0x7f08040b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.373+0000 7f0803400640 1 -- 172.21.15.44:0/3336226317 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010695700 0 0) 0x7f08040b66e0 con 0x7f08040b73d0 2024-03-30T13:14:38.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.373+0000 7f0803400640 1 -- 172.21.15.44:0/3336226317 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07ec003520 con 0x7f08040b73d0 2024-03-30T13:14:38.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.374+0000 7f0803400640 1 -- 172.21.15.44:0/3336226317 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808538758 0 0) 0x7f08040d2ff0 con 0x7f08040ba090 2024-03-30T13:14:38.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.374+0000 7f0808a00640 1 -- 172.21.15.44:0/3336226317 >> v1:172.21.15.151:6789/0 conn(0x7f08040ba090 legacy=0x7f08040d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.374+0000 7f0808a00640 1 -- 172.21.15.44:0/3336226317 >> v1:172.21.15.44:6789/0 conn(0x7f08040b73d0 legacy=0x7f08040b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.374+0000 7f0808a00640 1 -- 172.21.15.44:0/3336226317 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08040d32d0 con 0x7f08040b5dc0 2024-03-30T13:14:38.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.376+0000 7f0808a00640 1 --2- 172.21.15.44:0/3336226317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08040b5dc0 0x7f08040b61a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f07f80097d0 tx=0x7f07f802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bec1ea275ee2b6c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.376+0000 7f0803400640 1 -- 172.21.15.44:0/3336226317 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8037070 con 0x7f08040b5dc0 2024-03-30T13:14:38.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.376+0000 7f0803400640 1 -- 172.21.15.44:0/3336226317 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f8030710 con 0x7f08040b5dc0 2024-03-30T13:14:38.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.376+0000 7f0803400640 1 -- 172.21.15.44:0/3336226317 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8030ae0 con 0x7f08040b5dc0 2024-03-30T13:14:38.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.377+0000 7f080b400640 1 -- 172.21.15.44:0/3336226317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08040b5dc0 msgr2=0x7f08040b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.377+0000 7f080b400640 1 --2- 172.21.15.44:0/3336226317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08040b5dc0 0x7f08040b61a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f07f80097d0 tx=0x7f07f802b800 comp rx=0 tx=0).stop 2024-03-30T13:14:38.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.377+0000 7f080b400640 1 -- 172.21.15.44:0/3336226317 shutdown_connections 2024-03-30T13:14:38.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.377+0000 7f080b400640 1 --2- 172.21.15.44:0/3336226317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08040b5dc0 0x7f08040b61a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.377+0000 7f080b400640 1 -- 172.21.15.44:0/3336226317 >> 172.21.15.44:0/3336226317 conn(0x7f08040678f0 msgr2=0x7f08040d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.377+0000 7f080b400640 1 -- 172.21.15.44:0/3336226317 shutdown_connections 2024-03-30T13:14:38.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.377+0000 7f080b400640 1 -- 172.21.15.44:0/3336226317 wait complete. 2024-03-30T13:14:38.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.379+0000 7f080b400640 1 Processor -- start 2024-03-30T13:14:38.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.379+0000 7f080b400640 1 -- start start 2024-03-30T13:14:38.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.380+0000 7f080b400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08040b5dc0 0x7f08040b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.380+0000 7f080b400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08040b73d0 0x7f08041607f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.380+0000 7f080b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08040ba090 0x7f08041588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.380+0000 7f080b400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f08040d3b70 con 0x7f08040ba090 2024-03-30T13:14:38.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.380+0000 7f080b400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f08040d3890 con 0x7f08040b5dc0 2024-03-30T13:14:38.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.380+0000 7f080b400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f08040d4090 con 0x7f08040b73d0 2024-03-30T13:14:38.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.380+0000 7f0809400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08040ba090 0x7f08041588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.380+0000 7f0809400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08040ba090 0x7f08041588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33128/0 (socket says 172.21.15.44:33128) 2024-03-30T13:14:38.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.380+0000 7f0809400640 1 -- 172.21.15.44:0/922186003 learned_addr learned my addr 172.21.15.44:0/922186003 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.381+0000 7f0808a00640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08040b5dc0 0x7f08040b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.381+0000 7f0803e00640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08040b73d0 0x7f08041607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.381+0000 7f0809400640 1 -- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08040b73d0 msgr2=0x7f08041607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.381+0000 7f0809400640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08040b73d0 0x7f08041607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.381+0000 7f0809400640 1 -- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08040b5dc0 msgr2=0x7f08040b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.381+0000 7f0809400640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08040b5dc0 0x7f08040b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.381+0000 7f0809400640 1 -- 172.21.15.44:0/922186003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08041f4060 con 0x7f08040ba090 2024-03-30T13:14:38.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.381+0000 7f0809400640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08040ba090 0x7f08041588d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f07fc002030 tx=0x7f07fc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.382+0000 7f0800c00640 1 -- 172.21.15.44:0/922186003 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc017070 con 0x7f08040ba090 2024-03-30T13:14:38.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.382+0000 7f0800c00640 1 -- 172.21.15.44:0/922186003 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07fc012400 con 0x7f08040ba090 2024-03-30T13:14:38.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.382+0000 7f0800c00640 1 -- 172.21.15.44:0/922186003 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc012810 con 0x7f08040ba090 2024-03-30T13:14:38.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.382+0000 7f080b400640 1 -- 172.21.15.44:0/922186003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08041f4300 con 0x7f08040ba090 2024-03-30T13:14:38.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.382+0000 7f080b400640 1 -- 172.21.15.44:0/922186003 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08041f48c0 con 0x7f08040ba090 2024-03-30T13:14:38.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.384+0000 7f0800c00640 1 -- 172.21.15.44:0/922186003 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f07fc01a070 con 0x7f08040ba090 2024-03-30T13:14:38.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.385+0000 7f0800c00640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f07e406c560 0x7f07e406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.385+0000 7f0800c00640 1 -- 172.21.15.44:0/922186003 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f07fc08b9d0 con 0x7f08040ba090 2024-03-30T13:14:38.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.386+0000 7f080e190740 1 Processor -- start 2024-03-30T13:14:38.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.386+0000 7f080e190740 1 -- start start 2024-03-30T13:14:38.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.386+0000 7f0808a00640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f07e406c560 0x7f07e406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.387+0000 7f080e190740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 0x5616218cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.387+0000 7f080e190740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218cf300 0x5616218a72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.387+0000 7f080e190740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218a8670 0x5616218a7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.387+0000 7f080e190740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56162180b330 con 0x5616218a8290 2024-03-30T13:14:38.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.387+0000 7f080e190740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5616217b3620 con 0x5616218cf300 2024-03-30T13:14:38.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.387+0000 7f080e190740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x561621807440 con 0x5616218a8670 2024-03-30T13:14:38.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.387+0000 7f0808a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 0x5616218cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.387+0000 7f0808a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 0x5616218cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33136/0 (socket says 172.21.15.44:33136) 2024-03-30T13:14:38.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.387+0000 7f0808a00640 1 -- 172.21.15.44:0/3268792097 learned_addr learned my addr 172.21.15.44:0/3268792097 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.387+0000 7f0808a00640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f07e406c560 0x7f07e406ea20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f07f8034000 tx=0x7f07f8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.387+0000 7f0803e00640 1 --2- 172.21.15.44:0/3268792097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218cf300 0x5616218a72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.387+0000 7f0809400640 1 --2- 172.21.15.44:0/3268792097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218a8670 0x5616218a7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.388+0000 7f0808a00640 1 -- 172.21.15.44:0/3268792097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218a8670 msgr2=0x5616218a7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.388+0000 7f0808a00640 1 --2- 172.21.15.44:0/3268792097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218a8670 0x5616218a7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.388+0000 7f0808a00640 1 -- 172.21.15.44:0/3268792097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218cf300 msgr2=0x5616218a72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.388+0000 7f0808a00640 1 --2- 172.21.15.44:0/3268792097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218cf300 0x5616218a72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.388+0000 7f0808a00640 1 -- 172.21.15.44:0/3268792097 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616215eb920 con 0x5616218a8290 2024-03-30T13:14:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.388+0000 7f0809400640 1 --2- 172.21.15.44:0/3268792097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218a8670 0x5616218a7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:38.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.388+0000 7f0808a00640 1 --2- 172.21.15.44:0/3268792097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 0x5616218cedc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f07f8000c00 tx=0x7f07f8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b19f5881e2ace2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.388+0000 7f07f5200640 1 -- 172.21.15.44:0/3268792097 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f804c070 con 0x5616218a8290 2024-03-30T13:14:38.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.388+0000 7f07f5200640 1 -- 172.21.15.44:0/3268792097 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f8030e50 con 0x5616218a8290 2024-03-30T13:14:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.388+0000 7f07f5200640 1 -- 172.21.15.44:0/3268792097 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8037040 con 0x5616218a8290 2024-03-30T13:14:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.389+0000 7f080e190740 1 -- 172.21.15.44:0/3268792097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 msgr2=0x5616218cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.389+0000 7f080e190740 1 --2- 172.21.15.44:0/3268792097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 0x5616218cedc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f07f8000c00 tx=0x7f07f8030000 comp rx=0 tx=0).stop 2024-03-30T13:14:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.389+0000 7f080e190740 1 -- 172.21.15.44:0/3268792097 shutdown_connections 2024-03-30T13:14:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.389+0000 7f080e190740 1 --2- 172.21.15.44:0/3268792097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218a8670 0x5616218a7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.389+0000 7f080e190740 1 --2- 172.21.15.44:0/3268792097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218cf300 0x5616218a72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.389+0000 7f080e190740 1 --2- 172.21.15.44:0/3268792097 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 0x5616218cedc0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.389+0000 7f080e190740 1 -- 172.21.15.44:0/3268792097 >> 172.21.15.44:0/3268792097 conn(0x56162186ebe0 msgr2=0x5616218ecfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.389+0000 7f080e190740 1 -- 172.21.15.44:0/3268792097 shutdown_connections 2024-03-30T13:14:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.389+0000 7f080e190740 1 -- 172.21.15.44:0/3268792097 wait complete. 2024-03-30T13:14:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.390+0000 7f080e190740 1 -- start start 2024-03-30T13:14:38.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.390+0000 7f080e190740 1 Processor -- start 2024-03-30T13:14:38.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.391+0000 7f080e190740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 0x5616218e5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.391+0000 7f080e190740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8670 0x5616218f0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.391+0000 7f080e190740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218c6040 0x5616218bb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.391+0000 7f080e190740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5616218ce930 con 0x5616218a8290 2024-03-30T13:14:38.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.391+0000 7f080e190740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5616217c69d0 con 0x5616218a8670 2024-03-30T13:14:38.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.391+0000 7f080e190740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5616218c76b0 con 0x5616218c6040 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.391+0000 7f080e190740 10 client.0 _ll_register_callbacks cb 0x561621802fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.391+0000 7f0808a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 0x5616218e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.391+0000 7f0808a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 0x5616218e5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33152/0 (socket says 172.21.15.44:33152) 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.391+0000 7f0808a00640 1 -- 172.21.15.44:0/661818974 learned_addr learned my addr 172.21.15.44:0/661818974 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.392+0000 7f0808a00640 1 -- 172.21.15.44:0/661818974 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218c6040 msgr2=0x5616218bb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.392+0000 7f0808a00640 1 --2- 172.21.15.44:0/661818974 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218c6040 0x5616218bb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.392+0000 7f0808a00640 1 -- 172.21.15.44:0/661818974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8670 msgr2=0x5616218f0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.392+0000 7f0803e00640 1 --2- 172.21.15.44:0/661818974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8670 0x5616218f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.392+0000 7f0808a00640 1 --2- 172.21.15.44:0/661818974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8670 0x5616218f0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.392+0000 7f0808a00640 1 -- 172.21.15.44:0/661818974 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616214df210 con 0x5616218a8290 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.392+0000 7f0808a00640 1 --2- 172.21.15.44:0/661818974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 0x5616218e5080 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f07f80098f0 tx=0x7f07f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906c14f08df77eb4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.392+0000 7f07e9600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f07e9600640 1 -- 172.21.15.44:0/661818974 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f8037070 con 0x5616218a8290 2024-03-30T13:14:38.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f080e190740 1 -- 172.21.15.44:0/661818974 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07f8030e50 con 0x5616218a8290 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f07e9600640 1 -- 172.21.15.44:0/661818974 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f07f8051c00 con 0x5616218a8290 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f07e9600640 1 -- 172.21.15.44:0/661818974 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f07f8062050 con 0x5616218a8290 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f080e190740 10 client.5610 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f080e190740 1 -- 172.21.15.44:0/661818974 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x56162164c0b0 con 0x5616218a8290 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f07e9600640 1 -- 172.21.15.44:0/661818974 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f8030e50 con 0x5616218a8290 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f07e9600640 1 -- 172.21.15.44:0/661818974 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f07f8065020 con 0x5616218a8290 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f080e190740 10 client.5610 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f080e190740 10 client.5610 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f080e190740 20 client.5610 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f080e190740 1 --2- 172.21.15.44:0/661818974 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5616218d35d0 0x5616218d39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f080e190740 4 client.5610 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.393+0000 7f080e190740 1 -- 172.21.15.44:0/661818974 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561621818870 con 0x5616218d35d0 2024-03-30T13:14:38.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.394+0000 7f0803e00640 1 --2- 172.21.15.44:0/661818974 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5616218d35d0 0x5616218d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.394+0000 7f0803e00640 1 --2- 172.21.15.44:0/661818974 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5616218d35d0 0x5616218d39e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f99903bff32a27a9 server_cookie=99d37b01af15fde9 in_seq=0 out_seq=0 2024-03-30T13:14:38.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.394+0000 7f07e9600640 10 client.5610 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.395+0000 7f07e9600640 1 -- 172.21.15.44:0/661818974 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x561621818870 con 0x5616218d35d0 2024-03-30T13:14:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.395+0000 7f07e9600640 10 client.5610 handle_command_reply: tid=0 2024-03-30T13:14:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.395+0000 7f080e190740 1 client.5610 shutdown 2024-03-30T13:14:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.396+0000 7f080e190740 1 -- 172.21.15.44:0/661818974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 msgr2=0x5616218e5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.396+0000 7f080e190740 1 --2- 172.21.15.44:0/661818974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 0x5616218e5080 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f07f80098f0 tx=0x7f07f8004730 comp rx=0 tx=0).stop 2024-03-30T13:14:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.396+0000 7f080e190740 1 -- 172.21.15.44:0/661818974 shutdown_connections 2024-03-30T13:14:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.396+0000 7f080e190740 1 --2- 172.21.15.44:0/661818974 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5616218d35d0 0x5616218d39e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.396+0000 7f080e190740 1 --2- 172.21.15.44:0/661818974 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218c6040 0x5616218bb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.396+0000 7f080e190740 1 --2- 172.21.15.44:0/661818974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8670 0x5616218f0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.396+0000 7f080e190740 1 --2- 172.21.15.44:0/661818974 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8290 0x5616218e5080 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.396+0000 7f07e9600640 0 client.5610 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:38.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.396+0000 7f080e190740 1 -- 172.21.15.44:0/661818974 >> 172.21.15.44:0/661818974 conn(0x56162186ebe0 msgr2=0x5616218cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.396+0000 7f080e190740 1 -- 172.21.15.44:0/661818974 shutdown_connections 2024-03-30T13:14:38.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.396+0000 7f080e190740 1 -- 172.21.15.44:0/661818974 wait complete. 2024-03-30T13:14:38.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.396+0000 7f080e190740 20 client.5610 trim_cache size 0 max 16384 2024-03-30T13:14:38.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.421+0000 7f080e190740 1 Processor -- start 2024-03-30T13:14:38.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.421+0000 7f080e190740 1 -- start start 2024-03-30T13:14:38.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f080e190740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8290 0x5616218efd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f080e190740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8670 0x5616218a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f080e190740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218c6040 0x5616218a6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f080e190740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0804200fb0 con 0x5616218a8670 2024-03-30T13:14:38.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f080e190740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f08041fffc0 con 0x5616218a8290 2024-03-30T13:14:38.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f080e190740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f080415f420 con 0x5616218c6040 2024-03-30T13:14:38.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f0803e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8670 0x5616218a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f0803e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8670 0x5616218a5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33154/0 (socket says 172.21.15.44:33154) 2024-03-30T13:14:38.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f0803e00640 1 -- 172.21.15.44:0/1182027373 learned_addr learned my addr 172.21.15.44:0/1182027373 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f0803e00640 1 -- 172.21.15.44:0/1182027373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218c6040 msgr2=0x5616218a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f0803e00640 1 --2- 172.21.15.44:0/1182027373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218c6040 0x5616218a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f0803e00640 1 -- 172.21.15.44:0/1182027373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8290 msgr2=0x5616218efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.422+0000 7f0803e00640 1 --2- 172.21.15.44:0/1182027373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8290 0x5616218efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.423+0000 7f0803e00640 1 -- 172.21.15.44:0/1182027373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616218d42e0 con 0x5616218a8670 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.423+0000 7f0803e00640 1 --2- 172.21.15.44:0/1182027373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8670 0x5616218a5df0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f08040ba4b0 tx=0x7f07f0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7408f7e721749d0a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.423+0000 7f07ebe00640 1 -- 172.21.15.44:0/1182027373 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f001d070 con 0x5616218a8670 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.423+0000 7f07ebe00640 1 -- 172.21.15.44:0/1182027373 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f00197d0 con 0x5616218a8670 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.423+0000 7f07ebe00640 1 -- 172.21.15.44:0/1182027373 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f0010040 con 0x5616218a8670 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.424+0000 7f080e190740 1 -- 172.21.15.44:0/1182027373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8670 msgr2=0x5616218a5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.424+0000 7f080e190740 1 --2- 172.21.15.44:0/1182027373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8670 0x5616218a5df0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f08040ba4b0 tx=0x7f07f0007d90 comp rx=0 tx=0).stop 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.424+0000 7f080e190740 1 -- 172.21.15.44:0/1182027373 shutdown_connections 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.424+0000 7f080e190740 1 --2- 172.21.15.44:0/1182027373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218c6040 0x5616218a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.424+0000 7f080e190740 1 --2- 172.21.15.44:0/1182027373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218a8670 0x5616218a5df0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.424+0000 7f080e190740 1 --2- 172.21.15.44:0/1182027373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8290 0x5616218efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.424+0000 7f080e190740 1 -- 172.21.15.44:0/1182027373 >> 172.21.15.44:0/1182027373 conn(0x56162186ebe0 msgr2=0x5616218e60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.424+0000 7f080e190740 1 -- 172.21.15.44:0/1182027373 shutdown_connections 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.424+0000 7f080e190740 1 -- 172.21.15.44:0/1182027373 wait complete. 2024-03-30T13:14:38.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.425+0000 7f080e190740 1 -- start start 2024-03-30T13:14:38.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.425+0000 7f080e190740 1 Processor -- start 2024-03-30T13:14:38.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.426+0000 7f080e190740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218a8290 0x56162196bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.426+0000 7f080e190740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8670 0x5616218cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.426+0000 7f080e190740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218c6040 0x5616218ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.426+0000 7f080e190740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5616218a6870 con 0x5616218c6040 2024-03-30T13:14:38.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.426+0000 7f080e190740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f08041ff9a0 con 0x5616218a8670 2024-03-30T13:14:38.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.426+0000 7f080e190740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5616218d2120 con 0x5616218a8290 2024-03-30T13:14:38.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.426+0000 7f080e190740 10 client.0 _ll_register_callbacks cb 0x7f07f8035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:38.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.426+0000 7f0809400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218c6040 0x5616218ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.426+0000 7f0809400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218c6040 0x5616218ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33164/0 (socket says 172.21.15.44:33164) 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.426+0000 7f0809400640 1 -- 172.21.15.44:0/707387652 learned_addr learned my addr 172.21.15.44:0/707387652 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f0808a00640 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218a8290 0x56162196bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f0803e00640 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8670 0x5616218cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f0809400640 1 -- 172.21.15.44:0/707387652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218a8290 msgr2=0x56162196bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f0809400640 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218a8290 0x56162196bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f0809400640 1 -- 172.21.15.44:0/707387652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8670 msgr2=0x5616218cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f0809400640 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8670 0x5616218cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f0809400640 1 -- 172.21.15.44:0/707387652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616214b82d0 con 0x5616218c6040 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f0808a00640 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218a8290 0x56162196bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f0809400640 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218c6040 0x5616218ce2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f07fc059630 tx=0x7f07fc059ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3de141202abfba server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f07e9600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f07e9600640 1 -- 172.21.15.44:0/707387652 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc071020 con 0x5616218c6040 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f07e9600640 1 -- 172.21.15.44:0/707387652 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f07fc059900 con 0x5616218c6040 2024-03-30T13:14:38.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f080e190740 1 -- 172.21.15.44:0/707387652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07f00197d0 con 0x5616218c6040 2024-03-30T13:14:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f07e9600640 1 -- 172.21.15.44:0/707387652 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f07fc059b20 con 0x5616218c6040 2024-03-30T13:14:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f080e190740 10 client.5616 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.427+0000 7f080e190740 1 -- 172.21.15.44:0/707387652 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5616218d1c20 con 0x5616218c6040 2024-03-30T13:14:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.428+0000 7f07e9600640 1 -- 172.21.15.44:0/707387652 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f00197d0 con 0x5616218c6040 2024-03-30T13:14:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.428+0000 7f07e9600640 1 -- 172.21.15.44:0/707387652 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f07fc061df0 con 0x5616218c6040 2024-03-30T13:14:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.428+0000 7f080e190740 10 client.5616 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.428+0000 7f080e190740 10 client.5616 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.428+0000 7f080e190740 20 client.5616 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.428+0000 7f080e190740 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5616218e4130 0x5616218d5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.428+0000 7f080e190740 4 client.5616 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511627780}] 2024-03-30T13:14:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.428+0000 7f080e190740 1 -- 172.21.15.44:0/707387652 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511627780}) -- 0x561621812bc0 con 0x5616218e4130 2024-03-30T13:14:38.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.428+0000 7f0808a00640 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5616218e4130 0x5616218d5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f07e9600640 10 client.5616 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f0808a00640 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5616218e4130 0x5616218d5340 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313e001675f83fd0 server_cookie=de57001d4a389595 in_seq=0 out_seq=0 2024-03-30T13:14:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f07e9600640 1 -- 172.21.15.44:0/707387652 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4773 (crc 0 0 0) 0x561621812bc0 con 0x5616218e4130 2024-03-30T13:14:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f07e9600640 10 client.5616 handle_command_reply: tid=0 2024-03-30T13:14:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f080e190740 1 client.5616 shutdown 2024-03-30T13:14:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f080e190740 1 -- 172.21.15.44:0/707387652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218c6040 msgr2=0x5616218ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f080e190740 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218c6040 0x5616218ce2f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f07fc059630 tx=0x7f07fc059ee0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f080e190740 1 -- 172.21.15.44:0/707387652 shutdown_connections 2024-03-30T13:14:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f080e190740 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5616218e4130 0x5616218d5340 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f080e190740 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5616218c6040 0x5616218ce2f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f080e190740 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616218a8670 0x5616218cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f080e190740 1 --2- 172.21.15.44:0/707387652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5616218a8290 0x56162196bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f080e190740 1 -- 172.21.15.44:0/707387652 >> 172.21.15.44:0/707387652 conn(0x56162186ebe0 msgr2=0x5616218e60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.429+0000 7f07e9600640 0 client.5616 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.430+0000 7f080e190740 1 -- 172.21.15.44:0/707387652 shutdown_connections 2024-03-30T13:14:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.430+0000 7f080e190740 1 -- 172.21.15.44:0/707387652 wait complete. 2024-03-30T13:14:38.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.430+0000 7f080e190740 20 client.5616 trim_cache size 0 max 16384 2024-03-30T13:14:38.438 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:38.438 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ceph/Kconfig", 2024-03-30T13:14:38.438 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511627780, 2024-03-30T13:14:38.438 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:38.438 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.138961+0000", 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.041261+0000", 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:38.439 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 1481, 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.041261+0000", 2024-03-30T13:14:38.440 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 1 2024-03-30T13:14:38.441 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1481, 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:38.442 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.138961+0000" 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1481, 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.138961+0000" 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 94, 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:38.443 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 2, 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:38.444 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:38.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.446 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:38.446 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:38.446 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:38.446 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:38.446 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:38.446 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:38.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.446 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:38.446 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:38.446 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:38.446 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:38.446 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:38.447 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:38.448 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:38.449 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:38.450 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:38.451 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:38.452 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:38.453 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:38.454 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:38.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.430+0000 7f080b400640 1 -- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f07e406c560 msgr2=0x7f07e406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.430+0000 7f080b400640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f07e406c560 0x7f07e406ea20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f07f8034000 tx=0x7f07f8008030 comp rx=0 tx=0).stop 2024-03-30T13:14:38.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.430+0000 7f080b400640 1 -- 172.21.15.44:0/922186003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08040ba090 msgr2=0x7f08041588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.430+0000 7f080b400640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08040ba090 0x7f08041588d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f07fc002030 tx=0x7f07fc00a430 comp rx=0 tx=0).stop 2024-03-30T13:14:38.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.431+0000 7f080b400640 1 -- 172.21.15.44:0/922186003 shutdown_connections 2024-03-30T13:14:38.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.431+0000 7f080b400640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08040ba090 0x7f08041588d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.431+0000 7f080b400640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08040b73d0 0x7f08041607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.431+0000 7f080b400640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f07e406c560 0x7f07e406ea20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.431+0000 7f080b400640 1 --2- 172.21.15.44:0/922186003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08040b5dc0 0x7f08040b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.431+0000 7f080b400640 1 -- 172.21.15.44:0/922186003 >> 172.21.15.44:0/922186003 conn(0x7f08040678f0 msgr2=0x7f08040b8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.431+0000 7f080b400640 1 -- 172.21.15.44:0/922186003 shutdown_connections 2024-03-30T13:14:38.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.431+0000 7f080b400640 1 -- 172.21.15.44:0/922186003 wait complete. 2024-03-30T13:14:38.456 DEBUG:tasks.cephfs.test_uninlining:getting inode info #2 of 23:1099511628281 2024-03-30T13:14:38.456 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628281 2024-03-30T13:14:38.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628281 2024-03-30T13:14:38.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.674+0000 7f8a83800640 1 Processor -- start 2024-03-30T13:14:38.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.674+0000 7f8a83800640 1 -- start start 2024-03-30T13:14:38.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.676+0000 7f8a83800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8a7c0ba090 0x7f8a7c0d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.676+0000 7f8a83800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8a7c0b73d0 0x7f8a7c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.676+0000 7f8a83800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a7c0d2ff0 con 0x7f8a7c0b5dc0 2024-03-30T13:14:38.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.676+0000 7f8a83800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8a7c0d32d0 con 0x7f8a7c0ba090 2024-03-30T13:14:38.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.676+0000 7f8a83800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f8a7c0d35b0 con 0x7f8a7c0b73d0 2024-03-30T13:14:38.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.676+0000 7f8a7be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8a7c0ba090 0x7f8a7c0d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.676+0000 7f8a7be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8a7c0ba090 0x7f8a7c0d2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33168/0 (socket says 172.21.15.44:33168) 2024-03-30T13:14:38.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.677+0000 7f8a7be00640 1 -- 172.21.15.44:0/1739944374 learned_addr learned my addr 172.21.15.44:0/1739944374 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.677+0000 7f8a81800640 1 --2- 172.21.15.44:0/1739944374 >> v2:172.21.15.151:3300/0 conn(0x7f8a7c0b73d0 0x7f8a7c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.677+0000 7f8a7be00640 1 -- 172.21.15.44:0/1739944374 >> v2:172.21.15.151:3300/0 conn(0x7f8a7c0b73d0 msgr2=0x7f8a7c0b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.677+0000 7f8a7be00640 1 --2- 172.21.15.44:0/1739944374 >> v2:172.21.15.151:3300/0 conn(0x7f8a7c0b73d0 0x7f8a7c0b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.677+0000 7f8a7be00640 1 -- 172.21.15.44:0/1739944374 >> v1:172.21.15.151:6789/0 conn(0x7f8a7c0b5dc0 legacy=0x7f8a7c0b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.677+0000 7f8a7be00640 1 -- 172.21.15.44:0/1739944374 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c0d3890 con 0x7f8a7c0ba090 2024-03-30T13:14:38.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.678+0000 7f8a7be00640 1 --2- 172.21.15.44:0/1739944374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c0ba090 0x7f8a7c0d2680 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009870 tx=0x7f8a6402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba949a2479d808a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.678+0000 7f8a7b400640 1 -- 172.21.15.44:0/1739944374 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64035020 con 0x7f8a7c0ba090 2024-03-30T13:14:38.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.679+0000 7f8a7b400640 1 -- 172.21.15.44:0/1739944374 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a64031870 con 0x7f8a7c0ba090 2024-03-30T13:14:38.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.679+0000 7f8a7b400640 1 -- 172.21.15.44:0/1739944374 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64031c40 con 0x7f8a7c0ba090 2024-03-30T13:14:38.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.679+0000 7f8a83800640 1 -- 172.21.15.44:0/1739944374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c0ba090 msgr2=0x7f8a7c0d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.679+0000 7f8a83800640 1 --2- 172.21.15.44:0/1739944374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c0ba090 0x7f8a7c0d2680 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009870 tx=0x7f8a6402b910 comp rx=0 tx=0).stop 2024-03-30T13:14:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.679+0000 7f8a83800640 1 -- 172.21.15.44:0/1739944374 shutdown_connections 2024-03-30T13:14:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.679+0000 7f8a83800640 1 --2- 172.21.15.44:0/1739944374 >> v2:172.21.15.151:3300/0 conn(0x7f8a7c0b73d0 0x7f8a7c0b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.679+0000 7f8a83800640 1 --2- 172.21.15.44:0/1739944374 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c0ba090 0x7f8a7c0d2680 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.679+0000 7f8a83800640 1 -- 172.21.15.44:0/1739944374 >> 172.21.15.44:0/1739944374 conn(0x7f8a7c0678f0 msgr2=0x7f8a7c0d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.679+0000 7f8a83800640 1 -- 172.21.15.44:0/1739944374 shutdown_connections 2024-03-30T13:14:38.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.680+0000 7f8a83800640 1 -- 172.21.15.44:0/1739944374 wait complete. 2024-03-30T13:14:38.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.681+0000 7f8a83800640 1 Processor -- start 2024-03-30T13:14:38.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.681+0000 7f8a83800640 1 -- start start 2024-03-30T13:14:38.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.682+0000 7f8a83800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a7c0b5dc0 0x7f8a7c1f7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.682+0000 7f8a83800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a7c0b73d0 0x7f8a7c158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.682+0000 7f8a83800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c0ba090 0x7f8a7c1589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.682+0000 7f8a83800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c15e880 con 0x7f8a7c0ba090 2024-03-30T13:14:38.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.682+0000 7f8a83800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c0d4090 con 0x7f8a7c0b73d0 2024-03-30T13:14:38.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.682+0000 7f8a83800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c15ea00 con 0x7f8a7c0b5dc0 2024-03-30T13:14:38.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a81800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c0ba090 0x7f8a7c1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a81800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c0ba090 0x7f8a7c1589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33184/0 (socket says 172.21.15.44:33184) 2024-03-30T13:14:38.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a81800640 1 -- 172.21.15.44:0/3831268595 learned_addr learned my addr 172.21.15.44:0/3831268595 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a7be00640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a7c0b73d0 0x7f8a7c158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a81800640 1 -- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a7c0b5dc0 msgr2=0x7f8a7c1f7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a80e00640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a7c0b5dc0 0x7f8a7c1f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a81800640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a7c0b5dc0 0x7f8a7c1f7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a81800640 1 -- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a7c0b73d0 msgr2=0x7f8a7c158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a81800640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a7c0b73d0 0x7f8a7c158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a81800640 1 -- 172.21.15.44:0/3831268595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c0cdad0 con 0x7f8a7c0ba090 2024-03-30T13:14:38.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a80e00640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a7c0b5dc0 0x7f8a7c1f7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:38.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a7be00640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a7c0b73d0 0x7f8a7c158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:38.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.683+0000 7f8a81800640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c0ba090 0x7f8a7c1589e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8a74007e70 tx=0x7f8a7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.684+0000 7f8a78c00640 1 -- 172.21.15.44:0/3831268595 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74014620 con 0x7f8a7c0ba090 2024-03-30T13:14:38.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.684+0000 7f8a78c00640 1 -- 172.21.15.44:0/3831268595 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a74019070 con 0x7f8a7c0ba090 2024-03-30T13:14:38.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.684+0000 7f8a78c00640 1 -- 172.21.15.44:0/3831268595 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74014a20 con 0x7f8a7c0ba090 2024-03-30T13:14:38.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.684+0000 7f8a83800640 1 -- 172.21.15.44:0/3831268595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7c0cddb0 con 0x7f8a7c0ba090 2024-03-30T13:14:38.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.684+0000 7f8a83800640 1 -- 172.21.15.44:0/3831268595 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7c15fdd0 con 0x7f8a7c0ba090 2024-03-30T13:14:38.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.686+0000 7f8a78c00640 1 -- 172.21.15.44:0/3831268595 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8a74014bc0 con 0x7f8a7c0ba090 2024-03-30T13:14:38.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.687+0000 7f8a78c00640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8a5806c560 0x7f8a5806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.687+0000 7f8a78c00640 1 -- 172.21.15.44:0/3831268595 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f8a7408c230 con 0x7f8a7c0ba090 2024-03-30T13:14:38.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.688+0000 7f8a80e00640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8a5806c560 0x7f8a5806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.688+0000 7f8a863ff740 1 Processor -- start 2024-03-30T13:14:38.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.688+0000 7f8a863ff740 1 -- start start 2024-03-30T13:14:38.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.689+0000 7f8a863ff740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262290 0x56067a288dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.689+0000 7f8a80e00640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8a5806c560 0x7f8a5806ea20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c003eb0 tx=0x7f8a6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.689+0000 7f8a863ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a289300 0x56067a2612d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.689+0000 7f8a863ff740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262670 0x56067a261810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.689+0000 7f8a863ff740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56067a1c5330 con 0x56067a262290 2024-03-30T13:14:38.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.689+0000 7f8a863ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56067a16d620 con 0x56067a289300 2024-03-30T13:14:38.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.689+0000 7f8a863ff740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x56067a1c1440 con 0x56067a262670 2024-03-30T13:14:38.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.689+0000 7f8a80e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262290 0x56067a288dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.690+0000 7f8a80e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262290 0x56067a288dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33194/0 (socket says 172.21.15.44:33194) 2024-03-30T13:14:38.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.690+0000 7f8a80e00640 1 -- 172.21.15.44:0/217420316 learned_addr learned my addr 172.21.15.44:0/217420316 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.690+0000 7f8a80e00640 1 -- 172.21.15.44:0/217420316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262670 msgr2=0x56067a261810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.690+0000 7f8a80e00640 1 --2- 172.21.15.44:0/217420316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262670 0x56067a261810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.690+0000 7f8a80e00640 1 -- 172.21.15.44:0/217420316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a289300 msgr2=0x56067a2612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.690+0000 7f8a80e00640 1 --2- 172.21.15.44:0/217420316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a289300 0x56067a2612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.690+0000 7f8a80e00640 1 -- 172.21.15.44:0/217420316 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560679fa5920 con 0x56067a262290 2024-03-30T13:14:38.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.690+0000 7f8a80e00640 1 --2- 172.21.15.44:0/217420316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262290 0x56067a288dc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c003c90 tx=0x7f8a6c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae7d7a5aa621b7d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.691+0000 7f8a71600640 1 -- 172.21.15.44:0/217420316 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c024070 con 0x56067a262290 2024-03-30T13:14:38.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.691+0000 7f8a71600640 1 -- 172.21.15.44:0/217420316 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a6c014dd0 con 0x56067a262290 2024-03-30T13:14:38.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.691+0000 7f8a71600640 1 -- 172.21.15.44:0/217420316 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c01f640 con 0x56067a262290 2024-03-30T13:14:38.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.691+0000 7f8a863ff740 1 -- 172.21.15.44:0/217420316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262290 msgr2=0x56067a288dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.691+0000 7f8a863ff740 1 --2- 172.21.15.44:0/217420316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262290 0x56067a288dc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c003c90 tx=0x7f8a6c010000 comp rx=0 tx=0).stop 2024-03-30T13:14:38.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.691+0000 7f8a863ff740 1 -- 172.21.15.44:0/217420316 shutdown_connections 2024-03-30T13:14:38.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.691+0000 7f8a863ff740 1 --2- 172.21.15.44:0/217420316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262670 0x56067a261810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.691+0000 7f8a863ff740 1 --2- 172.21.15.44:0/217420316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a289300 0x56067a2612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.691+0000 7f8a863ff740 1 --2- 172.21.15.44:0/217420316 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262290 0x56067a288dc0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.691+0000 7f8a863ff740 1 -- 172.21.15.44:0/217420316 >> 172.21.15.44:0/217420316 conn(0x56067a228be0 msgr2=0x56067a2a6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.691+0000 7f8a863ff740 1 -- 172.21.15.44:0/217420316 shutdown_connections 2024-03-30T13:14:38.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.692+0000 7f8a863ff740 1 -- 172.21.15.44:0/217420316 wait complete. 2024-03-30T13:14:38.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.692+0000 7f8a863ff740 1 -- start start 2024-03-30T13:14:38.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.692+0000 7f8a863ff740 1 Processor -- start 2024-03-30T13:14:38.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.693+0000 7f8a863ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262290 0x56067a2aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a863ff740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262670 0x56067a2808d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a863ff740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a2ba2e0 0x56067a2ba760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a863ff740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56067a288930 con 0x56067a262670 2024-03-30T13:14:38.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a863ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56067a1809d0 con 0x56067a262290 2024-03-30T13:14:38.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a863ff740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x56067a2816b0 con 0x56067a2ba2e0 2024-03-30T13:14:38.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a863ff740 10 client.0 _ll_register_callbacks cb 0x56067a1bcfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:38.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a7be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262670 0x56067a2808d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a7be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262670 0x56067a2808d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33206/0 (socket says 172.21.15.44:33206) 2024-03-30T13:14:38.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a7be00640 1 -- 172.21.15.44:0/359318288 learned_addr learned my addr 172.21.15.44:0/359318288 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a80e00640 1 --2- 172.21.15.44:0/359318288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262290 0x56067a2aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a7be00640 1 -- 172.21.15.44:0/359318288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a2ba2e0 msgr2=0x56067a2ba760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a7be00640 1 --2- 172.21.15.44:0/359318288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a2ba2e0 0x56067a2ba760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a7be00640 1 -- 172.21.15.44:0/359318288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262290 msgr2=0x56067a2aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a7be00640 1 --2- 172.21.15.44:0/359318288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262290 0x56067a2aaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.694+0000 7f8a7be00640 1 -- 172.21.15.44:0/359318288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560679e99210 con 0x56067a262670 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.695+0000 7f8a7be00640 1 --2- 172.21.15.44:0/359318288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262670 0x56067a2808d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8a640097c0 tx=0x7f8a640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832c6c38a63a83ed server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.695+0000 7f8a6a000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.695+0000 7f8a6a000640 1 -- 172.21.15.44:0/359318288 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64035040 con 0x56067a262670 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.695+0000 7f8a6a000640 1 -- 172.21.15.44:0/359318288 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f8a64045c50 con 0x56067a262670 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.695+0000 7f8a863ff740 1 -- 172.21.15.44:0/359318288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a6c014dd0 con 0x56067a262670 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.695+0000 7f8a6a000640 1 -- 172.21.15.44:0/359318288 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8a64045e50 con 0x56067a262670 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.695+0000 7f8a863ff740 10 client.5628 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.695+0000 7f8a863ff740 1 -- 172.21.15.44:0/359318288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x56067a0060b0 con 0x56067a262670 2024-03-30T13:14:38.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.696+0000 7f8a6a000640 1 -- 172.21.15.44:0/359318288 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a6c014dd0 con 0x56067a262670 2024-03-30T13:14:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.696+0000 7f8a6a000640 1 -- 172.21.15.44:0/359318288 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f8a6403a830 con 0x56067a262670 2024-03-30T13:14:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.696+0000 7f8a863ff740 10 client.5628 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.696+0000 7f8a863ff740 10 client.5628 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.696+0000 7f8a863ff740 20 client.5628 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.696+0000 7f8a863ff740 1 --2- 172.21.15.44:0/359318288 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56067a2a8d20 0x56067a2a9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.696+0000 7f8a863ff740 4 client.5628 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.696+0000 7f8a863ff740 1 -- 172.21.15.44:0/359318288 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56067a1d2870 con 0x56067a2a8d20 2024-03-30T13:14:38.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.696+0000 7f8a80e00640 1 --2- 172.21.15.44:0/359318288 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56067a2a8d20 0x56067a2a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.697+0000 7f8a80e00640 1 --2- 172.21.15.44:0/359318288 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56067a2a8d20 0x56067a2a9160 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac9b76637287e181 server_cookie=dc8017f2c94bb7e9 in_seq=0 out_seq=0 2024-03-30T13:14:38.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.697+0000 7f8a6a000640 10 client.5628 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:38.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.697+0000 7f8a6a000640 1 -- 172.21.15.44:0/359318288 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x56067a1d2870 con 0x56067a2a8d20 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.697+0000 7f8a6a000640 10 client.5628 handle_command_reply: tid=0 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.697+0000 7f8a863ff740 1 client.5628 shutdown 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.698+0000 7f8a863ff740 1 -- 172.21.15.44:0/359318288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262670 msgr2=0x56067a2808d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.698+0000 7f8a863ff740 1 --2- 172.21.15.44:0/359318288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262670 0x56067a2808d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8a640097c0 tx=0x7f8a640046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.698+0000 7f8a863ff740 1 -- 172.21.15.44:0/359318288 shutdown_connections 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.698+0000 7f8a863ff740 1 --2- 172.21.15.44:0/359318288 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56067a2a8d20 0x56067a2a9160 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.698+0000 7f8a863ff740 1 --2- 172.21.15.44:0/359318288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a2ba2e0 0x56067a2ba760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.698+0000 7f8a863ff740 1 --2- 172.21.15.44:0/359318288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a262670 0x56067a2808d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.698+0000 7f8a863ff740 1 --2- 172.21.15.44:0/359318288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262290 0x56067a2aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.698+0000 7f8a6a000640 0 client.5628 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.698+0000 7f8a863ff740 1 -- 172.21.15.44:0/359318288 >> 172.21.15.44:0/359318288 conn(0x56067a228be0 msgr2=0x56067a28bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.698+0000 7f8a863ff740 1 -- 172.21.15.44:0/359318288 shutdown_connections 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.698+0000 7f8a863ff740 1 -- 172.21.15.44:0/359318288 wait complete. 2024-03-30T13:14:38.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.698+0000 7f8a863ff740 20 client.5628 trim_cache size 0 max 16384 2024-03-30T13:14:38.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.714+0000 7f8a863ff740 1 Processor -- start 2024-03-30T13:14:38.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.714+0000 7f8a863ff740 1 -- start start 2024-03-30T13:14:38.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.715+0000 7f8a863ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262290 0x56067a2aab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.715+0000 7f8a863ff740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262670 0x56067a2873a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.715+0000 7f8a863ff740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 0x56067a2878e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.715+0000 7f8a863ff740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c201270 con 0x56067a2ba2e0 2024-03-30T13:14:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.715+0000 7f8a863ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c200290 con 0x56067a262290 2024-03-30T13:14:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.715+0000 7f8a863ff740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c160cd0 con 0x56067a262670 2024-03-30T13:14:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.715+0000 7f8a81800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 0x56067a2878e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.715+0000 7f8a81800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 0x56067a2878e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33222/0 (socket says 172.21.15.44:33222) 2024-03-30T13:14:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.715+0000 7f8a81800640 1 -- 172.21.15.44:0/2713554116 learned_addr learned my addr 172.21.15.44:0/2713554116 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.716+0000 7f8a81800640 1 -- 172.21.15.44:0/2713554116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262670 msgr2=0x56067a2873a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.716+0000 7f8a81800640 1 --2- 172.21.15.44:0/2713554116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262670 0x56067a2873a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.716+0000 7f8a81800640 1 -- 172.21.15.44:0/2713554116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262290 msgr2=0x56067a2aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.716+0000 7f8a81800640 1 --2- 172.21.15.44:0/2713554116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262290 0x56067a2aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.716+0000 7f8a81800640 1 -- 172.21.15.44:0/2713554116 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560679e722d0 con 0x56067a2ba2e0 2024-03-30T13:14:38.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.716+0000 7f8a81800640 1 --2- 172.21.15.44:0/2713554116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 0x56067a2878e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8a74056360 tx=0x7f8a7405a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3559dec06b2f20 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.716+0000 7f8a70c00640 1 -- 172.21.15.44:0/2713554116 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7405e2b0 con 0x56067a2ba2e0 2024-03-30T13:14:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.716+0000 7f8a70c00640 1 -- 172.21.15.44:0/2713554116 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a74062ae0 con 0x56067a2ba2e0 2024-03-30T13:14:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.716+0000 7f8a70c00640 1 -- 172.21.15.44:0/2713554116 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74059f00 con 0x56067a2ba2e0 2024-03-30T13:14:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.717+0000 7f8a863ff740 1 -- 172.21.15.44:0/2713554116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 msgr2=0x56067a2878e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.717+0000 7f8a863ff740 1 --2- 172.21.15.44:0/2713554116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 0x56067a2878e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8a74056360 tx=0x7f8a7405a600 comp rx=0 tx=0).stop 2024-03-30T13:14:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.717+0000 7f8a863ff740 1 -- 172.21.15.44:0/2713554116 shutdown_connections 2024-03-30T13:14:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.717+0000 7f8a863ff740 1 --2- 172.21.15.44:0/2713554116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 0x56067a2878e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.717+0000 7f8a863ff740 1 --2- 172.21.15.44:0/2713554116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262670 0x56067a2873a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.717+0000 7f8a863ff740 1 --2- 172.21.15.44:0/2713554116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262290 0x56067a2aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.717+0000 7f8a863ff740 1 -- 172.21.15.44:0/2713554116 >> 172.21.15.44:0/2713554116 conn(0x56067a228be0 msgr2=0x56067a2578d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.717+0000 7f8a863ff740 1 -- 172.21.15.44:0/2713554116 shutdown_connections 2024-03-30T13:14:38.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.717+0000 7f8a863ff740 1 -- 172.21.15.44:0/2713554116 wait complete. 2024-03-30T13:14:38.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.718+0000 7f8a863ff740 1 -- start start 2024-03-30T13:14:38.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.718+0000 7f8a863ff740 1 Processor -- start 2024-03-30T13:14:38.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a863ff740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262290 0x56067a321ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a863ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262670 0x56067a2b6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a863ff740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 0x56067a2a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a863ff740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c161320 con 0x56067a2ba2e0 2024-03-30T13:14:38.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a863ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56067a2a7c10 con 0x56067a262670 2024-03-30T13:14:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a863ff740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x56067a25fd00 con 0x56067a262290 2024-03-30T13:14:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a863ff740 10 client.0 _ll_register_callbacks cb 0x7f8a640096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a81800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 0x56067a2a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a81800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 0x56067a2a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33226/0 (socket says 172.21.15.44:33226) 2024-03-30T13:14:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a81800640 1 -- 172.21.15.44:0/3201897387 learned_addr learned my addr 172.21.15.44:0/3201897387 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a80e00640 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262290 0x56067a321ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a7be00640 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262670 0x56067a2b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a81800640 1 -- 172.21.15.44:0/3201897387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262290 msgr2=0x56067a321ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a81800640 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262290 0x56067a321ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a81800640 1 -- 172.21.15.44:0/3201897387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262670 msgr2=0x56067a2b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.719+0000 7f8a81800640 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262670 0x56067a2b6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.720+0000 7f8a81800640 1 -- 172.21.15.44:0/3201897387 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56067a2b6ab0 con 0x56067a2ba2e0 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.720+0000 7f8a81800640 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 0x56067a2a05f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8a7405a7b0 tx=0x7f8a74015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c7bef1aa746aa5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.720+0000 7f8a6a000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.720+0000 7f8a6a000640 1 -- 172.21.15.44:0/3201897387 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74077060 con 0x56067a2ba2e0 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.720+0000 7f8a6a000640 1 -- 172.21.15.44:0/3201897387 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f8a74056570 con 0x56067a2ba2e0 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.720+0000 7f8a863ff740 1 -- 172.21.15.44:0/3201897387 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a74062ae0 con 0x56067a2ba2e0 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.720+0000 7f8a6a000640 1 -- 172.21.15.44:0/3201897387 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8a7408a260 con 0x56067a2ba2e0 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.720+0000 7f8a863ff740 10 client.5634 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.720+0000 7f8a863ff740 1 -- 172.21.15.44:0/3201897387 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x56067a25fa40 con 0x56067a2ba2e0 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.720+0000 7f8a6a000640 1 -- 172.21.15.44:0/3201897387 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a74062ae0 con 0x56067a2ba2e0 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.721+0000 7f8a6a000640 1 -- 172.21.15.44:0/3201897387 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f8a74062650 con 0x56067a2ba2e0 2024-03-30T13:14:38.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.721+0000 7f8a863ff740 10 client.5634 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:38.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.721+0000 7f8a863ff740 10 client.5634 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:38.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.721+0000 7f8a863ff740 20 client.5634 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:38.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.721+0000 7f8a863ff740 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56067a28e0c0 0x56067a29c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.721+0000 7f8a863ff740 4 client.5634 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628281}] 2024-03-30T13:14:38.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.721+0000 7f8a863ff740 1 -- 172.21.15.44:0/3201897387 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628281}) -- 0x56067a1ccbc0 con 0x56067a28e0c0 2024-03-30T13:14:38.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.721+0000 7f8a80e00640 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56067a28e0c0 0x56067a29c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.721+0000 7f8a80e00640 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56067a28e0c0 0x56067a29c940 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39bdafe141d5fa36 server_cookie=1936c1764ed46ea in_seq=0 out_seq=0 2024-03-30T13:14:38.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.721+0000 7f8a6a000640 10 client.5634 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:38.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a6a000640 1 -- 172.21.15.44:0/3201897387 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4772 (crc 0 0 0) 0x56067a1ccbc0 con 0x56067a28e0c0 2024-03-30T13:14:38.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a6a000640 10 client.5634 handle_command_reply: tid=0 2024-03-30T13:14:38.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a863ff740 1 client.5634 shutdown 2024-03-30T13:14:38.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a863ff740 1 -- 172.21.15.44:0/3201897387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 msgr2=0x56067a2a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a863ff740 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 0x56067a2a05f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8a7405a7b0 tx=0x7f8a74015000 comp rx=0 tx=0).stop 2024-03-30T13:14:38.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a863ff740 1 -- 172.21.15.44:0/3201897387 shutdown_connections 2024-03-30T13:14:38.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a863ff740 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56067a28e0c0 0x56067a29c940 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a863ff740 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56067a2ba2e0 0x56067a2a05f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a863ff740 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067a262670 0x56067a2b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a863ff740 1 --2- 172.21.15.44:0/3201897387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56067a262290 0x56067a321ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a6a000640 0 client.5634 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a863ff740 1 -- 172.21.15.44:0/3201897387 >> 172.21.15.44:0/3201897387 conn(0x56067a228be0 msgr2=0x56067a2873a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a863ff740 1 -- 172.21.15.44:0/3201897387 shutdown_connections 2024-03-30T13:14:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a863ff740 1 -- 172.21.15.44:0/3201897387 wait complete. 2024-03-30T13:14:38.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.722+0000 7f8a863ff740 20 client.5634 trim_cache size 0 max 16384 2024-03-30T13:14:38.731 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:38.731 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ceph/Makefile", 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628281, 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.182038+0000", 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.045261+0000", 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:38.732 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 356, 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:38.733 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.045261+0000", 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:14:38.734 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 1 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:38.735 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 356, 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.182038+0000" 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 356, 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.182038+0000" 2024-03-30T13:14:38.736 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 136, 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 4, 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:38.737 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:38.738 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:38.739 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:38.740 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:38.741 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:38.742 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:38.743 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:38.744 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:14:38.745 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:38.746 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:38.746 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:38.746 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:38.746 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:14:38.746 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:38.746 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:38.746 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.723+0000 7f8a83800640 1 -- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8a5806c560 msgr2=0x7f8a5806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.723+0000 7f8a83800640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8a5806c560 0x7f8a5806ea20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c003eb0 tx=0x7f8a6c009040 comp rx=0 tx=0).stop 2024-03-30T13:14:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.723+0000 7f8a83800640 1 -- 172.21.15.44:0/3831268595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c0ba090 msgr2=0x7f8a7c1589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.723+0000 7f8a83800640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c0ba090 0x7f8a7c1589e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8a74007e70 tx=0x7f8a7400e4b0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.723+0000 7f8a83800640 1 -- 172.21.15.44:0/3831268595 shutdown_connections 2024-03-30T13:14:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.723+0000 7f8a83800640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c0ba090 0x7f8a7c1589e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.723+0000 7f8a83800640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8a5806c560 0x7f8a5806ea20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.723+0000 7f8a83800640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a7c0b73d0 0x7f8a7c158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.723+0000 7f8a83800640 1 --2- 172.21.15.44:0/3831268595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a7c0b5dc0 0x7f8a7c1f7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.723+0000 7f8a83800640 1 -- 172.21.15.44:0/3831268595 >> 172.21.15.44:0/3831268595 conn(0x7f8a7c0678f0 msgr2=0x7f8a7c0b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.723+0000 7f8a83800640 1 -- 172.21.15.44:0/3831268595 shutdown_connections 2024-03-30T13:14:38.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.723+0000 7f8a83800640 1 -- 172.21.15.44:0/3831268595 wait complete. 2024-03-30T13:14:38.751 DEBUG:tasks.cephfs.test_uninlining:getting inode info #3 of 23:1099511628287 2024-03-30T13:14:38.751 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628287 2024-03-30T13:14:38.752 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628287 2024-03-30T13:14:38.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.956+0000 7ff37f200640 1 Processor -- start 2024-03-30T13:14:38.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.956+0000 7ff37f200640 1 -- start start 2024-03-30T13:14:38.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.958+0000 7ff37f200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff3800d0b90 0x7ff3800d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.958+0000 7ff37f200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3800b54b0 con 0x7ff3800b4d00 2024-03-30T13:14:38.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.958+0000 7ff37f200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3800cfca0 con 0x7ff3800b4920 2024-03-30T13:14:38.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.958+0000 7ff37f200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff3800d0260 con 0x7ff3800d0b90 2024-03-30T13:14:38.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.958+0000 7ff377e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff3800b4d00 0x7ff3800d4ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36776/0 (socket says 172.21.15.44:36776) 2024-03-30T13:14:38.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.958+0000 7ff37e800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff3800d0b90 0x7ff3800d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.958+0000 7ff377e00640 1 -- 172.21.15.44:0/2964554330 learned_addr learned my addr 172.21.15.44:0/2964554330 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:38.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.959+0000 7ff37e800640 1 -- 172.21.15.44:0/2964554330 >> v1:172.21.15.151:6789/0 conn(0x7ff3800b4920 legacy=0x7ff3800b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.959+0000 7ff37e800640 1 -- 172.21.15.44:0/2964554330 >> v1:172.21.15.44:6789/0 conn(0x7ff3800b4d00 legacy=0x7ff3800d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.959+0000 7ff37d400640 1 -- 172.21.15.44:0/2964554330 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2328670200 0 0) 0x7ff368001110 con 0x7ff3800b4d00 2024-03-30T13:14:38.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.959+0000 7ff37e800640 1 -- 172.21.15.44:0/2964554330 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3800cff80 con 0x7ff3800d0b90 2024-03-30T13:14:38.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.960+0000 7ff37e800640 1 --2- 172.21.15.44:0/2964554330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800d0b90 0x7ff3800d1040 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff378009d90 tx=0x7ff37802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9ab03a02e5f2ea server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.961+0000 7ff37d400640 1 -- 172.21.15.44:0/2964554330 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378039070 con 0x7ff3800d0b90 2024-03-30T13:14:38.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.961+0000 7ff37d400640 1 -- 172.21.15.44:0/2964554330 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37802cc60 con 0x7ff3800d0b90 2024-03-30T13:14:38.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.961+0000 7ff37d400640 1 -- 172.21.15.44:0/2964554330 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378034660 con 0x7ff3800d0b90 2024-03-30T13:14:38.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.961+0000 7ff37f200640 1 -- 172.21.15.44:0/2964554330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800d0b90 msgr2=0x7ff3800d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.961+0000 7ff37f200640 1 --2- 172.21.15.44:0/2964554330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800d0b90 0x7ff3800d1040 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff378009d90 tx=0x7ff37802beb0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.961+0000 7ff37f200640 1 -- 172.21.15.44:0/2964554330 shutdown_connections 2024-03-30T13:14:38.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.961+0000 7ff37f200640 1 --2- 172.21.15.44:0/2964554330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800d0b90 0x7ff3800d1040 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.961+0000 7ff37f200640 1 -- 172.21.15.44:0/2964554330 >> 172.21.15.44:0/2964554330 conn(0x7ff38009d4e0 msgr2=0x7ff3800d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.962+0000 7ff37f200640 1 -- 172.21.15.44:0/2964554330 shutdown_connections 2024-03-30T13:14:38.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.962+0000 7ff37f200640 1 -- 172.21.15.44:0/2964554330 wait complete. 2024-03-30T13:14:38.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.965+0000 7ff37f200640 1 Processor -- start 2024-03-30T13:14:38.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.965+0000 7ff37f200640 1 -- start start 2024-03-30T13:14:38.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.967+0000 7ff37f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b4920 0x7ff380153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.967+0000 7ff37f200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3800b4d00 0x7ff380153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.967+0000 7ff37f200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3800d0b90 0x7ff380153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.967+0000 7ff37f200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3800cf8c0 con 0x7ff3800b4920 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.967+0000 7ff37f200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff3800d2180 con 0x7ff3800b4d00 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.967+0000 7ff37f200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff3800cfa40 con 0x7ff3800d0b90 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.967+0000 7ff37de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b4920 0x7ff380153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.967+0000 7ff37de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b4920 0x7ff380153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33250/0 (socket says 172.21.15.44:33250) 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.967+0000 7ff37de00640 1 -- 172.21.15.44:0/2995940704 learned_addr learned my addr 172.21.15.44:0/2995940704 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff37e800640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3800d0b90 0x7ff380153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff37de00640 1 -- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3800d0b90 msgr2=0x7ff380153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff377e00640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3800b4d00 0x7ff380153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff37de00640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3800d0b90 0x7ff380153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff37de00640 1 -- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3800b4d00 msgr2=0x7ff380153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff37de00640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3800b4d00 0x7ff380153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff37de00640 1 -- 172.21.15.44:0/2995940704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff380153070 con 0x7ff3800b4920 2024-03-30T13:14:38.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff37de00640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b4920 0x7ff380153570 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff37000c400 tx=0x7ff37000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff376000640 1 -- 172.21.15.44:0/2995940704 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370017070 con 0x7ff3800b4920 2024-03-30T13:14:38.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff376000640 1 -- 172.21.15.44:0/2995940704 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3700052d0 con 0x7ff3800b4920 2024-03-30T13:14:38.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff376000640 1 -- 172.21.15.44:0/2995940704 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370003830 con 0x7ff3800b4920 2024-03-30T13:14:38.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff37f200640 1 -- 172.21.15.44:0/2995940704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3800a1530 con 0x7ff3800b4920 2024-03-30T13:14:38.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.968+0000 7ff37f200640 1 -- 172.21.15.44:0/2995940704 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3800a1af0 con 0x7ff3800b4920 2024-03-30T13:14:38.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.971+0000 7ff376000640 1 -- 172.21.15.44:0/2995940704 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff37001a070 con 0x7ff3800b4920 2024-03-30T13:14:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.972+0000 7ff376000640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff35c06c530 0x7ff35c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.972+0000 7ff376000640 1 -- 172.21.15.44:0/2995940704 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7ff37008ac20 con 0x7ff3800b4920 2024-03-30T13:14:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.972+0000 7ff377e00640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff35c06c530 0x7ff35c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.973+0000 7ff387783740 1 Processor -- start 2024-03-30T13:14:38.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.973+0000 7ff387783740 1 -- start start 2024-03-30T13:14:38.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.974+0000 7ff377e00640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff35c06c530 0x7ff35c06e9f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff380152f40 tx=0x7ff368009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.974+0000 7ff387783740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 0x5557bb5c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.974+0000 7ff387783740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb5c64e0 0x5557bb59e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.974+0000 7ff387783740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 0x5557bb59e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.974+0000 7ff387783740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5557bb502330 con 0x5557bb59f850 2024-03-30T13:14:38.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.974+0000 7ff387783740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5557bb4aa620 con 0x5557bb59f470 2024-03-30T13:14:38.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.974+0000 7ff387783740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5557bb4fe440 con 0x5557bb5c64e0 2024-03-30T13:14:38.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.974+0000 7ff37e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 0x5557bb59e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.974+0000 7ff37e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 0x5557bb59e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33256/0 (socket says 172.21.15.44:33256) 2024-03-30T13:14:38.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.974+0000 7ff37e800640 1 -- 172.21.15.44:0/2176103967 learned_addr learned my addr 172.21.15.44:0/2176103967 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.974+0000 7ff37de00640 1 --2- 172.21.15.44:0/2176103967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 0x5557bb5c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.975+0000 7ff377e00640 1 --2- 172.21.15.44:0/2176103967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb5c64e0 0x5557bb59e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.975+0000 7ff37e800640 1 -- 172.21.15.44:0/2176103967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb5c64e0 msgr2=0x5557bb59e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.975+0000 7ff37e800640 1 --2- 172.21.15.44:0/2176103967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb5c64e0 0x5557bb59e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.975+0000 7ff37e800640 1 -- 172.21.15.44:0/2176103967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 msgr2=0x5557bb5c5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.975+0000 7ff37e800640 1 --2- 172.21.15.44:0/2176103967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 0x5557bb5c5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.975+0000 7ff37e800640 1 -- 172.21.15.44:0/2176103967 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557bb2e2920 con 0x5557bb59f850 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.975+0000 7ff37e800640 1 --2- 172.21.15.44:0/2176103967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 0x5557bb59e9f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff37802c4c0 tx=0x7ff37802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2a9e6b6765eff server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.975+0000 7ff36e600640 1 -- 172.21.15.44:0/2176103967 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378039070 con 0x5557bb59f850 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.975+0000 7ff36e600640 1 -- 172.21.15.44:0/2176103967 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff378045070 con 0x5557bb59f850 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.975+0000 7ff36e600640 1 -- 172.21.15.44:0/2176103967 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378040680 con 0x5557bb59f850 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.976+0000 7ff387783740 1 -- 172.21.15.44:0/2176103967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 msgr2=0x5557bb59e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.976+0000 7ff387783740 1 --2- 172.21.15.44:0/2176103967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 0x5557bb59e9f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff37802c4c0 tx=0x7ff37802e000 comp rx=0 tx=0).stop 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.976+0000 7ff387783740 1 -- 172.21.15.44:0/2176103967 shutdown_connections 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.976+0000 7ff387783740 1 --2- 172.21.15.44:0/2176103967 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 0x5557bb59e9f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.976+0000 7ff387783740 1 --2- 172.21.15.44:0/2176103967 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb5c64e0 0x5557bb59e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.976+0000 7ff387783740 1 --2- 172.21.15.44:0/2176103967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 0x5557bb5c5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.976+0000 7ff387783740 1 -- 172.21.15.44:0/2176103967 >> 172.21.15.44:0/2176103967 conn(0x5557bb565be0 msgr2=0x5557bb5e4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.976+0000 7ff387783740 1 -- 172.21.15.44:0/2176103967 shutdown_connections 2024-03-30T13:14:38.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.976+0000 7ff387783740 1 -- 172.21.15.44:0/2176103967 wait complete. 2024-03-30T13:14:38.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.977+0000 7ff387783740 1 -- start start 2024-03-30T13:14:38.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.977+0000 7ff387783740 1 Processor -- start 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.978+0000 7ff387783740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 0x5557bb5e6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.978+0000 7ff387783740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb59f850 0x5557bb5e3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.978+0000 7ff387783740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 0x5557bb5cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.978+0000 7ff387783740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5557bb5c5b10 con 0x5557bb5bda40 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.978+0000 7ff387783740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5557bb4bd9d0 con 0x5557bb59f470 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.978+0000 7ff387783740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5557bb5be890 con 0x5557bb59f850 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.978+0000 7ff387783740 10 client.0 _ll_register_callbacks cb 0x5557bb4f9fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.979+0000 7ff37e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 0x5557bb5cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.979+0000 7ff37e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 0x5557bb5cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33270/0 (socket says 172.21.15.44:33270) 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.979+0000 7ff37e800640 1 -- 172.21.15.44:0/3443950256 learned_addr learned my addr 172.21.15.44:0/3443950256 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.979+0000 7ff37de00640 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 0x5557bb5e6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.979+0000 7ff377e00640 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb59f850 0x5557bb5e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.979+0000 7ff37e800640 1 -- 172.21.15.44:0/3443950256 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb59f850 msgr2=0x5557bb5e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.979+0000 7ff37e800640 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb59f850 0x5557bb5e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.979+0000 7ff37e800640 1 -- 172.21.15.44:0/3443950256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 msgr2=0x5557bb5e6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:38.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.979+0000 7ff37e800640 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 0x5557bb5e6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.979+0000 7ff37e800640 1 -- 172.21.15.44:0/3443950256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557bb1d6210 con 0x5557bb5bda40 2024-03-30T13:14:38.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.980+0000 7ff37e800640 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 0x5557bb5cc5c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff378009d90 tx=0x7ff37802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdbf342e3125bf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:38.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.980+0000 7ff362a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:38.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.980+0000 7ff362a00640 1 -- 172.21.15.44:0/3443950256 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378039050 con 0x5557bb5bda40 2024-03-30T13:14:38.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.980+0000 7ff362a00640 1 -- 172.21.15.44:0/3443950256 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7ff378040890 con 0x5557bb5bda40 2024-03-30T13:14:38.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.980+0000 7ff387783740 1 -- 172.21.15.44:0/3443950256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff378045070 con 0x5557bb5bda40 2024-03-30T13:14:38.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.980+0000 7ff362a00640 1 -- 172.21.15.44:0/3443950256 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff378059050 con 0x5557bb5bda40 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.980+0000 7ff387783740 10 client.5649 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.980+0000 7ff387783740 1 -- 172.21.15.44:0/3443950256 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5557bb3430b0 con 0x5557bb5bda40 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.981+0000 7ff362a00640 1 -- 172.21.15.44:0/3443950256 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff378045070 con 0x5557bb5bda40 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.981+0000 7ff362a00640 1 -- 172.21.15.44:0/3443950256 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7ff37805c020 con 0x5557bb5bda40 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.981+0000 7ff387783740 10 client.5649 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.981+0000 7ff387783740 10 client.5649 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.981+0000 7ff387783740 20 client.5649 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.981+0000 7ff387783740 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5557bb5f4530 0x5557bb5f4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.981+0000 7ff387783740 4 client.5649 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.981+0000 7ff387783740 1 -- 172.21.15.44:0/3443950256 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557bb50f870 con 0x5557bb5f4530 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.981+0000 7ff37de00640 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5557bb5f4530 0x5557bb5f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.982+0000 7ff37de00640 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5557bb5f4530 0x5557bb5f4960 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b0bb8b210e83fe9 server_cookie=de781e86465b1b11 in_seq=0 out_seq=0 2024-03-30T13:14:38.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.982+0000 7ff362a00640 10 client.5649 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff362a00640 1 -- 172.21.15.44:0/3443950256 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5557bb50f870 con 0x5557bb5f4530 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff362a00640 10 client.5649 handle_command_reply: tid=0 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff387783740 1 client.5649 shutdown 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff387783740 1 -- 172.21.15.44:0/3443950256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 msgr2=0x5557bb5cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff387783740 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 0x5557bb5cc5c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff378009d90 tx=0x7ff37802e070 comp rx=0 tx=0).stop 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff387783740 1 -- 172.21.15.44:0/3443950256 shutdown_connections 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff387783740 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5557bb5f4530 0x5557bb5f4960 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff387783740 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 0x5557bb5cc5c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff387783740 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb59f850 0x5557bb5e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff387783740 1 --2- 172.21.15.44:0/3443950256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 0x5557bb5e6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff387783740 1 -- 172.21.15.44:0/3443950256 >> 172.21.15.44:0/3443950256 conn(0x5557bb565be0 msgr2=0x5557bb598b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff362a00640 0 client.5649 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff387783740 1 -- 172.21.15.44:0/3443950256 shutdown_connections 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff387783740 1 -- 172.21.15.44:0/3443950256 wait complete. 2024-03-30T13:14:38.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.983+0000 7ff387783740 20 client.5649 trim_cache size 0 max 16384 2024-03-30T13:14:39.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.999+0000 7ff387783740 1 Processor -- start 2024-03-30T13:14:39.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:38.999+0000 7ff387783740 1 -- start start 2024-03-30T13:14:39.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.000+0000 7ff387783740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 0x5557bb5c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.000+0000 7ff387783740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 0x5557bb5d9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.000+0000 7ff387783740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb5bda40 0x5557bb5da060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.000+0000 7ff387783740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3802053b0 con 0x5557bb59f850 2024-03-30T13:14:39.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.000+0000 7ff387783740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff380204410 con 0x5557bb59f470 2024-03-30T13:14:39.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.000+0000 7ff387783740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff3800b9250 con 0x5557bb5bda40 2024-03-30T13:14:39.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.000+0000 7ff377e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 0x5557bb5d9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.001+0000 7ff377e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 0x5557bb5d9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33274/0 (socket says 172.21.15.44:33274) 2024-03-30T13:14:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.001+0000 7ff377e00640 1 -- 172.21.15.44:0/1163358895 learned_addr learned my addr 172.21.15.44:0/1163358895 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.001+0000 7ff37de00640 1 --2- 172.21.15.44:0/1163358895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 0x5557bb5c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.001+0000 7ff377e00640 1 -- 172.21.15.44:0/1163358895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb5bda40 msgr2=0x5557bb5da060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.001+0000 7ff377e00640 1 --2- 172.21.15.44:0/1163358895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb5bda40 0x5557bb5da060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.001+0000 7ff377e00640 1 -- 172.21.15.44:0/1163358895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 msgr2=0x5557bb5c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.001+0000 7ff377e00640 1 --2- 172.21.15.44:0/1163358895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 0x5557bb5c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.001+0000 7ff377e00640 1 -- 172.21.15.44:0/1163358895 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557bb1af2d0 con 0x5557bb59f850 2024-03-30T13:14:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.001+0000 7ff377e00640 1 --2- 172.21.15.44:0/1163358895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 0x5557bb5d9b20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff368007290 tx=0x7ff368011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198907c100945ca2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.001+0000 7ff36dc00640 1 -- 172.21.15.44:0/1163358895 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff368025070 con 0x5557bb59f850 2024-03-30T13:14:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.001+0000 7ff36dc00640 1 -- 172.21.15.44:0/1163358895 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36800d7a0 con 0x5557bb59f850 2024-03-30T13:14:39.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.001+0000 7ff36dc00640 1 -- 172.21.15.44:0/1163358895 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36800db50 con 0x5557bb59f850 2024-03-30T13:14:39.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.002+0000 7ff387783740 1 -- 172.21.15.44:0/1163358895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 msgr2=0x5557bb5d9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.002+0000 7ff387783740 1 --2- 172.21.15.44:0/1163358895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 0x5557bb5d9b20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff368007290 tx=0x7ff368011000 comp rx=0 tx=0).stop 2024-03-30T13:14:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.002+0000 7ff387783740 1 -- 172.21.15.44:0/1163358895 shutdown_connections 2024-03-30T13:14:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.002+0000 7ff387783740 1 --2- 172.21.15.44:0/1163358895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb5bda40 0x5557bb5da060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.002+0000 7ff387783740 1 --2- 172.21.15.44:0/1163358895 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb59f850 0x5557bb5d9b20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.002+0000 7ff387783740 1 --2- 172.21.15.44:0/1163358895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f470 0x5557bb5c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.002+0000 7ff387783740 1 -- 172.21.15.44:0/1163358895 >> 172.21.15.44:0/1163358895 conn(0x5557bb565be0 msgr2=0x5557bb5bccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.002+0000 7ff387783740 1 -- 172.21.15.44:0/1163358895 shutdown_connections 2024-03-30T13:14:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.002+0000 7ff387783740 1 -- 172.21.15.44:0/1163358895 wait complete. 2024-03-30T13:14:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.003+0000 7ff387783740 1 -- start start 2024-03-30T13:14:39.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.003+0000 7ff387783740 1 Processor -- start 2024-03-30T13:14:39.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.004+0000 7ff387783740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb59f470 0x5557bb5c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.004+0000 7ff387783740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f850 0x5557bb65fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.004+0000 7ff387783740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 0x5557bb5c3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.004+0000 7ff387783740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff380203e40 con 0x5557bb5bda40 2024-03-30T13:14:39.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.004+0000 7ff387783740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5557bb663d10 con 0x5557bb59f850 2024-03-30T13:14:39.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.004+0000 7ff387783740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5557bb594b10 con 0x5557bb59f470 2024-03-30T13:14:39.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.004+0000 7ff387783740 10 client.0 _ll_register_callbacks cb 0x7ff378009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:39.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.004+0000 7ff37e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 0x5557bb5c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.004+0000 7ff37e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 0x5557bb5c3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33278/0 (socket says 172.21.15.44:33278) 2024-03-30T13:14:39.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.004+0000 7ff37e800640 1 -- 172.21.15.44:0/324916214 learned_addr learned my addr 172.21.15.44:0/324916214 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.005+0000 7ff37e800640 1 -- 172.21.15.44:0/324916214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb59f470 msgr2=0x5557bb5c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.005+0000 7ff37e800640 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb59f470 0x5557bb5c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.005+0000 7ff377e00640 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f850 0x5557bb65fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.005+0000 7ff37e800640 1 -- 172.21.15.44:0/324916214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f850 msgr2=0x5557bb65fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.005+0000 7ff37e800640 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f850 0x5557bb65fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.005+0000 7ff37e800640 1 -- 172.21.15.44:0/324916214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557bb661050 con 0x5557bb5bda40 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.005+0000 7ff377e00640 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f850 0x5557bb65fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.005+0000 7ff37e800640 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 0x5557bb5c3760 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff37802c5b0 tx=0x7ff378004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2c0d91edaefa03 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.005+0000 7ff362a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.005+0000 7ff362a00640 1 -- 172.21.15.44:0/324916214 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37804d070 con 0x5557bb5bda40 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.005+0000 7ff362a00640 1 -- 172.21.15.44:0/324916214 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7ff378003b90 con 0x5557bb5bda40 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.005+0000 7ff387783740 1 -- 172.21.15.44:0/324916214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff36800d7a0 con 0x5557bb5bda40 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.006+0000 7ff362a00640 1 -- 172.21.15.44:0/324916214 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff378039040 con 0x5557bb5bda40 2024-03-30T13:14:39.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.006+0000 7ff387783740 10 client.5655 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:39.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.006+0000 7ff387783740 1 -- 172.21.15.44:0/324916214 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5557bb5c3ca0 con 0x5557bb5bda40 2024-03-30T13:14:39.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.006+0000 7ff362a00640 1 -- 172.21.15.44:0/324916214 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36800d7a0 con 0x5557bb5bda40 2024-03-30T13:14:39.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.006+0000 7ff362a00640 1 -- 172.21.15.44:0/324916214 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7ff37805c040 con 0x5557bb5bda40 2024-03-30T13:14:39.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.006+0000 7ff387783740 10 client.5655 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:39.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.006+0000 7ff387783740 10 client.5655 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:39.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.006+0000 7ff387783740 20 client.5655 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:39.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.006+0000 7ff387783740 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5557bb598f00 0x5557bb5e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.006+0000 7ff387783740 4 client.5655 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628287}] 2024-03-30T13:14:39.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.006+0000 7ff387783740 1 -- 172.21.15.44:0/324916214 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628287}) -- 0x5557bb509bc0 con 0x5557bb598f00 2024-03-30T13:14:39.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.007+0000 7ff37de00640 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5557bb598f00 0x5557bb5e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.007+0000 7ff37de00640 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5557bb598f00 0x5557bb5e50a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb17582666def1e9 server_cookie=1629714f1cf68638 in_seq=0 out_seq=0 2024-03-30T13:14:39.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.007+0000 7ff362a00640 10 client.5655 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.007+0000 7ff362a00640 1 -- 172.21.15.44:0/324916214 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4333 (crc 0 0 0) 0x5557bb509bc0 con 0x5557bb598f00 2024-03-30T13:14:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff362a00640 10 client.5655 handle_command_reply: tid=0 2024-03-30T13:14:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff387783740 1 client.5655 shutdown 2024-03-30T13:14:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff387783740 1 -- 172.21.15.44:0/324916214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 msgr2=0x5557bb5c3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff387783740 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 0x5557bb5c3760 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff37802c5b0 tx=0x7ff378004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff387783740 1 -- 172.21.15.44:0/324916214 shutdown_connections 2024-03-30T13:14:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff387783740 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5557bb598f00 0x5557bb5e50a0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff387783740 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5557bb5bda40 0x5557bb5c3760 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff387783740 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5557bb59f850 0x5557bb65fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff387783740 1 --2- 172.21.15.44:0/324916214 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5557bb59f470 0x5557bb5c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff387783740 1 -- 172.21.15.44:0/324916214 >> 172.21.15.44:0/324916214 conn(0x5557bb565be0 msgr2=0x5557bb5e7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff362a00640 0 client.5655 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff387783740 1 -- 172.21.15.44:0/324916214 shutdown_connections 2024-03-30T13:14:39.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff387783740 1 -- 172.21.15.44:0/324916214 wait complete. 2024-03-30T13:14:39.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.008+0000 7ff387783740 20 client.5655 trim_cache size 0 max 16384 2024-03-30T13:14:39.017 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:39.017 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ceph/ceph_frag.c", 2024-03-30T13:14:39.017 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628287, 2024-03-30T13:14:39.017 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:39.017 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.204923+0000", 2024-03-30T13:14:39.017 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.066261+0000", 2024-03-30T13:14:39.017 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:39.017 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:39.018 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:39.018 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:39.018 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:39.018 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:39.018 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:39.018 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:39.018 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:39.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.018 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:39.018 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:39.018 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:39.018 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 401, 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.066261+0000", 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:39.019 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 1 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:39.020 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 401, 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.204923+0000" 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 401, 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:39.021 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.204923+0000" 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 152, 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 16, 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:39.022 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:39.023 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 1, 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:39.024 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 1, 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 1, 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 1, 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 6, 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:39.025 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:14:39.026 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 1, 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:39.027 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.028 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:39.029 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:39.030 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:39.030 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:39.030 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.009+0000 7ff37f200640 1 -- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff35c06c530 msgr2=0x7ff35c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.009+0000 7ff37f200640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff35c06c530 0x7ff35c06e9f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff380152f40 tx=0x7ff368009040 comp rx=0 tx=0).stop 2024-03-30T13:14:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.009+0000 7ff37f200640 1 -- 172.21.15.44:0/2995940704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b4920 msgr2=0x7ff380153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.009+0000 7ff37f200640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b4920 0x7ff380153570 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff37000c400 tx=0x7ff37000c8c0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.009+0000 7ff37f200640 1 -- 172.21.15.44:0/2995940704 shutdown_connections 2024-03-30T13:14:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.009+0000 7ff37f200640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3800d0b90 0x7ff380153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.009+0000 7ff37f200640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff35c06c530 0x7ff35c06e9f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.009+0000 7ff37f200640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3800b4d00 0x7ff380153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.009+0000 7ff37f200640 1 --2- 172.21.15.44:0/2995940704 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3800b4920 0x7ff380153570 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.009+0000 7ff37f200640 1 -- 172.21.15.44:0/2995940704 >> 172.21.15.44:0/2995940704 conn(0x7ff38009d4e0 msgr2=0x7ff3800b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.009+0000 7ff37f200640 1 -- 172.21.15.44:0/2995940704 shutdown_connections 2024-03-30T13:14:39.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.009+0000 7ff37f200640 1 -- 172.21.15.44:0/2995940704 wait complete. 2024-03-30T13:14:39.032 DEBUG:tasks.cephfs.test_uninlining:getting inode info #4 of 23:1099511628294 2024-03-30T13:14:39.032 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628294 2024-03-30T13:14:39.033 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628294 2024-03-30T13:14:39.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.244+0000 7f7852a00640 1 Processor -- start 2024-03-30T13:14:39.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.245+0000 7f7852a00640 1 -- start start 2024-03-30T13:14:39.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.246+0000 7f7852a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f784c15d5c0 0x7f784c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.246+0000 7f7852a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784c0cc970 con 0x7f784c145d70 2024-03-30T13:14:39.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.246+0000 7f7852a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784c0ccc50 con 0x7f784c160880 2024-03-30T13:14:39.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.246+0000 7f7852a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f784c146150 con 0x7f784c15d5c0 2024-03-30T13:14:39.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.247+0000 7f784be00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f784c145d70 0x7f784c0cfd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36778/0 (socket says 172.21.15.44:36778) 2024-03-30T13:14:39.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.247+0000 7f7850a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f784c15d5c0 0x7f784c0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.247+0000 7f784be00640 1 -- 172.21.15.44:0/1122997039 learned_addr learned my addr 172.21.15.44:0/1122997039 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.247+0000 7f7850a00640 1 -- 172.21.15.44:0/1122997039 >> v1:172.21.15.151:6789/0 conn(0x7f784c160880 legacy=0x7f784c15ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.247+0000 7f7850a00640 1 -- 172.21.15.44:0/1122997039 >> v1:172.21.15.44:6789/0 conn(0x7f784c145d70 legacy=0x7f784c0cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.247+0000 7f7850a00640 1 -- 172.21.15.44:0/1122997039 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c0d0460 con 0x7f784c15d5c0 2024-03-30T13:14:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.247+0000 7f784aa00640 1 -- 172.21.15.44:0/1122997039 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3593227142 0 0) 0x7f784c0cc970 con 0x7f784c145d70 2024-03-30T13:14:39.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.249+0000 7f7850a00640 1 --2- 172.21.15.44:0/1122997039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f784c15d5c0 0x7f784c0ce490 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7844009d90 tx=0x7f784402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36e6c15ff3dd950 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.249+0000 7f784aa00640 1 -- 172.21.15.44:0/1122997039 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844039070 con 0x7f784c15d5c0 2024-03-30T13:14:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.249+0000 7f784aa00640 1 -- 172.21.15.44:0/1122997039 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784402cc60 con 0x7f784c15d5c0 2024-03-30T13:14:39.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.249+0000 7f784aa00640 1 -- 172.21.15.44:0/1122997039 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844034660 con 0x7f784c15d5c0 2024-03-30T13:14:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.250+0000 7f7852a00640 1 -- 172.21.15.44:0/1122997039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f784c15d5c0 msgr2=0x7f784c0ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.250+0000 7f7852a00640 1 --2- 172.21.15.44:0/1122997039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f784c15d5c0 0x7f784c0ce490 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7844009d90 tx=0x7f784402beb0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.250+0000 7f7852a00640 1 -- 172.21.15.44:0/1122997039 shutdown_connections 2024-03-30T13:14:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.250+0000 7f7852a00640 1 --2- 172.21.15.44:0/1122997039 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f784c15d5c0 0x7f784c0ce490 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.250+0000 7f7852a00640 1 -- 172.21.15.44:0/1122997039 >> 172.21.15.44:0/1122997039 conn(0x7f784c0b3e70 msgr2=0x7f784c0b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.250+0000 7f7852a00640 1 -- 172.21.15.44:0/1122997039 shutdown_connections 2024-03-30T13:14:39.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.250+0000 7f7852a00640 1 -- 172.21.15.44:0/1122997039 wait complete. 2024-03-30T13:14:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.251+0000 7f7852a00640 1 Processor -- start 2024-03-30T13:14:39.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.252+0000 7f7852a00640 1 -- start start 2024-03-30T13:14:39.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7852a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f784c145d70 0x7f784c156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7852a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f784c15d5c0 0x7f784c1f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7852a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f784c160880 0x7f784c06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7852a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f784c0ccf30 con 0x7f784c160880 2024-03-30T13:14:39.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7852a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f784c15ca20 con 0x7f784c15d5c0 2024-03-30T13:14:39.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7852a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f784c0ceb90 con 0x7f784c145d70 2024-03-30T13:14:39.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7850a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f784c160880 0x7f784c06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7850a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f784c160880 0x7f784c06d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33290/0 (socket says 172.21.15.44:33290) 2024-03-30T13:14:39.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7850a00640 1 -- 172.21.15.44:0/3698091342 learned_addr learned my addr 172.21.15.44:0/3698091342 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f784be00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f784c145d70 0x7f784c156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f784b400640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f784c15d5c0 0x7f784c1f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7850a00640 1 -- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f784c145d70 msgr2=0x7f784c156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7850a00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f784c145d70 0x7f784c156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7850a00640 1 -- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f784c15d5c0 msgr2=0x7f784c1f38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.253+0000 7f7850a00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f784c15d5c0 0x7f784c1f38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.254+0000 7f7850a00640 1 -- 172.21.15.44:0/3698091342 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c154840 con 0x7f784c160880 2024-03-30T13:14:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.254+0000 7f7850a00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f784c160880 0x7f784c06d6e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7844037040 tx=0x7f7844004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.254+0000 7f7843e00640 1 -- 172.21.15.44:0/3698091342 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844039050 con 0x7f784c160880 2024-03-30T13:14:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.254+0000 7f7843e00640 1 -- 172.21.15.44:0/3698091342 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784403a040 con 0x7f784c160880 2024-03-30T13:14:39.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.254+0000 7f7843e00640 1 -- 172.21.15.44:0/3698091342 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784403e610 con 0x7f784c160880 2024-03-30T13:14:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.254+0000 7f7852a00640 1 -- 172.21.15.44:0/3698091342 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784c1554b0 con 0x7f784c160880 2024-03-30T13:14:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.254+0000 7f7852a00640 1 -- 172.21.15.44:0/3698091342 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784c155a70 con 0x7f784c160880 2024-03-30T13:14:39.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.257+0000 7f7843e00640 1 -- 172.21.15.44:0/3698091342 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7844047020 con 0x7f784c160880 2024-03-30T13:14:39.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.258+0000 7f7843e00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f782c06c530 0x7f782c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.258+0000 7f7843e00640 1 -- 172.21.15.44:0/3698091342 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f78440adca0 con 0x7f784c160880 2024-03-30T13:14:39.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.258+0000 7f784be00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f782c06c530 0x7f782c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.258+0000 7f78557cf740 1 Processor -- start 2024-03-30T13:14:39.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.258+0000 7f78557cf740 1 -- start start 2024-03-30T13:14:39.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.259+0000 7f78557cf740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959edf290 0x559959f05dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.259+0000 7f784be00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f782c06c530 0x7f782c06e9f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f783c000f60 tx=0x7f783c007b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f78557cf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959f06300 0x559959ede2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f78557cf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 0x559959ede810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f78557cf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559959e42330 con 0x559959f06300 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f78557cf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559959dea620 con 0x559959edf670 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f78557cf740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x559959e3e440 con 0x559959edf290 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f784b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959f06300 0x559959ede2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f784b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959f06300 0x559959ede2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33292/0 (socket says 172.21.15.44:33292) 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f784b400640 1 -- 172.21.15.44:0/3101335789 learned_addr learned my addr 172.21.15.44:0/3101335789 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f784be00640 1 --2- 172.21.15.44:0/3101335789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959edf290 0x559959f05dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f7850a00640 1 --2- 172.21.15.44:0/3101335789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 0x559959ede810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f784b400640 1 -- 172.21.15.44:0/3101335789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959edf290 msgr2=0x559959f05dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f784b400640 1 --2- 172.21.15.44:0/3101335789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959edf290 0x559959f05dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f784b400640 1 -- 172.21.15.44:0/3101335789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 msgr2=0x559959ede810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f784b400640 1 --2- 172.21.15.44:0/3101335789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 0x559959ede810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.260+0000 7f784b400640 1 -- 172.21.15.44:0/3101335789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559959c22920 con 0x559959f06300 2024-03-30T13:14:39.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.261+0000 7f784b400640 1 --2- 172.21.15.44:0/3101335789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959f06300 0x559959ede2d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f78380014a0 tx=0x7f7838001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4bc77774fb3450 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.261+0000 7f7837e00640 1 -- 172.21.15.44:0/3101335789 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838019070 con 0x559959f06300 2024-03-30T13:14:39.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.261+0000 7f7837e00640 1 -- 172.21.15.44:0/3101335789 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78380052e0 con 0x559959f06300 2024-03-30T13:14:39.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.261+0000 7f7837e00640 1 -- 172.21.15.44:0/3101335789 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838003810 con 0x559959f06300 2024-03-30T13:14:39.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.262+0000 7f78557cf740 1 -- 172.21.15.44:0/3101335789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959f06300 msgr2=0x559959ede2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.262+0000 7f78557cf740 1 --2- 172.21.15.44:0/3101335789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959f06300 0x559959ede2d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f78380014a0 tx=0x7f7838001960 comp rx=0 tx=0).stop 2024-03-30T13:14:39.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.262+0000 7f78557cf740 1 -- 172.21.15.44:0/3101335789 shutdown_connections 2024-03-30T13:14:39.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.262+0000 7f78557cf740 1 --2- 172.21.15.44:0/3101335789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 0x559959ede810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.262+0000 7f78557cf740 1 --2- 172.21.15.44:0/3101335789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959f06300 0x559959ede2d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.262+0000 7f78557cf740 1 --2- 172.21.15.44:0/3101335789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959edf290 0x559959f05dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.262+0000 7f78557cf740 1 -- 172.21.15.44:0/3101335789 >> 172.21.15.44:0/3101335789 conn(0x559959ea5be0 msgr2=0x559959f23fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.262+0000 7f78557cf740 1 -- 172.21.15.44:0/3101335789 shutdown_connections 2024-03-30T13:14:39.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.262+0000 7f78557cf740 1 -- 172.21.15.44:0/3101335789 wait complete. 2024-03-30T13:14:39.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.263+0000 7f78557cf740 1 -- start start 2024-03-30T13:14:39.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.263+0000 7f78557cf740 1 Processor -- start 2024-03-30T13:14:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.264+0000 7f78557cf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959efd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.264+0000 7f78557cf740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959edf670 0x559959f03f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.264+0000 7f78557cf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959f044c0 0x559959f27290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.264+0000 7f78557cf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559959f05930 con 0x559959edf290 2024-03-30T13:14:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.264+0000 7f78557cf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559959dfd9d0 con 0x559959f044c0 2024-03-30T13:14:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.264+0000 7f78557cf740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x559959efe6b0 con 0x559959edf670 2024-03-30T13:14:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.264+0000 7f78557cf740 10 client.0 _ll_register_callbacks cb 0x559959e39fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:39.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.264+0000 7f784be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959efd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.264+0000 7f784be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959efd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33302/0 (socket says 172.21.15.44:33302) 2024-03-30T13:14:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.264+0000 7f784be00640 1 -- 172.21.15.44:0/1573204725 learned_addr learned my addr 172.21.15.44:0/1573204725 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.265+0000 7f7850a00640 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959f044c0 0x559959f27290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.265+0000 7f784b400640 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959edf670 0x559959f03f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.265+0000 7f784be00640 1 -- 172.21.15.44:0/1573204725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959edf670 msgr2=0x559959f03f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.265+0000 7f784be00640 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959edf670 0x559959f03f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.265+0000 7f784be00640 1 -- 172.21.15.44:0/1573204725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959f044c0 msgr2=0x559959f27290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.265+0000 7f784be00640 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959f044c0 0x559959f27290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.265+0000 7f784be00640 1 -- 172.21.15.44:0/1573204725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559959b16210 con 0x559959edf290 2024-03-30T13:14:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.265+0000 7f7850a00640 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959f044c0 0x559959f27290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.265+0000 7f784be00640 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959efd150 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f783c001ce0 tx=0x7f783c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e6a44b26c03185 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.265+0000 7f7834c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.266+0000 7f7834c00640 1 -- 172.21.15.44:0/1573204725 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c027060 con 0x559959edf290 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.266+0000 7f7834c00640 1 -- 172.21.15.44:0/1573204725 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f783c010040 con 0x559959edf290 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.266+0000 7f78557cf740 1 -- 172.21.15.44:0/1573204725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78380052e0 con 0x559959edf290 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.266+0000 7f7834c00640 1 -- 172.21.15.44:0/1573204725 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f783c015110 con 0x559959edf290 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.266+0000 7f78557cf740 10 client.5670 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.266+0000 7f78557cf740 1 -- 172.21.15.44:0/1573204725 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x559959c830b0 con 0x559959edf290 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.266+0000 7f7834c00640 1 -- 172.21.15.44:0/1573204725 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78380052e0 con 0x559959edf290 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.266+0000 7f7834c00640 1 -- 172.21.15.44:0/1573204725 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f783c022430 con 0x559959edf290 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.266+0000 7f78557cf740 10 client.5670 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.266+0000 7f78557cf740 10 client.5670 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.267+0000 7f78557cf740 20 client.5670 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.267+0000 7f78557cf740 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x559959f0a5d0 0x559959f0aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.267+0000 7f78557cf740 4 client.5670 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:39.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.267+0000 7f78557cf740 1 -- 172.21.15.44:0/1573204725 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559959e4f870 con 0x559959f0a5d0 2024-03-30T13:14:39.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.267+0000 7f784b400640 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x559959f0a5d0 0x559959f0aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.267+0000 7f784b400640 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x559959f0a5d0 0x559959f0aa10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3d97e8c08a3a243 server_cookie=7b2ab3487417b30a in_seq=0 out_seq=0 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.267+0000 7f7834c00640 10 client.5670 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.268+0000 7f7834c00640 1 -- 172.21.15.44:0/1573204725 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x559959e4f870 con 0x559959f0a5d0 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.268+0000 7f7834c00640 10 client.5670 handle_command_reply: tid=0 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.268+0000 7f78557cf740 1 client.5670 shutdown 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.268+0000 7f78557cf740 1 -- 172.21.15.44:0/1573204725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 msgr2=0x559959efd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.268+0000 7f78557cf740 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959efd150 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f783c001ce0 tx=0x7f783c011000 comp rx=0 tx=0).stop 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.269+0000 7f78557cf740 1 -- 172.21.15.44:0/1573204725 shutdown_connections 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.269+0000 7f78557cf740 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x559959f0a5d0 0x559959f0aa10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.269+0000 7f78557cf740 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959f044c0 0x559959f27290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.269+0000 7f78557cf740 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959edf670 0x559959f03f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.269+0000 7f78557cf740 1 --2- 172.21.15.44:0/1573204725 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959efd150 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.269+0000 7f78557cf740 1 -- 172.21.15.44:0/1573204725 >> 172.21.15.44:0/1573204725 conn(0x559959ea5be0 msgr2=0x559959f050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.269+0000 7f7834c00640 0 client.5670 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.269+0000 7f78557cf740 1 -- 172.21.15.44:0/1573204725 shutdown_connections 2024-03-30T13:14:39.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.269+0000 7f78557cf740 1 -- 172.21.15.44:0/1573204725 wait complete. 2024-03-30T13:14:39.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.269+0000 7f78557cf740 20 client.5670 trim_cache size 0 max 16384 2024-03-30T13:14:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.285+0000 7f78557cf740 1 Processor -- start 2024-03-30T13:14:39.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.285+0000 7f78557cf740 1 -- start start 2024-03-30T13:14:39.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.286+0000 7f78557cf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959ed9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.286+0000 7f78557cf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 0x559959f26e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.286+0000 7f78557cf740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959f044c0 0x559959f99750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.286+0000 7f78557cf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f784c201140 con 0x559959edf290 2024-03-30T13:14:39.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.286+0000 7f78557cf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f784c200180 con 0x559959edf670 2024-03-30T13:14:39.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.286+0000 7f78557cf740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f784c1ff4e0 con 0x559959f044c0 2024-03-30T13:14:39.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.286+0000 7f784be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959ed9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.286+0000 7f784be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959ed9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33310/0 (socket says 172.21.15.44:33310) 2024-03-30T13:14:39.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.286+0000 7f784be00640 1 -- 172.21.15.44:0/1815821289 learned_addr learned my addr 172.21.15.44:0/1815821289 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.287+0000 7f784b400640 1 --2- 172.21.15.44:0/1815821289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 0x559959f26e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.287+0000 7f7850a00640 1 --2- 172.21.15.44:0/1815821289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959f044c0 0x559959f99750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.287+0000 7f784be00640 1 -- 172.21.15.44:0/1815821289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959f044c0 msgr2=0x559959f99750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.287+0000 7f784be00640 1 --2- 172.21.15.44:0/1815821289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959f044c0 0x559959f99750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.287+0000 7f784be00640 1 -- 172.21.15.44:0/1815821289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 msgr2=0x559959f26e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.287+0000 7f784be00640 1 --2- 172.21.15.44:0/1815821289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 0x559959f26e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.287+0000 7f784be00640 1 -- 172.21.15.44:0/1815821289 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559959aef2d0 con 0x559959edf290 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.287+0000 7f784be00640 1 --2- 172.21.15.44:0/1815821289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959ed9290 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f783c005fc0 tx=0x7f783c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d3ba8195a78437 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.287+0000 7f7837400640 1 -- 172.21.15.44:0/1815821289 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c022430 con 0x559959edf290 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.287+0000 7f7837400640 1 -- 172.21.15.44:0/1815821289 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783c0228e0 con 0x559959edf290 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.287+0000 7f7837400640 1 -- 172.21.15.44:0/1815821289 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c022a90 con 0x559959edf290 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.288+0000 7f78557cf740 1 -- 172.21.15.44:0/1815821289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 msgr2=0x559959ed9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.288+0000 7f78557cf740 1 --2- 172.21.15.44:0/1815821289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959ed9290 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f783c005fc0 tx=0x7f783c013000 comp rx=0 tx=0).stop 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.288+0000 7f78557cf740 1 -- 172.21.15.44:0/1815821289 shutdown_connections 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.288+0000 7f78557cf740 1 --2- 172.21.15.44:0/1815821289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959f044c0 0x559959f99750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.288+0000 7f78557cf740 1 --2- 172.21.15.44:0/1815821289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 0x559959f26e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.288+0000 7f78557cf740 1 --2- 172.21.15.44:0/1815821289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959ed9290 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.288+0000 7f78557cf740 1 -- 172.21.15.44:0/1815821289 >> 172.21.15.44:0/1815821289 conn(0x559959ea5be0 msgr2=0x559959f23370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.288+0000 7f78557cf740 1 -- 172.21.15.44:0/1815821289 shutdown_connections 2024-03-30T13:14:39.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.288+0000 7f78557cf740 1 -- 172.21.15.44:0/1815821289 wait complete. 2024-03-30T13:14:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.289+0000 7f78557cf740 1 -- start start 2024-03-30T13:14:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.289+0000 7f78557cf740 1 Processor -- start 2024-03-30T13:14:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.290+0000 7f78557cf740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959f88b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.290+0000 7f78557cf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 0x559959ed8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.290+0000 7f78557cf740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959f044c0 0x559959ed9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.290+0000 7f78557cf740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559959f27e30 con 0x559959edf290 2024-03-30T13:14:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.290+0000 7f78557cf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f784c1ffb30 con 0x559959edf670 2024-03-30T13:14:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.290+0000 7f78557cf740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x559959f20ec0 con 0x559959f044c0 2024-03-30T13:14:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.290+0000 7f78557cf740 10 client.0 _ll_register_callbacks cb 0x7f783c007740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.290+0000 7f784be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959f88b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.290+0000 7f784be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959f88b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33312/0 (socket says 172.21.15.44:33312) 2024-03-30T13:14:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.290+0000 7f784be00640 1 -- 172.21.15.44:0/2526369408 learned_addr learned my addr 172.21.15.44:0/2526369408 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.291+0000 7f784be00640 1 -- 172.21.15.44:0/2526369408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959f044c0 msgr2=0x559959ed9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.291+0000 7f784be00640 1 --2- 172.21.15.44:0/2526369408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959f044c0 0x559959ed9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.291+0000 7f784be00640 1 -- 172.21.15.44:0/2526369408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 msgr2=0x559959ed8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.291+0000 7f784be00640 1 --2- 172.21.15.44:0/2526369408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 0x559959ed8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.291+0000 7f784be00640 1 -- 172.21.15.44:0/2526369408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559959f32720 con 0x559959edf290 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.291+0000 7f784be00640 1 --2- 172.21.15.44:0/2526369408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959f88b00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f783c000c00 tx=0x7f783c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19fe65f2b1df7d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.291+0000 7f7834c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.291+0000 7f7834c00640 1 -- 172.21.15.44:0/2526369408 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c0016d0 con 0x559959edf290 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.291+0000 7f7834c00640 1 -- 172.21.15.44:0/2526369408 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f783c032070 con 0x559959edf290 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.291+0000 7f78557cf740 1 -- 172.21.15.44:0/2526369408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f783c0228e0 con 0x559959edf290 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.292+0000 7f7834c00640 1 -- 172.21.15.44:0/2526369408 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f783c02d430 con 0x559959edf290 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.292+0000 7f78557cf740 10 client.5676 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.292+0000 7f78557cf740 1 -- 172.21.15.44:0/2526369408 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x559959f32cd0 con 0x559959edf290 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.292+0000 7f7834c00640 1 -- 172.21.15.44:0/2526369408 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783c0228e0 con 0x559959edf290 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.292+0000 7f7834c00640 1 -- 172.21.15.44:0/2526369408 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f783c02d5d0 con 0x559959edf290 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.292+0000 7f78557cf740 10 client.5676 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.292+0000 7f78557cf740 10 client.5676 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:39.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.292+0000 7f78557cf740 20 client.5676 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:39.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.292+0000 7f78557cf740 1 --2- 172.21.15.44:0/2526369408 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x559959ee0460 0x559959f19940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.292+0000 7f78557cf740 4 client.5676 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628294}] 2024-03-30T13:14:39.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.292+0000 7f78557cf740 1 -- 172.21.15.44:0/2526369408 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628294}) -- 0x559959e49bc0 con 0x559959ee0460 2024-03-30T13:14:39.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.292+0000 7f784b400640 1 --2- 172.21.15.44:0/2526369408 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x559959ee0460 0x559959f19940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.293+0000 7f7834c00640 10 client.5676 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.293+0000 7f784b400640 1 --2- 172.21.15.44:0/2526369408 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x559959ee0460 0x559959f19940 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee1fd2d61e1a3a40 server_cookie=3f562268e282719e in_seq=0 out_seq=0 2024-03-30T13:14:39.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.293+0000 7f7834c00640 1 -- 172.21.15.44:0/2526369408 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4326 (crc 0 0 0) 0x559959e49bc0 con 0x559959ee0460 2024-03-30T13:14:39.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.293+0000 7f7834c00640 10 client.5676 handle_command_reply: tid=0 2024-03-30T13:14:39.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.293+0000 7f78557cf740 1 client.5676 shutdown 2024-03-30T13:14:39.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.294+0000 7f78557cf740 1 -- 172.21.15.44:0/2526369408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 msgr2=0x559959f88b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.294+0000 7f78557cf740 1 --2- 172.21.15.44:0/2526369408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959f88b00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f783c000c00 tx=0x7f783c007a10 comp rx=0 tx=0).stop 2024-03-30T13:14:39.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.294+0000 7f78557cf740 1 -- 172.21.15.44:0/2526369408 shutdown_connections 2024-03-30T13:14:39.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.294+0000 7f78557cf740 1 --2- 172.21.15.44:0/2526369408 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x559959ee0460 0x559959f19940 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.294+0000 7f78557cf740 1 --2- 172.21.15.44:0/2526369408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559959f044c0 0x559959ed9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.294+0000 7f78557cf740 1 --2- 172.21.15.44:0/2526369408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559959edf670 0x559959ed8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.294+0000 7f78557cf740 1 --2- 172.21.15.44:0/2526369408 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559959edf290 0x559959f88b00 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.294+0000 7f7834c00640 0 client.5676 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.294+0000 7f78557cf740 1 -- 172.21.15.44:0/2526369408 >> 172.21.15.44:0/2526369408 conn(0x559959ea5be0 msgr2=0x559959f0b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.294+0000 7f78557cf740 1 -- 172.21.15.44:0/2526369408 shutdown_connections 2024-03-30T13:14:39.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.294+0000 7f78557cf740 1 -- 172.21.15.44:0/2526369408 wait complete. 2024-03-30T13:14:39.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.294+0000 7f78557cf740 20 client.5676 trim_cache size 0 max 16384 2024-03-30T13:14:39.302 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:39.302 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ceph/io.h", 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628294, 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.210174+0000", 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.092261+0000", 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:39.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 387, 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.092261+0000", 2024-03-30T13:14:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 1 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:39.305 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 387, 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:39.306 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.210174+0000" 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 387, 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.210174+0000" 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 156, 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:39.307 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 30, 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:39.308 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.309 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 1, 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 1, 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 1, 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:39.310 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 1, 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 6, 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:39.311 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 1, 2024-03-30T13:14:39.312 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.313 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:39.314 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:39.315 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:39.315 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.315 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:39.315 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:39.315 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:39.315 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:39.315 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:39.315 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:39.315 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:39.315 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:39.315 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.315 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:39.316 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:39.316 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:39.316 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:39.316 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:39.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.295+0000 7f7852a00640 1 -- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f782c06c530 msgr2=0x7f782c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.295+0000 7f7852a00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f782c06c530 0x7f782c06e9f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f783c000f60 tx=0x7f783c007b90 comp rx=0 tx=0).stop 2024-03-30T13:14:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.295+0000 7f7852a00640 1 -- 172.21.15.44:0/3698091342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f784c160880 msgr2=0x7f784c06d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.295+0000 7f7852a00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f784c160880 0x7f784c06d6e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7844037040 tx=0x7f7844004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.295+0000 7f7852a00640 1 -- 172.21.15.44:0/3698091342 shutdown_connections 2024-03-30T13:14:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.295+0000 7f7852a00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f784c160880 0x7f784c06d6e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.295+0000 7f7852a00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f782c06c530 0x7f782c06e9f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.295+0000 7f7852a00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f784c15d5c0 0x7f784c1f38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.295+0000 7f7852a00640 1 --2- 172.21.15.44:0/3698091342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f784c145d70 0x7f784c156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.295+0000 7f7852a00640 1 -- 172.21.15.44:0/3698091342 >> 172.21.15.44:0/3698091342 conn(0x7f784c0b3e70 msgr2=0x7f784c0cb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.295+0000 7f7852a00640 1 -- 172.21.15.44:0/3698091342 shutdown_connections 2024-03-30T13:14:39.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.295+0000 7f7852a00640 1 -- 172.21.15.44:0/3698091342 wait complete. 2024-03-30T13:14:39.323 DEBUG:tasks.cephfs.test_uninlining:getting inode info #5 of 23:1099511628296 2024-03-30T13:14:39.323 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628296 2024-03-30T13:14:39.323 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628296 2024-03-30T13:14:39.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.544+0000 7feaffe00640 1 Processor -- start 2024-03-30T13:14:39.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.545+0000 7feaffe00640 1 -- start start 2024-03-30T13:14:39.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.546+0000 7feaffe00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7feb00158d10 0x7feb00070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.546+0000 7feaffe00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb00070b10 con 0x7feb0015f510 2024-03-30T13:14:39.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.546+0000 7feaffe00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb000adf80 con 0x7feb0006b580 2024-03-30T13:14:39.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.546+0000 7feaffe00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7feb000ae260 con 0x7feb00158d10 2024-03-30T13:14:39.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.546+0000 7feaf7e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7feb0015f510 0x7feb000aea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36784/0 (socket says 172.21.15.44:36784) 2024-03-30T13:14:39.551 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.546+0000 7feaf7e00640 1 -- 172.21.15.44:0/3827608492 learned_addr learned my addr 172.21.15.44:0/3827608492 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:39.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.547+0000 7feafea00640 1 --2- 172.21.15.44:0/3827608492 >> v2:172.21.15.151:3300/0 conn(0x7feb00158d10 0x7feb00070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.547+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3853017053 0 0) 0x7feb00070b10 con 0x7feb0015f510 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.547+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feae4003520 con 0x7feb0015f510 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.547+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3430557267 0 0) 0x7feae4003520 con 0x7feb0015f510 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.547+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 >> v2:172.21.15.151:3300/0 conn(0x7feb00158d10 msgr2=0x7feb00070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.547+0000 7feafe000640 1 --2- 172.21.15.44:0/3827608492 >> v2:172.21.15.151:3300/0 conn(0x7feb00158d10 0x7feb00070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.547+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 >> v1:172.21.15.151:6789/0 conn(0x7feb0006b580 legacy=0x7feb000b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.547+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb000ae540 con 0x7feb0015f510 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.547+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7feae8001670 con 0x7feb0015f510 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.547+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 >> v1:172.21.15.44:6789/0 conn(0x7feb0015f510 legacy=0x7feb000aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feafe000640 1 --2- 172.21.15.44:0/3827608492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 0x7feae4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feafe000640 1 --2- 172.21.15.44:0/3827608492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae4004800 0x7feae4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feafe000640 1 --2- 172.21.15.44:0/3827608492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feae40051c0 0x7feae400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb000ae260 con 0x7feae40039b0 2024-03-30T13:14:39.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7feae400c060 con 0x7feae4004800 2024-03-30T13:14:39.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7feae400c260 con 0x7feae40051c0 2024-03-30T13:14:39.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feafea00640 1 --2- 172.21.15.44:0/3827608492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 0x7feae4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feaf7e00640 1 --2- 172.21.15.44:0/3827608492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae4004800 0x7feae4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feaff400640 1 --2- 172.21.15.44:0/3827608492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feae40051c0 0x7feae400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feafea00640 1 -- 172.21.15.44:0/3827608492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feae40051c0 msgr2=0x7feae400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feafea00640 1 --2- 172.21.15.44:0/3827608492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feae40051c0 0x7feae400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feafea00640 1 -- 172.21.15.44:0/3827608492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae4004800 msgr2=0x7feae4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feafea00640 1 --2- 172.21.15.44:0/3827608492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae4004800 0x7feae4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feafea00640 1 -- 172.21.15.44:0/3827608492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae4003520 con 0x7feae40039b0 2024-03-30T13:14:39.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feaf7e00640 1 --2- 172.21.15.44:0/3827608492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feae4004800 0x7feae4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:39.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.548+0000 7feaff400640 1 -- 172.21.15.44:0/3827608492 reap_dead start 2024-03-30T13:14:39.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.549+0000 7feafea00640 1 --2- 172.21.15.44:0/3827608492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 0x7feae4003dd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009ac0 tx=0x7feae4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56814cf6abc403bb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.550+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0039070 con 0x7feae40039b0 2024-03-30T13:14:39.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.550+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf002c6b0 con 0x7feae40039b0 2024-03-30T13:14:39.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.550+0000 7feafe000640 1 -- 172.21.15.44:0/3827608492 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0009690 con 0x7feae40039b0 2024-03-30T13:14:39.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.550+0000 7feaffe00640 1 -- 172.21.15.44:0/3827608492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 msgr2=0x7feae4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.550+0000 7feaffe00640 1 --2- 172.21.15.44:0/3827608492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 0x7feae4003dd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7feaf0009ac0 tx=0x7feae4005830 comp rx=0 tx=0).stop 2024-03-30T13:14:39.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.550+0000 7feaffe00640 1 -- 172.21.15.44:0/3827608492 shutdown_connections 2024-03-30T13:14:39.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.550+0000 7feaffe00640 1 --2- 172.21.15.44:0/3827608492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 0x7feae4003dd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.550+0000 7feaffe00640 1 -- 172.21.15.44:0/3827608492 >> 172.21.15.44:0/3827608492 conn(0x7feb000d0ed0 msgr2=0x7feb000d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.551+0000 7feaffe00640 1 -- 172.21.15.44:0/3827608492 shutdown_connections 2024-03-30T13:14:39.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.551+0000 7feaffe00640 1 -- 172.21.15.44:0/3827608492 wait complete. 2024-03-30T13:14:39.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.553+0000 7feaffe00640 1 Processor -- start 2024-03-30T13:14:39.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.553+0000 7feaffe00640 1 -- start start 2024-03-30T13:14:39.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.554+0000 7feaffe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 0x7feb001f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.554+0000 7feaffe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb001527e0 0x7feb001552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.554+0000 7feaffe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb001487c0 0x7feb000b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.554+0000 7feaffe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb000706b0 con 0x7feae40039b0 2024-03-30T13:14:39.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.554+0000 7feaffe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7feb00070530 con 0x7feb001487c0 2024-03-30T13:14:39.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.554+0000 7feaffe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7feb00070830 con 0x7feb001527e0 2024-03-30T13:14:39.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.554+0000 7feafea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 0x7feb001f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.554+0000 7feafea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 0x7feb001f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33330/0 (socket says 172.21.15.44:33330) 2024-03-30T13:14:39.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.555+0000 7feafea00640 1 -- 172.21.15.44:0/1073796435 learned_addr learned my addr 172.21.15.44:0/1073796435 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.555+0000 7feafea00640 1 -- 172.21.15.44:0/1073796435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb001527e0 msgr2=0x7feb001552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.555+0000 7feafea00640 1 --2- 172.21.15.44:0/1073796435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb001527e0 0x7feb001552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.555+0000 7feafea00640 1 -- 172.21.15.44:0/1073796435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb001487c0 msgr2=0x7feb000b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.555+0000 7feafea00640 1 --2- 172.21.15.44:0/1073796435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb001487c0 0x7feb000b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.555+0000 7feafea00640 1 -- 172.21.15.44:0/1073796435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb001557e0 con 0x7feae40039b0 2024-03-30T13:14:39.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.555+0000 7feafea00640 1 --2- 172.21.15.44:0/1073796435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 0x7feb001f4450 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feaf0000c00 tx=0x7feaf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.555+0000 7feaf6a00640 1 -- 172.21.15.44:0/1073796435 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0042020 con 0x7feae40039b0 2024-03-30T13:14:39.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.556+0000 7feaf6a00640 1 -- 172.21.15.44:0/1073796435 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf003a040 con 0x7feae40039b0 2024-03-30T13:14:39.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.556+0000 7feaffe00640 1 -- 172.21.15.44:0/1073796435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb00155a60 con 0x7feae40039b0 2024-03-30T13:14:39.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.556+0000 7feaf6a00640 1 -- 172.21.15.44:0/1073796435 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0039070 con 0x7feae40039b0 2024-03-30T13:14:39.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.556+0000 7feaffe00640 1 -- 172.21.15.44:0/1073796435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb00161620 con 0x7feae40039b0 2024-03-30T13:14:39.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.558+0000 7feaf6a00640 1 -- 172.21.15.44:0/1073796435 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7feaf0045020 con 0x7feae40039b0 2024-03-30T13:14:39.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.559+0000 7feaf6a00640 1 --2- 172.21.15.44:0/1073796435 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7feadc06c560 0x7feadc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.559+0000 7feaf6a00640 1 -- 172.21.15.44:0/1073796435 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7feaf00acc60 con 0x7feae40039b0 2024-03-30T13:14:39.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.560+0000 7feb085a7740 1 Processor -- start 2024-03-30T13:14:39.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.560+0000 7feaf7e00640 1 --2- 172.21.15.44:0/1073796435 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7feadc06c560 0x7feadc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.560+0000 7feb085a7740 1 -- start start 2024-03-30T13:14:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.561+0000 7feb085a7740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd4892fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.561+0000 7feb085a7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd48934e0 0x55bfd486b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.561+0000 7feb085a7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd486c850 0x55bfd486b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.561+0000 7feb085a7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bfd47cf330 con 0x55bfd48934e0 2024-03-30T13:14:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.561+0000 7feb085a7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bfd4777620 con 0x55bfd486c850 2024-03-30T13:14:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.561+0000 7feb085a7740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55bfd47cb440 con 0x55bfd486c470 2024-03-30T13:14:39.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.562+0000 7feaf7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd48934e0 0x55bfd486b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.562+0000 7feaf7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd48934e0 0x55bfd486b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33332/0 (socket says 172.21.15.44:33332) 2024-03-30T13:14:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.562+0000 7feaf7e00640 1 -- 172.21.15.44:0/962704579 learned_addr learned my addr 172.21.15.44:0/962704579 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.562+0000 7feafea00640 1 --2- 172.21.15.44:0/962704579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd4892fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.562+0000 7feaff400640 1 --2- 172.21.15.44:0/962704579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd486c850 0x55bfd486b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.562+0000 7feaf7e00640 1 --2- 172.21.15.44:0/1073796435 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7feadc06c560 0x7feadc06ea20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feae8001eb0 tx=0x7feae8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.562+0000 7feaf7e00640 1 -- 172.21.15.44:0/962704579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 msgr2=0x55bfd4892fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.562+0000 7feaf7e00640 1 --2- 172.21.15.44:0/962704579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd4892fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.562+0000 7feaf7e00640 1 -- 172.21.15.44:0/962704579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd486c850 msgr2=0x55bfd486b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.562+0000 7feaf7e00640 1 --2- 172.21.15.44:0/962704579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd486c850 0x55bfd486b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.562+0000 7feaf7e00640 1 -- 172.21.15.44:0/962704579 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfd45af920 con 0x55bfd48934e0 2024-03-30T13:14:39.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.562+0000 7feaf7e00640 1 --2- 172.21.15.44:0/962704579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd48934e0 0x55bfd486b4b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7feae800db60 tx=0x7feae8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61ff85701561cbf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.563+0000 7feaef400640 1 -- 172.21.15.44:0/962704579 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae8024070 con 0x55bfd48934e0 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.563+0000 7feaef400640 1 -- 172.21.15.44:0/962704579 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae8017070 con 0x55bfd48934e0 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.563+0000 7feaef400640 1 -- 172.21.15.44:0/962704579 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae8019050 con 0x55bfd48934e0 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.564+0000 7feb085a7740 1 -- 172.21.15.44:0/962704579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd48934e0 msgr2=0x55bfd486b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.564+0000 7feb085a7740 1 --2- 172.21.15.44:0/962704579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd48934e0 0x55bfd486b4b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7feae800db60 tx=0x7feae8010000 comp rx=0 tx=0).stop 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.564+0000 7feb085a7740 1 -- 172.21.15.44:0/962704579 shutdown_connections 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.564+0000 7feb085a7740 1 --2- 172.21.15.44:0/962704579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd486c850 0x55bfd486b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.564+0000 7feb085a7740 1 --2- 172.21.15.44:0/962704579 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd48934e0 0x55bfd486b4b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.564+0000 7feb085a7740 1 --2- 172.21.15.44:0/962704579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd4892fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.564+0000 7feb085a7740 1 -- 172.21.15.44:0/962704579 >> 172.21.15.44:0/962704579 conn(0x55bfd4832be0 msgr2=0x55bfd48b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.564+0000 7feb085a7740 1 -- 172.21.15.44:0/962704579 shutdown_connections 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.564+0000 7feb085a7740 1 -- 172.21.15.44:0/962704579 wait complete. 2024-03-30T13:14:39.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.565+0000 7feb085a7740 1 -- start start 2024-03-30T13:14:39.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.565+0000 7feb085a7740 1 Processor -- start 2024-03-30T13:14:39.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.566+0000 7feb085a7740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd48c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.566+0000 7feb085a7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd48c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.566+0000 7feb085a7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 0x55bfd486b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.566+0000 7feb085a7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bfd4892b10 con 0x55bfd486c850 2024-03-30T13:14:39.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.566+0000 7feb085a7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bfd478a9d0 con 0x55bfd48a97d0 2024-03-30T13:14:39.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.566+0000 7feb085a7740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55bfd488b890 con 0x55bfd486c470 2024-03-30T13:14:39.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.566+0000 7feb085a7740 10 client.0 _ll_register_callbacks cb 0x55bfd47c6fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.566+0000 7feaf7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd48c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.566+0000 7feaf7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd48c1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33344/0 (socket says 172.21.15.44:33344) 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.566+0000 7feaf7e00640 1 -- 172.21.15.44:0/33187876 learned_addr learned my addr 172.21.15.44:0/33187876 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.567+0000 7feafea00640 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd48c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.567+0000 7feaf7e00640 1 -- 172.21.15.44:0/33187876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 msgr2=0x55bfd48c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.567+0000 7feaf7e00640 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd48c1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.567+0000 7feaff400640 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 0x55bfd486b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.567+0000 7feaf7e00640 1 -- 172.21.15.44:0/33187876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 msgr2=0x55bfd486b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.567+0000 7feaf7e00640 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 0x55bfd486b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.567+0000 7feaf7e00640 1 -- 172.21.15.44:0/33187876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfd44a3210 con 0x55bfd486c850 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.567+0000 7feaf7e00640 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd48c1b70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7feae80017e0 tx=0x7feae8001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e3ff4f15925fe server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.567+0000 7feae3e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.567+0000 7feae3e00640 1 -- 172.21.15.44:0/33187876 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae8024030 con 0x55bfd486c850 2024-03-30T13:14:39.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.567+0000 7feae3e00640 1 -- 172.21.15.44:0/33187876 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7feae8025070 con 0x55bfd486c850 2024-03-30T13:14:39.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.567+0000 7feb085a7740 1 -- 172.21.15.44:0/33187876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feae8017070 con 0x55bfd486c850 2024-03-30T13:14:39.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.568+0000 7feae3e00640 1 -- 172.21.15.44:0/33187876 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7feae8037050 con 0x55bfd486c850 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.568+0000 7feb085a7740 10 client.5688 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.568+0000 7feb085a7740 1 -- 172.21.15.44:0/33187876 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55bfd46100b0 con 0x55bfd486c850 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.568+0000 7feae3e00640 1 -- 172.21.15.44:0/33187876 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae8017070 con 0x55bfd486c850 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.568+0000 7feae3e00640 1 -- 172.21.15.44:0/33187876 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7feae803a020 con 0x55bfd486c850 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.568+0000 7feb085a7740 10 client.5688 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.568+0000 7feb085a7740 10 client.5688 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.568+0000 7feb085a7740 20 client.5688 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.568+0000 7feb085a7740 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bfd48c3450 0x55bfd48c3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.568+0000 7feb085a7740 4 client.5688 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.568+0000 7feb085a7740 1 -- 172.21.15.44:0/33187876 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfd47dc870 con 0x55bfd48c3450 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.569+0000 7feafea00640 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bfd48c3450 0x55bfd48c3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.569+0000 7feafea00640 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bfd48c3450 0x55bfd48c3830 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd571742ec17657c server_cookie=58c3e053646af449 in_seq=0 out_seq=0 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.569+0000 7feae3e00640 10 client.5688 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feae3e00640 1 -- 172.21.15.44:0/33187876 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55bfd47dc870 con 0x55bfd48c3450 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feae3e00640 10 client.5688 handle_command_reply: tid=0 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feb085a7740 1 client.5688 shutdown 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feb085a7740 1 -- 172.21.15.44:0/33187876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 msgr2=0x55bfd48c1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feb085a7740 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd48c1b70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7feae80017e0 tx=0x7feae8001150 comp rx=0 tx=0).stop 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feb085a7740 1 -- 172.21.15.44:0/33187876 shutdown_connections 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feb085a7740 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bfd48c3450 0x55bfd48c3830 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feb085a7740 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 0x55bfd486b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feb085a7740 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd48c1b70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feb085a7740 1 --2- 172.21.15.44:0/33187876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd48c1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feae3e00640 0 client.5688 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feb085a7740 1 -- 172.21.15.44:0/33187876 >> 172.21.15.44:0/33187876 conn(0x55bfd4832be0 msgr2=0x55bfd4865b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feb085a7740 1 -- 172.21.15.44:0/33187876 shutdown_connections 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.570+0000 7feb085a7740 1 -- 172.21.15.44:0/33187876 wait complete. 2024-03-30T13:14:39.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.571+0000 7feb085a7740 20 client.5688 trim_cache size 0 max 16384 2024-03-30T13:14:39.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.586+0000 7feb085a7740 1 Processor -- start 2024-03-30T13:14:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.586+0000 7feb085a7740 1 -- start start 2024-03-30T13:14:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.587+0000 7feb085a7740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd48653f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.587+0000 7feb085a7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd4865930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.587+0000 7feb085a7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 0x55bfd4892360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.587+0000 7feb085a7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb00201730 con 0x55bfd486c850 2024-03-30T13:14:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.587+0000 7feb085a7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7feb00200730 con 0x55bfd48a97d0 2024-03-30T13:14:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.587+0000 7feb085a7740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7feb001ffc10 con 0x55bfd486c470 2024-03-30T13:14:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.588+0000 7feaf7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd4865930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.588+0000 7feaf7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd4865930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33354/0 (socket says 172.21.15.44:33354) 2024-03-30T13:14:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.588+0000 7feaf7e00640 1 -- 172.21.15.44:0/2032728914 learned_addr learned my addr 172.21.15.44:0/2032728914 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.588+0000 7feaf7e00640 1 -- 172.21.15.44:0/2032728914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 msgr2=0x55bfd48653f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.588+0000 7feaf7e00640 1 --2- 172.21.15.44:0/2032728914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd48653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.588+0000 7feaf7e00640 1 -- 172.21.15.44:0/2032728914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 msgr2=0x55bfd4892360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.588+0000 7feaf7e00640 1 --2- 172.21.15.44:0/2032728914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 0x55bfd4892360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.588+0000 7feaf7e00640 1 -- 172.21.15.44:0/2032728914 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfd447c2d0 con 0x55bfd486c850 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.588+0000 7feaf7e00640 1 --2- 172.21.15.44:0/2032728914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd4865930 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feae80076e0 tx=0x7feae802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb2b96a168b0fc5d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.588+0000 7feaeea00640 1 -- 172.21.15.44:0/2032728914 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae8019020 con 0x55bfd486c850 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.589+0000 7feaeea00640 1 -- 172.21.15.44:0/2032728914 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae8017070 con 0x55bfd486c850 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.589+0000 7feaeea00640 1 -- 172.21.15.44:0/2032728914 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae8024040 con 0x55bfd486c850 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.589+0000 7feb085a7740 1 -- 172.21.15.44:0/2032728914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 msgr2=0x55bfd4865930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.589+0000 7feb085a7740 1 --2- 172.21.15.44:0/2032728914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd4865930 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feae80076e0 tx=0x7feae802a000 comp rx=0 tx=0).stop 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.589+0000 7feb085a7740 1 -- 172.21.15.44:0/2032728914 shutdown_connections 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.589+0000 7feb085a7740 1 --2- 172.21.15.44:0/2032728914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 0x55bfd4892360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.589+0000 7feb085a7740 1 --2- 172.21.15.44:0/2032728914 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd4865930 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.589+0000 7feb085a7740 1 --2- 172.21.15.44:0/2032728914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd48653f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.589+0000 7feb085a7740 1 -- 172.21.15.44:0/2032728914 >> 172.21.15.44:0/2032728914 conn(0x55bfd4832be0 msgr2=0x55bfd48ad1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.589+0000 7feb085a7740 1 -- 172.21.15.44:0/2032728914 shutdown_connections 2024-03-30T13:14:39.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.589+0000 7feb085a7740 1 -- 172.21.15.44:0/2032728914 wait complete. 2024-03-30T13:14:39.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.590+0000 7feb085a7740 1 -- start start 2024-03-30T13:14:39.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.590+0000 7feb085a7740 1 Processor -- start 2024-03-30T13:14:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.591+0000 7feb085a7740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd491de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.591+0000 7feb085a7740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd48c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.591+0000 7feb085a7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 0x55bfd48ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.591+0000 7feb085a7740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb002000e0 con 0x55bfd486c850 2024-03-30T13:14:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.591+0000 7feb085a7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bfd48acf90 con 0x55bfd48a97d0 2024-03-30T13:14:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.591+0000 7feb085a7740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55bfd491edc0 con 0x55bfd486c470 2024-03-30T13:14:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.591+0000 7feb085a7740 10 client.0 _ll_register_callbacks cb 0x7feae8022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:39.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.591+0000 7feaf7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd48c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.592+0000 7feaf7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd48c9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33358/0 (socket says 172.21.15.44:33358) 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.592+0000 7feaf7e00640 1 -- 172.21.15.44:0/1474186211 learned_addr learned my addr 172.21.15.44:0/1474186211 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.592+0000 7feaf7e00640 1 -- 172.21.15.44:0/1474186211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 msgr2=0x55bfd491de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.592+0000 7feaf7e00640 1 --2- 172.21.15.44:0/1474186211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd491de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.592+0000 7feaf7e00640 1 -- 172.21.15.44:0/1474186211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 msgr2=0x55bfd48ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.592+0000 7feaf7e00640 1 --2- 172.21.15.44:0/1474186211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 0x55bfd48ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.592+0000 7feaf7e00640 1 -- 172.21.15.44:0/1474186211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfd48928b0 con 0x55bfd486c850 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.592+0000 7feaf7e00640 1 --2- 172.21.15.44:0/1474186211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd48c9e20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feae80017e0 tx=0x7feae8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3332f315df46bc1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.592+0000 7feae3e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.592+0000 7feae3e00640 1 -- 172.21.15.44:0/1474186211 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae802b640 con 0x55bfd486c850 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feae3e00640 1 -- 172.21.15.44:0/1474186211 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7feae8045c50 con 0x55bfd486c850 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feb085a7740 1 -- 172.21.15.44:0/1474186211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feae8017070 con 0x55bfd486c850 2024-03-30T13:14:39.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feae3e00640 1 -- 172.21.15.44:0/1474186211 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7feae802b7e0 con 0x55bfd486c850 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feb085a7740 10 client.5694 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feb085a7740 1 -- 172.21.15.44:0/1474186211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55bfd48d4580 con 0x55bfd486c850 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feae3e00640 1 -- 172.21.15.44:0/1474186211 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae8017070 con 0x55bfd486c850 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feae3e00640 1 -- 172.21.15.44:0/1474186211 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7feae803a030 con 0x55bfd486c850 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feb085a7740 10 client.5694 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feb085a7740 10 client.5694 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feb085a7740 20 client.5694 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feb085a7740 1 --2- 172.21.15.44:0/1474186211 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bfd49306b0 0x55bfd48a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feb085a7740 4 client.5694 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628296}] 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.593+0000 7feb085a7740 1 -- 172.21.15.44:0/1474186211 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628296}) -- 0x55bfd47d6bc0 con 0x55bfd49306b0 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.594+0000 7feafea00640 1 --2- 172.21.15.44:0/1474186211 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bfd49306b0 0x55bfd48a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.594+0000 7feafea00640 1 --2- 172.21.15.44:0/1474186211 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bfd49306b0 0x55bfd48a6b20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=921715470a91dceb server_cookie=88f3629e21d3b3b1 in_seq=0 out_seq=0 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.594+0000 7feae3e00640 10 client.5694 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.594+0000 7feae3e00640 1 -- 172.21.15.44:0/1474186211 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4332 (crc 0 0 0) 0x55bfd47d6bc0 con 0x55bfd49306b0 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.594+0000 7feae3e00640 10 client.5694 handle_command_reply: tid=0 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.594+0000 7feb085a7740 1 client.5694 shutdown 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.595+0000 7feb085a7740 1 -- 172.21.15.44:0/1474186211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 msgr2=0x55bfd48c9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.595+0000 7feb085a7740 1 --2- 172.21.15.44:0/1474186211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd48c9e20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feae80017e0 tx=0x7feae8013000 comp rx=0 tx=0).stop 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.595+0000 7feb085a7740 1 -- 172.21.15.44:0/1474186211 shutdown_connections 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.595+0000 7feb085a7740 1 --2- 172.21.15.44:0/1474186211 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bfd49306b0 0x55bfd48a6b20 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.595+0000 7feb085a7740 1 --2- 172.21.15.44:0/1474186211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfd48a97d0 0x55bfd48ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.595+0000 7feb085a7740 1 --2- 172.21.15.44:0/1474186211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bfd486c850 0x55bfd48c9e20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.595+0000 7feb085a7740 1 --2- 172.21.15.44:0/1474186211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bfd486c470 0x55bfd491de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.595+0000 7feae3e00640 0 client.5694 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.595+0000 7feb085a7740 1 -- 172.21.15.44:0/1474186211 >> 172.21.15.44:0/1474186211 conn(0x55bfd4832be0 msgr2=0x55bfd48ad110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.595+0000 7feb085a7740 1 -- 172.21.15.44:0/1474186211 shutdown_connections 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.595+0000 7feb085a7740 1 -- 172.21.15.44:0/1474186211 wait complete. 2024-03-30T13:14:39.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.595+0000 7feb085a7740 20 client.5694 trim_cache size 0 max 16384 2024-03-30T13:14:39.605 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:39.605 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ceph/ioctl.h", 2024-03-30T13:14:39.605 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628296, 2024-03-30T13:14:39.605 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:39.605 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.215656+0000", 2024-03-30T13:14:39.605 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.099260+0000", 2024-03-30T13:14:39.605 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:39.605 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:39.605 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:39.606 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 3724, 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.099260+0000", 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:39.607 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 1 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:39.608 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 3724, 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.215656+0000" 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.609 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 3724, 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.215656+0000" 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 160, 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 34, 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:39.610 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:39.611 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:39.612 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 1, 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 1, 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 1, 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:39.613 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 1, 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 6, 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.614 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 1, 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.615 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:39.616 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.617 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:39.618 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.596+0000 7feaffe00640 1 -- 172.21.15.44:0/1073796435 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7feadc06c560 msgr2=0x7feadc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.596+0000 7feaffe00640 1 --2- 172.21.15.44:0/1073796435 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7feadc06c560 0x7feadc06ea20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feae8001eb0 tx=0x7feae8009040 comp rx=0 tx=0).stop 2024-03-30T13:14:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.596+0000 7feaffe00640 1 -- 172.21.15.44:0/1073796435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 msgr2=0x7feb001f4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.596+0000 7feaffe00640 1 --2- 172.21.15.44:0/1073796435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 0x7feb001f4450 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7feaf0000c00 tx=0x7feaf0004730 comp rx=0 tx=0).stop 2024-03-30T13:14:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.596+0000 7feaffe00640 1 -- 172.21.15.44:0/1073796435 shutdown_connections 2024-03-30T13:14:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.596+0000 7feaffe00640 1 --2- 172.21.15.44:0/1073796435 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7feadc06c560 0x7feadc06ea20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.596+0000 7feaffe00640 1 --2- 172.21.15.44:0/1073796435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb001487c0 0x7feb000b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.596+0000 7feaffe00640 1 --2- 172.21.15.44:0/1073796435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb001527e0 0x7feb001552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.596+0000 7feaffe00640 1 --2- 172.21.15.44:0/1073796435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feae40039b0 0x7feb001f4450 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.596+0000 7feaffe00640 1 -- 172.21.15.44:0/1073796435 >> 172.21.15.44:0/1073796435 conn(0x7feb000d0ed0 msgr2=0x7feb000d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.596+0000 7feaffe00640 1 -- 172.21.15.44:0/1073796435 shutdown_connections 2024-03-30T13:14:39.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.596+0000 7feaffe00640 1 -- 172.21.15.44:0/1073796435 wait complete. 2024-03-30T13:14:39.621 DEBUG:tasks.cephfs.test_uninlining:getting inode info #6 of 23:1099511628308 2024-03-30T13:14:39.621 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628308 2024-03-30T13:14:39.621 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628308 2024-03-30T13:14:39.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.834+0000 7fba5be00640 1 Processor -- start 2024-03-30T13:14:39.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.834+0000 7fba5be00640 1 -- start start 2024-03-30T13:14:39.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.835+0000 7fba5be00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0b4920 0x7fba5c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.835+0000 7fba5be00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fba5c0b4d00 0x7fba5c0d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.835+0000 7fba5be00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5c0b54b0 con 0x7fba5c0d0b90 2024-03-30T13:14:39.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.835+0000 7fba5be00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fba5c0d0260 con 0x7fba5c0b4d00 2024-03-30T13:14:39.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.835+0000 7fba5be00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fba5c0cfca0 con 0x7fba5c0b4920 2024-03-30T13:14:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.836+0000 7fba5b400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fba5c0d0b90 0x7fba5c0d26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36796/0 (socket says 172.21.15.44:36796) 2024-03-30T13:14:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.836+0000 7fba5b400640 1 -- 172.21.15.44:0/1216963440 learned_addr learned my addr 172.21.15.44:0/1216963440 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.836+0000 7fba5aa00640 1 --2- 172.21.15.44:0/1216963440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0b4920 0x7fba5c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.836+0000 7fba5a000640 1 --2- 172.21.15.44:0/1216963440 >> v2:172.21.15.151:3300/0 conn(0x7fba5c0b4d00 0x7fba5c0d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.837+0000 7fba59600640 1 -- 172.21.15.44:0/1216963440 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745778654 0 0) 0x7fba54001490 con 0x7fba5c0d0b90 2024-03-30T13:14:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.837+0000 7fba59600640 1 -- 172.21.15.44:0/1216963440 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba40003520 con 0x7fba5c0d0b90 2024-03-30T13:14:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.837+0000 7fba5aa00640 1 -- 172.21.15.44:0/1216963440 >> v2:172.21.15.151:3300/0 conn(0x7fba5c0b4d00 msgr2=0x7fba5c0d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.837+0000 7fba5aa00640 1 --2- 172.21.15.44:0/1216963440 >> v2:172.21.15.151:3300/0 conn(0x7fba5c0b4d00 0x7fba5c0d4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.837+0000 7fba5aa00640 1 -- 172.21.15.44:0/1216963440 >> v1:172.21.15.44:6789/0 conn(0x7fba5c0d0b90 legacy=0x7fba5c0d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.837+0000 7fba59600640 1 -- 172.21.15.44:0/1216963440 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3853017843 0 0) 0x7fba40003520 con 0x7fba5c0d0b90 2024-03-30T13:14:39.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.837+0000 7fba5aa00640 1 -- 172.21.15.44:0/1216963440 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c0cff80 con 0x7fba5c0b4920 2024-03-30T13:14:39.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.838+0000 7fba5aa00640 1 --2- 172.21.15.44:0/1216963440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0b4920 0x7fba5c0b3ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0097a0 tx=0x7fba4c02b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff47fea722232ae9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.839+0000 7fba59600640 1 -- 172.21.15.44:0/1216963440 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c037070 con 0x7fba5c0b4920 2024-03-30T13:14:39.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.839+0000 7fba59600640 1 -- 172.21.15.44:0/1216963440 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c030510 con 0x7fba5c0b4920 2024-03-30T13:14:39.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.839+0000 7fba59600640 1 -- 172.21.15.44:0/1216963440 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54001bc0 con 0x7fba5c0b4920 2024-03-30T13:14:39.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.839+0000 7fba5be00640 1 -- 172.21.15.44:0/1216963440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0b4920 msgr2=0x7fba5c0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.839+0000 7fba5be00640 1 --2- 172.21.15.44:0/1216963440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0b4920 0x7fba5c0b3ab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0097a0 tx=0x7fba4c02b710 comp rx=0 tx=0).stop 2024-03-30T13:14:39.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.840+0000 7fba5be00640 1 -- 172.21.15.44:0/1216963440 shutdown_connections 2024-03-30T13:14:39.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.840+0000 7fba5be00640 1 --2- 172.21.15.44:0/1216963440 >> v2:172.21.15.151:3300/0 conn(0x7fba5c0b4d00 0x7fba5c0d4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.840+0000 7fba5be00640 1 --2- 172.21.15.44:0/1216963440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0b4920 0x7fba5c0b3ab0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.840+0000 7fba5be00640 1 -- 172.21.15.44:0/1216963440 >> 172.21.15.44:0/1216963440 conn(0x7fba5c09d4e0 msgr2=0x7fba5c0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.840+0000 7fba5be00640 1 -- 172.21.15.44:0/1216963440 shutdown_connections 2024-03-30T13:14:39.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.840+0000 7fba5be00640 1 -- 172.21.15.44:0/1216963440 wait complete. 2024-03-30T13:14:39.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.841+0000 7fba5be00640 1 Processor -- start 2024-03-30T13:14:39.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.841+0000 7fba5be00640 1 -- start start 2024-03-30T13:14:39.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.842+0000 7fba5be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c0b4920 0x7fba5c0cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.842+0000 7fba5be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba5c0b4d00 0x7fba5c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.842+0000 7fba5be00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0d0b90 0x7fba5c0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.842+0000 7fba5be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c0b3ff0 con 0x7fba5c0b4920 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.842+0000 7fba5be00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c0d2180 con 0x7fba5c0b4d00 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.842+0000 7fba5be00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fba5c0d5000 con 0x7fba5c0d0b90 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.843+0000 7fba5aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c0b4920 0x7fba5c0cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.843+0000 7fba5aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c0b4920 0x7fba5c0cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33374/0 (socket says 172.21.15.44:33374) 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.843+0000 7fba5aa00640 1 -- 172.21.15.44:0/1612290354 learned_addr learned my addr 172.21.15.44:0/1612290354 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.843+0000 7fba5aa00640 1 -- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0d0b90 msgr2=0x7fba5c0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.843+0000 7fba5b400640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0d0b90 0x7fba5c0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.843+0000 7fba5a000640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba5c0b4d00 0x7fba5c1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.843+0000 7fba5aa00640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0d0b90 0x7fba5c0ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.843+0000 7fba5aa00640 1 -- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba5c0b4d00 msgr2=0x7fba5c1514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.843+0000 7fba5aa00640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba5c0b4d00 0x7fba5c1514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.843+0000 7fba5aa00640 1 -- 172.21.15.44:0/1612290354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c0ce0d0 con 0x7fba5c0b4920 2024-03-30T13:14:39.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.843+0000 7fba5b400640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0d0b90 0x7fba5c0ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:39.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.843+0000 7fba5a000640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba5c0b4d00 0x7fba5c1514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:39.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.844+0000 7fba5aa00640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c0b4920 0x7fba5c0cdb90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fba4c000c00 tx=0x7fba4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.844+0000 7fba52a00640 1 -- 172.21.15.44:0/1612290354 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c040020 con 0x7fba5c0b4920 2024-03-30T13:14:39.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.844+0000 7fba52a00640 1 -- 172.21.15.44:0/1612290354 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c038040 con 0x7fba5c0b4920 2024-03-30T13:14:39.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.844+0000 7fba52a00640 1 -- 172.21.15.44:0/1612290354 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c037070 con 0x7fba5c0b4920 2024-03-30T13:14:39.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.844+0000 7fba5be00640 1 -- 172.21.15.44:0/1612290354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c1f7cc0 con 0x7fba5c0b4920 2024-03-30T13:14:39.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.844+0000 7fba5be00640 1 -- 172.21.15.44:0/1612290354 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c1f8280 con 0x7fba5c0b4920 2024-03-30T13:14:39.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.848+0000 7fba52a00640 1 -- 172.21.15.44:0/1612290354 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fba4c043020 con 0x7fba5c0b4920 2024-03-30T13:14:39.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.848+0000 7fba645f8740 1 Processor -- start 2024-03-30T13:14:39.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.848+0000 7fba645f8740 1 -- start start 2024-03-30T13:14:39.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.849+0000 7fba52a00640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fba3806c530 0x7fba3806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.849+0000 7fba645f8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82470 0x55bc14ba8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.849+0000 7fba52a00640 1 -- 172.21.15.44:0/1612290354 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fba4c0acde0 con 0x7fba5c0b4920 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.849+0000 7fba645f8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba94e0 0x55bc14b814b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.849+0000 7fba645f8740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82850 0x55bc14b819f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.849+0000 7fba645f8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc14ae5330 con 0x55bc14ba94e0 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.849+0000 7fba645f8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bc14a8d620 con 0x55bc14b82470 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.849+0000 7fba645f8740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55bc14ae1440 con 0x55bc14b82850 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.850+0000 7fba5a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba94e0 0x55bc14b814b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.850+0000 7fba5a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba94e0 0x55bc14b814b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33388/0 (socket says 172.21.15.44:33388) 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.850+0000 7fba5a000640 1 -- 172.21.15.44:0/1333970968 learned_addr learned my addr 172.21.15.44:0/1333970968 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.850+0000 7fba5b400640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fba3806c530 0x7fba3806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.850+0000 7fba5aa00640 1 --2- 172.21.15.44:0/1333970968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82470 0x55bc14ba8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.850+0000 7fba5b400640 1 --2- 172.21.15.44:0/1333970968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82850 0x55bc14b819f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.850+0000 7fba5a000640 1 -- 172.21.15.44:0/1333970968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82850 msgr2=0x55bc14b819f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.850+0000 7fba5a000640 1 --2- 172.21.15.44:0/1333970968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82850 0x55bc14b819f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.850+0000 7fba5a000640 1 -- 172.21.15.44:0/1333970968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82470 msgr2=0x55bc14ba8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.850+0000 7fba5a000640 1 --2- 172.21.15.44:0/1333970968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82470 0x55bc14ba8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.850+0000 7fba5a000640 1 -- 172.21.15.44:0/1333970968 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc148c5920 con 0x55bc14ba94e0 2024-03-30T13:14:39.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.850+0000 7fba5aa00640 1 --2- 172.21.15.44:0/1333970968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82470 0x55bc14ba8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:39.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.851+0000 7fba5a000640 1 --2- 172.21.15.44:0/1333970968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba94e0 0x55bc14b814b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fba44009b70 tx=0x7fba44009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56141591290258e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.851+0000 7fba4b400640 1 -- 172.21.15.44:0/1333970968 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4400f040 con 0x55bc14ba94e0 2024-03-30T13:14:39.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.851+0000 7fba4b400640 1 -- 172.21.15.44:0/1333970968 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba44010e00 con 0x55bc14ba94e0 2024-03-30T13:14:39.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.851+0000 7fba4b400640 1 -- 172.21.15.44:0/1333970968 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44004270 con 0x55bc14ba94e0 2024-03-30T13:14:39.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.852+0000 7fba645f8740 1 -- 172.21.15.44:0/1333970968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba94e0 msgr2=0x55bc14b814b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.852+0000 7fba5b400640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fba3806c530 0x7fba3806e9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fba540018d0 tx=0x7fba540021b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.852+0000 7fba645f8740 1 --2- 172.21.15.44:0/1333970968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba94e0 0x55bc14b814b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fba44009b70 tx=0x7fba44009190 comp rx=0 tx=0).stop 2024-03-30T13:14:39.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.852+0000 7fba645f8740 1 -- 172.21.15.44:0/1333970968 shutdown_connections 2024-03-30T13:14:39.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.852+0000 7fba645f8740 1 --2- 172.21.15.44:0/1333970968 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82850 0x55bc14b819f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.852+0000 7fba645f8740 1 --2- 172.21.15.44:0/1333970968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba94e0 0x55bc14b814b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.852+0000 7fba645f8740 1 --2- 172.21.15.44:0/1333970968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82470 0x55bc14ba8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.852+0000 7fba645f8740 1 -- 172.21.15.44:0/1333970968 >> 172.21.15.44:0/1333970968 conn(0x55bc14b48be0 msgr2=0x55bc14bc7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.852+0000 7fba645f8740 1 -- 172.21.15.44:0/1333970968 shutdown_connections 2024-03-30T13:14:39.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.852+0000 7fba645f8740 1 -- 172.21.15.44:0/1333970968 wait complete. 2024-03-30T13:14:39.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.853+0000 7fba645f8740 1 -- start start 2024-03-30T13:14:39.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.853+0000 7fba645f8740 1 Processor -- start 2024-03-30T13:14:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.854+0000 7fba645f8740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82470 0x55bc14bae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.854+0000 7fba645f8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82850 0x55bc14bac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.854+0000 7fba645f8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14ba0310 0x55bc14bac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.854+0000 7fba645f8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc14ba8b10 con 0x55bc14b82850 2024-03-30T13:14:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.854+0000 7fba645f8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bc14aa09d0 con 0x55bc14ba0310 2024-03-30T13:14:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.854+0000 7fba645f8740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55bc14ba1890 con 0x55bc14b82470 2024-03-30T13:14:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.854+0000 7fba645f8740 10 client.0 _ll_register_callbacks cb 0x55bc14adcfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.854+0000 7fba5a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82850 0x55bc14bac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.854+0000 7fba5a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82850 0x55bc14bac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33398/0 (socket says 172.21.15.44:33398) 2024-03-30T13:14:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.854+0000 7fba5a000640 1 -- 172.21.15.44:0/1065121500 learned_addr learned my addr 172.21.15.44:0/1065121500 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.855+0000 7fba5b400640 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14ba0310 0x55bc14bac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.855+0000 7fba5aa00640 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82470 0x55bc14bae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.855+0000 7fba5a000640 1 -- 172.21.15.44:0/1065121500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82470 msgr2=0x55bc14bae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.855+0000 7fba5a000640 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82470 0x55bc14bae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.855+0000 7fba5a000640 1 -- 172.21.15.44:0/1065121500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14ba0310 msgr2=0x55bc14bac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.855+0000 7fba5a000640 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14ba0310 0x55bc14bac7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.855+0000 7fba5a000640 1 -- 172.21.15.44:0/1065121500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc147b9210 con 0x55bc14b82850 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.855+0000 7fba5a000640 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82850 0x55bc14bac270 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x55bc14bb0850 tx=0x7fba44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e08642cf9b1630f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.855+0000 7fba3fe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.855+0000 7fba3fe00640 1 -- 172.21.15.44:0/1065121500 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4402c060 con 0x55bc14b82850 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.855+0000 7fba3fe00640 1 -- 172.21.15.44:0/1065121500 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fba44010c00 con 0x55bc14b82850 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.855+0000 7fba645f8740 1 -- 172.21.15.44:0/1065121500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba44010e00 con 0x55bc14b82850 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.856+0000 7fba3fe00640 1 -- 172.21.15.44:0/1065121500 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fba44032050 con 0x55bc14b82850 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.856+0000 7fba645f8740 10 client.5706 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.856+0000 7fba645f8740 1 -- 172.21.15.44:0/1065121500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55bc149260b0 con 0x55bc14b82850 2024-03-30T13:14:39.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.856+0000 7fba3fe00640 1 -- 172.21.15.44:0/1065121500 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba44010e00 con 0x55bc14b82850 2024-03-30T13:14:39.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.856+0000 7fba3fe00640 1 -- 172.21.15.44:0/1065121500 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fba44035020 con 0x55bc14b82850 2024-03-30T13:14:39.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.856+0000 7fba645f8740 10 client.5706 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:39.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.856+0000 7fba645f8740 10 client.5706 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:39.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.856+0000 7fba645f8740 20 client.5706 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:39.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.856+0000 7fba645f8740 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bc14bad7b0 0x55bc14badbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.856+0000 7fba645f8740 4 client.5706 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:39.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.856+0000 7fba645f8740 1 -- 172.21.15.44:0/1065121500 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc14af2870 con 0x55bc14bad7b0 2024-03-30T13:14:39.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.857+0000 7fba5aa00640 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bc14bad7b0 0x55bc14badbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.857+0000 7fba5aa00640 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bc14bad7b0 0x55bc14badbc0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6912599ec32bb756 server_cookie=d580abbf0f17cdb3 in_seq=0 out_seq=0 2024-03-30T13:14:39.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.857+0000 7fba3fe00640 10 client.5706 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba3fe00640 1 -- 172.21.15.44:0/1065121500 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55bc14af2870 con 0x55bc14bad7b0 2024-03-30T13:14:39.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba3fe00640 10 client.5706 handle_command_reply: tid=0 2024-03-30T13:14:39.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba645f8740 1 client.5706 shutdown 2024-03-30T13:14:39.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba645f8740 1 -- 172.21.15.44:0/1065121500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82850 msgr2=0x55bc14bac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba645f8740 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82850 0x55bc14bac270 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x55bc14bb0850 tx=0x7fba44004730 comp rx=0 tx=0).stop 2024-03-30T13:14:39.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba645f8740 1 -- 172.21.15.44:0/1065121500 shutdown_connections 2024-03-30T13:14:39.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba645f8740 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bc14bad7b0 0x55bc14badbc0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba645f8740 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14ba0310 0x55bc14bac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba645f8740 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82850 0x55bc14bac270 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba645f8740 1 --2- 172.21.15.44:0/1065121500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82470 0x55bc14bae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba3fe00640 0 client.5706 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba645f8740 1 -- 172.21.15.44:0/1065121500 >> 172.21.15.44:0/1065121500 conn(0x55bc14b48be0 msgr2=0x55bc14b7bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba645f8740 1 -- 172.21.15.44:0/1065121500 shutdown_connections 2024-03-30T13:14:39.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba645f8740 1 -- 172.21.15.44:0/1065121500 wait complete. 2024-03-30T13:14:39.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.858+0000 7fba645f8740 20 client.5706 trim_cache size 0 max 16384 2024-03-30T13:14:39.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.874+0000 7fba645f8740 1 Processor -- start 2024-03-30T13:14:39.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.874+0000 7fba645f8740 1 -- start start 2024-03-30T13:14:39.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.875+0000 7fba645f8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82470 0x55bc14bacd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.875+0000 7fba645f8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82850 0x55bc14babe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.875+0000 7fba645f8740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14ba0310 0x55bc14be0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.875+0000 7fba645f8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55bc14bc1780 con 0x55bc14b82470 2024-03-30T13:14:39.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.875+0000 7fba645f8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c200f60 con 0x55bc14b82850 2024-03-30T13:14:39.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.875+0000 7fba645f8740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fba5c1fff90 con 0x55bc14ba0310 2024-03-30T13:14:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.876+0000 7fba5aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82470 0x55bc14bacd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.876+0000 7fba5aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82470 0x55bc14bacd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33412/0 (socket says 172.21.15.44:33412) 2024-03-30T13:14:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.876+0000 7fba5aa00640 1 -- 172.21.15.44:0/2142697611 learned_addr learned my addr 172.21.15.44:0/2142697611 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.876+0000 7fba5a000640 1 --2- 172.21.15.44:0/2142697611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82850 0x55bc14babe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.876+0000 7fba5b400640 1 --2- 172.21.15.44:0/2142697611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14ba0310 0x55bc14be0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.876+0000 7fba5aa00640 1 -- 172.21.15.44:0/2142697611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14ba0310 msgr2=0x55bc14be0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.876+0000 7fba5aa00640 1 --2- 172.21.15.44:0/2142697611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14ba0310 0x55bc14be0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.876+0000 7fba5aa00640 1 -- 172.21.15.44:0/2142697611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82850 msgr2=0x55bc14babe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.876+0000 7fba5aa00640 1 --2- 172.21.15.44:0/2142697611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82850 0x55bc14babe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.876+0000 7fba5aa00640 1 -- 172.21.15.44:0/2142697611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc147922d0 con 0x55bc14b82470 2024-03-30T13:14:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.876+0000 7fba5aa00640 1 --2- 172.21.15.44:0/2142697611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82470 0x55bc14bacd50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fba4c07a840 tx=0x7fba4c030b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8370c3d2b2cfa4b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.877+0000 7fba4aa00640 1 -- 172.21.15.44:0/2142697611 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c07ab40 con 0x55bc14b82470 2024-03-30T13:14:39.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.877+0000 7fba4aa00640 1 -- 172.21.15.44:0/2142697611 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c07eef0 con 0x55bc14b82470 2024-03-30T13:14:39.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.877+0000 7fba4aa00640 1 -- 172.21.15.44:0/2142697611 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c083720 con 0x55bc14b82470 2024-03-30T13:14:39.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.877+0000 7fba645f8740 1 -- 172.21.15.44:0/2142697611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82470 msgr2=0x55bc14bacd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.877+0000 7fba645f8740 1 --2- 172.21.15.44:0/2142697611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82470 0x55bc14bacd50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fba4c07a840 tx=0x7fba4c030b40 comp rx=0 tx=0).stop 2024-03-30T13:14:39.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.877+0000 7fba645f8740 1 -- 172.21.15.44:0/2142697611 shutdown_connections 2024-03-30T13:14:39.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.877+0000 7fba645f8740 1 --2- 172.21.15.44:0/2142697611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14ba0310 0x55bc14be0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.877+0000 7fba645f8740 1 --2- 172.21.15.44:0/2142697611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82850 0x55bc14babe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.877+0000 7fba645f8740 1 --2- 172.21.15.44:0/2142697611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14b82470 0x55bc14bacd50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.877+0000 7fba645f8740 1 -- 172.21.15.44:0/2142697611 >> 172.21.15.44:0/2142697611 conn(0x55bc14b48be0 msgr2=0x55bc14bbeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.877+0000 7fba645f8740 1 -- 172.21.15.44:0/2142697611 shutdown_connections 2024-03-30T13:14:39.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.877+0000 7fba645f8740 1 -- 172.21.15.44:0/2142697611 wait complete. 2024-03-30T13:14:39.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.878+0000 7fba645f8740 1 -- start start 2024-03-30T13:14:39.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.878+0000 7fba645f8740 1 Processor -- start 2024-03-30T13:14:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.879+0000 7fba645f8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82470 0x55bc14b77d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.879+0000 7fba645f8740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82850 0x55bc14c41d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.879+0000 7fba645f8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba0310 0x55bc14ba3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.879+0000 7fba645f8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c1ffa90 con 0x55bc14ba0310 2024-03-30T13:14:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.879+0000 7fba645f8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c0b9760 con 0x55bc14b82470 2024-03-30T13:14:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.879+0000 7fba645f8740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55bc14bc1780 con 0x55bc14b82850 2024-03-30T13:14:39.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.879+0000 7fba645f8740 10 client.0 _ll_register_callbacks cb 0x7fba440099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.879+0000 7fba5b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba0310 0x55bc14ba3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.880+0000 7fba5b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba0310 0x55bc14ba3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33416/0 (socket says 172.21.15.44:33416) 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.880+0000 7fba5b400640 1 -- 172.21.15.44:0/365350865 learned_addr learned my addr 172.21.15.44:0/365350865 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.880+0000 7fba5aa00640 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82470 0x55bc14b77d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.880+0000 7fba5a000640 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82850 0x55bc14c41d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.880+0000 7fba5b400640 1 -- 172.21.15.44:0/365350865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82850 msgr2=0x55bc14c41d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.880+0000 7fba5b400640 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82850 0x55bc14c41d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.880+0000 7fba5b400640 1 -- 172.21.15.44:0/365350865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82470 msgr2=0x55bc14b77d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.880+0000 7fba5b400640 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82470 0x55bc14b77d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.880+0000 7fba5b400640 1 -- 172.21.15.44:0/365350865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc14ba4340 con 0x55bc14ba0310 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.880+0000 7fba5b400640 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba0310 0x55bc14ba3e00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fba5c074d40 tx=0x7fba54005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d390eadc528b2f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.880+0000 7fba3fe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.881+0000 7fba3fe00640 1 -- 172.21.15.44:0/365350865 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba54010040 con 0x55bc14ba0310 2024-03-30T13:14:39.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.881+0000 7fba3fe00640 1 -- 172.21.15.44:0/365350865 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fba54013c70 con 0x55bc14ba0310 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.881+0000 7fba645f8740 1 -- 172.21.15.44:0/365350865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba4c07eef0 con 0x55bc14ba0310 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.881+0000 7fba3fe00640 1 -- 172.21.15.44:0/365350865 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fba5402e050 con 0x55bc14ba0310 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.881+0000 7fba645f8740 10 client.5712 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.881+0000 7fba645f8740 1 -- 172.21.15.44:0/365350865 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55bc14ba45e0 con 0x55bc14ba0310 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.881+0000 7fba3fe00640 1 -- 172.21.15.44:0/365350865 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c07eef0 con 0x55bc14ba0310 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.881+0000 7fba3fe00640 1 -- 172.21.15.44:0/365350865 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fba54031020 con 0x55bc14ba0310 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.882+0000 7fba645f8740 10 client.5712 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.882+0000 7fba645f8740 10 client.5712 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.882+0000 7fba645f8740 20 client.5712 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.882+0000 7fba645f8740 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bc14b813a0 0x55bc14ba7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.882+0000 7fba645f8740 4 client.5712 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628308}] 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.882+0000 7fba645f8740 1 -- 172.21.15.44:0/365350865 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628308}) -- 0x55bc14aecbc0 con 0x55bc14b813a0 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.882+0000 7fba5aa00640 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bc14b813a0 0x55bc14ba7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:39.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.882+0000 7fba5aa00640 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bc14b813a0 0x55bc14ba7230 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf74f7f6d2b677b0 server_cookie=57e82839b5b2af89 in_seq=0 out_seq=0 2024-03-30T13:14:39.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.882+0000 7fba3fe00640 10 client.5712 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba3fe00640 1 -- 172.21.15.44:0/365350865 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4330 (crc 0 0 0) 0x55bc14aecbc0 con 0x55bc14b813a0 2024-03-30T13:14:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba3fe00640 10 client.5712 handle_command_reply: tid=0 2024-03-30T13:14:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba645f8740 1 client.5712 shutdown 2024-03-30T13:14:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba645f8740 1 -- 172.21.15.44:0/365350865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba0310 msgr2=0x55bc14ba3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba645f8740 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba0310 0x55bc14ba3e00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fba5c074d40 tx=0x7fba54005b70 comp rx=0 tx=0).stop 2024-03-30T13:14:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba645f8740 1 -- 172.21.15.44:0/365350865 shutdown_connections 2024-03-30T13:14:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba645f8740 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55bc14b813a0 0x55bc14ba7230 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba645f8740 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55bc14ba0310 0x55bc14ba3e00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba645f8740 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc14b82850 0x55bc14c41d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba645f8740 1 --2- 172.21.15.44:0/365350865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc14b82470 0x55bc14b77d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba3fe00640 0 client.5712 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:39.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba645f8740 1 -- 172.21.15.44:0/365350865 >> 172.21.15.44:0/365350865 conn(0x55bc14b48be0 msgr2=0x55bc14bbe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba645f8740 1 -- 172.21.15.44:0/365350865 shutdown_connections 2024-03-30T13:14:39.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba645f8740 1 -- 172.21.15.44:0/365350865 wait complete. 2024-03-30T13:14:39.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.883+0000 7fba645f8740 20 client.5712 trim_cache size 0 max 16384 2024-03-30T13:14:39.892 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/Kconfig", 2024-03-30T13:14:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628308, 2024-03-30T13:14:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.220640+0000", 2024-03-30T13:14:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.197259+0000", 2024-03-30T13:14:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.893 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 1240, 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.197259+0000", 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:39.894 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 1 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:39.895 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1240, 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.220640+0000" 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1240, 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:39.896 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.220640+0000" 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 68, 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 2, 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:14:39.897 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:39.898 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 1, 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 1, 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:39.899 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 1, 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 1, 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 6, 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:39.900 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 1, 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.901 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:39.902 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:39.903 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:39.904 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:39.905 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:39.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.884+0000 7fba5be00640 1 -- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fba3806c530 msgr2=0x7fba3806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.884+0000 7fba5be00640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fba3806c530 0x7fba3806e9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fba540018d0 tx=0x7fba540021b0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.884+0000 7fba5be00640 1 -- 172.21.15.44:0/1612290354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c0b4920 msgr2=0x7fba5c0cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:39.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.884+0000 7fba5be00640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c0b4920 0x7fba5c0cdb90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fba4c000c00 tx=0x7fba4c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.884+0000 7fba5be00640 1 -- 172.21.15.44:0/1612290354 shutdown_connections 2024-03-30T13:14:39.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.884+0000 7fba5be00640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fba5c0d0b90 0x7fba5c0ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.884+0000 7fba5be00640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fba3806c530 0x7fba3806e9f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.884+0000 7fba5be00640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba5c0b4d00 0x7fba5c1514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.884+0000 7fba5be00640 1 --2- 172.21.15.44:0/1612290354 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fba5c0b4920 0x7fba5c0cdb90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:39.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.884+0000 7fba5be00640 1 -- 172.21.15.44:0/1612290354 >> 172.21.15.44:0/1612290354 conn(0x7fba5c09d4e0 msgr2=0x7fba5c0b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:39.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.884+0000 7fba5be00640 1 -- 172.21.15.44:0/1612290354 shutdown_connections 2024-03-30T13:14:39.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:39.884+0000 7fba5be00640 1 -- 172.21.15.44:0/1612290354 wait complete. 2024-03-30T13:14:39.910 DEBUG:tasks.cephfs.test_uninlining:getting inode info #7 of 23:1099511628326 2024-03-30T13:14:39.911 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628326 2024-03-30T13:14:39.911 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628326 2024-03-30T13:14:40.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.127+0000 7fb7b6200640 1 Processor -- start 2024-03-30T13:14:40.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.128+0000 7fb7b6200640 1 -- start start 2024-03-30T13:14:40.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.129+0000 7fb7b6200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb7b00b4d00 0x7fb7b00d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.129+0000 7fb7b6200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb7b00d0b90 0x7fb7b00d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.129+0000 7fb7b6200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7b00b54b0 con 0x7fb7b00b4920 2024-03-30T13:14:40.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.129+0000 7fb7b6200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb7b00d0260 con 0x7fb7b00b4d00 2024-03-30T13:14:40.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.129+0000 7fb7b6200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fb7b00cfca0 con 0x7fb7b00d0b90 2024-03-30T13:14:40.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.129+0000 7fb7b4e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb7b00b4920 0x7fb7b00b3ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36808/0 (socket says 172.21.15.44:36808) 2024-03-30T13:14:40.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.130+0000 7fb7afe00640 1 --2- 172.21.15.44:0/2264745660 >> v2:172.21.15.44:3300/0 conn(0x7fb7b00b4d00 0x7fb7b00d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.130+0000 7fb7b4e00640 1 -- 172.21.15.44:0/2264745660 learned_addr learned my addr 172.21.15.44:0/2264745660 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:40.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.130+0000 7fb7b5800640 1 --2- 172.21.15.44:0/2264745660 >> v2:172.21.15.151:3300/0 conn(0x7fb7b00d0b90 0x7fb7b00d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.130+0000 7fb7afe00640 1 -- 172.21.15.44:0/2264745660 >> v2:172.21.15.151:3300/0 conn(0x7fb7b00d0b90 msgr2=0x7fb7b00d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.130+0000 7fb7afe00640 1 --2- 172.21.15.44:0/2264745660 >> v2:172.21.15.151:3300/0 conn(0x7fb7b00d0b90 0x7fb7b00d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.130+0000 7fb7afe00640 1 -- 172.21.15.44:0/2264745660 >> v1:172.21.15.44:6789/0 conn(0x7fb7b00b4920 legacy=0x7fb7b00b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.130+0000 7fb7afe00640 1 -- 172.21.15.44:0/2264745660 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b00cff80 con 0x7fb7b00b4d00 2024-03-30T13:14:40.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.130+0000 7fb7b5800640 1 --2- 172.21.15.44:0/2264745660 >> v2:172.21.15.151:3300/0 conn(0x7fb7b00d0b90 0x7fb7b00d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:40.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.131+0000 7fb7afe00640 1 --2- 172.21.15.44:0/2264745660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b00b4d00 0x7fb7b00d4ac0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb7b00ce780 tx=0x7fb79c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81a199412a5f168 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.132+0000 7fb7af400640 1 -- 172.21.15.44:0/2264745660 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c0315a0 con 0x7fb7b00b4d00 2024-03-30T13:14:40.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.132+0000 7fb7af400640 1 -- 172.21.15.44:0/2264745660 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c037070 con 0x7fb7b00b4d00 2024-03-30T13:14:40.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.132+0000 7fb7af400640 1 -- 172.21.15.44:0/2264745660 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c031960 con 0x7fb7b00b4d00 2024-03-30T13:14:40.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.132+0000 7fb7b6200640 1 -- 172.21.15.44:0/2264745660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b00b4d00 msgr2=0x7fb7b00d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.132+0000 7fb7b6200640 1 --2- 172.21.15.44:0/2264745660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b00b4d00 0x7fb7b00d4ac0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb7b00ce780 tx=0x7fb79c02b840 comp rx=0 tx=0).stop 2024-03-30T13:14:40.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.132+0000 7fb7b6200640 1 -- 172.21.15.44:0/2264745660 shutdown_connections 2024-03-30T13:14:40.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.132+0000 7fb7b6200640 1 --2- 172.21.15.44:0/2264745660 >> v2:172.21.15.151:3300/0 conn(0x7fb7b00d0b90 0x7fb7b00d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.132+0000 7fb7b6200640 1 --2- 172.21.15.44:0/2264745660 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b00b4d00 0x7fb7b00d4ac0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.132+0000 7fb7b6200640 1 -- 172.21.15.44:0/2264745660 >> 172.21.15.44:0/2264745660 conn(0x7fb7b009d4e0 msgr2=0x7fb7b00d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.132+0000 7fb7b6200640 1 -- 172.21.15.44:0/2264745660 shutdown_connections 2024-03-30T13:14:40.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.133+0000 7fb7b6200640 1 -- 172.21.15.44:0/2264745660 wait complete. 2024-03-30T13:14:40.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.134+0000 7fb7b6200640 1 Processor -- start 2024-03-30T13:14:40.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.134+0000 7fb7b6200640 1 -- start start 2024-03-30T13:14:40.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.135+0000 7fb7b6200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7b00b4920 0x7fb7b01e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.135+0000 7fb7b6200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7b00b4d00 0x7fb7b00b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.135+0000 7fb7b6200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b00d0b90 0x7fb7b01f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.135+0000 7fb7b6200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b00d5000 con 0x7fb7b00d0b90 2024-03-30T13:14:40.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.135+0000 7fb7b6200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b00d2180 con 0x7fb7b00b4920 2024-03-30T13:14:40.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.135+0000 7fb7b6200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b00cf8c0 con 0x7fb7b00b4d00 2024-03-30T13:14:40.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.136+0000 7fb7b5800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b00d0b90 0x7fb7b01f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.136+0000 7fb7b4e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7b00b4920 0x7fb7b01e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.136+0000 7fb7b5800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b00d0b90 0x7fb7b01f7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33444/0 (socket says 172.21.15.44:33444) 2024-03-30T13:14:40.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.136+0000 7fb7b5800640 1 -- 172.21.15.44:0/1723236724 learned_addr learned my addr 172.21.15.44:0/1723236724 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.136+0000 7fb7afe00640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7b00b4d00 0x7fb7b00b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.136+0000 7fb7b5800640 1 -- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7b00b4d00 msgr2=0x7fb7b00b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.136+0000 7fb7b5800640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7b00b4d00 0x7fb7b00b7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.136+0000 7fb7b5800640 1 -- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7b00b4920 msgr2=0x7fb7b01e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.136+0000 7fb7b5800640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7b00b4920 0x7fb7b01e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.136+0000 7fb7b5800640 1 -- 172.21.15.44:0/1723236724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b00b8440 con 0x7fb7b00d0b90 2024-03-30T13:14:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.136+0000 7fb7afe00640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7b00b4d00 0x7fb7b00b7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.137+0000 7fb7b5800640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b00d0b90 0x7fb7b01f7e70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800c7f0 tx=0x7fb7a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.137+0000 7fb7acc00640 1 -- 172.21.15.44:0/1723236724 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8015070 con 0x7fb7b00d0b90 2024-03-30T13:14:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.137+0000 7fb7acc00640 1 -- 172.21.15.44:0/1723236724 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a8007820 con 0x7fb7b00d0b90 2024-03-30T13:14:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.137+0000 7fb7acc00640 1 -- 172.21.15.44:0/1723236724 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8007c50 con 0x7fb7b00d0b90 2024-03-30T13:14:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.137+0000 7fb7b6200640 1 -- 172.21.15.44:0/1723236724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b00b86e0 con 0x7fb7b00d0b90 2024-03-30T13:14:40.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.137+0000 7fb7b6200640 1 -- 172.21.15.44:0/1723236724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b00b8ca0 con 0x7fb7b00d0b90 2024-03-30T13:14:40.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.140+0000 7fb7acc00640 1 -- 172.21.15.44:0/1723236724 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb7a8018070 con 0x7fb7b00d0b90 2024-03-30T13:14:40.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.141+0000 7fb7acc00640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb79006c530 0x7fb79006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.141+0000 7fb7acc00640 1 -- 172.21.15.44:0/1723236724 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fb7a808ba30 con 0x7fb7b00d0b90 2024-03-30T13:14:40.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.141+0000 7fb7b4e00640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb79006c530 0x7fb79006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.142+0000 7fb7ba58d740 1 Processor -- start 2024-03-30T13:14:40.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.142+0000 7fb7ba58d740 1 -- start start 2024-03-30T13:14:40.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.142+0000 7fb7b4e00640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb79006c530 0x7fb79006e9f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00012e0 tx=0x7fb7a0001990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.143+0000 7fb7ba58d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08778470 0x55ff0879efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.143+0000 7fb7ba58d740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff0879f4e0 0x55ff087774b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.143+0000 7fb7ba58d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087779f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.143+0000 7fb7ba58d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff086db330 con 0x55ff08778850 2024-03-30T13:14:40.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.143+0000 7fb7ba58d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ff08683620 con 0x55ff08778470 2024-03-30T13:14:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.143+0000 7fb7ba58d740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55ff086d7440 con 0x55ff0879f4e0 2024-03-30T13:14:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.143+0000 7fb7b5800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087779f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.143+0000 7fb7b5800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087779f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33450/0 (socket says 172.21.15.44:33450) 2024-03-30T13:14:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.143+0000 7fb7b5800640 1 -- 172.21.15.44:0/182439843 learned_addr learned my addr 172.21.15.44:0/182439843 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.143+0000 7fb7b4e00640 1 --2- 172.21.15.44:0/182439843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08778470 0x55ff0879efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.143+0000 7fb7afe00640 1 --2- 172.21.15.44:0/182439843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff0879f4e0 0x55ff087774b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.144+0000 7fb7b5800640 1 -- 172.21.15.44:0/182439843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff0879f4e0 msgr2=0x55ff087774b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.144+0000 7fb7b5800640 1 --2- 172.21.15.44:0/182439843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff0879f4e0 0x55ff087774b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.144+0000 7fb7b5800640 1 -- 172.21.15.44:0/182439843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08778470 msgr2=0x55ff0879efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.144+0000 7fb7b5800640 1 --2- 172.21.15.44:0/182439843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08778470 0x55ff0879efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.144+0000 7fb7b5800640 1 -- 172.21.15.44:0/182439843 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff084bb920 con 0x55ff08778850 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.144+0000 7fb7b5800640 1 --2- 172.21.15.44:0/182439843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087779f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8089c80 tx=0x7fb7a805dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b24a6f39a19b12 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.144+0000 7fb7a5600640 1 -- 172.21.15.44:0/182439843 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a801f040 con 0x55ff08778850 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.144+0000 7fb7a5600640 1 -- 172.21.15.44:0/182439843 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a8058c00 con 0x55ff08778850 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.144+0000 7fb7a5600640 1 -- 172.21.15.44:0/182439843 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a808b040 con 0x55ff08778850 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.145+0000 7fb7ba58d740 1 -- 172.21.15.44:0/182439843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 msgr2=0x55ff087779f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.145+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/182439843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087779f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8089c80 tx=0x7fb7a805dc30 comp rx=0 tx=0).stop 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.145+0000 7fb7ba58d740 1 -- 172.21.15.44:0/182439843 shutdown_connections 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.145+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/182439843 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087779f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.145+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/182439843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff0879f4e0 0x55ff087774b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.145+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/182439843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08778470 0x55ff0879efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.145+0000 7fb7ba58d740 1 -- 172.21.15.44:0/182439843 >> 172.21.15.44:0/182439843 conn(0x55ff0873ebe0 msgr2=0x55ff087bd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.145+0000 7fb7ba58d740 1 -- 172.21.15.44:0/182439843 shutdown_connections 2024-03-30T13:14:40.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.145+0000 7fb7ba58d740 1 -- 172.21.15.44:0/182439843 wait complete. 2024-03-30T13:14:40.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.146+0000 7fb7ba58d740 1 -- start start 2024-03-30T13:14:40.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.147+0000 7fb7ba58d740 1 Processor -- start 2024-03-30T13:14:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.148+0000 7fb7ba58d740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08778470 0x55ff087a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.148+0000 7fb7ba58d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087770a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.148+0000 7fb7ba58d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08795b30 0x55ff087775e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.148+0000 7fb7ba58d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff0879eb10 con 0x55ff08778850 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.148+0000 7fb7ba58d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ff086969d0 con 0x55ff08795b30 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.148+0000 7fb7ba58d740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55ff08797890 con 0x55ff08778470 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.149+0000 7fb7ba58d740 10 client.0 _ll_register_callbacks cb 0x55ff086d2fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.149+0000 7fb7afe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087770a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.149+0000 7fb7afe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087770a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33466/0 (socket says 172.21.15.44:33466) 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.149+0000 7fb7afe00640 1 -- 172.21.15.44:0/1803919837 learned_addr learned my addr 172.21.15.44:0/1803919837 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.149+0000 7fb7afe00640 1 -- 172.21.15.44:0/1803919837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08778470 msgr2=0x55ff087a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.149+0000 7fb7b4e00640 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08778470 0x55ff087a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.149+0000 7fb7b5800640 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08795b30 0x55ff087775e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.149+0000 7fb7afe00640 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08778470 0x55ff087a4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.149+0000 7fb7afe00640 1 -- 172.21.15.44:0/1803919837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08795b30 msgr2=0x55ff087775e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.149+0000 7fb7afe00640 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08795b30 0x55ff087775e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.149+0000 7fb7afe00640 1 -- 172.21.15.44:0/1803919837 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff083af210 con 0x55ff08778850 2024-03-30T13:14:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.150+0000 7fb7afe00640 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087770a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb79c02b880 tx=0x7fb79c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681cb5cc4955a401 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.150+0000 7fb79a000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.150+0000 7fb79a000640 1 -- 172.21.15.44:0/1803919837 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c032840 con 0x55ff08778850 2024-03-30T13:14:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.150+0000 7fb79a000640 1 -- 172.21.15.44:0/1803919837 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fb79c0329e0 con 0x55ff08778850 2024-03-30T13:14:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.150+0000 7fb7ba58d740 1 -- 172.21.15.44:0/1803919837 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7a8058c00 con 0x55ff08778850 2024-03-30T13:14:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.150+0000 7fb79a000640 1 -- 172.21.15.44:0/1803919837 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb79c053050 con 0x55ff08778850 2024-03-30T13:14:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.150+0000 7fb7ba58d740 10 client.5727 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.150+0000 7fb7ba58d740 1 -- 172.21.15.44:0/1803919837 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55ff0851c0b0 con 0x55ff08778850 2024-03-30T13:14:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.150+0000 7fb79a000640 1 -- 172.21.15.44:0/1803919837 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a8058c00 con 0x55ff08778850 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.151+0000 7fb79a000640 1 -- 172.21.15.44:0/1803919837 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fb79c056020 con 0x55ff08778850 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.151+0000 7fb7ba58d740 10 client.5727 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.151+0000 7fb7ba58d740 10 client.5727 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.151+0000 7fb7ba58d740 20 client.5727 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.151+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ff087bbf60 0x55ff087bc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.151+0000 7fb7ba58d740 4 client.5727 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.151+0000 7fb7ba58d740 1 -- 172.21.15.44:0/1803919837 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff086e8870 con 0x55ff087bbf60 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.151+0000 7fb7b4e00640 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ff087bbf60 0x55ff087bc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.152+0000 7fb7b4e00640 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ff087bbf60 0x55ff087bc360 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=403636c6cdb4b157 server_cookie=422ada770e32ed0 in_seq=0 out_seq=0 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.152+0000 7fb79a000640 10 client.5727 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.152+0000 7fb79a000640 1 -- 172.21.15.44:0/1803919837 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55ff086e8870 con 0x55ff087bbf60 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.152+0000 7fb79a000640 10 client.5727 handle_command_reply: tid=0 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.152+0000 7fb7ba58d740 1 client.5727 shutdown 2024-03-30T13:14:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.153+0000 7fb7ba58d740 1 -- 172.21.15.44:0/1803919837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 msgr2=0x55ff087770a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.153+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087770a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb79c02b880 tx=0x7fb79c02e000 comp rx=0 tx=0).stop 2024-03-30T13:14:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.153+0000 7fb7ba58d740 1 -- 172.21.15.44:0/1803919837 shutdown_connections 2024-03-30T13:14:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.153+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ff087bbf60 0x55ff087bc360 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.153+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08795b30 0x55ff087775e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.153+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087770a0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.153+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/1803919837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08778470 0x55ff087a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.153+0000 7fb7ba58d740 1 -- 172.21.15.44:0/1803919837 >> 172.21.15.44:0/1803919837 conn(0x55ff0873ebe0 msgr2=0x55ff08771b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.153+0000 7fb79a000640 0 client.5727 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.153+0000 7fb7ba58d740 1 -- 172.21.15.44:0/1803919837 shutdown_connections 2024-03-30T13:14:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.153+0000 7fb7ba58d740 1 -- 172.21.15.44:0/1803919837 wait complete. 2024-03-30T13:14:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.153+0000 7fb7ba58d740 20 client.5727 trim_cache size 0 max 16384 2024-03-30T13:14:40.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.169+0000 7fb7ba58d740 1 Processor -- start 2024-03-30T13:14:40.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.169+0000 7fb7ba58d740 1 -- start start 2024-03-30T13:14:40.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.170+0000 7fb7ba58d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08778470 0x55ff087cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.170+0000 7fb7ba58d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087a2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.170+0000 7fb7ba58d740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08795b30 0x55ff087a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.170+0000 7fb7ba58d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b0200fb0 con 0x55ff08778850 2024-03-30T13:14:40.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.170+0000 7fb7ba58d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b01fffe0 con 0x55ff08778470 2024-03-30T13:14:40.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.170+0000 7fb7ba58d740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b01f52e0 con 0x55ff08795b30 2024-03-30T13:14:40.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.170+0000 7fb7afe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.170+0000 7fb7afe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087a2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33478/0 (socket says 172.21.15.44:33478) 2024-03-30T13:14:40.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.170+0000 7fb7afe00640 1 -- 172.21.15.44:0/298900048 learned_addr learned my addr 172.21.15.44:0/298900048 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.171+0000 7fb7afe00640 1 -- 172.21.15.44:0/298900048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08795b30 msgr2=0x55ff087a26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.171+0000 7fb7afe00640 1 --2- 172.21.15.44:0/298900048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08795b30 0x55ff087a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.171+0000 7fb7afe00640 1 -- 172.21.15.44:0/298900048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08778470 msgr2=0x55ff087cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.171+0000 7fb7afe00640 1 --2- 172.21.15.44:0/298900048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08778470 0x55ff087cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.171+0000 7fb7afe00640 1 -- 172.21.15.44:0/298900048 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff083882d0 con 0x55ff08778850 2024-03-30T13:14:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.171+0000 7fb7afe00640 1 --2- 172.21.15.44:0/298900048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087a2180 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb79c02bf90 tx=0x7fb79c031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d646bb01a2273f37 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.171+0000 7fb7a4c00640 1 -- 172.21.15.44:0/298900048 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c004140 con 0x55ff08778850 2024-03-30T13:14:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.171+0000 7fb7a4c00640 1 -- 172.21.15.44:0/298900048 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c04b070 con 0x55ff08778850 2024-03-30T13:14:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.171+0000 7fb7a4c00640 1 -- 172.21.15.44:0/298900048 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c0044e0 con 0x55ff08778850 2024-03-30T13:14:40.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.172+0000 7fb7ba58d740 1 -- 172.21.15.44:0/298900048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 msgr2=0x55ff087a2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.172+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/298900048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087a2180 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb79c02bf90 tx=0x7fb79c031000 comp rx=0 tx=0).stop 2024-03-30T13:14:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.172+0000 7fb7ba58d740 1 -- 172.21.15.44:0/298900048 shutdown_connections 2024-03-30T13:14:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.172+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/298900048 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08795b30 0x55ff087a26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.172+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/298900048 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778850 0x55ff087a2180 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.172+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/298900048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08778470 0x55ff087cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.172+0000 7fb7ba58d740 1 -- 172.21.15.44:0/298900048 >> 172.21.15.44:0/298900048 conn(0x55ff0873ebe0 msgr2=0x55ff087bc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.172+0000 7fb7ba58d740 1 -- 172.21.15.44:0/298900048 shutdown_connections 2024-03-30T13:14:40.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.172+0000 7fb7ba58d740 1 -- 172.21.15.44:0/298900048 wait complete. 2024-03-30T13:14:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.173+0000 7fb7ba58d740 1 -- start start 2024-03-30T13:14:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.173+0000 7fb7ba58d740 1 Processor -- start 2024-03-30T13:14:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7ba58d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778470 0x55ff08833980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7ba58d740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08778850 0x55ff087a2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7ba58d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08795b30 0x55ff087a3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7ba58d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b00ccbb0 con 0x55ff08778470 2024-03-30T13:14:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7ba58d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ff087940c0 con 0x55ff08795b30 2024-03-30T13:14:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7ba58d740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55ff087a2920 con 0x55ff08778850 2024-03-30T13:14:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7ba58d740 10 client.0 _ll_register_callbacks cb 0x7fb79c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7b4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778470 0x55ff08833980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7b4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778470 0x55ff08833980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33492/0 (socket says 172.21.15.44:33492) 2024-03-30T13:14:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7b4e00640 1 -- 172.21.15.44:0/585625228 learned_addr learned my addr 172.21.15.44:0/585625228 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7b4e00640 1 -- 172.21.15.44:0/585625228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08778850 msgr2=0x55ff087a2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7b4e00640 1 --2- 172.21.15.44:0/585625228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08778850 0x55ff087a2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7b4e00640 1 -- 172.21.15.44:0/585625228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08795b30 msgr2=0x55ff087a3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7b4e00640 1 --2- 172.21.15.44:0/585625228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08795b30 0x55ff087a3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.174+0000 7fb7b4e00640 1 -- 172.21.15.44:0/585625228 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff0879d2a0 con 0x55ff08778470 2024-03-30T13:14:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.175+0000 7fb7b4e00640 1 --2- 172.21.15.44:0/585625228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778470 0x55ff08833980 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x55ff087cce90 tx=0x7fb7a0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a93a3dfbb939da server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.175+0000 7fb79a000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.175+0000 7fb79a000640 1 -- 172.21.15.44:0/585625228 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a00260e0 con 0x55ff08778470 2024-03-30T13:14:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.175+0000 7fb79a000640 1 -- 172.21.15.44:0/585625228 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fb7a0026280 con 0x55ff08778470 2024-03-30T13:14:40.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.175+0000 7fb7ba58d740 1 -- 172.21.15.44:0/585625228 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb79c04b070 con 0x55ff08778470 2024-03-30T13:14:40.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.175+0000 7fb79a000640 1 -- 172.21.15.44:0/585625228 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb7a0034050 con 0x55ff08778470 2024-03-30T13:14:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.175+0000 7fb7ba58d740 10 client.5733 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.175+0000 7fb7ba58d740 1 -- 172.21.15.44:0/585625228 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55ff08777810 con 0x55ff08778470 2024-03-30T13:14:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.176+0000 7fb79a000640 1 -- 172.21.15.44:0/585625228 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c04b070 con 0x55ff08778470 2024-03-30T13:14:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.176+0000 7fb79a000640 1 -- 172.21.15.44:0/585625228 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fb7a0037020 con 0x55ff08778470 2024-03-30T13:14:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.176+0000 7fb7ba58d740 10 client.5733 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.176+0000 7fb7ba58d740 10 client.5733 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.176+0000 7fb7ba58d740 20 client.5733 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.176+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/585625228 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ff08775f00 0x55ff08776320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.176+0000 7fb7ba58d740 4 client.5733 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628326}] 2024-03-30T13:14:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.176+0000 7fb7ba58d740 1 -- 172.21.15.44:0/585625228 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628326}) -- 0x55ff087bdf90 con 0x55ff08775f00 2024-03-30T13:14:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.176+0000 7fb7afe00640 1 --2- 172.21.15.44:0/585625228 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ff08775f00 0x55ff08776320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb7afe00640 1 --2- 172.21.15.44:0/585625228 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ff08775f00 0x55ff08776320 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab2aed3cf1d18766 server_cookie=f44a04c87ddbc82c in_seq=0 out_seq=0 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb79a000640 10 client.5733 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb79a000640 1 -- 172.21.15.44:0/585625228 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4336 (crc 0 0 0) 0x55ff087bdf90 con 0x55ff08775f00 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb79a000640 10 client.5733 handle_command_reply: tid=0 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb7ba58d740 1 client.5733 shutdown 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb7ba58d740 1 -- 172.21.15.44:0/585625228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778470 msgr2=0x55ff08833980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/585625228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778470 0x55ff08833980 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x55ff087cce90 tx=0x7fb7a0001250 comp rx=0 tx=0).stop 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb7ba58d740 1 -- 172.21.15.44:0/585625228 shutdown_connections 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/585625228 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ff08775f00 0x55ff08776320 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/585625228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ff08795b30 0x55ff087a3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/585625228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ff08778850 0x55ff087a2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb7ba58d740 1 --2- 172.21.15.44:0/585625228 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff08778470 0x55ff08833980 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb79a000640 0 client.5733 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.177+0000 7fb7ba58d740 1 -- 172.21.15.44:0/585625228 >> 172.21.15.44:0/585625228 conn(0x55ff0873ebe0 msgr2=0x55ff087a2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.178+0000 7fb7ba58d740 1 -- 172.21.15.44:0/585625228 shutdown_connections 2024-03-30T13:14:40.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.178+0000 7fb7ba58d740 1 -- 172.21.15.44:0/585625228 wait complete. 2024-03-30T13:14:40.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.178+0000 7fb7ba58d740 20 client.5733 trim_cache size 0 max 16384 2024-03-30T13:14:40.186 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:40.186 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/xattr_user.c", 2024-03-30T13:14:40.186 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628326, 2024-03-30T13:14:40.186 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:40.186 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.226910+0000", 2024-03-30T13:14:40.186 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.245258+0000", 2024-03-30T13:14:40.186 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:40.186 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:40.186 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.187 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 1232, 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.245258+0000", 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:14:40.188 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 1 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.189 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1232, 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.226910+0000" 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1232, 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:40.190 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.226910+0000" 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 76, 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 38, 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:40.191 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:40.192 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 1, 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:40.193 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 1, 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 1, 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 1, 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 6, 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:40.194 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:40.195 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 1, 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:40.196 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:40.197 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:40.198 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:40.199 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:40.199 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:40.199 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.199 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:40.199 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:40.199 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:40.199 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:40.199 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.178+0000 7fb7b6200640 1 -- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb79006c530 msgr2=0x7fb79006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.178+0000 7fb7b6200640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb79006c530 0x7fb79006e9f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00012e0 tx=0x7fb7a0001990 comp rx=0 tx=0).stop 2024-03-30T13:14:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.178+0000 7fb7b6200640 1 -- 172.21.15.44:0/1723236724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b00d0b90 msgr2=0x7fb7b01f7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.178+0000 7fb7b6200640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b00d0b90 0x7fb7b01f7e70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb7a800c7f0 tx=0x7fb7a800ccb0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.178+0000 7fb7b6200640 1 -- 172.21.15.44:0/1723236724 shutdown_connections 2024-03-30T13:14:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.178+0000 7fb7b6200640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7b00d0b90 0x7fb7b01f7e70 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.178+0000 7fb7b6200640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7b00b4d00 0x7fb7b00b7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.178+0000 7fb7b6200640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb79006c530 0x7fb79006e9f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.178+0000 7fb7b6200640 1 --2- 172.21.15.44:0/1723236724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7b00b4920 0x7fb7b01e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.179+0000 7fb7b6200640 1 -- 172.21.15.44:0/1723236724 >> 172.21.15.44:0/1723236724 conn(0x7fb7b009d4e0 msgr2=0x7fb7b00cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.179+0000 7fb7b6200640 1 -- 172.21.15.44:0/1723236724 shutdown_connections 2024-03-30T13:14:40.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.179+0000 7fb7b6200640 1 -- 172.21.15.44:0/1723236724 wait complete. 2024-03-30T13:14:40.201 DEBUG:tasks.cephfs.test_uninlining:getting inode info #8 of 23:1099511628324 2024-03-30T13:14:40.202 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628324 2024-03-30T13:14:40.202 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628324 2024-03-30T13:14:40.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.403+0000 7f37e5200640 1 Processor -- start 2024-03-30T13:14:40.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.403+0000 7f37e5200640 1 -- start start 2024-03-30T13:14:40.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.405+0000 7f37e5200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f37e00b4d00 0x7f37e00d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.405+0000 7f37e5200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37e00d0b90 0x7f37e00d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.405+0000 7f37e5200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37e00b54b0 con 0x7f37e00b4920 2024-03-30T13:14:40.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.405+0000 7f37e5200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f37e00d0260 con 0x7f37e00b4d00 2024-03-30T13:14:40.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.405+0000 7f37e5200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f37e00cfca0 con 0x7f37e00d0b90 2024-03-30T13:14:40.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.406+0000 7f37d7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f37e00b4d00 0x7f37e00d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.406+0000 7f37d7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f37e00b4d00 0x7f37e00d4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33508/0 (socket says 172.21.15.44:33508) 2024-03-30T13:14:40.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.406+0000 7f37d7e00640 1 -- 172.21.15.44:0/748481181 learned_addr learned my addr 172.21.15.44:0/748481181 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.406+0000 7f37dfe00640 1 --2- 172.21.15.44:0/748481181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37e00d0b90 0x7f37e00d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.406+0000 7f37d7e00640 1 -- 172.21.15.44:0/748481181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37e00d0b90 msgr2=0x7f37e00d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.406+0000 7f37d7e00640 1 --2- 172.21.15.44:0/748481181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37e00d0b90 0x7f37e00d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.406+0000 7f37d7e00640 1 -- 172.21.15.44:0/748481181 >> v1:172.21.15.151:6789/0 conn(0x7f37e00b4920 legacy=0x7f37e00b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.406+0000 7f37d7e00640 1 -- 172.21.15.44:0/748481181 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e00cff80 con 0x7f37e00b4d00 2024-03-30T13:14:40.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.408+0000 7f37d7e00640 1 --2- 172.21.15.44:0/748481181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37e00b4d00 0x7f37e00d4ac0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009870 tx=0x7f37c802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6369c8bfe13b7b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.408+0000 7f37dea00640 1 -- 172.21.15.44:0/748481181 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c8035020 con 0x7f37e00b4d00 2024-03-30T13:14:40.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.408+0000 7f37dea00640 1 -- 172.21.15.44:0/748481181 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c8031640 con 0x7f37e00b4d00 2024-03-30T13:14:40.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.408+0000 7f37dea00640 1 -- 172.21.15.44:0/748481181 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c802d040 con 0x7f37e00b4d00 2024-03-30T13:14:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.408+0000 7f37e5200640 1 -- 172.21.15.44:0/748481181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37e00b4d00 msgr2=0x7f37e00d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.408+0000 7f37e5200640 1 --2- 172.21.15.44:0/748481181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37e00b4d00 0x7f37e00d4ac0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f37c8009870 tx=0x7f37c802b8f0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.409+0000 7f37e5200640 1 -- 172.21.15.44:0/748481181 shutdown_connections 2024-03-30T13:14:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.409+0000 7f37e5200640 1 --2- 172.21.15.44:0/748481181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37e00d0b90 0x7f37e00d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.409+0000 7f37e5200640 1 --2- 172.21.15.44:0/748481181 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37e00b4d00 0x7f37e00d4ac0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.409+0000 7f37e5200640 1 -- 172.21.15.44:0/748481181 >> 172.21.15.44:0/748481181 conn(0x7f37e009d4e0 msgr2=0x7f37e00d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.409+0000 7f37e5200640 1 -- 172.21.15.44:0/748481181 shutdown_connections 2024-03-30T13:14:40.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.409+0000 7f37e5200640 1 -- 172.21.15.44:0/748481181 wait complete. 2024-03-30T13:14:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.410+0000 7f37e5200640 1 Processor -- start 2024-03-30T13:14:40.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.411+0000 7f37e5200640 1 -- start start 2024-03-30T13:14:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.411+0000 7f37e5200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37e00b4920 0x7f37e00b9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.411+0000 7f37e5200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37e00b4d00 0x7f37e00ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37e5200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37e00d0b90 0x7f37e015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37e5200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f37e00d5000 con 0x7f37e00d0b90 2024-03-30T13:14:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37e5200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f37e00d2180 con 0x7f37e00b4920 2024-03-30T13:14:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37e5200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f37e00cf8c0 con 0x7f37e00b4d00 2024-03-30T13:14:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37dfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37e00d0b90 0x7f37e015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37dfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37e00d0b90 0x7f37e015eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33516/0 (socket says 172.21.15.44:33516) 2024-03-30T13:14:40.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37dfe00640 1 -- 172.21.15.44:0/747215809 learned_addr learned my addr 172.21.15.44:0/747215809 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37df400640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37e00b4920 0x7f37e00b9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37d7e00640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37e00b4d00 0x7f37e00ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37dfe00640 1 -- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37e00b4d00 msgr2=0x7f37e00ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37dfe00640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37e00b4d00 0x7f37e00ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37dfe00640 1 -- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37e00b4920 msgr2=0x7f37e00b9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37dfe00640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37e00b4920 0x7f37e00b9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37dfe00640 1 -- 172.21.15.44:0/747215809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e00cabb0 con 0x7f37e00d0b90 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.412+0000 7f37df400640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37e00b4920 0x7f37e00b9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.413+0000 7f37dfe00640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37e00d0b90 0x7f37e015eb40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f37d8007e40 tx=0x7f37d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.413+0000 7f37d7400640 1 -- 172.21.15.44:0/747215809 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8014620 con 0x7f37e00d0b90 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.413+0000 7f37d7400640 1 -- 172.21.15.44:0/747215809 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8019070 con 0x7f37e00d0b90 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.413+0000 7f37d7400640 1 -- 172.21.15.44:0/747215809 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8014a20 con 0x7f37e00d0b90 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.413+0000 7f37e5200640 1 -- 172.21.15.44:0/747215809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e00b8260 con 0x7f37e00d0b90 2024-03-30T13:14:40.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.413+0000 7f37e5200640 1 -- 172.21.15.44:0/747215809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e00b8820 con 0x7f37e00d0b90 2024-03-30T13:14:40.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.415+0000 7f37d7400640 1 -- 172.21.15.44:0/747215809 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f37d8014bc0 con 0x7f37e00d0b90 2024-03-30T13:14:40.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.417+0000 7f37e9620740 1 Processor -- start 2024-03-30T13:14:40.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.417+0000 7f37d7400640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f37bc06c530 0x7f37bc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.417+0000 7f37e9620740 1 -- start start 2024-03-30T13:14:40.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.417+0000 7f37d7400640 1 -- 172.21.15.44:0/747215809 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f37d808c170 con 0x7f37e00d0b90 2024-03-30T13:14:40.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.418+0000 7f37d7e00640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f37bc06c530 0x7f37bc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.418+0000 7f37e9620740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 0x564b27e09fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.418+0000 7f37e9620740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27e0a4e0 0x564b27de24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.418+0000 7f37e9620740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27de3850 0x564b27de29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.418+0000 7f37e9620740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b27d46330 con 0x564b27de3470 2024-03-30T13:14:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.418+0000 7f37e9620740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564b27cee620 con 0x564b27e0a4e0 2024-03-30T13:14:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.418+0000 7f37e9620740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x564b27d42440 con 0x564b27de3850 2024-03-30T13:14:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.419+0000 7f37df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 0x564b27e09fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.419+0000 7f37df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 0x564b27e09fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33518/0 (socket says 172.21.15.44:33518) 2024-03-30T13:14:40.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.419+0000 7f37df400640 1 -- 172.21.15.44:0/3154024225 learned_addr learned my addr 172.21.15.44:0/3154024225 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.419+0000 7f37df400640 1 -- 172.21.15.44:0/3154024225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27de3850 msgr2=0x564b27de29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.419+0000 7f37df400640 1 --2- 172.21.15.44:0/3154024225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27de3850 0x564b27de29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.419+0000 7f37df400640 1 -- 172.21.15.44:0/3154024225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27e0a4e0 msgr2=0x564b27de24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.419+0000 7f37df400640 1 --2- 172.21.15.44:0/3154024225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27e0a4e0 0x564b27de24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.419+0000 7f37df400640 1 -- 172.21.15.44:0/3154024225 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b27b26920 con 0x564b27de3470 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.419+0000 7f37df400640 1 --2- 172.21.15.44:0/3154024225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 0x564b27e09fa0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f37d00016d0 tx=0x7f37d0001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa3d7664a967694 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.420+0000 7f37d7e00640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f37bc06c530 0x7f37bc06e9f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f37c8036000 tx=0x7f37c8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.420+0000 7f37cfe00640 1 -- 172.21.15.44:0/3154024225 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0018070 con 0x564b27de3470 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.420+0000 7f37cfe00640 1 -- 172.21.15.44:0/3154024225 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d000d6d0 con 0x564b27de3470 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.420+0000 7f37cfe00640 1 -- 172.21.15.44:0/3154024225 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d000daa0 con 0x564b27de3470 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.420+0000 7f37e9620740 1 -- 172.21.15.44:0/3154024225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 msgr2=0x564b27e09fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.420+0000 7f37e9620740 1 --2- 172.21.15.44:0/3154024225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 0x564b27e09fa0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f37d00016d0 tx=0x7f37d0001b90 comp rx=0 tx=0).stop 2024-03-30T13:14:40.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.421+0000 7f37e9620740 1 -- 172.21.15.44:0/3154024225 shutdown_connections 2024-03-30T13:14:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.421+0000 7f37e9620740 1 --2- 172.21.15.44:0/3154024225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27de3850 0x564b27de29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.421+0000 7f37e9620740 1 --2- 172.21.15.44:0/3154024225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27e0a4e0 0x564b27de24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.421+0000 7f37e9620740 1 --2- 172.21.15.44:0/3154024225 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 0x564b27e09fa0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.421+0000 7f37e9620740 1 -- 172.21.15.44:0/3154024225 >> 172.21.15.44:0/3154024225 conn(0x564b27da9be0 msgr2=0x564b27e28190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.421+0000 7f37e9620740 1 -- 172.21.15.44:0/3154024225 shutdown_connections 2024-03-30T13:14:40.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.421+0000 7f37e9620740 1 -- 172.21.15.44:0/3154024225 wait complete. 2024-03-30T13:14:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.421+0000 7f37e9620740 1 -- start start 2024-03-30T13:14:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.422+0000 7f37e9620740 1 Processor -- start 2024-03-30T13:14:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37e9620740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27de3470 0x564b27e21960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37e9620740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3850 0x564b27e0e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37e9620740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27e255e0 0x564b27e1f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37e9620740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564b27e09b10 con 0x564b27e255e0 2024-03-30T13:14:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37e9620740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564b27d019d0 con 0x564b27de3850 2024-03-30T13:14:40.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37e9620740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x564b27e02890 con 0x564b27de3470 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37e9620740 10 client.0 _ll_register_callbacks cb 0x564b27d3dfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37dfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27e255e0 0x564b27e1f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37dfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27e255e0 0x564b27e1f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33534/0 (socket says 172.21.15.44:33534) 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37dfe00640 1 -- 172.21.15.44:0/1356740756 learned_addr learned my addr 172.21.15.44:0/1356740756 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37d7e00640 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3850 0x564b27e0e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37df400640 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27de3470 0x564b27e21960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37dfe00640 1 -- 172.21.15.44:0/1356740756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27de3470 msgr2=0x564b27e21960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37dfe00640 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27de3470 0x564b27e21960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37dfe00640 1 -- 172.21.15.44:0/1356740756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3850 msgr2=0x564b27e0e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37dfe00640 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3850 0x564b27e0e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37dfe00640 1 -- 172.21.15.44:0/1356740756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b27a1a210 con 0x564b27e255e0 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.423+0000 7f37df400640 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27de3470 0x564b27e21960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:40.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.424+0000 7f37dfe00640 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27e255e0 0x564b27e1f4f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f37d8062580 tx=0x7f37d8059f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07533c17b61469 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.424+0000 7f37ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.424+0000 7f37ccc00640 1 -- 172.21.15.44:0/1356740756 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8062ab0 con 0x564b27e255e0 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.424+0000 7f37ccc00640 1 -- 172.21.15.44:0/1356740756 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f37d8056540 con 0x564b27e255e0 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.424+0000 7f37e9620740 1 -- 172.21.15.44:0/1356740756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37d000d6d0 con 0x564b27e255e0 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.424+0000 7f37ccc00640 1 -- 172.21.15.44:0/1356740756 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f37d808a170 con 0x564b27e255e0 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.424+0000 7f37e9620740 10 client.5745 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.424+0000 7f37e9620740 1 -- 172.21.15.44:0/1356740756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x564b27b870b0 con 0x564b27e255e0 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.425+0000 7f37ccc00640 1 -- 172.21.15.44:0/1356740756 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d000d6d0 con 0x564b27e255e0 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.425+0000 7f37ccc00640 1 -- 172.21.15.44:0/1356740756 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f37d805a130 con 0x564b27e255e0 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.425+0000 7f37e9620740 10 client.5745 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.425+0000 7f37e9620740 10 client.5745 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.425+0000 7f37e9620740 20 client.5745 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.425+0000 7f37e9620740 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564b27e2bab0 0x564b27df5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.425+0000 7f37e9620740 4 client.5745 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:40.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.425+0000 7f37e9620740 1 -- 172.21.15.44:0/1356740756 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b27d53870 con 0x564b27e2bab0 2024-03-30T13:14:40.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.425+0000 7f37df400640 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564b27e2bab0 0x564b27df5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.426+0000 7f37df400640 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564b27e2bab0 0x564b27df5e80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80e6a7b2ca7f20dc server_cookie=35d089ecc4dce002 in_seq=0 out_seq=0 2024-03-30T13:14:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.426+0000 7f37ccc00640 10 client.5745 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.426+0000 7f37ccc00640 1 -- 172.21.15.44:0/1356740756 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x564b27d53870 con 0x564b27e2bab0 2024-03-30T13:14:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.426+0000 7f37ccc00640 10 client.5745 handle_command_reply: tid=0 2024-03-30T13:14:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37e9620740 1 client.5745 shutdown 2024-03-30T13:14:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37e9620740 1 -- 172.21.15.44:0/1356740756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27e255e0 msgr2=0x564b27e1f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37e9620740 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27e255e0 0x564b27e1f4f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f37d8062580 tx=0x7f37d8059f90 comp rx=0 tx=0).stop 2024-03-30T13:14:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37e9620740 1 -- 172.21.15.44:0/1356740756 shutdown_connections 2024-03-30T13:14:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37e9620740 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564b27e2bab0 0x564b27df5e80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37e9620740 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27e255e0 0x564b27e1f4f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37e9620740 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3850 0x564b27e0e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37e9620740 1 --2- 172.21.15.44:0/1356740756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27de3470 0x564b27e21960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37ccc00640 0 client.5745 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:40.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37e9620740 1 -- 172.21.15.44:0/1356740756 >> 172.21.15.44:0/1356740756 conn(0x564b27da9be0 msgr2=0x564b27ddcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37e9620740 1 -- 172.21.15.44:0/1356740756 shutdown_connections 2024-03-30T13:14:40.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37e9620740 1 -- 172.21.15.44:0/1356740756 wait complete. 2024-03-30T13:14:40.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.427+0000 7f37e9620740 20 client.5745 trim_cache size 0 max 16384 2024-03-30T13:14:40.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.443+0000 7f37e9620740 1 Processor -- start 2024-03-30T13:14:40.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.443+0000 7f37e9620740 1 -- start start 2024-03-30T13:14:40.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.444+0000 7f37e9620740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3470 0x564b27e00ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.444+0000 7f37e9620740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3850 0x564b27e01000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.444+0000 7f37e9620740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27e28e90 0x564b27ddc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.444+0000 7f37e9620740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f37e02011e0 con 0x564b27de3850 2024-03-30T13:14:40.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.444+0000 7f37e9620740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f37e0200240 con 0x564b27de3470 2024-03-30T13:14:40.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.444+0000 7f37e9620740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f37e014de50 con 0x564b27e28e90 2024-03-30T13:14:40.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.444+0000 7f37d7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3850 0x564b27e01000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.445+0000 7f37d7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3850 0x564b27e01000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33548/0 (socket says 172.21.15.44:33548) 2024-03-30T13:14:40.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.445+0000 7f37d7e00640 1 -- 172.21.15.44:0/1109088853 learned_addr learned my addr 172.21.15.44:0/1109088853 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.445+0000 7f37df400640 1 --2- 172.21.15.44:0/1109088853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3470 0x564b27e00ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.445+0000 7f37d7e00640 1 -- 172.21.15.44:0/1109088853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27e28e90 msgr2=0x564b27ddc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.445+0000 7f37dfe00640 1 --2- 172.21.15.44:0/1109088853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27e28e90 0x564b27ddc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.445+0000 7f37d7e00640 1 --2- 172.21.15.44:0/1109088853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27e28e90 0x564b27ddc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.445+0000 7f37d7e00640 1 -- 172.21.15.44:0/1109088853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3470 msgr2=0x564b27e00ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.445+0000 7f37d7e00640 1 --2- 172.21.15.44:0/1109088853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3470 0x564b27e00ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.445+0000 7f37d7e00640 1 -- 172.21.15.44:0/1109088853 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b279f32d0 con 0x564b27de3850 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.445+0000 7f37d7e00640 1 --2- 172.21.15.44:0/1109088853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3850 0x564b27e01000 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f37c802bf00 tx=0x7f37c8031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5560f487cb29a57d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.446+0000 7f37cf400640 1 -- 172.21.15.44:0/1109088853 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c8049070 con 0x564b27de3850 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.446+0000 7f37cf400640 1 -- 172.21.15.44:0/1109088853 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c804e460 con 0x564b27de3850 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.446+0000 7f37cf400640 1 -- 172.21.15.44:0/1109088853 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c8035040 con 0x564b27de3850 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.446+0000 7f37e9620740 1 -- 172.21.15.44:0/1109088853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3850 msgr2=0x564b27e01000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.446+0000 7f37e9620740 1 --2- 172.21.15.44:0/1109088853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3850 0x564b27e01000 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f37c802bf00 tx=0x7f37c8031000 comp rx=0 tx=0).stop 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.446+0000 7f37e9620740 1 -- 172.21.15.44:0/1109088853 shutdown_connections 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.446+0000 7f37e9620740 1 --2- 172.21.15.44:0/1109088853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27e28e90 0x564b27ddc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.446+0000 7f37e9620740 1 --2- 172.21.15.44:0/1109088853 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3850 0x564b27e01000 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.446+0000 7f37e9620740 1 --2- 172.21.15.44:0/1109088853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3470 0x564b27e00ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.446+0000 7f37e9620740 1 -- 172.21.15.44:0/1109088853 >> 172.21.15.44:0/1109088853 conn(0x564b27da9be0 msgr2=0x564b27e21770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.447+0000 7f37e9620740 1 -- 172.21.15.44:0/1109088853 shutdown_connections 2024-03-30T13:14:40.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.447+0000 7f37e9620740 1 -- 172.21.15.44:0/1109088853 wait complete. 2024-03-30T13:14:40.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.448+0000 7f37e9620740 1 -- start start 2024-03-30T13:14:40.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.448+0000 7f37e9620740 1 Processor -- start 2024-03-30T13:14:40.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37e9620740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 0x564b27ea3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37e9620740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3850 0x564b27e280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37e9620740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27e28e90 0x564b27e285e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37e9620740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01ffde0 con 0x564b27de3470 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37e9620740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564b27ea5190 con 0x564b27de3850 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37e9620740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x564b27e2c3e0 con 0x564b27e28e90 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37e9620740 10 client.0 _ll_register_callbacks cb 0x7f37d800eeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 0x564b27ea3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 0x564b27ea3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33558/0 (socket says 172.21.15.44:33558) 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37df400640 1 -- 172.21.15.44:0/1722982619 learned_addr learned my addr 172.21.15.44:0/1722982619 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37d7e00640 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3850 0x564b27e280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37dfe00640 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27e28e90 0x564b27e285e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37df400640 1 -- 172.21.15.44:0/1722982619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27e28e90 msgr2=0x564b27e285e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37df400640 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27e28e90 0x564b27e285e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37df400640 1 -- 172.21.15.44:0/1722982619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3850 msgr2=0x564b27e280a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37df400640 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3850 0x564b27e280a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37df400640 1 -- 172.21.15.44:0/1722982619 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b27e27e60 con 0x564b27de3470 2024-03-30T13:14:40.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.450+0000 7f37d7e00640 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3850 0x564b27e280a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:40.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.451+0000 7f37df400640 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 0x564b27ea3500 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f37d00016d0 tx=0x7f37d0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f6bfa7cb6a9ad server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.451+0000 7f37ccc00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.451+0000 7f37ccc00640 1 -- 172.21.15.44:0/1722982619 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d002b060 con 0x564b27de3470 2024-03-30T13:14:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.451+0000 7f37ccc00640 1 -- 172.21.15.44:0/1722982619 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f37d00067d0 con 0x564b27de3470 2024-03-30T13:14:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.451+0000 7f37e9620740 1 -- 172.21.15.44:0/1722982619 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37c804e460 con 0x564b27de3470 2024-03-30T13:14:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.451+0000 7f37ccc00640 1 -- 172.21.15.44:0/1722982619 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f37d0031050 con 0x564b27de3470 2024-03-30T13:14:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.451+0000 7f37e9620740 10 client.5751 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.451+0000 7f37e9620740 1 -- 172.21.15.44:0/1722982619 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x564b27ddf610 con 0x564b27de3470 2024-03-30T13:14:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.452+0000 7f37ccc00640 1 -- 172.21.15.44:0/1722982619 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c804e460 con 0x564b27de3470 2024-03-30T13:14:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.452+0000 7f37ccc00640 1 -- 172.21.15.44:0/1722982619 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f37d0034020 con 0x564b27de3470 2024-03-30T13:14:40.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.452+0000 7f37e9620740 10 client.5751 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.452+0000 7f37e9620740 10 client.5751 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.452+0000 7f37e9620740 20 client.5751 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.452+0000 7f37e9620740 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564b27e36860 0x564b27e36c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.452+0000 7f37e9620740 4 client.5751 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628324}] 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.452+0000 7f37e9620740 1 -- 172.21.15.44:0/1722982619 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628324}) -- 0x564b27d4dbc0 con 0x564b27e36860 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.452+0000 7f37d7e00640 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564b27e36860 0x564b27e36c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37d7e00640 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564b27e36860 0x564b27e36c70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2a53c43f19da037 server_cookie=bc3c72fbd852ff1e in_seq=0 out_seq=0 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37ccc00640 10 client.5751 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37ccc00640 1 -- 172.21.15.44:0/1722982619 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4340 (crc 0 0 0) 0x564b27d4dbc0 con 0x564b27e36860 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37ccc00640 10 client.5751 handle_command_reply: tid=0 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37e9620740 1 client.5751 shutdown 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37e9620740 1 -- 172.21.15.44:0/1722982619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 msgr2=0x564b27ea3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37e9620740 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 0x564b27ea3500 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f37d00016d0 tx=0x7f37d0000bc0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37e9620740 1 -- 172.21.15.44:0/1722982619 shutdown_connections 2024-03-30T13:14:40.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37e9620740 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564b27e36860 0x564b27e36c70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37e9620740 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b27e28e90 0x564b27e285e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37e9620740 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b27de3850 0x564b27e280a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37e9620740 1 --2- 172.21.15.44:0/1722982619 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564b27de3470 0x564b27ea3500 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37e9620740 1 -- 172.21.15.44:0/1722982619 >> 172.21.15.44:0/1722982619 conn(0x564b27da9be0 msgr2=0x564b27ddc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.453+0000 7f37ccc00640 0 client.5751 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:40.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e9620740 1 -- 172.21.15.44:0/1722982619 shutdown_connections 2024-03-30T13:14:40.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e9620740 1 -- 172.21.15.44:0/1722982619 wait complete. 2024-03-30T13:14:40.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e9620740 20 client.5751 trim_cache size 0 max 16384 2024-03-30T13:14:40.461 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:40.461 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/xattr_security.c", 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628324, 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.233457+0000", 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.240258+0000", 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:40.462 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 1473, 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:40.463 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.240258+0000", 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.464 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 1 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1473, 2024-03-30T13:14:40.465 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.233457+0000" 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1473, 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.233457+0000" 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 82, 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:40.466 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 34, 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:40.467 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:40.468 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 1, 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 1, 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 1, 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:40.469 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 1, 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 6, 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:40.470 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 1, 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:40.471 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:40.472 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:40.473 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:40.474 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:40.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e5200640 1 -- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f37bc06c530 msgr2=0x7f37bc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e5200640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f37bc06c530 0x7f37bc06e9f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f37c8036000 tx=0x7f37c8030000 comp rx=0 tx=0).stop 2024-03-30T13:14:40.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e5200640 1 -- 172.21.15.44:0/747215809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37e00d0b90 msgr2=0x7f37e015eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e5200640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37e00d0b90 0x7f37e015eb40 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f37d8007e40 tx=0x7f37d800e4b0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e5200640 1 -- 172.21.15.44:0/747215809 shutdown_connections 2024-03-30T13:14:40.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e5200640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37e00d0b90 0x7f37e015eb40 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e5200640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37e00b4d00 0x7f37e00ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e5200640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f37bc06c530 0x7f37bc06e9f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e5200640 1 --2- 172.21.15.44:0/747215809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37e00b4920 0x7f37e00b9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.454+0000 7f37e5200640 1 -- 172.21.15.44:0/747215809 >> 172.21.15.44:0/747215809 conn(0x7f37e009d4e0 msgr2=0x7f37e00d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.455+0000 7f37e5200640 1 -- 172.21.15.44:0/747215809 shutdown_connections 2024-03-30T13:14:40.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.455+0000 7f37e5200640 1 -- 172.21.15.44:0/747215809 wait complete. 2024-03-30T13:14:40.478 DEBUG:tasks.cephfs.test_uninlining:getting inode info #9 of 23:1099511628309 2024-03-30T13:14:40.478 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628309 2024-03-30T13:14:40.478 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628309 2024-03-30T13:14:40.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.707+0000 7fc13e400640 1 Processor -- start 2024-03-30T13:14:40.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.707+0000 7fc13e400640 1 -- start start 2024-03-30T13:14:40.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.709+0000 7fc13e400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc13806e980 0x7fc138072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.709+0000 7fc13e400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc1380ae9d0 0x7fc1380aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.709+0000 7fc13e400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1380ad2e0 con 0x7fc1380acd60 2024-03-30T13:14:40.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.709+0000 7fc13e400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc1380ad5c0 con 0x7fc1380ae9d0 2024-03-30T13:14:40.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.709+0000 7fc13e400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc138071450 con 0x7fc13806e980 2024-03-30T13:14:40.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.709+0000 7fc13da00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc1380ae9d0 0x7fc1380aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.709+0000 7fc137e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc1380acd60 0x7fc13815d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36822/0 (socket says 172.21.15.44:36822) 2024-03-30T13:14:40.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.709+0000 7fc137e00640 1 -- 172.21.15.44:0/3793648235 learned_addr learned my addr 172.21.15.44:0/3793648235 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:40.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.710+0000 7fc13d000640 1 --2- 172.21.15.44:0/3793648235 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc13806e980 0x7fc138072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.710+0000 7fc13da00640 1 -- 172.21.15.44:0/3793648235 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc13806e980 msgr2=0x7fc138072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.710+0000 7fc13da00640 1 --2- 172.21.15.44:0/3793648235 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc13806e980 0x7fc138072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.710+0000 7fc13da00640 1 -- 172.21.15.44:0/3793648235 >> v1:172.21.15.44:6789/0 conn(0x7fc1380acd60 legacy=0x7fc13815d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.710+0000 7fc137400640 1 -- 172.21.15.44:0/3793648235 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89868983 0 0) 0x7fc1380ad2e0 con 0x7fc1380acd60 2024-03-30T13:14:40.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.710+0000 7fc13da00640 1 -- 172.21.15.44:0/3793648235 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1380716a0 con 0x7fc1380ae9d0 2024-03-30T13:14:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.711+0000 7fc13da00640 1 --2- 172.21.15.44:0/3793648235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1380ae9d0 0x7fc1380aee60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc130009d90 tx=0x7fc13002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba02a5431f740fb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.711+0000 7fc137400640 1 -- 172.21.15.44:0/3793648235 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130039070 con 0x7fc1380ae9d0 2024-03-30T13:14:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.711+0000 7fc137400640 1 -- 172.21.15.44:0/3793648235 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc13002cc50 con 0x7fc1380ae9d0 2024-03-30T13:14:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.711+0000 7fc137400640 1 -- 172.21.15.44:0/3793648235 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130034440 con 0x7fc1380ae9d0 2024-03-30T13:14:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.712+0000 7fc13e400640 1 -- 172.21.15.44:0/3793648235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1380ae9d0 msgr2=0x7fc1380aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.712+0000 7fc13e400640 1 --2- 172.21.15.44:0/3793648235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1380ae9d0 0x7fc1380aee60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc130009d90 tx=0x7fc13002bea0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.712+0000 7fc13e400640 1 -- 172.21.15.44:0/3793648235 shutdown_connections 2024-03-30T13:14:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.712+0000 7fc13e400640 1 --2- 172.21.15.44:0/3793648235 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1380ae9d0 0x7fc1380aee60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.712+0000 7fc13e400640 1 --2- 172.21.15.44:0/3793648235 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc13806e980 0x7fc138072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.712+0000 7fc13e400640 1 -- 172.21.15.44:0/3793648235 >> 172.21.15.44:0/3793648235 conn(0x7fc1380cfd90 msgr2=0x7fc1380d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.712+0000 7fc13e400640 1 -- 172.21.15.44:0/3793648235 shutdown_connections 2024-03-30T13:14:40.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.712+0000 7fc13e400640 1 -- 172.21.15.44:0/3793648235 wait complete. 2024-03-30T13:14:40.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.714+0000 7fc13e400640 1 Processor -- start 2024-03-30T13:14:40.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.714+0000 7fc13e400640 1 -- start start 2024-03-30T13:14:40.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.715+0000 7fc13e400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc13806e980 0x7fc13814a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.715+0000 7fc13e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1380acd60 0x7fc1380af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.715+0000 7fc13e400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1380ae9d0 0x7fc1380afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.715+0000 7fc13e400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc1380af3a0 con 0x7fc1380acd60 2024-03-30T13:14:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.715+0000 7fc13e400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc138071c60 con 0x7fc1380ae9d0 2024-03-30T13:14:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.715+0000 7fc13e400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc138156020 con 0x7fc13806e980 2024-03-30T13:14:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.715+0000 7fc137e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1380acd60 0x7fc1380af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.715+0000 7fc137e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1380acd60 0x7fc1380af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33586/0 (socket says 172.21.15.44:33586) 2024-03-30T13:14:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.715+0000 7fc137e00640 1 -- 172.21.15.44:0/1219157171 learned_addr learned my addr 172.21.15.44:0/1219157171 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc13da00640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1380ae9d0 0x7fc1380afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc13d000640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc13806e980 0x7fc13814a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc137e00640 1 -- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc13806e980 msgr2=0x7fc13814a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc137e00640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc13806e980 0x7fc13814a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc137e00640 1 -- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1380ae9d0 msgr2=0x7fc1380afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc137e00640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1380ae9d0 0x7fc1380afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc137e00640 1 -- 172.21.15.44:0/1219157171 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc138156580 con 0x7fc1380acd60 2024-03-30T13:14:40.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc13da00640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1380ae9d0 0x7fc1380afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:40.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc137e00640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1380acd60 0x7fc1380af8f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc12400c500 tx=0x7fc12400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc134c00640 1 -- 172.21.15.44:0/1219157171 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124018070 con 0x7fc1380acd60 2024-03-30T13:14:40.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc134c00640 1 -- 172.21.15.44:0/1219157171 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc124007580 con 0x7fc1380acd60 2024-03-30T13:14:40.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc13e400640 1 -- 172.21.15.44:0/1219157171 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc138156860 con 0x7fc1380acd60 2024-03-30T13:14:40.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc134c00640 1 -- 172.21.15.44:0/1219157171 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124004a20 con 0x7fc1380acd60 2024-03-30T13:14:40.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.716+0000 7fc13e400640 1 -- 172.21.15.44:0/1219157171 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc138156e20 con 0x7fc1380acd60 2024-03-30T13:14:40.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.719+0000 7fc134c00640 1 -- 172.21.15.44:0/1219157171 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc12401b070 con 0x7fc1380acd60 2024-03-30T13:14:40.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.720+0000 7fc134c00640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc11806c530 0x7fc11806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.720+0000 7fc134c00640 1 -- 172.21.15.44:0/1219157171 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc12408abf0 con 0x7fc1380acd60 2024-03-30T13:14:40.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.720+0000 7fc13d000640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc11806c530 0x7fc11806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.721+0000 7fc1427c2740 1 Processor -- start 2024-03-30T13:14:40.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.721+0000 7fc1427c2740 1 -- start start 2024-03-30T13:14:40.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.721+0000 7fc13d000640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc11806c530 0x7fc11806e9f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc12c006fd0 tx=0x7fc12c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.722+0000 7fc1427c2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626470 0x558f2d64cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.722+0000 7fc1427c2740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d64d4e0 0x558f2d6254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.722+0000 7fc1427c2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 0x558f2d6259f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.722+0000 7fc1427c2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558f2d589330 con 0x558f2d626850 2024-03-30T13:14:40.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.722+0000 7fc1427c2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558f2d531620 con 0x558f2d626470 2024-03-30T13:14:40.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.722+0000 7fc1427c2740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x558f2d585440 con 0x558f2d64d4e0 2024-03-30T13:14:40.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.722+0000 7fc13da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 0x558f2d6259f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.722+0000 7fc13da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 0x558f2d6259f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33588/0 (socket says 172.21.15.44:33588) 2024-03-30T13:14:40.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.722+0000 7fc13da00640 1 -- 172.21.15.44:0/2752914584 learned_addr learned my addr 172.21.15.44:0/2752914584 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.723+0000 7fc137e00640 1 --2- 172.21.15.44:0/2752914584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d64d4e0 0x558f2d6254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.723+0000 7fc13d000640 1 --2- 172.21.15.44:0/2752914584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626470 0x558f2d64cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.723+0000 7fc13da00640 1 -- 172.21.15.44:0/2752914584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d64d4e0 msgr2=0x558f2d6254b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.723+0000 7fc13da00640 1 --2- 172.21.15.44:0/2752914584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d64d4e0 0x558f2d6254b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.723+0000 7fc13da00640 1 -- 172.21.15.44:0/2752914584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626470 msgr2=0x558f2d64cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.723+0000 7fc13da00640 1 --2- 172.21.15.44:0/2752914584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626470 0x558f2d64cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.723+0000 7fc13da00640 1 -- 172.21.15.44:0/2752914584 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f2d369920 con 0x558f2d626850 2024-03-30T13:14:40.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.723+0000 7fc13da00640 1 --2- 172.21.15.44:0/2752914584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 0x558f2d6259f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc130009eb0 tx=0x7fc13002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3826e3f5a1e58402 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.724+0000 7fc129600640 1 -- 172.21.15.44:0/2752914584 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130039040 con 0x558f2d626850 2024-03-30T13:14:40.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.724+0000 7fc129600640 1 -- 172.21.15.44:0/2752914584 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc13002cb50 con 0x558f2d626850 2024-03-30T13:14:40.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.724+0000 7fc129600640 1 -- 172.21.15.44:0/2752914584 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13003f470 con 0x558f2d626850 2024-03-30T13:14:40.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.724+0000 7fc1427c2740 1 -- 172.21.15.44:0/2752914584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 msgr2=0x558f2d6259f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.724+0000 7fc1427c2740 1 --2- 172.21.15.44:0/2752914584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 0x558f2d6259f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc130009eb0 tx=0x7fc13002e000 comp rx=0 tx=0).stop 2024-03-30T13:14:40.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.724+0000 7fc1427c2740 1 -- 172.21.15.44:0/2752914584 shutdown_connections 2024-03-30T13:14:40.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.724+0000 7fc1427c2740 1 --2- 172.21.15.44:0/2752914584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 0x558f2d6259f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.724+0000 7fc1427c2740 1 --2- 172.21.15.44:0/2752914584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d64d4e0 0x558f2d6254b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.724+0000 7fc1427c2740 1 --2- 172.21.15.44:0/2752914584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626470 0x558f2d64cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.724+0000 7fc1427c2740 1 -- 172.21.15.44:0/2752914584 >> 172.21.15.44:0/2752914584 conn(0x558f2d5ecbe0 msgr2=0x558f2d66b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.724+0000 7fc1427c2740 1 -- 172.21.15.44:0/2752914584 shutdown_connections 2024-03-30T13:14:40.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.724+0000 7fc1427c2740 1 -- 172.21.15.44:0/2752914584 wait complete. 2024-03-30T13:14:40.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.725+0000 7fc1427c2740 1 -- start start 2024-03-30T13:14:40.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.725+0000 7fc1427c2740 1 Processor -- start 2024-03-30T13:14:40.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.727+0000 7fc1427c2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 0x558f2d6396d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.727+0000 7fc1427c2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626850 0x558f2d67b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.727+0000 7fc1427c2740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d6639c0 0x558f2d6250a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.727+0000 7fc1427c2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x558f2d64cb10 con 0x558f2d626470 2024-03-30T13:14:40.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.727+0000 7fc1427c2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558f2d5449d0 con 0x558f2d626850 2024-03-30T13:14:40.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.727+0000 7fc1427c2740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x558f2d645890 con 0x558f2d6639c0 2024-03-30T13:14:40.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.727+0000 7fc1427c2740 10 client.0 _ll_register_callbacks cb 0x558f2d580fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:40.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.727+0000 7fc13d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 0x558f2d6396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.727+0000 7fc13d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 0x558f2d6396d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33598/0 (socket says 172.21.15.44:33598) 2024-03-30T13:14:40.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.727+0000 7fc13d000640 1 -- 172.21.15.44:0/2190391245 learned_addr learned my addr 172.21.15.44:0/2190391245 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.728+0000 7fc13d000640 1 -- 172.21.15.44:0/2190391245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d6639c0 msgr2=0x558f2d6250a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.728+0000 7fc13d000640 1 --2- 172.21.15.44:0/2190391245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d6639c0 0x558f2d6250a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.728+0000 7fc13d000640 1 -- 172.21.15.44:0/2190391245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626850 msgr2=0x558f2d67b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.728+0000 7fc13d000640 1 --2- 172.21.15.44:0/2190391245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626850 0x558f2d67b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.728+0000 7fc13d000640 1 -- 172.21.15.44:0/2190391245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f2d25d210 con 0x558f2d626470 2024-03-30T13:14:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.728+0000 7fc13d000640 1 --2- 172.21.15.44:0/2190391245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 0x558f2d6396d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00efd0 tx=0x7fc12c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44755349d389fc90 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.728+0000 7fc11e000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.728+0000 7fc11e000640 1 -- 172.21.15.44:0/2190391245 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c00f040 con 0x558f2d626470 2024-03-30T13:14:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.728+0000 7fc11e000640 1 -- 172.21.15.44:0/2190391245 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc12c015bd0 con 0x558f2d626470 2024-03-30T13:14:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.728+0000 7fc1427c2740 1 -- 172.21.15.44:0/2190391245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc13002cb50 con 0x558f2d626470 2024-03-30T13:14:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.729+0000 7fc11e000640 1 -- 172.21.15.44:0/2190391245 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc12c02c050 con 0x558f2d626470 2024-03-30T13:14:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.729+0000 7fc1427c2740 10 client.5766 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:40.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.729+0000 7fc1427c2740 1 -- 172.21.15.44:0/2190391245 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x558f2d3ca0b0 con 0x558f2d626470 2024-03-30T13:14:40.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.729+0000 7fc11e000640 1 -- 172.21.15.44:0/2190391245 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc13002cb50 con 0x558f2d626470 2024-03-30T13:14:40.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.729+0000 7fc11e000640 1 -- 172.21.15.44:0/2190391245 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fc12c02f020 con 0x558f2d626470 2024-03-30T13:14:40.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.729+0000 7fc1427c2740 10 client.5766 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:40.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.729+0000 7fc1427c2740 10 client.5766 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:40.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.729+0000 7fc1427c2740 20 client.5766 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.729+0000 7fc1427c2740 1 --2- 172.21.15.44:0/2190391245 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558f2d67d760 0x558f2d67dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.729+0000 7fc1427c2740 4 client.5766 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.729+0000 7fc1427c2740 1 -- 172.21.15.44:0/2190391245 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f2d596870 con 0x558f2d67d760 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.730+0000 7fc137e00640 1 --2- 172.21.15.44:0/2190391245 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558f2d67d760 0x558f2d67dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.730+0000 7fc11e000640 10 client.5766 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.730+0000 7fc137e00640 1 --2- 172.21.15.44:0/2190391245 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558f2d67d760 0x558f2d67dbe0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=160a918ac7888b71 server_cookie=afbcedd87a554b89 in_seq=0 out_seq=0 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc11e000640 1 -- 172.21.15.44:0/2190391245 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x558f2d596870 con 0x558f2d67d760 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc11e000640 10 client.5766 handle_command_reply: tid=0 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc1427c2740 1 client.5766 shutdown 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc1427c2740 1 -- 172.21.15.44:0/2190391245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 msgr2=0x558f2d6396d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc1427c2740 1 --2- 172.21.15.44:0/2190391245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 0x558f2d6396d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00efd0 tx=0x7fc12c004730 comp rx=0 tx=0).stop 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc1427c2740 1 -- 172.21.15.44:0/2190391245 shutdown_connections 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc1427c2740 1 --2- 172.21.15.44:0/2190391245 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558f2d67d760 0x558f2d67dbe0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc1427c2740 1 --2- 172.21.15.44:0/2190391245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d6639c0 0x558f2d6250a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc1427c2740 1 --2- 172.21.15.44:0/2190391245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626850 0x558f2d67b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc1427c2740 1 --2- 172.21.15.44:0/2190391245 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 0x558f2d6396d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc11e000640 0 client.5766 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:40.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc1427c2740 1 -- 172.21.15.44:0/2190391245 >> 172.21.15.44:0/2190391245 conn(0x558f2d5ecbe0 msgr2=0x558f2d61fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc1427c2740 1 -- 172.21.15.44:0/2190391245 shutdown_connections 2024-03-30T13:14:40.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.731+0000 7fc1427c2740 1 -- 172.21.15.44:0/2190391245 wait complete. 2024-03-30T13:14:40.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.732+0000 7fc1427c2740 20 client.5766 trim_cache size 0 max 16384 2024-03-30T13:14:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.747+0000 7fc1427c2740 1 Processor -- start 2024-03-30T13:14:40.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.747+0000 7fc1427c2740 1 -- start start 2024-03-30T13:14:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.748+0000 7fc1427c2740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d626470 0x558f2d6dd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.748+0000 7fc1427c2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 0x558f2d67ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.748+0000 7fc1427c2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d6639c0 0x558f2d67b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.748+0000 7fc1427c2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc138200c70 con 0x558f2d626850 2024-03-30T13:14:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.748+0000 7fc1427c2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc1381ffc50 con 0x558f2d6639c0 2024-03-30T13:14:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.748+0000 7fc1427c2740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc1381fefe0 con 0x558f2d626470 2024-03-30T13:14:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.749+0000 7fc137e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 0x558f2d67ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.749+0000 7fc137e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 0x558f2d67ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33600/0 (socket says 172.21.15.44:33600) 2024-03-30T13:14:40.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.749+0000 7fc137e00640 1 -- 172.21.15.44:0/1885003238 learned_addr learned my addr 172.21.15.44:0/1885003238 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.749+0000 7fc13d000640 1 --2- 172.21.15.44:0/1885003238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d626470 0x558f2d6dd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.749+0000 7fc13da00640 1 --2- 172.21.15.44:0/1885003238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d6639c0 0x558f2d67b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.749+0000 7fc137e00640 1 -- 172.21.15.44:0/1885003238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d626470 msgr2=0x558f2d6dd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.749+0000 7fc137e00640 1 --2- 172.21.15.44:0/1885003238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d626470 0x558f2d6dd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.749+0000 7fc137e00640 1 -- 172.21.15.44:0/1885003238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d6639c0 msgr2=0x558f2d67b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.749+0000 7fc137e00640 1 --2- 172.21.15.44:0/1885003238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d6639c0 0x558f2d67b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.749+0000 7fc137e00640 1 -- 172.21.15.44:0/1885003238 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f2d2362d0 con 0x558f2d626850 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.749+0000 7fc137e00640 1 --2- 172.21.15.44:0/1885003238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 0x558f2d67ae50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc124058650 tx=0x7fc124088e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5a5a50a456f2b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.750+0000 7fc128c00640 1 -- 172.21.15.44:0/1885003238 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12406e040 con 0x558f2d626850 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.750+0000 7fc128c00640 1 -- 172.21.15.44:0/1885003238 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc124075070 con 0x558f2d626850 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.750+0000 7fc128c00640 1 -- 172.21.15.44:0/1885003238 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc124056c50 con 0x558f2d626850 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.750+0000 7fc1427c2740 1 -- 172.21.15.44:0/1885003238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 msgr2=0x558f2d67ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.750+0000 7fc1427c2740 1 --2- 172.21.15.44:0/1885003238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 0x558f2d67ae50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc124058650 tx=0x7fc124088e30 comp rx=0 tx=0).stop 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.751+0000 7fc1427c2740 1 -- 172.21.15.44:0/1885003238 shutdown_connections 2024-03-30T13:14:40.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.751+0000 7fc1427c2740 1 --2- 172.21.15.44:0/1885003238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d6639c0 0x558f2d67b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.751+0000 7fc1427c2740 1 --2- 172.21.15.44:0/1885003238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626850 0x558f2d67ae50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.751+0000 7fc1427c2740 1 --2- 172.21.15.44:0/1885003238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d626470 0x558f2d6dd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.751+0000 7fc1427c2740 1 -- 172.21.15.44:0/1885003238 >> 172.21.15.44:0/1885003238 conn(0x558f2d5ecbe0 msgr2=0x558f2d61f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.751+0000 7fc1427c2740 1 -- 172.21.15.44:0/1885003238 shutdown_connections 2024-03-30T13:14:40.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.751+0000 7fc1427c2740 1 -- 172.21.15.44:0/1885003238 wait complete. 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.751+0000 7fc1427c2740 1 -- start start 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.752+0000 7fc1427c2740 1 Processor -- start 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.752+0000 7fc1427c2740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 0x558f2d6d9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc1427c2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626850 0x558f2d67b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc1427c2740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d6639c0 0x558f2d623f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc1427c2740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc1381ff600 con 0x558f2d626470 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc1427c2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558f2d67d560 con 0x558f2d626850 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc1427c2740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x558f2d624a60 con 0x558f2d6639c0 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc1427c2740 10 client.0 _ll_register_callbacks cb 0x7fc12c00ec50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc13d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 0x558f2d6d9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc13d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 0x558f2d6d9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33606/0 (socket says 172.21.15.44:33606) 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc13d000640 1 -- 172.21.15.44:0/926891921 learned_addr learned my addr 172.21.15.44:0/926891921 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:40.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc137e00640 1 --2- 172.21.15.44:0/926891921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626850 0x558f2d67b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc13d000640 1 -- 172.21.15.44:0/926891921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d6639c0 msgr2=0x558f2d623f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc13d000640 1 --2- 172.21.15.44:0/926891921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d6639c0 0x558f2d623f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc13d000640 1 -- 172.21.15.44:0/926891921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626850 msgr2=0x558f2d67b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc13d000640 1 --2- 172.21.15.44:0/926891921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626850 0x558f2d67b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.753+0000 7fc13d000640 1 -- 172.21.15.44:0/926891921 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f2d6507b0 con 0x558f2d626470 2024-03-30T13:14:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.754+0000 7fc13d000640 1 --2- 172.21.15.44:0/926891921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 0x558f2d6d9d90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc12c000c00 tx=0x7fc12c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2959b2b65a617852 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.754+0000 7fc11e000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.754+0000 7fc11e000640 1 -- 172.21.15.44:0/926891921 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c00e590 con 0x558f2d626470 2024-03-30T13:14:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.754+0000 7fc11e000640 1 -- 172.21.15.44:0/926891921 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc12c015bd0 con 0x558f2d626470 2024-03-30T13:14:40.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.754+0000 7fc1427c2740 1 -- 172.21.15.44:0/926891921 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc124075070 con 0x558f2d626470 2024-03-30T13:14:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.754+0000 7fc11e000640 1 -- 172.21.15.44:0/926891921 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc12c003b80 con 0x558f2d626470 2024-03-30T13:14:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.754+0000 7fc1427c2740 10 client.5772 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.754+0000 7fc1427c2740 1 -- 172.21.15.44:0/926891921 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x558f2d67bb10 con 0x558f2d626470 2024-03-30T13:14:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.755+0000 7fc11e000640 1 -- 172.21.15.44:0/926891921 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc124075070 con 0x558f2d626470 2024-03-30T13:14:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.755+0000 7fc11e000640 1 -- 172.21.15.44:0/926891921 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fc12c02f040 con 0x558f2d626470 2024-03-30T13:14:40.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.755+0000 7fc1427c2740 10 client.5772 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.755+0000 7fc1427c2740 10 client.5772 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.755+0000 7fc1427c2740 20 client.5772 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.755+0000 7fc1427c2740 1 --2- 172.21.15.44:0/926891921 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558f2d652f40 0x558f2d68d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.755+0000 7fc1427c2740 4 client.5772 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628309}] 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.755+0000 7fc1427c2740 1 -- 172.21.15.44:0/926891921 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628309}) -- 0x558f2d590bc0 con 0x558f2d652f40 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.755+0000 7fc137e00640 1 --2- 172.21.15.44:0/926891921 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558f2d652f40 0x558f2d68d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc137e00640 1 --2- 172.21.15.44:0/926891921 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558f2d652f40 0x558f2d68d6c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4101aeaea6e11338 server_cookie=82ce8a18006084a8 in_seq=0 out_seq=0 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc11e000640 10 client.5772 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc11e000640 1 -- 172.21.15.44:0/926891921 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4329 (crc 0 0 0) 0x558f2d590bc0 con 0x558f2d652f40 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc11e000640 10 client.5772 handle_command_reply: tid=0 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc1427c2740 1 client.5772 shutdown 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc1427c2740 1 -- 172.21.15.44:0/926891921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 msgr2=0x558f2d6d9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc1427c2740 1 --2- 172.21.15.44:0/926891921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 0x558f2d6d9d90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc12c000c00 tx=0x7fc12c013000 comp rx=0 tx=0).stop 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc1427c2740 1 -- 172.21.15.44:0/926891921 shutdown_connections 2024-03-30T13:14:40.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc1427c2740 1 --2- 172.21.15.44:0/926891921 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x558f2d652f40 0x558f2d68d6c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc1427c2740 1 --2- 172.21.15.44:0/926891921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558f2d6639c0 0x558f2d623f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc1427c2740 1 --2- 172.21.15.44:0/926891921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f2d626850 0x558f2d67b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc1427c2740 1 --2- 172.21.15.44:0/926891921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x558f2d626470 0x558f2d6d9d90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc11e000640 0 client.5772 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:40.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.756+0000 7fc1427c2740 1 -- 172.21.15.44:0/926891921 >> 172.21.15.44:0/926891921 conn(0x558f2d5ecbe0 msgr2=0x558f2d6679f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.757+0000 7fc1427c2740 1 -- 172.21.15.44:0/926891921 shutdown_connections 2024-03-30T13:14:40.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.757+0000 7fc1427c2740 1 -- 172.21.15.44:0/926891921 wait complete. 2024-03-30T13:14:40.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.757+0000 7fc1427c2740 20 client.5772 trim_cache size 0 max 16384 2024-03-30T13:14:40.764 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:40.764 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/Makefile", 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628309, 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.262050+0000", 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.199259+0000", 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:40.765 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 378, 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:40.766 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.199259+0000", 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:14:40.767 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 1 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 378, 2024-03-30T13:14:40.768 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.262050+0000" 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 378, 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.262050+0000" 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 100, 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:40.769 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 4, 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:40.770 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.771 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 1, 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 1, 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 1, 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:40.772 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 1, 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 6, 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:40.773 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 1, 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:40.774 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:40.775 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:40.776 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:40.777 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:40.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.757+0000 7fc13e400640 1 -- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc11806c530 msgr2=0x7fc11806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.757+0000 7fc13e400640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc11806c530 0x7fc11806e9f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc12c006fd0 tx=0x7fc12c008040 comp rx=0 tx=0).stop 2024-03-30T13:14:40.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.757+0000 7fc13e400640 1 -- 172.21.15.44:0/1219157171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1380acd60 msgr2=0x7fc1380af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:40.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.757+0000 7fc13e400640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1380acd60 0x7fc1380af8f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc12400c500 tx=0x7fc12400c9c0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.758+0000 7fc13e400640 1 -- 172.21.15.44:0/1219157171 shutdown_connections 2024-03-30T13:14:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.758+0000 7fc13e400640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc11806c530 0x7fc11806e9f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.758+0000 7fc13e400640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1380ae9d0 0x7fc1380afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.758+0000 7fc13e400640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1380acd60 0x7fc1380af8f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.758+0000 7fc13e400640 1 --2- 172.21.15.44:0/1219157171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc13806e980 0x7fc13814a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.758+0000 7fc13e400640 1 -- 172.21.15.44:0/1219157171 >> 172.21.15.44:0/1219157171 conn(0x7fc1380cfd90 msgr2=0x7fc13806bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.758+0000 7fc13e400640 1 -- 172.21.15.44:0/1219157171 shutdown_connections 2024-03-30T13:14:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.758+0000 7fc13e400640 1 -- 172.21.15.44:0/1219157171 wait complete. 2024-03-30T13:14:40.788 DEBUG:tasks.cephfs.test_uninlining:getting inode info #10 of 23:1099511628321 2024-03-30T13:14:40.788 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628321 2024-03-30T13:14:40.789 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628321 2024-03-30T13:14:40.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.993+0000 7f9adb000640 1 Processor -- start 2024-03-30T13:14:40.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.994+0000 7f9adb000640 1 -- start start 2024-03-30T13:14:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.995+0000 7f9adb000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ad40b4d00 0x7f9ad40d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.995+0000 7f9adb000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ad40d0b90 0x7f9ad40d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.995+0000 7f9adb000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad40b54b0 con 0x7f9ad40b4920 2024-03-30T13:14:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.995+0000 7f9adb000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad40d0260 con 0x7f9ad40b4d00 2024-03-30T13:14:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.995+0000 7f9adb000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad40cfca0 con 0x7f9ad40d0b90 2024-03-30T13:14:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.996+0000 7f9ad9200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ad40b4d00 0x7f9ad40d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.996+0000 7f9ad9200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9ad40b4d00 0x7f9ad40d4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33610/0 (socket says 172.21.15.44:33610) 2024-03-30T13:14:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.996+0000 7f9ad9200640 1 -- 172.21.15.44:0/2578313644 learned_addr learned my addr 172.21.15.44:0/2578313644 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.996+0000 7f9ada600640 1 --2- 172.21.15.44:0/2578313644 >> v2:172.21.15.151:3300/0 conn(0x7f9ad40d0b90 0x7f9ad40d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.997+0000 7f9ad9200640 1 -- 172.21.15.44:0/2578313644 >> v2:172.21.15.151:3300/0 conn(0x7f9ad40d0b90 msgr2=0x7f9ad40d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.997+0000 7f9ad9200640 1 --2- 172.21.15.44:0/2578313644 >> v2:172.21.15.151:3300/0 conn(0x7f9ad40d0b90 0x7f9ad40d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.997+0000 7f9ad9200640 1 -- 172.21.15.44:0/2578313644 >> v1:172.21.15.151:6789/0 conn(0x7f9ad40b4920 legacy=0x7f9ad40b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.997+0000 7f9ad9200640 1 -- 172.21.15.44:0/2578313644 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad40cff80 con 0x7f9ad40b4d00 2024-03-30T13:14:41.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.998+0000 7f9ad9200640 1 --2- 172.21.15.44:0/2578313644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad40b4d00 0x7f9ad40d4ac0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40ce780 tx=0x7f9ac002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304829a06229deb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.998+0000 7f9ad3e00640 1 -- 172.21.15.44:0/2578313644 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0035020 con 0x7f9ad40b4d00 2024-03-30T13:14:41.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.998+0000 7f9ad3e00640 1 -- 172.21.15.44:0/2578313644 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac0031870 con 0x7f9ad40b4d00 2024-03-30T13:14:41.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.999+0000 7f9ad3e00640 1 -- 172.21.15.44:0/2578313644 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0031c40 con 0x7f9ad40b4d00 2024-03-30T13:14:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.999+0000 7f9adb000640 1 -- 172.21.15.44:0/2578313644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad40b4d00 msgr2=0x7f9ad40d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.999+0000 7f9adb000640 1 --2- 172.21.15.44:0/2578313644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad40b4d00 0x7f9ad40d4ac0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40ce780 tx=0x7f9ac002b910 comp rx=0 tx=0).stop 2024-03-30T13:14:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.999+0000 7f9adb000640 1 -- 172.21.15.44:0/2578313644 shutdown_connections 2024-03-30T13:14:41.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.999+0000 7f9adb000640 1 --2- 172.21.15.44:0/2578313644 >> v2:172.21.15.151:3300/0 conn(0x7f9ad40d0b90 0x7f9ad40d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.999+0000 7f9adb000640 1 --2- 172.21.15.44:0/2578313644 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad40b4d00 0x7f9ad40d4ac0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.999+0000 7f9adb000640 1 -- 172.21.15.44:0/2578313644 >> 172.21.15.44:0/2578313644 conn(0x7f9ad409d4e0 msgr2=0x7f9ad40d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:40.999+0000 7f9adb000640 1 -- 172.21.15.44:0/2578313644 shutdown_connections 2024-03-30T13:14:41.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.000+0000 7f9adb000640 1 -- 172.21.15.44:0/2578313644 wait complete. 2024-03-30T13:14:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.001+0000 7f9adb000640 1 Processor -- start 2024-03-30T13:14:41.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.002+0000 7f9adb000640 1 -- start start 2024-03-30T13:14:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.003+0000 7f9adb000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad40b4920 0x7f9ad409e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.003+0000 7f9adb000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ad40b4d00 0x7f9ad40b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.003+0000 7f9adb000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ad40d0b90 0x7f9ad40b9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.003+0000 7f9adb000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad40d5000 con 0x7f9ad40b4920 2024-03-30T13:14:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.003+0000 7f9adb000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad40d2180 con 0x7f9ad40b4d00 2024-03-30T13:14:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.003+0000 7f9adb000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad40cf8c0 con 0x7f9ad40d0b90 2024-03-30T13:14:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.004+0000 7f9ad9c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad40b4920 0x7f9ad409e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.004+0000 7f9ad9c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad40b4920 0x7f9ad409e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33614/0 (socket says 172.21.15.44:33614) 2024-03-30T13:14:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.004+0000 7f9ad9c00640 1 -- 172.21.15.44:0/2444731852 learned_addr learned my addr 172.21.15.44:0/2444731852 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.004+0000 7f9ad9200640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ad40b4d00 0x7f9ad40b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.004+0000 7f9ada600640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ad40d0b90 0x7f9ad40b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.004+0000 7f9ad9c00640 1 -- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ad40d0b90 msgr2=0x7f9ad40b9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.004+0000 7f9ad9c00640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ad40d0b90 0x7f9ad40b9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.004+0000 7f9ad9c00640 1 -- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ad40b4d00 msgr2=0x7f9ad40b8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.004+0000 7f9ad9c00640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ad40b4d00 0x7f9ad40b8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.004+0000 7f9ad9c00640 1 -- 172.21.15.44:0/2444731852 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad40a0fc0 con 0x7f9ad40b4920 2024-03-30T13:14:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.004+0000 7f9ad9200640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ad40b4d00 0x7f9ad40b8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.005+0000 7f9ad9c00640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad40b4920 0x7f9ad409e860 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800c400 tx=0x7f9ac800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.005+0000 7f9ad1600640 1 -- 172.21.15.44:0/2444731852 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8017070 con 0x7f9ad40b4920 2024-03-30T13:14:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.005+0000 7f9ad1600640 1 -- 172.21.15.44:0/2444731852 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ac80052d0 con 0x7f9ad40b4920 2024-03-30T13:14:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.005+0000 7f9adb000640 1 -- 172.21.15.44:0/2444731852 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad40a12a0 con 0x7f9ad40b4920 2024-03-30T13:14:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.005+0000 7f9ad1600640 1 -- 172.21.15.44:0/2444731852 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8003830 con 0x7f9ad40b4920 2024-03-30T13:14:41.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.005+0000 7f9adb000640 1 -- 172.21.15.44:0/2444731852 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad40a1860 con 0x7f9ad40b4920 2024-03-30T13:14:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.008+0000 7f9ad1600640 1 -- 172.21.15.44:0/2444731852 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9ac801a070 con 0x7f9ad40b4920 2024-03-30T13:14:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.009+0000 7f9ad1600640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9ab406c530 0x7f9ab406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.009+0000 7f9adf24f740 1 Processor -- start 2024-03-30T13:14:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.009+0000 7f9ad1600640 1 -- 172.21.15.44:0/2444731852 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f9ac808ac00 con 0x7f9ad40b4920 2024-03-30T13:14:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.009+0000 7f9adf24f740 1 -- start start 2024-03-30T13:14:41.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.010+0000 7f9ad9200640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9ab406c530 0x7f9ab406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.011+0000 7f9adf24f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f470 0x55db31375fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.011+0000 7f9adf24f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db313764e0 0x55db3134e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.011+0000 7f9adf24f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3134e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.011+0000 7f9adf24f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55db312b2330 con 0x55db3134f850 2024-03-30T13:14:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.011+0000 7f9adf24f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55db3125a620 con 0x55db3134f470 2024-03-30T13:14:41.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.011+0000 7f9adf24f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55db312ae440 con 0x55db313764e0 2024-03-30T13:14:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.011+0000 7f9ada600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3134e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.011+0000 7f9ada600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3134e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33628/0 (socket says 172.21.15.44:33628) 2024-03-30T13:14:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.011+0000 7f9ada600640 1 -- 172.21.15.44:0/114761608 learned_addr learned my addr 172.21.15.44:0/114761608 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.011+0000 7f9ad9c00640 1 --2- 172.21.15.44:0/114761608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f470 0x55db31375fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.012+0000 7f9ada600640 1 -- 172.21.15.44:0/114761608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db313764e0 msgr2=0x55db3134e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.012+0000 7f9ada600640 1 --2- 172.21.15.44:0/114761608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db313764e0 0x55db3134e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.012+0000 7f9ada600640 1 -- 172.21.15.44:0/114761608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f470 msgr2=0x55db31375fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.012+0000 7f9ada600640 1 --2- 172.21.15.44:0/114761608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f470 0x55db31375fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.012+0000 7f9ada600640 1 -- 172.21.15.44:0/114761608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db31092920 con 0x55db3134f850 2024-03-30T13:14:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.012+0000 7f9ad9200640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9ab406c530 0x7f9ab406e9f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0036000 tx=0x7f9ac003c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.012+0000 7f9ada600640 1 --2- 172.21.15.44:0/114761608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3134e9f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9acc007470 tx=0x7f9acc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd905879e9037506 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.012+0000 7f9ac6000640 1 -- 172.21.15.44:0/114761608 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc019020 con 0x55db3134f850 2024-03-30T13:14:41.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.012+0000 7f9ac6000640 1 -- 172.21.15.44:0/114761608 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc015600 con 0x55db3134f850 2024-03-30T13:14:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.012+0000 7f9ac6000640 1 -- 172.21.15.44:0/114761608 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc0159b0 con 0x55db3134f850 2024-03-30T13:14:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.013+0000 7f9adf24f740 1 -- 172.21.15.44:0/114761608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 msgr2=0x55db3134e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.013+0000 7f9adf24f740 1 --2- 172.21.15.44:0/114761608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3134e9f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9acc007470 tx=0x7f9acc009750 comp rx=0 tx=0).stop 2024-03-30T13:14:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.013+0000 7f9adf24f740 1 -- 172.21.15.44:0/114761608 shutdown_connections 2024-03-30T13:14:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.013+0000 7f9adf24f740 1 --2- 172.21.15.44:0/114761608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3134e9f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.013+0000 7f9adf24f740 1 --2- 172.21.15.44:0/114761608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db313764e0 0x55db3134e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.013+0000 7f9adf24f740 1 --2- 172.21.15.44:0/114761608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f470 0x55db31375fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.013+0000 7f9adf24f740 1 -- 172.21.15.44:0/114761608 >> 172.21.15.44:0/114761608 conn(0x55db31315be0 msgr2=0x55db31394190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.013+0000 7f9adf24f740 1 -- 172.21.15.44:0/114761608 shutdown_connections 2024-03-30T13:14:41.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.013+0000 7f9adf24f740 1 -- 172.21.15.44:0/114761608 wait complete. 2024-03-30T13:14:41.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.014+0000 7f9adf24f740 1 -- start start 2024-03-30T13:14:41.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.015+0000 7f9adf24f740 1 Processor -- start 2024-03-30T13:14:41.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.016+0000 7f9adf24f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3134f470 0x55db3137c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.016+0000 7f9adf24f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3137cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9adf24f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3136d3a0 0x55db3136fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9adf24f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55db31375b10 con 0x55db3134f850 2024-03-30T13:14:41.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9adf24f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55db3126d9d0 con 0x55db3136d3a0 2024-03-30T13:14:41.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9adf24f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55db3136e890 con 0x55db3134f470 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9adf24f740 10 client.0 _ll_register_callbacks cb 0x55db312a9fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9ad9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3137cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9ad9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3137cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33636/0 (socket says 172.21.15.44:33636) 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9ad9200640 1 -- 172.21.15.44:0/2998739683 learned_addr learned my addr 172.21.15.44:0/2998739683 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9ada600640 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3136d3a0 0x55db3136fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9ad9c00640 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3134f470 0x55db3137c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9ad9200640 1 -- 172.21.15.44:0/2998739683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3134f470 msgr2=0x55db3137c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9ad9200640 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3134f470 0x55db3137c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9ad9200640 1 -- 172.21.15.44:0/2998739683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3136d3a0 msgr2=0x55db3136fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9ad9200640 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3136d3a0 0x55db3136fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9ad9200640 1 -- 172.21.15.44:0/2998739683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db30f86210 con 0x55db3134f850 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9ad9c00640 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3134f470 0x55db3137c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.017+0000 7f9ada600640 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3136d3a0 0x55db3136fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.018+0000 7f9ad9200640 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3137cb60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009960 tx=0x7f9ac0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904e5c90500712d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.018+0000 7f9abaa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.018+0000 7f9abaa00640 1 -- 172.21.15.44:0/2998739683 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0044610 con 0x55db3134f850 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.018+0000 7f9abaa00640 1 -- 172.21.15.44:0/2998739683 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f9ac0041050 con 0x55db3134f850 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.018+0000 7f9adf24f740 1 -- 172.21.15.44:0/2998739683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9acc015600 con 0x55db3134f850 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.018+0000 7f9abaa00640 1 -- 172.21.15.44:0/2998739683 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9ac0058050 con 0x55db3134f850 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.018+0000 7f9adf24f740 10 client.5784 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.018+0000 7f9adf24f740 1 -- 172.21.15.44:0/2998739683 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55db310f30b0 con 0x55db3134f850 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.019+0000 7f9abaa00640 1 -- 172.21.15.44:0/2998739683 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc015600 con 0x55db3134f850 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.019+0000 7f9abaa00640 1 -- 172.21.15.44:0/2998739683 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f9ac005b020 con 0x55db3134f850 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.019+0000 7f9adf24f740 10 client.5784 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.019+0000 7f9adf24f740 10 client.5784 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.019+0000 7f9adf24f740 20 client.5784 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.019+0000 7f9adf24f740 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55db31370000 0x55db31370460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.019+0000 7f9adf24f740 4 client.5784 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:41.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.019+0000 7f9adf24f740 1 -- 172.21.15.44:0/2998739683 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db312bf870 con 0x55db31370000 2024-03-30T13:14:41.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.019+0000 7f9ad9c00640 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55db31370000 0x55db31370460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.020+0000 7f9ad9c00640 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55db31370000 0x55db31370460 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8d5be76ce42be2f server_cookie=d25ca6cab8257ff3 in_seq=0 out_seq=0 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.020+0000 7f9abaa00640 10 client.5784 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.020+0000 7f9abaa00640 1 -- 172.21.15.44:0/2998739683 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55db312bf870 con 0x55db31370000 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.020+0000 7f9abaa00640 10 client.5784 handle_command_reply: tid=0 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9adf24f740 1 client.5784 shutdown 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9adf24f740 1 -- 172.21.15.44:0/2998739683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 msgr2=0x55db3137cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9adf24f740 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3137cb60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009960 tx=0x7f9ac0004730 comp rx=0 tx=0).stop 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9adf24f740 1 -- 172.21.15.44:0/2998739683 shutdown_connections 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9adf24f740 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55db31370000 0x55db31370460 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9adf24f740 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3136d3a0 0x55db3136fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9adf24f740 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3137cb60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9adf24f740 1 --2- 172.21.15.44:0/2998739683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3134f470 0x55db3137c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9abaa00640 0 client.5784 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9adf24f740 1 -- 172.21.15.44:0/2998739683 >> 172.21.15.44:0/2998739683 conn(0x55db31315be0 msgr2=0x55db31348b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9adf24f740 1 -- 172.21.15.44:0/2998739683 shutdown_connections 2024-03-30T13:14:41.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9adf24f740 1 -- 172.21.15.44:0/2998739683 wait complete. 2024-03-30T13:14:41.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.021+0000 7f9adf24f740 20 client.5784 trim_cache size 0 max 16384 2024-03-30T13:14:41.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.037+0000 7f9adf24f740 1 Processor -- start 2024-03-30T13:14:41.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.037+0000 7f9adf24f740 1 -- start start 2024-03-30T13:14:41.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.038+0000 7f9adf24f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3134f470 0x55db31375e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.038+0000 7f9adf24f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f850 0x55db31379480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.038+0000 7f9adf24f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3136d3a0 0x55db3136acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.038+0000 7f9adf24f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad4200f80 con 0x55db3136d3a0 2024-03-30T13:14:41.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.038+0000 7f9adf24f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad41fff90 con 0x55db3134f850 2024-03-30T13:14:41.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.038+0000 7f9adf24f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad40cd2a0 con 0x55db3134f470 2024-03-30T13:14:41.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.039+0000 7f9ada600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3136d3a0 0x55db3136acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.039+0000 7f9ada600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3136d3a0 0x55db3136acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33650/0 (socket says 172.21.15.44:33650) 2024-03-30T13:14:41.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.039+0000 7f9ada600640 1 -- 172.21.15.44:0/2186496927 learned_addr learned my addr 172.21.15.44:0/2186496927 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.039+0000 7f9ada600640 1 -- 172.21.15.44:0/2186496927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3134f470 msgr2=0x55db31375e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.039+0000 7f9ada600640 1 --2- 172.21.15.44:0/2186496927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3134f470 0x55db31375e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.039+0000 7f9ada600640 1 -- 172.21.15.44:0/2186496927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f850 msgr2=0x55db31379480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.039+0000 7f9ada600640 1 --2- 172.21.15.44:0/2186496927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f850 0x55db31379480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.039+0000 7f9ada600640 1 -- 172.21.15.44:0/2186496927 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db30f5f2d0 con 0x55db3136d3a0 2024-03-30T13:14:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.039+0000 7f9ada600640 1 --2- 172.21.15.44:0/2186496927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3136d3a0 0x55db3136acb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9acc018040 tx=0x7f9acc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9eba08d516183d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.040+0000 7f9ac5600640 1 -- 172.21.15.44:0/2186496927 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc019040 con 0x55db3136d3a0 2024-03-30T13:14:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.040+0000 7f9ac5600640 1 -- 172.21.15.44:0/2186496927 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc022030 con 0x55db3136d3a0 2024-03-30T13:14:41.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.040+0000 7f9ac5600640 1 -- 172.21.15.44:0/2186496927 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc015a80 con 0x55db3136d3a0 2024-03-30T13:14:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.040+0000 7f9adf24f740 1 -- 172.21.15.44:0/2186496927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3136d3a0 msgr2=0x55db3136acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.040+0000 7f9adf24f740 1 --2- 172.21.15.44:0/2186496927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3136d3a0 0x55db3136acb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9acc018040 tx=0x7f9acc015000 comp rx=0 tx=0).stop 2024-03-30T13:14:41.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.041+0000 7f9adf24f740 1 -- 172.21.15.44:0/2186496927 shutdown_connections 2024-03-30T13:14:41.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.041+0000 7f9adf24f740 1 --2- 172.21.15.44:0/2186496927 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3136d3a0 0x55db3136acb0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.041+0000 7f9adf24f740 1 --2- 172.21.15.44:0/2186496927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f850 0x55db31379480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.041+0000 7f9adf24f740 1 --2- 172.21.15.44:0/2186496927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3134f470 0x55db31375e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.041+0000 7f9adf24f740 1 -- 172.21.15.44:0/2186496927 >> 172.21.15.44:0/2186496927 conn(0x55db31315be0 msgr2=0x55db313483f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.041+0000 7f9adf24f740 1 -- 172.21.15.44:0/2186496927 shutdown_connections 2024-03-30T13:14:41.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.041+0000 7f9adf24f740 1 -- 172.21.15.44:0/2186496927 wait complete. 2024-03-30T13:14:41.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.042+0000 7f9adf24f740 1 -- start start 2024-03-30T13:14:41.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.042+0000 7f9adf24f740 1 Processor -- start 2024-03-30T13:14:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9adf24f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f470 0x55db313a6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9adf24f740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3134cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9adf24f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3136d3a0 0x55db313483f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9adf24f740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55db3134b2f0 con 0x55db3134f850 2024-03-30T13:14:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9adf24f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad40cd8f0 con 0x55db3134f470 2024-03-30T13:14:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9adf24f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55db31397dc0 con 0x55db3136d3a0 2024-03-30T13:14:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9adf24f740 10 client.0 _ll_register_callbacks cb 0x7f9acc0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9ad9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3134cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9ad9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3134cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33656/0 (socket says 172.21.15.44:33656) 2024-03-30T13:14:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9ad9200640 1 -- 172.21.15.44:0/1457318430 learned_addr learned my addr 172.21.15.44:0/1457318430 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9ad9c00640 1 --2- 172.21.15.44:0/1457318430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f470 0x55db313a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9ad9200640 1 -- 172.21.15.44:0/1457318430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3136d3a0 msgr2=0x55db313483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9ad9200640 1 --2- 172.21.15.44:0/1457318430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3136d3a0 0x55db313483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9ad9200640 1 -- 172.21.15.44:0/1457318430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f470 msgr2=0x55db313a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9ad9200640 1 --2- 172.21.15.44:0/1457318430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f470 0x55db313a6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.044+0000 7f9ad9200640 1 -- 172.21.15.44:0/1457318430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db313740e0 con 0x55db3134f850 2024-03-30T13:14:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.045+0000 7f9ad9200640 1 --2- 172.21.15.44:0/1457318430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3134cf00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0006da0 tx=0x7f9ac00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31f3a2e41cf61de server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.045+0000 7f9abaa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.045+0000 7f9abaa00640 1 -- 172.21.15.44:0/1457318430 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0060020 con 0x55db3134f850 2024-03-30T13:14:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.045+0000 7f9abaa00640 1 -- 172.21.15.44:0/1457318430 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f9ac0046890 con 0x55db3134f850 2024-03-30T13:14:41.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.045+0000 7f9adf24f740 1 -- 172.21.15.44:0/1457318430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9acc022030 con 0x55db3134f850 2024-03-30T13:14:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.045+0000 7f9abaa00640 1 -- 172.21.15.44:0/1457318430 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9ac0048070 con 0x55db3134f850 2024-03-30T13:14:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.045+0000 7f9adf24f740 10 client.5790 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.045+0000 7f9adf24f740 1 -- 172.21.15.44:0/1457318430 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55db3134d850 con 0x55db3134f850 2024-03-30T13:14:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.046+0000 7f9abaa00640 1 -- 172.21.15.44:0/1457318430 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc022030 con 0x55db3134f850 2024-03-30T13:14:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.046+0000 7f9abaa00640 1 -- 172.21.15.44:0/1457318430 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f9ac005b040 con 0x55db3134f850 2024-03-30T13:14:41.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.046+0000 7f9adf24f740 10 client.5790 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.046+0000 7f9adf24f740 10 client.5790 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.046+0000 7f9adf24f740 20 client.5790 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.046+0000 7f9adf24f740 1 --2- 172.21.15.44:0/1457318430 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55db3134d440 0x55db31348930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.046+0000 7f9adf24f740 4 client.5790 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628321}] 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.046+0000 7f9adf24f740 1 -- 172.21.15.44:0/1457318430 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628321}) -- 0x55db312b9bc0 con 0x55db3134d440 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.046+0000 7f9ad9c00640 1 --2- 172.21.15.44:0/1457318430 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55db3134d440 0x55db31348930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9ad9c00640 1 --2- 172.21.15.44:0/1457318430 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55db3134d440 0x55db31348930 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=debfa448747a0b6e server_cookie=6e407ff1601f49a5 in_seq=0 out_seq=0 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9abaa00640 10 client.5790 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9abaa00640 1 -- 172.21.15.44:0/1457318430 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3965 (crc 0 0 0) 0x55db312b9bc0 con 0x55db3134d440 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9abaa00640 10 client.5790 handle_command_reply: tid=0 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9adf24f740 1 client.5790 shutdown 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9adf24f740 1 -- 172.21.15.44:0/1457318430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 msgr2=0x55db3134cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9adf24f740 1 --2- 172.21.15.44:0/1457318430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3134cf00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0006da0 tx=0x7f9ac00046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9adf24f740 1 -- 172.21.15.44:0/1457318430 shutdown_connections 2024-03-30T13:14:41.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9adf24f740 1 --2- 172.21.15.44:0/1457318430 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55db3134d440 0x55db31348930 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9adf24f740 1 --2- 172.21.15.44:0/1457318430 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55db3136d3a0 0x55db313483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9adf24f740 1 --2- 172.21.15.44:0/1457318430 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55db3134f850 0x55db3134cf00 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9adf24f740 1 --2- 172.21.15.44:0/1457318430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db3134f470 0x55db313a6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9adf24f740 1 -- 172.21.15.44:0/1457318430 >> 172.21.15.44:0/1457318430 conn(0x55db31315be0 msgr2=0x55db31379480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.047+0000 7f9abaa00640 0 client.5790 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.048+0000 7f9adf24f740 1 -- 172.21.15.44:0/1457318430 shutdown_connections 2024-03-30T13:14:41.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.048+0000 7f9adf24f740 1 -- 172.21.15.44:0/1457318430 wait complete. 2024-03-30T13:14:41.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.048+0000 7f9adf24f740 20 client.5790 trim_cache size 0 max 16384 2024-03-30T13:14:41.055 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:41.055 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/symlink.c", 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628321, 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.264613+0000", 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.232258+0000", 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:41.056 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 916, 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:41.057 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.232258+0000", 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:41.058 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 916, 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.264613+0000" 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 916, 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:41.059 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.264613+0000" 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 140, 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 28, 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:41.060 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:06.311327+0000", 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 64, 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:41.061 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:41.062 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:41.063 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:41.064 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:41.065 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:41.066 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:41.067 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:41.067 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:41.067 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:41.067 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:41.067 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:41.067 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.067 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:41.067 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:41.067 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:41.067 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:41.067 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:41.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.048+0000 7f9adb000640 1 -- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9ab406c530 msgr2=0x7f9ab406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.048+0000 7f9adb000640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9ab406c530 0x7f9ab406e9f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0036000 tx=0x7f9ac003c040 comp rx=0 tx=0).stop 2024-03-30T13:14:41.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.048+0000 7f9adb000640 1 -- 172.21.15.44:0/2444731852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad40b4920 msgr2=0x7f9ad409e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.048+0000 7f9adb000640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad40b4920 0x7f9ad409e860 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800c400 tx=0x7f9ac800c8c0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.049+0000 7f9adb000640 1 -- 172.21.15.44:0/2444731852 shutdown_connections 2024-03-30T13:14:41.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.049+0000 7f9adb000640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ad40d0b90 0x7f9ad40b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.049+0000 7f9adb000640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9ab406c530 0x7f9ab406e9f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.049+0000 7f9adb000640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ad40b4d00 0x7f9ad40b8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.049+0000 7f9adb000640 1 --2- 172.21.15.44:0/2444731852 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad40b4920 0x7f9ad409e860 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.049+0000 7f9adb000640 1 -- 172.21.15.44:0/2444731852 >> 172.21.15.44:0/2444731852 conn(0x7f9ad409d4e0 msgr2=0x7f9ad40b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.049+0000 7f9adb000640 1 -- 172.21.15.44:0/2444731852 shutdown_connections 2024-03-30T13:14:41.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.049+0000 7f9adb000640 1 -- 172.21.15.44:0/2444731852 wait complete. 2024-03-30T13:14:41.070 DEBUG:tasks.cephfs.test_uninlining:getting inode info #11 of 23:1099511628311 2024-03-30T13:14:41.071 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628311 2024-03-30T13:14:41.071 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628311 2024-03-30T13:14:41.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.276+0000 7fca0f600640 1 Processor -- start 2024-03-30T13:14:41.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.277+0000 7fca0f600640 1 -- start start 2024-03-30T13:14:41.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.278+0000 7fca0f600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca081605a0 0x7fca080cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.278+0000 7fca0f600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca080ce9c0 con 0x7fca0806d8f0 2024-03-30T13:14:41.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.279+0000 7fca0f600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca08160b50 con 0x7fca0813f0c0 2024-03-30T13:14:41.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.279+0000 7fca0f600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fca08160e30 con 0x7fca081605a0 2024-03-30T13:14:41.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.279+0000 7fca07e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fca0806d8f0 0x7fca0815fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36832/0 (socket says 172.21.15.44:36832) 2024-03-30T13:14:41.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.279+0000 7fca07e00640 1 -- 172.21.15.44:0/2741986785 learned_addr learned my addr 172.21.15.44:0/2741986785 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:41.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.279+0000 7fca0d600640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca081605a0 0x7fca080cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.279+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640801609 0 0) 0x7fc9f4001110 con 0x7fca0806d8f0 2024-03-30T13:14:41.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.279+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9f0003520 con 0x7fca0806d8f0 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3121581153 0 0) 0x7fc9f0003520 con 0x7fca0806d8f0 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca081605a0 msgr2=0x7fca080cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca081605a0 0x7fca080cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 >> v1:172.21.15.151:6789/0 conn(0x7fca0813f0c0 legacy=0x7fca0806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0813fa40 con 0x7fca0806d8f0 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fc9f4001860 con 0x7fca0806d8f0 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 >> v1:172.21.15.44:6789/0 conn(0x7fca0806d8f0 legacy=0x7fca0815fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f00039e0 0x7fc9f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9f0004800 0x7fc9f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca081605a0 0x7fc9f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fca08160e30 con 0x7fc9f00039e0 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f0005550 con 0x7fc9f0004800 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f000bf00 con 0x7fca081605a0 2024-03-30T13:14:41.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.280+0000 7fca0cc00640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f00039e0 0x7fc9f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.281+0000 7fca07e00640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9f0004800 0x7fc9f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.281+0000 7fca0d600640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca081605a0 0x7fc9f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.281+0000 7fca0cc00640 1 -- 172.21.15.44:0/2741986785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca081605a0 msgr2=0x7fc9f000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.281+0000 7fca0cc00640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca081605a0 0x7fc9f000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.281+0000 7fca0cc00640 1 -- 172.21.15.44:0/2741986785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9f0004800 msgr2=0x7fc9f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.281+0000 7fca0cc00640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9f0004800 0x7fc9f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.281+0000 7fca0cc00640 1 -- 172.21.15.44:0/2741986785 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f0003520 con 0x7fc9f00039e0 2024-03-30T13:14:41.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.281+0000 7fca0d600640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca081605a0 0x7fc9f000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.283+0000 7fca0cc00640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f00039e0 0x7fc9f0003e00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc001750 tx=0x7fc9f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe4271cd7fa8b1e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.283+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc001370 con 0x7fc9f00039e0 2024-03-30T13:14:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.283+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc0052d0 con 0x7fc9f00039e0 2024-03-30T13:14:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.283+0000 7fca07400640 1 -- 172.21.15.44:0/2741986785 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc003830 con 0x7fc9f00039e0 2024-03-30T13:14:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.283+0000 7fca0f600640 1 -- 172.21.15.44:0/2741986785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f00039e0 msgr2=0x7fc9f0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.284+0000 7fca0f600640 1 --2- 172.21.15.44:0/2741986785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f00039e0 0x7fc9f0003e00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc001750 tx=0x7fc9f0005830 comp rx=0 tx=0).stop 2024-03-30T13:14:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.284+0000 7fca0d600640 1 -- 172.21.15.44:0/2741986785 reap_dead start 2024-03-30T13:14:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.284+0000 7fca0f600640 1 -- 172.21.15.44:0/2741986785 shutdown_connections 2024-03-30T13:14:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.284+0000 7fca0f600640 1 -- 172.21.15.44:0/2741986785 >> 172.21.15.44:0/2741986785 conn(0x7fca080b5b00 msgr2=0x7fca0806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.284+0000 7fca0f600640 1 -- 172.21.15.44:0/2741986785 shutdown_connections 2024-03-30T13:14:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.284+0000 7fca0f600640 1 -- 172.21.15.44:0/2741986785 wait complete. 2024-03-30T13:14:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.286+0000 7fca0f600640 1 Processor -- start 2024-03-30T13:14:41.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.286+0000 7fca0f600640 1 -- start start 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.287+0000 7fca0f600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f00039e0 0x7fca081445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.287+0000 7fca0f600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca080b0040 0x7fca081429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.287+0000 7fca0f600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08142ef0 0x7fca08143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.287+0000 7fca0f600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fca0813f4a0 con 0x7fc9f00039e0 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.287+0000 7fca0f600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fca08140000 con 0x7fca080b0040 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.287+0000 7fca0f600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fca0813f620 con 0x7fca08142ef0 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.287+0000 7fca0cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f00039e0 0x7fca081445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.287+0000 7fca0cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f00039e0 0x7fca081445a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33670/0 (socket says 172.21.15.44:33670) 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.287+0000 7fca0cc00640 1 -- 172.21.15.44:0/3437726980 learned_addr learned my addr 172.21.15.44:0/3437726980 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.287+0000 7fca07e00640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca080b0040 0x7fca081429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.287+0000 7fca0d600640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08142ef0 0x7fca08143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.287+0000 7fca0cc00640 1 -- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08142ef0 msgr2=0x7fca08143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.288+0000 7fca0cc00640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08142ef0 0x7fca08143370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.288+0000 7fca0cc00640 1 -- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca080b0040 msgr2=0x7fca081429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.288+0000 7fca0cc00640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca080b0040 0x7fca081429b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.288+0000 7fca0cc00640 1 -- 172.21.15.44:0/3437726980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0813eef0 con 0x7fc9f00039e0 2024-03-30T13:14:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.288+0000 7fca07e00640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca080b0040 0x7fca081429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.288+0000 7fca0d600640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08142ef0 0x7fca08143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.288+0000 7fca0cc00640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f00039e0 0x7fca081445a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc008fd0 tx=0x7fc9fc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.288+0000 7fca04c00640 1 -- 172.21.15.44:0/3437726980 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc041070 con 0x7fc9f00039e0 2024-03-30T13:14:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.288+0000 7fca04c00640 1 -- 172.21.15.44:0/3437726980 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc005480 con 0x7fc9f00039e0 2024-03-30T13:14:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.288+0000 7fca04c00640 1 -- 172.21.15.44:0/3437726980 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc001370 con 0x7fc9f00039e0 2024-03-30T13:14:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.288+0000 7fca0f600640 1 -- 172.21.15.44:0/3437726980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca08151c20 con 0x7fc9f00039e0 2024-03-30T13:14:41.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.289+0000 7fca0f600640 1 -- 172.21.15.44:0/3437726980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca081521e0 con 0x7fc9f00039e0 2024-03-30T13:14:41.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.291+0000 7fca04c00640 1 -- 172.21.15.44:0/3437726980 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc9fc044070 con 0x7fc9f00039e0 2024-03-30T13:14:41.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.292+0000 7fca1225e740 1 Processor -- start 2024-03-30T13:14:41.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.293+0000 7fca04c00640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc9e806c530 0x7fc9e806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.293+0000 7fca1225e740 1 -- start start 2024-03-30T13:14:41.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.293+0000 7fca04c00640 1 -- 172.21.15.44:0/3437726980 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc9fc0ad300 con 0x7fc9f00039e0 2024-03-30T13:14:41.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.293+0000 7fca0d600640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc9e806c530 0x7fc9e806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca1225e740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 0x557a63562030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca1225e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 0x557a635a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca1225e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b580 0x557a63583ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca1225e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557a634c4330 con 0x557a63588230 2024-03-30T13:14:41.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca1225e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557a6346c620 con 0x557a6358b580 2024-03-30T13:14:41.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca1225e740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x557a634c0440 con 0x557a6358b1a0 2024-03-30T13:14:41.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca07e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 0x557a635a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca07e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 0x557a635a3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33680/0 (socket says 172.21.15.44:33680) 2024-03-30T13:14:41.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca07e00640 1 -- 172.21.15.44:0/3112437427 learned_addr learned my addr 172.21.15.44:0/3112437427 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca0cc00640 1 --2- 172.21.15.44:0/3112437427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 0x557a63562030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca07e00640 1 -- 172.21.15.44:0/3112437427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 msgr2=0x557a63562030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca07e00640 1 --2- 172.21.15.44:0/3112437427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 0x557a63562030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca07e00640 1 -- 172.21.15.44:0/3112437427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b580 msgr2=0x557a63583ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca07e00640 1 --2- 172.21.15.44:0/3112437427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b580 0x557a63583ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.294+0000 7fca07e00640 1 -- 172.21.15.44:0/3112437427 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a632a4920 con 0x557a63588230 2024-03-30T13:14:41.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.295+0000 7fca07e00640 1 --2- 172.21.15.44:0/3112437427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 0x557a635a3b80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fca08146000 tx=0x7fc9f4005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58733a94884a4dc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.295+0000 7fca0d600640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc9e806c530 0x7fc9e806e9f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fca080b53d0 tx=0x7fca0000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.295+0000 7fc9f9200640 1 -- 172.21.15.44:0/3112437427 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f401a070 con 0x557a63588230 2024-03-30T13:14:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.295+0000 7fc9f9200640 1 -- 172.21.15.44:0/3112437427 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f4005250 con 0x557a63588230 2024-03-30T13:14:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.295+0000 7fc9f9200640 1 -- 172.21.15.44:0/3112437427 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400d070 con 0x557a63588230 2024-03-30T13:14:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.296+0000 7fca1225e740 1 -- 172.21.15.44:0/3112437427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 msgr2=0x557a635a3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.296+0000 7fca1225e740 1 --2- 172.21.15.44:0/3112437427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 0x557a635a3b80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fca08146000 tx=0x7fc9f4005d00 comp rx=0 tx=0).stop 2024-03-30T13:14:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.296+0000 7fca1225e740 1 -- 172.21.15.44:0/3112437427 shutdown_connections 2024-03-30T13:14:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.296+0000 7fca1225e740 1 --2- 172.21.15.44:0/3112437427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b580 0x557a63583ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.296+0000 7fca1225e740 1 --2- 172.21.15.44:0/3112437427 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 0x557a635a3b80 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.296+0000 7fca1225e740 1 --2- 172.21.15.44:0/3112437427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 0x557a63562030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.296+0000 7fca1225e740 1 -- 172.21.15.44:0/3112437427 >> 172.21.15.44:0/3112437427 conn(0x557a63527be0 msgr2=0x557a635a5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.296+0000 7fca1225e740 1 -- 172.21.15.44:0/3112437427 shutdown_connections 2024-03-30T13:14:41.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.296+0000 7fca1225e740 1 -- 172.21.15.44:0/3112437427 wait complete. 2024-03-30T13:14:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.297+0000 7fca1225e740 1 -- start start 2024-03-30T13:14:41.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.297+0000 7fca1225e740 1 Processor -- start 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.298+0000 7fca1225e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a63588230 0x557a63585780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.298+0000 7fca1225e740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 0x557a635a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.298+0000 7fca1225e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 0x557a635a4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.298+0000 7fca1225e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557a6355b1c0 con 0x557a6358b580 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.298+0000 7fca1225e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557a6347f9d0 con 0x557a63588230 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.298+0000 7fca1225e740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x557a6355b460 con 0x557a6358b1a0 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.298+0000 7fca1225e740 10 client.0 _ll_register_callbacks cb 0x557a634bbfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.298+0000 7fca0d600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 0x557a635a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.298+0000 7fca0d600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 0x557a635a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33682/0 (socket says 172.21.15.44:33682) 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.298+0000 7fca0d600640 1 -- 172.21.15.44:0/1231365513 learned_addr learned my addr 172.21.15.44:0/1231365513 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.299+0000 7fca0d600640 1 -- 172.21.15.44:0/1231365513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 msgr2=0x557a635a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.299+0000 7fca0d600640 1 --2- 172.21.15.44:0/1231365513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 0x557a635a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.299+0000 7fca0d600640 1 -- 172.21.15.44:0/1231365513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a63588230 msgr2=0x557a63585780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.299+0000 7fca0d600640 1 --2- 172.21.15.44:0/1231365513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a63588230 0x557a63585780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.299+0000 7fca0d600640 1 -- 172.21.15.44:0/1231365513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a63198210 con 0x557a6358b580 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.299+0000 7fca0d600640 1 --2- 172.21.15.44:0/1231365513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 0x557a635a4670 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fca0001b950 tx=0x7fca00004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac82db2453f9c432 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.299+0000 7fc9ed600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.299+0000 7fc9ed600640 1 -- 172.21.15.44:0/1231365513 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca00028060 con 0x557a6358b580 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.299+0000 7fc9ed600640 1 -- 172.21.15.44:0/1231365513 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fca00017630 con 0x557a6358b580 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.299+0000 7fca1225e740 1 -- 172.21.15.44:0/1231365513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9f4005250 con 0x557a6358b580 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.300+0000 7fc9ed600640 1 -- 172.21.15.44:0/1231365513 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fca00017830 con 0x557a6358b580 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.300+0000 7fca1225e740 10 client.5802 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.300+0000 7fca1225e740 1 -- 172.21.15.44:0/1231365513 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x557a633050b0 con 0x557a6358b580 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.300+0000 7fc9ed600640 1 -- 172.21.15.44:0/1231365513 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f4005250 con 0x557a6358b580 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.300+0000 7fc9ed600640 1 -- 172.21.15.44:0/1231365513 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fca00031080 con 0x557a6358b580 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.300+0000 7fca1225e740 10 client.5802 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.300+0000 7fca1225e740 10 client.5802 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:41.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.300+0000 7fca1225e740 20 client.5802 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.300+0000 7fca1225e740 1 --2- 172.21.15.44:0/1231365513 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557a6358c980 0x557a6359d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.300+0000 7fca1225e740 4 client.5802 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.300+0000 7fca1225e740 1 -- 172.21.15.44:0/1231365513 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a634d1870 con 0x557a6358c980 2024-03-30T13:14:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.300+0000 7fca0cc00640 1 --2- 172.21.15.44:0/1231365513 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557a6358c980 0x557a6359d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.301+0000 7fca0cc00640 1 --2- 172.21.15.44:0/1231365513 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557a6358c980 0x557a6359d7b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e291228fc4ee4c server_cookie=d55efadd47d747e2 in_seq=0 out_seq=0 2024-03-30T13:14:41.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.301+0000 7fc9ed600640 10 client.5802 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.301+0000 7fc9ed600640 1 -- 172.21.15.44:0/1231365513 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x557a634d1870 con 0x557a6358c980 2024-03-30T13:14:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.301+0000 7fc9ed600640 10 client.5802 handle_command_reply: tid=0 2024-03-30T13:14:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fca1225e740 1 client.5802 shutdown 2024-03-30T13:14:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fca1225e740 1 -- 172.21.15.44:0/1231365513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 msgr2=0x557a635a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fca1225e740 1 --2- 172.21.15.44:0/1231365513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 0x557a635a4670 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fca0001b950 tx=0x7fca00004ab0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fca1225e740 1 -- 172.21.15.44:0/1231365513 shutdown_connections 2024-03-30T13:14:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fca1225e740 1 --2- 172.21.15.44:0/1231365513 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557a6358c980 0x557a6359d7b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fca1225e740 1 --2- 172.21.15.44:0/1231365513 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 0x557a635a4670 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fca1225e740 1 --2- 172.21.15.44:0/1231365513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 0x557a635a39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fca1225e740 1 --2- 172.21.15.44:0/1231365513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a63588230 0x557a63585780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fca1225e740 1 -- 172.21.15.44:0/1231365513 >> 172.21.15.44:0/1231365513 conn(0x557a63527be0 msgr2=0x557a6355a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fc9ed600640 0 client.5802 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fca1225e740 1 -- 172.21.15.44:0/1231365513 shutdown_connections 2024-03-30T13:14:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fca1225e740 1 -- 172.21.15.44:0/1231365513 wait complete. 2024-03-30T13:14:41.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.302+0000 7fca1225e740 20 client.5802 trim_cache size 0 max 16384 2024-03-30T13:14:41.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.327+0000 7fca1225e740 1 Processor -- start 2024-03-30T13:14:41.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.327+0000 7fca1225e740 1 -- start start 2024-03-30T13:14:41.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca1225e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 0x557a63560cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca1225e740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 0x557a635c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca1225e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b580 0x557a635c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca1225e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fca081fd770 con 0x557a63588230 2024-03-30T13:14:41.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca1225e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fca081fc830 con 0x557a6358b580 2024-03-30T13:14:41.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca1225e740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fca080b4530 con 0x557a6358b1a0 2024-03-30T13:14:41.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca0cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 0x557a63560cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca0cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 0x557a63560cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33688/0 (socket says 172.21.15.44:33688) 2024-03-30T13:14:41.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca0cc00640 1 -- 172.21.15.44:0/3986025028 learned_addr learned my addr 172.21.15.44:0/3986025028 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca0cc00640 1 -- 172.21.15.44:0/3986025028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 msgr2=0x557a635c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca0cc00640 1 --2- 172.21.15.44:0/3986025028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 0x557a635c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca0d600640 1 --2- 172.21.15.44:0/3986025028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b580 0x557a635c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.329+0000 7fca0cc00640 1 -- 172.21.15.44:0/3986025028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b580 msgr2=0x557a635c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.330+0000 7fca0cc00640 1 --2- 172.21.15.44:0/3986025028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b580 0x557a635c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.330+0000 7fca0cc00640 1 -- 172.21.15.44:0/3986025028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a635a49e0 con 0x557a63588230 2024-03-30T13:14:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.330+0000 7fca0d600640 1 --2- 172.21.15.44:0/3986025028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b580 0x557a635c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.330+0000 7fca0cc00640 1 --2- 172.21.15.44:0/3986025028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 0x557a63560cc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc07aff0 tx=0x7fc9fc0773d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6460617855be43e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.330+0000 7fc9efe00640 1 -- 172.21.15.44:0/3986025028 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc04b040 con 0x557a63588230 2024-03-30T13:14:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.330+0000 7fc9efe00640 1 -- 172.21.15.44:0/3986025028 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc0ad0d0 con 0x557a63588230 2024-03-30T13:14:41.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.330+0000 7fc9efe00640 1 -- 172.21.15.44:0/3986025028 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc07f410 con 0x557a63588230 2024-03-30T13:14:41.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.331+0000 7fca1225e740 1 -- 172.21.15.44:0/3986025028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 msgr2=0x557a63560cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.331+0000 7fca1225e740 1 --2- 172.21.15.44:0/3986025028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 0x557a63560cc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc07aff0 tx=0x7fc9fc0773d0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.331+0000 7fca1225e740 1 -- 172.21.15.44:0/3986025028 shutdown_connections 2024-03-30T13:14:41.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.331+0000 7fca1225e740 1 --2- 172.21.15.44:0/3986025028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b580 0x557a635c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.331+0000 7fca1225e740 1 --2- 172.21.15.44:0/3986025028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a6358b1a0 0x557a635c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.331+0000 7fca1225e740 1 --2- 172.21.15.44:0/3986025028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a63588230 0x557a63560cc0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.331+0000 7fca1225e740 1 -- 172.21.15.44:0/3986025028 >> 172.21.15.44:0/3986025028 conn(0x557a63527be0 msgr2=0x557a635a5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.331+0000 7fca1225e740 1 -- 172.21.15.44:0/3986025028 shutdown_connections 2024-03-30T13:14:41.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.331+0000 7fca1225e740 1 -- 172.21.15.44:0/3986025028 wait complete. 2024-03-30T13:14:41.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.332+0000 7fca1225e740 1 -- start start 2024-03-30T13:14:41.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.332+0000 7fca1225e740 1 Processor -- start 2024-03-30T13:14:41.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.333+0000 7fca1225e740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a63588230 0x557a635cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.333+0000 7fca1225e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b1a0 0x557a635ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.333+0000 7fca1225e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 0x557a63585b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.333+0000 7fca1225e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fca080b4b80 con 0x557a6358b580 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.333+0000 7fca1225e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557a63584ed0 con 0x557a6358b1a0 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.333+0000 7fca1225e740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x557a635a9a70 con 0x557a63588230 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.333+0000 7fca1225e740 10 client.0 _ll_register_callbacks cb 0x7fca00007cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.334+0000 7fca0d600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 0x557a63585b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.334+0000 7fca0d600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 0x557a63585b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33690/0 (socket says 172.21.15.44:33690) 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.334+0000 7fca0d600640 1 -- 172.21.15.44:0/3252500918 learned_addr learned my addr 172.21.15.44:0/3252500918 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.334+0000 7fca0cc00640 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a63588230 0x557a635cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.334+0000 7fca0d600640 1 -- 172.21.15.44:0/3252500918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a63588230 msgr2=0x557a635cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.334+0000 7fca07e00640 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b1a0 0x557a635ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.334+0000 7fca0d600640 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a63588230 0x557a635cc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.334+0000 7fca0d600640 1 -- 172.21.15.44:0/3252500918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b1a0 msgr2=0x557a635ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.334+0000 7fca0d600640 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b1a0 0x557a635ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.334+0000 7fca0d600640 1 -- 172.21.15.44:0/3252500918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a631712d0 con 0x557a6358b580 2024-03-30T13:14:41.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.334+0000 7fca0d600640 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 0x557a63585b50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fca00017fd0 tx=0x7fca00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee0f97b8cb606f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.334+0000 7fc9ed600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:41.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fc9ed600640 1 -- 172.21.15.44:0/3252500918 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0001bd50 con 0x557a6358b580 2024-03-30T13:14:41.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fca1225e740 1 -- 172.21.15.44:0/3252500918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9fc0ad0d0 con 0x557a6358b580 2024-03-30T13:14:41.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fc9ed600640 1 -- 172.21.15.44:0/3252500918 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fca0003acd0 con 0x557a6358b580 2024-03-30T13:14:41.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fc9ed600640 1 -- 172.21.15.44:0/3252500918 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fca00019cc0 con 0x557a6358b580 2024-03-30T13:14:41.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fca1225e740 10 client.5808 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:41.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fca1225e740 1 -- 172.21.15.44:0/3252500918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x557a63561d00 con 0x557a6358b580 2024-03-30T13:14:41.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fc9ed600640 1 -- 172.21.15.44:0/3252500918 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc0ad0d0 con 0x557a6358b580 2024-03-30T13:14:41.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fc9ed600640 1 -- 172.21.15.44:0/3252500918 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fca00022030 con 0x557a6358b580 2024-03-30T13:14:41.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fca1225e740 10 client.5808 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fca1225e740 10 client.5808 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fca1225e740 20 client.5808 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fca1225e740 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557a635a3160 0x557a63586090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fca1225e740 4 client.5808 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628311}] 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.335+0000 7fca1225e740 1 -- 172.21.15.44:0/3252500918 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628311}) -- 0x557a634cbbc0 con 0x557a635a3160 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.336+0000 7fca0cc00640 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557a635a3160 0x557a63586090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.336+0000 7fca0cc00640 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557a635a3160 0x557a63586090 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19ac149a7a4bf0b server_cookie=9735c210b7db3290 in_seq=0 out_seq=0 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.336+0000 7fc9ed600640 10 client.5808 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fc9ed600640 1 -- 172.21.15.44:0/3252500918 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3963 (crc 0 0 0) 0x557a634cbbc0 con 0x557a635a3160 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fc9ed600640 10 client.5808 handle_command_reply: tid=0 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fca1225e740 1 client.5808 shutdown 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fca1225e740 1 -- 172.21.15.44:0/3252500918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 msgr2=0x557a63585b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fca1225e740 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 0x557a63585b50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fca00017fd0 tx=0x7fca00017000 comp rx=0 tx=0).stop 2024-03-30T13:14:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fca1225e740 1 -- 172.21.15.44:0/3252500918 shutdown_connections 2024-03-30T13:14:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fca1225e740 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557a635a3160 0x557a63586090 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fca1225e740 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557a6358b580 0x557a63585b50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fca1225e740 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a6358b1a0 0x557a635ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fca1225e740 1 --2- 172.21.15.44:0/3252500918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557a63588230 0x557a635cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fca1225e740 1 -- 172.21.15.44:0/3252500918 >> 172.21.15.44:0/3252500918 conn(0x557a63527be0 msgr2=0x557a635601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fc9ed600640 0 client.5808 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fca1225e740 1 -- 172.21.15.44:0/3252500918 shutdown_connections 2024-03-30T13:14:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fca1225e740 1 -- 172.21.15.44:0/3252500918 wait complete. 2024-03-30T13:14:41.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.337+0000 7fca1225e740 20 client.5808 trim_cache size 0 max 16384 2024-03-30T13:14:41.345 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:41.346 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/acl.h", 2024-03-30T13:14:41.346 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628311, 2024-03-30T13:14:41.346 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:41.346 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.273332+0000", 2024-03-30T13:14:41.346 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.204259+0000", 2024-03-30T13:14:41.346 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:41.346 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:41.346 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:41.346 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:41.346 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:41.346 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 1502, 2024-03-30T13:14:41.347 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.204259+0000", 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:41.348 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1502, 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.273332+0000" 2024-03-30T13:14:41.349 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1502, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.273332+0000" 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 120, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 8, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:41.350 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:06.323583+0000", 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 70, 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:41.351 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.352 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:41.353 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:41.354 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:41.355 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:41.356 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:41.357 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:41.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.338+0000 7fca0f600640 1 -- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc9e806c530 msgr2=0x7fc9e806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.338+0000 7fca0f600640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc9e806c530 0x7fc9e806e9f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fca080b53d0 tx=0x7fca0000b040 comp rx=0 tx=0).stop 2024-03-30T13:14:41.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.338+0000 7fca0f600640 1 -- 172.21.15.44:0/3437726980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f00039e0 msgr2=0x7fca081445a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.338+0000 7fca0f600640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f00039e0 0x7fca081445a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc008fd0 tx=0x7fc9fc001120 comp rx=0 tx=0).stop 2024-03-30T13:14:41.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.338+0000 7fca0f600640 1 -- 172.21.15.44:0/3437726980 shutdown_connections 2024-03-30T13:14:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.338+0000 7fca0f600640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08142ef0 0x7fca08143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.338+0000 7fca0f600640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc9e806c530 0x7fc9e806e9f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.338+0000 7fca0f600640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca080b0040 0x7fca081429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.338+0000 7fca0f600640 1 --2- 172.21.15.44:0/3437726980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc9f00039e0 0x7fca081445a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.338+0000 7fca0f600640 1 -- 172.21.15.44:0/3437726980 >> 172.21.15.44:0/3437726980 conn(0x7fca080b5b00 msgr2=0x7fca08141900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.338+0000 7fca0f600640 1 -- 172.21.15.44:0/3437726980 shutdown_connections 2024-03-30T13:14:41.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.338+0000 7fca0f600640 1 -- 172.21.15.44:0/3437726980 wait complete. 2024-03-30T13:14:41.360 DEBUG:tasks.cephfs.test_uninlining:getting inode info #12 of 23:1099511628325 2024-03-30T13:14:41.360 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628325 2024-03-30T13:14:41.360 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628325 2024-03-30T13:14:41.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.552+0000 7f9eeca00640 1 Processor -- start 2024-03-30T13:14:41.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.552+0000 7f9eeca00640 1 -- start start 2024-03-30T13:14:41.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.554+0000 7f9eeca00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ee815c040 0x7f9ee815f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.554+0000 7f9eeca00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 0x7f9ee80b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.554+0000 7f9eeca00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee80d32b0 con 0x7f9ee80d18f0 2024-03-30T13:14:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.554+0000 7f9eeca00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f9ee80d2210 con 0x7f9ee815c040 2024-03-30T13:14:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.554+0000 7f9eeca00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee80d24f0 con 0x7f9ee80d4880 2024-03-30T13:14:41.559 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.555+0000 7f9ee7200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 0x7f9ee80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.555+0000 7f9ee6800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ee815c040 0x7f9ee815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.555+0000 7f9ee7200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 0x7f9ee80b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:59728/0 (socket says 172.21.15.44:59728) 2024-03-30T13:14:41.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.555+0000 7f9ee7200640 1 -- 172.21.15.44:0/1922621797 learned_addr learned my addr 172.21.15.44:0/1922621797 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.555+0000 7f9ee7200640 1 -- 172.21.15.44:0/1922621797 >> v2:172.21.15.151:3300/0 conn(0x7f9ee815c040 msgr2=0x7f9ee815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.555+0000 7f9ee7200640 1 --2- 172.21.15.44:0/1922621797 >> v2:172.21.15.151:3300/0 conn(0x7f9ee815c040 0x7f9ee815f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.555+0000 7f9ee7200640 1 -- 172.21.15.44:0/1922621797 >> v1:172.21.15.151:6789/0 conn(0x7f9ee80d18f0 legacy=0x7f9ee80d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.555+0000 7f9ee7200640 1 -- 172.21.15.44:0/1922621797 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee80d27d0 con 0x7f9ee80d4880 2024-03-30T13:14:41.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.555+0000 7f9ee6800640 1 --2- 172.21.15.44:0/1922621797 >> v2:172.21.15.151:3300/0 conn(0x7f9ee815c040 0x7f9ee815f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:14:41.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.557+0000 7f9ee7200640 1 --2- 172.21.15.44:0/1922621797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 0x7f9ee80b4f10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009e80 tx=0x7f9ee002beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=976047ed86a5b9f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.557+0000 7f9ee5400640 1 -- 172.21.15.44:0/1922621797 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee002ca50 con 0x7f9ee80d4880 2024-03-30T13:14:41.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.557+0000 7f9ee5400640 1 -- 172.21.15.44:0/1922621797 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee002cbf0 con 0x7f9ee80d4880 2024-03-30T13:14:41.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.557+0000 7f9ee5400640 1 -- 172.21.15.44:0/1922621797 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00343f0 con 0x7f9ee80d4880 2024-03-30T13:14:41.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.558+0000 7f9eeca00640 1 -- 172.21.15.44:0/1922621797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 msgr2=0x7f9ee80b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.558+0000 7f9eeca00640 1 --2- 172.21.15.44:0/1922621797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 0x7f9ee80b4f10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009e80 tx=0x7f9ee002beb0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.558+0000 7f9eeca00640 1 -- 172.21.15.44:0/1922621797 shutdown_connections 2024-03-30T13:14:41.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.558+0000 7f9eeca00640 1 --2- 172.21.15.44:0/1922621797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 0x7f9ee80b4f10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.558+0000 7f9eeca00640 1 --2- 172.21.15.44:0/1922621797 >> v2:172.21.15.151:3300/0 conn(0x7f9ee815c040 0x7f9ee815f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.558+0000 7f9eeca00640 1 -- 172.21.15.44:0/1922621797 >> 172.21.15.44:0/1922621797 conn(0x7f9ee808dbf0 msgr2=0x7f9ee809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.558+0000 7f9eeca00640 1 -- 172.21.15.44:0/1922621797 shutdown_connections 2024-03-30T13:14:41.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.558+0000 7f9eeca00640 1 -- 172.21.15.44:0/1922621797 wait complete. 2024-03-30T13:14:41.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.561+0000 7f9eeca00640 1 Processor -- start 2024-03-30T13:14:41.566 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.561+0000 7f9eeca00640 1 -- start start 2024-03-30T13:14:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.563+0000 7f9eeca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ee80d18f0 0x7f9ee80c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.563+0000 7f9eeca00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 0x7f9ee8152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.563+0000 7f9eeca00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee815c040 0x7f9ee8151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.563+0000 7f9eeca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee815c420 con 0x7f9ee80d18f0 2024-03-30T13:14:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.563+0000 7f9eeca00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee80d2d90 con 0x7f9ee815c040 2024-03-30T13:14:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.563+0000 7f9eeca00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee815f8a0 con 0x7f9ee80d4880 2024-03-30T13:14:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.563+0000 7f9ee6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ee80d18f0 0x7f9ee80c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.563+0000 7f9ee6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ee80d18f0 0x7f9ee80c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33696/0 (socket says 172.21.15.44:33696) 2024-03-30T13:14:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.563+0000 7f9ee6800640 1 -- 172.21.15.44:0/3968006118 learned_addr learned my addr 172.21.15.44:0/3968006118 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9ee7200640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee815c040 0x7f9ee8151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 0x7f9ee8152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9ee6800640 1 -- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 msgr2=0x7f9ee8152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9ee6800640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 0x7f9ee8152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9ee6800640 1 -- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee815c040 msgr2=0x7f9ee8151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9ee6800640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee815c040 0x7f9ee8151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9ee6800640 1 -- 172.21.15.44:0/3968006118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee81f7b10 con 0x7f9ee80d18f0 2024-03-30T13:14:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 0x7f9ee8152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9ee7200640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee815c040 0x7f9ee8151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9ee6800640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ee80d18f0 0x7f9ee80c9200 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800ec10 tx=0x7f9ed800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9edea00640 1 -- 172.21.15.44:0/3968006118 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8017070 con 0x7f9ee80d18f0 2024-03-30T13:14:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9edea00640 1 -- 172.21.15.44:0/3968006118 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed800cc30 con 0x7f9ee80d18f0 2024-03-30T13:14:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9edea00640 1 -- 172.21.15.44:0/3968006118 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8013470 con 0x7f9ee80d18f0 2024-03-30T13:14:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.564+0000 7f9eeca00640 1 -- 172.21.15.44:0/3968006118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee81f8890 con 0x7f9ee80d18f0 2024-03-30T13:14:41.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.565+0000 7f9eeca00640 1 -- 172.21.15.44:0/3968006118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee81f8090 con 0x7f9ee80d18f0 2024-03-30T13:14:41.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.568+0000 7f9edea00640 1 -- 172.21.15.44:0/3968006118 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9ed801a070 con 0x7f9ee80d18f0 2024-03-30T13:14:41.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.568+0000 7f9edea00640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9ec806c530 0x7f9ec806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.569+0000 7f9edea00640 1 -- 172.21.15.44:0/3968006118 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f9ed808b760 con 0x7f9ee80d18f0 2024-03-30T13:14:41.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.569+0000 7f9ef0031740 1 Processor -- start 2024-03-30T13:14:41.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.569+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9ec806c530 0x7f9ec806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.569+0000 7f9ef0031740 1 -- start start 2024-03-30T13:14:41.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.570+0000 7f9ef0031740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 0x55ce63804fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.570+0000 7f9ef0031740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce638054e0 0x55ce637dd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.570+0000 7f9ef0031740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de850 0x55ce637dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.570+0000 7f9ef0031740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ce63741330 con 0x55ce638054e0 2024-03-30T13:14:41.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.570+0000 7f9ef0031740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ce636e9620 con 0x55ce637de470 2024-03-30T13:14:41.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.570+0000 7f9ef0031740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55ce6373d440 con 0x55ce637de850 2024-03-30T13:14:41.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.570+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9ec806c530 0x7f9ec806e9f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9ee81f78d0 tx=0x7f9ed4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.570+0000 7f9ee5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce638054e0 0x55ce637dd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.571+0000 7f9ee5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce638054e0 0x55ce637dd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33710/0 (socket says 172.21.15.44:33710) 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.571+0000 7f9ee5e00640 1 -- 172.21.15.44:0/1475878483 learned_addr learned my addr 172.21.15.44:0/1475878483 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.571+0000 7f9ee6800640 1 --2- 172.21.15.44:0/1475878483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 0x55ce63804fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.571+0000 7f9ee7200640 1 --2- 172.21.15.44:0/1475878483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de850 0x55ce637dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.571+0000 7f9ee5e00640 1 -- 172.21.15.44:0/1475878483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de850 msgr2=0x55ce637dd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.571+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/1475878483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de850 0x55ce637dd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.571+0000 7f9ee5e00640 1 -- 172.21.15.44:0/1475878483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 msgr2=0x55ce63804fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.571+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/1475878483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 0x55ce63804fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.571+0000 7f9ee5e00640 1 -- 172.21.15.44:0/1475878483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce63521920 con 0x55ce638054e0 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.571+0000 7f9ee6800640 1 --2- 172.21.15.44:0/1475878483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 0x55ce63804fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.571+0000 7f9ee7200640 1 --2- 172.21.15.44:0/1475878483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de850 0x55ce637dd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.571+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/1475878483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce638054e0 0x55ce637dd4b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400d790 tx=0x7f9ed4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1ebd61afceb489 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.572+0000 7f9ed3000640 1 -- 172.21.15.44:0/1475878483 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4024070 con 0x55ce638054e0 2024-03-30T13:14:41.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.572+0000 7f9ed3000640 1 -- 172.21.15.44:0/1475878483 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed4014ba0 con 0x55ce638054e0 2024-03-30T13:14:41.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.572+0000 7f9ed3000640 1 -- 172.21.15.44:0/1475878483 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4007050 con 0x55ce638054e0 2024-03-30T13:14:41.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.572+0000 7f9ef0031740 1 -- 172.21.15.44:0/1475878483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce638054e0 msgr2=0x55ce637dd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.572+0000 7f9ef0031740 1 --2- 172.21.15.44:0/1475878483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce638054e0 0x55ce637dd4b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400d790 tx=0x7f9ed4010000 comp rx=0 tx=0).stop 2024-03-30T13:14:41.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.572+0000 7f9ef0031740 1 -- 172.21.15.44:0/1475878483 shutdown_connections 2024-03-30T13:14:41.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.572+0000 7f9ef0031740 1 --2- 172.21.15.44:0/1475878483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de850 0x55ce637dd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.572+0000 7f9ef0031740 1 --2- 172.21.15.44:0/1475878483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce638054e0 0x55ce637dd4b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.572+0000 7f9ef0031740 1 --2- 172.21.15.44:0/1475878483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 0x55ce63804fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.572+0000 7f9ef0031740 1 -- 172.21.15.44:0/1475878483 >> 172.21.15.44:0/1475878483 conn(0x55ce637a4be0 msgr2=0x55ce63823190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.572+0000 7f9ef0031740 1 -- 172.21.15.44:0/1475878483 shutdown_connections 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.572+0000 7f9ef0031740 1 -- 172.21.15.44:0/1475878483 wait complete. 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.573+0000 7f9ef0031740 1 -- start start 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.573+0000 7f9ef0031740 1 Processor -- start 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.574+0000 7f9ef0031740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 0x55ce63809d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.574+0000 7f9ef0031740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de850 0x55ce638080f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.574+0000 7f9ef0031740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6381f9b0 0x55ce63808630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.574+0000 7f9ef0031740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ce63804b10 con 0x55ce6381f9b0 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.574+0000 7f9ef0031740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ce636fc9d0 con 0x55ce637de470 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.574+0000 7f9ef0031740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55ce637fd890 con 0x55ce637de850 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.575+0000 7f9ef0031740 10 client.0 _ll_register_callbacks cb 0x55ce63738fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:41.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.575+0000 7f9ee7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6381f9b0 0x55ce63808630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.575+0000 7f9ee7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6381f9b0 0x55ce63808630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33718/0 (socket says 172.21.15.44:33718) 2024-03-30T13:14:41.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.575+0000 7f9ee7200640 1 -- 172.21.15.44:0/2435890567 learned_addr learned my addr 172.21.15.44:0/2435890567 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.575+0000 7f9ee6800640 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 0x55ce63809d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.575+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de850 0x55ce638080f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.575+0000 7f9ee7200640 1 -- 172.21.15.44:0/2435890567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de850 msgr2=0x55ce638080f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.575+0000 7f9ee7200640 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de850 0x55ce638080f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.575+0000 7f9ee7200640 1 -- 172.21.15.44:0/2435890567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 msgr2=0x55ce63809d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.575+0000 7f9ee7200640 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 0x55ce63809d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.575+0000 7f9ee7200640 1 -- 172.21.15.44:0/2435890567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce63415210 con 0x55ce6381f9b0 2024-03-30T13:14:41.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.576+0000 7f9ee7200640 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6381f9b0 0x55ce63808630 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009fa0 tx=0x7f9ee0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d469943b6d689c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.576+0000 7f9ec7400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:41.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.576+0000 7f9ec7400640 1 -- 172.21.15.44:0/2435890567 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0044070 con 0x55ce6381f9b0 2024-03-30T13:14:41.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.576+0000 7f9ec7400640 1 -- 172.21.15.44:0/2435890567 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f9ee0034b30 con 0x55ce6381f9b0 2024-03-30T13:14:41.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.576+0000 7f9ef0031740 1 -- 172.21.15.44:0/2435890567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ed4014ba0 con 0x55ce6381f9b0 2024-03-30T13:14:41.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.576+0000 7f9ec7400640 1 -- 172.21.15.44:0/2435890567 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9ee0034d30 con 0x55ce6381f9b0 2024-03-30T13:14:41.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.576+0000 7f9ef0031740 10 client.5817 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:41.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.576+0000 7f9ef0031740 1 -- 172.21.15.44:0/2435890567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55ce635820b0 con 0x55ce6381f9b0 2024-03-30T13:14:41.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.576+0000 7f9ec7400640 1 -- 172.21.15.44:0/2435890567 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed4014ba0 con 0x55ce6381f9b0 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.577+0000 7f9ec7400640 1 -- 172.21.15.44:0/2435890567 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f9ee0008040 con 0x55ce6381f9b0 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.577+0000 7f9ef0031740 10 client.5817 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.577+0000 7f9ef0031740 10 client.5817 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.577+0000 7f9ef0031740 20 client.5817 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.577+0000 7f9ef0031740 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ce63833260 0x55ce63833660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.577+0000 7f9ef0031740 4 client.5817 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.577+0000 7f9ef0031740 1 -- 172.21.15.44:0/2435890567 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce6374e870 con 0x55ce63833260 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.577+0000 7f9ee6800640 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ce63833260 0x55ce63833660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.578+0000 7f9ee6800640 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ce63833260 0x55ce63833660 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0a4976f49159db5 server_cookie=a9e015f7c606bb7b in_seq=0 out_seq=0 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.578+0000 7f9ec7400640 10 client.5817 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.578+0000 7f9ec7400640 1 -- 172.21.15.44:0/2435890567 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55ce6374e870 con 0x55ce63833260 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.578+0000 7f9ec7400640 10 client.5817 handle_command_reply: tid=0 2024-03-30T13:14:41.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.578+0000 7f9ef0031740 1 client.5817 shutdown 2024-03-30T13:14:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.578+0000 7f9ef0031740 1 -- 172.21.15.44:0/2435890567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6381f9b0 msgr2=0x55ce63808630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.578+0000 7f9ef0031740 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6381f9b0 0x55ce63808630 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009fa0 tx=0x7f9ee0004ab0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.579+0000 7f9ef0031740 1 -- 172.21.15.44:0/2435890567 shutdown_connections 2024-03-30T13:14:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.579+0000 7f9ef0031740 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ce63833260 0x55ce63833660 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.579+0000 7f9ef0031740 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce6381f9b0 0x55ce63808630 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.579+0000 7f9ef0031740 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de850 0x55ce638080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.579+0000 7f9ef0031740 1 --2- 172.21.15.44:0/2435890567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 0x55ce63809d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.579+0000 7f9ef0031740 1 -- 172.21.15.44:0/2435890567 >> 172.21.15.44:0/2435890567 conn(0x55ce637a4be0 msgr2=0x55ce637d7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.579+0000 7f9ec7400640 0 client.5817 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.579+0000 7f9ef0031740 1 -- 172.21.15.44:0/2435890567 shutdown_connections 2024-03-30T13:14:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.579+0000 7f9ef0031740 1 -- 172.21.15.44:0/2435890567 wait complete. 2024-03-30T13:14:41.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.579+0000 7f9ef0031740 20 client.5817 trim_cache size 0 max 16384 2024-03-30T13:14:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.595+0000 7f9ef0031740 1 Processor -- start 2024-03-30T13:14:41.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.595+0000 7f9ef0031740 1 -- start start 2024-03-30T13:14:41.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ef0031740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 0x55ce637d75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ef0031740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 0x55ce637d7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ef0031740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce6381f9b0 0x55ce63818b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ef0031740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee82010d0 con 0x55ce637de850 2024-03-30T13:14:41.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ef0031740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee8200170 con 0x55ce637de470 2024-03-30T13:14:41.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ef0031740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee806d3f0 con 0x55ce6381f9b0 2024-03-30T13:14:41.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ee5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 0x55ce637d7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ee5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 0x55ce637d7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33720/0 (socket says 172.21.15.44:33720) 2024-03-30T13:14:41.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ee5e00640 1 -- 172.21.15.44:0/3098950348 learned_addr learned my addr 172.21.15.44:0/3098950348 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ee5e00640 1 -- 172.21.15.44:0/3098950348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce6381f9b0 msgr2=0x55ce63818b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/3098950348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce6381f9b0 0x55ce63818b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ee5e00640 1 -- 172.21.15.44:0/3098950348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 msgr2=0x55ce637d75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/3098950348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 0x55ce637d75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.596+0000 7f9ee5e00640 1 -- 172.21.15.44:0/3098950348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce633ee2d0 con 0x55ce637de850 2024-03-30T13:14:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.597+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/3098950348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 0x55ce637d7b20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4022040 tx=0x7f9ed4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c41c7e23456389 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.597+0000 7f9ed2600640 1 -- 172.21.15.44:0/3098950348 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4024040 con 0x55ce637de850 2024-03-30T13:14:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.597+0000 7f9ed2600640 1 -- 172.21.15.44:0/3098950348 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed4014d40 con 0x55ce637de850 2024-03-30T13:14:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.597+0000 7f9ed2600640 1 -- 172.21.15.44:0/3098950348 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4007290 con 0x55ce637de850 2024-03-30T13:14:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.598+0000 7f9ef0031740 1 -- 172.21.15.44:0/3098950348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 msgr2=0x55ce637d7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.598+0000 7f9ef0031740 1 --2- 172.21.15.44:0/3098950348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 0x55ce637d7b20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4022040 tx=0x7f9ed4012000 comp rx=0 tx=0).stop 2024-03-30T13:14:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.598+0000 7f9ef0031740 1 -- 172.21.15.44:0/3098950348 shutdown_connections 2024-03-30T13:14:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.598+0000 7f9ef0031740 1 --2- 172.21.15.44:0/3098950348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce6381f9b0 0x55ce63818b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.598+0000 7f9ef0031740 1 --2- 172.21.15.44:0/3098950348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 0x55ce637d7b20 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.598+0000 7f9ef0031740 1 --2- 172.21.15.44:0/3098950348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce637de470 0x55ce637d75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.598+0000 7f9ef0031740 1 -- 172.21.15.44:0/3098950348 >> 172.21.15.44:0/3098950348 conn(0x55ce637a4be0 msgr2=0x55ce6381ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.598+0000 7f9ef0031740 1 -- 172.21.15.44:0/3098950348 shutdown_connections 2024-03-30T13:14:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.598+0000 7f9ef0031740 1 -- 172.21.15.44:0/3098950348 wait complete. 2024-03-30T13:14:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.598+0000 7f9ef0031740 1 -- start start 2024-03-30T13:14:41.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.599+0000 7f9ef0031740 1 Processor -- start 2024-03-30T13:14:41.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ef0031740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de470 0x55ce63809740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ef0031740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 0x55ce63807410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ef0031740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce6381f9b0 0x55ce6389ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ef0031740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ce637da6b0 con 0x55ce637de850 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ef0031740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee806da40 con 0x55ce6381f9b0 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ef0031740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55ce63807e20 con 0x55ce637de470 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ef0031740 10 client.0 _ll_register_callbacks cb 0x7f9ed8009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ee5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 0x55ce63807410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ee5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 0x55ce63807410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33732/0 (socket says 172.21.15.44:33732) 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ee5e00640 1 -- 172.21.15.44:0/1884874505 learned_addr learned my addr 172.21.15.44:0/1884874505 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ee7200640 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce6381f9b0 0x55ce6389ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ee5e00640 1 -- 172.21.15.44:0/1884874505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de470 msgr2=0x55ce63809740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ee6800640 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de470 0x55ce63809740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de470 0x55ce63809740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ee5e00640 1 -- 172.21.15.44:0/1884874505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce6381f9b0 msgr2=0x55ce6389ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce6381f9b0 0x55ce6389ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ee5e00640 1 -- 172.21.15.44:0/1884874505 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce63807950 con 0x55ce637de850 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.600+0000 7f9ee7200640 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce6381f9b0 0x55ce6389ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.601+0000 7f9ee5e00640 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 0x55ce63807410 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9ed401e000 tx=0x7f9ed4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1617e4ba9d2ee0e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.601+0000 7f9ec7400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.601+0000 7f9ec7400640 1 -- 172.21.15.44:0/1884874505 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4035070 con 0x55ce637de850 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.601+0000 7f9ec7400640 1 -- 172.21.15.44:0/1884874505 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f9ed4007450 con 0x55ce637de850 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.601+0000 7f9ef0031740 1 -- 172.21.15.44:0/1884874505 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ed4014d40 con 0x55ce637de850 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.601+0000 7f9ec7400640 1 -- 172.21.15.44:0/1884874505 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9ed4024070 con 0x55ce637de850 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.602+0000 7f9ef0031740 10 client.5823 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.602+0000 7f9ef0031740 1 -- 172.21.15.44:0/1884874505 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55ce6389e3f0 con 0x55ce637de850 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.602+0000 7f9ec7400640 1 -- 172.21.15.44:0/1884874505 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed4014d40 con 0x55ce637de850 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.602+0000 7f9ec7400640 1 -- 172.21.15.44:0/1884874505 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f9ed40067d0 con 0x55ce637de850 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.602+0000 7f9ef0031740 10 client.5823 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:41.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.602+0000 7f9ef0031740 10 client.5823 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:41.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.602+0000 7f9ef0031740 20 client.5823 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:41.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.602+0000 7f9ef0031740 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ce63804160 0x55ce637d75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.602+0000 7f9ef0031740 4 client.5823 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628325}] 2024-03-30T13:14:41.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.602+0000 7f9ef0031740 1 -- 172.21.15.44:0/1884874505 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628325}) -- 0x55ce63748bc0 con 0x55ce63804160 2024-03-30T13:14:41.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.602+0000 7f9ee6800640 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ce63804160 0x55ce637d75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ee6800640 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ce63804160 0x55ce637d75e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abbec006c16992bc server_cookie=94dbf06d139daabe in_seq=0 out_seq=0 2024-03-30T13:14:41.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ec7400640 10 client.5823 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ec7400640 1 -- 172.21.15.44:0/1884874505 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3974 (crc 0 0 0) 0x55ce63748bc0 con 0x55ce63804160 2024-03-30T13:14:41.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ec7400640 10 client.5823 handle_command_reply: tid=0 2024-03-30T13:14:41.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ef0031740 1 client.5823 shutdown 2024-03-30T13:14:41.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ef0031740 1 -- 172.21.15.44:0/1884874505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 msgr2=0x55ce63807410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ef0031740 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 0x55ce63807410 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9ed401e000 tx=0x7f9ed4000bc0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ef0031740 1 -- 172.21.15.44:0/1884874505 shutdown_connections 2024-03-30T13:14:41.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ef0031740 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ce63804160 0x55ce637d75e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ef0031740 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce6381f9b0 0x55ce6389ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ef0031740 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ce637de850 0x55ce63807410 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ef0031740 1 --2- 172.21.15.44:0/1884874505 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ce637de470 0x55ce63809740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ec7400640 0 client.5823 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.603+0000 7f9ef0031740 1 -- 172.21.15.44:0/1884874505 >> 172.21.15.44:0/1884874505 conn(0x55ce637a4be0 msgr2=0x55ce63835270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.604+0000 7f9ef0031740 1 -- 172.21.15.44:0/1884874505 shutdown_connections 2024-03-30T13:14:41.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.604+0000 7f9ef0031740 1 -- 172.21.15.44:0/1884874505 wait complete. 2024-03-30T13:14:41.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.604+0000 7f9ef0031740 20 client.5823 trim_cache size 0 max 16384 2024-03-30T13:14:41.612 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/xattr_trusted.c", 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628325, 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.278972+0000", 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.242258+0000", 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:41.613 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 1094, 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:41.614 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.242258+0000", 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:41.615 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1094, 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.278972+0000" 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1094, 2024-03-30T13:14:41.616 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.278972+0000" 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 124, 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 36, 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:41.617 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:41.618 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:41.618 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.618 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:06.335560+0000", 2024-03-30T13:14:41.618 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 74, 2024-03-30T13:14:41.618 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:41.618 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:41.618 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:41.618 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:41.618 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:41.618 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:41.618 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.618 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:41.619 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:41.620 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.621 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:41.622 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.623 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.624 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:41.625 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:41.625 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:41.625 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:41.625 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:41.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.604+0000 7f9eeca00640 1 -- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9ec806c530 msgr2=0x7f9ec806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.604+0000 7f9eeca00640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9ec806c530 0x7f9ec806e9f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9ee81f78d0 tx=0x7f9ed4009040 comp rx=0 tx=0).stop 2024-03-30T13:14:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.604+0000 7f9eeca00640 1 -- 172.21.15.44:0/3968006118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ee80d18f0 msgr2=0x7f9ee80c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.604+0000 7f9eeca00640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ee80d18f0 0x7f9ee80c9200 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800ec10 tx=0x7f9ed800c520 comp rx=0 tx=0).stop 2024-03-30T13:14:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.605+0000 7f9eeca00640 1 -- 172.21.15.44:0/3968006118 shutdown_connections 2024-03-30T13:14:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.605+0000 7f9eeca00640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f9ec806c530 0x7f9ec806e9f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.605+0000 7f9eeca00640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee815c040 0x7f9ee8151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.605+0000 7f9eeca00640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ee80d4880 0x7f9ee8152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.605+0000 7f9eeca00640 1 --2- 172.21.15.44:0/3968006118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ee80d18f0 0x7f9ee80c9200 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.605+0000 7f9eeca00640 1 -- 172.21.15.44:0/3968006118 >> 172.21.15.44:0/3968006118 conn(0x7f9ee808dbf0 msgr2=0x7f9ee815d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.605+0000 7f9eeca00640 1 -- 172.21.15.44:0/3968006118 shutdown_connections 2024-03-30T13:14:41.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.605+0000 7f9eeca00640 1 -- 172.21.15.44:0/3968006118 wait complete. 2024-03-30T13:14:41.628 DEBUG:tasks.cephfs.test_uninlining:getting inode info #13 of 23:1099511628323 2024-03-30T13:14:41.628 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628323 2024-03-30T13:14:41.628 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628323 2024-03-30T13:14:41.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.843+0000 7f291ca00640 1 Processor -- start 2024-03-30T13:14:41.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.843+0000 7f291ca00640 1 -- start start 2024-03-30T13:14:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.845+0000 7f291ca00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29180b4d00 0x7f29180d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.845+0000 7f291ca00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f29180d0b90 0x7f29180d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.845+0000 7f291ca00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29180b54b0 con 0x7f29180b4920 2024-03-30T13:14:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.845+0000 7f291ca00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f29180d0260 con 0x7f29180d0b90 2024-03-30T13:14:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.845+0000 7f291ca00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f29180cfca0 con 0x7f29180b4d00 2024-03-30T13:14:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.845+0000 7f2917400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f29180b4920 0x7f29180b3ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36840/0 (socket says 172.21.15.44:36840) 2024-03-30T13:14:41.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.845+0000 7f2917400640 1 -- 172.21.15.44:0/2931139024 learned_addr learned my addr 172.21.15.44:0/2931139024 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:41.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2917e00640 1 --2- 172.21.15.44:0/2931139024 >> v2:172.21.15.151:3300/0 conn(0x7f29180d0b90 0x7f29180d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f290fe00640 1 --2- 172.21.15.44:0/2931139024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29180b4d00 0x7f29180d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668916097 0 0) 0x7f2908001110 con 0x7f29180b4920 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28fc003520 con 0x7f29180b4920 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2696239714 0 0) 0x7f28fc003520 con 0x7f29180b4920 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29180b4d00 msgr2=0x7f29180d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 --2- 172.21.15.44:0/2931139024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29180b4d00 0x7f29180d4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 >> v2:172.21.15.151:3300/0 conn(0x7f29180d0b90 msgr2=0x7f29180d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 --2- 172.21.15.44:0/2931139024 >> v2:172.21.15.151:3300/0 conn(0x7f29180d0b90 0x7f29180d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29180cff80 con 0x7f29180b4920 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f2908001840 con 0x7f29180b4920 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f290fe00640 1 --2- 172.21.15.44:0/2931139024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29180b4d00 0x7f29180d4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 >> v1:172.21.15.44:6789/0 conn(0x7f29180b4920 legacy=0x7f29180b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 --2- 172.21.15.44:0/2931139024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28fc0039b0 0x7f28fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 --2- 172.21.15.44:0/2931139024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28fc004800 0x7f28fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 --2- 172.21.15.44:0/2931139024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29180b4d00 0x7f28fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f29180d0260 con 0x7f28fc0039b0 2024-03-30T13:14:41.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f29180cfca0 con 0x7f28fc004800 2024-03-30T13:14:41.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.846+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f28fc00ba70 con 0x7f29180b4d00 2024-03-30T13:14:41.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.847+0000 7f2917400640 1 --2- 172.21.15.44:0/2931139024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28fc0039b0 0x7f28fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.847+0000 7f2917e00640 1 --2- 172.21.15.44:0/2931139024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29180b4d00 0x7f28fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.847+0000 7f2917400640 1 -- 172.21.15.44:0/2931139024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29180b4d00 msgr2=0x7f28fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.847+0000 7f2917400640 1 --2- 172.21.15.44:0/2931139024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29180b4d00 0x7f28fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.847+0000 7f2917400640 1 -- 172.21.15.44:0/2931139024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28fc004800 msgr2=0x7f28fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.847+0000 7f2917400640 1 --2- 172.21.15.44:0/2931139024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28fc004800 0x7f28fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.847+0000 7f2917400640 1 -- 172.21.15.44:0/2931139024 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc003520 con 0x7f28fc0039b0 2024-03-30T13:14:41.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.848+0000 7f2917400640 1 --2- 172.21.15.44:0/2931139024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28fc0039b0 0x7f28fc003dd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f290800c2f0 tx=0x7f28fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb10fa82631c9202 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.849+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290802cbf0 con 0x7f28fc0039b0 2024-03-30T13:14:41.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.849+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2908030070 con 0x7f28fc0039b0 2024-03-30T13:14:41.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.849+0000 7f2916a00640 1 -- 172.21.15.44:0/2931139024 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29080058d0 con 0x7f28fc0039b0 2024-03-30T13:14:41.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.849+0000 7f291ca00640 1 -- 172.21.15.44:0/2931139024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28fc0039b0 msgr2=0x7f28fc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.849+0000 7f291ca00640 1 --2- 172.21.15.44:0/2931139024 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f28fc0039b0 0x7f28fc003dd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f290800c2f0 tx=0x7f28fc005830 comp rx=0 tx=0).stop 2024-03-30T13:14:41.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.849+0000 7f2917e00640 1 -- 172.21.15.44:0/2931139024 reap_dead start 2024-03-30T13:14:41.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.849+0000 7f291ca00640 1 -- 172.21.15.44:0/2931139024 shutdown_connections 2024-03-30T13:14:41.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.849+0000 7f291ca00640 1 -- 172.21.15.44:0/2931139024 >> 172.21.15.44:0/2931139024 conn(0x7f291809d4e0 msgr2=0x7f29180d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.850+0000 7f291ca00640 1 -- 172.21.15.44:0/2931139024 shutdown_connections 2024-03-30T13:14:41.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.850+0000 7f291ca00640 1 -- 172.21.15.44:0/2931139024 wait complete. 2024-03-30T13:14:41.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.851+0000 7f291ca00640 1 Processor -- start 2024-03-30T13:14:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.851+0000 7f291ca00640 1 -- start start 2024-03-30T13:14:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.852+0000 7f291ca00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28fc0039b0 0x7f291815dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.852+0000 7f291ca00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29180b8580 0x7f29180c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.852+0000 7f291ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29180b89c0 0x7f29180c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.852+0000 7f291ca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f29180cf8c0 con 0x7f29180b89c0 2024-03-30T13:14:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.852+0000 7f291ca00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f29180d2180 con 0x7f29180b8580 2024-03-30T13:14:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.852+0000 7f291ca00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f29180cfa40 con 0x7f28fc0039b0 2024-03-30T13:14:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.853+0000 7f2917e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29180b89c0 0x7f29180c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.853+0000 7f2917e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29180b89c0 0x7f29180c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33748/0 (socket says 172.21.15.44:33748) 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.853+0000 7f2917e00640 1 -- 172.21.15.44:0/106259044 learned_addr learned my addr 172.21.15.44:0/106259044 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.853+0000 7f290fe00640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29180b8580 0x7f29180c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.853+0000 7f2917400640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28fc0039b0 0x7f291815dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.853+0000 7f2917e00640 1 -- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28fc0039b0 msgr2=0x7f291815dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.853+0000 7f2917e00640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28fc0039b0 0x7f291815dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.853+0000 7f2917e00640 1 -- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29180b8580 msgr2=0x7f29180c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.853+0000 7f2917e00640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29180b8580 0x7f29180c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.853+0000 7f2917e00640 1 -- 172.21.15.44:0/106259044 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29180c96a0 con 0x7f29180b89c0 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.853+0000 7f2917400640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28fc0039b0 0x7f291815dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.854+0000 7f2917e00640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29180b89c0 0x7f29180c9020 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f29180d0f70 tx=0x7f29100115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.854+0000 7f290f400640 1 -- 172.21.15.44:0/106259044 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910011e10 con 0x7f29180b89c0 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.854+0000 7f290f400640 1 -- 172.21.15.44:0/106259044 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291001b070 con 0x7f29180b89c0 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.854+0000 7f290f400640 1 -- 172.21.15.44:0/106259044 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910003990 con 0x7f29180b89c0 2024-03-30T13:14:41.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.854+0000 7f291ca00640 1 -- 172.21.15.44:0/106259044 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29180c9980 con 0x7f29180b89c0 2024-03-30T13:14:41.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.854+0000 7f291ca00640 1 -- 172.21.15.44:0/106259044 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29180b7220 con 0x7f29180b89c0 2024-03-30T13:14:41.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.857+0000 7f290f400640 1 -- 172.21.15.44:0/106259044 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2910005d10 con 0x7f29180b89c0 2024-03-30T13:14:41.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.858+0000 7f290f400640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f28f406c560 0x7f28f406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.858+0000 7f290f400640 1 -- 172.21.15.44:0/106259044 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f291008bd10 con 0x7f29180b89c0 2024-03-30T13:14:41.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.859+0000 7f2920c05740 1 Processor -- start 2024-03-30T13:14:41.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.859+0000 7f2917400640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f28f406c560 0x7f28f406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.859+0000 7f2920c05740 1 -- start start 2024-03-30T13:14:41.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.860+0000 7f2920c05740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8470 0x556d109cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.860+0000 7f2920c05740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109cf4e0 0x556d109a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.860+0000 7f2920c05740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8850 0x556d109a79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.860+0000 7f2920c05740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556d1090b330 con 0x556d109cf4e0 2024-03-30T13:14:41.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.860+0000 7f2920c05740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556d108b3620 con 0x556d109a8850 2024-03-30T13:14:41.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.860+0000 7f2920c05740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x556d10907440 con 0x556d109a8470 2024-03-30T13:14:41.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.860+0000 7f290fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109cf4e0 0x556d109a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.860+0000 7f2917400640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f28f406c560 0x7f28f406ea20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2908034000 tx=0x7f2908007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.860+0000 7f290fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109cf4e0 0x556d109a74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33750/0 (socket says 172.21.15.44:33750) 2024-03-30T13:14:41.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.860+0000 7f290fe00640 1 -- 172.21.15.44:0/3232185479 learned_addr learned my addr 172.21.15.44:0/3232185479 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.860+0000 7f2917e00640 1 --2- 172.21.15.44:0/3232185479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8850 0x556d109a79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.860+0000 7f2917400640 1 --2- 172.21.15.44:0/3232185479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8470 0x556d109cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.861+0000 7f290fe00640 1 -- 172.21.15.44:0/3232185479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8470 msgr2=0x556d109cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.861+0000 7f290fe00640 1 --2- 172.21.15.44:0/3232185479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8470 0x556d109cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.861+0000 7f290fe00640 1 -- 172.21.15.44:0/3232185479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8850 msgr2=0x556d109a79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.861+0000 7f290fe00640 1 --2- 172.21.15.44:0/3232185479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8850 0x556d109a79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.861+0000 7f290fe00640 1 -- 172.21.15.44:0/3232185479 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d106eb920 con 0x556d109cf4e0 2024-03-30T13:14:41.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.861+0000 7f2917400640 1 --2- 172.21.15.44:0/3232185479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8470 0x556d109cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:41.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.861+0000 7f290fe00640 1 --2- 172.21.15.44:0/3232185479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109cf4e0 0x556d109a74b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f29000099b0 tx=0x7f2900009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfba4753fe5c1042 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.861+0000 7f2907400640 1 -- 172.21.15.44:0/3232185479 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900019020 con 0x556d109cf4e0 2024-03-30T13:14:41.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.861+0000 7f2907400640 1 -- 172.21.15.44:0/3232185479 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900010c40 con 0x556d109cf4e0 2024-03-30T13:14:41.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.861+0000 7f2907400640 1 -- 172.21.15.44:0/3232185479 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290000f040 con 0x556d109cf4e0 2024-03-30T13:14:41.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.862+0000 7f2920c05740 1 -- 172.21.15.44:0/3232185479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109cf4e0 msgr2=0x556d109a74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.862+0000 7f2920c05740 1 --2- 172.21.15.44:0/3232185479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109cf4e0 0x556d109a74b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f29000099b0 tx=0x7f2900009e70 comp rx=0 tx=0).stop 2024-03-30T13:14:41.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.862+0000 7f2920c05740 1 -- 172.21.15.44:0/3232185479 shutdown_connections 2024-03-30T13:14:41.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.862+0000 7f2920c05740 1 --2- 172.21.15.44:0/3232185479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8850 0x556d109a79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.862+0000 7f2920c05740 1 --2- 172.21.15.44:0/3232185479 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109cf4e0 0x556d109a74b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.862+0000 7f2920c05740 1 --2- 172.21.15.44:0/3232185479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8470 0x556d109cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.862+0000 7f2920c05740 1 -- 172.21.15.44:0/3232185479 >> 172.21.15.44:0/3232185479 conn(0x556d1096ebe0 msgr2=0x556d109ed190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.862+0000 7f2920c05740 1 -- 172.21.15.44:0/3232185479 shutdown_connections 2024-03-30T13:14:41.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.862+0000 7f2920c05740 1 -- 172.21.15.44:0/3232185479 wait complete. 2024-03-30T13:14:41.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.863+0000 7f2920c05740 1 -- start start 2024-03-30T13:14:41.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.864+0000 7f2920c05740 1 Processor -- start 2024-03-30T13:14:41.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.865+0000 7f2920c05740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8470 0x556d109fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.865+0000 7f2920c05740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 0x556d109ec560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.865+0000 7f2920c05740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 0x556d109ecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.865+0000 7f2920c05740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556d109ceb10 con 0x556d109ebcc0 2024-03-30T13:14:41.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.865+0000 7f2920c05740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556d108c69d0 con 0x556d109a8470 2024-03-30T13:14:41.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.865+0000 7f2920c05740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x556d109c7890 con 0x556d109a8850 2024-03-30T13:14:41.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.865+0000 7f2920c05740 10 client.0 _ll_register_callbacks cb 0x556d10902fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:41.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.866+0000 7f2917e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 0x556d109ecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.866+0000 7f2917e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 0x556d109ecaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33766/0 (socket says 172.21.15.44:33766) 2024-03-30T13:14:41.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.866+0000 7f2917e00640 1 -- 172.21.15.44:0/4219087143 learned_addr learned my addr 172.21.15.44:0/4219087143 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.866+0000 7f2917400640 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8470 0x556d109fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.866+0000 7f290fe00640 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 0x556d109ec560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.866+0000 7f2917e00640 1 -- 172.21.15.44:0/4219087143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 msgr2=0x556d109ec560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.866+0000 7f2917e00640 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 0x556d109ec560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.866+0000 7f2917e00640 1 -- 172.21.15.44:0/4219087143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8470 msgr2=0x556d109fd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.866+0000 7f2917e00640 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8470 0x556d109fd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.866+0000 7f2917e00640 1 -- 172.21.15.44:0/4219087143 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d105df210 con 0x556d109ebcc0 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.867+0000 7f2917e00640 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 0x556d109ecaa0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f291008a090 tx=0x7f291005a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a30c3ee867d615 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.867+0000 7f28fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.867+0000 7f28fbe00640 1 -- 172.21.15.44:0/4219087143 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910088060 con 0x556d109ebcc0 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.867+0000 7f28fbe00640 1 -- 172.21.15.44:0/4219087143 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f2910062460 con 0x556d109ebcc0 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.867+0000 7f2920c05740 1 -- 172.21.15.44:0/4219087143 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2900010c40 con 0x556d109ebcc0 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.867+0000 7f28fbe00640 1 -- 172.21.15.44:0/4219087143 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f29100626f0 con 0x556d109ebcc0 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.867+0000 7f2920c05740 10 client.5835 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:41.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.867+0000 7f2920c05740 1 -- 172.21.15.44:0/4219087143 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556d1074c0b0 con 0x556d109ebcc0 2024-03-30T13:14:41.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.867+0000 7f28fbe00640 1 -- 172.21.15.44:0/4219087143 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900010c40 con 0x556d109ebcc0 2024-03-30T13:14:41.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.867+0000 7f28fbe00640 1 -- 172.21.15.44:0/4219087143 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f2910003b50 con 0x556d109ebcc0 2024-03-30T13:14:41.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.868+0000 7f2920c05740 10 client.5835 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:41.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.868+0000 7f2920c05740 10 client.5835 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:41.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.868+0000 7f2920c05740 20 client.5835 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.868+0000 7f2920c05740 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x556d109eaf70 0x556d109eb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.868+0000 7f2920c05740 4 client.5835 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.868+0000 7f2920c05740 1 -- 172.21.15.44:0/4219087143 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d10918870 con 0x556d109eaf70 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.868+0000 7f2917400640 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x556d109eaf70 0x556d109eb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.869+0000 7f2917400640 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x556d109eaf70 0x556d109eb3e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a04073ef4dfa123 server_cookie=74e0752424d50889 in_seq=0 out_seq=0 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.869+0000 7f28fbe00640 10 client.5835 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.869+0000 7f28fbe00640 1 -- 172.21.15.44:0/4219087143 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x556d10918870 con 0x556d109eaf70 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.869+0000 7f28fbe00640 10 client.5835 handle_command_reply: tid=0 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.869+0000 7f2920c05740 1 client.5835 shutdown 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.870+0000 7f2920c05740 1 -- 172.21.15.44:0/4219087143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 msgr2=0x556d109ecaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.870+0000 7f2920c05740 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 0x556d109ecaa0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f291008a090 tx=0x7f291005a210 comp rx=0 tx=0).stop 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.870+0000 7f2920c05740 1 -- 172.21.15.44:0/4219087143 shutdown_connections 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.870+0000 7f2920c05740 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x556d109eaf70 0x556d109eb3e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.870+0000 7f2920c05740 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 0x556d109ecaa0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.870+0000 7f2920c05740 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 0x556d109ec560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.870+0000 7f2920c05740 1 --2- 172.21.15.44:0/4219087143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8470 0x556d109fd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.870+0000 7f2920c05740 1 -- 172.21.15.44:0/4219087143 >> 172.21.15.44:0/4219087143 conn(0x556d1096ebe0 msgr2=0x556d109a1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.870+0000 7f28fbe00640 0 client.5835 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.870+0000 7f2920c05740 1 -- 172.21.15.44:0/4219087143 shutdown_connections 2024-03-30T13:14:41.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.870+0000 7f2920c05740 1 -- 172.21.15.44:0/4219087143 wait complete. 2024-03-30T13:14:41.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.870+0000 7f2920c05740 20 client.5835 trim_cache size 0 max 16384 2024-03-30T13:14:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.894+0000 7f2920c05740 1 Processor -- start 2024-03-30T13:14:41.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.894+0000 7f2920c05740 1 -- start start 2024-03-30T13:14:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2920c05740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109a8470 0x556d109cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2920c05740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 0x556d109ec560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2920c05740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109ebcc0 0x556d109ecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2920c05740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f29182019d0 con 0x556d109a8470 2024-03-30T13:14:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2920c05740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f29182009f0 con 0x556d109ebcc0 2024-03-30T13:14:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2920c05740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f29181ffd50 con 0x556d109a8850 2024-03-30T13:14:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2917400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109a8470 0x556d109cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2917400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109a8470 0x556d109cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33776/0 (socket says 172.21.15.44:33776) 2024-03-30T13:14:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2917400640 1 -- 172.21.15.44:0/22751842 learned_addr learned my addr 172.21.15.44:0/22751842 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2917400640 1 -- 172.21.15.44:0/22751842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 msgr2=0x556d109ec560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2917400640 1 --2- 172.21.15.44:0/22751842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 0x556d109ec560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2917400640 1 -- 172.21.15.44:0/22751842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109ebcc0 msgr2=0x556d109ecaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2917400640 1 --2- 172.21.15.44:0/22751842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109ebcc0 0x556d109ecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.896+0000 7f2917400640 1 -- 172.21.15.44:0/22751842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d105b82d0 con 0x556d109a8470 2024-03-30T13:14:41.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.897+0000 7f2917400640 1 --2- 172.21.15.44:0/22751842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109a8470 0x556d109cde90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f290800c3e0 tx=0x7f290802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bda8d5983835f3f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.897+0000 7f2906a00640 1 -- 172.21.15.44:0/22751842 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908056070 con 0x556d109a8470 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.897+0000 7f2906a00640 1 -- 172.21.15.44:0/22751842 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2908030040 con 0x556d109a8470 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.897+0000 7f2906a00640 1 -- 172.21.15.44:0/22751842 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29080074f0 con 0x556d109a8470 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.898+0000 7f2920c05740 1 -- 172.21.15.44:0/22751842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109a8470 msgr2=0x556d109cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.898+0000 7f2920c05740 1 --2- 172.21.15.44:0/22751842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109a8470 0x556d109cde90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f290800c3e0 tx=0x7f290802e000 comp rx=0 tx=0).stop 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.898+0000 7f2920c05740 1 -- 172.21.15.44:0/22751842 shutdown_connections 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.898+0000 7f2920c05740 1 --2- 172.21.15.44:0/22751842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109ebcc0 0x556d109ecaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.898+0000 7f2920c05740 1 --2- 172.21.15.44:0/22751842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 0x556d109ec560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.898+0000 7f2920c05740 1 --2- 172.21.15.44:0/22751842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109a8470 0x556d109cde90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.898+0000 7f2920c05740 1 -- 172.21.15.44:0/22751842 >> 172.21.15.44:0/22751842 conn(0x556d1096ebe0 msgr2=0x556d1099db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.898+0000 7f2920c05740 1 -- 172.21.15.44:0/22751842 shutdown_connections 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.898+0000 7f2920c05740 1 -- 172.21.15.44:0/22751842 wait complete. 2024-03-30T13:14:41.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.898+0000 7f2920c05740 1 -- start start 2024-03-30T13:14:41.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.899+0000 7f2920c05740 1 Processor -- start 2024-03-30T13:14:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2920c05740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8470 0x556d10a68ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2920c05740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 0x556d10a06930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2920c05740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 0x556d10a06e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2920c05740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556d109ed130 con 0x556d109ebcc0 2024-03-30T13:14:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2920c05740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f29182003a0 con 0x556d109a8470 2024-03-30T13:14:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2920c05740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x556d1099e6a0 con 0x556d109a8850 2024-03-30T13:14:41.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2920c05740 10 client.0 _ll_register_callbacks cb 0x7f2910055db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2917e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 0x556d10a06e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2917e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 0x556d10a06e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33788/0 (socket says 172.21.15.44:33788) 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2917e00640 1 -- 172.21.15.44:0/2887381916 learned_addr learned my addr 172.21.15.44:0/2887381916 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2917400640 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8470 0x556d10a68ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f290fe00640 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 0x556d10a06930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2917e00640 1 -- 172.21.15.44:0/2887381916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 msgr2=0x556d10a06930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2917e00640 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 0x556d10a06930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2917e00640 1 -- 172.21.15.44:0/2887381916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8470 msgr2=0x556d10a68ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.900+0000 7f2917e00640 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8470 0x556d10a68ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.901+0000 7f2917e00640 1 -- 172.21.15.44:0/2887381916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d10a693e0 con 0x556d109ebcc0 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.901+0000 7f2917e00640 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 0x556d10a06e70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2910007090 tx=0x7f2910000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc06375cc82e4c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.901+0000 7f28fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.901+0000 7f28fbe00640 1 -- 172.21.15.44:0/2887381916 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910088040 con 0x556d109ebcc0 2024-03-30T13:14:41.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.901+0000 7f28fbe00640 1 -- 172.21.15.44:0/2887381916 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f29100600c0 con 0x556d109ebcc0 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.901+0000 7f2920c05740 1 -- 172.21.15.44:0/2887381916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2908030040 con 0x556d109ebcc0 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.901+0000 7f28fbe00640 1 -- 172.21.15.44:0/2887381916 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2910059650 con 0x556d109ebcc0 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.901+0000 7f2920c05740 10 client.5841 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.901+0000 7f2920c05740 1 -- 172.21.15.44:0/2887381916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556d109ecc50 con 0x556d109ebcc0 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.902+0000 7f28fbe00640 1 -- 172.21.15.44:0/2887381916 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2908030040 con 0x556d109ebcc0 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.902+0000 7f28fbe00640 1 -- 172.21.15.44:0/2887381916 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f2910055860 con 0x556d109ebcc0 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.902+0000 7f2920c05740 10 client.5841 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.902+0000 7f2920c05740 10 client.5841 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.902+0000 7f2920c05740 20 client.5841 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.902+0000 7f2920c05740 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x556d109fdef0 0x556d109cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.902+0000 7f2920c05740 4 client.5841 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628323}] 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.902+0000 7f2920c05740 1 -- 172.21.15.44:0/2887381916 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628323}) -- 0x556d10912bc0 con 0x556d109fdef0 2024-03-30T13:14:41.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.902+0000 7f2917400640 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x556d109fdef0 0x556d109cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:41.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f2917400640 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x556d109fdef0 0x556d109cde90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=217e511b5204e875 server_cookie=27ceba3a4b0e2ee5 in_seq=0 out_seq=0 2024-03-30T13:14:41.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f28fbe00640 10 client.5841 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f28fbe00640 1 -- 172.21.15.44:0/2887381916 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3966 (crc 0 0 0) 0x556d10912bc0 con 0x556d109fdef0 2024-03-30T13:14:41.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f28fbe00640 10 client.5841 handle_command_reply: tid=0 2024-03-30T13:14:41.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f2920c05740 1 client.5841 shutdown 2024-03-30T13:14:41.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f2920c05740 1 -- 172.21.15.44:0/2887381916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 msgr2=0x556d10a06e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f2920c05740 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 0x556d10a06e70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2910007090 tx=0x7f2910000f40 comp rx=0 tx=0).stop 2024-03-30T13:14:41.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f2920c05740 1 -- 172.21.15.44:0/2887381916 shutdown_connections 2024-03-30T13:14:41.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f2920c05740 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x556d109fdef0 0x556d109cde90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f2920c05740 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556d109ebcc0 0x556d10a06e70 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f2920c05740 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556d109a8850 0x556d10a06930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f2920c05740 1 --2- 172.21.15.44:0/2887381916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d109a8470 0x556d10a68ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f28fbe00640 0 client.5841 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:41.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.903+0000 7f2920c05740 1 -- 172.21.15.44:0/2887381916 >> 172.21.15.44:0/2887381916 conn(0x556d1096ebe0 msgr2=0x556d109ec540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.904+0000 7f2920c05740 1 -- 172.21.15.44:0/2887381916 shutdown_connections 2024-03-30T13:14:41.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.904+0000 7f2920c05740 1 -- 172.21.15.44:0/2887381916 wait complete. 2024-03-30T13:14:41.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.904+0000 7f2920c05740 20 client.5841 trim_cache size 0 max 16384 2024-03-30T13:14:41.912 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:41.912 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/xattr.h", 2024-03-30T13:14:41.912 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628323, 2024-03-30T13:14:41.912 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:41.912 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.282016+0000", 2024-03-30T13:14:41.912 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.237258+0000", 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:41.913 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 3340, 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.237258+0000", 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:41.914 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:41.915 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 3340, 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.282016+0000" 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 3340, 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.282016+0000" 2024-03-30T13:14:41.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 136, 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 32, 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:06.333618+0000", 2024-03-30T13:14:41.917 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 80, 2024-03-30T13:14:41.918 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:41.918 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:41.918 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:41.918 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:41.918 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:41.918 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:41.918 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.918 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:41.918 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:41.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.918 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:41.918 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:41.919 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:41.920 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:41.921 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:41.922 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:41.923 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:41.924 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:41.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.904+0000 7f291ca00640 1 -- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f28f406c560 msgr2=0x7f28f406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.904+0000 7f291ca00640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f28f406c560 0x7f28f406ea20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2908034000 tx=0x7f2908007000 comp rx=0 tx=0).stop 2024-03-30T13:14:41.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.905+0000 7f291ca00640 1 -- 172.21.15.44:0/106259044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29180b89c0 msgr2=0x7f29180c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:41.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.905+0000 7f291ca00640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29180b89c0 0x7f29180c9020 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f29180d0f70 tx=0x7f29100115a0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.905+0000 7f291ca00640 1 -- 172.21.15.44:0/106259044 shutdown_connections 2024-03-30T13:14:41.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.905+0000 7f291ca00640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29180b89c0 0x7f29180c9020 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.905+0000 7f291ca00640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f28f406c560 0x7f28f406ea20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.905+0000 7f291ca00640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29180b8580 0x7f29180c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.905+0000 7f291ca00640 1 --2- 172.21.15.44:0/106259044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28fc0039b0 0x7f291815dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:41.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.905+0000 7f291ca00640 1 -- 172.21.15.44:0/106259044 >> 172.21.15.44:0/106259044 conn(0x7f291809d4e0 msgr2=0x7f29180b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:41.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.905+0000 7f291ca00640 1 -- 172.21.15.44:0/106259044 shutdown_connections 2024-03-30T13:14:41.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:41.905+0000 7f291ca00640 1 -- 172.21.15.44:0/106259044 wait complete. 2024-03-30T13:14:41.930 DEBUG:tasks.cephfs.test_uninlining:getting inode info #14 of 23:1099511628328 2024-03-30T13:14:41.930 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628328 2024-03-30T13:14:41.930 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628328 2024-03-30T13:14:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.166+0000 7fc8dbe00640 1 Processor -- start 2024-03-30T13:14:42.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.166+0000 7fc8dbe00640 1 -- start start 2024-03-30T13:14:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.168+0000 7fc8dbe00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc8dc071240 0x7fc8dc0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.168+0000 7fc8dbe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8dc0b3970 0x7fc8dc0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.168+0000 7fc8dbe00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8dc0b4ef0 con 0x7fc8dc15e540 2024-03-30T13:14:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.168+0000 7fc8dbe00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fc8dc0b4a30 con 0x7fc8dc071240 2024-03-30T13:14:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.168+0000 7fc8dbe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc8dc0aef20 con 0x7fc8dc0b3970 2024-03-30T13:14:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.168+0000 7fc8da000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc8dc15e540 0x7fc8dc071620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36844/0 (socket says 172.21.15.44:36844) 2024-03-30T13:14:42.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.168+0000 7fc8da000640 1 -- 172.21.15.44:0/2528178887 learned_addr learned my addr 172.21.15.44:0/2528178887 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.169+0000 7fc8daa00640 1 --2- 172.21.15.44:0/2528178887 >> v2:172.21.15.151:3300/0 conn(0x7fc8dc071240 0x7fc8dc0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.169+0000 7fc8db400640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8dc0b3970 0x7fc8dc0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.169+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190942689 0 0) 0x7fc8dc0b4ef0 con 0x7fc8dc15e540 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.169+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8c0003520 con 0x7fc8dc15e540 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.169+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1036133841 0 0) 0x7fc8c0003520 con 0x7fc8dc15e540 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.169+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8dc0b3970 msgr2=0x7fc8dc0b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.169+0000 7fc8d9600640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8dc0b3970 0x7fc8dc0b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.169+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 >> v2:172.21.15.151:3300/0 conn(0x7fc8dc071240 msgr2=0x7fc8dc0acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.169+0000 7fc8d9600640 1 --2- 172.21.15.44:0/2528178887 >> v2:172.21.15.151:3300/0 conn(0x7fc8dc071240 0x7fc8dc0acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.169+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc0b3f10 con 0x7fc8dc15e540 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.169+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fc8c8001670 con 0x7fc8dc15e540 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.169+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 >> v1:172.21.15.44:6789/0 conn(0x7fc8dc15e540 legacy=0x7fc8dc071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8d9600640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8c00039e0 0x7fc8c0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8d9600640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8c0004800 0x7fc8c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8d9600640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8dc0b3970 0x7fc8c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc0b4a30 con 0x7fc8c00039e0 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc0aef20 con 0x7fc8c0004800 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c000b9c0 con 0x7fc8dc0b3970 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8daa00640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8c00039e0 0x7fc8c0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8da000640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8c0004800 0x7fc8c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8db400640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8dc0b3970 0x7fc8c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8daa00640 1 -- 172.21.15.44:0/2528178887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8dc0b3970 msgr2=0x7fc8c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8daa00640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8dc0b3970 0x7fc8c00051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8daa00640 1 -- 172.21.15.44:0/2528178887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8c0004800 msgr2=0x7fc8c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8daa00640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8c0004800 0x7fc8c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8daa00640 1 -- 172.21.15.44:0/2528178887 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c0003520 con 0x7fc8c00039e0 2024-03-30T13:14:42.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.170+0000 7fc8da000640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8c0004800 0x7fc8c0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.171+0000 7fc8daa00640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8c00039e0 0x7fc8c0003e00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc009ac0 tx=0x7fc8c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12218f49ea069da4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.172+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc039070 con 0x7fc8c00039e0 2024-03-30T13:14:42.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.172+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8cc02c710 con 0x7fc8c00039e0 2024-03-30T13:14:42.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.172+0000 7fc8d9600640 1 -- 172.21.15.44:0/2528178887 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc009690 con 0x7fc8c00039e0 2024-03-30T13:14:42.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.172+0000 7fc8dbe00640 1 -- 172.21.15.44:0/2528178887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8c00039e0 msgr2=0x7fc8c0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.172+0000 7fc8dbe00640 1 --2- 172.21.15.44:0/2528178887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8c00039e0 0x7fc8c0003e00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc009ac0 tx=0x7fc8c0005830 comp rx=0 tx=0).stop 2024-03-30T13:14:42.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.172+0000 7fc8db400640 1 -- 172.21.15.44:0/2528178887 reap_dead start 2024-03-30T13:14:42.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.172+0000 7fc8dbe00640 1 -- 172.21.15.44:0/2528178887 shutdown_connections 2024-03-30T13:14:42.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.172+0000 7fc8dbe00640 1 -- 172.21.15.44:0/2528178887 >> 172.21.15.44:0/2528178887 conn(0x7fc8dc0cfd90 msgr2=0x7fc8dc0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.173+0000 7fc8dbe00640 1 -- 172.21.15.44:0/2528178887 shutdown_connections 2024-03-30T13:14:42.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.173+0000 7fc8dbe00640 1 -- 172.21.15.44:0/2528178887 wait complete. 2024-03-30T13:14:42.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.174+0000 7fc8dbe00640 1 Processor -- start 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.174+0000 7fc8dbe00640 1 -- start start 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.175+0000 7fc8dbe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8c00039e0 0x7fc8dc1f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.175+0000 7fc8dbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc152b60 0x7fc8dc154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.175+0000 7fc8dbe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8dc156470 0x7fc8dc15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.175+0000 7fc8dbe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc06d980 con 0x7fc8dc152b60 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.175+0000 7fc8dbe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc06d0e0 con 0x7fc8dc156470 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.175+0000 7fc8dbe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc8dc06d610 con 0x7fc8c00039e0 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.176+0000 7fc8da000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc152b60 0x7fc8dc154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.176+0000 7fc8da000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc152b60 0x7fc8dc154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33800/0 (socket says 172.21.15.44:33800) 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.176+0000 7fc8da000640 1 -- 172.21.15.44:0/309743753 learned_addr learned my addr 172.21.15.44:0/309743753 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.176+0000 7fc8daa00640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8c00039e0 0x7fc8dc1f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.176+0000 7fc8db400640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8dc156470 0x7fc8dc15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.176+0000 7fc8da000640 1 -- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8c00039e0 msgr2=0x7fc8dc1f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.176+0000 7fc8da000640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8c00039e0 0x7fc8dc1f3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.176+0000 7fc8da000640 1 -- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8dc156470 msgr2=0x7fc8dc15ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.176+0000 7fc8da000640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8dc156470 0x7fc8dc15ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.176+0000 7fc8da000640 1 -- 172.21.15.44:0/309743753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8dc1617e0 con 0x7fc8dc152b60 2024-03-30T13:14:42.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.176+0000 7fc8da000640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc152b60 0x7fc8dc154b80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800d830 tx=0x7fc8c800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.177+0000 7fc8d2a00640 1 -- 172.21.15.44:0/309743753 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8019070 con 0x7fc8dc152b60 2024-03-30T13:14:42.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.177+0000 7fc8d2a00640 1 -- 172.21.15.44:0/309743753 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c80074e0 con 0x7fc8dc152b60 2024-03-30T13:14:42.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.177+0000 7fc8d2a00640 1 -- 172.21.15.44:0/309743753 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8004a20 con 0x7fc8dc152b60 2024-03-30T13:14:42.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.177+0000 7fc8dbe00640 1 -- 172.21.15.44:0/309743753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8dc1553d0 con 0x7fc8dc152b60 2024-03-30T13:14:42.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.177+0000 7fc8dbe00640 1 -- 172.21.15.44:0/309743753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8dc155990 con 0x7fc8dc152b60 2024-03-30T13:14:42.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.179+0000 7fc8d2a00640 1 -- 172.21.15.44:0/309743753 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc8c801c070 con 0x7fc8dc152b60 2024-03-30T13:14:42.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.180+0000 7fc8d2a00640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc8bc06c530 0x7fc8bc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.180+0000 7fc8d2a00640 1 -- 172.21.15.44:0/309743753 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc8c808b340 con 0x7fc8dc152b60 2024-03-30T13:14:42.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.181+0000 7fc8e420a740 1 Processor -- start 2024-03-30T13:14:42.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.181+0000 7fc8daa00640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc8bc06c530 0x7fc8bc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.181+0000 7fc8e420a740 1 -- start start 2024-03-30T13:14:42.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8e420a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c470 0x55b5a3492fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8e420a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34934e0 0x55b5a346b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8e420a740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a346b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8e420a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b5a33cf330 con 0x55b5a34934e0 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8e420a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b5a3377620 con 0x55b5a346c470 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8e420a740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55b5a33cb440 con 0x55b5a346c850 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8da000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34934e0 0x55b5a346b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8da000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34934e0 0x55b5a346b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33814/0 (socket says 172.21.15.44:33814) 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8da000640 1 -- 172.21.15.44:0/3383614802 learned_addr learned my addr 172.21.15.44:0/3383614802 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8daa00640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc8bc06c530 0x7fc8bc06e9f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc036000 tx=0x7fc8cc030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8daa00640 1 --2- 172.21.15.44:0/3383614802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c470 0x55b5a3492fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8db400640 1 --2- 172.21.15.44:0/3383614802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a346b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8da000640 1 -- 172.21.15.44:0/3383614802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 msgr2=0x55b5a346b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8da000640 1 --2- 172.21.15.44:0/3383614802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a346b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8da000640 1 -- 172.21.15.44:0/3383614802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c470 msgr2=0x55b5a3492fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8da000640 1 --2- 172.21.15.44:0/3383614802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c470 0x55b5a3492fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.182+0000 7fc8da000640 1 -- 172.21.15.44:0/3383614802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5a31af920 con 0x55b5a34934e0 2024-03-30T13:14:42.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.183+0000 7fc8da000640 1 --2- 172.21.15.44:0/3383614802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34934e0 0x55b5a346b4b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8055470 tx=0x7fc8c8059710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab904f147062118 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.183+0000 7fc8c7000640 1 -- 172.21.15.44:0/3383614802 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8061bf0 con 0x55b5a34934e0 2024-03-30T13:14:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.183+0000 7fc8c7000640 1 -- 172.21.15.44:0/3383614802 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c80570b0 con 0x55b5a34934e0 2024-03-30T13:14:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.183+0000 7fc8c7000640 1 -- 172.21.15.44:0/3383614802 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8055680 con 0x55b5a34934e0 2024-03-30T13:14:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.184+0000 7fc8e420a740 1 -- 172.21.15.44:0/3383614802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34934e0 msgr2=0x55b5a346b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.184+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3383614802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34934e0 0x55b5a346b4b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8055470 tx=0x7fc8c8059710 comp rx=0 tx=0).stop 2024-03-30T13:14:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.184+0000 7fc8e420a740 1 -- 172.21.15.44:0/3383614802 shutdown_connections 2024-03-30T13:14:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.184+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3383614802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a346b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.184+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3383614802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34934e0 0x55b5a346b4b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.184+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3383614802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c470 0x55b5a3492fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.184+0000 7fc8e420a740 1 -- 172.21.15.44:0/3383614802 >> 172.21.15.44:0/3383614802 conn(0x55b5a3432be0 msgr2=0x55b5a34b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.184+0000 7fc8e420a740 1 -- 172.21.15.44:0/3383614802 shutdown_connections 2024-03-30T13:14:42.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.184+0000 7fc8e420a740 1 -- 172.21.15.44:0/3383614802 wait complete. 2024-03-30T13:14:42.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.185+0000 7fc8e420a740 1 -- start start 2024-03-30T13:14:42.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.185+0000 7fc8e420a740 1 Processor -- start 2024-03-30T13:14:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.186+0000 7fc8e420a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c470 0x55b5a3489a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.186+0000 7fc8e420a740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a3496180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.186+0000 7fc8e420a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34ae190 0x55b5a34966c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.186+0000 7fc8e420a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b5a3492b10 con 0x55b5a34ae190 2024-03-30T13:14:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.186+0000 7fc8e420a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b5a338a9d0 con 0x55b5a346c470 2024-03-30T13:14:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.186+0000 7fc8e420a740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55b5a348b890 con 0x55b5a346c850 2024-03-30T13:14:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.186+0000 7fc8e420a740 10 client.0 _ll_register_callbacks cb 0x55b5a33c6fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.186+0000 7fc8db400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34ae190 0x55b5a34966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.186+0000 7fc8db400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34ae190 0x55b5a34966c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33820/0 (socket says 172.21.15.44:33820) 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.186+0000 7fc8db400640 1 -- 172.21.15.44:0/3300586567 learned_addr learned my addr 172.21.15.44:0/3300586567 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8da000640 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a3496180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8daa00640 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c470 0x55b5a3489a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8db400640 1 -- 172.21.15.44:0/3300586567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 msgr2=0x55b5a3496180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8db400640 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a3496180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8db400640 1 -- 172.21.15.44:0/3300586567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c470 msgr2=0x55b5a3489a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8db400640 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c470 0x55b5a3489a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8db400640 1 -- 172.21.15.44:0/3300586567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5a30a3210 con 0x55b5a34ae190 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8da000640 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a3496180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8daa00640 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c470 0x55b5a3489a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8db400640 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34ae190 0x55b5a34966c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc09e0b0 tx=0x7fc8d4004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3406fab11c4dc2d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8bb400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:42.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8bb400640 1 -- 172.21.15.44:0/3300586567 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4004830 con 0x55b5a34ae190 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8bb400640 1 -- 172.21.15.44:0/3300586567 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc8d40079f0 con 0x55b5a34ae190 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.187+0000 7fc8e420a740 1 -- 172.21.15.44:0/3300586567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8c80570b0 con 0x55b5a34ae190 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.188+0000 7fc8bb400640 1 -- 172.21.15.44:0/3300586567 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc8d4024050 con 0x55b5a34ae190 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.188+0000 7fc8e420a740 10 client.5853 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.188+0000 7fc8e420a740 1 -- 172.21.15.44:0/3300586567 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55b5a32100b0 con 0x55b5a34ae190 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.188+0000 7fc8bb400640 1 -- 172.21.15.44:0/3300586567 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c80570b0 con 0x55b5a34ae190 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.188+0000 7fc8bb400640 1 -- 172.21.15.44:0/3300586567 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fc8d4027020 con 0x55b5a34ae190 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.188+0000 7fc8e420a740 10 client.5853 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.188+0000 7fc8e420a740 10 client.5853 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.188+0000 7fc8e420a740 20 client.5853 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.188+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b5a34cbe00 0x55b5a34ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.188+0000 7fc8e420a740 4 client.5853 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.188+0000 7fc8e420a740 1 -- 172.21.15.44:0/3300586567 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5a33dc870 con 0x55b5a34cbe00 2024-03-30T13:14:42.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.189+0000 7fc8daa00640 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b5a34cbe00 0x55b5a34ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.190+0000 7fc8daa00640 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b5a34cbe00 0x55b5a34ce1f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96ad34102fb7e45f server_cookie=c19caaf8a2c9ec6b in_seq=0 out_seq=0 2024-03-30T13:14:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.190+0000 7fc8bb400640 10 client.5853 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.190+0000 7fc8bb400640 1 -- 172.21.15.44:0/3300586567 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b5a33dc870 con 0x55b5a34cbe00 2024-03-30T13:14:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.190+0000 7fc8bb400640 10 client.5853 handle_command_reply: tid=0 2024-03-30T13:14:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.190+0000 7fc8e420a740 1 client.5853 shutdown 2024-03-30T13:14:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.191+0000 7fc8e420a740 1 -- 172.21.15.44:0/3300586567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34ae190 msgr2=0x55b5a34966c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.191+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34ae190 0x55b5a34966c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc09e0b0 tx=0x7fc8d4004700 comp rx=0 tx=0).stop 2024-03-30T13:14:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.191+0000 7fc8e420a740 1 -- 172.21.15.44:0/3300586567 shutdown_connections 2024-03-30T13:14:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.191+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b5a34cbe00 0x55b5a34ce1f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.191+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a34ae190 0x55b5a34966c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.191+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a3496180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.191+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3300586567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c470 0x55b5a3489a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.191+0000 7fc8e420a740 1 -- 172.21.15.44:0/3300586567 >> 172.21.15.44:0/3300586567 conn(0x55b5a3432be0 msgr2=0x55b5a3465b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.191+0000 7fc8bb400640 0 client.5853 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:42.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.191+0000 7fc8e420a740 1 -- 172.21.15.44:0/3300586567 shutdown_connections 2024-03-30T13:14:42.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.191+0000 7fc8e420a740 1 -- 172.21.15.44:0/3300586567 wait complete. 2024-03-30T13:14:42.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.191+0000 7fc8e420a740 20 client.5853 trim_cache size 0 max 16384 2024-03-30T13:14:42.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.207+0000 7fc8e420a740 1 Processor -- start 2024-03-30T13:14:42.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.207+0000 7fc8e420a740 1 -- start start 2024-03-30T13:14:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.208+0000 7fc8e420a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 0x55b5a3461d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.208+0000 7fc8e420a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c850 0x55b5a34a82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.208+0000 7fc8e420a740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a34ae190 0x55b5a3523640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.208+0000 7fc8e420a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc201640 con 0x55b5a346c470 2024-03-30T13:14:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.208+0000 7fc8e420a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc200640 con 0x55b5a346c850 2024-03-30T13:14:42.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.208+0000 7fc8e420a740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc8dc160580 con 0x55b5a34ae190 2024-03-30T13:14:42.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.208+0000 7fc8daa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 0x55b5a3461d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.208+0000 7fc8daa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 0x55b5a3461d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33824/0 (socket says 172.21.15.44:33824) 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.208+0000 7fc8daa00640 1 -- 172.21.15.44:0/19835497 learned_addr learned my addr 172.21.15.44:0/19835497 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.209+0000 7fc8daa00640 1 -- 172.21.15.44:0/19835497 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a34ae190 msgr2=0x55b5a3523640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.209+0000 7fc8db400640 1 --2- 172.21.15.44:0/19835497 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a34ae190 0x55b5a3523640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.209+0000 7fc8da000640 1 --2- 172.21.15.44:0/19835497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c850 0x55b5a34a82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.209+0000 7fc8daa00640 1 --2- 172.21.15.44:0/19835497 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a34ae190 0x55b5a3523640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.209+0000 7fc8daa00640 1 -- 172.21.15.44:0/19835497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c850 msgr2=0x55b5a34a82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.209+0000 7fc8daa00640 1 --2- 172.21.15.44:0/19835497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c850 0x55b5a34a82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.209+0000 7fc8daa00640 1 -- 172.21.15.44:0/19835497 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5a307c2d0 con 0x55b5a346c470 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.209+0000 7fc8da000640 1 --2- 172.21.15.44:0/19835497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c850 0x55b5a34a82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.209+0000 7fc8daa00640 1 --2- 172.21.15.44:0/19835497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 0x55b5a3461d20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc009be0 tx=0x7fc8cc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faa884bcb0ba249 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.210+0000 7fc8c6600640 1 -- 172.21.15.44:0/19835497 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc056070 con 0x55b5a346c470 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.210+0000 7fc8c6600640 1 -- 172.21.15.44:0/19835497 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8cc03a040 con 0x55b5a346c470 2024-03-30T13:14:42.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.210+0000 7fc8c6600640 1 -- 172.21.15.44:0/19835497 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc039050 con 0x55b5a346c470 2024-03-30T13:14:42.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.210+0000 7fc8e420a740 1 -- 172.21.15.44:0/19835497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 msgr2=0x55b5a3461d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.210+0000 7fc8e420a740 1 --2- 172.21.15.44:0/19835497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 0x55b5a3461d20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc009be0 tx=0x7fc8cc02e000 comp rx=0 tx=0).stop 2024-03-30T13:14:42.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.210+0000 7fc8e420a740 1 -- 172.21.15.44:0/19835497 shutdown_connections 2024-03-30T13:14:42.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.210+0000 7fc8e420a740 1 --2- 172.21.15.44:0/19835497 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a34ae190 0x55b5a3523640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.210+0000 7fc8e420a740 1 --2- 172.21.15.44:0/19835497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a346c850 0x55b5a34a82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.210+0000 7fc8e420a740 1 --2- 172.21.15.44:0/19835497 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 0x55b5a3461d20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.210+0000 7fc8e420a740 1 -- 172.21.15.44:0/19835497 >> 172.21.15.44:0/19835497 conn(0x55b5a3432be0 msgr2=0x55b5a34c8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.210+0000 7fc8e420a740 1 -- 172.21.15.44:0/19835497 shutdown_connections 2024-03-30T13:14:42.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.210+0000 7fc8e420a740 1 -- 172.21.15.44:0/19835497 wait complete. 2024-03-30T13:14:42.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.211+0000 7fc8e420a740 1 -- start start 2024-03-30T13:14:42.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.211+0000 7fc8e420a740 1 Processor -- start 2024-03-30T13:14:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.212+0000 7fc8e420a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 0x55b5a34658f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.212+0000 7fc8e420a740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a34b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.212+0000 7fc8e420a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a34ae190 0x55b5a34b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.212+0000 7fc8e420a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8dc200080 con 0x55b5a346c470 2024-03-30T13:14:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.212+0000 7fc8e420a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b5a3469f00 con 0x55b5a34ae190 2024-03-30T13:14:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.212+0000 7fc8e420a740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55b5a3488620 con 0x55b5a346c850 2024-03-30T13:14:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.212+0000 7fc8e420a740 10 client.0 _ll_register_callbacks cb 0x7fc8d4009bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:42.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.212+0000 7fc8daa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 0x55b5a34658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.213+0000 7fc8daa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 0x55b5a34658f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33830/0 (socket says 172.21.15.44:33830) 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.213+0000 7fc8daa00640 1 -- 172.21.15.44:0/3415299962 learned_addr learned my addr 172.21.15.44:0/3415299962 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.213+0000 7fc8db400640 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a34ae190 0x55b5a34b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.213+0000 7fc8da000640 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a34b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.213+0000 7fc8daa00640 1 -- 172.21.15.44:0/3415299962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 msgr2=0x55b5a34b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.213+0000 7fc8daa00640 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a34b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.213+0000 7fc8daa00640 1 -- 172.21.15.44:0/3415299962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a34ae190 msgr2=0x55b5a34b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.213+0000 7fc8daa00640 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a34ae190 0x55b5a34b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.213+0000 7fc8daa00640 1 -- 172.21.15.44:0/3415299962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5a34b4f60 con 0x55b5a346c470 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.213+0000 7fc8db400640 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a34ae190 0x55b5a34b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.213+0000 7fc8daa00640 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 0x55b5a34658f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc02c380 tx=0x7fc8cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d91c45e23b6933 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.213+0000 7fc8bb400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.214+0000 7fc8bb400640 1 -- 172.21.15.44:0/3415299962 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc056070 con 0x55b5a346c470 2024-03-30T13:14:42.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.214+0000 7fc8bb400640 1 -- 172.21.15.44:0/3415299962 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc8cc005b90 con 0x55b5a346c470 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.214+0000 7fc8e420a740 1 -- 172.21.15.44:0/3415299962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8cc03a040 con 0x55b5a346c470 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.214+0000 7fc8bb400640 1 -- 172.21.15.44:0/3415299962 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc8cc039040 con 0x55b5a346c470 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.214+0000 7fc8e420a740 10 client.5859 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.214+0000 7fc8e420a740 1 -- 172.21.15.44:0/3415299962 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55b5a3488360 con 0x55b5a346c470 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.214+0000 7fc8bb400640 1 -- 172.21.15.44:0/3415299962 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8cc03a040 con 0x55b5a346c470 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.214+0000 7fc8bb400640 1 -- 172.21.15.44:0/3415299962 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fc8cc064020 con 0x55b5a346c470 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.214+0000 7fc8e420a740 10 client.5859 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.214+0000 7fc8e420a740 10 client.5859 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.214+0000 7fc8e420a740 20 client.5859 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.214+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b5a3526cd0 0x55b5a3498ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.215+0000 7fc8e420a740 4 client.5859 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628328}] 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.215+0000 7fc8e420a740 1 -- 172.21.15.44:0/3415299962 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628328}) -- 0x55b5a33d6bc0 con 0x55b5a3526cd0 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.215+0000 7fc8da000640 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b5a3526cd0 0x55b5a3498ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.215+0000 7fc8da000640 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b5a3526cd0 0x55b5a3498ea0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b32268066353cf8 server_cookie=be31168a18bc33d1 in_seq=0 out_seq=0 2024-03-30T13:14:42.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.215+0000 7fc8bb400640 10 client.5859 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8bb400640 1 -- 172.21.15.44:0/3415299962 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3966 (crc 0 0 0) 0x55b5a33d6bc0 con 0x55b5a3526cd0 2024-03-30T13:14:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8bb400640 10 client.5859 handle_command_reply: tid=0 2024-03-30T13:14:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8e420a740 1 client.5859 shutdown 2024-03-30T13:14:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8e420a740 1 -- 172.21.15.44:0/3415299962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 msgr2=0x55b5a34658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 0x55b5a34658f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc02c380 tx=0x7fc8cc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8e420a740 1 -- 172.21.15.44:0/3415299962 shutdown_connections 2024-03-30T13:14:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b5a3526cd0 0x55b5a3498ea0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5a34ae190 0x55b5a34b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b5a346c850 0x55b5a34b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8e420a740 1 --2- 172.21.15.44:0/3415299962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b5a346c470 0x55b5a34658f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8e420a740 1 -- 172.21.15.44:0/3415299962 >> 172.21.15.44:0/3415299962 conn(0x55b5a3432be0 msgr2=0x55b5a3491f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8bb400640 0 client.5859 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8e420a740 1 -- 172.21.15.44:0/3415299962 shutdown_connections 2024-03-30T13:14:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8e420a740 1 -- 172.21.15.44:0/3415299962 wait complete. 2024-03-30T13:14:42.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.216+0000 7fc8e420a740 20 client.5859 trim_cache size 0 max 16384 2024-03-30T13:14:42.225 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:42.225 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/Kconfig", 2024-03-30T13:14:42.225 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628328, 2024-03-30T13:14:42.225 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:42.225 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.293106+0000", 2024-03-30T13:14:42.225 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.394256+0000", 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:42.226 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 228, 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.394256+0000", 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:42.227 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:42.228 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 228, 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.293106+0000" 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 228, 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.293106+0000" 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.229 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 176, 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 2, 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:06.340014+0000", 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 58, 2024-03-30T13:14:42.230 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:42.231 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:42.232 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:42.233 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:42.234 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:42.234 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:42.234 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:42.234 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:42.234 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.234 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:42.234 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:42.234 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:42.234 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:42.234 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:42.234 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:42.234 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:42.235 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:42.236 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:42.237 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:42.238 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:42.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.217+0000 7fc8dbe00640 1 -- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc8bc06c530 msgr2=0x7fc8bc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.217+0000 7fc8dbe00640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc8bc06c530 0x7fc8bc06e9f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc036000 tx=0x7fc8cc030000 comp rx=0 tx=0).stop 2024-03-30T13:14:42.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.217+0000 7fc8dbe00640 1 -- 172.21.15.44:0/309743753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc152b60 msgr2=0x7fc8dc154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.217+0000 7fc8dbe00640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc152b60 0x7fc8dc154b80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800d830 tx=0x7fc8c800dcf0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.217+0000 7fc8dbe00640 1 -- 172.21.15.44:0/309743753 shutdown_connections 2024-03-30T13:14:42.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.217+0000 7fc8dbe00640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc8bc06c530 0x7fc8bc06e9f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.217+0000 7fc8dbe00640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8dc156470 0x7fc8dc15ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.217+0000 7fc8dbe00640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8dc152b60 0x7fc8dc154b80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.217+0000 7fc8dbe00640 1 --2- 172.21.15.44:0/309743753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8c00039e0 0x7fc8dc1f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.217+0000 7fc8dbe00640 1 -- 172.21.15.44:0/309743753 >> 172.21.15.44:0/309743753 conn(0x7fc8dc0cfd90 msgr2=0x7fc8dc0af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.217+0000 7fc8dbe00640 1 -- 172.21.15.44:0/309743753 shutdown_connections 2024-03-30T13:14:42.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.217+0000 7fc8dbe00640 1 -- 172.21.15.44:0/309743753 wait complete. 2024-03-30T13:14:42.247 DEBUG:tasks.cephfs.test_uninlining:getting inode info #15 of 23:1099511628341 2024-03-30T13:14:42.247 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628341 2024-03-30T13:14:42.247 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628341 2024-03-30T13:14:42.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.452+0000 7fe9c3400640 1 Processor -- start 2024-03-30T13:14:42.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.452+0000 7fe9c3400640 1 -- start start 2024-03-30T13:14:42.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.454+0000 7fe9c3400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc13f0c0 0x7fe9bc06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.454+0000 7fe9c3400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9bc0ce9c0 con 0x7fe9bc06d720 2024-03-30T13:14:42.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.454+0000 7fe9c3400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9bc160b50 con 0x7fe9bc1605a0 2024-03-30T13:14:42.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.454+0000 7fe9c3400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe9bc160e30 con 0x7fe9bc13f0c0 2024-03-30T13:14:42.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.455+0000 7fe9bbe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe9bc06d720 0x7fe9bc15fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36854/0 (socket says 172.21.15.44:36854) 2024-03-30T13:14:42.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.455+0000 7fe9bbe00640 1 -- 172.21.15.44:0/3736662509 learned_addr learned my addr 172.21.15.44:0/3736662509 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:42.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.455+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/3736662509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc13f0c0 0x7fe9bc06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.455+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 209365395 0 0) 0x7fe9a8001110 con 0x7fe9bc06d720 2024-03-30T13:14:42.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.455+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9a4003520 con 0x7fe9bc06d720 2024-03-30T13:14:42.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 415821904 0 0) 0x7fe9a4003520 con 0x7fe9bc06d720 2024-03-30T13:14:42.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc13f0c0 msgr2=0x7fe9bc06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 --2- 172.21.15.44:0/3736662509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc13f0c0 0x7fe9bc06d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 >> v1:172.21.15.151:6789/0 conn(0x7fe9bc1605a0 legacy=0x7fe9bc0cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc13fa40 con 0x7fe9bc06d720 2024-03-30T13:14:42.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fe9a8001840 con 0x7fe9bc06d720 2024-03-30T13:14:42.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 >> v1:172.21.15.44:6789/0 conn(0x7fe9bc06d720 legacy=0x7fe9bc15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 --2- 172.21.15.44:0/3736662509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc13f0c0 0x7fe9a40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 --2- 172.21.15.44:0/3736662509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9a4003fb0 0x7fe9a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 --2- 172.21.15.44:0/3736662509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a4004d40 0x7fe9a40051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc160e30 con 0x7fe9a4004d40 2024-03-30T13:14:42.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a400bc50 con 0x7fe9a4003fb0 2024-03-30T13:14:42.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a400be50 con 0x7fe9bc13f0c0 2024-03-30T13:14:42.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9c1400640 1 --2- 172.21.15.44:0/3736662509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a4004d40 0x7fe9a40051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/3736662509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc13f0c0 0x7fe9a40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.456+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/3736662509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9a4003fb0 0x7fe9a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.457+0000 7fe9c1400640 1 -- 172.21.15.44:0/3736662509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc13f0c0 msgr2=0x7fe9a40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.457+0000 7fe9c1400640 1 --2- 172.21.15.44:0/3736662509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc13f0c0 0x7fe9a40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.457+0000 7fe9c1400640 1 -- 172.21.15.44:0/3736662509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9a4003fb0 msgr2=0x7fe9a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.457+0000 7fe9c1400640 1 --2- 172.21.15.44:0/3736662509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9a4003fb0 0x7fe9a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.457+0000 7fe9c1400640 1 -- 172.21.15.44:0/3736662509 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a4003520 con 0x7fe9a4004d40 2024-03-30T13:14:42.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.458+0000 7fe9c1400640 1 --2- 172.21.15.44:0/3736662509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a4004d40 0x7fe9a40051a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4001e50 tx=0x7fe9a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a604d52e7a1e2a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.458+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4001a70 con 0x7fe9a4004d40 2024-03-30T13:14:42.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.458+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b4003b70 con 0x7fe9a4004d40 2024-03-30T13:14:42.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.458+0000 7fe9bb400640 1 -- 172.21.15.44:0/3736662509 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b40050d0 con 0x7fe9a4004d40 2024-03-30T13:14:42.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.459+0000 7fe9c3400640 1 -- 172.21.15.44:0/3736662509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a4004d40 msgr2=0x7fe9a40051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.459+0000 7fe9c3400640 1 --2- 172.21.15.44:0/3736662509 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9a4004d40 0x7fe9a40051a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4001e50 tx=0x7fe9a4005830 comp rx=0 tx=0).stop 2024-03-30T13:14:42.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.459+0000 7fe9c1400640 1 -- 172.21.15.44:0/3736662509 reap_dead start 2024-03-30T13:14:42.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.459+0000 7fe9c3400640 1 -- 172.21.15.44:0/3736662509 shutdown_connections 2024-03-30T13:14:42.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.459+0000 7fe9c3400640 1 -- 172.21.15.44:0/3736662509 >> 172.21.15.44:0/3736662509 conn(0x7fe9bc0b5b00 msgr2=0x7fe9bc06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.459+0000 7fe9c3400640 1 -- 172.21.15.44:0/3736662509 shutdown_connections 2024-03-30T13:14:42.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.459+0000 7fe9c3400640 1 -- 172.21.15.44:0/3736662509 wait complete. 2024-03-30T13:14:42.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.462+0000 7fe9c3400640 1 Processor -- start 2024-03-30T13:14:42.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.462+0000 7fe9c3400640 1 -- start start 2024-03-30T13:14:42.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c3400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9a4004d40 0x7fe9bc0a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c3400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc157750 0x7fe9bc131310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9bc0ae8d0 0x7fe9bc1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c3400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc13f4a0 con 0x7fe9bc0ae8d0 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c3400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc140000 con 0x7fe9a4004d40 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c3400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe9bc13f620 con 0x7fe9bc157750 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9bc0ae8d0 0x7fe9bc1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9bc0ae8d0 0x7fe9bc1595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33842/0 (socket says 172.21.15.44:33842) 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c1400640 1 -- 172.21.15.44:0/3823015420 learned_addr learned my addr 172.21.15.44:0/3823015420 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9a4004d40 0x7fe9bc0a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc157750 0x7fe9bc131310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c1400640 1 -- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc157750 msgr2=0x7fe9bc131310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c1400640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc157750 0x7fe9bc131310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c1400640 1 -- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9a4004d40 msgr2=0x7fe9bc0a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.464+0000 7fe9c1400640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9a4004d40 0x7fe9bc0a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.465+0000 7fe9c1400640 1 -- 172.21.15.44:0/3823015420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc157bb0 con 0x7fe9bc0ae8d0 2024-03-30T13:14:42.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.465+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9a4004d40 0x7fe9bc0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.465+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc157750 0x7fe9bc131310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.465+0000 7fe9c1400640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9bc0ae8d0 0x7fe9bc1595a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe9b402c060 tx=0x7fe9b40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.465+0000 7fe9b8c00640 1 -- 172.21.15.44:0/3823015420 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4007db0 con 0x7fe9bc0ae8d0 2024-03-30T13:14:42.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.465+0000 7fe9b8c00640 1 -- 172.21.15.44:0/3823015420 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b4003970 con 0x7fe9bc0ae8d0 2024-03-30T13:14:42.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.465+0000 7fe9b8c00640 1 -- 172.21.15.44:0/3823015420 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4006d70 con 0x7fe9bc0ae8d0 2024-03-30T13:14:42.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.465+0000 7fe9c3400640 1 -- 172.21.15.44:0/3823015420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9bc0a9b70 con 0x7fe9bc0ae8d0 2024-03-30T13:14:42.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.465+0000 7fe9c3400640 1 -- 172.21.15.44:0/3823015420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9bc158da0 con 0x7fe9bc0ae8d0 2024-03-30T13:14:42.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.468+0000 7fe9b8c00640 1 -- 172.21.15.44:0/3823015420 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe9b4007030 con 0x7fe9bc0ae8d0 2024-03-30T13:14:42.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.468+0000 7fe9b8c00640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe99c06c530 0x7fe99c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.469+0000 7fe9b8c00640 1 -- 172.21.15.44:0/3823015420 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fe9b40acbb0 con 0x7fe9bc0ae8d0 2024-03-30T13:14:42.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.469+0000 7fe9c61c1740 1 Processor -- start 2024-03-30T13:14:42.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.469+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe99c06c530 0x7fe99c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.469+0000 7fe9c61c1740 1 -- start start 2024-03-30T13:14:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.470+0000 7fe9c61c1740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955b6a0 0x5557295821d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.470+0000 7fe9c61c1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555729582710 0x55572955a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.470+0000 7fe9c61c1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955ba80 0x55572955ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.470+0000 7fe9c61c1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5557294ba330 con 0x55572955ba80 2024-03-30T13:14:42.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.470+0000 7fe9c61c1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555729462620 con 0x555729582710 2024-03-30T13:14:42.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.470+0000 7fe9c61c1740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5557294b6440 con 0x55572955b6a0 2024-03-30T13:14:42.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.470+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955ba80 0x55572955ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.470+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe99c06c530 0x7fe99c06e9f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009a00 tx=0x7fe9b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.470+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955ba80 0x55572955ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33846/0 (socket says 172.21.15.44:33846) 2024-03-30T13:14:42.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.470+0000 7fe9c1400640 1 -- 172.21.15.44:0/2922660942 learned_addr learned my addr 172.21.15.44:0/2922660942 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.471+0000 7fe9c1400640 1 -- 172.21.15.44:0/2922660942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955b6a0 msgr2=0x5557295821d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.471+0000 7fe9c1400640 1 --2- 172.21.15.44:0/2922660942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955b6a0 0x5557295821d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.471+0000 7fe9c1400640 1 -- 172.21.15.44:0/2922660942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555729582710 msgr2=0x55572955a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.471+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/2922660942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555729582710 0x55572955a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.471+0000 7fe9c1400640 1 --2- 172.21.15.44:0/2922660942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555729582710 0x55572955a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.471+0000 7fe9c1400640 1 -- 172.21.15.44:0/2922660942 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55572929a920 con 0x55572955ba80 2024-03-30T13:14:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.471+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/2922660942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555729582710 0x55572955a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.471+0000 7fe9c1400640 1 --2- 172.21.15.44:0/2922660942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955ba80 0x55572955ac20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe9b407a570 tx=0x7fe9b407a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4b6e8bc56217e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.471+0000 7fe9ad200640 1 -- 172.21.15.44:0/2922660942 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4048070 con 0x55572955ba80 2024-03-30T13:14:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.471+0000 7fe9ad200640 1 -- 172.21.15.44:0/2922660942 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b407ec20 con 0x55572955ba80 2024-03-30T13:14:42.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.471+0000 7fe9ad200640 1 -- 172.21.15.44:0/2922660942 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b40834e0 con 0x55572955ba80 2024-03-30T13:14:42.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.472+0000 7fe9c61c1740 1 -- 172.21.15.44:0/2922660942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955ba80 msgr2=0x55572955ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.472+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/2922660942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955ba80 0x55572955ac20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe9b407a570 tx=0x7fe9b407a2d0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.472+0000 7fe9c61c1740 1 -- 172.21.15.44:0/2922660942 shutdown_connections 2024-03-30T13:14:42.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.472+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/2922660942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955ba80 0x55572955ac20 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.472+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/2922660942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555729582710 0x55572955a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.472+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/2922660942 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955b6a0 0x5557295821d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.472+0000 7fe9c61c1740 1 -- 172.21.15.44:0/2922660942 >> 172.21.15.44:0/2922660942 conn(0x55572951dbe0 msgr2=0x5557295a03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.472+0000 7fe9c61c1740 1 -- 172.21.15.44:0/2922660942 shutdown_connections 2024-03-30T13:14:42.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.472+0000 7fe9c61c1740 1 -- 172.21.15.44:0/2922660942 wait complete. 2024-03-30T13:14:42.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.473+0000 7fe9c61c1740 1 -- start start 2024-03-30T13:14:42.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.474+0000 7fe9c61c1740 1 Processor -- start 2024-03-30T13:14:42.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.475+0000 7fe9c61c1740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955b6a0 0x5557295a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.475+0000 7fe9c61c1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55572955ba80 0x5557295a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.475+0000 7fe9c61c1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 0x555729588c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.475+0000 7fe9c61c1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555729462620 con 0x555729579190 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.475+0000 7fe9c61c1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5557294759d0 con 0x55572955ba80 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9c61c1740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5557294ba330 con 0x55572955b6a0 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9c61c1740 10 client.0 _ll_register_callbacks cb 0x5557294b1fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 0x555729588c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 0x555729588c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33850/0 (socket says 172.21.15.44:33850) 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9c1400640 1 -- 172.21.15.44:0/1555482608 learned_addr learned my addr 172.21.15.44:0/1555482608 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955b6a0 0x5557295a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55572955ba80 0x5557295a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9c1400640 1 -- 172.21.15.44:0/1555482608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955b6a0 msgr2=0x5557295a37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9c1400640 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955b6a0 0x5557295a37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9c1400640 1 -- 172.21.15.44:0/1555482608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55572955ba80 msgr2=0x5557295a3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9c1400640 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55572955ba80 0x5557295a3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9c1400640 1 -- 172.21.15.44:0/1555482608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55572918e210 con 0x555729579190 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.476+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55572955ba80 0x5557295a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9c1400640 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 0x555729588c10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe9b407aa30 tx=0x7fe9b40011c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3b13e04e4365df server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9a1600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9a1600640 1 -- 172.21.15.44:0/1555482608 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b407bda0 con 0x555729579190 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9a1600640 1 -- 172.21.15.44:0/1555482608 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fe9b4038c50 con 0x555729579190 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1555482608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9b407ec20 con 0x555729579190 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9a1600640 1 -- 172.21.15.44:0/1555482608 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe9b4038e50 con 0x555729579190 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9c61c1740 10 client.5871 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1555482608 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5557292fb0b0 con 0x555729579190 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9a1600640 1 -- 172.21.15.44:0/1555482608 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b407ec20 con 0x555729579190 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9a1600640 1 -- 172.21.15.44:0/1555482608 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fe9b40ac040 con 0x555729579190 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9c61c1740 10 client.5871 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9c61c1740 10 client.5871 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.477+0000 7fe9c61c1740 20 client.5871 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.478+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555729589150 0x555729586540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.478+0000 7fe9c61c1740 4 client.5871 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.478+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1555482608 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557294c7870 con 0x555729589150 2024-03-30T13:14:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.478+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555729589150 0x555729586540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.478+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555729589150 0x555729586540 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4073d6b068596795 server_cookie=125718b85ed3e34c in_seq=0 out_seq=0 2024-03-30T13:14:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.478+0000 7fe9a1600640 10 client.5871 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:42.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.479+0000 7fe9a1600640 1 -- 172.21.15.44:0/1555482608 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5557294c7870 con 0x555729589150 2024-03-30T13:14:42.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.479+0000 7fe9a1600640 10 client.5871 handle_command_reply: tid=0 2024-03-30T13:14:42.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.479+0000 7fe9c61c1740 1 client.5871 shutdown 2024-03-30T13:14:42.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.479+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1555482608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 msgr2=0x555729588c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.479+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 0x555729588c10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe9b407aa30 tx=0x7fe9b40011c0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.479+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1555482608 shutdown_connections 2024-03-30T13:14:42.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.479+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555729589150 0x555729586540 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.479+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 0x555729588c10 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.479+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55572955ba80 0x5557295a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.479+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/1555482608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955b6a0 0x5557295a37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.480+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1555482608 >> 172.21.15.44:0/1555482608 conn(0x55572951dbe0 msgr2=0x555729581150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.480+0000 7fe9a1600640 0 client.5871 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:42.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.480+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1555482608 shutdown_connections 2024-03-30T13:14:42.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.480+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1555482608 wait complete. 2024-03-30T13:14:42.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.480+0000 7fe9c61c1740 20 client.5871 trim_cache size 0 max 16384 2024-03-30T13:14:42.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.496+0000 7fe9c61c1740 1 Processor -- start 2024-03-30T13:14:42.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.496+0000 7fe9c61c1740 1 -- start start 2024-03-30T13:14:42.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c61c1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55572955b6a0 0x5557295785a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c61c1740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955ba80 0x5557295a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c61c1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 0x5557295b2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c61c1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc1fd560 con 0x555729579190 2024-03-30T13:14:42.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c61c1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc1fc670 con 0x55572955b6a0 2024-03-30T13:14:42.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c61c1740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe9bc0b44f0 con 0x55572955ba80 2024-03-30T13:14:42.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 0x5557295b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 0x5557295b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33858/0 (socket says 172.21.15.44:33858) 2024-03-30T13:14:42.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c1400640 1 -- 172.21.15.44:0/381104243 learned_addr learned my addr 172.21.15.44:0/381104243 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/381104243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955ba80 0x5557295a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c1400640 1 -- 172.21.15.44:0/381104243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955ba80 msgr2=0x5557295a34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/381104243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55572955b6a0 0x5557295785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c1400640 1 --2- 172.21.15.44:0/381104243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955ba80 0x5557295a34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.497+0000 7fe9c1400640 1 -- 172.21.15.44:0/381104243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55572955b6a0 msgr2=0x5557295785a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.498+0000 7fe9c1400640 1 --2- 172.21.15.44:0/381104243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55572955b6a0 0x5557295785a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.498+0000 7fe9c1400640 1 -- 172.21.15.44:0/381104243 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557291672d0 con 0x555729579190 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.498+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/381104243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955ba80 0x5557295a34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.498+0000 7fe9c1400640 1 --2- 172.21.15.44:0/381104243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 0x5557295b2470 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4078b20 tx=0x7fe9b40a6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786f08472156bef3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.498+0000 7fe9a3e00640 1 -- 172.21.15.44:0/381104243 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b407af70 con 0x555729579190 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.498+0000 7fe9a3e00640 1 -- 172.21.15.44:0/381104243 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b407ec20 con 0x555729579190 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.498+0000 7fe9a3e00640 1 -- 172.21.15.44:0/381104243 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b40834e0 con 0x555729579190 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.499+0000 7fe9c61c1740 1 -- 172.21.15.44:0/381104243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 msgr2=0x5557295b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.499+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/381104243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 0x5557295b2470 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4078b20 tx=0x7fe9b40a6040 comp rx=0 tx=0).stop 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.499+0000 7fe9c61c1740 1 -- 172.21.15.44:0/381104243 shutdown_connections 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.499+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/381104243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555729579190 0x5557295b2470 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.499+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/381104243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955ba80 0x5557295a34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.499+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/381104243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55572955b6a0 0x5557295785a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.499+0000 7fe9c61c1740 1 -- 172.21.15.44:0/381104243 >> 172.21.15.44:0/381104243 conn(0x55572951dbe0 msgr2=0x5557295889d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.499+0000 7fe9c61c1740 1 -- 172.21.15.44:0/381104243 shutdown_connections 2024-03-30T13:14:42.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.499+0000 7fe9c61c1740 1 -- 172.21.15.44:0/381104243 wait complete. 2024-03-30T13:14:42.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.500+0000 7fe9c61c1740 1 -- start start 2024-03-30T13:14:42.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.500+0000 7fe9c61c1740 1 Processor -- start 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.502+0000 7fe9c61c1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955b6a0 0x555729576ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.502+0000 7fe9c61c1740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955ba80 0x555729577400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.502+0000 7fe9c61c1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555729579190 0x555729586540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.502+0000 7fe9c61c1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc0b4b40 con 0x55572955b6a0 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.502+0000 7fe9c61c1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5557294c7870 con 0x555729579190 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.502+0000 7fe9c61c1740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5557295877e0 con 0x55572955ba80 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.502+0000 7fe9c61c1740 10 client.0 _ll_register_callbacks cb 0x7fe9b407a6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.502+0000 7fe9c0a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955b6a0 0x555729576ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.502+0000 7fe9c0a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955b6a0 0x555729576ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33866/0 (socket says 172.21.15.44:33866) 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.502+0000 7fe9c0a00640 1 -- 172.21.15.44:0/1119829699 learned_addr learned my addr 172.21.15.44:0/1119829699 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.503+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955ba80 0x555729577400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.503+0000 7fe9c1400640 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555729579190 0x555729586540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.503+0000 7fe9c0a00640 1 -- 172.21.15.44:0/1119829699 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955ba80 msgr2=0x555729577400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.503+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955ba80 0x555729577400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.503+0000 7fe9c0a00640 1 -- 172.21.15.44:0/1119829699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555729579190 msgr2=0x555729586540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.503+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555729579190 0x555729586540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.503+0000 7fe9c0a00640 1 -- 172.21.15.44:0/1119829699 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557295af910 con 0x55572955b6a0 2024-03-30T13:14:42.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.503+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955ba80 0x555729577400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.503+0000 7fe9c0a00640 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955b6a0 0x555729576ec0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0012ba0 tx=0x7fe9b0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c199e503bd2ee server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.503+0000 7fe9a1600640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:42.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9a1600640 1 -- 172.21.15.44:0/1119829699 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b001d040 con 0x55572955b6a0 2024-03-30T13:14:42.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9a1600640 1 -- 172.21.15.44:0/1119829699 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fe9b0029620 con 0x55572955b6a0 2024-03-30T13:14:42.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1119829699 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9b407ec20 con 0x55572955b6a0 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9a1600640 1 -- 172.21.15.44:0/1119829699 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe9b0038050 con 0x55572955b6a0 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9c61c1740 10 client.5877 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1119829699 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5557295857c0 con 0x55572955b6a0 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9a1600640 1 -- 172.21.15.44:0/1119829699 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b407ec20 con 0x55572955b6a0 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9a1600640 1 -- 172.21.15.44:0/1119829699 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fe9b003b020 con 0x55572955b6a0 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9c61c1740 10 client.5877 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9c61c1740 10 client.5877 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9c61c1740 20 client.5877 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555729586a80 0x555729586e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9c61c1740 4 client.5877 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628341}] 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.504+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1119829699 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628341}) -- 0x5557294c1bc0 con 0x555729586a80 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.505+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555729586a80 0x555729586e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.505+0000 7fe9bbe00640 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555729586a80 0x555729586e60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b9624a12e275443 server_cookie=3c1531b53690ffe5 in_seq=0 out_seq=0 2024-03-30T13:14:42.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.505+0000 7fe9a1600640 10 client.5877 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.505+0000 7fe9a1600640 1 -- 172.21.15.44:0/1119829699 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3979 (crc 0 0 0) 0x5557294c1bc0 con 0x555729586a80 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9a1600640 10 client.5877 handle_command_reply: tid=0 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9c61c1740 1 client.5877 shutdown 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1119829699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955b6a0 msgr2=0x555729576ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955b6a0 0x555729576ec0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0012ba0 tx=0x7fe9b0009190 comp rx=0 tx=0).stop 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1119829699 shutdown_connections 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555729586a80 0x555729586e60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555729579190 0x555729586540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55572955ba80 0x555729577400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9c61c1740 1 --2- 172.21.15.44:0/1119829699 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55572955b6a0 0x555729576ec0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1119829699 >> 172.21.15.44:0/1119829699 conn(0x55572951dbe0 msgr2=0x5557295a34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9a1600640 0 client.5877 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1119829699 shutdown_connections 2024-03-30T13:14:42.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9c61c1740 1 -- 172.21.15.44:0/1119829699 wait complete. 2024-03-30T13:14:42.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.506+0000 7fe9c61c1740 20 client.5877 trim_cache size 0 max 16384 2024-03-30T13:14:42.514 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:42.514 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-debug.h", 2024-03-30T13:14:42.514 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628341, 2024-03-30T13:14:42.514 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.295739+0000", 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.416256+0000", 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.515 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2579, 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:42.516 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.416256+0000", 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 4, 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:42.517 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:42.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.518 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:42.518 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:42.518 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 2579, 2024-03-30T13:14:42.518 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:42.518 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:42.518 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:42.518 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.295739+0000" 2024-03-30T13:14:42.518 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.518 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:42.519 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:42.519 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 2579, 2024-03-30T13:14:42.519 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:42.519 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:42.519 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:42.519 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.295739+0000" 2024-03-30T13:14:42.519 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.519 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 214, 2024-03-30T13:14:42.519 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:42.519 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:42.519 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 28, 2024-03-30T13:14:42.519 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:06.340676+0000", 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 60, 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:42.520 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:42.521 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:42.522 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:42.523 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:42.523 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:42.523 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:42.523 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:42.523 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.523 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:42.523 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:42.523 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:42.523 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:42.523 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:42.523 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:42.523 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:42.524 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:42.525 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:42.525 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:42.525 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:42.525 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:42.525 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:42.525 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:42.525 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.525 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:42.525 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:42.525 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:42.525 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:42.525 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:42.526 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:42.526 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:42.526 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:42.526 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:42.526 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:42.526 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:42.526 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.526 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:42.526 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:42.526 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:42.526 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:42.526 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:42.527 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:42.528 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:42.528 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:42.528 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:42.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.507+0000 7fe9c3400640 1 -- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe99c06c530 msgr2=0x7fe99c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.507+0000 7fe9c3400640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe99c06c530 0x7fe99c06e9f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009a00 tx=0x7fe9b0008040 comp rx=0 tx=0).stop 2024-03-30T13:14:42.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.507+0000 7fe9c3400640 1 -- 172.21.15.44:0/3823015420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9bc0ae8d0 msgr2=0x7fe9bc1595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.507+0000 7fe9c3400640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9bc0ae8d0 0x7fe9bc1595a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe9b402c060 tx=0x7fe9b40014a0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.507+0000 7fe9c3400640 1 -- 172.21.15.44:0/3823015420 shutdown_connections 2024-03-30T13:14:42.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.507+0000 7fe9c3400640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe9bc0ae8d0 0x7fe9bc1595a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.507+0000 7fe9c3400640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9bc157750 0x7fe9bc131310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.507+0000 7fe9c3400640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe99c06c530 0x7fe99c06e9f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.507+0000 7fe9c3400640 1 --2- 172.21.15.44:0/3823015420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9a4004d40 0x7fe9bc0a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.507+0000 7fe9c3400640 1 -- 172.21.15.44:0/3823015420 >> 172.21.15.44:0/3823015420 conn(0x7fe9bc0b5b00 msgr2=0x7fe9bc140420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.507+0000 7fe9c3400640 1 -- 172.21.15.44:0/3823015420 shutdown_connections 2024-03-30T13:14:42.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.507+0000 7fe9c3400640 1 -- 172.21.15.44:0/3823015420 wait complete. 2024-03-30T13:14:42.530 DEBUG:tasks.cephfs.test_uninlining:getting inode info #16 of 23:1099511628348 2024-03-30T13:14:42.530 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628348 2024-03-30T13:14:42.531 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628348 2024-03-30T13:14:42.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.735+0000 7f7c02a00640 1 Processor -- start 2024-03-30T13:14:42.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.736+0000 7f7c02a00640 1 -- start start 2024-03-30T13:14:42.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.737+0000 7f7c02a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7bfc15e5a0 0x7f7bfc072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.737+0000 7f7c02a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bfc0b3fa0 0x7f7bfc0cfc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.737+0000 7f7c02a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bfc0b2f20 con 0x7f7bfc073440 2024-03-30T13:14:42.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.737+0000 7f7c02a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f7bfc0b3b10 con 0x7f7bfc15e5a0 2024-03-30T13:14:42.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.737+0000 7f7c02a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7bfc15e980 con 0x7f7bfc0b3fa0 2024-03-30T13:14:42.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.738+0000 7f7c00a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7bfc073440 0x7f7bfc06d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36858/0 (socket says 172.21.15.44:36858) 2024-03-30T13:14:42.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.738+0000 7f7c00a00640 1 -- 172.21.15.44:0/4285775944 learned_addr learned my addr 172.21.15.44:0/4285775944 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.738+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/4285775944 >> v2:172.21.15.151:3300/0 conn(0x7f7bfc15e5a0 0x7f7bfc072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.738+0000 7f7bfb400640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bfc0b3fa0 0x7f7bfc0cfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.738+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18124221 0 0) 0x7f7bfc0b2f20 con 0x7f7bfc073440 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.738+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7be0003520 con 0x7f7bfc073440 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2756307397 0 0) 0x7f7be0003520 con 0x7f7bfc073440 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bfc0b3fa0 msgr2=0x7f7bfc0cfc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bfc0b3fa0 0x7f7bfc0cfc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 >> v2:172.21.15.151:3300/0 conn(0x7f7bfc15e5a0 msgr2=0x7f7bfc072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 --2- 172.21.15.44:0/4285775944 >> v2:172.21.15.151:3300/0 conn(0x7f7bfc15e5a0 0x7f7bfc072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc0b31e0 con 0x7f7bfc073440 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f7bf4001670 con 0x7f7bfc073440 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 >> v1:172.21.15.44:6789/0 conn(0x7f7bfc073440 legacy=0x7f7bfc06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7be00039b0 0x7f7be0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7be0004800 0x7f7be0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bfc0b3fa0 0x7f7be00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc0b3b10 con 0x7f7be0004800 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc15e980 con 0x7f7be00039b0 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7be000b9c0 con 0x7f7bfc0b3fa0 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.739+0000 7f7bfb400640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7be0004800 0x7f7be0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.740+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7be00039b0 0x7f7be0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.740+0000 7f7c00a00640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bfc0b3fa0 0x7f7be00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.740+0000 7f7bfb400640 1 -- 172.21.15.44:0/4285775944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bfc0b3fa0 msgr2=0x7f7be00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.740+0000 7f7bfb400640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bfc0b3fa0 0x7f7be00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.740+0000 7f7bfb400640 1 -- 172.21.15.44:0/4285775944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7be00039b0 msgr2=0x7f7be0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.740+0000 7f7bfb400640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7be00039b0 0x7f7be0003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.740+0000 7f7bfb400640 1 -- 172.21.15.44:0/4285775944 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be0003520 con 0x7f7be0004800 2024-03-30T13:14:42.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.740+0000 7f7c00a00640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bfc0b3fa0 0x7f7be00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.741+0000 7f7bfb400640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7be0004800 0x7f7be0004c80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009a90 tx=0x7f7be0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2bfb2cfc40582f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.741+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4039070 con 0x7f7be0004800 2024-03-30T13:14:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.741+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be402c6b0 con 0x7f7be0004800 2024-03-30T13:14:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.741+0000 7f7bfaa00640 1 -- 172.21.15.44:0/4285775944 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4009690 con 0x7f7be0004800 2024-03-30T13:14:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.742+0000 7f7c02a00640 1 -- 172.21.15.44:0/4285775944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7be0004800 msgr2=0x7f7be0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.742+0000 7f7c02a00640 1 --2- 172.21.15.44:0/4285775944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7be0004800 0x7f7be0004c80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009a90 tx=0x7f7be0005830 comp rx=0 tx=0).stop 2024-03-30T13:14:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.742+0000 7f7c00a00640 1 -- 172.21.15.44:0/4285775944 reap_dead start 2024-03-30T13:14:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.742+0000 7f7c02a00640 1 -- 172.21.15.44:0/4285775944 shutdown_connections 2024-03-30T13:14:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.742+0000 7f7c02a00640 1 -- 172.21.15.44:0/4285775944 >> 172.21.15.44:0/4285775944 conn(0x7f7bfc0b5b00 msgr2=0x7f7bfc06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.742+0000 7f7c02a00640 1 -- 172.21.15.44:0/4285775944 shutdown_connections 2024-03-30T13:14:42.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.742+0000 7f7c02a00640 1 -- 172.21.15.44:0/4285775944 wait complete. 2024-03-30T13:14:42.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.744+0000 7f7c02a00640 1 Processor -- start 2024-03-30T13:14:42.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.744+0000 7f7c02a00640 1 -- start start 2024-03-30T13:14:42.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.745+0000 7f7c02a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7be0004800 0x7f7bfc1449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.745+0000 7f7c02a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bfc157430 0x7f7bfc141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.745+0000 7f7c02a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bfc160310 0x7f7bfc160790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.745+0000 7f7c02a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc0726a0 con 0x7f7bfc157430 2024-03-30T13:14:42.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.745+0000 7f7c02a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc0b37a0 con 0x7f7bfc160310 2024-03-30T13:14:42.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.745+0000 7f7c02a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7bfc15f990 con 0x7f7be0004800 2024-03-30T13:14:42.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.745+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bfc157430 0x7f7bfc141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.745+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bfc157430 0x7f7bfc141580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33886/0 (socket says 172.21.15.44:33886) 2024-03-30T13:14:42.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.745+0000 7f7bfb400640 1 -- 172.21.15.44:0/3672592480 learned_addr learned my addr 172.21.15.44:0/3672592480 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.746+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7be0004800 0x7f7bfc1449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.746+0000 7f7c00a00640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bfc160310 0x7f7bfc160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.746+0000 7f7bfb400640 1 -- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7be0004800 msgr2=0x7f7bfc1449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.746+0000 7f7bfb400640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7be0004800 0x7f7bfc1449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.746+0000 7f7bfb400640 1 -- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bfc160310 msgr2=0x7f7bfc160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.746+0000 7f7bfb400640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bfc160310 0x7f7bfc160790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.746+0000 7f7bfb400640 1 -- 172.21.15.44:0/3672592480 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc157c30 con 0x7f7bfc157430 2024-03-30T13:14:42.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.746+0000 7f7bfb400640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bfc157430 0x7f7bfc141580 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7be4000c00 tx=0x7f7be4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.746+0000 7f7bf3e00640 1 -- 172.21.15.44:0/3672592480 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4042020 con 0x7f7bfc157430 2024-03-30T13:14:42.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.746+0000 7f7bf3e00640 1 -- 172.21.15.44:0/3672592480 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be403a040 con 0x7f7bfc157430 2024-03-30T13:14:42.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.746+0000 7f7bf3e00640 1 -- 172.21.15.44:0/3672592480 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4039070 con 0x7f7bfc157430 2024-03-30T13:14:42.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.746+0000 7f7c02a00640 1 -- 172.21.15.44:0/3672592480 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bfc157f10 con 0x7f7bfc157430 2024-03-30T13:14:42.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.747+0000 7f7c02a00640 1 -- 172.21.15.44:0/3672592480 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bfc1584d0 con 0x7f7bfc157430 2024-03-30T13:14:42.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.749+0000 7f7bf3e00640 1 -- 172.21.15.44:0/3672592480 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7be4045020 con 0x7f7bfc157430 2024-03-30T13:14:42.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.750+0000 7f7bf3e00640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7bd806c560 0x7f7bd806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.750+0000 7f7bf3e00640 1 -- 172.21.15.44:0/3672592480 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f7be40acb90 con 0x7f7bfc157430 2024-03-30T13:14:42.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.750+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7bd806c560 0x7f7bd806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.751+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7bd806c560 0x7f7bd806ea20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7bec003a50 tx=0x7f7bec00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.752+0000 7f7c05832740 1 Processor -- start 2024-03-30T13:14:42.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.753+0000 7f7c05832740 1 -- start start 2024-03-30T13:14:42.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.754+0000 7f7c05832740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 0x560c192f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.754+0000 7f7c05832740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c192f9300 0x560c192d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.754+0000 7f7c05832740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 0x560c192d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.754+0000 7f7c05832740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560c19235330 con 0x560c192d2290 2024-03-30T13:14:42.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.754+0000 7f7c05832740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560c191dd620 con 0x560c192d2670 2024-03-30T13:14:42.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.754+0000 7f7c05832740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x560c19231440 con 0x560c192f9300 2024-03-30T13:14:42.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.754+0000 7f7bfbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 0x560c192f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.755+0000 7f7bfbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 0x560c192f8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33896/0 (socket says 172.21.15.44:33896) 2024-03-30T13:14:42.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.755+0000 7f7bfbe00640 1 -- 172.21.15.44:0/1282782526 learned_addr learned my addr 172.21.15.44:0/1282782526 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.755+0000 7f7c00a00640 1 --2- 172.21.15.44:0/1282782526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 0x560c192d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.755+0000 7f7bfbe00640 1 -- 172.21.15.44:0/1282782526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c192f9300 msgr2=0x560c192d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.755+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/1282782526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c192f9300 0x560c192d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.755+0000 7f7bfbe00640 1 -- 172.21.15.44:0/1282782526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 msgr2=0x560c192d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.755+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/1282782526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 0x560c192d1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.755+0000 7f7bfbe00640 1 -- 172.21.15.44:0/1282782526 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c19015920 con 0x560c192d2290 2024-03-30T13:14:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.755+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/1282782526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 0x560c192f8dc0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0094c0 tx=0x7f7bec013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25785727e96311a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.756+0000 7f7bebe00640 1 -- 172.21.15.44:0/1282782526 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec027070 con 0x560c192d2290 2024-03-30T13:14:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.756+0000 7f7bebe00640 1 -- 172.21.15.44:0/1282782526 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec017e40 con 0x560c192d2290 2024-03-30T13:14:42.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.756+0000 7f7bebe00640 1 -- 172.21.15.44:0/1282782526 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec015830 con 0x560c192d2290 2024-03-30T13:14:42.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.756+0000 7f7c05832740 1 -- 172.21.15.44:0/1282782526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 msgr2=0x560c192f8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.756+0000 7f7c05832740 1 --2- 172.21.15.44:0/1282782526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 0x560c192f8dc0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0094c0 tx=0x7f7bec013000 comp rx=0 tx=0).stop 2024-03-30T13:14:42.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.757+0000 7f7c05832740 1 -- 172.21.15.44:0/1282782526 shutdown_connections 2024-03-30T13:14:42.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.757+0000 7f7c05832740 1 --2- 172.21.15.44:0/1282782526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 0x560c192d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.757+0000 7f7c05832740 1 --2- 172.21.15.44:0/1282782526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c192f9300 0x560c192d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.757+0000 7f7c05832740 1 --2- 172.21.15.44:0/1282782526 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 0x560c192f8dc0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.757+0000 7f7c05832740 1 -- 172.21.15.44:0/1282782526 >> 172.21.15.44:0/1282782526 conn(0x560c19298be0 msgr2=0x560c19316fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.757+0000 7f7c05832740 1 -- 172.21.15.44:0/1282782526 shutdown_connections 2024-03-30T13:14:42.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.757+0000 7f7c05832740 1 -- 172.21.15.44:0/1282782526 wait complete. 2024-03-30T13:14:42.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.758+0000 7f7c05832740 1 -- start start 2024-03-30T13:14:42.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.758+0000 7f7c05832740 1 Processor -- start 2024-03-30T13:14:42.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.760+0000 7f7c05832740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c192d2290 0x560c192f7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.760+0000 7f7c05832740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 0x560c1931a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.760+0000 7f7c05832740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c19326f10 0x560c1931adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.760+0000 7f7c05832740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560c192f8930 con 0x560c19326f10 2024-03-30T13:14:42.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.760+0000 7f7c05832740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560c191f09d0 con 0x560c192d2670 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.760+0000 7f7c05832740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x560c192f16b0 con 0x560c192d2290 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.760+0000 7f7c05832740 10 client.0 _ll_register_callbacks cb 0x560c1922cfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.760+0000 7f7c00a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c19326f10 0x560c1931adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.760+0000 7f7c00a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c19326f10 0x560c1931adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33910/0 (socket says 172.21.15.44:33910) 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.760+0000 7f7c00a00640 1 -- 172.21.15.44:0/1283277443 learned_addr learned my addr 172.21.15.44:0/1283277443 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7bfb400640 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 0x560c1931a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c192d2290 0x560c192f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7c00a00640 1 -- 172.21.15.44:0/1283277443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c192d2290 msgr2=0x560c192f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7c00a00640 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c192d2290 0x560c192f7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7c00a00640 1 -- 172.21.15.44:0/1283277443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 msgr2=0x560c1931a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7c00a00640 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 0x560c1931a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7c00a00640 1 -- 172.21.15.44:0/1283277443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c18f09210 con 0x560c19326f10 2024-03-30T13:14:42.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7bfb400640 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 0x560c1931a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7c00a00640 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c19326f10 0x560c1931adc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0738b0 tx=0x7f7bf400f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb05970bcbf1f35 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7be8c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7be8c00640 1 -- 172.21.15.44:0/1283277443 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4019060 con 0x560c19326f10 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7be8c00640 1 -- 172.21.15.44:0/1283277443 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f7bf4014cb0 con 0x560c19326f10 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.761+0000 7f7c05832740 1 -- 172.21.15.44:0/1283277443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c19242870 con 0x560c19326f10 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.762+0000 7f7be8c00640 1 -- 172.21.15.44:0/1283277443 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7bf40072d0 con 0x560c19326f10 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.762+0000 7f7c05832740 10 client.5889 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.762+0000 7f7c05832740 1 -- 172.21.15.44:0/1283277443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x560c190760b0 con 0x560c19326f10 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.762+0000 7f7be8c00640 1 -- 172.21.15.44:0/1283277443 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x560c19242870 con 0x560c19326f10 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.762+0000 7f7be8c00640 1 -- 172.21.15.44:0/1283277443 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f7bf4007470 con 0x560c19326f10 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.762+0000 7f7c05832740 10 client.5889 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.762+0000 7f7c05832740 10 client.5889 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.762+0000 7f7c05832740 20 client.5889 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:42.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.762+0000 7f7c05832740 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560c193163d0 0x560c192fd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.762+0000 7f7c05832740 4 client.5889 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:42.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.762+0000 7f7c05832740 1 -- 172.21.15.44:0/1283277443 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c1923cbc0 con 0x560c193163d0 2024-03-30T13:14:42.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.763+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560c193163d0 0x560c192fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.763+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560c193163d0 0x560c192fd100 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7d49d516ff9fe68 server_cookie=92395e669fe61ea9 in_seq=0 out_seq=0 2024-03-30T13:14:42.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.763+0000 7f7be8c00640 10 client.5889 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:42.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7be8c00640 1 -- 172.21.15.44:0/1283277443 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x560c1923cbc0 con 0x560c193163d0 2024-03-30T13:14:42.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7be8c00640 10 client.5889 handle_command_reply: tid=0 2024-03-30T13:14:42.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7c05832740 1 client.5889 shutdown 2024-03-30T13:14:42.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7c05832740 1 -- 172.21.15.44:0/1283277443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c19326f10 msgr2=0x560c1931adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7c05832740 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c19326f10 0x560c1931adc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0738b0 tx=0x7f7bf400f600 comp rx=0 tx=0).stop 2024-03-30T13:14:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7c05832740 1 -- 172.21.15.44:0/1283277443 shutdown_connections 2024-03-30T13:14:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7c05832740 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560c193163d0 0x560c192fd100 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7c05832740 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c19326f10 0x560c1931adc0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7c05832740 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 0x560c1931a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7c05832740 1 --2- 172.21.15.44:0/1283277443 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c192d2290 0x560c192f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7c05832740 1 -- 172.21.15.44:0/1283277443 >> 172.21.15.44:0/1283277443 conn(0x560c19298be0 msgr2=0x560c192f8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7be8c00640 0 client.5889 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7c05832740 1 -- 172.21.15.44:0/1283277443 shutdown_connections 2024-03-30T13:14:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.764+0000 7f7c05832740 1 -- 172.21.15.44:0/1283277443 wait complete. 2024-03-30T13:14:42.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.765+0000 7f7c05832740 20 client.5889 trim_cache size 0 max 16384 2024-03-30T13:14:42.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.781+0000 7f7c05832740 1 Processor -- start 2024-03-30T13:14:42.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.781+0000 7f7c05832740 1 -- start start 2024-03-30T13:14:42.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.782+0000 7f7c05832740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2290 0x560c192f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.782+0000 7f7c05832740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2670 0x560c192cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.782+0000 7f7c05832740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c19326f10 0x560c192cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.782+0000 7f7c05832740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc201aa0 con 0x560c192d2670 2024-03-30T13:14:42.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.782+0000 7f7c05832740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc200ae0 con 0x560c192d2290 2024-03-30T13:14:42.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.782+0000 7f7c05832740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7bfc1ffe70 con 0x560c19326f10 2024-03-30T13:14:42.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.783+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2670 0x560c192cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.783+0000 7f7bfb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2670 0x560c192cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33926/0 (socket says 172.21.15.44:33926) 2024-03-30T13:14:42.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.783+0000 7f7bfb400640 1 -- 172.21.15.44:0/601344483 learned_addr learned my addr 172.21.15.44:0/601344483 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.783+0000 7f7bfb400640 1 -- 172.21.15.44:0/601344483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c19326f10 msgr2=0x560c192cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.783+0000 7f7bfb400640 1 --2- 172.21.15.44:0/601344483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c19326f10 0x560c192cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.783+0000 7f7bfb400640 1 -- 172.21.15.44:0/601344483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2290 msgr2=0x560c192f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.783+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/601344483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2290 0x560c192f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.783+0000 7f7bfb400640 1 --2- 172.21.15.44:0/601344483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2290 0x560c192f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.783+0000 7f7bfb400640 1 -- 172.21.15.44:0/601344483 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c18ee22d0 con 0x560c192d2670 2024-03-30T13:14:42.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.783+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/601344483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2290 0x560c192f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:42.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.783+0000 7f7bfb400640 1 --2- 172.21.15.44:0/601344483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2670 0x560c192cb070 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009a90 tx=0x7f7be407a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b841fc17072867e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.784+0000 7f7beb400640 1 -- 172.21.15.44:0/601344483 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be407b090 con 0x560c192d2670 2024-03-30T13:14:42.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.784+0000 7f7beb400640 1 -- 172.21.15.44:0/601344483 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be407a990 con 0x560c192d2670 2024-03-30T13:14:42.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.784+0000 7f7beb400640 1 -- 172.21.15.44:0/601344483 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be407ed40 con 0x560c192d2670 2024-03-30T13:14:42.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.784+0000 7f7c05832740 1 -- 172.21.15.44:0/601344483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2670 msgr2=0x560c192cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.784+0000 7f7c05832740 1 --2- 172.21.15.44:0/601344483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2670 0x560c192cb070 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009a90 tx=0x7f7be407a590 comp rx=0 tx=0).stop 2024-03-30T13:14:42.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.784+0000 7f7c05832740 1 -- 172.21.15.44:0/601344483 shutdown_connections 2024-03-30T13:14:42.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.784+0000 7f7c05832740 1 --2- 172.21.15.44:0/601344483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c19326f10 0x560c192cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.784+0000 7f7c05832740 1 --2- 172.21.15.44:0/601344483 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2670 0x560c192cb070 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.784+0000 7f7c05832740 1 --2- 172.21.15.44:0/601344483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2290 0x560c192f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.784+0000 7f7c05832740 1 -- 172.21.15.44:0/601344483 >> 172.21.15.44:0/601344483 conn(0x560c19298be0 msgr2=0x560c193297e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.785+0000 7f7c05832740 1 -- 172.21.15.44:0/601344483 shutdown_connections 2024-03-30T13:14:42.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.785+0000 7f7c05832740 1 -- 172.21.15.44:0/601344483 wait complete. 2024-03-30T13:14:42.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.785+0000 7f7c05832740 1 -- start start 2024-03-30T13:14:42.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.785+0000 7f7c05832740 1 Processor -- start 2024-03-30T13:14:42.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.786+0000 7f7c05832740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 0x560c1938cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.786+0000 7f7c05832740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 0x560c1930c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.786+0000 7f7c05832740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c19326f10 0x560c1930ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.786+0000 7f7c05832740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc200490 con 0x560c192d2290 2024-03-30T13:14:42.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.786+0000 7f7c05832740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560c192cbaf0 con 0x560c192d2670 2024-03-30T13:14:42.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.786+0000 7f7c05832740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x560c1931ae40 con 0x560c19326f10 2024-03-30T13:14:42.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.786+0000 7f7c05832740 10 client.0 _ll_register_callbacks cb 0x7f7bf4001470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:42.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.787+0000 7f7bfbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 0x560c1938cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.787+0000 7f7bfbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 0x560c1938cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33940/0 (socket says 172.21.15.44:33940) 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.787+0000 7f7bfbe00640 1 -- 172.21.15.44:0/3303223764 learned_addr learned my addr 172.21.15.44:0/3303223764 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.787+0000 7f7bfbe00640 1 -- 172.21.15.44:0/3303223764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c19326f10 msgr2=0x560c1930ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.787+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/3303223764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c19326f10 0x560c1930ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.787+0000 7f7bfbe00640 1 -- 172.21.15.44:0/3303223764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 msgr2=0x560c1930c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.787+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/3303223764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 0x560c1930c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.787+0000 7f7bfbe00640 1 -- 172.21.15.44:0/3303223764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c193107b0 con 0x560c192d2290 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.787+0000 7f7bfbe00640 1 --2- 172.21.15.44:0/3303223764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 0x560c1938cf00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7bec004830 tx=0x7f7bec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5664c9f18c7a5386 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.787+0000 7f7be8c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7be8c00640 1 -- 172.21.15.44:0/3303223764 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec037060 con 0x560c192d2290 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7be8c00640 1 -- 172.21.15.44:0/3303223764 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f7bec015b10 con 0x560c192d2290 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7c05832740 1 -- 172.21.15.44:0/3303223764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7be407a990 con 0x560c192d2290 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7be8c00640 1 -- 172.21.15.44:0/3303223764 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7bec027040 con 0x560c192d2290 2024-03-30T13:14:42.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7c05832740 10 client.5895 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:42.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7c05832740 1 -- 172.21.15.44:0/3303223764 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x560c192cb770 con 0x560c192d2290 2024-03-30T13:14:42.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7be8c00640 1 -- 172.21.15.44:0/3303223764 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be407a990 con 0x560c192d2290 2024-03-30T13:14:42.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7be8c00640 1 -- 172.21.15.44:0/3303223764 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f7bec016070 con 0x560c192d2290 2024-03-30T13:14:42.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7c05832740 10 client.5895 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:42.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7c05832740 10 client.5895 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:42.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7c05832740 20 client.5895 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:42.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7c05832740 1 --2- 172.21.15.44:0/3303223764 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560c192cbca0 0x560c19319fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:42.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7c05832740 4 client.5895 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628348}] 2024-03-30T13:14:42.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.788+0000 7f7c05832740 1 -- 172.21.15.44:0/3303223764 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628348}) -- 0x560c191ba950 con 0x560c192cbca0 2024-03-30T13:14:42.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.789+0000 7f7bfb400640 1 --2- 172.21.15.44:0/3303223764 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560c192cbca0 0x560c19319fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:42.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.789+0000 7f7bfb400640 1 --2- 172.21.15.44:0/3303223764 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560c192cbca0 0x560c19319fb0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46263b6757742f53 server_cookie=2a531a23426625d4 in_seq=0 out_seq=0 2024-03-30T13:14:42.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.789+0000 7f7be8c00640 10 client.5895 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:42.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.789+0000 7f7be8c00640 1 -- 172.21.15.44:0/3303223764 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3973 (crc 0 0 0) 0x560c191ba950 con 0x560c192cbca0 2024-03-30T13:14:42.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.789+0000 7f7be8c00640 10 client.5895 handle_command_reply: tid=0 2024-03-30T13:14:42.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.789+0000 7f7c05832740 1 client.5895 shutdown 2024-03-30T13:14:42.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.790+0000 7f7c05832740 1 -- 172.21.15.44:0/3303223764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 msgr2=0x560c1938cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.790+0000 7f7c05832740 1 --2- 172.21.15.44:0/3303223764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 0x560c1938cf00 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7bec004830 tx=0x7f7bec004ab0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.790+0000 7f7c05832740 1 -- 172.21.15.44:0/3303223764 shutdown_connections 2024-03-30T13:14:42.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.790+0000 7f7c05832740 1 --2- 172.21.15.44:0/3303223764 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560c192cbca0 0x560c19319fb0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.790+0000 7f7c05832740 1 --2- 172.21.15.44:0/3303223764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560c19326f10 0x560c1930ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.790+0000 7f7c05832740 1 --2- 172.21.15.44:0/3303223764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c192d2670 0x560c1930c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.790+0000 7f7c05832740 1 --2- 172.21.15.44:0/3303223764 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560c192d2290 0x560c1938cf00 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.790+0000 7f7be8c00640 0 client.5895 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:42.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.790+0000 7f7c05832740 1 -- 172.21.15.44:0/3303223764 >> 172.21.15.44:0/3303223764 conn(0x560c19298be0 msgr2=0x560c192ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.790+0000 7f7c05832740 1 -- 172.21.15.44:0/3303223764 shutdown_connections 2024-03-30T13:14:42.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.790+0000 7f7c05832740 1 -- 172.21.15.44:0/3303223764 wait complete. 2024-03-30T13:14:42.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.790+0000 7f7c05832740 20 client.5895 trim_cache size 0 max 16384 2024-03-30T13:14:42.799 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:42.799 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-sysfs.h", 2024-03-30T13:14:42.799 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628348, 2024-03-30T13:14:42.799 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:42.799 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.298360+0000", 2024-03-30T13:14:42.799 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.431255+0000", 2024-03-30T13:14:42.799 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:42.800 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 77, 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.431255+0000", 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:42.801 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:42.802 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 77, 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.298360+0000" 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 77, 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.298360+0000" 2024-03-30T13:14:42.803 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 186, 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 42, 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:06.344458+0000", 2024-03-30T13:14:42.804 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 62, 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:42.805 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:42.806 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:42.807 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:42.808 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:42.809 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:42.810 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:42.811 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:42.812 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:42.812 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:42.812 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:42.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.791+0000 7f7c02a00640 1 -- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7bd806c560 msgr2=0x7f7bd806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.791+0000 7f7c02a00640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7bd806c560 0x7f7bd806ea20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7bec003a50 tx=0x7f7bec00b040 comp rx=0 tx=0).stop 2024-03-30T13:14:42.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.791+0000 7f7c02a00640 1 -- 172.21.15.44:0/3672592480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bfc157430 msgr2=0x7f7bfc141580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:42.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.791+0000 7f7c02a00640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bfc157430 0x7f7bfc141580 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7be4000c00 tx=0x7f7be4004730 comp rx=0 tx=0).stop 2024-03-30T13:14:42.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.791+0000 7f7c02a00640 1 -- 172.21.15.44:0/3672592480 shutdown_connections 2024-03-30T13:14:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.791+0000 7f7c02a00640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7bd806c560 0x7f7bd806ea20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.791+0000 7f7c02a00640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bfc160310 0x7f7bfc160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.791+0000 7f7c02a00640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7bfc157430 0x7f7bfc141580 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.791+0000 7f7c02a00640 1 --2- 172.21.15.44:0/3672592480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7be0004800 0x7f7bfc1449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.791+0000 7f7c02a00640 1 -- 172.21.15.44:0/3672592480 >> 172.21.15.44:0/3672592480 conn(0x7f7bfc0b5b00 msgr2=0x7f7bfc0b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.791+0000 7f7c02a00640 1 -- 172.21.15.44:0/3672592480 shutdown_connections 2024-03-30T13:14:42.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:42.791+0000 7f7c02a00640 1 -- 172.21.15.44:0/3672592480 wait complete. 2024-03-30T13:14:42.814 DEBUG:tasks.cephfs.test_uninlining:getting inode info #17 of 23:1099511628331 2024-03-30T13:14:42.814 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628331 2024-03-30T13:14:42.815 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628331 2024-03-30T13:14:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.008+0000 7fa60d400640 1 Processor -- start 2024-03-30T13:14:43.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.009+0000 7fa60d400640 1 -- start start 2024-03-30T13:14:43.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.010+0000 7fa60d400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa6080d18f0 0x7fa6080d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.010+0000 7fa60d400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa6080d46b0 0x7fa6080b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.010+0000 7fa60d400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6080d32b0 con 0x7fa60815c040 2024-03-30T13:14:43.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.010+0000 7fa60d400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fa6080d4b20 con 0x7fa6080d18f0 2024-03-30T13:14:43.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.010+0000 7fa60d400640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fa60815fa70 con 0x7fa6080d46b0 2024-03-30T13:14:43.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.010+0000 7fa5ffe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa6080d18f0 0x7fa6080d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.010+0000 7fa5ffe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fa6080d18f0 0x7fa6080d4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33956/0 (socket says 172.21.15.44:33956) 2024-03-30T13:14:43.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.010+0000 7fa5ffe00640 1 -- 172.21.15.44:0/3723985439 learned_addr learned my addr 172.21.15.44:0/3723985439 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.011+0000 7fa5ffe00640 1 -- 172.21.15.44:0/3723985439 >> v2:172.21.15.151:3300/0 conn(0x7fa6080d46b0 msgr2=0x7fa6080b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.011+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/3723985439 >> v2:172.21.15.151:3300/0 conn(0x7fa6080d46b0 0x7fa6080b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.011+0000 7fa5ffe00640 1 -- 172.21.15.44:0/3723985439 >> v1:172.21.15.151:6789/0 conn(0x7fa60815c040 legacy=0x7fa60815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.011+0000 7fa5ffe00640 1 -- 172.21.15.44:0/3723985439 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6080d2210 con 0x7fa6080d18f0 2024-03-30T13:14:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.012+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/3723985439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6080d18f0 0x7fa6080d4170 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009870 tx=0x7fa5f002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df5766d648ef698 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.012+0000 7fa607400640 1 -- 172.21.15.44:0/3723985439 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f002e070 con 0x7fa6080d18f0 2024-03-30T13:14:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.012+0000 7fa607400640 1 -- 172.21.15.44:0/3723985439 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f0037070 con 0x7fa6080d18f0 2024-03-30T13:14:43.017 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.012+0000 7fa607400640 1 -- 172.21.15.44:0/3723985439 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0031a00 con 0x7fa6080d18f0 2024-03-30T13:14:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.013+0000 7fa60d400640 1 -- 172.21.15.44:0/3723985439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6080d18f0 msgr2=0x7fa6080d4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.013+0000 7fa60d400640 1 --2- 172.21.15.44:0/3723985439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6080d18f0 0x7fa6080d4170 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009870 tx=0x7fa5f002b880 comp rx=0 tx=0).stop 2024-03-30T13:14:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.013+0000 7fa60d400640 1 -- 172.21.15.44:0/3723985439 shutdown_connections 2024-03-30T13:14:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.013+0000 7fa60d400640 1 --2- 172.21.15.44:0/3723985439 >> v2:172.21.15.151:3300/0 conn(0x7fa6080d46b0 0x7fa6080b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.013+0000 7fa60d400640 1 --2- 172.21.15.44:0/3723985439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6080d18f0 0x7fa6080d4170 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.013+0000 7fa60d400640 1 -- 172.21.15.44:0/3723985439 >> 172.21.15.44:0/3723985439 conn(0x7fa60808dbf0 msgr2=0x7fa60809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.013+0000 7fa60d400640 1 -- 172.21.15.44:0/3723985439 shutdown_connections 2024-03-30T13:14:43.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.013+0000 7fa60d400640 1 -- 172.21.15.44:0/3723985439 wait complete. 2024-03-30T13:14:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.016+0000 7fa60d400640 1 Processor -- start 2024-03-30T13:14:43.021 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.016+0000 7fa60d400640 1 -- start start 2024-03-30T13:14:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.018+0000 7fa60d400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080d18f0 0x7fa6080b9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.018+0000 7fa60d400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6080d46b0 0x7fa6081524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.018+0000 7fa60d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa60815c040 0x7fa6081f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.018+0000 7fa60d400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa6080d2ab0 con 0x7fa60815c040 2024-03-30T13:14:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.018+0000 7fa60d400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa6080d27d0 con 0x7fa6080d46b0 2024-03-30T13:14:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.018+0000 7fa60d400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa6080d2d90 con 0x7fa6080d18f0 2024-03-30T13:14:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.018+0000 7fa60ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa60815c040 0x7fa6081f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.018+0000 7fa60ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa60815c040 0x7fa6081f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33968/0 (socket says 172.21.15.44:33968) 2024-03-30T13:14:43.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.018+0000 7fa60ca00640 1 -- 172.21.15.44:0/4190976107 learned_addr learned my addr 172.21.15.44:0/4190976107 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.018+0000 7fa607e00640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080d18f0 0x7fa6080b9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.018+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6080d46b0 0x7fa6081524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.019+0000 7fa60ca00640 1 -- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080d18f0 msgr2=0x7fa6080b9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.019+0000 7fa60ca00640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080d18f0 0x7fa6080b9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.019+0000 7fa60ca00640 1 -- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6080d46b0 msgr2=0x7fa6081524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.019+0000 7fa60ca00640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6080d46b0 0x7fa6081524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.019+0000 7fa60ca00640 1 -- 172.21.15.44:0/4190976107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6080cc770 con 0x7fa60815c040 2024-03-30T13:14:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.019+0000 7fa60ca00640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa60815c040 0x7fa6081f4160 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa60000b970 tx=0x7fa60000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.019+0000 7fa604c00640 1 -- 172.21.15.44:0/4190976107 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600019070 con 0x7fa60815c040 2024-03-30T13:14:43.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.019+0000 7fa604c00640 1 -- 172.21.15.44:0/4190976107 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa60000cb60 con 0x7fa60815c040 2024-03-30T13:14:43.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.019+0000 7fa60d400640 1 -- 172.21.15.44:0/4190976107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6080cca50 con 0x7fa60815c040 2024-03-30T13:14:43.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.019+0000 7fa604c00640 1 -- 172.21.15.44:0/4190976107 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600014440 con 0x7fa60815c040 2024-03-30T13:14:43.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.020+0000 7fa60d400640 1 -- 172.21.15.44:0/4190976107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6080cd010 con 0x7fa60815c040 2024-03-30T13:14:43.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.022+0000 7fa604c00640 1 -- 172.21.15.44:0/4190976107 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa60001c070 con 0x7fa60815c040 2024-03-30T13:14:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.024+0000 7fa61177b740 1 Processor -- start 2024-03-30T13:14:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.024+0000 7fa604c00640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa5e406c530 0x7fa5e406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.024+0000 7fa61177b740 1 -- start start 2024-03-30T13:14:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.024+0000 7fa604c00640 1 -- 172.21.15.44:0/4190976107 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fa60008b6a0 con 0x7fa60815c040 2024-03-30T13:14:43.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.025+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa5e406c530 0x7fa5e406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.025+0000 7fa61177b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023a7470 0x55ea023cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.025+0000 7fa61177b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023ce4e0 0x55ea023a64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.025+0000 7fa61177b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7850 0x55ea023a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.025+0000 7fa61177b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ea0230a330 con 0x55ea023a7850 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.025+0000 7fa61177b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ea022b2620 con 0x55ea023ce4e0 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.025+0000 7fa61177b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55ea02306440 con 0x55ea023a7470 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.025+0000 7fa60ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7850 0x55ea023a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.026+0000 7fa60ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7850 0x55ea023a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33982/0 (socket says 172.21.15.44:33982) 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.026+0000 7fa60ca00640 1 -- 172.21.15.44:0/3651075013 learned_addr learned my addr 172.21.15.44:0/3651075013 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.026+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/3651075013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023ce4e0 0x55ea023a64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.026+0000 7fa607e00640 1 --2- 172.21.15.44:0/3651075013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023a7470 0x55ea023cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.026+0000 7fa60ca00640 1 -- 172.21.15.44:0/3651075013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023a7470 msgr2=0x55ea023cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.026+0000 7fa60ca00640 1 --2- 172.21.15.44:0/3651075013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023a7470 0x55ea023cdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.026+0000 7fa60ca00640 1 -- 172.21.15.44:0/3651075013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023ce4e0 msgr2=0x55ea023a64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.026+0000 7fa60ca00640 1 --2- 172.21.15.44:0/3651075013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023ce4e0 0x55ea023a64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.026+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa5e406c530 0x7fa5e406e9f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0036000 tx=0x7fa5f0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.026+0000 7fa60ca00640 1 -- 172.21.15.44:0/3651075013 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea020ea920 con 0x55ea023a7850 2024-03-30T13:14:43.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.026+0000 7fa60ca00640 1 --2- 172.21.15.44:0/3651075013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7850 0x55ea023a69f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa600061a20 tx=0x7fa600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeb75a40d45ae05 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.026+0000 7fa5f7e00640 1 -- 172.21.15.44:0/3651075013 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600061f50 con 0x55ea023a7850 2024-03-30T13:14:43.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.027+0000 7fa5f7e00640 1 -- 172.21.15.44:0/3651075013 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa600057670 con 0x55ea023a7850 2024-03-30T13:14:43.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.027+0000 7fa5f7e00640 1 -- 172.21.15.44:0/3651075013 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600061ac0 con 0x55ea023a7850 2024-03-30T13:14:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.027+0000 7fa61177b740 1 -- 172.21.15.44:0/3651075013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7850 msgr2=0x55ea023a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.027+0000 7fa61177b740 1 --2- 172.21.15.44:0/3651075013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7850 0x55ea023a69f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa600061a20 tx=0x7fa600004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.027+0000 7fa61177b740 1 -- 172.21.15.44:0/3651075013 shutdown_connections 2024-03-30T13:14:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.027+0000 7fa61177b740 1 --2- 172.21.15.44:0/3651075013 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7850 0x55ea023a69f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.027+0000 7fa61177b740 1 --2- 172.21.15.44:0/3651075013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023ce4e0 0x55ea023a64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.027+0000 7fa61177b740 1 --2- 172.21.15.44:0/3651075013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023a7470 0x55ea023cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.027+0000 7fa61177b740 1 -- 172.21.15.44:0/3651075013 >> 172.21.15.44:0/3651075013 conn(0x55ea0236dbe0 msgr2=0x55ea023ec190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.027+0000 7fa61177b740 1 -- 172.21.15.44:0/3651075013 shutdown_connections 2024-03-30T13:14:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.027+0000 7fa61177b740 1 -- 172.21.15.44:0/3651075013 wait complete. 2024-03-30T13:14:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.028+0000 7fa61177b740 1 -- start start 2024-03-30T13:14:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.028+0000 7fa61177b740 1 Processor -- start 2024-03-30T13:14:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.029+0000 7fa61177b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023fbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.029+0000 7fa61177b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023a7850 0x55ea023c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.029+0000 7fa61177b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023c4dc0 0x55ea023a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.029+0000 7fa61177b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ea023cdb10 con 0x55ea023a7470 2024-03-30T13:14:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.029+0000 7fa61177b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ea022c59d0 con 0x55ea023a7850 2024-03-30T13:14:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.029+0000 7fa61177b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55ea023c6890 con 0x55ea023c4dc0 2024-03-30T13:14:43.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.030+0000 7fa61177b740 10 client.0 _ll_register_callbacks cb 0x55ea02301fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.030+0000 7fa607e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023fbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.030+0000 7fa607e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023fbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:33994/0 (socket says 172.21.15.44:33994) 2024-03-30T13:14:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.030+0000 7fa607e00640 1 -- 172.21.15.44:0/573083661 learned_addr learned my addr 172.21.15.44:0/573083661 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.030+0000 7fa60ca00640 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023c4dc0 0x55ea023a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.030+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023a7850 0x55ea023c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.030+0000 7fa607e00640 1 -- 172.21.15.44:0/573083661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023c4dc0 msgr2=0x55ea023a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.030+0000 7fa607e00640 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023c4dc0 0x55ea023a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.030+0000 7fa607e00640 1 -- 172.21.15.44:0/573083661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023a7850 msgr2=0x55ea023c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.030+0000 7fa607e00640 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023a7850 0x55ea023c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.030+0000 7fa607e00640 1 -- 172.21.15.44:0/573083661 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea01fde210 con 0x55ea023a7470 2024-03-30T13:14:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.031+0000 7fa607e00640 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023fbcb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800f1d0 tx=0x7fa5f800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0d14795945d9d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.031+0000 7fa5f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.031+0000 7fa5f4c00640 1 -- 172.21.15.44:0/573083661 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80052e0 con 0x55ea023a7470 2024-03-30T13:14:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.031+0000 7fa5f4c00640 1 -- 172.21.15.44:0/573083661 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fa5f80035f0 con 0x55ea023a7470 2024-03-30T13:14:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.031+0000 7fa61177b740 1 -- 172.21.15.44:0/573083661 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa600057670 con 0x55ea023a7470 2024-03-30T13:14:43.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.031+0000 7fa5f4c00640 1 -- 172.21.15.44:0/573083661 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa5f80037f0 con 0x55ea023a7470 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.031+0000 7fa61177b740 10 client.5907 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.031+0000 7fa61177b740 1 -- 172.21.15.44:0/573083661 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55ea0214b0b0 con 0x55ea023a7470 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.032+0000 7fa5f4c00640 1 -- 172.21.15.44:0/573083661 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa600057670 con 0x55ea023a7470 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.032+0000 7fa5f4c00640 1 -- 172.21.15.44:0/573083661 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fa5f8023020 con 0x55ea023a7470 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.032+0000 7fa61177b740 10 client.5907 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.032+0000 7fa61177b740 10 client.5907 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.032+0000 7fa61177b740 20 client.5907 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.032+0000 7fa61177b740 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ea023d4ec0 0x55ea023d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.032+0000 7fa61177b740 4 client.5907 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.032+0000 7fa61177b740 1 -- 172.21.15.44:0/573083661 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea02317870 con 0x55ea023d4ec0 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.032+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ea023d4ec0 0x55ea023d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.033+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ea023d4ec0 0x55ea023d22e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c5b2d79daa1f899 server_cookie=5b8681584915e3c in_seq=0 out_seq=0 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.033+0000 7fa5f4c00640 10 client.5907 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa5f4c00640 1 -- 172.21.15.44:0/573083661 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55ea02317870 con 0x55ea023d4ec0 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa5f4c00640 10 client.5907 handle_command_reply: tid=0 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa61177b740 1 client.5907 shutdown 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa61177b740 1 -- 172.21.15.44:0/573083661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 msgr2=0x55ea023fbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa61177b740 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023fbcb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800f1d0 tx=0x7fa5f800f690 comp rx=0 tx=0).stop 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa61177b740 1 -- 172.21.15.44:0/573083661 shutdown_connections 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa61177b740 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ea023d4ec0 0x55ea023d22e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa61177b740 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023c4dc0 0x55ea023a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa61177b740 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023a7850 0x55ea023c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa61177b740 1 --2- 172.21.15.44:0/573083661 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023fbcb0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa5f4c00640 0 client.5907 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa61177b740 1 -- 172.21.15.44:0/573083661 >> 172.21.15.44:0/573083661 conn(0x55ea0236dbe0 msgr2=0x55ea023a0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.034+0000 7fa61177b740 1 -- 172.21.15.44:0/573083661 shutdown_connections 2024-03-30T13:14:43.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.035+0000 7fa61177b740 1 -- 172.21.15.44:0/573083661 wait complete. 2024-03-30T13:14:43.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.035+0000 7fa61177b740 20 client.5907 trim_cache size 0 max 16384 2024-03-30T13:14:43.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.051+0000 7fa61177b740 1 Processor -- start 2024-03-30T13:14:43.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.051+0000 7fa61177b740 1 -- start start 2024-03-30T13:14:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.051+0000 7fa61177b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.051+0000 7fa61177b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023a7850 0x55ea023e9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.051+0000 7fa61177b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023c4dc0 0x55ea023e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.051+0000 7fa61177b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa6082010d0 con 0x55ea023a7470 2024-03-30T13:14:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.051+0000 7fa61177b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa608200150 con 0x55ea023c4dc0 2024-03-30T13:14:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.051+0000 7fa61177b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa6080cbea0 con 0x55ea023a7850 2024-03-30T13:14:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.052+0000 7fa607e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.052+0000 7fa607e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023d0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34006/0 (socket says 172.21.15.44:34006) 2024-03-30T13:14:43.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.052+0000 7fa607e00640 1 -- 172.21.15.44:0/2605296926 learned_addr learned my addr 172.21.15.44:0/2605296926 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.052+0000 7fa60ca00640 1 --2- 172.21.15.44:0/2605296926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023c4dc0 0x55ea023e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.052+0000 7fa607e00640 1 -- 172.21.15.44:0/2605296926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023a7850 msgr2=0x55ea023e9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.052+0000 7fa607e00640 1 --2- 172.21.15.44:0/2605296926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023a7850 0x55ea023e9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.052+0000 7fa607e00640 1 -- 172.21.15.44:0/2605296926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023c4dc0 msgr2=0x55ea023e9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.052+0000 7fa607e00640 1 --2- 172.21.15.44:0/2605296926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023c4dc0 0x55ea023e9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.052+0000 7fa607e00640 1 -- 172.21.15.44:0/2605296926 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea01fb72d0 con 0x55ea023a7470 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.052+0000 7fa60ca00640 1 --2- 172.21.15.44:0/2605296926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023c4dc0 0x55ea023e9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.053+0000 7fa607e00640 1 --2- 172.21.15.44:0/2605296926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023d0f00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8007ce0 tx=0x7fa5f800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd31646e16aeb4c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.053+0000 7fa5f7400640 1 -- 172.21.15.44:0/2605296926 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8028070 con 0x55ea023a7470 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.053+0000 7fa5f7400640 1 -- 172.21.15.44:0/2605296926 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f8018070 con 0x55ea023a7470 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.053+0000 7fa5f7400640 1 -- 172.21.15.44:0/2605296926 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8003af0 con 0x55ea023a7470 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.053+0000 7fa61177b740 1 -- 172.21.15.44:0/2605296926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 msgr2=0x55ea023d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.053+0000 7fa61177b740 1 --2- 172.21.15.44:0/2605296926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023d0f00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8007ce0 tx=0x7fa5f800a000 comp rx=0 tx=0).stop 2024-03-30T13:14:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.054+0000 7fa61177b740 1 -- 172.21.15.44:0/2605296926 shutdown_connections 2024-03-30T13:14:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.054+0000 7fa61177b740 1 --2- 172.21.15.44:0/2605296926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023c4dc0 0x55ea023e9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.054+0000 7fa61177b740 1 --2- 172.21.15.44:0/2605296926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023a7850 0x55ea023e9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.054+0000 7fa61177b740 1 --2- 172.21.15.44:0/2605296926 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023d0f00 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.054+0000 7fa61177b740 1 -- 172.21.15.44:0/2605296926 >> 172.21.15.44:0/2605296926 conn(0x55ea0236dbe0 msgr2=0x55ea023cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.054+0000 7fa61177b740 1 -- 172.21.15.44:0/2605296926 shutdown_connections 2024-03-30T13:14:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.054+0000 7fa61177b740 1 -- 172.21.15.44:0/2605296926 wait complete. 2024-03-30T13:14:43.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.055+0000 7fa61177b740 1 -- start start 2024-03-30T13:14:43.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.055+0000 7fa61177b740 1 Processor -- start 2024-03-30T13:14:43.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa61177b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa61177b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023a7850 0x55ea023eb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa61177b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023c4dc0 0x55ea02464d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa61177b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ea023c4c40 con 0x55ea023a7470 2024-03-30T13:14:43.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa61177b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa6081ffb30 con 0x55ea023a7850 2024-03-30T13:14:43.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa61177b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55ea023d18c0 con 0x55ea023c4dc0 2024-03-30T13:14:43.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa61177b740 10 client.0 _ll_register_callbacks cb 0x7fa5f8007e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:43.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa607e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa607e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023cbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34008/0 (socket says 172.21.15.44:34008) 2024-03-30T13:14:43.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa607e00640 1 -- 172.21.15.44:0/1873252348 learned_addr learned my addr 172.21.15.44:0/1873252348 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa607e00640 1 -- 172.21.15.44:0/1873252348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023c4dc0 msgr2=0x55ea02464d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa607e00640 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023c4dc0 0x55ea02464d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa607e00640 1 -- 172.21.15.44:0/1873252348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023a7850 msgr2=0x55ea023eb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023a7850 0x55ea023eb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa607e00640 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023a7850 0x55ea023eb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.057+0000 7fa607e00640 1 -- 172.21.15.44:0/1873252348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea023d1e70 con 0x55ea023a7470 2024-03-30T13:14:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.058+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023a7850 0x55ea023eb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.058+0000 7fa607e00640 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023cbfc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8000ea0 tx=0x7fa5f8001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3dc288986ab0e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.058+0000 7fa5f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.058+0000 7fa5f4c00640 1 -- 172.21.15.44:0/1873252348 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8028040 con 0x55ea023a7470 2024-03-30T13:14:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.058+0000 7fa5f4c00640 1 -- 172.21.15.44:0/1873252348 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fa5f8003990 con 0x55ea023a7470 2024-03-30T13:14:43.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.058+0000 7fa61177b740 1 -- 172.21.15.44:0/1873252348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5f8018070 con 0x55ea023a7470 2024-03-30T13:14:43.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.058+0000 7fa5f4c00640 1 -- 172.21.15.44:0/1873252348 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa5f803c050 con 0x55ea023a7470 2024-03-30T13:14:43.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.058+0000 7fa61177b740 10 client.5913 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.059+0000 7fa61177b740 1 -- 172.21.15.44:0/1873252348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55ea0240fe00 con 0x55ea023a7470 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.059+0000 7fa5f4c00640 1 -- 172.21.15.44:0/1873252348 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f8018070 con 0x55ea023a7470 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.059+0000 7fa5f4c00640 1 -- 172.21.15.44:0/1873252348 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fa5f803f020 con 0x55ea023a7470 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.059+0000 7fa61177b740 10 client.5913 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.059+0000 7fa61177b740 10 client.5913 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.059+0000 7fa61177b740 20 client.5913 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.059+0000 7fa61177b740 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ea024652d0 0x55ea0240e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.059+0000 7fa61177b740 4 client.5913 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628331}] 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.059+0000 7fa61177b740 1 -- 172.21.15.44:0/1873252348 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628331}) -- 0x55ea02311bc0 con 0x55ea024652d0 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.059+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ea024652d0 0x55ea0240e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa5ffe00640 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ea024652d0 0x55ea0240e5e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d545c744db275433 server_cookie=6b4b8611a9716bdc in_seq=0 out_seq=0 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa5f4c00640 10 client.5913 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa5f4c00640 1 -- 172.21.15.44:0/1873252348 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3970 (crc 0 0 0) 0x55ea02311bc0 con 0x55ea024652d0 2024-03-30T13:14:43.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa5f4c00640 10 client.5913 handle_command_reply: tid=0 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa61177b740 1 client.5913 shutdown 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa61177b740 1 -- 172.21.15.44:0/1873252348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 msgr2=0x55ea023cbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa61177b740 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023cbfc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8000ea0 tx=0x7fa5f8001020 comp rx=0 tx=0).stop 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa61177b740 1 -- 172.21.15.44:0/1873252348 shutdown_connections 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa61177b740 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ea024652d0 0x55ea0240e5e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa61177b740 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ea023c4dc0 0x55ea02464d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa61177b740 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea023a7850 0x55ea023eb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa61177b740 1 --2- 172.21.15.44:0/1873252348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ea023a7470 0x55ea023cbfc0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa5f4c00640 0 client.5913 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.060+0000 7fa61177b740 1 -- 172.21.15.44:0/1873252348 >> 172.21.15.44:0/1873252348 conn(0x55ea0236dbe0 msgr2=0x55ea023cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.061+0000 7fa61177b740 1 -- 172.21.15.44:0/1873252348 shutdown_connections 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.061+0000 7fa61177b740 1 -- 172.21.15.44:0/1873252348 wait complete. 2024-03-30T13:14:43.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.061+0000 7fa61177b740 20 client.5913 trim_cache size 0 max 16384 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/dcache.c", 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628331, 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.300958+0000", 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.398256+0000", 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:43.069 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 3670, 2024-03-30T13:14:43.070 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.398256+0000", 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 4, 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:43.071 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 3670, 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.300958+0000" 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:43.072 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 3670, 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.300958+0000" 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 210, 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 8, 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:43.073 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:06.340314+0000", 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 64, 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:43.074 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:43.075 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:43.076 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.077 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:43.078 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:43.079 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:43.080 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:43.081 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:43.081 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:43.081 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:43.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.061+0000 7fa60d400640 1 -- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa5e406c530 msgr2=0x7fa5e406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.061+0000 7fa60d400640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa5e406c530 0x7fa5e406e9f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0036000 tx=0x7fa5f0008030 comp rx=0 tx=0).stop 2024-03-30T13:14:43.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.061+0000 7fa60d400640 1 -- 172.21.15.44:0/4190976107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa60815c040 msgr2=0x7fa6081f4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.061+0000 7fa60d400640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa60815c040 0x7fa6081f4160 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa60000b970 tx=0x7fa60000be30 comp rx=0 tx=0).stop 2024-03-30T13:14:43.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.062+0000 7fa60d400640 1 -- 172.21.15.44:0/4190976107 shutdown_connections 2024-03-30T13:14:43.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.062+0000 7fa60d400640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa60815c040 0x7fa6081f4160 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.062+0000 7fa60d400640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa5e406c530 0x7fa5e406e9f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.062+0000 7fa60d400640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6080d46b0 0x7fa6081524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.062+0000 7fa60d400640 1 --2- 172.21.15.44:0/4190976107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080d18f0 0x7fa6080b9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.062+0000 7fa60d400640 1 -- 172.21.15.44:0/4190976107 >> 172.21.15.44:0/4190976107 conn(0x7fa60808dbf0 msgr2=0x7fa60806c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.062+0000 7fa60d400640 1 -- 172.21.15.44:0/4190976107 shutdown_connections 2024-03-30T13:14:43.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.062+0000 7fa60d400640 1 -- 172.21.15.44:0/4190976107 wait complete. 2024-03-30T13:14:43.086 DEBUG:tasks.cephfs.test_uninlining:getting inode info #18 of 23:1099511628339 2024-03-30T13:14:43.086 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628339 2024-03-30T13:14:43.086 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628339 2024-03-30T13:14:43.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.299+0000 7f04b3e00640 1 Processor -- start 2024-03-30T13:14:43.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.300+0000 7f04b3e00640 1 -- start start 2024-03-30T13:14:43.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.301+0000 7f04b3e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f04ac15c000 0x7f04ac0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.301+0000 7f04b3e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04ac0b9cf0 0x7f04ac0d4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.301+0000 7f04b3e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04ac0ba150 0x7f04ac0d48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.301+0000 7f04b3e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f04ac0b3c30 con 0x7f04ac0ba150 2024-03-30T13:14:43.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.301+0000 7f04b3e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f04ac162110 con 0x7f04ac15c000 2024-03-30T13:14:43.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.301+0000 7f04b3e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac1623d0 con 0x7f04ac0b9cf0 2024-03-30T13:14:43.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.302+0000 7f04b1e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04ac0ba150 0x7f04ac0d48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.302+0000 7f04b1e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f04ac0ba150 0x7f04ac0d48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34014/0 (socket says 172.21.15.44:34014) 2024-03-30T13:14:43.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.302+0000 7f04b1e00640 1 -- 172.21.15.44:0/3748425898 learned_addr learned my addr 172.21.15.44:0/3748425898 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.302+0000 7f04b1400640 1 --2- 172.21.15.44:0/3748425898 >> v2:172.21.15.151:3300/0 conn(0x7f04ac15c000 0x7f04ac0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.302+0000 7f04b0a00640 1 --2- 172.21.15.44:0/3748425898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04ac0b9cf0 0x7f04ac0d4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.302+0000 7f04b1e00640 1 -- 172.21.15.44:0/3748425898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04ac0b9cf0 msgr2=0x7f04ac0d4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.302+0000 7f04b1e00640 1 --2- 172.21.15.44:0/3748425898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04ac0b9cf0 0x7f04ac0d4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.302+0000 7f04b1e00640 1 -- 172.21.15.44:0/3748425898 >> v2:172.21.15.151:3300/0 conn(0x7f04ac15c000 msgr2=0x7f04ac0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.302+0000 7f04b1e00640 1 --2- 172.21.15.44:0/3748425898 >> v2:172.21.15.151:3300/0 conn(0x7f04ac15c000 0x7f04ac0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.302+0000 7f04b1e00640 1 -- 172.21.15.44:0/3748425898 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac1626b0 con 0x7f04ac0ba150 2024-03-30T13:14:43.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.302+0000 7f04b1400640 1 --2- 172.21.15.44:0/3748425898 >> v2:172.21.15.151:3300/0 conn(0x7f04ac15c000 0x7f04ac0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:43.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.303+0000 7f04b1e00640 1 --2- 172.21.15.44:0/3748425898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0ba150 0x7f04ac0d48a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0d1b90 tx=0x7f04a402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee31c05a4fd8d12 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.304+0000 7f04abe00640 1 -- 172.21.15.44:0/3748425898 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a402c9e0 con 0x7f04ac0ba150 2024-03-30T13:14:43.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.304+0000 7f04abe00640 1 -- 172.21.15.44:0/3748425898 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a402cb80 con 0x7f04ac0ba150 2024-03-30T13:14:43.309 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.304+0000 7f04abe00640 1 -- 172.21.15.44:0/3748425898 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a40343f0 con 0x7f04ac0ba150 2024-03-30T13:14:43.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.304+0000 7f04b3e00640 1 -- 172.21.15.44:0/3748425898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0ba150 msgr2=0x7f04ac0d48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.304+0000 7f04b3e00640 1 --2- 172.21.15.44:0/3748425898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0ba150 0x7f04ac0d48a0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0d1b90 tx=0x7f04a402be40 comp rx=0 tx=0).stop 2024-03-30T13:14:43.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.304+0000 7f04b3e00640 1 -- 172.21.15.44:0/3748425898 shutdown_connections 2024-03-30T13:14:43.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.304+0000 7f04b3e00640 1 --2- 172.21.15.44:0/3748425898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac0ba150 0x7f04ac0d48a0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.304+0000 7f04b3e00640 1 --2- 172.21.15.44:0/3748425898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04ac0b9cf0 0x7f04ac0d4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.304+0000 7f04b3e00640 1 --2- 172.21.15.44:0/3748425898 >> v2:172.21.15.151:3300/0 conn(0x7f04ac15c000 0x7f04ac0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.304+0000 7f04b3e00640 1 -- 172.21.15.44:0/3748425898 >> 172.21.15.44:0/3748425898 conn(0x7f04ac0676e0 msgr2=0x7f04ac067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.305+0000 7f04b3e00640 1 -- 172.21.15.44:0/3748425898 shutdown_connections 2024-03-30T13:14:43.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.305+0000 7f04b3e00640 1 -- 172.21.15.44:0/3748425898 wait complete. 2024-03-30T13:14:43.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.307+0000 7f04b3e00640 1 Processor -- start 2024-03-30T13:14:43.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.307+0000 7f04b3e00640 1 -- start start 2024-03-30T13:14:43.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.308+0000 7f04b3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ac0b9cf0 0x7f04ac0b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.308+0000 7f04b3e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04ac0ba150 0x7f04ac15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.308+0000 7f04b3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac15c000 0x7f04ac154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.308+0000 7f04b3e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac15c3e0 con 0x7f04ac15c000 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.308+0000 7f04b3e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac162c70 con 0x7f04ac0b9cf0 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.308+0000 7f04b3e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac15c560 con 0x7f04ac0ba150 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.309+0000 7f04b1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac15c000 0x7f04ac154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.309+0000 7f04b1e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac15c000 0x7f04ac154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34020/0 (socket says 172.21.15.44:34020) 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.309+0000 7f04b1e00640 1 -- 172.21.15.44:0/248422609 learned_addr learned my addr 172.21.15.44:0/248422609 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.309+0000 7f04b1400640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ac0b9cf0 0x7f04ac0b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.309+0000 7f04b0a00640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04ac0ba150 0x7f04ac15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.309+0000 7f04b1e00640 1 -- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04ac0ba150 msgr2=0x7f04ac15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.309+0000 7f04b1e00640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04ac0ba150 0x7f04ac15a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.309+0000 7f04b1e00640 1 -- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ac0b9cf0 msgr2=0x7f04ac0b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.309+0000 7f04b1e00640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ac0b9cf0 0x7f04ac0b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.309+0000 7f04b1e00640 1 -- 172.21.15.44:0/248422609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac0b4d70 con 0x7f04ac15c000 2024-03-30T13:14:43.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.309+0000 7f04b0a00640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04ac0ba150 0x7f04ac15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:43.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.310+0000 7f04b1e00640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac15c000 0x7f04ac154550 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009f40 tx=0x7f04a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.310+0000 7f04a9600640 1 -- 172.21.15.44:0/248422609 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4043020 con 0x7f04ac15c000 2024-03-30T13:14:43.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.310+0000 7f04a9600640 1 -- 172.21.15.44:0/248422609 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a403e450 con 0x7f04ac15c000 2024-03-30T13:14:43.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.310+0000 7f04a9600640 1 -- 172.21.15.44:0/248422609 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4009510 con 0x7f04ac15c000 2024-03-30T13:14:43.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.310+0000 7f04b3e00640 1 -- 172.21.15.44:0/248422609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04ac0b5050 con 0x7f04ac15c000 2024-03-30T13:14:43.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.310+0000 7f04b3e00640 1 -- 172.21.15.44:0/248422609 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04ac0b49d0 con 0x7f04ac15c000 2024-03-30T13:14:43.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.312+0000 7f04a9600640 1 -- 172.21.15.44:0/248422609 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f04a4046020 con 0x7f04ac15c000 2024-03-30T13:14:43.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.314+0000 7f04a9600640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f048c06c530 0x7f048c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.314+0000 7f04a9600640 1 -- 172.21.15.44:0/248422609 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f04a40adf50 con 0x7f04ac15c000 2024-03-30T13:14:43.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.314+0000 7f04b6b81740 1 Processor -- start 2024-03-30T13:14:43.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.314+0000 7f04b1400640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f048c06c530 0x7f048c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.314+0000 7f04b6b81740 1 -- start start 2024-03-30T13:14:43.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.315+0000 7f04b6b81740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4dedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.315+0000 7f04b6b81740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4df300 0x563ffc4b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.315+0000 7f04b6b81740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4b8670 0x563ffc4b7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b6b81740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563ffc41b330 con 0x563ffc4b8290 2024-03-30T13:14:43.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b6b81740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563ffc3c3620 con 0x563ffc4b8670 2024-03-30T13:14:43.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b6b81740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x563ffc417440 con 0x563ffc4df300 2024-03-30T13:14:43.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b1400640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f048c06c530 0x7f048c06e9f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f04a000a990 tx=0x7f04a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4dedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4dedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34036/0 (socket says 172.21.15.44:34036) 2024-03-30T13:14:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b1400640 1 -- 172.21.15.44:0/4037274485 learned_addr learned my addr 172.21.15.44:0/4037274485 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b1e00640 1 --2- 172.21.15.44:0/4037274485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4b8670 0x563ffc4b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b0a00640 1 --2- 172.21.15.44:0/4037274485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4df300 0x563ffc4b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b1400640 1 -- 172.21.15.44:0/4037274485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4df300 msgr2=0x563ffc4b72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b1400640 1 --2- 172.21.15.44:0/4037274485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4df300 0x563ffc4b72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b1400640 1 -- 172.21.15.44:0/4037274485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4b8670 msgr2=0x563ffc4b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b1400640 1 --2- 172.21.15.44:0/4037274485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4b8670 0x563ffc4b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.316+0000 7f04b1400640 1 -- 172.21.15.44:0/4037274485 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ffc1fb920 con 0x563ffc4b8290 2024-03-30T13:14:43.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.317+0000 7f04b1400640 1 --2- 172.21.15.44:0/4037274485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4dedc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f04a000fa80 tx=0x7f04a0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f177d9e32127ee70 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.317+0000 7f049dc00640 1 -- 172.21.15.44:0/4037274485 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a001b050 con 0x563ffc4b8290 2024-03-30T13:14:43.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.317+0000 7f049dc00640 1 -- 172.21.15.44:0/4037274485 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a0025070 con 0x563ffc4b8290 2024-03-30T13:14:43.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.317+0000 7f049dc00640 1 -- 172.21.15.44:0/4037274485 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0014e20 con 0x563ffc4b8290 2024-03-30T13:14:43.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.318+0000 7f04b6b81740 1 -- 172.21.15.44:0/4037274485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 msgr2=0x563ffc4dedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.318+0000 7f04b6b81740 1 --2- 172.21.15.44:0/4037274485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4dedc0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f04a000fa80 tx=0x7f04a0012000 comp rx=0 tx=0).stop 2024-03-30T13:14:43.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.318+0000 7f04b6b81740 1 -- 172.21.15.44:0/4037274485 shutdown_connections 2024-03-30T13:14:43.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.318+0000 7f04b6b81740 1 --2- 172.21.15.44:0/4037274485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4b8670 0x563ffc4b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.318+0000 7f04b6b81740 1 --2- 172.21.15.44:0/4037274485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4df300 0x563ffc4b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.318+0000 7f04b6b81740 1 --2- 172.21.15.44:0/4037274485 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4dedc0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.318+0000 7f04b6b81740 1 -- 172.21.15.44:0/4037274485 >> 172.21.15.44:0/4037274485 conn(0x563ffc47ebe0 msgr2=0x563ffc4fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.318+0000 7f04b6b81740 1 -- 172.21.15.44:0/4037274485 shutdown_connections 2024-03-30T13:14:43.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.318+0000 7f04b6b81740 1 -- 172.21.15.44:0/4037274485 wait complete. 2024-03-30T13:14:43.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.319+0000 7f04b6b81740 1 -- start start 2024-03-30T13:14:43.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.319+0000 7f04b6b81740 1 Processor -- start 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b6b81740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4e6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b6b81740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4b8670 0x563ffc4e4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b6b81740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4cb8b0 0x563ffc4ffb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b6b81740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563ffc4de930 con 0x563ffc4b8290 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b6b81740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563ffc3d69d0 con 0x563ffc4cb8b0 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b6b81740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x563ffc4d76b0 con 0x563ffc4b8670 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b6b81740 10 client.0 _ll_register_callbacks cb 0x563ffc412fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4e6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4e6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34048/0 (socket says 172.21.15.44:34048) 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b1400640 1 -- 172.21.15.44:0/2550455973 learned_addr learned my addr 172.21.15.44:0/2550455973 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b0a00640 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4b8670 0x563ffc4e4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b1400640 1 -- 172.21.15.44:0/2550455973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4b8670 msgr2=0x563ffc4e4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b1e00640 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4cb8b0 0x563ffc4ffb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b1400640 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4b8670 0x563ffc4e4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b1400640 1 -- 172.21.15.44:0/2550455973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4cb8b0 msgr2=0x563ffc4ffb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b1400640 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4cb8b0 0x563ffc4ffb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.321+0000 7f04b1400640 1 -- 172.21.15.44:0/2550455973 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ffc0ef210 con 0x563ffc4b8290 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.322+0000 7f04b1400640 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4e6100 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f04a000fa80 tx=0x7f04a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338460a5a1b9587b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.322+0000 7f0492000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.322+0000 7f0492000640 1 -- 172.21.15.44:0/2550455973 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0037060 con 0x563ffc4b8290 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.322+0000 7f0492000640 1 -- 172.21.15.44:0/2550455973 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f04a0020a80 con 0x563ffc4b8290 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.322+0000 7f04b6b81740 1 -- 172.21.15.44:0/2550455973 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04a0025070 con 0x563ffc4b8290 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.322+0000 7f0492000640 1 -- 172.21.15.44:0/2550455973 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f04a001b030 con 0x563ffc4b8290 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.322+0000 7f04b6b81740 10 client.5925 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.322+0000 7f04b6b81740 1 -- 172.21.15.44:0/2550455973 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x563ffc25c0b0 con 0x563ffc4b8290 2024-03-30T13:14:43.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.323+0000 7f0492000640 1 -- 172.21.15.44:0/2550455973 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a0025070 con 0x563ffc4b8290 2024-03-30T13:14:43.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.323+0000 7f0492000640 1 -- 172.21.15.44:0/2550455973 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f04a0020c80 con 0x563ffc4b8290 2024-03-30T13:14:43.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.323+0000 7f04b6b81740 10 client.5925 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:43.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.323+0000 7f04b6b81740 10 client.5925 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:43.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.323+0000 7f04b6b81740 20 client.5925 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:43.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.323+0000 7f04b6b81740 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563ffc50cd70 0x563ffc50d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.323+0000 7f04b6b81740 4 client.5925 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:43.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.323+0000 7f04b6b81740 1 -- 172.21.15.44:0/2550455973 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ffc428870 con 0x563ffc50cd70 2024-03-30T13:14:43.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.323+0000 7f04b0a00640 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563ffc50cd70 0x563ffc50d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.324+0000 7f04b0a00640 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563ffc50cd70 0x563ffc50d170 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=239deb401b086855 server_cookie=1a78b25fea2b0c8e in_seq=0 out_seq=0 2024-03-30T13:14:43.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.324+0000 7f0492000640 10 client.5925 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.325+0000 7f0492000640 1 -- 172.21.15.44:0/2550455973 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x563ffc428870 con 0x563ffc50cd70 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.325+0000 7f0492000640 10 client.5925 handle_command_reply: tid=0 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.325+0000 7f04b6b81740 1 client.5925 shutdown 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.325+0000 7f04b6b81740 1 -- 172.21.15.44:0/2550455973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 msgr2=0x563ffc4e6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.325+0000 7f04b6b81740 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4e6100 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f04a000fa80 tx=0x7f04a0004730 comp rx=0 tx=0).stop 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.325+0000 7f04b6b81740 1 -- 172.21.15.44:0/2550455973 shutdown_connections 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.325+0000 7f04b6b81740 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563ffc50cd70 0x563ffc50d170 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.325+0000 7f04b6b81740 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4cb8b0 0x563ffc4ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.325+0000 7f04b6b81740 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4b8670 0x563ffc4e4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.325+0000 7f04b6b81740 1 --2- 172.21.15.44:0/2550455973 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4e6100 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.325+0000 7f04b6b81740 1 -- 172.21.15.44:0/2550455973 >> 172.21.15.44:0/2550455973 conn(0x563ffc47ebe0 msgr2=0x563ffc4de160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.325+0000 7f0492000640 0 client.5925 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.326+0000 7f04b6b81740 1 -- 172.21.15.44:0/2550455973 shutdown_connections 2024-03-30T13:14:43.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.326+0000 7f04b6b81740 1 -- 172.21.15.44:0/2550455973 wait complete. 2024-03-30T13:14:43.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.326+0000 7f04b6b81740 20 client.5925 trim_cache size 0 max 16384 2024-03-30T13:14:43.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.342+0000 7f04b6b81740 1 Processor -- start 2024-03-30T13:14:43.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.342+0000 7f04b6b81740 1 -- start start 2024-03-30T13:14:43.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.343+0000 7f04b6b81740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.343+0000 7f04b6b81740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4b8670 0x563ffc4ddde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.343+0000 7f04b6b81740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4cb8b0 0x563ffc4dc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.343+0000 7f04b6b81740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac201240 con 0x563ffc4b8290 2024-03-30T13:14:43.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.343+0000 7f04b6b81740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac200220 con 0x563ffc4cb8b0 2024-03-30T13:14:43.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.343+0000 7f04b6b81740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac0ca670 con 0x563ffc4b8670 2024-03-30T13:14:43.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.343+0000 7f04b1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.343+0000 7f04b1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34050/0 (socket says 172.21.15.44:34050) 2024-03-30T13:14:43.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.343+0000 7f04b1400640 1 -- 172.21.15.44:0/3675850603 learned_addr learned my addr 172.21.15.44:0/3675850603 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.344+0000 7f04b1e00640 1 --2- 172.21.15.44:0/3675850603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4cb8b0 0x563ffc4dc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.344+0000 7f04b1400640 1 -- 172.21.15.44:0/3675850603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4b8670 msgr2=0x563ffc4ddde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.344+0000 7f04b0a00640 1 --2- 172.21.15.44:0/3675850603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4b8670 0x563ffc4ddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.344+0000 7f04b1400640 1 --2- 172.21.15.44:0/3675850603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4b8670 0x563ffc4ddde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.344+0000 7f04b1400640 1 -- 172.21.15.44:0/3675850603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4cb8b0 msgr2=0x563ffc4dc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.344+0000 7f04b1400640 1 --2- 172.21.15.44:0/3675850603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4cb8b0 0x563ffc4dc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.344+0000 7f04b1400640 1 -- 172.21.15.44:0/3675850603 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ffc0c82d0 con 0x563ffc4b8290 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.344+0000 7f04b1400640 1 --2- 172.21.15.44:0/3675850603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4b1a20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f04a0006e00 tx=0x7f04a002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba75f77043edec9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.344+0000 7f049d200640 1 -- 172.21.15.44:0/3675850603 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0005c30 con 0x563ffc4b8290 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.344+0000 7f049d200640 1 -- 172.21.15.44:0/3675850603 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a0025050 con 0x563ffc4b8290 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.344+0000 7f049d200640 1 -- 172.21.15.44:0/3675850603 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0020c80 con 0x563ffc4b8290 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.345+0000 7f04b6b81740 1 -- 172.21.15.44:0/3675850603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 msgr2=0x563ffc4b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.345+0000 7f04b6b81740 1 --2- 172.21.15.44:0/3675850603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4b1a20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f04a0006e00 tx=0x7f04a002c040 comp rx=0 tx=0).stop 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.345+0000 7f04b6b81740 1 -- 172.21.15.44:0/3675850603 shutdown_connections 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.345+0000 7f04b6b81740 1 --2- 172.21.15.44:0/3675850603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4cb8b0 0x563ffc4dc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.345+0000 7f04b6b81740 1 --2- 172.21.15.44:0/3675850603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4b8670 0x563ffc4ddde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.345+0000 7f04b6b81740 1 --2- 172.21.15.44:0/3675850603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4b1a20 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.345+0000 7f04b6b81740 1 -- 172.21.15.44:0/3675850603 >> 172.21.15.44:0/3675850603 conn(0x563ffc47ebe0 msgr2=0x563ffc4d8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.345+0000 7f04b6b81740 1 -- 172.21.15.44:0/3675850603 shutdown_connections 2024-03-30T13:14:43.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.345+0000 7f04b6b81740 1 -- 172.21.15.44:0/3675850603 wait complete. 2024-03-30T13:14:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.346+0000 7f04b6b81740 1 -- start start 2024-03-30T13:14:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.346+0000 7f04b6b81740 1 Processor -- start 2024-03-30T13:14:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.347+0000 7f04b6b81740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4dc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.347+0000 7f04b6b81740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4b8670 0x563ffc4dc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.347+0000 7f04b6b81740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4cb8b0 0x563ffc4b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.347+0000 7f04b6b81740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563ffc50d390 con 0x563ffc4b8290 2024-03-30T13:14:43.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.347+0000 7f04b6b81740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac1ffca0 con 0x563ffc4b8670 2024-03-30T13:14:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.347+0000 7f04b6b81740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x563ffc520c50 con 0x563ffc4cb8b0 2024-03-30T13:14:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.347+0000 7f04b6b81740 10 client.0 _ll_register_callbacks cb 0x7f04a000f950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.347+0000 7f04b1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4dc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.347+0000 7f04b1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4dc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34064/0 (socket says 172.21.15.44:34064) 2024-03-30T13:14:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.347+0000 7f04b1400640 1 -- 172.21.15.44:0/2524967453 learned_addr learned my addr 172.21.15.44:0/2524967453 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.348+0000 7f04b1400640 1 -- 172.21.15.44:0/2524967453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4cb8b0 msgr2=0x563ffc4b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.348+0000 7f04b1400640 1 --2- 172.21.15.44:0/2524967453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4cb8b0 0x563ffc4b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.348+0000 7f04b1400640 1 -- 172.21.15.44:0/2524967453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4b8670 msgr2=0x563ffc4dc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.348+0000 7f04b1400640 1 --2- 172.21.15.44:0/2524967453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4b8670 0x563ffc4dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.348+0000 7f04b1400640 1 -- 172.21.15.44:0/2524967453 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ffc4e3be0 con 0x563ffc4b8290 2024-03-30T13:14:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.348+0000 7f04b1400640 1 --2- 172.21.15.44:0/2524967453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4dc220 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f04a0008010 tx=0x7f04a0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca038576327ce0e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.348+0000 7f0492000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:43.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.349+0000 7f0492000640 1 -- 172.21.15.44:0/2524967453 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a0020500 con 0x563ffc4b8290 2024-03-30T13:14:43.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.349+0000 7f0492000640 1 -- 172.21.15.44:0/2524967453 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f04a0005a30 con 0x563ffc4b8290 2024-03-30T13:14:43.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.349+0000 7f04b6b81740 1 -- 172.21.15.44:0/2524967453 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04a0025050 con 0x563ffc4b8290 2024-03-30T13:14:43.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.349+0000 7f0492000640 1 -- 172.21.15.44:0/2524967453 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f04a0051050 con 0x563ffc4b8290 2024-03-30T13:14:43.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.349+0000 7f04b6b81740 10 client.5931 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:43.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.349+0000 7f04b6b81740 1 -- 172.21.15.44:0/2524967453 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x563ffc5007c0 con 0x563ffc4b8290 2024-03-30T13:14:43.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.349+0000 7f0492000640 1 -- 172.21.15.44:0/2524967453 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a0025050 con 0x563ffc4b8290 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.349+0000 7f0492000640 1 -- 172.21.15.44:0/2524967453 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f04a0054020 con 0x563ffc4b8290 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.349+0000 7f04b6b81740 10 client.5931 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.349+0000 7f04b6b81740 10 client.5931 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.349+0000 7f04b6b81740 20 client.5931 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.349+0000 7f04b6b81740 1 --2- 172.21.15.44:0/2524967453 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563ffc4b68f0 0x563ffc4b7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.350+0000 7f04b6b81740 4 client.5931 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628339}] 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.350+0000 7f04b6b81740 1 -- 172.21.15.44:0/2524967453 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628339}) -- 0x563ffc422bc0 con 0x563ffc4b68f0 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.350+0000 7f04b0a00640 1 --2- 172.21.15.44:0/2524967453 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563ffc4b68f0 0x563ffc4b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.350+0000 7f04b0a00640 1 --2- 172.21.15.44:0/2524967453 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563ffc4b68f0 0x563ffc4b7400 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=314ca26777429e49 server_cookie=cf240bdc5280a834 in_seq=0 out_seq=0 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.350+0000 7f0492000640 10 client.5931 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f0492000640 1 -- 172.21.15.44:0/2524967453 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3977 (crc 0 0 0) 0x563ffc422bc0 con 0x563ffc4b68f0 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f0492000640 10 client.5931 handle_command_reply: tid=0 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f04b6b81740 1 client.5931 shutdown 2024-03-30T13:14:43.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f04b6b81740 1 -- 172.21.15.44:0/2524967453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 msgr2=0x563ffc4dc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f04b6b81740 1 --2- 172.21.15.44:0/2524967453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4dc220 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f04a0008010 tx=0x7f04a0015000 comp rx=0 tx=0).stop 2024-03-30T13:14:43.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f04b6b81740 1 -- 172.21.15.44:0/2524967453 shutdown_connections 2024-03-30T13:14:43.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f04b6b81740 1 --2- 172.21.15.44:0/2524967453 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563ffc4b68f0 0x563ffc4b7400 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f04b6b81740 1 --2- 172.21.15.44:0/2524967453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563ffc4cb8b0 0x563ffc4b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f04b6b81740 1 --2- 172.21.15.44:0/2524967453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ffc4b8670 0x563ffc4dc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f0492000640 0 client.5931 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f04b6b81740 1 --2- 172.21.15.44:0/2524967453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563ffc4b8290 0x563ffc4dc220 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f04b6b81740 1 -- 172.21.15.44:0/2524967453 >> 172.21.15.44:0/2524967453 conn(0x563ffc47ebe0 msgr2=0x563ffc4ca280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f04b6b81740 1 -- 172.21.15.44:0/2524967453 shutdown_connections 2024-03-30T13:14:43.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f04b6b81740 1 -- 172.21.15.44:0/2524967453 wait complete. 2024-03-30T13:14:43.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.351+0000 7f04b6b81740 20 client.5931 trim_cache size 0 max 16384 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-bufmap.h", 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628339, 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.304380+0000", 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.412256+0000", 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:43.360 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 925, 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:43.361 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.412256+0000", 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:43.362 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 925, 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.304380+0000" 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:43.363 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 925, 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.304380+0000" 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 190, 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 24, 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:43.364 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:06.341703+0000", 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 66, 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.365 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.366 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:43.368 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:43.369 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.370 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:43.371 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.352+0000 7f04b3e00640 1 -- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f048c06c530 msgr2=0x7f048c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.352+0000 7f04b3e00640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f048c06c530 0x7f048c06e9f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f04a000a990 tx=0x7f04a0008040 comp rx=0 tx=0).stop 2024-03-30T13:14:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.352+0000 7f04b3e00640 1 -- 172.21.15.44:0/248422609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac15c000 msgr2=0x7f04ac154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.352+0000 7f04b3e00640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac15c000 0x7f04ac154550 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009f40 tx=0x7f04a4004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:43.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.352+0000 7f04b3e00640 1 -- 172.21.15.44:0/248422609 shutdown_connections 2024-03-30T13:14:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.352+0000 7f04b3e00640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04ac15c000 0x7f04ac154550 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.352+0000 7f04b3e00640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04ac0ba150 0x7f04ac15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.352+0000 7f04b3e00640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f048c06c530 0x7f048c06e9f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.352+0000 7f04b3e00640 1 --2- 172.21.15.44:0/248422609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ac0b9cf0 0x7f04ac0b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.352+0000 7f04b3e00640 1 -- 172.21.15.44:0/248422609 >> 172.21.15.44:0/248422609 conn(0x7f04ac0676e0 msgr2=0x7f04ac067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.352+0000 7f04b3e00640 1 -- 172.21.15.44:0/248422609 shutdown_connections 2024-03-30T13:14:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.352+0000 7f04b3e00640 1 -- 172.21.15.44:0/248422609 wait complete. 2024-03-30T13:14:43.379 DEBUG:tasks.cephfs.test_uninlining:getting inode info #19 of 23:1099511628343 2024-03-30T13:14:43.379 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628343 2024-03-30T13:14:43.379 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628343 2024-03-30T13:14:43.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.592+0000 7f7a64e00640 1 Processor -- start 2024-03-30T13:14:43.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.592+0000 7f7a64e00640 1 -- start start 2024-03-30T13:14:43.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.595+0000 7f7a64e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7a60158a20 0x7f7a6006b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.595+0000 7f7a64e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a60158e00 0x7f7a6006bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.595+0000 7f7a64e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a60072570 con 0x7f7a600b0030 2024-03-30T13:14:43.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.595+0000 7f7a64e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f7a60072850 con 0x7f7a60158a20 2024-03-30T13:14:43.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.595+0000 7f7a64e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7a60072b30 con 0x7f7a60158e00 2024-03-30T13:14:43.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.596+0000 7f7a5e800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f7a600b0030 0x7f7a600b04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36866/0 (socket says 172.21.15.44:36866) 2024-03-30T13:14:43.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.596+0000 7f7a5e800640 1 -- 172.21.15.44:0/186110925 learned_addr learned my addr 172.21.15.44:0/186110925 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:43.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.596+0000 7f7a5de00640 1 --2- 172.21.15.44:0/186110925 >> v2:172.21.15.151:3300/0 conn(0x7f7a60158a20 0x7f7a6006b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.596+0000 7f7a5d400640 1 --2- 172.21.15.44:0/186110925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a60158e00 0x7f7a6006bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.596+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 46850807 0 0) 0x7f7a60072570 con 0x7f7a600b0030 2024-03-30T13:14:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.596+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a40003520 con 0x7f7a600b0030 2024-03-30T13:14:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2498167091 0 0) 0x7f7a40003520 con 0x7f7a600b0030 2024-03-30T13:14:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a60158e00 msgr2=0x7f7a6006bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 --2- 172.21.15.44:0/186110925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a60158e00 0x7f7a6006bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 >> v2:172.21.15.151:3300/0 conn(0x7f7a60158a20 msgr2=0x7f7a6006b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 --2- 172.21.15.44:0/186110925 >> v2:172.21.15.151:3300/0 conn(0x7f7a60158a20 0x7f7a6006b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a60072e10 con 0x7f7a600b0030 2024-03-30T13:14:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f7a58001670 con 0x7f7a600b0030 2024-03-30T13:14:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 >> v1:172.21.15.44:6789/0 conn(0x7f7a600b0030 legacy=0x7f7a600b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 --2- 172.21.15.44:0/186110925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a400039b0 0x7f7a40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 --2- 172.21.15.44:0/186110925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a40004800 0x7f7a40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 --2- 172.21.15.44:0/186110925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a60158e00 0x7f7a400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7a60072850 con 0x7f7a40004800 2024-03-30T13:14:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7a60072b30 con 0x7f7a400039b0 2024-03-30T13:14:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4000b9c0 con 0x7f7a60158e00 2024-03-30T13:14:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.597+0000 7f7a5d400640 1 --2- 172.21.15.44:0/186110925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a40004800 0x7f7a40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.598+0000 7f7a5de00640 1 --2- 172.21.15.44:0/186110925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a400039b0 0x7f7a40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.598+0000 7f7a5e800640 1 --2- 172.21.15.44:0/186110925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a60158e00 0x7f7a400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.598+0000 7f7a5d400640 1 -- 172.21.15.44:0/186110925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a60158e00 msgr2=0x7f7a400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.598+0000 7f7a5d400640 1 --2- 172.21.15.44:0/186110925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a60158e00 0x7f7a400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.598+0000 7f7a5d400640 1 -- 172.21.15.44:0/186110925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a400039b0 msgr2=0x7f7a40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.598+0000 7f7a5d400640 1 --2- 172.21.15.44:0/186110925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a400039b0 0x7f7a40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.598+0000 7f7a5d400640 1 -- 172.21.15.44:0/186110925 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a40003520 con 0x7f7a40004800 2024-03-30T13:14:43.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.599+0000 7f7a5d400640 1 --2- 172.21.15.44:0/186110925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a40004800 0x7f7a40004c80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009fc0 tx=0x7f7a40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12dfba75f1489ea server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.600+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48039070 con 0x7f7a40004800 2024-03-30T13:14:43.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.600+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4802cc20 con 0x7f7a40004800 2024-03-30T13:14:43.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.600+0000 7f7a5ca00640 1 -- 172.21.15.44:0/186110925 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48009c10 con 0x7f7a40004800 2024-03-30T13:14:43.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.600+0000 7f7a64e00640 1 -- 172.21.15.44:0/186110925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a40004800 msgr2=0x7f7a40004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.600+0000 7f7a64e00640 1 --2- 172.21.15.44:0/186110925 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a40004800 0x7f7a40004c80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009fc0 tx=0x7f7a40005830 comp rx=0 tx=0).stop 2024-03-30T13:14:43.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.600+0000 7f7a5e800640 1 -- 172.21.15.44:0/186110925 reap_dead start 2024-03-30T13:14:43.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.600+0000 7f7a64e00640 1 -- 172.21.15.44:0/186110925 shutdown_connections 2024-03-30T13:14:43.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.600+0000 7f7a64e00640 1 -- 172.21.15.44:0/186110925 >> 172.21.15.44:0/186110925 conn(0x7f7a600d1160 msgr2=0x7f7a600d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.600+0000 7f7a64e00640 1 -- 172.21.15.44:0/186110925 shutdown_connections 2024-03-30T13:14:43.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.600+0000 7f7a64e00640 1 -- 172.21.15.44:0/186110925 wait complete. 2024-03-30T13:14:43.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.603+0000 7f7a64e00640 1 Processor -- start 2024-03-30T13:14:43.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.604+0000 7f7a64e00640 1 -- start start 2024-03-30T13:14:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.605+0000 7f7a64e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a40004800 0x7f7a60151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.605+0000 7f7a64e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a601f4ba0 0x7f7a6014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.605+0000 7f7a64e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a600ae720 0x7f7a601500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.605+0000 7f7a64e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6006bc40 con 0x7f7a601f4ba0 2024-03-30T13:14:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.605+0000 7f7a64e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6006bac0 con 0x7f7a40004800 2024-03-30T13:14:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.605+0000 7f7a64e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6006bdc0 con 0x7f7a600ae720 2024-03-30T13:14:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.605+0000 7f7a5d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a601f4ba0 0x7f7a6014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.605+0000 7f7a5d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a601f4ba0 0x7f7a6014f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34082/0 (socket says 172.21.15.44:34082) 2024-03-30T13:14:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.605+0000 7f7a5d400640 1 -- 172.21.15.44:0/4016151236 learned_addr learned my addr 172.21.15.44:0/4016151236 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.606+0000 7f7a5d400640 1 -- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a600ae720 msgr2=0x7f7a601500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.606+0000 7f7a5e800640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a600ae720 0x7f7a601500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.606+0000 7f7a5d400640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a600ae720 0x7f7a601500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.606+0000 7f7a5de00640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a40004800 0x7f7a60151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.606+0000 7f7a5d400640 1 -- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a40004800 msgr2=0x7f7a60151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.606+0000 7f7a5d400640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a40004800 0x7f7a60151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.606+0000 7f7a5d400640 1 -- 172.21.15.44:0/4016151236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a601f4100 con 0x7f7a601f4ba0 2024-03-30T13:14:43.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.606+0000 7f7a5d400640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a601f4ba0 0x7f7a6014f510 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800e230 tx=0x7f7a48009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.607+0000 7f7a56000640 1 -- 172.21.15.44:0/4016151236 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48039050 con 0x7f7a601f4ba0 2024-03-30T13:14:43.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.607+0000 7f7a56000640 1 -- 172.21.15.44:0/4016151236 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4803a040 con 0x7f7a601f4ba0 2024-03-30T13:14:43.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.607+0000 7f7a56000640 1 -- 172.21.15.44:0/4016151236 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48003bb0 con 0x7f7a601f4ba0 2024-03-30T13:14:43.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.607+0000 7f7a64e00640 1 -- 172.21.15.44:0/4016151236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a60152510 con 0x7f7a601f4ba0 2024-03-30T13:14:43.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.607+0000 7f7a64e00640 1 -- 172.21.15.44:0/4016151236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6014fa50 con 0x7f7a601f4ba0 2024-03-30T13:14:43.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.609+0000 7f7a56000640 1 -- 172.21.15.44:0/4016151236 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7a48004030 con 0x7f7a601f4ba0 2024-03-30T13:14:43.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.610+0000 7f7a56000640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7a3c06c560 0x7f7a3c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.610+0000 7f7a56000640 1 -- 172.21.15.44:0/4016151236 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f7a480ae010 con 0x7f7a601f4ba0 2024-03-30T13:14:43.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.611+0000 7f7a5de00640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7a3c06c560 0x7f7a3c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.612+0000 7f7a67bf6740 1 Processor -- start 2024-03-30T13:14:43.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.612+0000 7f7a5de00640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7a3c06c560 0x7f7a3c06ea20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7a600b1740 tx=0x7f7a50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.612+0000 7f7a67bf6740 1 -- start start 2024-03-30T13:14:43.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.613+0000 7f7a67bf6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf389c290 0x55edf38c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.613+0000 7f7a67bf6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38c3300 0x55edf389b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.613+0000 7f7a67bf6740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf389b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.613+0000 7f7a67bf6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55edf37ff330 con 0x55edf38c3300 2024-03-30T13:14:43.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.613+0000 7f7a67bf6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55edf37a7620 con 0x55edf389c290 2024-03-30T13:14:43.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.613+0000 7f7a67bf6740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55edf37fb440 con 0x55edf389c670 2024-03-30T13:14:43.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.614+0000 7f7a5d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38c3300 0x55edf389b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.614+0000 7f7a5d400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38c3300 0x55edf389b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34090/0 (socket says 172.21.15.44:34090) 2024-03-30T13:14:43.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.614+0000 7f7a5d400640 1 -- 172.21.15.44:0/2243792566 learned_addr learned my addr 172.21.15.44:0/2243792566 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.614+0000 7f7a5de00640 1 --2- 172.21.15.44:0/2243792566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf389c290 0x55edf38c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.620 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.614+0000 7f7a5d400640 1 -- 172.21.15.44:0/2243792566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 msgr2=0x55edf389b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.614+0000 7f7a5d400640 1 --2- 172.21.15.44:0/2243792566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf389b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.614+0000 7f7a5d400640 1 -- 172.21.15.44:0/2243792566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf389c290 msgr2=0x55edf38c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.614+0000 7f7a5d400640 1 --2- 172.21.15.44:0/2243792566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf389c290 0x55edf38c2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.614+0000 7f7a5d400640 1 -- 172.21.15.44:0/2243792566 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edf35df920 con 0x55edf38c3300 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.614+0000 7f7a5d400640 1 --2- 172.21.15.44:0/2243792566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38c3300 0x55edf389b2d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7a48078270 tx=0x7f7a4802cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66da45deecdb0135 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.614+0000 7f7a4ea00640 1 -- 172.21.15.44:0/2243792566 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480aa070 con 0x55edf38c3300 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.615+0000 7f7a4ea00640 1 -- 172.21.15.44:0/2243792566 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a48009cd0 con 0x55edf38c3300 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.615+0000 7f7a4ea00640 1 -- 172.21.15.44:0/2243792566 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48094030 con 0x55edf38c3300 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.615+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2243792566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38c3300 msgr2=0x55edf389b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.615+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/2243792566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38c3300 0x55edf389b2d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7a48078270 tx=0x7f7a4802cc20 comp rx=0 tx=0).stop 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.615+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2243792566 shutdown_connections 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.615+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/2243792566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf389b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.615+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/2243792566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38c3300 0x55edf389b2d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.615+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/2243792566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf389c290 0x55edf38c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.615+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2243792566 >> 172.21.15.44:0/2243792566 conn(0x55edf3862be0 msgr2=0x55edf38e0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.615+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2243792566 shutdown_connections 2024-03-30T13:14:43.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.615+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2243792566 wait complete. 2024-03-30T13:14:43.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.617+0000 7f7a67bf6740 1 -- start start 2024-03-30T13:14:43.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.617+0000 7f7a67bf6740 1 Processor -- start 2024-03-30T13:14:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a67bf6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 0x55edf38da6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a67bf6740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf38dce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a67bf6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf38f4830 0x55edf38dd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a67bf6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55edf37a7620 con 0x55edf389c290 2024-03-30T13:14:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a67bf6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55edf37ba9d0 con 0x55edf38f4830 2024-03-30T13:14:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a67bf6740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55edf37ff330 con 0x55edf389c670 2024-03-30T13:14:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a67bf6740 10 client.0 _ll_register_callbacks cb 0x55edf37f6fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a5de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 0x55edf38da6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a5de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 0x55edf38da6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34092/0 (socket says 172.21.15.44:34092) 2024-03-30T13:14:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a5de00640 1 -- 172.21.15.44:0/413982992 learned_addr learned my addr 172.21.15.44:0/413982992 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a5e800640 1 --2- 172.21.15.44:0/413982992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf38f4830 0x55edf38dd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a5de00640 1 -- 172.21.15.44:0/413982992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 msgr2=0x55edf38dce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a5de00640 1 --2- 172.21.15.44:0/413982992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf38dce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a5de00640 1 -- 172.21.15.44:0/413982992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf38f4830 msgr2=0x55edf38dd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a5de00640 1 --2- 172.21.15.44:0/413982992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf38f4830 0x55edf38dd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.619+0000 7f7a5de00640 1 -- 172.21.15.44:0/413982992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edf34d3210 con 0x55edf389c290 2024-03-30T13:14:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.620+0000 7f7a5de00640 1 --2- 172.21.15.44:0/413982992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 0x55edf38da6f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7a500157d0 tx=0x7f7a50004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6302bf9f07ccbe server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.620+0000 7f7a47400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.620+0000 7f7a47400640 1 -- 172.21.15.44:0/413982992 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a50026070 con 0x55edf389c290 2024-03-30T13:14:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.620+0000 7f7a47400640 1 -- 172.21.15.44:0/413982992 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f7a50014b30 con 0x55edf389c290 2024-03-30T13:14:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.620+0000 7f7a67bf6740 1 -- 172.21.15.44:0/413982992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55edf380c870 con 0x55edf389c290 2024-03-30T13:14:43.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.620+0000 7f7a47400640 1 -- 172.21.15.44:0/413982992 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7a50031050 con 0x55edf389c290 2024-03-30T13:14:43.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.620+0000 7f7a67bf6740 10 client.5943 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.620+0000 7f7a67bf6740 1 -- 172.21.15.44:0/413982992 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55edf36400b0 con 0x55edf389c290 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.621+0000 7f7a47400640 1 -- 172.21.15.44:0/413982992 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55edf380c870 con 0x55edf389c290 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.621+0000 7f7a47400640 1 -- 172.21.15.44:0/413982992 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f7a50034020 con 0x55edf389c290 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.621+0000 7f7a67bf6740 10 client.5943 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.621+0000 7f7a67bf6740 10 client.5943 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.621+0000 7f7a67bf6740 20 client.5943 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.621+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/413982992 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55edf38fbe60 0x55edf38fe250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.621+0000 7f7a67bf6740 4 client.5943 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.621+0000 7f7a67bf6740 1 -- 172.21.15.44:0/413982992 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edf3806bc0 con 0x55edf38fbe60 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.621+0000 7f7a5d400640 1 --2- 172.21.15.44:0/413982992 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55edf38fbe60 0x55edf38fe250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.622+0000 7f7a5d400640 1 --2- 172.21.15.44:0/413982992 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55edf38fbe60 0x55edf38fe250 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67e2897f73d9b029 server_cookie=78405a4cb0d144da in_seq=0 out_seq=0 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.622+0000 7f7a47400640 10 client.5943 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.622+0000 7f7a47400640 1 -- 172.21.15.44:0/413982992 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55edf3806bc0 con 0x55edf38fbe60 2024-03-30T13:14:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.622+0000 7f7a47400640 10 client.5943 handle_command_reply: tid=0 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a67bf6740 1 client.5943 shutdown 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a67bf6740 1 -- 172.21.15.44:0/413982992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 msgr2=0x55edf38da6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/413982992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 0x55edf38da6f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7a500157d0 tx=0x7f7a50004730 comp rx=0 tx=0).stop 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a67bf6740 1 -- 172.21.15.44:0/413982992 shutdown_connections 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/413982992 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55edf38fbe60 0x55edf38fe250 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/413982992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf38f4830 0x55edf38dd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/413982992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf38dce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/413982992 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 0x55edf38da6f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a47400640 0 client.5943 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a67bf6740 1 -- 172.21.15.44:0/413982992 >> 172.21.15.44:0/413982992 conn(0x55edf3862be0 msgr2=0x55edf38c3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a67bf6740 1 -- 172.21.15.44:0/413982992 shutdown_connections 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a67bf6740 1 -- 172.21.15.44:0/413982992 wait complete. 2024-03-30T13:14:43.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.623+0000 7f7a67bf6740 20 client.5943 trim_cache size 0 max 16384 2024-03-30T13:14:43.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.639+0000 7f7a67bf6740 1 Processor -- start 2024-03-30T13:14:43.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.639+0000 7f7a67bf6740 1 -- start start 2024-03-30T13:14:43.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.640+0000 7f7a67bf6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf389c290 0x55edf38c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.640+0000 7f7a67bf6740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf38d8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.640+0000 7f7a67bf6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38f4830 0x55edf38c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.640+0000 7f7a67bf6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7a602019d0 con 0x55edf38f4830 2024-03-30T13:14:43.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.640+0000 7f7a67bf6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7a602009f0 con 0x55edf389c290 2024-03-30T13:14:43.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.640+0000 7f7a67bf6740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6015f7c0 con 0x55edf389c670 2024-03-30T13:14:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.641+0000 7f7a5e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38f4830 0x55edf38c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.641+0000 7f7a5e800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38f4830 0x55edf38c0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34106/0 (socket says 172.21.15.44:34106) 2024-03-30T13:14:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.641+0000 7f7a5e800640 1 -- 172.21.15.44:0/3167429624 learned_addr learned my addr 172.21.15.44:0/3167429624 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.641+0000 7f7a5de00640 1 --2- 172.21.15.44:0/3167429624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf389c290 0x55edf38c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.641+0000 7f7a5d400640 1 --2- 172.21.15.44:0/3167429624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf38d8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.641+0000 7f7a5e800640 1 -- 172.21.15.44:0/3167429624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 msgr2=0x55edf38d8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.641+0000 7f7a5e800640 1 --2- 172.21.15.44:0/3167429624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf38d8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.641+0000 7f7a5e800640 1 -- 172.21.15.44:0/3167429624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf389c290 msgr2=0x55edf38c07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.641+0000 7f7a5e800640 1 --2- 172.21.15.44:0/3167429624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf389c290 0x55edf38c07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.641+0000 7f7a5e800640 1 -- 172.21.15.44:0/3167429624 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edf38d96c0 con 0x55edf38f4830 2024-03-30T13:14:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.642+0000 7f7a5e800640 1 --2- 172.21.15.44:0/3167429624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38f4830 0x55edf38c0d60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7a58001730 tx=0x7f7a58001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a900cfa2448af48 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.642+0000 7f7a4e000640 1 -- 172.21.15.44:0/3167429624 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58019070 con 0x55edf38f4830 2024-03-30T13:14:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.642+0000 7f7a4e000640 1 -- 172.21.15.44:0/3167429624 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a58010740 con 0x55edf38f4830 2024-03-30T13:14:43.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.642+0000 7f7a4e000640 1 -- 172.21.15.44:0/3167429624 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58010b30 con 0x55edf38f4830 2024-03-30T13:14:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.643+0000 7f7a67bf6740 1 -- 172.21.15.44:0/3167429624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38f4830 msgr2=0x55edf38c0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.643+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/3167429624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38f4830 0x55edf38c0d60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7a58001730 tx=0x7f7a58001820 comp rx=0 tx=0).stop 2024-03-30T13:14:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.643+0000 7f7a67bf6740 1 -- 172.21.15.44:0/3167429624 shutdown_connections 2024-03-30T13:14:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.643+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/3167429624 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf38f4830 0x55edf38c0d60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.643+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/3167429624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf38d8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.643+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/3167429624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf389c290 0x55edf38c07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.643+0000 7f7a67bf6740 1 -- 172.21.15.44:0/3167429624 >> 172.21.15.44:0/3167429624 conn(0x55edf3862be0 msgr2=0x55edf38e4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.643+0000 7f7a67bf6740 1 -- 172.21.15.44:0/3167429624 shutdown_connections 2024-03-30T13:14:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.643+0000 7f7a67bf6740 1 -- 172.21.15.44:0/3167429624 wait complete. 2024-03-30T13:14:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.644+0000 7f7a67bf6740 1 -- start start 2024-03-30T13:14:43.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.644+0000 7f7a67bf6740 1 Processor -- start 2024-03-30T13:14:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.646+0000 7f7a67bf6740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 0x55edf38f8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.646+0000 7f7a67bf6740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf39032e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.646+0000 7f7a67bf6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf38f4830 0x55edf3895070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.646+0000 7f7a67bf6740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7a602003a0 con 0x55edf389c290 2024-03-30T13:14:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.646+0000 7f7a67bf6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55edf3896560 con 0x55edf38f4830 2024-03-30T13:14:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.646+0000 7f7a67bf6740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55edf38f9000 con 0x55edf389c670 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.646+0000 7f7a67bf6740 10 client.0 _ll_register_callbacks cb 0x7f7a50009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.646+0000 7f7a5de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 0x55edf38f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.646+0000 7f7a5de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 0x55edf38f8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34118/0 (socket says 172.21.15.44:34118) 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.646+0000 7f7a5de00640 1 -- 172.21.15.44:0/2183045397 learned_addr learned my addr 172.21.15.44:0/2183045397 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.647+0000 7f7a5de00640 1 -- 172.21.15.44:0/2183045397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 msgr2=0x55edf39032e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.647+0000 7f7a5de00640 1 --2- 172.21.15.44:0/2183045397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf39032e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.647+0000 7f7a5de00640 1 -- 172.21.15.44:0/2183045397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf38f4830 msgr2=0x55edf3895070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.647+0000 7f7a5de00640 1 --2- 172.21.15.44:0/2183045397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf38f4830 0x55edf3895070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.647+0000 7f7a5de00640 1 -- 172.21.15.44:0/2183045397 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edf34ac2d0 con 0x55edf389c290 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.647+0000 7f7a5de00640 1 --2- 172.21.15.44:0/2183045397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 0x55edf38f8510 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7a500126a0 tx=0x7f7a50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a3679b7342ec89 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.647+0000 7f7a47400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.647+0000 7f7a47400640 1 -- 172.21.15.44:0/2183045397 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a50026070 con 0x55edf389c290 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.647+0000 7f7a47400640 1 -- 172.21.15.44:0/2183045397 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f7a5002b920 con 0x55edf389c290 2024-03-30T13:14:43.653 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.647+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2183045397 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a58010740 con 0x55edf389c290 2024-03-30T13:14:43.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.648+0000 7f7a47400640 1 -- 172.21.15.44:0/2183045397 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7a50045050 con 0x55edf389c290 2024-03-30T13:14:43.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.648+0000 7f7a67bf6740 10 client.5949 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:43.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.648+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2183045397 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55edf38f8d40 con 0x55edf389c290 2024-03-30T13:14:43.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.648+0000 7f7a47400640 1 -- 172.21.15.44:0/2183045397 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a58010740 con 0x55edf389c290 2024-03-30T13:14:43.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.648+0000 7f7a47400640 1 -- 172.21.15.44:0/2183045397 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f7a50048020 con 0x55edf389c290 2024-03-30T13:14:43.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.648+0000 7f7a67bf6740 10 client.5949 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:43.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.648+0000 7f7a67bf6740 10 client.5949 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:43.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.648+0000 7f7a67bf6740 20 client.5949 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:43.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.648+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/2183045397 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55edf3952320 0x55edf38955b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.648+0000 7f7a67bf6740 4 client.5949 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628343}] 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.648+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2183045397 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628343}) -- 0x55edf3784950 con 0x55edf3952320 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.648+0000 7f7a5d400640 1 --2- 172.21.15.44:0/2183045397 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55edf3952320 0x55edf38955b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.649+0000 7f7a5d400640 1 --2- 172.21.15.44:0/2183045397 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55edf3952320 0x55edf38955b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29074b9297cacc2 server_cookie=64eb498012a16ec3 in_seq=0 out_seq=0 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.649+0000 7f7a47400640 10 client.5949 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.649+0000 7f7a47400640 1 -- 172.21.15.44:0/2183045397 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x55edf3784950 con 0x55edf3952320 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.649+0000 7f7a47400640 10 client.5949 handle_command_reply: tid=0 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.649+0000 7f7a67bf6740 1 client.5949 shutdown 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.650+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2183045397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 msgr2=0x55edf38f8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.650+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/2183045397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 0x55edf38f8510 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7a500126a0 tx=0x7f7a50017000 comp rx=0 tx=0).stop 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.650+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2183045397 shutdown_connections 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.650+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/2183045397 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55edf3952320 0x55edf38955b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.650+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/2183045397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf38f4830 0x55edf3895070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.650+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/2183045397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55edf389c670 0x55edf39032e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.650+0000 7f7a67bf6740 1 --2- 172.21.15.44:0/2183045397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55edf389c290 0x55edf38f8510 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.650+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2183045397 >> 172.21.15.44:0/2183045397 conn(0x55edf3862be0 msgr2=0x55edf38e4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.650+0000 7f7a47400640 0 client.5949 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.650+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2183045397 shutdown_connections 2024-03-30T13:14:43.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.650+0000 7f7a67bf6740 1 -- 172.21.15.44:0/2183045397 wait complete. 2024-03-30T13:14:43.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.650+0000 7f7a67bf6740 20 client.5949 trim_cache size 0 max 16384 2024-03-30T13:14:43.658 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:43.658 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-debugfs.h", 2024-03-30T13:14:43.658 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628343, 2024-03-30T13:14:43.658 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.341527+0000", 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.420255+0000", 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:43.659 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 311, 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:43.660 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.420255+0000", 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:43.661 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 311, 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.341527+0000" 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:43.662 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 311, 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.341527+0000" 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 212, 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 32, 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:43.663 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:11.001156+0000", 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 84, 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.664 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:43.665 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:43.666 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:43.667 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:43.667 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:43.667 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.667 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:43.667 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:43.667 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:43.667 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:43.667 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:43.667 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:43.667 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:43.667 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:43.668 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:43.669 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:43.670 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:43.671 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:43.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.651+0000 7f7a64e00640 1 -- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7a3c06c560 msgr2=0x7f7a3c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.651+0000 7f7a64e00640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7a3c06c560 0x7f7a3c06ea20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7a600b1740 tx=0x7f7a50008040 comp rx=0 tx=0).stop 2024-03-30T13:14:43.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.651+0000 7f7a64e00640 1 -- 172.21.15.44:0/4016151236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a601f4ba0 msgr2=0x7f7a6014f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.651+0000 7f7a64e00640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a601f4ba0 0x7f7a6014f510 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800e230 tx=0x7f7a48009750 comp rx=0 tx=0).stop 2024-03-30T13:14:43.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.651+0000 7f7a64e00640 1 -- 172.21.15.44:0/4016151236 shutdown_connections 2024-03-30T13:14:43.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.651+0000 7f7a64e00640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a600ae720 0x7f7a601500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.651+0000 7f7a64e00640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7a601f4ba0 0x7f7a6014f510 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.651+0000 7f7a64e00640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f7a3c06c560 0x7f7a3c06ea20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.651+0000 7f7a64e00640 1 --2- 172.21.15.44:0/4016151236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a40004800 0x7f7a60151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.651+0000 7f7a64e00640 1 -- 172.21.15.44:0/4016151236 >> 172.21.15.44:0/4016151236 conn(0x7f7a600d1160 msgr2=0x7f7a600ad930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.651+0000 7f7a64e00640 1 -- 172.21.15.44:0/4016151236 shutdown_connections 2024-03-30T13:14:43.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.651+0000 7f7a64e00640 1 -- 172.21.15.44:0/4016151236 wait complete. 2024-03-30T13:14:43.675 DEBUG:tasks.cephfs.test_uninlining:getting inode info #20 of 23:1099511628344 2024-03-30T13:14:43.675 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628344 2024-03-30T13:14:43.675 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628344 2024-03-30T13:14:43.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.914+0000 7fc8cbe00640 1 Processor -- start 2024-03-30T13:14:43.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.914+0000 7fc8cbe00640 1 -- start start 2024-03-30T13:14:43.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.916+0000 7fc8cbe00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc8cc0acd60 0x7fc8cc072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.916+0000 7fc8cbe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc8cc0ae9d0 0x7fc8cc0aee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.916+0000 7fc8cbe00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8cc0ad2e0 con 0x7fc8cc06e980 2024-03-30T13:14:43.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.916+0000 7fc8cbe00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc8cc0ad5c0 con 0x7fc8cc0ae9d0 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.916+0000 7fc8cbe00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fc8cc071450 con 0x7fc8cc0acd60 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.917+0000 7fc8cb400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc8cc0ae9d0 0x7fc8cc0aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.917+0000 7fc8caa00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc8cc06e980 0x7fc8cc15d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36876/0 (socket says 172.21.15.44:36876) 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.917+0000 7fc8caa00640 1 -- 172.21.15.44:0/2900341332 learned_addr learned my addr 172.21.15.44:0/2900341332 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.917+0000 7fc8ca000640 1 --2- 172.21.15.44:0/2900341332 >> v2:172.21.15.151:3300/0 conn(0x7fc8cc0acd60 0x7fc8cc072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.917+0000 7fc8c9600640 1 -- 172.21.15.44:0/2900341332 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 452720075 0 0) 0x7fc8cc0ad2e0 con 0x7fc8cc06e980 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.917+0000 7fc8c9600640 1 -- 172.21.15.44:0/2900341332 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8b0003520 con 0x7fc8cc06e980 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.917+0000 7fc8cb400640 1 -- 172.21.15.44:0/2900341332 >> v2:172.21.15.151:3300/0 conn(0x7fc8cc0acd60 msgr2=0x7fc8cc072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.917+0000 7fc8cb400640 1 --2- 172.21.15.44:0/2900341332 >> v2:172.21.15.151:3300/0 conn(0x7fc8cc0acd60 0x7fc8cc072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.918+0000 7fc8cb400640 1 -- 172.21.15.44:0/2900341332 >> v1:172.21.15.44:6789/0 conn(0x7fc8cc06e980 legacy=0x7fc8cc15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.918+0000 7fc8cb400640 1 -- 172.21.15.44:0/2900341332 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8cc0716a0 con 0x7fc8cc0ae9d0 2024-03-30T13:14:43.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.918+0000 7fc8ca000640 1 --2- 172.21.15.44:0/2900341332 >> v2:172.21.15.151:3300/0 conn(0x7fc8cc0acd60 0x7fc8cc072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:43.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.919+0000 7fc8cb400640 1 --2- 172.21.15.44:0/2900341332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8cc0ae9d0 0x7fc8cc0aee60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc06c5b0 tx=0x7fc8c402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a638d49e213d075d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.919+0000 7fc8c9600640 1 -- 172.21.15.44:0/2900341332 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4039070 con 0x7fc8cc0ae9d0 2024-03-30T13:14:43.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.919+0000 7fc8c9600640 1 -- 172.21.15.44:0/2900341332 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8c402cc80 con 0x7fc8cc0ae9d0 2024-03-30T13:14:43.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.919+0000 7fc8c9600640 1 -- 172.21.15.44:0/2900341332 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4034660 con 0x7fc8cc0ae9d0 2024-03-30T13:14:43.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.920+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2900341332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8cc0ae9d0 msgr2=0x7fc8cc0aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.920+0000 7fc8cbe00640 1 --2- 172.21.15.44:0/2900341332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8cc0ae9d0 0x7fc8cc0aee60 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc06c5b0 tx=0x7fc8c402bed0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.920+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2900341332 shutdown_connections 2024-03-30T13:14:43.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.920+0000 7fc8cbe00640 1 --2- 172.21.15.44:0/2900341332 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8cc0ae9d0 0x7fc8cc0aee60 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.920+0000 7fc8cbe00640 1 --2- 172.21.15.44:0/2900341332 >> v2:172.21.15.151:3300/0 conn(0x7fc8cc0acd60 0x7fc8cc072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.920+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2900341332 >> 172.21.15.44:0/2900341332 conn(0x7fc8cc0cfd90 msgr2=0x7fc8cc0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.920+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2900341332 shutdown_connections 2024-03-30T13:14:43.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.920+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2900341332 wait complete. 2024-03-30T13:14:43.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.922+0000 7fc8cbe00640 1 Processor -- start 2024-03-30T13:14:43.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.922+0000 7fc8cbe00640 1 -- start start 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8cbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8cc06e980 0x7fc8cc146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8cbe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8cc0acd60 0x7fc8cc0c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8cbe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8cc0ae9d0 0x7fc8cc06d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8cbe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc0af3a0 con 0x7fc8cc06e980 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8cbe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc071c60 con 0x7fc8cc0acd60 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8cbe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc8cc156020 con 0x7fc8cc0ae9d0 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8cc06e980 0x7fc8cc146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8cc06e980 0x7fc8cc146aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34126/0 (socket says 172.21.15.44:34126) 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8caa00640 1 -- 172.21.15.44:0/2903815747 learned_addr learned my addr 172.21.15.44:0/2903815747 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8ca000640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8cc0acd60 0x7fc8cc0c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8caa00640 1 -- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8cc0ae9d0 msgr2=0x7fc8cc06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8cb400640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8cc0ae9d0 0x7fc8cc06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8caa00640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8cc0ae9d0 0x7fc8cc06d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8caa00640 1 -- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8cc0acd60 msgr2=0x7fc8cc0c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8caa00640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8cc0acd60 0x7fc8cc0c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8caa00640 1 -- 172.21.15.44:0/2903815747 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8cc0c9970 con 0x7fc8cc06e980 2024-03-30T13:14:43.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.923+0000 7fc8ca000640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8cc0acd60 0x7fc8cc0c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:43.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.924+0000 7fc8caa00640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8cc06e980 0x7fc8cc146aa0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c460 tx=0x7fc8bc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.924+0000 7fc8c2a00640 1 -- 172.21.15.44:0/2903815747 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc005ce0 con 0x7fc8cc06e980 2024-03-30T13:14:43.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.924+0000 7fc8c2a00640 1 -- 172.21.15.44:0/2903815747 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8bc007070 con 0x7fc8cc06e980 2024-03-30T13:14:43.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.924+0000 7fc8c2a00640 1 -- 172.21.15.44:0/2903815747 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc007460 con 0x7fc8cc06e980 2024-03-30T13:14:43.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.924+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2903815747 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8cc0b2f20 con 0x7fc8cc06e980 2024-03-30T13:14:43.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.924+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2903815747 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8cc0b34e0 con 0x7fc8cc06e980 2024-03-30T13:14:43.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.927+0000 7fc8c2a00640 1 -- 172.21.15.44:0/2903815747 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc8bc007600 con 0x7fc8cc06e980 2024-03-30T13:14:43.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.929+0000 7fc8c2a00640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc8ac06c530 0x7fc8ac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.929+0000 7fc8d498c740 1 Processor -- start 2024-03-30T13:14:43.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.929+0000 7fc8c2a00640 1 -- 172.21.15.44:0/2903815747 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc8bc08b550 con 0x7fc8cc06e980 2024-03-30T13:14:43.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.929+0000 7fc8d498c740 1 -- start start 2024-03-30T13:14:43.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.929+0000 7fc8ca000640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc8ac06c530 0x7fc8ac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.930+0000 7fc8d498c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd3298fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.930+0000 7fc8d498c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd32994e0 0x560bd32714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.930+0000 7fc8d498c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd3272850 0x560bd32719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.930+0000 7fc8d498c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560bd31d5330 con 0x560bd3272470 2024-03-30T13:14:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.930+0000 7fc8d498c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560bd317d620 con 0x560bd3272850 2024-03-30T13:14:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.930+0000 7fc8d498c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x560bd31d1440 con 0x560bd32994e0 2024-03-30T13:14:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.930+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd3298fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.930+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd3298fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34130/0 (socket says 172.21.15.44:34130) 2024-03-30T13:14:43.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.930+0000 7fc8caa00640 1 -- 172.21.15.44:0/1789931468 learned_addr learned my addr 172.21.15.44:0/1789931468 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.930+0000 7fc8ca000640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc8ac06c530 0x7fc8ac06e9f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8006fd0 tx=0x7fc8b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.931+0000 7fc8cb400640 1 --2- 172.21.15.44:0/1789931468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd3272850 0x560bd32719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.931+0000 7fc8ca000640 1 --2- 172.21.15.44:0/1789931468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd32994e0 0x560bd32714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.931+0000 7fc8caa00640 1 -- 172.21.15.44:0/1789931468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd32994e0 msgr2=0x560bd32714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.931+0000 7fc8caa00640 1 --2- 172.21.15.44:0/1789931468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd32994e0 0x560bd32714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.931+0000 7fc8caa00640 1 -- 172.21.15.44:0/1789931468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd3272850 msgr2=0x560bd32719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.931+0000 7fc8caa00640 1 --2- 172.21.15.44:0/1789931468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd3272850 0x560bd32719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.931+0000 7fc8caa00640 1 -- 172.21.15.44:0/1789931468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bd2fb5920 con 0x560bd3272470 2024-03-30T13:14:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.931+0000 7fc8cb400640 1 --2- 172.21.15.44:0/1789931468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd3272850 0x560bd32719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:43.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.931+0000 7fc8caa00640 1 --2- 172.21.15.44:0/1789931468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd3298fa0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc005fd0 tx=0x7fc8bc0599b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04daeaab6d943d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.931+0000 7fc8b7400640 1 -- 172.21.15.44:0/1789931468 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc071020 con 0x560bd3272470 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.931+0000 7fc8b7400640 1 -- 172.21.15.44:0/1789931468 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8bc061e90 con 0x560bd3272470 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.931+0000 7fc8b7400640 1 -- 172.21.15.44:0/1789931468 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc055920 con 0x560bd3272470 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.932+0000 7fc8d498c740 1 -- 172.21.15.44:0/1789931468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 msgr2=0x560bd3298fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.932+0000 7fc8d498c740 1 --2- 172.21.15.44:0/1789931468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd3298fa0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc005fd0 tx=0x7fc8bc0599b0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.932+0000 7fc8d498c740 1 -- 172.21.15.44:0/1789931468 shutdown_connections 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.932+0000 7fc8d498c740 1 --2- 172.21.15.44:0/1789931468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd3272850 0x560bd32719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.932+0000 7fc8d498c740 1 --2- 172.21.15.44:0/1789931468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd32994e0 0x560bd32714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.932+0000 7fc8d498c740 1 --2- 172.21.15.44:0/1789931468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd3298fa0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.932+0000 7fc8d498c740 1 -- 172.21.15.44:0/1789931468 >> 172.21.15.44:0/1789931468 conn(0x560bd3238be0 msgr2=0x560bd32b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.932+0000 7fc8d498c740 1 -- 172.21.15.44:0/1789931468 shutdown_connections 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.932+0000 7fc8d498c740 1 -- 172.21.15.44:0/1789931468 wait complete. 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.934+0000 7fc8d498c740 1 -- start start 2024-03-30T13:14:43.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.934+0000 7fc8d498c740 1 Processor -- start 2024-03-30T13:14:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8d498c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd32c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8d498c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd3272850 0x560bd32b6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8d498c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd329fda0 0x560bd32b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8d498c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560bd3298b10 con 0x560bd3272470 2024-03-30T13:14:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8d498c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560bd31909d0 con 0x560bd329fda0 2024-03-30T13:14:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8d498c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x560bd3291890 con 0x560bd3272850 2024-03-30T13:14:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8d498c740 10 client.0 _ll_register_callbacks cb 0x560bd31ccfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd32c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd32c70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34144/0 (socket says 172.21.15.44:34144) 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8caa00640 1 -- 172.21.15.44:0/2258158250 learned_addr learned my addr 172.21.15.44:0/2258158250 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8cb400640 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd329fda0 0x560bd32b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8ca000640 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd3272850 0x560bd32b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8caa00640 1 -- 172.21.15.44:0/2258158250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd3272850 msgr2=0x560bd32b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8caa00640 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd3272850 0x560bd32b6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8caa00640 1 -- 172.21.15.44:0/2258158250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd329fda0 msgr2=0x560bd32b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8caa00640 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd329fda0 0x560bd32b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8caa00640 1 -- 172.21.15.44:0/2258158250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bd2ea9210 con 0x560bd3272470 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.936+0000 7fc8cb400640 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd329fda0 0x560bd32b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.937+0000 7fc8caa00640 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd32c70f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00cfd0 tx=0x7fc8bc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d622cc8434ba57f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.937+0000 7fc8abe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.937+0000 7fc8abe00640 1 -- 172.21.15.44:0/2258158250 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc071040 con 0x560bd3272470 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.937+0000 7fc8abe00640 1 -- 172.21.15.44:0/2258158250 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc8bc059710 con 0x560bd3272470 2024-03-30T13:14:43.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.937+0000 7fc8d498c740 1 -- 172.21.15.44:0/2258158250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8bc061e90 con 0x560bd3272470 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.937+0000 7fc8abe00640 1 -- 172.21.15.44:0/2258158250 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc8bc07f050 con 0x560bd3272470 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.937+0000 7fc8d498c740 10 client.5964 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.937+0000 7fc8d498c740 1 -- 172.21.15.44:0/2258158250 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x560bd30160b0 con 0x560bd3272470 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.938+0000 7fc8abe00640 1 -- 172.21.15.44:0/2258158250 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8bc061e90 con 0x560bd3272470 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.938+0000 7fc8abe00640 1 -- 172.21.15.44:0/2258158250 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fc8bc082020 con 0x560bd3272470 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.938+0000 7fc8d498c740 10 client.5964 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.938+0000 7fc8d498c740 10 client.5964 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.938+0000 7fc8d498c740 20 client.5964 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.938+0000 7fc8d498c740 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560bd329e460 0x560bd329e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.938+0000 7fc8d498c740 4 client.5964 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.938+0000 7fc8d498c740 1 -- 172.21.15.44:0/2258158250 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bd31e2870 con 0x560bd329e460 2024-03-30T13:14:43.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.938+0000 7fc8ca000640 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560bd329e460 0x560bd329e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.939+0000 7fc8ca000640 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560bd329e460 0x560bd329e860 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46de29152b3eee5c server_cookie=62c64f90880b9ed5 in_seq=0 out_seq=0 2024-03-30T13:14:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.939+0000 7fc8abe00640 10 client.5964 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.939+0000 7fc8abe00640 1 -- 172.21.15.44:0/2258158250 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x560bd31e2870 con 0x560bd329e460 2024-03-30T13:14:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.939+0000 7fc8abe00640 10 client.5964 handle_command_reply: tid=0 2024-03-30T13:14:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.939+0000 7fc8d498c740 1 client.5964 shutdown 2024-03-30T13:14:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.940+0000 7fc8d498c740 1 -- 172.21.15.44:0/2258158250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 msgr2=0x560bd32c70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.940+0000 7fc8d498c740 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd32c70f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00cfd0 tx=0x7fc8bc000bc0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.940+0000 7fc8d498c740 1 -- 172.21.15.44:0/2258158250 shutdown_connections 2024-03-30T13:14:43.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.940+0000 7fc8d498c740 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560bd329e460 0x560bd329e860 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.940+0000 7fc8d498c740 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd329fda0 0x560bd32b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.940+0000 7fc8d498c740 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd3272850 0x560bd32b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.940+0000 7fc8d498c740 1 --2- 172.21.15.44:0/2258158250 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd32c70f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.940+0000 7fc8d498c740 1 -- 172.21.15.44:0/2258158250 >> 172.21.15.44:0/2258158250 conn(0x560bd3238be0 msgr2=0x560bd326bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.940+0000 7fc8abe00640 0 client.5964 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.940+0000 7fc8d498c740 1 -- 172.21.15.44:0/2258158250 shutdown_connections 2024-03-30T13:14:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.940+0000 7fc8d498c740 1 -- 172.21.15.44:0/2258158250 wait complete. 2024-03-30T13:14:43.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.940+0000 7fc8d498c740 20 client.5964 trim_cache size 0 max 16384 2024-03-30T13:14:43.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.960+0000 7fc8d498c740 1 Processor -- start 2024-03-30T13:14:43.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.960+0000 7fc8d498c740 1 -- start start 2024-03-30T13:14:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.961+0000 7fc8d498c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd32b6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.961+0000 7fc8d498c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd3272850 0x560bd32b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.961+0000 7fc8d498c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd329fda0 0x560bd32d8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.961+0000 7fc8d498c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc200de0 con 0x560bd3272470 2024-03-30T13:14:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.961+0000 7fc8d498c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc1ffe80 con 0x560bd329fda0 2024-03-30T13:14:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.961+0000 7fc8d498c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc8cc0b4790 con 0x560bd3272850 2024-03-30T13:14:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.961+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd32b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.961+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd32b6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34158/0 (socket says 172.21.15.44:34158) 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.962+0000 7fc8caa00640 1 -- 172.21.15.44:0/3226742727 learned_addr learned my addr 172.21.15.44:0/3226742727 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.962+0000 7fc8caa00640 1 -- 172.21.15.44:0/3226742727 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd3272850 msgr2=0x560bd32b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.962+0000 7fc8caa00640 1 --2- 172.21.15.44:0/3226742727 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd3272850 0x560bd32b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.962+0000 7fc8caa00640 1 -- 172.21.15.44:0/3226742727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd329fda0 msgr2=0x560bd32d8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.962+0000 7fc8caa00640 1 --2- 172.21.15.44:0/3226742727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd329fda0 0x560bd32d8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.962+0000 7fc8caa00640 1 -- 172.21.15.44:0/3226742727 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bd2e822d0 con 0x560bd3272470 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.962+0000 7fc8caa00640 1 --2- 172.21.15.44:0/3226742727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd32b6740 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc061960 tx=0x7fc8bc088000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e666949517cc53c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.962+0000 7fc8b6a00640 1 -- 172.21.15.44:0/3226742727 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc071040 con 0x560bd3272470 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.962+0000 7fc8b6a00640 1 -- 172.21.15.44:0/3226742727 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8bc077070 con 0x560bd3272470 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.962+0000 7fc8b6a00640 1 -- 172.21.15.44:0/3226742727 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc059770 con 0x560bd3272470 2024-03-30T13:14:43.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.963+0000 7fc8d498c740 1 -- 172.21.15.44:0/3226742727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 msgr2=0x560bd32b6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.963+0000 7fc8d498c740 1 --2- 172.21.15.44:0/3226742727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd32b6740 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc061960 tx=0x7fc8bc088000 comp rx=0 tx=0).stop 2024-03-30T13:14:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.963+0000 7fc8d498c740 1 -- 172.21.15.44:0/3226742727 shutdown_connections 2024-03-30T13:14:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.963+0000 7fc8d498c740 1 --2- 172.21.15.44:0/3226742727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd329fda0 0x560bd32d8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.963+0000 7fc8d498c740 1 --2- 172.21.15.44:0/3226742727 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd3272850 0x560bd32b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.963+0000 7fc8d498c740 1 --2- 172.21.15.44:0/3226742727 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272470 0x560bd32b6740 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.963+0000 7fc8d498c740 1 -- 172.21.15.44:0/3226742727 >> 172.21.15.44:0/3226742727 conn(0x560bd3238be0 msgr2=0x560bd3267b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.963+0000 7fc8d498c740 1 -- 172.21.15.44:0/3226742727 shutdown_connections 2024-03-30T13:14:43.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.963+0000 7fc8d498c740 1 -- 172.21.15.44:0/3226742727 wait complete. 2024-03-30T13:14:43.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.964+0000 7fc8d498c740 1 -- start start 2024-03-30T13:14:43.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.964+0000 7fc8d498c740 1 Processor -- start 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.965+0000 7fc8d498c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd3272470 0x560bd32d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.965+0000 7fc8d498c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272850 0x560bd32d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.965+0000 7fc8d498c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd329fda0 0x560bd33323a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.965+0000 7fc8d498c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x560bd3299160 con 0x560bd3272850 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.965+0000 7fc8d498c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc1ff900 con 0x560bd3272470 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.965+0000 7fc8d498c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x560bd33332b0 con 0x560bd329fda0 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.965+0000 7fc8d498c740 10 client.0 _ll_register_callbacks cb 0x7fc8bc058ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.965+0000 7fc8ca000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272850 0x560bd32d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.966+0000 7fc8ca000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272850 0x560bd32d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34166/0 (socket says 172.21.15.44:34166) 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.966+0000 7fc8ca000640 1 -- 172.21.15.44:0/518534488 learned_addr learned my addr 172.21.15.44:0/518534488 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.966+0000 7fc8ca000640 1 -- 172.21.15.44:0/518534488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd329fda0 msgr2=0x560bd33323a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.966+0000 7fc8ca000640 1 --2- 172.21.15.44:0/518534488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd329fda0 0x560bd33323a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.966+0000 7fc8ca000640 1 -- 172.21.15.44:0/518534488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd3272470 msgr2=0x560bd32d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.966+0000 7fc8caa00640 1 --2- 172.21.15.44:0/518534488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd3272470 0x560bd32d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.966+0000 7fc8ca000640 1 --2- 172.21.15.44:0/518534488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd3272470 0x560bd32d0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.966+0000 7fc8ca000640 1 -- 172.21.15.44:0/518534488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bd32ba140 con 0x560bd3272850 2024-03-30T13:14:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.966+0000 7fc8ca000640 1 --2- 172.21.15.44:0/518534488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272850 0x560bd32d10a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800fa60 tx=0x7fc8b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69c1479679b843f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.966+0000 7fc8abe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.966+0000 7fc8abe00640 1 -- 172.21.15.44:0/518534488 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8005e60 con 0x560bd3272850 2024-03-30T13:14:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8abe00640 1 -- 172.21.15.44:0/518534488 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc8b80148b0 con 0x560bd3272850 2024-03-30T13:14:43.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8d498c740 1 -- 172.21.15.44:0/518534488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8bc077070 con 0x560bd3272850 2024-03-30T13:14:43.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8abe00640 1 -- 172.21.15.44:0/518534488 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc8b8014af0 con 0x560bd3272850 2024-03-30T13:14:43.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8d498c740 10 client.5970 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:43.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8d498c740 1 -- 172.21.15.44:0/518534488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x560bd32bacc0 con 0x560bd3272850 2024-03-30T13:14:43.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8abe00640 1 -- 172.21.15.44:0/518534488 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8bc077070 con 0x560bd3272850 2024-03-30T13:14:43.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8abe00640 1 -- 172.21.15.44:0/518534488 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fc8b8035020 con 0x560bd3272850 2024-03-30T13:14:43.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8d498c740 10 client.5970 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:43.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8d498c740 10 client.5970 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:43.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8d498c740 20 client.5970 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8d498c740 1 --2- 172.21.15.44:0/518534488 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560bd332c2d0 0x560bd33328e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8d498c740 4 client.5970 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628344}] 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.967+0000 7fc8d498c740 1 -- 172.21.15.44:0/518534488 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628344}) -- 0x560bd31dcbc0 con 0x560bd332c2d0 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.968+0000 7fc8caa00640 1 --2- 172.21.15.44:0/518534488 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560bd332c2d0 0x560bd33328e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.968+0000 7fc8caa00640 1 --2- 172.21.15.44:0/518534488 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560bd332c2d0 0x560bd33328e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17a41602ccb23fc5 server_cookie=c447b02b6be24740 in_seq=0 out_seq=0 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.968+0000 7fc8abe00640 10 client.5970 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8abe00640 1 -- 172.21.15.44:0/518534488 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3983 (crc 0 0 0) 0x560bd31dcbc0 con 0x560bd332c2d0 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8abe00640 10 client.5970 handle_command_reply: tid=0 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8d498c740 1 client.5970 shutdown 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8d498c740 1 -- 172.21.15.44:0/518534488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272850 msgr2=0x560bd32d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8d498c740 1 --2- 172.21.15.44:0/518534488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272850 0x560bd32d10a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800fa60 tx=0x7fc8b80046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8d498c740 1 -- 172.21.15.44:0/518534488 shutdown_connections 2024-03-30T13:14:43.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8d498c740 1 --2- 172.21.15.44:0/518534488 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x560bd332c2d0 0x560bd33328e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8d498c740 1 --2- 172.21.15.44:0/518534488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560bd329fda0 0x560bd33323a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8d498c740 1 --2- 172.21.15.44:0/518534488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x560bd3272850 0x560bd32d10a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8d498c740 1 --2- 172.21.15.44:0/518534488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560bd3272470 0x560bd32d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8d498c740 1 -- 172.21.15.44:0/518534488 >> 172.21.15.44:0/518534488 conn(0x560bd3238be0 msgr2=0x560bd3267b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8abe00640 0 client.5970 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:43.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8d498c740 1 -- 172.21.15.44:0/518534488 shutdown_connections 2024-03-30T13:14:43.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8d498c740 1 -- 172.21.15.44:0/518534488 wait complete. 2024-03-30T13:14:43.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.969+0000 7fc8d498c740 20 client.5970 trim_cache size 0 max 16384 2024-03-30T13:14:43.979 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:43.980 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-dev-proto.h", 2024-03-30T13:14:43.980 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628344, 2024-03-30T13:14:43.980 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:43.980 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.347610+0000", 2024-03-30T13:14:43.980 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.422255+0000", 2024-03-30T13:14:43.980 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:43.980 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:43.980 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:43.980 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:43.980 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:43.980 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:43.981 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:43.981 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:43.981 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:43.981 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.981 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:43.981 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:43.981 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:43.981 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:43.981 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:43.981 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:43.982 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.982 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:43.982 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2111, 2024-03-30T13:14:43.982 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:43.982 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:43.982 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:43.982 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:43.982 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:43.982 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.422255+0000", 2024-03-30T13:14:43.982 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 4, 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:43.983 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 2111, 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.347610+0000" 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 2111, 2024-03-30T13:14:43.984 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.347610+0000" 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 208, 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 34, 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:43.985 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:11.006758+0000", 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 92, 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:43.986 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:43.987 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:43.988 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:43.989 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:43.990 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:43.991 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:43.992 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:43.993 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:43.994 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:43.994 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:43.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.970+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc8ac06c530 msgr2=0x7fc8ac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.970+0000 7fc8cbe00640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc8ac06c530 0x7fc8ac06e9f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8006fd0 tx=0x7fc8b8008040 comp rx=0 tx=0).stop 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.970+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2903815747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8cc06e980 msgr2=0x7fc8cc146aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.970+0000 7fc8cbe00640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8cc06e980 0x7fc8cc146aa0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c460 tx=0x7fc8bc00c920 comp rx=0 tx=0).stop 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.970+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2903815747 shutdown_connections 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.970+0000 7fc8cbe00640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8cc0ae9d0 0x7fc8cc06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.970+0000 7fc8cbe00640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc8ac06c530 0x7fc8ac06e9f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.970+0000 7fc8cbe00640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8cc0acd60 0x7fc8cc0c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.970+0000 7fc8cbe00640 1 --2- 172.21.15.44:0/2903815747 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8cc06e980 0x7fc8cc146aa0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.970+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2903815747 >> 172.21.15.44:0/2903815747 conn(0x7fc8cc0cfd90 msgr2=0x7fc8cc06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.970+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2903815747 shutdown_connections 2024-03-30T13:14:43.996 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:43.970+0000 7fc8cbe00640 1 -- 172.21.15.44:0/2903815747 wait complete. 2024-03-30T13:14:43.997 DEBUG:tasks.cephfs.test_uninlining:getting inode info #21 of 23:1099511628329 2024-03-30T13:14:43.997 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628329 2024-03-30T13:14:43.997 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628329 2024-03-30T13:14:44.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.205+0000 7f4ab1600640 1 Processor -- start 2024-03-30T13:14:44.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.205+0000 7f4ab1600640 1 -- start start 2024-03-30T13:14:44.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.207+0000 7f4ab1600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4aac145d70 0x7f4aac160880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.207+0000 7f4ab1600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4aac0ce490 0x7f4aac0cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.207+0000 7f4ab1600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aac0cc970 con 0x7f4aac0d0290 2024-03-30T13:14:44.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.207+0000 7f4ab1600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f4aac0ce8f0 con 0x7f4aac0ce490 2024-03-30T13:14:44.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.207+0000 7f4ab1600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f4aac146150 con 0x7f4aac145d70 2024-03-30T13:14:44.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.207+0000 7f4aaa000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4aac0ce490 0x7f4aac0cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.207+0000 7f4aaa000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f4aac0ce490 0x7f4aac0cfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34176/0 (socket says 172.21.15.44:34176) 2024-03-30T13:14:44.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.207+0000 7f4aaa000640 1 -- 172.21.15.44:0/2852237785 learned_addr learned my addr 172.21.15.44:0/2852237785 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.207+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/2852237785 >> v2:172.21.15.151:3300/0 conn(0x7f4aac145d70 0x7f4aac160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.208+0000 7f4aaa000640 1 -- 172.21.15.44:0/2852237785 >> v2:172.21.15.151:3300/0 conn(0x7f4aac145d70 msgr2=0x7f4aac160880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.208+0000 7f4aaa000640 1 --2- 172.21.15.44:0/2852237785 >> v2:172.21.15.151:3300/0 conn(0x7f4aac145d70 0x7f4aac160880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.208+0000 7f4aaa000640 1 -- 172.21.15.44:0/2852237785 >> v1:172.21.15.151:6789/0 conn(0x7f4aac0d0290 legacy=0x7f4aac15ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.208+0000 7f4aaa000640 1 -- 172.21.15.44:0/2852237785 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac0ccc50 con 0x7f4aac0ce490 2024-03-30T13:14:44.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.209+0000 7f4aaa000640 1 --2- 172.21.15.44:0/2852237785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aac0ce490 0x7f4aac0cfd50 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0ceb60 tx=0x7f4a9802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f46c766a2806f0b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.209+0000 7f4aa9600640 1 -- 172.21.15.44:0/2852237785 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9802e070 con 0x7f4aac0ce490 2024-03-30T13:14:44.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.209+0000 7f4aa9600640 1 -- 172.21.15.44:0/2852237785 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a98037070 con 0x7f4aac0ce490 2024-03-30T13:14:44.214 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.209+0000 7f4aa9600640 1 -- 172.21.15.44:0/2852237785 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98031a00 con 0x7f4aac0ce490 2024-03-30T13:14:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.210+0000 7f4ab1600640 1 -- 172.21.15.44:0/2852237785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aac0ce490 msgr2=0x7f4aac0cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.210+0000 7f4ab1600640 1 --2- 172.21.15.44:0/2852237785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aac0ce490 0x7f4aac0cfd50 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0ceb60 tx=0x7f4a9802b880 comp rx=0 tx=0).stop 2024-03-30T13:14:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.210+0000 7f4ab1600640 1 -- 172.21.15.44:0/2852237785 shutdown_connections 2024-03-30T13:14:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.210+0000 7f4ab1600640 1 --2- 172.21.15.44:0/2852237785 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aac0ce490 0x7f4aac0cfd50 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.210+0000 7f4ab1600640 1 --2- 172.21.15.44:0/2852237785 >> v2:172.21.15.151:3300/0 conn(0x7f4aac145d70 0x7f4aac160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.210+0000 7f4ab1600640 1 -- 172.21.15.44:0/2852237785 >> 172.21.15.44:0/2852237785 conn(0x7f4aac0b3e70 msgr2=0x7f4aac0b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.210+0000 7f4ab1600640 1 -- 172.21.15.44:0/2852237785 shutdown_connections 2024-03-30T13:14:44.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.210+0000 7f4ab1600640 1 -- 172.21.15.44:0/2852237785 wait complete. 2024-03-30T13:14:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.212+0000 7f4ab1600640 1 Processor -- start 2024-03-30T13:14:44.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.212+0000 7f4ab1600640 1 -- start start 2024-03-30T13:14:44.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.213+0000 7f4ab1600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aac0ce490 0x7f4aac156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.213+0000 7f4ab1600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aac0d0290 0x7f4aac154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.213+0000 7f4ab1600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aac145d70 0x7f4aac1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.213+0000 7f4ab1600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac0ccf30 con 0x7f4aac0ce490 2024-03-30T13:14:44.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.213+0000 7f4ab1600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac15ca20 con 0x7f4aac145d70 2024-03-30T13:14:44.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.213+0000 7f4ab1600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4aac15d5c0 con 0x7f4aac0d0290 2024-03-30T13:14:44.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.214+0000 7f4aaaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aac0ce490 0x7f4aac156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.214+0000 7f4aaaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aac0ce490 0x7f4aac156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34192/0 (socket says 172.21.15.44:34192) 2024-03-30T13:14:44.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.214+0000 7f4aaaa00640 1 -- 172.21.15.44:0/3150208903 learned_addr learned my addr 172.21.15.44:0/3150208903 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.214+0000 7f4aaaa00640 1 -- 172.21.15.44:0/3150208903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aac0d0290 msgr2=0x7f4aac154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.214+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/3150208903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aac0d0290 0x7f4aac154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.214+0000 7f4aaaa00640 1 -- 172.21.15.44:0/3150208903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aac145d70 msgr2=0x7f4aac1594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.214+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/3150208903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aac145d70 0x7f4aac1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.214+0000 7f4aaaa00640 1 -- 172.21.15.44:0/3150208903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac06d510 con 0x7f4aac0ce490 2024-03-30T13:14:44.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.214+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/3150208903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aac0ce490 0x7f4aac156090 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00d5f0 tx=0x7f4a9c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.215+0000 7f4aa2a00640 1 -- 172.21.15.44:0/3150208903 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c0125f0 con 0x7f4aac0ce490 2024-03-30T13:14:44.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.215+0000 7f4aa2a00640 1 -- 172.21.15.44:0/3150208903 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c019070 con 0x7f4aac0ce490 2024-03-30T13:14:44.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.215+0000 7f4aa2a00640 1 -- 172.21.15.44:0/3150208903 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c0129d0 con 0x7f4aac0ce490 2024-03-30T13:14:44.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.215+0000 7f4ab1600640 1 -- 172.21.15.44:0/3150208903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aac06d7f0 con 0x7f4aac0ce490 2024-03-30T13:14:44.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.215+0000 7f4ab1600640 1 -- 172.21.15.44:0/3150208903 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aac06ddb0 con 0x7f4aac0ce490 2024-03-30T13:14:44.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.217+0000 7f4aa2a00640 1 -- 172.21.15.44:0/3150208903 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4a9c012b70 con 0x7f4aac0ce490 2024-03-30T13:14:44.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.218+0000 7f4aa2a00640 1 --2- 172.21.15.44:0/3150208903 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4a8c06c530 0x7f4a8c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.218+0000 7f4aa2a00640 1 -- 172.21.15.44:0/3150208903 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f4a9c08bd30 con 0x7f4aac0ce490 2024-03-30T13:14:44.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.219+0000 7f4aaa000640 1 --2- 172.21.15.44:0/3150208903 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4a8c06c530 0x7f4a8c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.219+0000 7f4ab421d740 1 Processor -- start 2024-03-30T13:14:44.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.219+0000 7f4ab421d740 1 -- start start 2024-03-30T13:14:44.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.220+0000 7f4ab421d740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960c91290 0x562960cb7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.220+0000 7f4ab421d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cb8300 0x562960c902d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.220+0000 7f4ab421d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91670 0x562960c90810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.220+0000 7f4ab421d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562960bf4330 con 0x562960cb8300 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.220+0000 7f4ab421d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562960b9c620 con 0x562960c91670 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.220+0000 7f4ab421d740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x562960bf0440 con 0x562960c91290 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.220+0000 7f4aaa000640 1 --2- 172.21.15.44:0/3150208903 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4a8c06c530 0x7f4a8c06e9f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4a98036000 tx=0x7f4a98030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.220+0000 7f4aaa000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cb8300 0x562960c902d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.220+0000 7f4aaa000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cb8300 0x562960c902d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34204/0 (socket says 172.21.15.44:34204) 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.220+0000 7f4aaa000640 1 -- 172.21.15.44:0/1572863902 learned_addr learned my addr 172.21.15.44:0/1572863902 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.220+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/1572863902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960c91290 0x562960cb7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.221+0000 7f4aab400640 1 --2- 172.21.15.44:0/1572863902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91670 0x562960c90810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.221+0000 7f4aaa000640 1 -- 172.21.15.44:0/1572863902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960c91290 msgr2=0x562960cb7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.221+0000 7f4aaa000640 1 --2- 172.21.15.44:0/1572863902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960c91290 0x562960cb7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.221+0000 7f4aaa000640 1 -- 172.21.15.44:0/1572863902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91670 msgr2=0x562960c90810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.221+0000 7f4aaa000640 1 --2- 172.21.15.44:0/1572863902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91670 0x562960c90810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.221+0000 7f4aaa000640 1 -- 172.21.15.44:0/1572863902 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629609d4920 con 0x562960cb8300 2024-03-30T13:14:44.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.221+0000 7f4aab400640 1 --2- 172.21.15.44:0/1572863902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91670 0x562960c90810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.221+0000 7f4aaa000640 1 --2- 172.21.15.44:0/1572863902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cb8300 0x562960c902d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4a98034040 tx=0x7f4a98031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e9810d808cef3e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.221+0000 7f4a97000640 1 -- 172.21.15.44:0/1572863902 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98041070 con 0x562960cb8300 2024-03-30T13:14:44.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.222+0000 7f4a97000640 1 -- 172.21.15.44:0/1572863902 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a98037040 con 0x562960cb8300 2024-03-30T13:14:44.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.222+0000 7f4a97000640 1 -- 172.21.15.44:0/1572863902 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98032e20 con 0x562960cb8300 2024-03-30T13:14:44.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.222+0000 7f4ab421d740 1 -- 172.21.15.44:0/1572863902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cb8300 msgr2=0x562960c902d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.222+0000 7f4ab421d740 1 --2- 172.21.15.44:0/1572863902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cb8300 0x562960c902d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f4a98034040 tx=0x7f4a98031000 comp rx=0 tx=0).stop 2024-03-30T13:14:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.222+0000 7f4ab421d740 1 -- 172.21.15.44:0/1572863902 shutdown_connections 2024-03-30T13:14:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.222+0000 7f4ab421d740 1 --2- 172.21.15.44:0/1572863902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91670 0x562960c90810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.222+0000 7f4ab421d740 1 --2- 172.21.15.44:0/1572863902 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cb8300 0x562960c902d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.222+0000 7f4ab421d740 1 --2- 172.21.15.44:0/1572863902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960c91290 0x562960cb7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.222+0000 7f4ab421d740 1 -- 172.21.15.44:0/1572863902 >> 172.21.15.44:0/1572863902 conn(0x562960c57be0 msgr2=0x562960cd5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.222+0000 7f4ab421d740 1 -- 172.21.15.44:0/1572863902 shutdown_connections 2024-03-30T13:14:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.222+0000 7f4ab421d740 1 -- 172.21.15.44:0/1572863902 wait complete. 2024-03-30T13:14:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.223+0000 7f4ab421d740 1 -- start start 2024-03-30T13:14:44.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.223+0000 7f4ab421d740 1 Processor -- start 2024-03-30T13:14:44.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.224+0000 7f4ab421d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91290 0x562960ce9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.224+0000 7f4ab421d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91670 0x562960ca44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.224+0000 7f4ab421d740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960cbf200 0x562960cd9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.224+0000 7f4ab421d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562960cb7930 con 0x562960c91290 2024-03-30T13:14:44.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.224+0000 7f4ab421d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562960baf9d0 con 0x562960c91670 2024-03-30T13:14:44.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.224+0000 7f4ab421d740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x562960cb06b0 con 0x562960cbf200 2024-03-30T13:14:44.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.224+0000 7f4ab421d740 10 client.0 _ll_register_callbacks cb 0x562960bebfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:44.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.225+0000 7f4aaaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91290 0x562960ce9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.225+0000 7f4aaaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91290 0x562960ce9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34210/0 (socket says 172.21.15.44:34210) 2024-03-30T13:14:44.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.225+0000 7f4aaaa00640 1 -- 172.21.15.44:0/2811707463 learned_addr learned my addr 172.21.15.44:0/2811707463 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.225+0000 7f4aaaa00640 1 -- 172.21.15.44:0/2811707463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960cbf200 msgr2=0x562960cd9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.225+0000 7f4aab400640 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960cbf200 0x562960cd9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.225+0000 7f4aaa000640 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91670 0x562960ca44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.225+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960cbf200 0x562960cd9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.225+0000 7f4aaaa00640 1 -- 172.21.15.44:0/2811707463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91670 msgr2=0x562960ca44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.225+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91670 0x562960ca44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.225+0000 7f4aaaa00640 1 -- 172.21.15.44:0/2811707463 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629608c8210 con 0x562960c91290 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.225+0000 7f4aab400640 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960cbf200 0x562960cd9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.226+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91290 0x562960ce9c80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c059700 tx=0x7f4a9c05a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d09ae0dd8dfe6ac server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.226+0000 7f4a8b400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.226+0000 7f4a8b400640 1 -- 172.21.15.44:0/2811707463 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c088060 con 0x562960c91290 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.226+0000 7f4a8b400640 1 -- 172.21.15.44:0/2811707463 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f4a9c056070 con 0x562960c91290 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.226+0000 7f4ab421d740 1 -- 172.21.15.44:0/2811707463 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a98037040 con 0x562960c91290 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.226+0000 7f4a8b400640 1 -- 172.21.15.44:0/2811707463 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4a9c0625e0 con 0x562960c91290 2024-03-30T13:14:44.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.226+0000 7f4ab421d740 10 client.5982 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.226+0000 7f4ab421d740 1 -- 172.21.15.44:0/2811707463 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x562960a350b0 con 0x562960c91290 2024-03-30T13:14:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.226+0000 7f4a8b400640 1 -- 172.21.15.44:0/2811707463 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c07b080 con 0x562960c91290 2024-03-30T13:14:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.226+0000 7f4a8b400640 1 -- 172.21.15.44:0/2811707463 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f4a9c013070 con 0x562960c91290 2024-03-30T13:14:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.227+0000 7f4ab421d740 10 client.5982 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.227+0000 7f4ab421d740 10 client.5982 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.227+0000 7f4ab421d740 20 client.5982 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.227+0000 7f4ab421d740 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562960cd3910 0x562960cd3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.227+0000 7f4ab421d740 4 client.5982 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.227+0000 7f4ab421d740 1 -- 172.21.15.44:0/2811707463 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562960c01870 con 0x562960cd3910 2024-03-30T13:14:44.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.227+0000 7f4aaa000640 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562960cd3910 0x562960cd3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.228+0000 7f4aaa000640 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562960cd3910 0x562960cd3da0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=572e0b75432dd07d server_cookie=d1c4045970e67607 in_seq=0 out_seq=0 2024-03-30T13:14:44.235 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.228+0000 7f4a8b400640 10 client.5982 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.228+0000 7f4a8b400640 1 -- 172.21.15.44:0/2811707463 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x562960c01870 con 0x562960cd3910 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.228+0000 7f4a8b400640 10 client.5982 handle_command_reply: tid=0 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.228+0000 7f4ab421d740 1 client.5982 shutdown 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.229+0000 7f4ab421d740 1 -- 172.21.15.44:0/2811707463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91290 msgr2=0x562960ce9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.229+0000 7f4ab421d740 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91290 0x562960ce9c80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c059700 tx=0x7f4a9c05a240 comp rx=0 tx=0).stop 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.229+0000 7f4ab421d740 1 -- 172.21.15.44:0/2811707463 shutdown_connections 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.229+0000 7f4ab421d740 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562960cd3910 0x562960cd3da0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.229+0000 7f4ab421d740 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960cbf200 0x562960cd9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.229+0000 7f4ab421d740 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91670 0x562960ca44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.229+0000 7f4ab421d740 1 --2- 172.21.15.44:0/2811707463 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91290 0x562960ce9c80 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.229+0000 7f4a8b400640 0 client.5982 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.229+0000 7f4ab421d740 1 -- 172.21.15.44:0/2811707463 >> 172.21.15.44:0/2811707463 conn(0x562960c57be0 msgr2=0x562960cb6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.229+0000 7f4ab421d740 1 -- 172.21.15.44:0/2811707463 shutdown_connections 2024-03-30T13:14:44.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.229+0000 7f4ab421d740 1 -- 172.21.15.44:0/2811707463 wait complete. 2024-03-30T13:14:44.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.229+0000 7f4ab421d740 20 client.5982 trim_cache size 0 max 16384 2024-03-30T13:14:44.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.245+0000 7f4ab421d740 1 Processor -- start 2024-03-30T13:14:44.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.245+0000 7f4ab421d740 1 -- start start 2024-03-30T13:14:44.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.246+0000 7f4ab421d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91290 0x562960cbc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.246+0000 7f4ab421d740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960c91670 0x562960d4c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.246+0000 7f4ab421d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cbf200 0x562960d4c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.246+0000 7f4ab421d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac201170 con 0x562960cbf200 2024-03-30T13:14:44.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.246+0000 7f4ab421d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac200190 con 0x562960c91290 2024-03-30T13:14:44.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.246+0000 7f4ab421d740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4aac1f8400 con 0x562960c91670 2024-03-30T13:14:44.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.246+0000 7f4aab400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cbf200 0x562960d4c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.246+0000 7f4aab400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cbf200 0x562960d4c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34212/0 (socket says 172.21.15.44:34212) 2024-03-30T13:14:44.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.246+0000 7f4aab400640 1 -- 172.21.15.44:0/4170931319 learned_addr learned my addr 172.21.15.44:0/4170931319 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.247+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/4170931319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91290 0x562960cbc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.247+0000 7f4aaa000640 1 --2- 172.21.15.44:0/4170931319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960c91670 0x562960d4c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.247+0000 7f4aab400640 1 -- 172.21.15.44:0/4170931319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960c91670 msgr2=0x562960d4c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.247+0000 7f4aab400640 1 --2- 172.21.15.44:0/4170931319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960c91670 0x562960d4c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.247+0000 7f4aab400640 1 -- 172.21.15.44:0/4170931319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91290 msgr2=0x562960cbc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.247+0000 7f4aab400640 1 --2- 172.21.15.44:0/4170931319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91290 0x562960cbc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.247+0000 7f4aab400640 1 -- 172.21.15.44:0/4170931319 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562960cb8130 con 0x562960cbf200 2024-03-30T13:14:44.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.247+0000 7f4aab400640 1 --2- 172.21.15.44:0/4170931319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cbf200 0x562960d4c940 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4005360 tx=0x7f4aa4005820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae5de95c75a2b23 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.248+0000 7f4a96600640 1 -- 172.21.15.44:0/4170931319 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4017030 con 0x562960cbf200 2024-03-30T13:14:44.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.248+0000 7f4a96600640 1 -- 172.21.15.44:0/4170931319 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa400c070 con 0x562960cbf200 2024-03-30T13:14:44.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.248+0000 7f4a96600640 1 -- 172.21.15.44:0/4170931319 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4006d70 con 0x562960cbf200 2024-03-30T13:14:44.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.248+0000 7f4ab421d740 1 -- 172.21.15.44:0/4170931319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cbf200 msgr2=0x562960d4c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.248+0000 7f4ab421d740 1 --2- 172.21.15.44:0/4170931319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cbf200 0x562960d4c940 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4005360 tx=0x7f4aa4005820 comp rx=0 tx=0).stop 2024-03-30T13:14:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.248+0000 7f4ab421d740 1 -- 172.21.15.44:0/4170931319 shutdown_connections 2024-03-30T13:14:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.248+0000 7f4ab421d740 1 --2- 172.21.15.44:0/4170931319 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960cbf200 0x562960d4c940 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.248+0000 7f4ab421d740 1 --2- 172.21.15.44:0/4170931319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960c91670 0x562960d4c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.248+0000 7f4ab421d740 1 --2- 172.21.15.44:0/4170931319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91290 0x562960cbc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.248+0000 7f4ab421d740 1 -- 172.21.15.44:0/4170931319 >> 172.21.15.44:0/4170931319 conn(0x562960c57be0 msgr2=0x562960cd90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.248+0000 7f4ab421d740 1 -- 172.21.15.44:0/4170931319 shutdown_connections 2024-03-30T13:14:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.248+0000 7f4ab421d740 1 -- 172.21.15.44:0/4170931319 wait complete. 2024-03-30T13:14:44.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.249+0000 7f4ab421d740 1 -- start start 2024-03-30T13:14:44.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.249+0000 7f4ab421d740 1 Processor -- start 2024-03-30T13:14:44.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.250+0000 7f4ab421d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91290 0x562960d52840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.250+0000 7f4ab421d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91670 0x562960ca39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.250+0000 7f4ab421d740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960cbf200 0x562960ce4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.250+0000 7f4ab421d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562960c01fa0 con 0x562960c91670 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.250+0000 7f4ab421d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1ffc60 con 0x562960c91290 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.250+0000 7f4ab421d740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x562960cd4330 con 0x562960cbf200 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.250+0000 7f4ab421d740 10 client.0 _ll_register_callbacks cb 0x7f4a9c055ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.251+0000 7f4aaa000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91670 0x562960ca39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.251+0000 7f4aaa000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91670 0x562960ca39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34220/0 (socket says 172.21.15.44:34220) 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.251+0000 7f4aaa000640 1 -- 172.21.15.44:0/2365468993 learned_addr learned my addr 172.21.15.44:0/2365468993 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.251+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91290 0x562960d52840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.251+0000 7f4aab400640 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960cbf200 0x562960ce4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.251+0000 7f4aaa000640 1 -- 172.21.15.44:0/2365468993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960cbf200 msgr2=0x562960ce4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.251+0000 7f4aaa000640 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960cbf200 0x562960ce4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.251+0000 7f4aaa000640 1 -- 172.21.15.44:0/2365468993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91290 msgr2=0x562960d52840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.251+0000 7f4aaa000640 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91290 0x562960d52840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.251+0000 7f4aaa000640 1 -- 172.21.15.44:0/2365468993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629608a12d0 con 0x562960c91670 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.251+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91290 0x562960d52840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.251+0000 7f4aab400640 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960cbf200 0x562960ce4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.252+0000 7f4aaa000640 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91670 0x562960ca39c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4a980319c0 tx=0x7f4a98004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba07605d8c8f6ca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.252+0000 7f4a8b400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.252+0000 7f4a8b400640 1 -- 172.21.15.44:0/2365468993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98041040 con 0x562960c91670 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.252+0000 7f4ab421d740 1 -- 172.21.15.44:0/2365468993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aa400c070 con 0x562960c91670 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.252+0000 7f4a8b400640 1 -- 172.21.15.44:0/2365468993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f4a98004450 con 0x562960c91670 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.252+0000 7f4a8b400640 1 -- 172.21.15.44:0/2365468993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4a98065050 con 0x562960c91670 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.252+0000 7f4ab421d740 10 client.5988 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.252+0000 7f4ab421d740 1 -- 172.21.15.44:0/2365468993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x562960ce5040 con 0x562960c91670 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.252+0000 7f4a8b400640 1 -- 172.21.15.44:0/2365468993 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa400c070 con 0x562960c91670 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.253+0000 7f4a8b400640 1 -- 172.21.15.44:0/2365468993 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f4a98068020 con 0x562960c91670 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.253+0000 7f4ab421d740 10 client.5988 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.253+0000 7f4ab421d740 10 client.5988 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:44.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.253+0000 7f4ab421d740 20 client.5988 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:44.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.253+0000 7f4ab421d740 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562960cb5ef0 0x562960cd90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.253+0000 7f4ab421d740 4 client.5988 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628329}] 2024-03-30T13:14:44.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.253+0000 7f4ab421d740 1 -- 172.21.15.44:0/2365468993 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628329}) -- 0x562960bfbbc0 con 0x562960cb5ef0 2024-03-30T13:14:44.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.253+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562960cb5ef0 0x562960cd90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4aaaa00640 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562960cb5ef0 0x562960cd90b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=355c8ab347baac6c server_cookie=7024b6e0b43379ab in_seq=0 out_seq=0 2024-03-30T13:14:44.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4a8b400640 10 client.5988 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:44.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4a8b400640 1 -- 172.21.15.44:0/2365468993 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3968 (crc 0 0 0) 0x562960bfbbc0 con 0x562960cb5ef0 2024-03-30T13:14:44.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4a8b400640 10 client.5988 handle_command_reply: tid=0 2024-03-30T13:14:44.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4ab421d740 1 client.5988 shutdown 2024-03-30T13:14:44.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4ab421d740 1 -- 172.21.15.44:0/2365468993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91670 msgr2=0x562960ca39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4ab421d740 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91670 0x562960ca39c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4a980319c0 tx=0x7f4a98004730 comp rx=0 tx=0).stop 2024-03-30T13:14:44.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4ab421d740 1 -- 172.21.15.44:0/2365468993 shutdown_connections 2024-03-30T13:14:44.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4ab421d740 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562960cb5ef0 0x562960cd90b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4ab421d740 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562960cbf200 0x562960ce4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4ab421d740 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562960c91670 0x562960ca39c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4ab421d740 1 --2- 172.21.15.44:0/2365468993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562960c91290 0x562960d52840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4ab421d740 1 -- 172.21.15.44:0/2365468993 >> 172.21.15.44:0/2365468993 conn(0x562960c57be0 msgr2=0x562960cf0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4a8b400640 0 client.5988 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:44.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.254+0000 7f4ab421d740 1 -- 172.21.15.44:0/2365468993 shutdown_connections 2024-03-30T13:14:44.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.255+0000 7f4ab421d740 1 -- 172.21.15.44:0/2365468993 wait complete. 2024-03-30T13:14:44.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.255+0000 7f4ab421d740 20 client.5988 trim_cache size 0 max 16384 2024-03-30T13:14:44.263 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/Makefile", 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628329, 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.349002+0000", 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.396256+0000", 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:44.264 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 356, 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:44.265 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.396256+0000", 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:44.266 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 356, 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.349002+0000" 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 356, 2024-03-30T13:14:44.267 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.349002+0000" 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 170, 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 4, 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:44.268 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:11.005693+0000", 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 102, 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.269 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.270 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.271 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:44.272 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:44.273 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:44.274 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:44.275 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:44.276 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:44.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.255+0000 7f4ab1600640 1 -- 172.21.15.44:0/3150208903 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4a8c06c530 msgr2=0x7f4a8c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.255+0000 7f4ab1600640 1 --2- 172.21.15.44:0/3150208903 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4a8c06c530 0x7f4a8c06e9f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4a98036000 tx=0x7f4a98030000 comp rx=0 tx=0).stop 2024-03-30T13:14:44.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.255+0000 7f4ab1600640 1 -- 172.21.15.44:0/3150208903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aac0ce490 msgr2=0x7f4aac156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.255+0000 7f4ab1600640 1 --2- 172.21.15.44:0/3150208903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aac0ce490 0x7f4aac156090 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c00d5f0 tx=0x7f4a9c00dab0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.255+0000 7f4ab1600640 1 -- 172.21.15.44:0/3150208903 shutdown_connections 2024-03-30T13:14:44.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.255+0000 7f4ab1600640 1 --2- 172.21.15.44:0/3150208903 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4a8c06c530 0x7f4a8c06e9f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.255+0000 7f4ab1600640 1 --2- 172.21.15.44:0/3150208903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4aac145d70 0x7f4aac1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.255+0000 7f4ab1600640 1 --2- 172.21.15.44:0/3150208903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4aac0d0290 0x7f4aac154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.255+0000 7f4ab1600640 1 --2- 172.21.15.44:0/3150208903 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4aac0ce490 0x7f4aac156090 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.255+0000 7f4ab1600640 1 -- 172.21.15.44:0/3150208903 >> 172.21.15.44:0/3150208903 conn(0x7f4aac0b3e70 msgr2=0x7f4aac0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.256+0000 7f4ab1600640 1 -- 172.21.15.44:0/3150208903 shutdown_connections 2024-03-30T13:14:44.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.256+0000 7f4ab1600640 1 -- 172.21.15.44:0/3150208903 wait complete. 2024-03-30T13:14:44.278 DEBUG:tasks.cephfs.test_uninlining:getting inode info #22 of 23:1099511628352 2024-03-30T13:14:44.278 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628352 2024-03-30T13:14:44.278 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628352 2024-03-30T13:14:44.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.481+0000 7fb812400640 1 Processor -- start 2024-03-30T13:14:44.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.481+0000 7fb812400640 1 -- start start 2024-03-30T13:14:44.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.484+0000 7fb812400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb80c0b4920 0x7fb80c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.484+0000 7fb812400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb80c0b4d00 0x7fb80c0d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.484+0000 7fb812400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80c0b54b0 con 0x7fb80c0d0b90 2024-03-30T13:14:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.484+0000 7fb812400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb80c0d0260 con 0x7fb80c0b4920 2024-03-30T13:14:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.484+0000 7fb812400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb80c0cfca0 con 0x7fb80c0b4d00 2024-03-30T13:14:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.484+0000 7fb811000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb80c0b4920 0x7fb80c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.484+0000 7fb811000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb80c0b4920 0x7fb80c0b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34224/0 (socket says 172.21.15.44:34224) 2024-03-30T13:14:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.484+0000 7fb811000640 1 -- 172.21.15.44:0/3271972403 learned_addr learned my addr 172.21.15.44:0/3271972403 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.484+0000 7fb80be00640 1 --2- 172.21.15.44:0/3271972403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb80c0b4d00 0x7fb80c0d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.485+0000 7fb811000640 1 -- 172.21.15.44:0/3271972403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb80c0b4d00 msgr2=0x7fb80c0d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.485+0000 7fb811000640 1 --2- 172.21.15.44:0/3271972403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb80c0b4d00 0x7fb80c0d4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.485+0000 7fb811000640 1 -- 172.21.15.44:0/3271972403 >> v1:172.21.15.151:6789/0 conn(0x7fb80c0d0b90 legacy=0x7fb80c0d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.485+0000 7fb811000640 1 -- 172.21.15.44:0/3271972403 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c0cff80 con 0x7fb80c0b4920 2024-03-30T13:14:44.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.486+0000 7fb811000640 1 --2- 172.21.15.44:0/3271972403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c0b4920 0x7fb80c0b3ab0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb800009870 tx=0x7fb80002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7454389cb979b03 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.486+0000 7fb80b400640 1 -- 172.21.15.44:0/3271972403 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8000317c0 con 0x7fb80c0b4920 2024-03-30T13:14:44.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.486+0000 7fb80b400640 1 -- 172.21.15.44:0/3271972403 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb800037070 con 0x7fb80c0b4920 2024-03-30T13:14:44.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.486+0000 7fb80b400640 1 -- 172.21.15.44:0/3271972403 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800031b80 con 0x7fb80c0b4920 2024-03-30T13:14:44.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.487+0000 7fb812400640 1 -- 172.21.15.44:0/3271972403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c0b4920 msgr2=0x7fb80c0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.487+0000 7fb812400640 1 --2- 172.21.15.44:0/3271972403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c0b4920 0x7fb80c0b3ab0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb800009870 tx=0x7fb80002b860 comp rx=0 tx=0).stop 2024-03-30T13:14:44.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.487+0000 7fb812400640 1 -- 172.21.15.44:0/3271972403 shutdown_connections 2024-03-30T13:14:44.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.487+0000 7fb812400640 1 --2- 172.21.15.44:0/3271972403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb80c0b4d00 0x7fb80c0d4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.487+0000 7fb812400640 1 --2- 172.21.15.44:0/3271972403 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c0b4920 0x7fb80c0b3ab0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.487+0000 7fb812400640 1 -- 172.21.15.44:0/3271972403 >> 172.21.15.44:0/3271972403 conn(0x7fb80c09d4e0 msgr2=0x7fb80c0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.487+0000 7fb812400640 1 -- 172.21.15.44:0/3271972403 shutdown_connections 2024-03-30T13:14:44.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.487+0000 7fb812400640 1 -- 172.21.15.44:0/3271972403 wait complete. 2024-03-30T13:14:44.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.489+0000 7fb812400640 1 Processor -- start 2024-03-30T13:14:44.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.489+0000 7fb812400640 1 -- start start 2024-03-30T13:14:44.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.490+0000 7fb812400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb80c0b4920 0x7fb80c0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.490+0000 7fb812400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb80c0b4d00 0x7fb80c0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.490+0000 7fb812400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c0d0b90 0x7fb80c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.490+0000 7fb812400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c0b3ff0 con 0x7fb80c0d0b90 2024-03-30T13:14:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.490+0000 7fb812400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c0d2180 con 0x7fb80c0b4d00 2024-03-30T13:14:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.490+0000 7fb812400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb80c0d5000 con 0x7fb80c0b4920 2024-03-30T13:14:44.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.490+0000 7fb811a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c0d0b90 0x7fb80c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.490+0000 7fb811a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c0d0b90 0x7fb80c0b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34234/0 (socket says 172.21.15.44:34234) 2024-03-30T13:14:44.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.490+0000 7fb811a00640 1 -- 172.21.15.44:0/4229753268 learned_addr learned my addr 172.21.15.44:0/4229753268 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.490+0000 7fb811000640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb80c0b4920 0x7fb80c0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.491+0000 7fb80be00640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb80c0b4d00 0x7fb80c0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.491+0000 7fb811a00640 1 -- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb80c0b4920 msgr2=0x7fb80c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.491+0000 7fb811a00640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb80c0b4920 0x7fb80c0c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.491+0000 7fb811a00640 1 -- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb80c0b4d00 msgr2=0x7fb80c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.491+0000 7fb811a00640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb80c0b4d00 0x7fb80c0b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.491+0000 7fb811a00640 1 -- 172.21.15.44:0/4229753268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c0b7a00 con 0x7fb80c0d0b90 2024-03-30T13:14:44.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.491+0000 7fb811a00640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c0d0b90 0x7fb80c0b2360 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb80400b9a0 tx=0x7fb80400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.491+0000 7fb808c00640 1 -- 172.21.15.44:0/4229753268 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804019070 con 0x7fb80c0d0b90 2024-03-30T13:14:44.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.491+0000 7fb808c00640 1 -- 172.21.15.44:0/4229753268 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb80400cba0 con 0x7fb80c0d0b90 2024-03-30T13:14:44.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.492+0000 7fb808c00640 1 -- 172.21.15.44:0/4229753268 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804014440 con 0x7fb80c0d0b90 2024-03-30T13:14:44.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.492+0000 7fb812400640 1 -- 172.21.15.44:0/4229753268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80c0b8720 con 0x7fb80c0d0b90 2024-03-30T13:14:44.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.492+0000 7fb812400640 1 -- 172.21.15.44:0/4229753268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb80c0b8ce0 con 0x7fb80c0d0b90 2024-03-30T13:14:44.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.494+0000 7fb808c00640 1 -- 172.21.15.44:0/4229753268 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb80401c070 con 0x7fb80c0d0b90 2024-03-30T13:14:44.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.496+0000 7fb808c00640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb7ec06c530 0x7fb7ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.496+0000 7fb808c00640 1 -- 172.21.15.44:0/4229753268 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fb80408b4b0 con 0x7fb80c0d0b90 2024-03-30T13:14:44.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.496+0000 7fb81677e740 1 Processor -- start 2024-03-30T13:14:44.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.496+0000 7fb81677e740 1 -- start start 2024-03-30T13:14:44.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.496+0000 7fb811000640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb7ec06c530 0x7fb7ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.497+0000 7fb81677e740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0470 0x5607e3816fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.497+0000 7fb81677e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e38174e0 0x5607e37ef4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.497+0000 7fb81677e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e37f0850 0x5607e37ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.497+0000 7fb81677e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5607e3753330 con 0x5607e38174e0 2024-03-30T13:14:44.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.497+0000 7fb81677e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5607e36fb620 con 0x5607e37f0850 2024-03-30T13:14:44.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.497+0000 7fb81677e740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5607e374f440 con 0x5607e37f0470 2024-03-30T13:14:44.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.497+0000 7fb80be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e38174e0 0x5607e37ef4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.498+0000 7fb80be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e38174e0 0x5607e37ef4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34250/0 (socket says 172.21.15.44:34250) 2024-03-30T13:14:44.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.498+0000 7fb80be00640 1 -- 172.21.15.44:0/1413194037 learned_addr learned my addr 172.21.15.44:0/1413194037 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.498+0000 7fb811a00640 1 --2- 172.21.15.44:0/1413194037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e37f0850 0x5607e37ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.498+0000 7fb811000640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb7ec06c530 0x7fb7ec06e9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb800036000 tx=0x7fb80003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.498+0000 7fb80be00640 1 -- 172.21.15.44:0/1413194037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0470 msgr2=0x5607e3816fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.498+0000 7fb80be00640 1 --2- 172.21.15.44:0/1413194037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0470 0x5607e3816fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.498+0000 7fb80be00640 1 -- 172.21.15.44:0/1413194037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e37f0850 msgr2=0x5607e37ef9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.498+0000 7fb80be00640 1 --2- 172.21.15.44:0/1413194037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e37f0850 0x5607e37ef9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.498+0000 7fb80be00640 1 -- 172.21.15.44:0/1413194037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607e3533920 con 0x5607e38174e0 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.498+0000 7fb811a00640 1 --2- 172.21.15.44:0/1413194037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e37f0850 0x5607e37ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.498+0000 7fb80be00640 1 --2- 172.21.15.44:0/1413194037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e38174e0 0x5607e37ef4b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800b8a0 tx=0x7fb7f800bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2396b472681bfa6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.499+0000 7fb7fd600640 1 -- 172.21.15.44:0/1413194037 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8018030 con 0x5607e38174e0 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.499+0000 7fb7fd600640 1 -- 172.21.15.44:0/1413194037 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f8004020 con 0x5607e38174e0 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.499+0000 7fb7fd600640 1 -- 172.21.15.44:0/1413194037 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f80043d0 con 0x5607e38174e0 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.499+0000 7fb81677e740 1 -- 172.21.15.44:0/1413194037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e38174e0 msgr2=0x5607e37ef4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.499+0000 7fb81677e740 1 --2- 172.21.15.44:0/1413194037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e38174e0 0x5607e37ef4b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800b8a0 tx=0x7fb7f800bd60 comp rx=0 tx=0).stop 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.499+0000 7fb81677e740 1 -- 172.21.15.44:0/1413194037 shutdown_connections 2024-03-30T13:14:44.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.499+0000 7fb81677e740 1 --2- 172.21.15.44:0/1413194037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e37f0850 0x5607e37ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.499+0000 7fb81677e740 1 --2- 172.21.15.44:0/1413194037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e38174e0 0x5607e37ef4b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.499+0000 7fb81677e740 1 --2- 172.21.15.44:0/1413194037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0470 0x5607e3816fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.499+0000 7fb81677e740 1 -- 172.21.15.44:0/1413194037 >> 172.21.15.44:0/1413194037 conn(0x5607e37b6be0 msgr2=0x5607e3835190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.499+0000 7fb81677e740 1 -- 172.21.15.44:0/1413194037 shutdown_connections 2024-03-30T13:14:44.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.500+0000 7fb81677e740 1 -- 172.21.15.44:0/1413194037 wait complete. 2024-03-30T13:14:44.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.501+0000 7fb81677e740 1 -- start start 2024-03-30T13:14:44.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.501+0000 7fb81677e740 1 Processor -- start 2024-03-30T13:14:44.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb81677e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e37f0470 0x5607e381df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb81677e740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0850 0x5607e3813240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb81677e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e380e7a0 0x5607e380aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb81677e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5607e3816b10 con 0x5607e380e7a0 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb81677e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5607e370e9d0 con 0x5607e37f0470 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb81677e740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5607e380f890 con 0x5607e37f0850 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb81677e740 10 client.0 _ll_register_callbacks cb 0x5607e374afd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb811a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e380e7a0 0x5607e380aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb811a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e380e7a0 0x5607e380aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34260/0 (socket says 172.21.15.44:34260) 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb811a00640 1 -- 172.21.15.44:0/729771131 learned_addr learned my addr 172.21.15.44:0/729771131 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb811000640 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e37f0470 0x5607e381df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb80be00640 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0850 0x5607e3813240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb811a00640 1 -- 172.21.15.44:0/729771131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0850 msgr2=0x5607e3813240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb811a00640 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0850 0x5607e3813240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb811a00640 1 -- 172.21.15.44:0/729771131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e37f0470 msgr2=0x5607e381df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb811a00640 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e37f0470 0x5607e381df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.503+0000 7fb811a00640 1 -- 172.21.15.44:0/729771131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607e3427210 con 0x5607e380e7a0 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.504+0000 7fb811a00640 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e380e7a0 0x5607e380aa70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb8040618d0 tx=0x7fb80405d690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34b147d9f33e00f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.504+0000 7fb7f2000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.504+0000 7fb7f2000640 1 -- 172.21.15.44:0/729771131 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80405d370 con 0x5607e380e7a0 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.504+0000 7fb7f2000640 1 -- 172.21.15.44:0/729771131 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fb804061970 con 0x5607e380e7a0 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.504+0000 7fb81677e740 1 -- 172.21.15.44:0/729771131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7f8004020 con 0x5607e380e7a0 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.504+0000 7fb7f2000640 1 -- 172.21.15.44:0/729771131 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb80408b2d0 con 0x5607e380e7a0 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.504+0000 7fb81677e740 10 client.6000 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.504+0000 7fb81677e740 1 -- 172.21.15.44:0/729771131 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5607e35940b0 con 0x5607e380e7a0 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.505+0000 7fb7f2000640 1 -- 172.21.15.44:0/729771131 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f8004020 con 0x5607e380e7a0 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.505+0000 7fb7f2000640 1 -- 172.21.15.44:0/729771131 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fb804058670 con 0x5607e380e7a0 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.505+0000 7fb81677e740 10 client.6000 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.505+0000 7fb81677e740 10 client.6000 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:44.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.505+0000 7fb81677e740 20 client.6000 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.505+0000 7fb81677e740 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5607e381c930 0x5607e3852af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.505+0000 7fb81677e740 4 client.6000 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.505+0000 7fb81677e740 1 -- 172.21.15.44:0/729771131 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607e3760870 con 0x5607e381c930 2024-03-30T13:14:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.505+0000 7fb811000640 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5607e381c930 0x5607e3852af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.506+0000 7fb811000640 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5607e381c930 0x5607e3852af0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ba3ce807007294d server_cookie=2b00ff817109cf58 in_seq=0 out_seq=0 2024-03-30T13:14:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.506+0000 7fb7f2000640 10 client.6000 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.506+0000 7fb7f2000640 1 -- 172.21.15.44:0/729771131 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5607e3760870 con 0x5607e381c930 2024-03-30T13:14:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.506+0000 7fb7f2000640 10 client.6000 handle_command_reply: tid=0 2024-03-30T13:14:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.506+0000 7fb81677e740 1 client.6000 shutdown 2024-03-30T13:14:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.507+0000 7fb81677e740 1 -- 172.21.15.44:0/729771131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e380e7a0 msgr2=0x5607e380aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.507+0000 7fb81677e740 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e380e7a0 0x5607e380aa70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb8040618d0 tx=0x7fb80405d690 comp rx=0 tx=0).stop 2024-03-30T13:14:44.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.507+0000 7fb81677e740 1 -- 172.21.15.44:0/729771131 shutdown_connections 2024-03-30T13:14:44.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.507+0000 7fb81677e740 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5607e381c930 0x5607e3852af0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.507+0000 7fb81677e740 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e380e7a0 0x5607e380aa70 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.507+0000 7fb81677e740 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0850 0x5607e3813240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.507+0000 7fb81677e740 1 --2- 172.21.15.44:0/729771131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e37f0470 0x5607e381df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.507+0000 7fb7f2000640 0 client.6000 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:44.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.507+0000 7fb81677e740 1 -- 172.21.15.44:0/729771131 >> 172.21.15.44:0/729771131 conn(0x5607e37b6be0 msgr2=0x5607e37e9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.507+0000 7fb81677e740 1 -- 172.21.15.44:0/729771131 shutdown_connections 2024-03-30T13:14:44.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.507+0000 7fb81677e740 1 -- 172.21.15.44:0/729771131 wait complete. 2024-03-30T13:14:44.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.507+0000 7fb81677e740 20 client.6000 trim_cache size 0 max 16384 2024-03-30T13:14:44.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.523+0000 7fb81677e740 1 Processor -- start 2024-03-30T13:14:44.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.523+0000 7fb81677e740 1 -- start start 2024-03-30T13:14:44.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.524+0000 7fb81677e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0470 0x5607e3857e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.524+0000 7fb81677e740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0850 0x5607e3837de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.524+0000 7fb81677e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e380e7a0 0x5607e3838320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.524+0000 7fb81677e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c2010e0 con 0x5607e37f0470 2024-03-30T13:14:44.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.524+0000 7fb81677e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c2000e0 con 0x5607e380e7a0 2024-03-30T13:14:44.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.524+0000 7fb81677e740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb80c0cc030 con 0x5607e37f0850 2024-03-30T13:14:44.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.524+0000 7fb811000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0470 0x5607e3857e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.524+0000 7fb811000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0470 0x5607e3857e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34272/0 (socket says 172.21.15.44:34272) 2024-03-30T13:14:44.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.524+0000 7fb811000640 1 -- 172.21.15.44:0/121715415 learned_addr learned my addr 172.21.15.44:0/121715415 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.525+0000 7fb811000640 1 -- 172.21.15.44:0/121715415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0850 msgr2=0x5607e3837de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.525+0000 7fb811000640 1 --2- 172.21.15.44:0/121715415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0850 0x5607e3837de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.525+0000 7fb811000640 1 -- 172.21.15.44:0/121715415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e380e7a0 msgr2=0x5607e3838320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.525+0000 7fb811000640 1 --2- 172.21.15.44:0/121715415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e380e7a0 0x5607e3838320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.525+0000 7fb811000640 1 -- 172.21.15.44:0/121715415 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607e34002d0 con 0x5607e37f0470 2024-03-30T13:14:44.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.525+0000 7fb811000640 1 --2- 172.21.15.44:0/121715415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0470 0x5607e3857e50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb800009870 tx=0x7fb800030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58787d2abae290c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.525+0000 7fb7fcc00640 1 -- 172.21.15.44:0/121715415 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800031da0 con 0x5607e37f0470 2024-03-30T13:14:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.525+0000 7fb7fcc00640 1 -- 172.21.15.44:0/121715415 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb800037040 con 0x5607e37f0470 2024-03-30T13:14:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.525+0000 7fb7fcc00640 1 -- 172.21.15.44:0/121715415 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb800053080 con 0x5607e37f0470 2024-03-30T13:14:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.526+0000 7fb81677e740 1 -- 172.21.15.44:0/121715415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0470 msgr2=0x5607e3857e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.526+0000 7fb81677e740 1 --2- 172.21.15.44:0/121715415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0470 0x5607e3857e50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb800009870 tx=0x7fb800030000 comp rx=0 tx=0).stop 2024-03-30T13:14:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.526+0000 7fb81677e740 1 -- 172.21.15.44:0/121715415 shutdown_connections 2024-03-30T13:14:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.526+0000 7fb81677e740 1 --2- 172.21.15.44:0/121715415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e380e7a0 0x5607e3838320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.526+0000 7fb81677e740 1 --2- 172.21.15.44:0/121715415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0850 0x5607e3837de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.526+0000 7fb81677e740 1 --2- 172.21.15.44:0/121715415 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0470 0x5607e3857e50 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.526+0000 7fb81677e740 1 -- 172.21.15.44:0/121715415 >> 172.21.15.44:0/121715415 conn(0x5607e37b6be0 msgr2=0x5607e37e5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.526+0000 7fb81677e740 1 -- 172.21.15.44:0/121715415 shutdown_connections 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.526+0000 7fb81677e740 1 -- 172.21.15.44:0/121715415 wait complete. 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.527+0000 7fb81677e740 1 -- start start 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.527+0000 7fb81677e740 1 Processor -- start 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.528+0000 7fb81677e740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0470 0x5607e3857de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.528+0000 7fb81677e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0850 0x5607e3858320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.528+0000 7fb81677e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e380e7a0 0x5607e380f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.528+0000 7fb81677e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb80c0b9b60 con 0x5607e37f0850 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.528+0000 7fb81677e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5607e3816230 con 0x5607e380e7a0 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.528+0000 7fb81677e740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5607e38b0f40 con 0x5607e37f0470 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.528+0000 7fb81677e740 10 client.0 _ll_register_callbacks cb 0x7fb804058ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.528+0000 7fb80be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0850 0x5607e3858320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.528+0000 7fb80be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0850 0x5607e3858320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34284/0 (socket says 172.21.15.44:34284) 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.528+0000 7fb80be00640 1 -- 172.21.15.44:0/1313340566 learned_addr learned my addr 172.21.15.44:0/1313340566 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.528+0000 7fb811000640 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0470 0x5607e3857de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.528+0000 7fb80be00640 1 -- 172.21.15.44:0/1313340566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0470 msgr2=0x5607e3857de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.529+0000 7fb811a00640 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e380e7a0 0x5607e380f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.529+0000 7fb80be00640 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0470 0x5607e3857de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.529+0000 7fb80be00640 1 -- 172.21.15.44:0/1313340566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e380e7a0 msgr2=0x5607e380f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.529+0000 7fb80be00640 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e380e7a0 0x5607e380f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.529+0000 7fb80be00640 1 -- 172.21.15.44:0/1313340566 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607e380ebc0 con 0x5607e37f0850 2024-03-30T13:14:44.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.529+0000 7fb811000640 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0470 0x5607e3857de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.529+0000 7fb811a00640 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e380e7a0 0x5607e380f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.529+0000 7fb80be00640 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0850 0x5607e3858320 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8017040 tx=0x7fb7f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab70e09e519484b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.529+0000 7fb7f2000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:44.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.529+0000 7fb7f2000640 1 -- 172.21.15.44:0/1313340566 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f800fc20 con 0x5607e37f0850 2024-03-30T13:14:44.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.529+0000 7fb7f2000640 1 -- 172.21.15.44:0/1313340566 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fb7f800fdc0 con 0x5607e37f0850 2024-03-30T13:14:44.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.529+0000 7fb81677e740 1 -- 172.21.15.44:0/1313340566 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb800037040 con 0x5607e37f0850 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.530+0000 7fb7f2000640 1 -- 172.21.15.44:0/1313340566 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb7f8003610 con 0x5607e37f0850 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.530+0000 7fb81677e740 10 client.6006 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.530+0000 7fb81677e740 1 -- 172.21.15.44:0/1313340566 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5607e38b0c80 con 0x5607e37f0850 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.530+0000 7fb7f2000640 1 -- 172.21.15.44:0/1313340566 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb800037040 con 0x5607e37f0850 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.530+0000 7fb7f2000640 1 -- 172.21.15.44:0/1313340566 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7fb7f80037b0 con 0x5607e37f0850 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.530+0000 7fb81677e740 10 client.6006 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.530+0000 7fb81677e740 10 client.6006 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.530+0000 7fb81677e740 20 client.6006 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.530+0000 7fb81677e740 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5607e38b0820 0x5607e380f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.530+0000 7fb81677e740 4 client.6006 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628352}] 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.530+0000 7fb81677e740 1 -- 172.21.15.44:0/1313340566 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628352}) -- 0x5607e375abc0 con 0x5607e38b0820 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.530+0000 7fb811000640 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5607e38b0820 0x5607e380f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.531+0000 7fb811000640 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5607e38b0820 0x5607e380f5e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5040a8bf490c1ec6 server_cookie=b60bc586257d72a8 in_seq=0 out_seq=0 2024-03-30T13:14:44.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.531+0000 7fb7f2000640 10 client.6006 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:44.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.531+0000 7fb7f2000640 1 -- 172.21.15.44:0/1313340566 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3970 (crc 0 0 0) 0x5607e375abc0 con 0x5607e38b0820 2024-03-30T13:14:44.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.531+0000 7fb7f2000640 10 client.6006 handle_command_reply: tid=0 2024-03-30T13:14:44.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.531+0000 7fb81677e740 1 client.6006 shutdown 2024-03-30T13:14:44.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.532+0000 7fb81677e740 1 -- 172.21.15.44:0/1313340566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0850 msgr2=0x5607e3858320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.532+0000 7fb81677e740 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0850 0x5607e3858320 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8017040 tx=0x7fb7f80046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.532+0000 7fb81677e740 1 -- 172.21.15.44:0/1313340566 shutdown_connections 2024-03-30T13:14:44.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.532+0000 7fb81677e740 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5607e38b0820 0x5607e380f5e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.532+0000 7fb81677e740 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607e380e7a0 0x5607e380f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.532+0000 7fb81677e740 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5607e37f0850 0x5607e3858320 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.532+0000 7fb7f2000640 0 client.6006 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:44.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.532+0000 7fb81677e740 1 --2- 172.21.15.44:0/1313340566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5607e37f0470 0x5607e3857de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.532+0000 7fb81677e740 1 -- 172.21.15.44:0/1313340566 >> 172.21.15.44:0/1313340566 conn(0x5607e37b6be0 msgr2=0x5607e381d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.532+0000 7fb81677e740 1 -- 172.21.15.44:0/1313340566 shutdown_connections 2024-03-30T13:14:44.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.532+0000 7fb81677e740 1 -- 172.21.15.44:0/1313340566 wait complete. 2024-03-30T13:14:44.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.532+0000 7fb81677e740 20 client.6006 trim_cache size 0 max 16384 2024-03-30T13:14:44.543 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:44.543 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/symlink.c", 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628352, 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.349416+0000", 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.439255+0000", 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:44.544 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 497, 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:44.545 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.439255+0000", 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:44.546 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 497, 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.349416+0000" 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:44.547 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 497, 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.349416+0000" 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 196, 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 50, 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:44.548 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:44.549 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:44.549 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.549 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:11.009871+0000", 2024-03-30T13:14:44.549 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 108, 2024-03-30T13:14:44.549 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:44.549 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:44.549 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:44.549 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:44.549 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:44.550 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:44.550 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:44.550 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:44.550 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:44.550 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.551 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:44.551 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:44.551 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:44.551 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:44.551 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:44.551 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:44.551 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.551 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:44.551 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:44.552 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:44.552 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:44.552 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:44.552 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:44.552 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.552 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:44.552 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:44.553 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:44.553 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:44.553 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:44.553 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:44.553 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:44.554 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:44.554 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:44.554 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:44.554 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:44.554 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:44.554 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:44.555 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.555 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:44.555 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:44.555 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:44.555 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:44.556 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:44.557 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:44.558 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:44.558 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:44.558 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:44.558 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:44.558 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:44.558 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:44.558 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:44.558 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:44.558 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.558 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:44.558 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:44.558 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:44.559 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:44.560 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:44.560 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:44.560 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:44.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.533+0000 7fb812400640 1 -- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb7ec06c530 msgr2=0x7fb7ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.533+0000 7fb812400640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb7ec06c530 0x7fb7ec06e9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb800036000 tx=0x7fb80003d040 comp rx=0 tx=0).stop 2024-03-30T13:14:44.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.533+0000 7fb812400640 1 -- 172.21.15.44:0/4229753268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c0d0b90 msgr2=0x7fb80c0b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.533+0000 7fb812400640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c0d0b90 0x7fb80c0b2360 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb80400b9a0 tx=0x7fb80400be60 comp rx=0 tx=0).stop 2024-03-30T13:14:44.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.533+0000 7fb812400640 1 -- 172.21.15.44:0/4229753268 shutdown_connections 2024-03-30T13:14:44.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.533+0000 7fb812400640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb80c0d0b90 0x7fb80c0b2360 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.533+0000 7fb812400640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb7ec06c530 0x7fb7ec06e9f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.533+0000 7fb812400640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb80c0b4d00 0x7fb80c0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.533+0000 7fb812400640 1 --2- 172.21.15.44:0/4229753268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb80c0b4920 0x7fb80c0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.533+0000 7fb812400640 1 -- 172.21.15.44:0/4229753268 >> 172.21.15.44:0/4229753268 conn(0x7fb80c09d4e0 msgr2=0x7fb80c06c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.533+0000 7fb812400640 1 -- 172.21.15.44:0/4229753268 shutdown_connections 2024-03-30T13:14:44.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.533+0000 7fb812400640 1 -- 172.21.15.44:0/4229753268 wait complete. 2024-03-30T13:14:44.562 DEBUG:tasks.cephfs.test_uninlining:getting inode info #23 of 23:1099511628334 2024-03-30T13:14:44.562 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628334 2024-03-30T13:14:44.562 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628334 2024-03-30T13:14:44.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.763+0000 7f6112c00640 1 Processor -- start 2024-03-30T13:14:44.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.763+0000 7f6112c00640 1 -- start start 2024-03-30T13:14:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.766+0000 7f6112c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f610c158a20 0x7f610c06b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.766+0000 7f6112c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f610c0b0740 0x7f610c06bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.766+0000 7f6112c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610c072570 con 0x7f610c158e00 2024-03-30T13:14:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.766+0000 7f6112c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f610c072850 con 0x7f610c0b0740 2024-03-30T13:14:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.766+0000 7f6112c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f610c072b30 con 0x7f610c158a20 2024-03-30T13:14:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.766+0000 7f6110c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f610c0b0740 0x7f610c06bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.766+0000 7f6110c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f610c0b0740 0x7f610c06bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34300/0 (socket says 172.21.15.44:34300) 2024-03-30T13:14:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.766+0000 7f6110c00640 1 -- 172.21.15.44:0/4076133350 learned_addr learned my addr 172.21.15.44:0/4076133350 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.766+0000 7f610be00640 1 --2- 172.21.15.44:0/4076133350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f610c158a20 0x7f610c06b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.767+0000 7f6110c00640 1 -- 172.21.15.44:0/4076133350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f610c158a20 msgr2=0x7f610c06b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.767+0000 7f6110c00640 1 --2- 172.21.15.44:0/4076133350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f610c158a20 0x7f610c06b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.767+0000 7f6110c00640 1 -- 172.21.15.44:0/4076133350 >> v1:172.21.15.151:6789/0 conn(0x7f610c158e00 legacy=0x7f610c0b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.767+0000 7f6110c00640 1 -- 172.21.15.44:0/4076133350 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c072e10 con 0x7f610c0b0740 2024-03-30T13:14:44.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.768+0000 7f6110c00640 1 --2- 172.21.15.44:0/4076133350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f610c0b0740 0x7f610c06bac0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6104009e50 tx=0x7f610402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2f2d17d3b81997 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.768+0000 7f610aa00640 1 -- 172.21.15.44:0/4076133350 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610402cb00 con 0x7f610c0b0740 2024-03-30T13:14:44.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.768+0000 7f610aa00640 1 -- 172.21.15.44:0/4076133350 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610402cca0 con 0x7f610c0b0740 2024-03-30T13:14:44.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.769+0000 7f610aa00640 1 -- 172.21.15.44:0/4076133350 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104034610 con 0x7f610c0b0740 2024-03-30T13:14:44.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.769+0000 7f6112c00640 1 -- 172.21.15.44:0/4076133350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f610c0b0740 msgr2=0x7f610c06bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.769+0000 7f6112c00640 1 --2- 172.21.15.44:0/4076133350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f610c0b0740 0x7f610c06bac0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6104009e50 tx=0x7f610402bf60 comp rx=0 tx=0).stop 2024-03-30T13:14:44.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.769+0000 7f6112c00640 1 -- 172.21.15.44:0/4076133350 shutdown_connections 2024-03-30T13:14:44.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.769+0000 7f6112c00640 1 --2- 172.21.15.44:0/4076133350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f610c0b0740 0x7f610c06bac0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.769+0000 7f6112c00640 1 --2- 172.21.15.44:0/4076133350 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f610c158a20 0x7f610c06b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.769+0000 7f6112c00640 1 -- 172.21.15.44:0/4076133350 >> 172.21.15.44:0/4076133350 conn(0x7f610c0d1160 msgr2=0x7f610c0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.770+0000 7f6112c00640 1 -- 172.21.15.44:0/4076133350 shutdown_connections 2024-03-30T13:14:44.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.770+0000 7f6112c00640 1 -- 172.21.15.44:0/4076133350 wait complete. 2024-03-30T13:14:44.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.771+0000 7f6112c00640 1 Processor -- start 2024-03-30T13:14:44.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.771+0000 7f6112c00640 1 -- start start 2024-03-30T13:14:44.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.772+0000 7f6112c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f610c0b0740 0x7f610c14d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.772+0000 7f6112c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f610c158a20 0x7f610c14f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.772+0000 7f6112c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f610c158e00 0x7f610c14fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.772+0000 7f6112c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f610c0b4290 con 0x7f610c158e00 2024-03-30T13:14:44.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.772+0000 7f6112c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f610c0b4110 con 0x7f610c0b0740 2024-03-30T13:14:44.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.772+0000 7f6112c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f610c0b4410 con 0x7f610c158a20 2024-03-30T13:14:44.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f6110c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f610c158e00 0x7f610c14fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f6110c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f610c158e00 0x7f610c14fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34302/0 (socket says 172.21.15.44:34302) 2024-03-30T13:14:44.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f6110c00640 1 -- 172.21.15.44:0/3886738831 learned_addr learned my addr 172.21.15.44:0/3886738831 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f610be00640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f610c0b0740 0x7f610c14d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f610b400640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f610c158a20 0x7f610c14f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f6110c00640 1 -- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f610c158a20 msgr2=0x7f610c14f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f6110c00640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f610c158a20 0x7f610c14f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f6110c00640 1 -- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f610c0b0740 msgr2=0x7f610c14d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f6110c00640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f610c0b0740 0x7f610c14d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f6110c00640 1 -- 172.21.15.44:0/3886738831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c152b30 con 0x7f610c158e00 2024-03-30T13:14:44.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f610b400640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f610c158a20 0x7f610c14f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f610be00640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f610c0b0740 0x7f610c14d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.773+0000 7f6110c00640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f610c158e00 0x7f610c14fa50 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6104009e50 tx=0x7f6104004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.774+0000 7f6103e00640 1 -- 172.21.15.44:0/3886738831 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104043020 con 0x7f610c158e00 2024-03-30T13:14:44.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.774+0000 7f6103e00640 1 -- 172.21.15.44:0/3886738831 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610402ce50 con 0x7f610c158e00 2024-03-30T13:14:44.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.774+0000 7f6103e00640 1 -- 172.21.15.44:0/3886738831 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104009510 con 0x7f610c158e00 2024-03-30T13:14:44.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.774+0000 7f6112c00640 1 -- 172.21.15.44:0/3886738831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c152e10 con 0x7f610c158e00 2024-03-30T13:14:44.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.774+0000 7f6112c00640 1 -- 172.21.15.44:0/3886738831 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610c1533d0 con 0x7f610c158e00 2024-03-30T13:14:44.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.777+0000 7f6103e00640 1 -- 172.21.15.44:0/3886738831 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6104046020 con 0x7f610c158e00 2024-03-30T13:14:44.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.778+0000 7f61159f3740 1 Processor -- start 2024-03-30T13:14:44.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.778+0000 7f6103e00640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f60ec06c560 0x7f60ec06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.778+0000 7f6103e00640 1 -- 172.21.15.44:0/3886738831 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f61040adfc0 con 0x7f610c158e00 2024-03-30T13:14:44.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.778+0000 7f61159f3740 1 -- start start 2024-03-30T13:14:44.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.779+0000 7f610b400640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f60ec06c560 0x7f60ec06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.779+0000 7f61159f3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca4edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.779+0000 7f61159f3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca4f300 0x564a4ca272d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.779+0000 7f61159f3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca27810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.779+0000 7f61159f3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564a4c98b330 con 0x564a4ca28670 2024-03-30T13:14:44.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.779+0000 7f61159f3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564a4c933620 con 0x564a4ca28290 2024-03-30T13:14:44.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.779+0000 7f61159f3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x564a4c987440 con 0x564a4ca4f300 2024-03-30T13:14:44.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f6110c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca27810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f6110c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca27810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34314/0 (socket says 172.21.15.44:34314) 2024-03-30T13:14:44.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f6110c00640 1 -- 172.21.15.44:0/782980129 learned_addr learned my addr 172.21.15.44:0/782980129 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f610be00640 1 --2- 172.21.15.44:0/782980129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca4edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f6110c00640 1 -- 172.21.15.44:0/782980129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca4f300 msgr2=0x564a4ca272d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f610b400640 1 --2- 172.21.15.44:0/782980129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca4f300 0x564a4ca272d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f6110c00640 1 --2- 172.21.15.44:0/782980129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca4f300 0x564a4ca272d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f6110c00640 1 -- 172.21.15.44:0/782980129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 msgr2=0x564a4ca4edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f6110c00640 1 --2- 172.21.15.44:0/782980129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca4edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f6110c00640 1 -- 172.21.15.44:0/782980129 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4c76b920 con 0x564a4ca28670 2024-03-30T13:14:44.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f610be00640 1 --2- 172.21.15.44:0/782980129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca4edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f610b400640 1 --2- 172.21.15.44:0/782980129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca4f300 0x564a4ca272d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.780+0000 7f6110c00640 1 --2- 172.21.15.44:0/782980129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca27810 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f61040780f0 tx=0x7f610407b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7993ac5535e1562b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.781+0000 7f610b400640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f60ec06c560 0x7f60ec06ea20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f610c158350 tx=0x7f60f80019c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.781+0000 7f60f7e00640 1 -- 172.21.15.44:0/782980129 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104084870 con 0x564a4ca28670 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.781+0000 7f60f7e00640 1 -- 172.21.15.44:0/782980129 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6104079d30 con 0x564a4ca28670 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.781+0000 7f60f7e00640 1 -- 172.21.15.44:0/782980129 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104078300 con 0x564a4ca28670 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.781+0000 7f61159f3740 1 -- 172.21.15.44:0/782980129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 msgr2=0x564a4ca27810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.781+0000 7f61159f3740 1 --2- 172.21.15.44:0/782980129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca27810 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f61040780f0 tx=0x7f610407b6b0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.781+0000 7f61159f3740 1 -- 172.21.15.44:0/782980129 shutdown_connections 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.781+0000 7f61159f3740 1 --2- 172.21.15.44:0/782980129 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca27810 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.781+0000 7f61159f3740 1 --2- 172.21.15.44:0/782980129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca4f300 0x564a4ca272d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.782+0000 7f61159f3740 1 --2- 172.21.15.44:0/782980129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca4edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.782+0000 7f61159f3740 1 -- 172.21.15.44:0/782980129 >> 172.21.15.44:0/782980129 conn(0x564a4c9eebe0 msgr2=0x564a4ca6cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.782+0000 7f61159f3740 1 -- 172.21.15.44:0/782980129 shutdown_connections 2024-03-30T13:14:44.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.782+0000 7f61159f3740 1 -- 172.21.15.44:0/782980129 wait complete. 2024-03-30T13:14:44.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.782+0000 7f61159f3740 1 -- start start 2024-03-30T13:14:44.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.783+0000 7f61159f3740 1 Processor -- start 2024-03-30T13:14:44.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.783+0000 7f61159f3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca6d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.783+0000 7f61159f3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca7c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.783+0000 7f61159f3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca463f0 0x564a4ca55cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.783+0000 7f61159f3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564a4c98b330 con 0x564a4ca28670 2024-03-30T13:14:44.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f61159f3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564a4c9469d0 con 0x564a4ca28290 2024-03-30T13:14:44.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f61159f3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x564a4ca4e930 con 0x564a4ca463f0 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f61159f3740 10 client.0 _ll_register_callbacks cb 0x564a4c982fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f610b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca7c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f610b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca7c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34322/0 (socket says 172.21.15.44:34322) 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f610b400640 1 -- 172.21.15.44:0/716604857 learned_addr learned my addr 172.21.15.44:0/716604857 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f610be00640 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca6d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f6110c00640 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca463f0 0x564a4ca55cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f610b400640 1 -- 172.21.15.44:0/716604857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca463f0 msgr2=0x564a4ca55cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f610b400640 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca463f0 0x564a4ca55cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f610b400640 1 -- 172.21.15.44:0/716604857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 msgr2=0x564a4ca6d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f610b400640 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca6d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f610b400640 1 -- 172.21.15.44:0/716604857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a4c65f210 con 0x564a4ca28670 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.784+0000 7f610be00640 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca6d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.785+0000 7f610b400640 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca7c850 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f610c06c080 tx=0x7f60f8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cd23a1748a61ab server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.785+0000 7f60f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.785+0000 7f60f4c00640 1 -- 172.21.15.44:0/716604857 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8018930 con 0x564a4ca28670 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.785+0000 7f60f4c00640 1 -- 172.21.15.44:0/716604857 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f60f8018ad0 con 0x564a4ca28670 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.785+0000 7f61159f3740 1 -- 172.21.15.44:0/716604857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6104079d30 con 0x564a4ca28670 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.785+0000 7f60f4c00640 1 -- 172.21.15.44:0/716604857 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f60f8018cd0 con 0x564a4ca28670 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.786+0000 7f61159f3740 10 client.6018 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.786+0000 7f61159f3740 1 -- 172.21.15.44:0/716604857 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x564a4c7cc0b0 con 0x564a4ca28670 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.786+0000 7f60f4c00640 1 -- 172.21.15.44:0/716604857 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6104079d30 con 0x564a4ca28670 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.786+0000 7f60f4c00640 1 -- 172.21.15.44:0/716604857 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f60f802e020 con 0x564a4ca28670 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.786+0000 7f61159f3740 10 client.6018 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.786+0000 7f61159f3740 10 client.6018 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.786+0000 7f61159f3740 20 client.6018 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.786+0000 7f61159f3740 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564a4ca703e0 0x564a4ca70820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.786+0000 7f61159f3740 4 client.6018 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:44.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.786+0000 7f61159f3740 1 -- 172.21.15.44:0/716604857 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a4c998870 con 0x564a4ca703e0 2024-03-30T13:14:44.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.786+0000 7f610be00640 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564a4ca703e0 0x564a4ca70820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.787+0000 7f610be00640 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564a4ca703e0 0x564a4ca70820 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dfd30465ae4ba5a server_cookie=b7e738c5fae68510 in_seq=0 out_seq=0 2024-03-30T13:14:44.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.787+0000 7f60f4c00640 10 client.6018 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:44.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f60f4c00640 1 -- 172.21.15.44:0/716604857 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x564a4c998870 con 0x564a4ca703e0 2024-03-30T13:14:44.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f60f4c00640 10 client.6018 handle_command_reply: tid=0 2024-03-30T13:14:44.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f61159f3740 1 client.6018 shutdown 2024-03-30T13:14:44.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f61159f3740 1 -- 172.21.15.44:0/716604857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 msgr2=0x564a4ca7c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f61159f3740 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca7c850 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f610c06c080 tx=0x7f60f8000bc0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f61159f3740 1 -- 172.21.15.44:0/716604857 shutdown_connections 2024-03-30T13:14:44.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f61159f3740 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564a4ca703e0 0x564a4ca70820 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f61159f3740 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca463f0 0x564a4ca55cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f61159f3740 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca7c850 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f61159f3740 1 --2- 172.21.15.44:0/716604857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca6d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f61159f3740 1 -- 172.21.15.44:0/716604857 >> 172.21.15.44:0/716604857 conn(0x564a4c9eebe0 msgr2=0x564a4ca52480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f60f4c00640 0 client.6018 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:44.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f61159f3740 1 -- 172.21.15.44:0/716604857 shutdown_connections 2024-03-30T13:14:44.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f61159f3740 1 -- 172.21.15.44:0/716604857 wait complete. 2024-03-30T13:14:44.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.788+0000 7f61159f3740 20 client.6018 trim_cache size 0 max 16384 2024-03-30T13:14:44.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.804+0000 7f61159f3740 1 Processor -- start 2024-03-30T13:14:44.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.804+0000 7f61159f3740 1 -- start start 2024-03-30T13:14:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.805+0000 7f61159f3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca28290 0x564a4ca3ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.805+0000 7f61159f3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca404a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.810 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.805+0000 7f61159f3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca463f0 0x564a4ca26d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.805+0000 7f61159f3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f610c201280 con 0x564a4ca28670 2024-03-30T13:14:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.805+0000 7f61159f3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f610c2002a0 con 0x564a4ca463f0 2024-03-30T13:14:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.805+0000 7f61159f3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f610c0ae610 con 0x564a4ca28290 2024-03-30T13:14:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.806+0000 7f610b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.806+0000 7f610b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca404a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34338/0 (socket says 172.21.15.44:34338) 2024-03-30T13:14:44.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.806+0000 7f610b400640 1 -- 172.21.15.44:0/2404307586 learned_addr learned my addr 172.21.15.44:0/2404307586 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.806+0000 7f6110c00640 1 --2- 172.21.15.44:0/2404307586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca463f0 0x564a4ca26d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.806+0000 7f610be00640 1 --2- 172.21.15.44:0/2404307586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca28290 0x564a4ca3ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.806+0000 7f610b400640 1 -- 172.21.15.44:0/2404307586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca28290 msgr2=0x564a4ca3ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.806+0000 7f610b400640 1 --2- 172.21.15.44:0/2404307586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca28290 0x564a4ca3ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.806+0000 7f610b400640 1 -- 172.21.15.44:0/2404307586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca463f0 msgr2=0x564a4ca26d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.806+0000 7f610b400640 1 --2- 172.21.15.44:0/2404307586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca463f0 0x564a4ca26d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.806+0000 7f610b400640 1 -- 172.21.15.44:0/2404307586 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a4ca6dc70 con 0x564a4ca28670 2024-03-30T13:14:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.806+0000 7f6110c00640 1 --2- 172.21.15.44:0/2404307586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca463f0 0x564a4ca26d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.806+0000 7f610b400640 1 --2- 172.21.15.44:0/2404307586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca404a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f60f80014a0 tx=0x7f60f801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b1d729c683080c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.807+0000 7f60f7400640 1 -- 172.21.15.44:0/2404307586 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8034070 con 0x564a4ca28670 2024-03-30T13:14:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.807+0000 7f60f7400640 1 -- 172.21.15.44:0/2404307586 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f8018800 con 0x564a4ca28670 2024-03-30T13:14:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.807+0000 7f60f7400640 1 -- 172.21.15.44:0/2404307586 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8016410 con 0x564a4ca28670 2024-03-30T13:14:44.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.807+0000 7f61159f3740 1 -- 172.21.15.44:0/2404307586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 msgr2=0x564a4ca404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.807+0000 7f61159f3740 1 --2- 172.21.15.44:0/2404307586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca404a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f60f80014a0 tx=0x7f60f801d000 comp rx=0 tx=0).stop 2024-03-30T13:14:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.807+0000 7f61159f3740 1 -- 172.21.15.44:0/2404307586 shutdown_connections 2024-03-30T13:14:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.807+0000 7f61159f3740 1 --2- 172.21.15.44:0/2404307586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca463f0 0x564a4ca26d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.807+0000 7f61159f3740 1 --2- 172.21.15.44:0/2404307586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca28670 0x564a4ca404a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.807+0000 7f61159f3740 1 --2- 172.21.15.44:0/2404307586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca28290 0x564a4ca3ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.807+0000 7f61159f3740 1 -- 172.21.15.44:0/2404307586 >> 172.21.15.44:0/2404307586 conn(0x564a4c9eebe0 msgr2=0x564a4ca700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.808+0000 7f61159f3740 1 -- 172.21.15.44:0/2404307586 shutdown_connections 2024-03-30T13:14:44.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.808+0000 7f61159f3740 1 -- 172.21.15.44:0/2404307586 wait complete. 2024-03-30T13:14:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.808+0000 7f61159f3740 1 -- start start 2024-03-30T13:14:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.808+0000 7f61159f3740 1 Processor -- start 2024-03-30T13:14:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.809+0000 7f61159f3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca40380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.809+0000 7f61159f3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca28670 0x564a4ca408c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.809+0000 7f61159f3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca463f0 0x564a4ca44a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.809+0000 7f61159f3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564a4ca41140 con 0x564a4ca463f0 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.809+0000 7f61159f3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f610c1ffdb0 con 0x564a4ca28290 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.809+0000 7f61159f3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x564a4ca7cc70 con 0x564a4ca28670 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.809+0000 7f61159f3740 10 client.0 _ll_register_callbacks cb 0x7f60f80012c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.810+0000 7f6110c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca463f0 0x564a4ca44a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.810+0000 7f6110c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca463f0 0x564a4ca44a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34354/0 (socket says 172.21.15.44:34354) 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.810+0000 7f6110c00640 1 -- 172.21.15.44:0/4050702435 learned_addr learned my addr 172.21.15.44:0/4050702435 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.810+0000 7f610be00640 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca40380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.810+0000 7f610b400640 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca28670 0x564a4ca408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.810+0000 7f6110c00640 1 -- 172.21.15.44:0/4050702435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca28670 msgr2=0x564a4ca408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.810+0000 7f6110c00640 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca28670 0x564a4ca408c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.810+0000 7f6110c00640 1 -- 172.21.15.44:0/4050702435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 msgr2=0x564a4ca40380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.810+0000 7f6110c00640 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca40380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.810+0000 7f6110c00640 1 -- 172.21.15.44:0/4050702435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a4c6382d0 con 0x564a4ca463f0 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.810+0000 7f610be00640 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca40380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.810+0000 7f610b400640 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca28670 0x564a4ca408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f6110c00640 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca463f0 0x564a4ca44a70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f610402c570 tx=0x7f6104049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d06526e00346e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f60f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f60f4c00640 1 -- 172.21.15.44:0/4050702435 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104084870 con 0x564a4ca463f0 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f60f4c00640 1 -- 172.21.15.44:0/4050702435 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f6104082040 con 0x564a4ca463f0 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f61159f3740 1 -- 172.21.15.44:0/4050702435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60f8018800 con 0x564a4ca463f0 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f60f4c00640 1 -- 172.21.15.44:0/4050702435 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6104080040 con 0x564a4ca463f0 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f61159f3740 10 client.6024 fetch_fsmap learned FSMap version 19 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f61159f3740 1 -- 172.21.15.44:0/4050702435 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x564a4ca432f0 con 0x564a4ca463f0 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f60f4c00640 1 -- 172.21.15.44:0/4050702435 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f8018800 con 0x564a4ca463f0 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f60f4c00640 1 -- 172.21.15.44:0/4050702435 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 19) ==== 3494+0+0 (secure 0 0 0) 0x7f6104078300 con 0x564a4ca463f0 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f61159f3740 10 client.6024 fetch_fsmap finished waiting for FSMap version 19 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f61159f3740 10 client.6024 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:44.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f61159f3740 20 client.6024 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.811+0000 7f61159f3740 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564a4ca54a30 0x564a4ca44fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.812+0000 7f61159f3740 4 client.6024 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628334}] 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.812+0000 7f61159f3740 1 -- 172.21.15.44:0/4050702435 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628334}) -- 0x564a4c992bc0 con 0x564a4ca54a30 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.812+0000 7f610be00640 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564a4ca54a30 0x564a4ca44fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.812+0000 7f610be00640 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564a4ca54a30 0x564a4ca44fb0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dea58e5f13bb469 server_cookie=15a780ea79639b26 in_seq=0 out_seq=0 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.812+0000 7f60f4c00640 10 client.6024 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f60f4c00640 1 -- 172.21.15.44:0/4050702435 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3974 (crc 0 0 0) 0x564a4c992bc0 con 0x564a4ca54a30 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f60f4c00640 10 client.6024 handle_command_reply: tid=0 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f61159f3740 1 client.6024 shutdown 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f61159f3740 1 -- 172.21.15.44:0/4050702435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca463f0 msgr2=0x564a4ca44a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f61159f3740 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca463f0 0x564a4ca44a70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f610402c570 tx=0x7f6104049000 comp rx=0 tx=0).stop 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f61159f3740 1 -- 172.21.15.44:0/4050702435 shutdown_connections 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f61159f3740 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564a4ca54a30 0x564a4ca44fb0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f61159f3740 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564a4ca463f0 0x564a4ca44a70 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f61159f3740 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564a4ca28670 0x564a4ca408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f61159f3740 1 --2- 172.21.15.44:0/4050702435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a4ca28290 0x564a4ca40380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f60f4c00640 0 client.6024 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:44.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f61159f3740 1 -- 172.21.15.44:0/4050702435 >> 172.21.15.44:0/4050702435 conn(0x564a4c9eebe0 msgr2=0x564a4ca700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f61159f3740 1 -- 172.21.15.44:0/4050702435 shutdown_connections 2024-03-30T13:14:44.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f61159f3740 1 -- 172.21.15.44:0/4050702435 wait complete. 2024-03-30T13:14:44.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.813+0000 7f61159f3740 20 client.6024 trim_cache size 0 max 16384 2024-03-30T13:14:44.822 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:44.822 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/downcall.h", 2024-03-30T13:14:44.822 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628334, 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:06.353698+0000", 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:04.404256+0000", 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:14:44.823 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2953, 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:14:44.824 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:04.404256+0000", 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [], 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:14:44.825 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 2953, 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.353698+0000" 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 2953, 2024-03-30T13:14:44.826 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:06.353698+0000" 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 182, 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 14, 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:14:44.827 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "2024-03-30T13:14:11.008804+0000", 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 114, 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:14:44.828 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 18446744073709551614, 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.829 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.830 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": {}, 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:14:44.831 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": {}, 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": {}, 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:14:44.832 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:14:44.833 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsLsXsFsc", 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsLsXsFsc", 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "-", 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": -1, 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:14:44.834 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:14:44.835 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:44.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.814+0000 7f6112c00640 1 -- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f60ec06c560 msgr2=0x7f60ec06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.814+0000 7f6112c00640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f60ec06c560 0x7f60ec06ea20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f610c158350 tx=0x7f60f80019c0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.814+0000 7f6112c00640 1 -- 172.21.15.44:0/3886738831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f610c158e00 msgr2=0x7f610c14fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:44.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.814+0000 7f6112c00640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f610c158e00 0x7f610c14fa50 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f6104009e50 tx=0x7f6104004a40 comp rx=0 tx=0).stop 2024-03-30T13:14:44.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.814+0000 7f6112c00640 1 -- 172.21.15.44:0/3886738831 shutdown_connections 2024-03-30T13:14:44.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.814+0000 7f6112c00640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f610c158e00 0x7f610c14fa50 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.814+0000 7f6112c00640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f610c158a20 0x7f610c14f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.814+0000 7f6112c00640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f60ec06c560 0x7f60ec06ea20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.814+0000 7f6112c00640 1 --2- 172.21.15.44:0/3886738831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f610c0b0740 0x7f610c14d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:44.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.814+0000 7f6112c00640 1 -- 172.21.15.44:0/3886738831 >> 172.21.15.44:0/3886738831 conn(0x7f610c0d1160 msgr2=0x7f610c0b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:44.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.814+0000 7f6112c00640 1 -- 172.21.15.44:0/3886738831 shutdown_connections 2024-03-30T13:14:44.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:44.814+0000 7f6112c00640 1 -- 172.21.15.44:0/3886738831 wait complete. 2024-03-30T13:14:44.844 DEBUG:tasks.cephfs.test_uninlining:removing dir linux-5.4 2024-03-30T13:14:44.845 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && rm -rf linux-5.4/ 2024-03-30T13:14:45.355 INFO:tasks.cephfs.test_uninlining:Found 23 files with inline_data_length == 0 2024-03-30T13:14:45.355 INFO:tasks.cephfs.test_uninlining:Found 23 files with inline_data_version == CEPH_INLINE_NONE 2024-03-30T13:14:45.356 INFO:tasks.cephfs.test_uninlining:Running Data Uninlining test with: without clearing cache, without unmount client, without mount.open_background, without multimds, with snapshots 2024-03-30T13:14:45.356 DEBUG:tasks.cephfs.test_uninlining:setting max_mds:1 2024-03-30T13:14:45.356 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-03-30T13:14:45.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.563+0000 7fc656400640 1 Processor -- start 2024-03-30T13:14:45.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.564+0000 7fc656400640 1 -- start start 2024-03-30T13:14:45.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.565+0000 7fc656400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc650161ae0 0x7fc6500d2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:45.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.565+0000 7fc656400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc6500b3150 0x7fc6500b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:45.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.565+0000 7fc656400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6500cef30 con 0x7fc6500b4060 2024-03-30T13:14:45.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.565+0000 7fc656400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc6500d4d30 con 0x7fc650161ae0 2024-03-30T13:14:45.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.565+0000 7fc656400640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fc6500cf1d0 con 0x7fc6500b3150 2024-03-30T13:14:45.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.566+0000 7fc655000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc650161ae0 0x7fc6500d2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:45.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.566+0000 7fc655a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc6500b4060 0x7fc6500d0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:36892/0 (socket says 172.21.15.44:36892) 2024-03-30T13:14:45.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.566+0000 7fc655a00640 1 -- 172.21.15.44:0/3608888131 learned_addr learned my addr 172.21.15.44:0/3608888131 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:45.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.566+0000 7fc64fe00640 1 --2- 172.21.15.44:0/3608888131 >> v2:172.21.15.151:3300/0 conn(0x7fc6500b3150 0x7fc6500b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:45.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.566+0000 7fc64f400640 1 -- 172.21.15.44:0/3608888131 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467357411 0 0) 0x7fc6500cef30 con 0x7fc6500b4060 2024-03-30T13:14:45.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.566+0000 7fc655000640 1 -- 172.21.15.44:0/3608888131 >> v2:172.21.15.151:3300/0 conn(0x7fc6500b3150 msgr2=0x7fc6500b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:45.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.566+0000 7fc655000640 1 --2- 172.21.15.44:0/3608888131 >> v2:172.21.15.151:3300/0 conn(0x7fc6500b3150 0x7fc6500b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:45.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.566+0000 7fc655000640 1 -- 172.21.15.44:0/3608888131 >> v1:172.21.15.44:6789/0 conn(0x7fc6500b4060 legacy=0x7fc6500d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:45.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.566+0000 7fc655000640 1 -- 172.21.15.44:0/3608888131 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6500cf4b0 con 0x7fc650161ae0 2024-03-30T13:14:45.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.568+0000 7fc655000640 1 --2- 172.21.15.44:0/3608888131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc650161ae0 0x7fc6500d2e90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc65008c630 tx=0x7fc64402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2f1a5e0c1e1275 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:45.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.568+0000 7fc64f400640 1 -- 172.21.15.44:0/3608888131 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6440315a0 con 0x7fc650161ae0 2024-03-30T13:14:45.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.568+0000 7fc64f400640 1 -- 172.21.15.44:0/3608888131 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc644037070 con 0x7fc650161ae0 2024-03-30T13:14:45.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.568+0000 7fc64f400640 1 -- 172.21.15.44:0/3608888131 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc644031960 con 0x7fc650161ae0 2024-03-30T13:14:45.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.569+0000 7fc656400640 1 -- 172.21.15.44:0/3608888131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc650161ae0 msgr2=0x7fc6500d2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:45.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.569+0000 7fc656400640 1 --2- 172.21.15.44:0/3608888131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc650161ae0 0x7fc6500d2e90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc65008c630 tx=0x7fc64402b840 comp rx=0 tx=0).stop 2024-03-30T13:14:45.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.569+0000 7fc656400640 1 -- 172.21.15.44:0/3608888131 shutdown_connections 2024-03-30T13:14:45.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.569+0000 7fc656400640 1 --2- 172.21.15.44:0/3608888131 >> v2:172.21.15.151:3300/0 conn(0x7fc6500b3150 0x7fc6500b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:45.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.569+0000 7fc656400640 1 --2- 172.21.15.44:0/3608888131 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc650161ae0 0x7fc6500d2e90 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:45.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.569+0000 7fc656400640 1 -- 172.21.15.44:0/3608888131 >> 172.21.15.44:0/3608888131 conn(0x7fc65009d4f0 msgr2=0x7fc6500d41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:45.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.569+0000 7fc656400640 1 -- 172.21.15.44:0/3608888131 shutdown_connections 2024-03-30T13:14:45.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.569+0000 7fc656400640 1 -- 172.21.15.44:0/3608888131 wait complete. 2024-03-30T13:14:45.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.571+0000 7fc656400640 1 Processor -- start 2024-03-30T13:14:45.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.571+0000 7fc656400640 1 -- start start 2024-03-30T13:14:45.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.572+0000 7fc656400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6500b3150 0x7fc6500cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:45.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.572+0000 7fc656400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6500b4060 0x7fc6500b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:45.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.572+0000 7fc656400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc650161ae0 0x7fc6500c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:45.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.572+0000 7fc656400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc6500d48d0 con 0x7fc6500b4060 2024-03-30T13:14:45.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.572+0000 7fc656400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc650161ec0 con 0x7fc650161ae0 2024-03-30T13:14:45.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.572+0000 7fc656400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc6500d4a50 con 0x7fc6500b3150 2024-03-30T13:14:45.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.572+0000 7fc64fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6500b4060 0x7fc6500b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:45.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.572+0000 7fc64fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6500b4060 0x7fc6500b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:34374/0 (socket says 172.21.15.44:34374) 2024-03-30T13:14:45.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.572+0000 7fc64fe00640 1 -- 172.21.15.44:0/3652545471 learned_addr learned my addr 172.21.15.44:0/3652545471 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:45.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.573+0000 7fc655a00640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc650161ae0 0x7fc6500c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:45.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.573+0000 7fc64fe00640 1 -- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6500b3150 msgr2=0x7fc6500cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:45.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.573+0000 7fc64fe00640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6500b3150 0x7fc6500cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:45.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.573+0000 7fc64fe00640 1 -- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc650161ae0 msgr2=0x7fc6500c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:45.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.573+0000 7fc64fe00640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc650161ae0 0x7fc6500c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:45.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.573+0000 7fc64fe00640 1 -- 172.21.15.44:0/3652545471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65014dd90 con 0x7fc6500b4060 2024-03-30T13:14:45.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.573+0000 7fc64fe00640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6500b4060 0x7fc6500b87f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00d830 tx=0x7fc63c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:45.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.573+0000 7fc64cc00640 1 -- 172.21.15.44:0/3652545471 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00b6c0 con 0x7fc6500b4060 2024-03-30T13:14:45.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.573+0000 7fc64cc00640 1 -- 172.21.15.44:0/3652545471 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63c019070 con 0x7fc6500b4060 2024-03-30T13:14:45.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.573+0000 7fc64cc00640 1 -- 172.21.15.44:0/3652545471 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00ba80 con 0x7fc6500b4060 2024-03-30T13:14:45.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.573+0000 7fc656400640 1 -- 172.21.15.44:0/3652545471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc65014e070 con 0x7fc6500b4060 2024-03-30T13:14:45.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.574+0000 7fc656400640 1 -- 172.21.15.44:0/3652545471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc65014e630 con 0x7fc6500b4060 2024-03-30T13:14:45.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.575+0000 7fc656400640 1 -- 172.21.15.44:0/3652545471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc650075890 con 0x7fc6500b4060 2024-03-30T13:14:45.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.576+0000 7fc64cc00640 1 -- 172.21.15.44:0/3652545471 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc63c01e460 con 0x7fc6500b4060 2024-03-30T13:14:45.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.577+0000 7fc64cc00640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc63006c530 0x7fc63006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:45.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.577+0000 7fc64cc00640 1 -- 172.21.15.44:0/3652545471 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc63c08c070 con 0x7fc6500b4060 2024-03-30T13:14:45.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.577+0000 7fc655000640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc63006c530 0x7fc63006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:45.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.579+0000 7fc655000640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc63006c530 0x7fc63006e9f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc644036000 tx=0x7fc644030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:45.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.581+0000 7fc64cc00640 1 -- 172.21.15.44:0/3652545471 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc63c05a3b0 con 0x7fc6500b4060 2024-03-30T13:14:45.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:45.852+0000 7fc656400640 1 -- 172.21.15.44:0/3652545471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7fc6500b2f00 con 0x7fc6500b4060 2024-03-30T13:14:46.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.340+0000 7fc64cc00640 1 -- 172.21.15.44:0/3652545471 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v20) ==== 105+0+0 (secure 0 0 0) 0x7fc63c059cb0 con 0x7fc6500b4060 2024-03-30T13:14:46.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.343+0000 7fc656400640 1 -- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc63006c530 msgr2=0x7fc63006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:46.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.343+0000 7fc656400640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc63006c530 0x7fc63006e9f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc644036000 tx=0x7fc644030000 comp rx=0 tx=0).stop 2024-03-30T13:14:46.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.343+0000 7fc656400640 1 -- 172.21.15.44:0/3652545471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6500b4060 msgr2=0x7fc6500b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:46.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.343+0000 7fc656400640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6500b4060 0x7fc6500b87f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00d830 tx=0x7fc63c00dcf0 comp rx=0 tx=0).stop 2024-03-30T13:14:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.343+0000 7fc656400640 1 -- 172.21.15.44:0/3652545471 shutdown_connections 2024-03-30T13:14:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.343+0000 7fc656400640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc63006c530 0x7fc63006e9f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.343+0000 7fc656400640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc650161ae0 0x7fc6500c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.343+0000 7fc656400640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc6500b4060 0x7fc6500b87f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.343+0000 7fc656400640 1 --2- 172.21.15.44:0/3652545471 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6500b3150 0x7fc6500cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.343+0000 7fc656400640 1 -- 172.21.15.44:0/3652545471 >> 172.21.15.44:0/3652545471 conn(0x7fc65009d4f0 msgr2=0x7fc6500d0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.344+0000 7fc656400640 1 -- 172.21.15.44:0/3652545471 shutdown_connections 2024-03-30T13:14:46.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:46.344+0000 7fc656400640 1 -- 172.21.15.44:0/3652545471 wait complete. 2024-03-30T13:14:46.369 DEBUG:tasks.cephfs.test_uninlining:getting client_max_inline_size 2024-03-30T13:14:46.369 DEBUG:tasks.cephfs.test_uninlining:got client_max_inline_size:4096 2024-03-30T13:14:46.369 DEBUG:tasks.cephfs.test_uninlining:starting snapshotter thread 2024-03-30T13:14:46.369 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4 2024-03-30T13:14:46.437 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_0 2024-03-30T13:14:46.438 DEBUG:tasks.cephfs.test_uninlining:extracting tarball 2024-03-30T13:14:46.438 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && tar -x -z -f linux-5.4.tar.gz linux-5.4/fs/ceph linux-5.4/fs/orangefs linux-5.4/fs/ext2 2024-03-30T13:14:47.526 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_1 2024-03-30T13:14:48.621 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_2 2024-03-30T13:14:49.708 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_3 2024-03-30T13:14:50.796 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_4 2024-03-30T13:14:51.774 DEBUG:tasks.cephfs.test_uninlining:fetching dir list 2024-03-30T13:14:51.774 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -mindepth 2 -maxdepth 2 -type d 2024-03-30T13:14:51.832 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph 2024-03-30T13:14:51.833 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2 2024-03-30T13:14:51.833 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs 2024-03-30T13:14:51.833 DEBUG:tasks.cephfs.test_uninlining:distributing dir pins 2024-03-30T13:14:51.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:51.833 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ceph) 2024-03-30T13:14:51.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:51.886 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ext2) 2024-03-30T13:14:51.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:51.934 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/orangefs) 2024-03-30T13:14:51.964 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_5 2024-03-30T13:14:51.982 DEBUG:tasks.cephfs.test_uninlining:listing files with size <= 4096 2024-03-30T13:14:51.982 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -type f -size -4097c 2024-03-30T13:14:52.157 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:14:52.157 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/Makefile 2024-03-30T13:14:52.157 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:14:52.157 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/io.h 2024-03-30T13:14:52.157 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:14:52.157 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:14:52.157 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:14:52.157 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:14:52.157 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/Makefile 2024-03-30T13:14:52.157 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:14:52.157 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/acl.h 2024-03-30T13:14:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:14:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:14:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:14:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:14:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:14:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:14:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:14:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:14:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:14:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:14:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:14:52.158 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:14:52.159 INFO:tasks.cephfs.test_uninlining:Found 23 inlined files 2024-03-30T13:14:52.159 DEBUG:tasks.cephfs.test_uninlining:starting scrub 2024-03-30T13:14:52.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:52.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive 2024-03-30T13:14:52.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.359+0000 7fdee8e00640 1 Processor -- start 2024-03-30T13:14:52.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.359+0000 7fdee8e00640 1 -- start start 2024-03-30T13:14:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.361+0000 7fdee8e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdee4161c30 0x7fdee40d2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.361+0000 7fdee8e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee4162010 con 0x7fdee40b5870 2024-03-30T13:14:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.361+0000 7fdee8e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee40b31c0 con 0x7fdee40d1100 2024-03-30T13:14:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.361+0000 7fdee8e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fdee40d22f0 con 0x7fdee4161c30 2024-03-30T13:14:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.361+0000 7fdee2a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdee40b5870 0x7fdee40d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33398/0 (socket says 172.21.15.44:33398) 2024-03-30T13:14:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.361+0000 7fdee2a00640 1 -- 172.21.15.44:0/3593356004 learned_addr learned my addr 172.21.15.44:0/3593356004 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.361+0000 7fdee3400640 1 --2- 172.21.15.44:0/3593356004 >> v2:172.21.15.44:3300/0 conn(0x7fdee4161c30 0x7fdee40d2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.362+0000 7fdee2000640 1 -- 172.21.15.44:0/3593356004 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776338977 0 0) 0x7fded0001110 con 0x7fdee40b5870 2024-03-30T13:14:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.362+0000 7fdee2000640 1 -- 172.21.15.44:0/3593356004 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdec8003520 con 0x7fdee40b5870 2024-03-30T13:14:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.362+0000 7fdee3400640 1 -- 172.21.15.44:0/3593356004 >> v1:172.21.15.151:6789/0 conn(0x7fdee40d1100 legacy=0x7fdee40cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.362+0000 7fdee3400640 1 -- 172.21.15.44:0/3593356004 >> v1:172.21.15.44:6789/0 conn(0x7fdee40b5870 legacy=0x7fdee40d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.362+0000 7fdee3400640 1 -- 172.21.15.44:0/3593356004 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee40d25d0 con 0x7fdee4161c30 2024-03-30T13:14:52.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.363+0000 7fdee3400640 1 --2- 172.21.15.44:0/3593356004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee4161c30 0x7fdee40d2dd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fded40097a0 tx=0x7fded402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfddeaab853eabb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.364+0000 7fdee2000640 1 -- 172.21.15.44:0/3593356004 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4035020 con 0x7fdee4161c30 2024-03-30T13:14:52.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.364+0000 7fdee2000640 1 -- 172.21.15.44:0/3593356004 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded4031830 con 0x7fdee4161c30 2024-03-30T13:14:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.364+0000 7fdee2000640 1 -- 172.21.15.44:0/3593356004 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4031c00 con 0x7fdee4161c30 2024-03-30T13:14:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.364+0000 7fdee8e00640 1 -- 172.21.15.44:0/3593356004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee4161c30 msgr2=0x7fdee40d2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.364+0000 7fdee8e00640 1 --2- 172.21.15.44:0/3593356004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee4161c30 0x7fdee40d2dd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fded40097a0 tx=0x7fded402b8d0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.364+0000 7fdee8e00640 1 -- 172.21.15.44:0/3593356004 shutdown_connections 2024-03-30T13:14:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.364+0000 7fdee8e00640 1 --2- 172.21.15.44:0/3593356004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee4161c30 0x7fdee40d2dd0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.364+0000 7fdee8e00640 1 -- 172.21.15.44:0/3593356004 >> 172.21.15.44:0/3593356004 conn(0x7fdee409d510 msgr2=0x7fdee40d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.364+0000 7fdee8e00640 1 -- 172.21.15.44:0/3593356004 shutdown_connections 2024-03-30T13:14:52.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.364+0000 7fdee8e00640 1 -- 172.21.15.44:0/3593356004 wait complete. 2024-03-30T13:14:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.366+0000 7fdee8e00640 1 Processor -- start 2024-03-30T13:14:52.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.366+0000 7fdee8e00640 1 -- start start 2024-03-30T13:14:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.367+0000 7fdee8e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdee40b5870 0x7fdee415fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.367+0000 7fdee8e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdee40d1100 0x7fdee40b98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.367+0000 7fdee8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee4161c30 0x7fdee4150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.367+0000 7fdee8e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdee40b3600 con 0x7fdee4161c30 2024-03-30T13:14:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.367+0000 7fdee8e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdee40d3310 con 0x7fdee40b5870 2024-03-30T13:14:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.367+0000 7fdee8e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fdee40b3780 con 0x7fdee40d1100 2024-03-30T13:14:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee4161c30 0x7fdee4150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee4161c30 0x7fdee4150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35948/0 (socket says 172.21.15.44:35948) 2024-03-30T13:14:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee3e00640 1 -- 172.21.15.44:0/340253204 learned_addr learned my addr 172.21.15.44:0/340253204 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee2a00640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdee40d1100 0x7fdee40b98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee3400640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdee40b5870 0x7fdee415fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee3e00640 1 -- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdee40d1100 msgr2=0x7fdee40b98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee3e00640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdee40d1100 0x7fdee40b98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee3e00640 1 -- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdee40b5870 msgr2=0x7fdee415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee3e00640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdee40b5870 0x7fdee415fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee3e00640 1 -- 172.21.15.44:0/340253204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee414e540 con 0x7fdee4161c30 2024-03-30T13:14:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee2a00640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdee40d1100 0x7fdee40b98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:52.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee3400640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdee40b5870 0x7fdee415fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:52.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.368+0000 7fdee3e00640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee4161c30 0x7fdee4150430 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00c780 tx=0x7fdedc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.369+0000 7fdedb400640 1 -- 172.21.15.44:0/340253204 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc004b60 con 0x7fdee4161c30 2024-03-30T13:14:52.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.369+0000 7fdedb400640 1 -- 172.21.15.44:0/340253204 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdedc004d00 con 0x7fdee4161c30 2024-03-30T13:14:52.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.369+0000 7fdedb400640 1 -- 172.21.15.44:0/340253204 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00aa90 con 0x7fdee4161c30 2024-03-30T13:14:52.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.369+0000 7fdee8e00640 1 -- 172.21.15.44:0/340253204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee414e820 con 0x7fdee4161c30 2024-03-30T13:14:52.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.369+0000 7fdee8e00640 1 -- 172.21.15.44:0/340253204 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee414ede0 con 0x7fdee4161c30 2024-03-30T13:14:52.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.371+0000 7fdedb400640 1 -- 172.21.15.44:0/340253204 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdedc00ac30 con 0x7fdee4161c30 2024-03-30T13:14:52.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.372+0000 7fdedb400640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdec406c530 0x7fdec406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.372+0000 7fdedb400640 1 -- 172.21.15.44:0/340253204 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fdedc08bbb0 con 0x7fdee4161c30 2024-03-30T13:14:52.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.373+0000 7fdee3400640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdec406c530 0x7fdec406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.373+0000 7fdeed16c740 1 Processor -- start 2024-03-30T13:14:52.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.373+0000 7fdeed16c740 1 -- start start 2024-03-30T13:14:52.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.374+0000 7fdee3400640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdec406c530 0x7fdec406e9f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fded4036000 tx=0x7fded4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.374+0000 7fdeed16c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d8f30 0x5630e14abed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.374+0000 7fdeed16c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d9310 0x5630e14dbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.374+0000 7fdeed16c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14ac410 0x5630e14dc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.374+0000 7fdeed16c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5630e1415350 con 0x5630e14ac410 2024-03-30T13:14:52.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.374+0000 7fdeed16c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5630e13bd530 con 0x5630e14d9310 2024-03-30T13:14:52.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.374+0000 7fdeed16c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5630e1411300 con 0x5630e14d8f30 2024-03-30T13:14:52.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.375+0000 7fdee3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14ac410 0x5630e14dc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.375+0000 7fdee3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14ac410 0x5630e14dc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35964/0 (socket says 172.21.15.44:35964) 2024-03-30T13:14:52.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.375+0000 7fdee3e00640 1 -- 172.21.15.44:0/3655658823 learned_addr learned my addr 172.21.15.44:0/3655658823 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:52.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.375+0000 7fdee3400640 1 --2- 172.21.15.44:0/3655658823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d8f30 0x5630e14abed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.375+0000 7fdee2a00640 1 --2- 172.21.15.44:0/3655658823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d9310 0x5630e14dbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.375+0000 7fdee3e00640 1 -- 172.21.15.44:0/3655658823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d8f30 msgr2=0x5630e14abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.375+0000 7fdee3e00640 1 --2- 172.21.15.44:0/3655658823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d8f30 0x5630e14abed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.375+0000 7fdee3e00640 1 -- 172.21.15.44:0/3655658823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d9310 msgr2=0x5630e14dbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.375+0000 7fdee3e00640 1 --2- 172.21.15.44:0/3655658823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d9310 0x5630e14dbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.375+0000 7fdee3e00640 1 -- 172.21.15.44:0/3655658823 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e13d41d0 con 0x5630e14ac410 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.375+0000 7fdee3e00640 1 --2- 172.21.15.44:0/3655658823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14ac410 0x5630e14dc200 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdedc089ea0 tx=0x7fdedc055cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0483c4e6bfad41 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.376+0000 7fdecfe00640 1 -- 172.21.15.44:0/3655658823 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc05ee60 con 0x5630e14ac410 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.376+0000 7fdecfe00640 1 -- 172.21.15.44:0/3655658823 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdedc088070 con 0x5630e14ac410 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.376+0000 7fdecfe00640 1 -- 172.21.15.44:0/3655658823 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc062500 con 0x5630e14ac410 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.376+0000 7fdeed16c740 1 -- 172.21.15.44:0/3655658823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14ac410 msgr2=0x5630e14dc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.376+0000 7fdeed16c740 1 --2- 172.21.15.44:0/3655658823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14ac410 0x5630e14dc200 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdedc089ea0 tx=0x7fdedc055cf0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.376+0000 7fdeed16c740 1 -- 172.21.15.44:0/3655658823 shutdown_connections 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.376+0000 7fdeed16c740 1 --2- 172.21.15.44:0/3655658823 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14ac410 0x5630e14dc200 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.376+0000 7fdeed16c740 1 --2- 172.21.15.44:0/3655658823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d9310 0x5630e14dbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.376+0000 7fdeed16c740 1 --2- 172.21.15.44:0/3655658823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d8f30 0x5630e14abed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.376+0000 7fdeed16c740 1 -- 172.21.15.44:0/3655658823 >> 172.21.15.44:0/3655658823 conn(0x5630e14ae140 msgr2=0x5630e14f6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.377+0000 7fdeed16c740 1 -- 172.21.15.44:0/3655658823 shutdown_connections 2024-03-30T13:14:52.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.377+0000 7fdeed16c740 1 -- 172.21.15.44:0/3655658823 wait complete. 2024-03-30T13:14:52.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.377+0000 7fdeed16c740 1 -- start start 2024-03-30T13:14:52.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.377+0000 7fdeed16c740 1 Processor -- start 2024-03-30T13:14:52.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.378+0000 7fdeed16c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d8f30 0x5630e14df6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.378+0000 7fdeed16c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d9310 0x5630e14dce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.378+0000 7fdeed16c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d1080 0x5630e14dd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdeed16c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5630e1415350 con 0x5630e14d9310 2024-03-30T13:14:52.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdeed16c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5630e13d08f0 con 0x5630e14d8f30 2024-03-30T13:14:52.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdeed16c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5630e14b07e0 con 0x5630e14d1080 2024-03-30T13:14:52.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdeed16c740 10 client.0 _ll_register_callbacks cb 0x5630e13d50c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:52.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdee2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d9310 0x5630e14dce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdee2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d9310 0x5630e14dce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35974/0 (socket says 172.21.15.44:35974) 2024-03-30T13:14:52.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdee2a00640 1 -- 172.21.15.44:0/1499686172 learned_addr learned my addr 172.21.15.44:0/1499686172 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:52.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdee3e00640 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d1080 0x5630e14dd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdee3400640 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d8f30 0x5630e14df6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdee2a00640 1 -- 172.21.15.44:0/1499686172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d1080 msgr2=0x5630e14dd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdee2a00640 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d1080 0x5630e14dd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdee2a00640 1 -- 172.21.15.44:0/1499686172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d8f30 msgr2=0x5630e14df6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdee2a00640 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d8f30 0x5630e14df6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.379+0000 7fdee2a00640 1 -- 172.21.15.44:0/1499686172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e11f57b0 con 0x5630e14d9310 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.380+0000 7fdee2a00640 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d9310 0x5630e14dce60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fded0007fa0 tx=0x7fded000f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb6b7a720cc908c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.380+0000 7fdeccc00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.380+0000 7fdeccc00640 1 -- 172.21.15.44:0/1499686172 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded00058b0 con 0x5630e14d9310 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.380+0000 7fdeccc00640 1 -- 172.21.15.44:0/1499686172 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fded0005a50 con 0x5630e14d9310 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.380+0000 7fdeed16c740 1 -- 172.21.15.44:0/1499686172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdedc088070 con 0x5630e14d9310 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.380+0000 7fdeccc00640 1 -- 172.21.15.44:0/1499686172 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fded0020050 con 0x5630e14d9310 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.380+0000 7fdeed16c740 10 client.6048 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.380+0000 7fdeed16c740 1 -- 172.21.15.44:0/1499686172 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5630e1255f40 con 0x5630e14d9310 2024-03-30T13:14:52.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.380+0000 7fdeccc00640 1 -- 172.21.15.44:0/1499686172 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdedc088070 con 0x5630e14d9310 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.381+0000 7fdeccc00640 1 -- 172.21.15.44:0/1499686172 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fded0023020 con 0x5630e14d9310 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.381+0000 7fdeed16c740 10 client.6048 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.381+0000 7fdeed16c740 10 client.6048 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.381+0000 7fdeed16c740 20 client.6048 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.381+0000 7fdeed16c740 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5630e14daa90 0x5630e1513e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.381+0000 7fdeed16c740 4 client.6048 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.381+0000 7fdeed16c740 1 -- 172.21.15.44:0/1499686172 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630e1422890 con 0x5630e14daa90 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.381+0000 7fdee3400640 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5630e14daa90 0x5630e1513e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.382+0000 7fdee3400640 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5630e14daa90 0x5630e1513e00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d193f18b49619c4a server_cookie=7df3de97b367e961 in_seq=0 out_seq=0 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.382+0000 7fdeccc00640 10 client.6048 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeccc00640 1 -- 172.21.15.44:0/1499686172 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5630e1422890 con 0x5630e14daa90 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeccc00640 10 client.6048 handle_command_reply: tid=0 2024-03-30T13:14:52.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeed16c740 1 client.6048 shutdown 2024-03-30T13:14:52.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeed16c740 1 -- 172.21.15.44:0/1499686172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d9310 msgr2=0x5630e14dce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeed16c740 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d9310 0x5630e14dce60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fded0007fa0 tx=0x7fded000f660 comp rx=0 tx=0).stop 2024-03-30T13:14:52.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeed16c740 1 -- 172.21.15.44:0/1499686172 shutdown_connections 2024-03-30T13:14:52.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeed16c740 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5630e14daa90 0x5630e1513e00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeed16c740 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d1080 0x5630e14dd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeed16c740 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d9310 0x5630e14dce60 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeed16c740 1 --2- 172.21.15.44:0/1499686172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d8f30 0x5630e14df6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeed16c740 1 -- 172.21.15.44:0/1499686172 >> 172.21.15.44:0/1499686172 conn(0x5630e14ac410 msgr2=0x5630e14f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:52.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeccc00640 0 client.6048 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:52.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeed16c740 1 -- 172.21.15.44:0/1499686172 shutdown_connections 2024-03-30T13:14:52.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.383+0000 7fdeed16c740 1 -- 172.21.15.44:0/1499686172 wait complete. 2024-03-30T13:14:52.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.384+0000 7fdeed16c740 20 client.6048 trim_cache size 0 max 16384 2024-03-30T13:14:52.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.403+0000 7fdeed16c740 1 Processor -- start 2024-03-30T13:14:52.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.403+0000 7fdeed16c740 1 -- start start 2024-03-30T13:14:52.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.404+0000 7fdeed16c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d1080 0x5630e14dccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.404+0000 7fdeed16c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d8f30 0x5630e14dd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.404+0000 7fdeed16c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d9310 0x5630e1518e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.404+0000 7fdeed16c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4201120 con 0x5630e14d8f30 2024-03-30T13:14:52.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.404+0000 7fdeed16c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4200120 con 0x5630e14d1080 2024-03-30T13:14:52.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.404+0000 7fdeed16c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fdee415f2f0 con 0x5630e14d9310 2024-03-30T13:14:52.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.404+0000 7fdee2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d8f30 0x5630e14dd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.404+0000 7fdee2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d8f30 0x5630e14dd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35986/0 (socket says 172.21.15.44:35986) 2024-03-30T13:14:52.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.404+0000 7fdee2a00640 1 -- 172.21.15.44:0/2107178892 learned_addr learned my addr 172.21.15.44:0/2107178892 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:52.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.405+0000 7fdee2a00640 1 -- 172.21.15.44:0/2107178892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d9310 msgr2=0x5630e1518e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.405+0000 7fdee2a00640 1 --2- 172.21.15.44:0/2107178892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d9310 0x5630e1518e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.405+0000 7fdee2a00640 1 -- 172.21.15.44:0/2107178892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d1080 msgr2=0x5630e14dccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.405+0000 7fdee2a00640 1 --2- 172.21.15.44:0/2107178892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d1080 0x5630e14dccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.405+0000 7fdee2a00640 1 -- 172.21.15.44:0/2107178892 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e10e90a0 con 0x5630e14d8f30 2024-03-30T13:14:52.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.405+0000 7fdee2a00640 1 --2- 172.21.15.44:0/2107178892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d8f30 0x5630e14dd200 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fded0005bf0 tx=0x7fded000d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d34c919d433b87 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.405+0000 7fdecf400640 1 -- 172.21.15.44:0/2107178892 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded00074e0 con 0x5630e14d8f30 2024-03-30T13:14:52.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.405+0000 7fdecf400640 1 -- 172.21.15.44:0/2107178892 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded0018070 con 0x5630e14d8f30 2024-03-30T13:14:52.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.405+0000 7fdecf400640 1 -- 172.21.15.44:0/2107178892 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded00133f0 con 0x5630e14d8f30 2024-03-30T13:14:52.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.406+0000 7fdeed16c740 1 -- 172.21.15.44:0/2107178892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d8f30 msgr2=0x5630e14dd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.406+0000 7fdeed16c740 1 --2- 172.21.15.44:0/2107178892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d8f30 0x5630e14dd200 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fded0005bf0 tx=0x7fded000d000 comp rx=0 tx=0).stop 2024-03-30T13:14:52.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.406+0000 7fdeed16c740 1 -- 172.21.15.44:0/2107178892 shutdown_connections 2024-03-30T13:14:52.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.406+0000 7fdeed16c740 1 --2- 172.21.15.44:0/2107178892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d9310 0x5630e1518e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.406+0000 7fdeed16c740 1 --2- 172.21.15.44:0/2107178892 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d8f30 0x5630e14dd200 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.406+0000 7fdeed16c740 1 --2- 172.21.15.44:0/2107178892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d1080 0x5630e14dccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.406+0000 7fdeed16c740 1 -- 172.21.15.44:0/2107178892 >> 172.21.15.44:0/2107178892 conn(0x5630e14ac410 msgr2=0x5630e14de2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:52.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.406+0000 7fdeed16c740 1 -- 172.21.15.44:0/2107178892 shutdown_connections 2024-03-30T13:14:52.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.406+0000 7fdeed16c740 1 -- 172.21.15.44:0/2107178892 wait complete. 2024-03-30T13:14:52.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.407+0000 7fdeed16c740 1 -- start start 2024-03-30T13:14:52.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.407+0000 7fdeed16c740 1 Processor -- start 2024-03-30T13:14:52.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.408+0000 7fdeed16c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d1080 0x5630e1517e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.408+0000 7fdeed16c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d8f30 0x5630e1572f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.408+0000 7fdeed16c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d9310 0x5630e14d74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.408+0000 7fdeed16c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41500e0 con 0x5630e14d1080 2024-03-30T13:14:52.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.408+0000 7fdeed16c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5630e14fa5d0 con 0x5630e14d9310 2024-03-30T13:14:52.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.408+0000 7fdeed16c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5630e1518790 con 0x5630e14d8f30 2024-03-30T13:14:52.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.408+0000 7fdeed16c740 10 client.0 _ll_register_callbacks cb 0x7fded0007ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:52.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.408+0000 7fdee3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d1080 0x5630e1517e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.408+0000 7fdee3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d1080 0x5630e1517e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35998/0 (socket says 172.21.15.44:35998) 2024-03-30T13:14:52.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.408+0000 7fdee3400640 1 -- 172.21.15.44:0/1776983158 learned_addr learned my addr 172.21.15.44:0/1776983158 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:52.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.409+0000 7fdee2a00640 1 --2- 172.21.15.44:0/1776983158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d8f30 0x5630e1572f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.409+0000 7fdee3400640 1 -- 172.21.15.44:0/1776983158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d8f30 msgr2=0x5630e1572f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.409+0000 7fdee3400640 1 --2- 172.21.15.44:0/1776983158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d8f30 0x5630e1572f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.409+0000 7fdee3400640 1 -- 172.21.15.44:0/1776983158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d9310 msgr2=0x5630e14d74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.409+0000 7fdee3400640 1 --2- 172.21.15.44:0/1776983158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d9310 0x5630e14d74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.409+0000 7fdee3400640 1 -- 172.21.15.44:0/1776983158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e1572760 con 0x5630e14d1080 2024-03-30T13:14:52.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.409+0000 7fdee3400640 1 --2- 172.21.15.44:0/1776983158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d1080 0x5630e1517e20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fded4034040 tx=0x7fded40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d0ab3701eef8e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.409+0000 7fdeccc00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:52.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.409+0000 7fdeccc00640 1 -- 172.21.15.44:0/1776983158 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4055060 con 0x5630e14d1080 2024-03-30T13:14:52.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.409+0000 7fdeccc00640 1 -- 172.21.15.44:0/1776983158 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fded4047c00 con 0x5630e14d1080 2024-03-30T13:14:52.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.409+0000 7fdeed16c740 1 -- 172.21.15.44:0/1776983158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fded0018070 con 0x5630e14d1080 2024-03-30T13:14:52.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.410+0000 7fdeccc00640 1 -- 172.21.15.44:0/1776983158 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fded405b050 con 0x5630e14d1080 2024-03-30T13:14:52.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.410+0000 7fdeed16c740 10 client.6054 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:52.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.410+0000 7fdeed16c740 1 -- 172.21.15.44:0/1776983158 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5630e1518530 con 0x5630e14d1080 2024-03-30T13:14:52.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.410+0000 7fdeccc00640 1 -- 172.21.15.44:0/1776983158 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded0018070 con 0x5630e14d1080 2024-03-30T13:14:52.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.410+0000 7fdeccc00640 1 -- 172.21.15.44:0/1776983158 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fded405e020 con 0x5630e14d1080 2024-03-30T13:14:52.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.410+0000 7fdeed16c740 10 client.6054 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:52.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.410+0000 7fdeed16c740 10 client.6054 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:52.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.410+0000 7fdeed16c740 20 client.6054 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:52.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.410+0000 7fdeed16c740 1 --2- 172.21.15.44:0/1776983158 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5630e156ca20 0x5630e14d7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.410+0000 7fdeed16c740 4 client.6054 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-03-30T13:14:52.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.410+0000 7fdeed16c740 1 -- 172.21.15.44:0/1776983158 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x5630e141cbe0 con 0x5630e156ca20 2024-03-30T13:14:52.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.410+0000 7fdee2a00640 1 --2- 172.21.15.44:0/1776983158 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5630e156ca20 0x5630e14d7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.411+0000 7fdeccc00640 10 client.6054 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:52.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.411+0000 7fdee2a00640 1 --2- 172.21.15.44:0/1776983158 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5630e156ca20 0x5630e14d7a20 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da911c7eef8aaa65 server_cookie=8ce4a2a439534b78 in_seq=0 out_seq=0 2024-03-30T13:14:52.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.412+0000 7fdeccc00640 1 -- 172.21.15.44:0/1776983158 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5630e141cbe0 con 0x5630e156ca20 2024-03-30T13:14:52.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.412+0000 7fdeccc00640 10 client.6054 handle_command_reply: tid=0 2024-03-30T13:14:52.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.412+0000 7fdeed16c740 1 client.6054 shutdown 2024-03-30T13:14:52.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.413+0000 7fdeed16c740 1 -- 172.21.15.44:0/1776983158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d1080 msgr2=0x5630e1517e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.413+0000 7fdeed16c740 1 --2- 172.21.15.44:0/1776983158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d1080 0x5630e1517e20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fded4034040 tx=0x7fded40046c0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.413+0000 7fdeed16c740 1 -- 172.21.15.44:0/1776983158 shutdown_connections 2024-03-30T13:14:52.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.413+0000 7fdeed16c740 1 --2- 172.21.15.44:0/1776983158 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5630e156ca20 0x5630e14d7a20 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.413+0000 7fdeed16c740 1 --2- 172.21.15.44:0/1776983158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630e14d9310 0x5630e14d74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.413+0000 7fdeed16c740 1 --2- 172.21.15.44:0/1776983158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630e14d8f30 0x5630e1572f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.413+0000 7fdeed16c740 1 --2- 172.21.15.44:0/1776983158 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5630e14d1080 0x5630e1517e20 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.413+0000 7fdeed16c740 1 -- 172.21.15.44:0/1776983158 >> 172.21.15.44:0/1776983158 conn(0x5630e14ac410 msgr2=0x5630e14dccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:52.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.413+0000 7fdeccc00640 0 client.6054 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:52.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.413+0000 7fdeed16c740 1 -- 172.21.15.44:0/1776983158 shutdown_connections 2024-03-30T13:14:52.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.413+0000 7fdeed16c740 1 -- 172.21.15.44:0/1776983158 wait complete. 2024-03-30T13:14:52.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.413+0000 7fdeed16c740 20 client.6054 trim_cache size 0 max 16384 2024-03-30T13:14:52.421 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:52.422 INFO:teuthology.orchestra.run.smithi044.stdout: "return_code": 0, 2024-03-30T13:14:52.422 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_tag": "8c53b1c8-1c8b-48a2-b043-c812feb528ad", 2024-03-30T13:14:52.422 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": "asynchronous" 2024-03-30T13:14:52.422 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.414+0000 7fdee8e00640 1 -- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdec406c530 msgr2=0x7fdec406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.414+0000 7fdee8e00640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdec406c530 0x7fdec406e9f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fded4036000 tx=0x7fded4008030 comp rx=0 tx=0).stop 2024-03-30T13:14:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.414+0000 7fdee8e00640 1 -- 172.21.15.44:0/340253204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee4161c30 msgr2=0x7fdee4150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.414+0000 7fdee8e00640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee4161c30 0x7fdee4150430 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00c780 tx=0x7fdedc00cc40 comp rx=0 tx=0).stop 2024-03-30T13:14:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.414+0000 7fdee8e00640 1 -- 172.21.15.44:0/340253204 shutdown_connections 2024-03-30T13:14:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.414+0000 7fdee8e00640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdee4161c30 0x7fdee4150430 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.414+0000 7fdee8e00640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdee40d1100 0x7fdee40b98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.414+0000 7fdee8e00640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fdec406c530 0x7fdec406e9f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.414+0000 7fdee8e00640 1 --2- 172.21.15.44:0/340253204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdee40b5870 0x7fdee415fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.415+0000 7fdee8e00640 1 -- 172.21.15.44:0/340253204 >> 172.21.15.44:0/340253204 conn(0x7fdee409d510 msgr2=0x7fdee406caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.415+0000 7fdee8e00640 1 -- 172.21.15.44:0/340253204 shutdown_connections 2024-03-30T13:14:52.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.415+0000 7fdee8e00640 1 -- 172.21.15.44:0/340253204 wait complete. 2024-03-30T13:14:52.442 DEBUG:tasks.cephfs.test_uninlining:scrub start response: {'return_code': 0, 'scrub_tag': '8c53b1c8-1c8b-48a2-b043-c812feb528ad', 'mode': 'asynchronous'} 2024-03-30T13:14:52.443 DEBUG:tasks.cephfs.test_uninlining:waiting for scrub to complete 2024-03-30T13:14:52.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:14:52.443 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-30T13:14:52.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.695+0000 7f1ae0800640 1 Processor -- start 2024-03-30T13:14:52.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.695+0000 7f1ae0800640 1 -- start start 2024-03-30T13:14:52.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.697+0000 7f1ae0800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1ad813f0c0 0x7f1ad806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.697+0000 7f1ae0800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ad81605a0 0x7f1ad80cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.697+0000 7f1ae0800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ad80ce9c0 con 0x7f1ad806d720 2024-03-30T13:14:52.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.697+0000 7f1ae0800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1ad8160e30 con 0x7f1ad81605a0 2024-03-30T13:14:52.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.697+0000 7f1ae0800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f1ad8160b50 con 0x7f1ad813f0c0 2024-03-30T13:14:52.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.697+0000 7f1ade800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1ad81605a0 0x7f1ad80cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.697+0000 7f1add400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1ad806d720 0x7f1ad815fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33408/0 (socket says 172.21.15.44:33408) 2024-03-30T13:14:52.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.697+0000 7f1add400640 1 -- 172.21.15.44:0/3653959608 learned_addr learned my addr 172.21.15.44:0/3653959608 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:14:52.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.697+0000 7f1adde00640 1 --2- 172.21.15.44:0/3653959608 >> v2:172.21.15.151:3300/0 conn(0x7f1ad813f0c0 0x7f1ad806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.698+0000 7f1ade800640 1 -- 172.21.15.44:0/3653959608 >> v2:172.21.15.151:3300/0 conn(0x7f1ad813f0c0 msgr2=0x7f1ad806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.698+0000 7f1ade800640 1 --2- 172.21.15.44:0/3653959608 >> v2:172.21.15.151:3300/0 conn(0x7f1ad813f0c0 0x7f1ad806d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.698+0000 7f1ade800640 1 -- 172.21.15.44:0/3653959608 >> v1:172.21.15.44:6789/0 conn(0x7f1ad806d720 legacy=0x7f1ad815fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.698+0000 7f1ade800640 1 -- 172.21.15.44:0/3653959608 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad813fa40 con 0x7f1ad81605a0 2024-03-30T13:14:52.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.698+0000 7f1adde00640 1 --2- 172.21.15.44:0/3653959608 >> v2:172.21.15.151:3300/0 conn(0x7f1ad813f0c0 0x7f1ad806d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:52.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.698+0000 7f1adca00640 1 -- 172.21.15.44:0/3653959608 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1985085776 0 0) 0x7f1ac8001110 con 0x7f1ad806d720 2024-03-30T13:14:52.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.699+0000 7f1ade800640 1 --2- 172.21.15.44:0/3653959608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ad81605a0 0x7f1ad80cfbb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1ad806e2b0 tx=0x7f1ad402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b156cce12df11f22 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.699+0000 7f1adca00640 1 -- 172.21.15.44:0/3653959608 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4039070 con 0x7f1ad81605a0 2024-03-30T13:14:52.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.699+0000 7f1adca00640 1 -- 172.21.15.44:0/3653959608 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad402cb60 con 0x7f1ad81605a0 2024-03-30T13:14:52.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.699+0000 7f1adca00640 1 -- 172.21.15.44:0/3653959608 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4034440 con 0x7f1ad81605a0 2024-03-30T13:14:52.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.700+0000 7f1ae0800640 1 -- 172.21.15.44:0/3653959608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ad81605a0 msgr2=0x7f1ad80cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.700+0000 7f1ae0800640 1 --2- 172.21.15.44:0/3653959608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ad81605a0 0x7f1ad80cfbb0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1ad806e2b0 tx=0x7f1ad402bdb0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.700+0000 7f1ae0800640 1 -- 172.21.15.44:0/3653959608 shutdown_connections 2024-03-30T13:14:52.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.700+0000 7f1ae0800640 1 --2- 172.21.15.44:0/3653959608 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ad81605a0 0x7f1ad80cfbb0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.700+0000 7f1ae0800640 1 --2- 172.21.15.44:0/3653959608 >> v2:172.21.15.151:3300/0 conn(0x7f1ad813f0c0 0x7f1ad806d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.700+0000 7f1ae0800640 1 -- 172.21.15.44:0/3653959608 >> 172.21.15.44:0/3653959608 conn(0x7f1ad80b5b00 msgr2=0x7f1ad806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:52.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.700+0000 7f1ae0800640 1 -- 172.21.15.44:0/3653959608 shutdown_connections 2024-03-30T13:14:52.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.700+0000 7f1ae0800640 1 -- 172.21.15.44:0/3653959608 wait complete. 2024-03-30T13:14:52.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.701+0000 7f1ae0800640 1 Processor -- start 2024-03-30T13:14:52.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.702+0000 7f1ae0800640 1 -- start start 2024-03-30T13:14:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.702+0000 7f1ae0800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ad806d720 0x7f1ad8157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.702+0000 7f1ae0800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ad813f0c0 0x7f1ad813dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.702+0000 7f1ae0800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ad81605a0 0x7f1ad8141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.702+0000 7f1ae0800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad813f4a0 con 0x7f1ad813f0c0 2024-03-30T13:14:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.702+0000 7f1ae0800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8140000 con 0x7f1ad806d720 2024-03-30T13:14:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.702+0000 7f1ae0800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad813f620 con 0x7f1ad81605a0 2024-03-30T13:14:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.703+0000 7f1add400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ad813f0c0 0x7f1ad813dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.703+0000 7f1add400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ad813f0c0 0x7f1ad813dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36006/0 (socket says 172.21.15.44:36006) 2024-03-30T13:14:52.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.703+0000 7f1add400640 1 -- 172.21.15.44:0/3486786200 learned_addr learned my addr 172.21.15.44:0/3486786200 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.703+0000 7f1add400640 1 -- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ad81605a0 msgr2=0x7f1ad8141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.703+0000 7f1add400640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ad81605a0 0x7f1ad8141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.703+0000 7f1adde00640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ad806d720 0x7f1ad8157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.703+0000 7f1add400640 1 -- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ad806d720 msgr2=0x7f1ad8157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.703+0000 7f1add400640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ad806d720 0x7f1ad8157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.703+0000 7f1add400640 1 -- 172.21.15.44:0/3486786200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad8142760 con 0x7f1ad813f0c0 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.704+0000 7f1add400640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ad813f0c0 0x7f1ad813dfe0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800c430 tx=0x7f1ac800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.704+0000 7f1ad2000640 1 -- 172.21.15.44:0/3486786200 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac80074e0 con 0x7f1ad813f0c0 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.704+0000 7f1ad2000640 1 -- 172.21.15.44:0/3486786200 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac80047e0 con 0x7f1ad813f0c0 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.704+0000 7f1ad2000640 1 -- 172.21.15.44:0/3486786200 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8004bd0 con 0x7f1ad813f0c0 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.704+0000 7f1ae0800640 1 -- 172.21.15.44:0/3486786200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad8142480 con 0x7f1ad813f0c0 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.704+0000 7f1ae0800640 1 -- 172.21.15.44:0/3486786200 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad80b26d0 con 0x7f1ad813f0c0 2024-03-30T13:14:52.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.706+0000 7f1ad2000640 1 -- 172.21.15.44:0/3486786200 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1ac8011070 con 0x7f1ad813f0c0 2024-03-30T13:14:52.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.707+0000 7f1ad2000640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1abc06c560 0x7f1abc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.707+0000 7f1ad2000640 1 -- 172.21.15.44:0/3486786200 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f1ac808b5d0 con 0x7f1ad813f0c0 2024-03-30T13:14:52.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.708+0000 7f1adde00640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1abc06c560 0x7f1abc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.709+0000 7f1adde00640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1abc06c560 0x7f1abc06ea20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1acc008850 tx=0x7f1acc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.710+0000 7f1ae3122740 1 Processor -- start 2024-03-30T13:14:52.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.710+0000 7f1ae3122740 1 -- start start 2024-03-30T13:14:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.711+0000 7f1ae3122740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b5c0 0x564ec5d3e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.711+0000 7f1ae3122740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b9a0 0x564ec5d6e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.711+0000 7f1ae3122740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d3eaa0 0x564ec5d6e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.711+0000 7f1ae3122740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ec5ca96d0 con 0x564ec5d6b9a0 2024-03-30T13:14:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.711+0000 7f1ae3122740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564ec5c51770 con 0x564ec5d3eaa0 2024-03-30T13:14:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.711+0000 7f1ae3122740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x564ec5ca5680 con 0x564ec5d6b5c0 2024-03-30T13:14:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.711+0000 7f1add400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b9a0 0x564ec5d6e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.711+0000 7f1add400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b9a0 0x564ec5d6e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36008/0 (socket says 172.21.15.44:36008) 2024-03-30T13:14:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.711+0000 7f1add400640 1 -- 172.21.15.44:0/3584504749 learned_addr learned my addr 172.21.15.44:0/3584504749 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.712+0000 7f1add400640 1 -- 172.21.15.44:0/3584504749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b5c0 msgr2=0x564ec5d3e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.712+0000 7f1add400640 1 --2- 172.21.15.44:0/3584504749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b5c0 0x564ec5d3e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.712+0000 7f1add400640 1 -- 172.21.15.44:0/3584504749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d3eaa0 msgr2=0x564ec5d6e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.712+0000 7f1add400640 1 --2- 172.21.15.44:0/3584504749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d3eaa0 0x564ec5d6e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.712+0000 7f1add400640 1 -- 172.21.15.44:0/3584504749 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec5a877d0 con 0x564ec5d6b9a0 2024-03-30T13:14:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.712+0000 7f1add400640 1 --2- 172.21.15.44:0/3584504749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b9a0 0x564ec5d6e350 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8061950 tx=0x7f1ac800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f8d8422e9b0397 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.712+0000 7f1ac6600640 1 -- 172.21.15.44:0/3584504749 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac805d5c0 con 0x564ec5d6b9a0 2024-03-30T13:14:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.712+0000 7f1ac6600640 1 -- 172.21.15.44:0/3584504749 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac8061e80 con 0x564ec5d6b9a0 2024-03-30T13:14:52.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.712+0000 7f1ac6600640 1 -- 172.21.15.44:0/3584504749 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8004d70 con 0x564ec5d6b9a0 2024-03-30T13:14:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.713+0000 7f1ae3122740 1 -- 172.21.15.44:0/3584504749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b9a0 msgr2=0x564ec5d6e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.713+0000 7f1ae3122740 1 --2- 172.21.15.44:0/3584504749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b9a0 0x564ec5d6e350 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8061950 tx=0x7f1ac800f000 comp rx=0 tx=0).stop 2024-03-30T13:14:52.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.713+0000 7f1ae3122740 1 -- 172.21.15.44:0/3584504749 shutdown_connections 2024-03-30T13:14:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.713+0000 7f1ae3122740 1 --2- 172.21.15.44:0/3584504749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d3eaa0 0x564ec5d6e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.713+0000 7f1ae3122740 1 --2- 172.21.15.44:0/3584504749 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b9a0 0x564ec5d6e350 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.713+0000 7f1ae3122740 1 --2- 172.21.15.44:0/3584504749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b5c0 0x564ec5d3e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.713+0000 7f1ae3122740 1 -- 172.21.15.44:0/3584504749 >> 172.21.15.44:0/3584504749 conn(0x564ec5d407d0 msgr2=0x564ec5d89350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.713+0000 7f1ae3122740 1 -- 172.21.15.44:0/3584504749 shutdown_connections 2024-03-30T13:14:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.713+0000 7f1ae3122740 1 -- 172.21.15.44:0/3584504749 wait complete. 2024-03-30T13:14:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.714+0000 7f1ae3122740 1 -- start start 2024-03-30T13:14:52.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.715+0000 7f1ae3122740 1 Processor -- start 2024-03-30T13:14:52.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.716+0000 7f1ae3122740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d6b5c0 0x564ec5d71490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.716+0000 7f1ae3122740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 0x564ec5d60790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.716+0000 7f1ae3122740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d83e10 0x564ec5d84290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.716+0000 7f1ae3122740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ec5d42e70 con 0x564ec5d83e10 2024-03-30T13:14:52.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.716+0000 7f1ae3122740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564ec5c64aa0 con 0x564ec5d6b5c0 2024-03-30T13:14:52.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.716+0000 7f1ae3122740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x564ec5d456b0 con 0x564ec5d6b9a0 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.716+0000 7f1ae3122740 10 client.0 _ll_register_callbacks cb 0x564ec5c64490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1ade800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d83e10 0x564ec5d84290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1ade800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d83e10 0x564ec5d84290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36020/0 (socket says 172.21.15.44:36020) 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1ade800640 1 -- 172.21.15.44:0/476136830 learned_addr learned my addr 172.21.15.44:0/476136830 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1add400640 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 0x564ec5d60790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1adde00640 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d6b5c0 0x564ec5d71490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1ade800640 1 -- 172.21.15.44:0/476136830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 msgr2=0x564ec5d60790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1ade800640 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 0x564ec5d60790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1ade800640 1 -- 172.21.15.44:0/476136830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d6b5c0 msgr2=0x564ec5d71490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1ade800640 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d6b5c0 0x564ec5d71490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1ade800640 1 -- 172.21.15.44:0/476136830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ec59bd3f0 con 0x564ec5d83e10 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1add400640 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 0x564ec5d60790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:52.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1adde00640 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d6b5c0 0x564ec5d71490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:14:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.717+0000 7f1ade800640 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d83e10 0x564ec5d84290 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009e80 tx=0x7f1ad4009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367d90e78173149c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.718+0000 7f1abaa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.718+0000 7f1abaa00640 1 -- 172.21.15.44:0/476136830 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4039050 con 0x564ec5d83e10 2024-03-30T13:14:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.718+0000 7f1abaa00640 1 -- 172.21.15.44:0/476136830 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f1ad40348d0 con 0x564ec5d83e10 2024-03-30T13:14:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.718+0000 7f1ae3122740 1 -- 172.21.15.44:0/476136830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ac8061e80 con 0x564ec5d83e10 2024-03-30T13:14:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.718+0000 7f1abaa00640 1 -- 172.21.15.44:0/476136830 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1ad4034ad0 con 0x564ec5d83e10 2024-03-30T13:14:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.718+0000 7f1ae3122740 10 client.6069 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.718+0000 7f1ae3122740 1 -- 172.21.15.44:0/476136830 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x564ec597d0f0 con 0x564ec5d83e10 2024-03-30T13:14:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.718+0000 7f1abaa00640 1 -- 172.21.15.44:0/476136830 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac8061e80 con 0x564ec5d83e10 2024-03-30T13:14:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.718+0000 7f1abaa00640 1 -- 172.21.15.44:0/476136830 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f1ad4034c70 con 0x564ec5d83e10 2024-03-30T13:14:52.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.719+0000 7f1ae3122740 10 client.6069 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.719+0000 7f1ae3122740 10 client.6069 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.719+0000 7f1ae3122740 20 client.6069 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.719+0000 7f1ae3122740 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564ec5d9d8a0 0x564ec5d9dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.719+0000 7f1ae3122740 4 client.6069 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.719+0000 7f1ae3122740 1 -- 172.21.15.44:0/476136830 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ec5cb6c10 con 0x564ec5d9d8a0 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.719+0000 7f1adde00640 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564ec5d9d8a0 0x564ec5d9dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.719+0000 7f1adde00640 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564ec5d9d8a0 0x564ec5d9dcb0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efa3bd7d8f4fc6b9 server_cookie=cb489115e53b935e in_seq=0 out_seq=0 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.719+0000 7f1abaa00640 10 client.6069 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.720+0000 7f1abaa00640 1 -- 172.21.15.44:0/476136830 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x564ec5cb6c10 con 0x564ec5d9d8a0 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.720+0000 7f1abaa00640 10 client.6069 handle_command_reply: tid=0 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.720+0000 7f1ae3122740 1 client.6069 shutdown 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.721+0000 7f1ae3122740 1 -- 172.21.15.44:0/476136830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d83e10 msgr2=0x564ec5d84290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.721+0000 7f1ae3122740 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d83e10 0x564ec5d84290 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009e80 tx=0x7f1ad4009ab0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.721+0000 7f1ae3122740 1 -- 172.21.15.44:0/476136830 shutdown_connections 2024-03-30T13:14:52.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.721+0000 7f1ae3122740 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564ec5d9d8a0 0x564ec5d9dcb0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.721+0000 7f1ae3122740 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d83e10 0x564ec5d84290 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.721+0000 7f1ae3122740 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 0x564ec5d60790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.721+0000 7f1ae3122740 1 --2- 172.21.15.44:0/476136830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d6b5c0 0x564ec5d71490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.721+0000 7f1abaa00640 0 client.6069 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.721+0000 7f1ae3122740 1 -- 172.21.15.44:0/476136830 >> 172.21.15.44:0/476136830 conn(0x564ec5d3eaa0 msgr2=0x564ec5d43460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.721+0000 7f1ae3122740 1 -- 172.21.15.44:0/476136830 shutdown_connections 2024-03-30T13:14:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.721+0000 7f1ae3122740 1 -- 172.21.15.44:0/476136830 wait complete. 2024-03-30T13:14:52.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.721+0000 7f1ae3122740 20 client.6069 trim_cache size 0 max 16384 2024-03-30T13:14:52.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.759+0000 7f1ae3122740 1 Processor -- start 2024-03-30T13:14:52.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.759+0000 7f1ae3122740 1 -- start start 2024-03-30T13:14:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.760+0000 7f1ae3122740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 0x564ec5d834d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.760+0000 7f1ae3122740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 0x564ec5d84b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.760+0000 7f1ae3122740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d83e10 0x564ec5d850a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.760+0000 7f1ae3122740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8201110 con 0x564ec5d6b5c0 2024-03-30T13:14:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.760+0000 7f1ae3122740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8200170 con 0x564ec5d83e10 2024-03-30T13:14:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.760+0000 7f1ae3122740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad80ae3f0 con 0x564ec5d6b9a0 2024-03-30T13:14:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.761+0000 7f1adde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 0x564ec5d834d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.761+0000 7f1adde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 0x564ec5d834d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36022/0 (socket says 172.21.15.44:36022) 2024-03-30T13:14:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.761+0000 7f1adde00640 1 -- 172.21.15.44:0/2234722735 learned_addr learned my addr 172.21.15.44:0/2234722735 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:52.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.761+0000 7f1adde00640 1 -- 172.21.15.44:0/2234722735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 msgr2=0x564ec5d84b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.761+0000 7f1adde00640 1 --2- 172.21.15.44:0/2234722735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 0x564ec5d84b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.761+0000 7f1adde00640 1 -- 172.21.15.44:0/2234722735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d83e10 msgr2=0x564ec5d850a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.761+0000 7f1adde00640 1 --2- 172.21.15.44:0/2234722735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d83e10 0x564ec5d850a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.761+0000 7f1adde00640 1 -- 172.21.15.44:0/2234722735 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ec5d9e020 con 0x564ec5d6b5c0 2024-03-30T13:14:52.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.761+0000 7f1adde00640 1 --2- 172.21.15.44:0/2234722735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 0x564ec5d834d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00dd70 tx=0x7f1acc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d8431028d63e35 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.761+0000 7f1ac5c00640 1 -- 172.21.15.44:0/2234722735 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc029070 con 0x564ec5d6b5c0 2024-03-30T13:14:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.761+0000 7f1ac5c00640 1 -- 172.21.15.44:0/2234722735 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1acc013af0 con 0x564ec5d6b5c0 2024-03-30T13:14:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.761+0000 7f1ac5c00640 1 -- 172.21.15.44:0/2234722735 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc00de60 con 0x564ec5d6b5c0 2024-03-30T13:14:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.762+0000 7f1ae3122740 1 -- 172.21.15.44:0/2234722735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 msgr2=0x564ec5d834d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.762+0000 7f1ae3122740 1 --2- 172.21.15.44:0/2234722735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 0x564ec5d834d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1acc00dd70 tx=0x7f1acc010000 comp rx=0 tx=0).stop 2024-03-30T13:14:52.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.762+0000 7f1ae3122740 1 -- 172.21.15.44:0/2234722735 shutdown_connections 2024-03-30T13:14:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.762+0000 7f1ae3122740 1 --2- 172.21.15.44:0/2234722735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d83e10 0x564ec5d850a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.762+0000 7f1ae3122740 1 --2- 172.21.15.44:0/2234722735 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 0x564ec5d84b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.762+0000 7f1ae3122740 1 --2- 172.21.15.44:0/2234722735 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 0x564ec5d834d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.762+0000 7f1ae3122740 1 -- 172.21.15.44:0/2234722735 >> 172.21.15.44:0/2234722735 conn(0x564ec5d3eaa0 msgr2=0x564ec5d89ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.762+0000 7f1ae3122740 1 -- 172.21.15.44:0/2234722735 shutdown_connections 2024-03-30T13:14:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.762+0000 7f1ae3122740 1 -- 172.21.15.44:0/2234722735 wait complete. 2024-03-30T13:14:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.763+0000 7f1ae3122740 1 -- start start 2024-03-30T13:14:52.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.763+0000 7f1ae3122740 1 Processor -- start 2024-03-30T13:14:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.764+0000 7f1ae3122740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 0x564ec5dac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.764+0000 7f1ae3122740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 0x564ec5d70e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.764+0000 7f1ae3122740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d83e10 0x564ec5d71360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.764+0000 7f1ae3122740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x564ec5d82ea0 con 0x564ec5d6b5c0 2024-03-30T13:14:52.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.764+0000 7f1ae3122740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad81ffb80 con 0x564ec5d83e10 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.764+0000 7f1ae3122740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x564ec5d39060 con 0x564ec5d6b9a0 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.764+0000 7f1ae3122740 10 client.0 _ll_register_callbacks cb 0x7f1ad402cd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.764+0000 7f1adde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 0x564ec5dac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.764+0000 7f1adde00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 0x564ec5dac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36030/0 (socket says 172.21.15.44:36030) 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.764+0000 7f1adde00640 1 -- 172.21.15.44:0/1947775416 learned_addr learned my addr 172.21.15.44:0/1947775416 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.765+0000 7f1adde00640 1 -- 172.21.15.44:0/1947775416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 msgr2=0x564ec5d70e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.765+0000 7f1adde00640 1 --2- 172.21.15.44:0/1947775416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 0x564ec5d70e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.765+0000 7f1adde00640 1 -- 172.21.15.44:0/1947775416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d83e10 msgr2=0x564ec5d71360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.765+0000 7f1adde00640 1 --2- 172.21.15.44:0/1947775416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d83e10 0x564ec5d71360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.765+0000 7f1adde00640 1 -- 172.21.15.44:0/1947775416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ec5d6f680 con 0x564ec5d6b5c0 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.765+0000 7f1adde00640 1 --2- 172.21.15.44:0/1947775416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 0x564ec5dac880 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1acc027040 tx=0x7f1acc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9394a5c3ba053f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.765+0000 7f1abaa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.765+0000 7f1abaa00640 1 -- 172.21.15.44:0/1947775416 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc029040 con 0x564ec5d6b5c0 2024-03-30T13:14:52.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.765+0000 7f1abaa00640 1 -- 172.21.15.44:0/1947775416 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f1acc023180 con 0x564ec5d6b5c0 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.765+0000 7f1ae3122740 1 -- 172.21.15.44:0/1947775416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1acc013af0 con 0x564ec5d6b5c0 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.766+0000 7f1abaa00640 1 -- 172.21.15.44:0/1947775416 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1acc00de60 con 0x564ec5d6b5c0 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.766+0000 7f1ae3122740 10 client.6075 fetch_fsmap learned FSMap version 20 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.766+0000 7f1ae3122740 1 -- 172.21.15.44:0/1947775416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x564ec5d6f350 con 0x564ec5d6b5c0 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.766+0000 7f1abaa00640 1 -- 172.21.15.44:0/1947775416 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1acc013af0 con 0x564ec5d6b5c0 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.766+0000 7f1abaa00640 1 -- 172.21.15.44:0/1947775416 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f1acc02c030 con 0x564ec5d6b5c0 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.766+0000 7f1ae3122740 10 client.6075 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.766+0000 7f1ae3122740 10 client.6075 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.766+0000 7f1ae3122740 20 client.6075 populate_metadata read hostname 'smithi044' 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.766+0000 7f1ae3122740 1 --2- 172.21.15.44:0/1947775416 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564ec5d8c0b0 0x564ec5d820d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.766+0000 7f1ae3122740 4 client.6075 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.766+0000 7f1ae3122740 1 -- 172.21.15.44:0/1947775416 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564ec5cb0f60 con 0x564ec5d8c0b0 2024-03-30T13:14:52.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.766+0000 7f1add400640 1 --2- 172.21.15.44:0/1947775416 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564ec5d8c0b0 0x564ec5d820d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1abaa00640 10 client.6075 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1add400640 1 --2- 172.21.15.44:0/1947775416 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564ec5d8c0b0 0x564ec5d820d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f3e4f7b2aaff05f server_cookie=c5e844f3906fe461 in_seq=0 out_seq=0 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1abaa00640 1 -- 172.21.15.44:0/1947775416 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+850 (crc 0 0 0) 0x564ec5cb0f60 con 0x564ec5d8c0b0 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1abaa00640 10 client.6075 handle_command_reply: tid=0 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1ae3122740 1 client.6075 shutdown 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1ae3122740 1 -- 172.21.15.44:0/1947775416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 msgr2=0x564ec5dac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1ae3122740 1 --2- 172.21.15.44:0/1947775416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 0x564ec5dac880 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1acc027040 tx=0x7f1acc004730 comp rx=0 tx=0).stop 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1ae3122740 1 -- 172.21.15.44:0/1947775416 shutdown_connections 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1ae3122740 1 --2- 172.21.15.44:0/1947775416 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x564ec5d8c0b0 0x564ec5d820d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1ae3122740 1 --2- 172.21.15.44:0/1947775416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ec5d83e10 0x564ec5d71360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1ae3122740 1 --2- 172.21.15.44:0/1947775416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564ec5d6b9a0 0x564ec5d70e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1ae3122740 1 --2- 172.21.15.44:0/1947775416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564ec5d6b5c0 0x564ec5dac880 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1ae3122740 1 -- 172.21.15.44:0/1947775416 >> 172.21.15.44:0/1947775416 conn(0x564ec5d3eaa0 msgr2=0x564ec5d89ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:52.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.767+0000 7f1abaa00640 0 client.6075 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:14:52.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.768+0000 7f1ae3122740 1 -- 172.21.15.44:0/1947775416 shutdown_connections 2024-03-30T13:14:52.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.768+0000 7f1ae3122740 1 -- 172.21.15.44:0/1947775416 wait complete. 2024-03-30T13:14:52.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.768+0000 7f1ae3122740 20 client.6075 trim_cache size 0 max 16384 2024-03-30T13:14:52.775 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:14:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-30T13:14:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": { 2024-03-30T13:14:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "8c53b1c8-1c8b-48a2-b043-c812feb528ad": { 2024-03-30T13:14:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-03-30T13:14:52.775 INFO:teuthology.orchestra.run.smithi044.stdout: "tag": "8c53b1c8-1c8b-48a2-b043-c812feb528ad", 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "options": "recursive" 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "8c53b1c8-1c8b-48a2-b043-c812feb528ad": { 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-03-30T13:14:52.411504+0000", 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 0, 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 0, 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "15729069-7252-4183-a34d-d65e02a27e24": { 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-03-30T13:14:06.098229+0000", 2024-03-30T13:14:52.776 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-03-30T13:14:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 75, 2024-03-30T13:14:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 75, 2024-03-30T13:14:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-03-30T13:14:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-03-30T13:14:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:52.777 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:14:52.777 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:14:52.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.768+0000 7f1ae0800640 1 -- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1abc06c560 msgr2=0x7f1abc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.768+0000 7f1ae0800640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1abc06c560 0x7f1abc06ea20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1acc008850 tx=0x7f1acc008040 comp rx=0 tx=0).stop 2024-03-30T13:14:52.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.768+0000 7f1ae0800640 1 -- 172.21.15.44:0/3486786200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ad813f0c0 msgr2=0x7f1ad813dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:14:52.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.768+0000 7f1ae0800640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ad813f0c0 0x7f1ad813dfe0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800c430 tx=0x7f1ac800c8f0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.769+0000 7f1ae0800640 1 -- 172.21.15.44:0/3486786200 shutdown_connections 2024-03-30T13:14:52.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.769+0000 7f1ae0800640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ad81605a0 0x7f1ad8141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.769+0000 7f1ae0800640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1ad813f0c0 0x7f1ad813dfe0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.769+0000 7f1ae0800640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1abc06c560 0x7f1abc06ea20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.769+0000 7f1ae0800640 1 --2- 172.21.15.44:0/3486786200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ad806d720 0x7f1ad8157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:14:52.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.769+0000 7f1ae0800640 1 -- 172.21.15.44:0/3486786200 >> 172.21.15.44:0/3486786200 conn(0x7f1ad80b5b00 msgr2=0x7f1ad80d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:14:52.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.769+0000 7f1ae0800640 1 -- 172.21.15.44:0/3486786200 shutdown_connections 2024-03-30T13:14:52.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:14:52.769+0000 7f1ae0800640 1 -- 172.21.15.44:0/3486786200 wait complete. 2024-03-30T13:14:52.788 INFO:tasks.cephfs.filesystem:scrub status for tag:8c53b1c8-1c8b-48a2-b043-c812feb528ad - {'path': '/', 'tag': '8c53b1c8-1c8b-48a2-b043-c812feb528ad', 'options': 'recursive'} 2024-03-30T13:14:53.055 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_6 2024-03-30T13:14:54.163 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_7 2024-03-30T13:14:55.256 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_8 2024-03-30T13:14:56.349 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && mkdir linux-5.4/.snap/snap_9 2024-03-30T13:15:00.569 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:15:00.581 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:15:22.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:22.789 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-30T13:15:23.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.014+0000 7f708ca00640 1 Processor -- start 2024-03-30T13:15:23.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.015+0000 7f708ca00640 1 -- start start 2024-03-30T13:15:23.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.016+0000 7f708ca00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f70880b4d00 0x7f70880d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.016+0000 7f708ca00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70880b54b0 con 0x7f70880d0b90 2024-03-30T13:15:23.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.016+0000 7f708ca00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70880cfca0 con 0x7f70880b4920 2024-03-30T13:15:23.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.016+0000 7f708ca00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f70880d0260 con 0x7f70880b4d00 2024-03-30T13:15:23.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.016+0000 7f7087e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f70880d0b90 0x7f70880d26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49228/0 (socket says 172.21.15.44:49228) 2024-03-30T13:15:23.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.016+0000 7f7087e00640 1 -- 172.21.15.44:0/687367572 learned_addr learned my addr 172.21.15.44:0/687367572 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:23.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f707fe00640 1 --2- 172.21.15.44:0/687367572 >> v2:172.21.15.151:3300/0 conn(0x7f70880b4d00 0x7f70880d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933537695 0 0) 0x7f7080001490 con 0x7f70880d0b90 2024-03-30T13:15:23.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f706c003520 con 0x7f70880d0b90 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 799493666 0 0) 0x7f706c003520 con 0x7f70880d0b90 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 >> v2:172.21.15.151:3300/0 conn(0x7f70880b4d00 msgr2=0x7f70880d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 --2- 172.21.15.44:0/687367572 >> v2:172.21.15.151:3300/0 conn(0x7f70880b4d00 0x7f70880d4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 >> v1:172.21.15.151:6789/0 conn(0x7f70880b4920 legacy=0x7f70880b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70880cff80 con 0x7f70880d0b90 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f7080001bc0 con 0x7f70880d0b90 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 >> v1:172.21.15.44:6789/0 conn(0x7f70880d0b90 legacy=0x7f70880d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 --2- 172.21.15.44:0/687367572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f706c003a00 0x7f706c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 --2- 172.21.15.44:0/687367572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f706c004800 0x7f706c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 --2- 172.21.15.44:0/687367572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c005210 0x7f706c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f70880d0260 con 0x7f706c004800 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f706c00c160 con 0x7f706c005210 2024-03-30T13:15:23.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.017+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f706c00c360 con 0x7f706c003a00 2024-03-30T13:15:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.018+0000 7f707fe00640 1 --2- 172.21.15.44:0/687367572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f706c004800 0x7f706c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.018+0000 7f7087400640 1 --2- 172.21.15.44:0/687367572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f706c003a00 0x7f706c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.018+0000 7f707fe00640 1 -- 172.21.15.44:0/687367572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f706c003a00 msgr2=0x7f706c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.018+0000 7f707fe00640 1 --2- 172.21.15.44:0/687367572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f706c003a00 0x7f706c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.018+0000 7f707fe00640 1 -- 172.21.15.44:0/687367572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c005210 msgr2=0x7f706c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.018+0000 7f7087e00640 1 --2- 172.21.15.44:0/687367572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c005210 0x7f706c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.018+0000 7f707fe00640 1 --2- 172.21.15.44:0/687367572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c005210 0x7f706c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.018+0000 7f707fe00640 1 -- 172.21.15.44:0/687367572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c003520 con 0x7f706c004800 2024-03-30T13:15:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.018+0000 7f7087e00640 1 --2- 172.21.15.44:0/687367572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c005210 0x7f706c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:23.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.018+0000 7f7087e00640 1 -- 172.21.15.44:0/687367572 reap_dead start 2024-03-30T13:15:23.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.019+0000 7f707fe00640 1 --2- 172.21.15.44:0/687367572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f706c004800 0x7f706c004c80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7070009a90 tx=0x7f706c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4beb4ec55bc32e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:23.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.020+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070039070 con 0x7f706c004800 2024-03-30T13:15:23.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.020+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707002c680 con 0x7f706c004800 2024-03-30T13:15:23.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.020+0000 7f7086a00640 1 -- 172.21.15.44:0/687367572 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070009690 con 0x7f706c004800 2024-03-30T13:15:23.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.020+0000 7f708ca00640 1 -- 172.21.15.44:0/687367572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f706c004800 msgr2=0x7f706c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:23.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.020+0000 7f708ca00640 1 --2- 172.21.15.44:0/687367572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f706c004800 0x7f706c004c80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7070009a90 tx=0x7f706c005830 comp rx=0 tx=0).stop 2024-03-30T13:15:23.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.020+0000 7f708ca00640 1 -- 172.21.15.44:0/687367572 shutdown_connections 2024-03-30T13:15:23.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.020+0000 7f708ca00640 1 --2- 172.21.15.44:0/687367572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f706c004800 0x7f706c004c80 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.020+0000 7f708ca00640 1 -- 172.21.15.44:0/687367572 >> 172.21.15.44:0/687367572 conn(0x7f708809d4e0 msgr2=0x7f70880d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:23.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.021+0000 7f708ca00640 1 -- 172.21.15.44:0/687367572 shutdown_connections 2024-03-30T13:15:23.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.021+0000 7f708ca00640 1 -- 172.21.15.44:0/687367572 wait complete. 2024-03-30T13:15:23.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.022+0000 7f708ca00640 1 Processor -- start 2024-03-30T13:15:23.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.022+0000 7f708ca00640 1 -- start start 2024-03-30T13:15:23.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.023+0000 7f708ca00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c004800 0x7f70880b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.023+0000 7f708ca00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70880cdbf0 0x7f70880b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.023+0000 7f708ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7088155240 0x7f70881556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.023+0000 7f708ca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f70880cf8c0 con 0x7f7088155240 2024-03-30T13:15:23.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.023+0000 7f708ca00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f70880d2180 con 0x7f706c004800 2024-03-30T13:15:23.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.023+0000 7f708ca00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f70880cfa40 con 0x7f70880cdbf0 2024-03-30T13:15:23.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.024+0000 7f7087e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7088155240 0x7f70881556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.024+0000 7f7087e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7088155240 0x7f70881556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51928/0 (socket says 172.21.15.44:51928) 2024-03-30T13:15:23.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.024+0000 7f7087e00640 1 -- 172.21.15.44:0/2520814591 learned_addr learned my addr 172.21.15.44:0/2520814591 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:23.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.024+0000 7f7087400640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c004800 0x7f70880b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.024+0000 7f707fe00640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70880cdbf0 0x7f70880b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.024+0000 7f7087e00640 1 -- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70880cdbf0 msgr2=0x7f70880b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.024+0000 7f7087e00640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70880cdbf0 0x7f70880b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.024+0000 7f7087e00640 1 -- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c004800 msgr2=0x7f70880b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.024+0000 7f7087e00640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c004800 0x7f70880b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.024+0000 7f7087e00640 1 -- 172.21.15.44:0/2520814591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70880ce070 con 0x7f7088155240 2024-03-30T13:15:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.024+0000 7f707fe00640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70880cdbf0 0x7f70880b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.025+0000 7f7087e00640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7088155240 0x7f70881556a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f70880d4120 tx=0x7f708000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.025+0000 7f707f400640 1 -- 172.21.15.44:0/2520814591 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080004d60 con 0x7f7088155240 2024-03-30T13:15:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.025+0000 7f707f400640 1 -- 172.21.15.44:0/2520814591 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708000bb00 con 0x7f7088155240 2024-03-30T13:15:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.025+0000 7f707f400640 1 -- 172.21.15.44:0/2520814591 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080007070 con 0x7f7088155240 2024-03-30T13:15:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.025+0000 7f708ca00640 1 -- 172.21.15.44:0/2520814591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70880b7410 con 0x7f7088155240 2024-03-30T13:15:23.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.025+0000 7f708ca00640 1 -- 172.21.15.44:0/2520814591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70880ccd60 con 0x7f7088155240 2024-03-30T13:15:23.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.028+0000 7f707f400640 1 -- 172.21.15.44:0/2520814591 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f708001b020 con 0x7f7088155240 2024-03-30T13:15:23.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.029+0000 7f707f400640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f706406c560 0x7f706406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.029+0000 7f707f400640 1 -- 172.21.15.44:0/2520814591 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f708008b8c0 con 0x7f7088155240 2024-03-30T13:15:23.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.029+0000 7f7090c36740 1 Processor -- start 2024-03-30T13:15:23.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.029+0000 7f7087400640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f706406c560 0x7f706406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.029+0000 7f7090c36740 1 -- start start 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.030+0000 7f7090c36740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faa780 0x5598c9f7d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.030+0000 7f7090c36740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faab60 0x5598c9fad510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.030+0000 7f7090c36740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9f7dc60 0x5598c9fada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.030+0000 7f7090c36740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5598c9ee86d0 con 0x5598c9faa780 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.030+0000 7f7090c36740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5598c9e90770 con 0x5598c9faab60 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.030+0000 7f7090c36740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5598c9ee4680 con 0x5598c9f7dc60 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f7087400640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f706406c560 0x7f706406ea20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f70780016d0 tx=0x7f7078009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f7087400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faa780 0x5598c9f7d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f7087400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faa780 0x5598c9f7d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51930/0 (socket says 172.21.15.44:51930) 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f7087400640 1 -- 172.21.15.44:0/3997154972 learned_addr learned my addr 172.21.15.44:0/3997154972 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f707fe00640 1 --2- 172.21.15.44:0/3997154972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faab60 0x5598c9fad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f7087400640 1 -- 172.21.15.44:0/3997154972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9f7dc60 msgr2=0x5598c9fada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:23.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f7087e00640 1 --2- 172.21.15.44:0/3997154972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9f7dc60 0x5598c9fada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f7087400640 1 --2- 172.21.15.44:0/3997154972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9f7dc60 0x5598c9fada50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f7087400640 1 -- 172.21.15.44:0/3997154972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faab60 msgr2=0x5598c9fad510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:23.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f7087400640 1 --2- 172.21.15.44:0/3997154972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faab60 0x5598c9fad510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f7087400640 1 -- 172.21.15.44:0/3997154972 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c9cc67d0 con 0x5598c9faa780 2024-03-30T13:15:23.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f707fe00640 1 --2- 172.21.15.44:0/3997154972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faab60 0x5598c9fad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:23.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.031+0000 7f7087400640 1 --2- 172.21.15.44:0/3997154972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faa780 0x5598c9f7d720 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7078011950 tx=0x7f7078014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec096eb30e635cfe server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:23.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.032+0000 7f7077400640 1 -- 172.21.15.44:0/3997154972 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078015bc0 con 0x5598c9faa780 2024-03-30T13:15:23.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.032+0000 7f7077400640 1 -- 172.21.15.44:0/3997154972 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7078026070 con 0x5598c9faa780 2024-03-30T13:15:23.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.032+0000 7f7077400640 1 -- 172.21.15.44:0/3997154972 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7078021450 con 0x5598c9faa780 2024-03-30T13:15:23.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.032+0000 7f7090c36740 1 -- 172.21.15.44:0/3997154972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faa780 msgr2=0x5598c9f7d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:23.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.032+0000 7f7090c36740 1 --2- 172.21.15.44:0/3997154972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faa780 0x5598c9f7d720 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7078011950 tx=0x7f7078014000 comp rx=0 tx=0).stop 2024-03-30T13:15:23.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.032+0000 7f7090c36740 1 -- 172.21.15.44:0/3997154972 shutdown_connections 2024-03-30T13:15:23.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.032+0000 7f7090c36740 1 --2- 172.21.15.44:0/3997154972 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9f7dc60 0x5598c9fada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.032+0000 7f7090c36740 1 --2- 172.21.15.44:0/3997154972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faab60 0x5598c9fad510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.032+0000 7f7090c36740 1 --2- 172.21.15.44:0/3997154972 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faa780 0x5598c9f7d720 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.032+0000 7f7090c36740 1 -- 172.21.15.44:0/3997154972 >> 172.21.15.44:0/3997154972 conn(0x5598c9f7f990 msgr2=0x5598c9fc8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.033+0000 7f7090c36740 1 -- 172.21.15.44:0/3997154972 shutdown_connections 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.033+0000 7f7090c36740 1 -- 172.21.15.44:0/3997154972 wait complete. 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.033+0000 7f7090c36740 1 -- start start 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.034+0000 7f7090c36740 1 Processor -- start 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f7090c36740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faa780 0x5598c9f9bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f7090c36740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9faf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f7090c36740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9fc7600 0x5598c9fc7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f7090c36740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5598c9f82030 con 0x5598c9faab60 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f7090c36740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5598c9ea3aa0 con 0x5598c9faa780 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f7090c36740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5598c9f84870 con 0x5598c9fc7600 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f7090c36740 10 client.0 _ll_register_callbacks cb 0x5598c9ea3490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f707fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9faf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f707fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9faf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51932/0 (socket says 172.21.15.44:51932) 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f707fe00640 1 -- 172.21.15.44:0/461114243 learned_addr learned my addr 172.21.15.44:0/461114243 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:23.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f7087400640 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faa780 0x5598c9f9bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f7087e00640 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9fc7600 0x5598c9fc7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.035+0000 7f707fe00640 1 -- 172.21.15.44:0/461114243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9fc7600 msgr2=0x5598c9fc7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:23.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.036+0000 7f707fe00640 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9fc7600 0x5598c9fc7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.036+0000 7f707fe00640 1 -- 172.21.15.44:0/461114243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faa780 msgr2=0x5598c9f9bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:23.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.036+0000 7f707fe00640 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faa780 0x5598c9f9bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.036+0000 7f707fe00640 1 -- 172.21.15.44:0/461114243 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c9bfc3f0 con 0x5598c9faab60 2024-03-30T13:15:23.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.036+0000 7f7087e00640 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9fc7600 0x5598c9fc7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:23.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.036+0000 7f707fe00640 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9faf8f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7070037040 tx=0x7f70700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3d337411068f4e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:23.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.036+0000 7f706be00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:23.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.036+0000 7f706be00640 1 -- 172.21.15.44:0/461114243 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070039030 con 0x5598c9faab60 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.036+0000 7f706be00640 1 -- 172.21.15.44:0/461114243 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f707002ca90 con 0x5598c9faab60 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.036+0000 7f7090c36740 1 -- 172.21.15.44:0/461114243 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7078026070 con 0x5598c9faab60 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.037+0000 7f706be00640 1 -- 172.21.15.44:0/461114243 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f707004c050 con 0x5598c9faab60 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.037+0000 7f7090c36740 10 client.6087 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.037+0000 7f7090c36740 1 -- 172.21.15.44:0/461114243 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5598c9bbc0f0 con 0x5598c9faab60 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.037+0000 7f706be00640 1 -- 172.21.15.44:0/461114243 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7078026070 con 0x5598c9faab60 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.037+0000 7f706be00640 1 -- 172.21.15.44:0/461114243 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f707004f020 con 0x5598c9faab60 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.037+0000 7f7090c36740 10 client.6087 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.037+0000 7f7090c36740 10 client.6087 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.037+0000 7f7090c36740 20 client.6087 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.037+0000 7f7090c36740 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5598c9f9c9f0 0x5598c9fae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.037+0000 7f7090c36740 4 client.6087 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.037+0000 7f7090c36740 1 -- 172.21.15.44:0/461114243 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598c9ef5c10 con 0x5598c9f9c9f0 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.038+0000 7f7087400640 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5598c9f9c9f0 0x5598c9fae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.038+0000 7f7087400640 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5598c9f9c9f0 0x5598c9fae6b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72a017a60e6285ce server_cookie=28416cfa1dae1adb in_seq=0 out_seq=0 2024-03-30T13:15:23.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.038+0000 7f706be00640 10 client.6087 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:23.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.039+0000 7f706be00640 1 -- 172.21.15.44:0/461114243 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5598c9ef5c10 con 0x5598c9f9c9f0 2024-03-30T13:15:23.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.039+0000 7f706be00640 10 client.6087 handle_command_reply: tid=0 2024-03-30T13:15:23.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.039+0000 7f7090c36740 1 client.6087 shutdown 2024-03-30T13:15:23.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.039+0000 7f7090c36740 1 -- 172.21.15.44:0/461114243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 msgr2=0x5598c9faf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:23.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.039+0000 7f7090c36740 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9faf8f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7070037040 tx=0x7f70700046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.039+0000 7f7090c36740 1 -- 172.21.15.44:0/461114243 shutdown_connections 2024-03-30T13:15:23.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.039+0000 7f7090c36740 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5598c9f9c9f0 0x5598c9fae6b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.039+0000 7f7090c36740 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9fc7600 0x5598c9fc7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.039+0000 7f7090c36740 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9faf8f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.039+0000 7f7090c36740 1 --2- 172.21.15.44:0/461114243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faa780 0x5598c9f9bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.039+0000 7f706be00640 0 client.6087 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:23.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.039+0000 7f7090c36740 1 -- 172.21.15.44:0/461114243 >> 172.21.15.44:0/461114243 conn(0x5598c9f7dc60 msgr2=0x5598c9f81700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:23.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.040+0000 7f7090c36740 1 -- 172.21.15.44:0/461114243 shutdown_connections 2024-03-30T13:15:23.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.040+0000 7f7090c36740 1 -- 172.21.15.44:0/461114243 wait complete. 2024-03-30T13:15:23.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.040+0000 7f7090c36740 20 client.6087 trim_cache size 0 max 16384 2024-03-30T13:15:23.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.080+0000 7f7090c36740 1 Processor -- start 2024-03-30T13:15:23.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.080+0000 7f7090c36740 1 -- start start 2024-03-30T13:15:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.081+0000 7f7090c36740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faa780 0x5598c9f7e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.081+0000 7f7090c36740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9f7c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.081+0000 7f7090c36740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9fc7600 0x5598c9f83320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.081+0000 7f7090c36740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5598c9fb3fa0 con 0x5598c9faab60 2024-03-30T13:15:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.081+0000 7f7090c36740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f70882019d0 con 0x5598c9faa780 2024-03-30T13:15:23.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.081+0000 7f7090c36740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f7088200a20 con 0x5598c9fc7600 2024-03-30T13:15:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.082+0000 7f707fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9f7c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.082+0000 7f707fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9f7c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51940/0 (socket says 172.21.15.44:51940) 2024-03-30T13:15:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.082+0000 7f707fe00640 1 -- 172.21.15.44:0/3520849273 learned_addr learned my addr 172.21.15.44:0/3520849273 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.082+0000 7f707fe00640 1 -- 172.21.15.44:0/3520849273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9fc7600 msgr2=0x5598c9f83320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.082+0000 7f707fe00640 1 --2- 172.21.15.44:0/3520849273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9fc7600 0x5598c9f83320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.082+0000 7f7087400640 1 --2- 172.21.15.44:0/3520849273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faa780 0x5598c9f7e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.082+0000 7f707fe00640 1 -- 172.21.15.44:0/3520849273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faa780 msgr2=0x5598c9f7e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.082+0000 7f707fe00640 1 --2- 172.21.15.44:0/3520849273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faa780 0x5598c9f7e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.082+0000 7f707fe00640 1 -- 172.21.15.44:0/3520849273 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c9f7f230 con 0x5598c9faab60 2024-03-30T13:15:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.082+0000 7f7087400640 1 --2- 172.21.15.44:0/3520849273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faa780 0x5598c9f7e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:23.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.082+0000 7f707fe00640 1 --2- 172.21.15.44:0/3520849273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9f7c800 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f70700096c0 tx=0x7f707003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e01ae7a28d9906 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:23.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.083+0000 7f7076a00640 1 -- 172.21.15.44:0/3520849273 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070039070 con 0x5598c9faab60 2024-03-30T13:15:23.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.083+0000 7f7076a00640 1 -- 172.21.15.44:0/3520849273 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707003a040 con 0x5598c9faab60 2024-03-30T13:15:23.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.083+0000 7f7076a00640 1 -- 172.21.15.44:0/3520849273 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070003610 con 0x5598c9faab60 2024-03-30T13:15:23.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.083+0000 7f7090c36740 1 -- 172.21.15.44:0/3520849273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 msgr2=0x5598c9f7c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:23.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.083+0000 7f7090c36740 1 --2- 172.21.15.44:0/3520849273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9f7c800 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f70700096c0 tx=0x7f707003b000 comp rx=0 tx=0).stop 2024-03-30T13:15:23.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.083+0000 7f7090c36740 1 -- 172.21.15.44:0/3520849273 shutdown_connections 2024-03-30T13:15:23.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.083+0000 7f7090c36740 1 --2- 172.21.15.44:0/3520849273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9fc7600 0x5598c9f83320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.083+0000 7f7090c36740 1 --2- 172.21.15.44:0/3520849273 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9f7c800 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.083+0000 7f7090c36740 1 --2- 172.21.15.44:0/3520849273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9faa780 0x5598c9f7e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.083+0000 7f7090c36740 1 -- 172.21.15.44:0/3520849273 >> 172.21.15.44:0/3520849273 conn(0x5598c9f7dc60 msgr2=0x5598c9fc8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:23.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.084+0000 7f7090c36740 1 -- 172.21.15.44:0/3520849273 shutdown_connections 2024-03-30T13:15:23.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.084+0000 7f7090c36740 1 -- 172.21.15.44:0/3520849273 wait complete. 2024-03-30T13:15:23.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.085+0000 7f7090c36740 1 -- start start 2024-03-30T13:15:23.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.085+0000 7f7090c36740 1 Processor -- start 2024-03-30T13:15:23.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f7090c36740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9faa780 0x5598c9fd8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f7090c36740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9f78f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f7090c36740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9fc7600 0x5598c9faf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f7090c36740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f70882003d0 con 0x5598c9faab60 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f7090c36740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f70880c9b00 con 0x5598c9fc7600 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f7090c36740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5598c9fec410 con 0x5598c9faa780 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f7090c36740 10 client.0 _ll_register_callbacks cb 0x7f706c00c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f707fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9f78f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f707fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9f78f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51946/0 (socket says 172.21.15.44:51946) 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f707fe00640 1 -- 172.21.15.44:0/2176807461 learned_addr learned my addr 172.21.15.44:0/2176807461 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f7087e00640 1 --2- 172.21.15.44:0/2176807461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9fc7600 0x5598c9faf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f707fe00640 1 -- 172.21.15.44:0/2176807461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9faa780 msgr2=0x5598c9fd8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f707fe00640 1 --2- 172.21.15.44:0/2176807461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9faa780 0x5598c9fd8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f707fe00640 1 -- 172.21.15.44:0/2176807461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9fc7600 msgr2=0x5598c9faf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:23.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f707fe00640 1 --2- 172.21.15.44:0/2176807461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9fc7600 0x5598c9faf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.087+0000 7f707fe00640 1 -- 172.21.15.44:0/2176807461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c9fc5c40 con 0x5598c9faab60 2024-03-30T13:15:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.088+0000 7f707fe00640 1 --2- 172.21.15.44:0/2176807461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9f78f70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7070004650 tx=0x7f7070009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939e5373307a5b34 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:23.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.088+0000 7f706be00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:23.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.088+0000 7f706be00640 1 -- 172.21.15.44:0/2176807461 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070058060 con 0x5598c9faab60 2024-03-30T13:15:23.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.088+0000 7f706be00640 1 -- 172.21.15.44:0/2176807461 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f7070003a20 con 0x5598c9faab60 2024-03-30T13:15:23.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.088+0000 7f7090c36740 1 -- 172.21.15.44:0/2176807461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f707003a040 con 0x5598c9faab60 2024-03-30T13:15:23.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.088+0000 7f706be00640 1 -- 172.21.15.44:0/2176807461 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f707005e050 con 0x5598c9faab60 2024-03-30T13:15:23.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.088+0000 7f7090c36740 10 client.6093 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:23.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.088+0000 7f7090c36740 1 -- 172.21.15.44:0/2176807461 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5598ca044940 con 0x5598c9faab60 2024-03-30T13:15:23.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.089+0000 7f706be00640 1 -- 172.21.15.44:0/2176807461 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707003a040 con 0x5598c9faab60 2024-03-30T13:15:23.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.089+0000 7f706be00640 1 -- 172.21.15.44:0/2176807461 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f7070061020 con 0x5598c9faab60 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.089+0000 7f7090c36740 10 client.6093 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.089+0000 7f7090c36740 10 client.6093 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.089+0000 7f7090c36740 20 client.6093 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.089+0000 7f7090c36740 1 --2- 172.21.15.44:0/2176807461 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5598ca043e60 0x5598ca044280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.089+0000 7f7090c36740 4 client.6093 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.089+0000 7f7090c36740 1 -- 172.21.15.44:0/2176807461 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5598c9eeff60 con 0x5598ca043e60 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.089+0000 7f7087400640 1 --2- 172.21.15.44:0/2176807461 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5598ca043e60 0x5598ca044280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f7087400640 1 --2- 172.21.15.44:0/2176807461 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5598ca043e60 0x5598ca044280 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29a9513daf84a24f server_cookie=3a85da63e9730c3c in_seq=0 out_seq=0 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f706be00640 10 client.6093 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f706be00640 1 -- 172.21.15.44:0/2176807461 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+662 (crc 0 0 0) 0x5598c9eeff60 con 0x5598ca043e60 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f706be00640 10 client.6093 handle_command_reply: tid=0 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f7090c36740 1 client.6093 shutdown 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f7090c36740 1 -- 172.21.15.44:0/2176807461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 msgr2=0x5598c9f78f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f7090c36740 1 --2- 172.21.15.44:0/2176807461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9f78f70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7070004650 tx=0x7f7070009190 comp rx=0 tx=0).stop 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f7090c36740 1 -- 172.21.15.44:0/2176807461 shutdown_connections 2024-03-30T13:15:23.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f7090c36740 1 --2- 172.21.15.44:0/2176807461 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5598ca043e60 0x5598ca044280 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f7090c36740 1 --2- 172.21.15.44:0/2176807461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598c9fc7600 0x5598c9faf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f7090c36740 1 --2- 172.21.15.44:0/2176807461 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5598c9faab60 0x5598c9f78f70 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f7090c36740 1 --2- 172.21.15.44:0/2176807461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5598c9faa780 0x5598c9fd8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f706be00640 0 client.6093 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:23.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f7090c36740 1 -- 172.21.15.44:0/2176807461 >> 172.21.15.44:0/2176807461 conn(0x5598c9f7dc60 msgr2=0x5598c9f844a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:23.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.090+0000 7f7090c36740 1 -- 172.21.15.44:0/2176807461 shutdown_connections 2024-03-30T13:15:23.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.091+0000 7f7090c36740 1 -- 172.21.15.44:0/2176807461 wait complete. 2024-03-30T13:15:23.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.091+0000 7f7090c36740 20 client.6093 trim_cache size 0 max 16384 2024-03-30T13:15:23.097 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "status": "no active scrubs running", 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubs": {}, 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "scrub_stats": { 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "8c53b1c8-1c8b-48a2-b043-c812feb528ad": { 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-03-30T13:14:52.411504+0000", 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 74, 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 74, 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "15729069-7252-4183-a34d-d65e02a27e24": { 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "start_time": "2024-03-30T13:14:06.098229+0000", 2024-03-30T13:15:23.098 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/", 2024-03-30T13:15:23.099 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_started": 75, 2024-03-30T13:15:23.099 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_passed": 75, 2024-03-30T13:15:23.099 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_failed": 0, 2024-03-30T13:15:23.099 INFO:teuthology.orchestra.run.smithi044.stdout: "uninline_skipped": 0 2024-03-30T13:15:23.099 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:23.099 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:23.099 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.091+0000 7f708ca00640 1 -- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f706406c560 msgr2=0x7f706406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.091+0000 7f708ca00640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f706406c560 0x7f706406ea20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f70780016d0 tx=0x7f7078009040 comp rx=0 tx=0).stop 2024-03-30T13:15:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.091+0000 7f708ca00640 1 -- 172.21.15.44:0/2520814591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7088155240 msgr2=0x7f70881556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.091+0000 7f708ca00640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7088155240 0x7f70881556a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f70880d4120 tx=0x7f708000b4a0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.091+0000 7f708ca00640 1 -- 172.21.15.44:0/2520814591 shutdown_connections 2024-03-30T13:15:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.091+0000 7f708ca00640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7088155240 0x7f70881556a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.091+0000 7f708ca00640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70880cdbf0 0x7f70880b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.091+0000 7f708ca00640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f706406c560 0x7f706406ea20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.091+0000 7f708ca00640 1 --2- 172.21.15.44:0/2520814591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c004800 0x7f70880b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.091+0000 7f708ca00640 1 -- 172.21.15.44:0/2520814591 >> 172.21.15.44:0/2520814591 conn(0x7f708809d4e0 msgr2=0x7f708806d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.092+0000 7f708ca00640 1 -- 172.21.15.44:0/2520814591 shutdown_connections 2024-03-30T13:15:23.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:23.092+0000 7f708ca00640 1 -- 172.21.15.44:0/2520814591 wait complete. 2024-03-30T13:15:23.114 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-30T13:15:23.115 DEBUG:tasks.cephfs.test_uninlining:joining snapshotter thread 2024-03-30T13:15:23.115 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_0 2024-03-30T13:15:23.187 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_1 2024-03-30T13:15:23.253 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_2 2024-03-30T13:15:23.318 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_3 2024-03-30T13:15:23.382 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_4 2024-03-30T13:15:23.447 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_5 2024-03-30T13:15:23.508 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_6 2024-03-30T13:15:23.572 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_7 2024-03-30T13:15:23.637 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_8 2024-03-30T13:15:23.703 DEBUG:teuthology.orchestra.run.smithi151:> cd /home/ubuntu/cephtest/mnt.1 && rmdir linux-5.4/.snap/snap_9 2024-03-30T13:15:23.771 DEBUG:tasks.cephfs.test_uninlining:extracting inodes 2024-03-30T13:15:23.771 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:15:23.771 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Kconfig 2024-03-30T13:15:23.824 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628358 linux-5.4/fs/ceph/Kconfig 2024-03-30T13:15:23.824 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Makefile 2024-03-30T13:15:23.824 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Makefile 2024-03-30T13:15:23.870 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628359 linux-5.4/fs/ceph/Makefile 2024-03-30T13:15:23.871 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:15:23.871 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:15:23.968 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628365 linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:15:23.968 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/io.h 2024-03-30T13:15:23.968 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/io.h 2024-03-30T13:15:24.017 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628372 linux-5.4/fs/ceph/io.h 2024-03-30T13:15:24.017 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:15:24.017 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:15:24.070 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628374 linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:15:24.071 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:15:24.071 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Kconfig 2024-03-30T13:15:24.124 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628386 linux-5.4/fs/ext2/Kconfig 2024-03-30T13:15:24.124 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:15:24.125 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:15:24.171 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628404 linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:15:24.172 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:15:24.172 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:15:24.265 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628402 linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:15:24.265 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Makefile 2024-03-30T13:15:24.265 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Makefile 2024-03-30T13:15:24.310 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628387 linux-5.4/fs/ext2/Makefile 2024-03-30T13:15:24.310 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:15:24.310 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/symlink.c 2024-03-30T13:15:24.405 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628399 linux-5.4/fs/ext2/symlink.c 2024-03-30T13:15:24.406 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/acl.h 2024-03-30T13:15:24.406 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/acl.h 2024-03-30T13:15:24.454 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628389 linux-5.4/fs/ext2/acl.h 2024-03-30T13:15:24.454 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:15:24.454 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:15:24.503 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628403 linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:15:24.503 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:15:24.504 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr.h 2024-03-30T13:15:24.554 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628401 linux-5.4/fs/ext2/xattr.h 2024-03-30T13:15:24.554 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:15:24.554 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:15:24.602 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628406 linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:15:24.603 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:15:24.603 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:15:24.651 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628419 linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:15:24.651 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:15:24.651 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:15:24.698 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628426 linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:15:24.699 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:15:24.699 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:15:24.792 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628409 linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:15:24.792 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:15:24.793 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:15:24.840 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628417 linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:15:24.840 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:15:24.840 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:15:24.890 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628421 linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:15:24.891 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:15:24.891 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:15:24.942 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628422 linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:15:24.942 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:15:24.942 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Makefile 2024-03-30T13:15:24.994 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628407 linux-5.4/fs/orangefs/Makefile 2024-03-30T13:15:24.994 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:15:24.995 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:15:25.039 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628430 linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:15:25.039 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:15:25.039 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:15:25.132 INFO:teuthology.orchestra.run.smithi044.stdout:1099511628412 linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:15:25.132 DEBUG:tasks.cephfs.test_uninlining:getting inline data info 2024-03-30T13:15:25.132 DEBUG:tasks.cephfs.test_uninlining:getting inode info #1 of 23:1099511628358 2024-03-30T13:15:25.132 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628358 2024-03-30T13:15:25.133 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628358 2024-03-30T13:15:25.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.347+0000 7f60bac00640 1 Processor -- start 2024-03-30T13:15:25.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.347+0000 7f60bac00640 1 -- start start 2024-03-30T13:15:25.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.349+0000 7f60bac00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b40d0510 0x7f60b40b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.349+0000 7f60bac00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b40d0e70 con 0x7f60b40b3020 2024-03-30T13:15:25.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.349+0000 7f60bac00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b40b10d0 con 0x7f60b40d08f0 2024-03-30T13:15:25.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.349+0000 7f60bac00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f60b40cfba0 con 0x7f60b40d0510 2024-03-30T13:15:25.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.349+0000 7f60ba200640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f60b40b3020 0x7f60b4160700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49240/0 (socket says 172.21.15.44:49240) 2024-03-30T13:15:25.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.349+0000 7f60ba200640 1 -- 172.21.15.44:0/525540449 learned_addr learned my addr 172.21.15.44:0/525540449 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:25.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.350+0000 7f60b9800640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b40d0510 0x7f60b40b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.350+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24920211 0 0) 0x7f60b40d0e70 con 0x7f60b40b3020 2024-03-30T13:15:25.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.350+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f609c003520 con 0x7f60b40b3020 2024-03-30T13:15:25.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.350+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1089013565 0 0) 0x7f609c003520 con 0x7f60b40b3020 2024-03-30T13:15:25.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.350+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b40d0510 msgr2=0x7f60b40b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.350+0000 7f60b3e00640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b40d0510 0x7f60b40b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.350+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 >> v1:172.21.15.151:6789/0 conn(0x7f60b40d08f0 legacy=0x7f60b40b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.350+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b40cfdf0 con 0x7f60b40b3020 2024-03-30T13:15:25.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.350+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f60ac0019f0 con 0x7f60b40b3020 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.351+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 >> v1:172.21.15.44:6789/0 conn(0x7f60b40b3020 legacy=0x7f60b4160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.351+0000 7f60b3e00640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b40d0510 0x7f609c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.351+0000 7f60b3e00640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c004010 0x7f609c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.351+0000 7f60b3e00640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f609c004d40 0x7f609c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.351+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60b40cfba0 con 0x7f609c004d40 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.351+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f609c00bb80 con 0x7f609c004010 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.351+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f609c00bd80 con 0x7f60b40d0510 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.351+0000 7f60ba200640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f609c004d40 0x7f609c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.351+0000 7f60b8e00640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c004010 0x7f609c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.351+0000 7f60b9800640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b40d0510 0x7f609c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.351+0000 7f60ba200640 1 -- 172.21.15.44:0/525540449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b40d0510 msgr2=0x7f609c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.352+0000 7f60ba200640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b40d0510 0x7f609c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.352+0000 7f60ba200640 1 -- 172.21.15.44:0/525540449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c004010 msgr2=0x7f609c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.352+0000 7f60ba200640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c004010 0x7f609c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.352+0000 7f60ba200640 1 -- 172.21.15.44:0/525540449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c003520 con 0x7f609c004d40 2024-03-30T13:15:25.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.352+0000 7f60b8e00640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f609c004010 0x7f609c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:25.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.353+0000 7f60ba200640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f609c004d40 0x7f609c0051c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00a850 tx=0x7f609c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91ddca08a8b5717 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.353+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00a4a0 con 0x7f609c004d40 2024-03-30T13:15:25.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.353+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ac034650 con 0x7f609c004d40 2024-03-30T13:15:25.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.353+0000 7f60b3e00640 1 -- 172.21.15.44:0/525540449 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac034a80 con 0x7f609c004d40 2024-03-30T13:15:25.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.353+0000 7f60bac00640 1 -- 172.21.15.44:0/525540449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f609c004d40 msgr2=0x7f609c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.353+0000 7f60bac00640 1 --2- 172.21.15.44:0/525540449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f609c004d40 0x7f609c0051c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00a850 tx=0x7f609c005830 comp rx=0 tx=0).stop 2024-03-30T13:15:25.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.354+0000 7f60ba200640 1 -- 172.21.15.44:0/525540449 reap_dead start 2024-03-30T13:15:25.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.354+0000 7f60bac00640 1 -- 172.21.15.44:0/525540449 shutdown_connections 2024-03-30T13:15:25.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.354+0000 7f60bac00640 1 -- 172.21.15.44:0/525540449 >> 172.21.15.44:0/525540449 conn(0x7f60b40cea50 msgr2=0x7f60b40cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.354+0000 7f60bac00640 1 -- 172.21.15.44:0/525540449 shutdown_connections 2024-03-30T13:15:25.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.354+0000 7f60bac00640 1 -- 172.21.15.44:0/525540449 wait complete. 2024-03-30T13:15:25.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.355+0000 7f60bac00640 1 Processor -- start 2024-03-30T13:15:25.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.356+0000 7f60bac00640 1 -- start start 2024-03-30T13:15:25.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.356+0000 7f60bac00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b41565d0 0x7f60b40af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.356+0000 7f60bac00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b40afd70 0x7f60b40ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60bac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60b40cac10 0x7f60b406c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60bac00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60b4160e10 con 0x7f60b40cac10 2024-03-30T13:15:25.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60bac00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f60b40d1150 con 0x7f60b40afd70 2024-03-30T13:15:25.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60bac00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f60b4067fe0 con 0x7f60b41565d0 2024-03-30T13:15:25.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60ba200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60b40cac10 0x7f60b406c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60ba200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60b40cac10 0x7f60b406c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51952/0 (socket says 172.21.15.44:51952) 2024-03-30T13:15:25.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60ba200640 1 -- 172.21.15.44:0/3826723059 learned_addr learned my addr 172.21.15.44:0/3826723059 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60b9800640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b41565d0 0x7f60b40af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60b8e00640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b40afd70 0x7f60b40ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60ba200640 1 -- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b41565d0 msgr2=0x7f60b40af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60ba200640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b41565d0 0x7f60b40af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60ba200640 1 -- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b40afd70 msgr2=0x7f60b40ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60ba200640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b40afd70 0x7f60b40ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.357+0000 7f60ba200640 1 -- 172.21.15.44:0/3826723059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b41569b0 con 0x7f60b40cac10 2024-03-30T13:15:25.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.358+0000 7f60ba200640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60b40cac10 0x7f60b406c690 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00a970 tx=0x7f60ac001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.358+0000 7f60b1600640 1 -- 172.21.15.44:0/3826723059 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00a480 con 0x7f60b40cac10 2024-03-30T13:15:25.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.358+0000 7f60b1600640 1 -- 172.21.15.44:0/3826723059 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ac045070 con 0x7f60b40cac10 2024-03-30T13:15:25.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.358+0000 7f60b1600640 1 -- 172.21.15.44:0/3826723059 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac034a00 con 0x7f60b40cac10 2024-03-30T13:15:25.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.358+0000 7f60bac00640 1 -- 172.21.15.44:0/3826723059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b40cb420 con 0x7f60b40cac10 2024-03-30T13:15:25.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.358+0000 7f60bac00640 1 -- 172.21.15.44:0/3826723059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b40cb9e0 con 0x7f60b40cac10 2024-03-30T13:15:25.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.360+0000 7f60b1600640 1 -- 172.21.15.44:0/3826723059 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f60ac034ba0 con 0x7f60b40cac10 2024-03-30T13:15:25.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.361+0000 7f60b1600640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f609406c580 0x7f609406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.361+0000 7f60b1600640 1 -- 172.21.15.44:0/3826723059 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f60ac0adb40 con 0x7f60b40cac10 2024-03-30T13:15:25.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.362+0000 7f60b9800640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f609406c580 0x7f609406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.362+0000 7f60beff1740 1 Processor -- start 2024-03-30T13:15:25.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.362+0000 7f60beff1740 1 -- start start 2024-03-30T13:15:25.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.363+0000 7f60b9800640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f609406c580 0x7f609406ea40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f60a8006fd0 tx=0x7f60a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.363+0000 7f60beff1740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47470 0x55b0afa6dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.363+0000 7f60beff1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa6e4e0 0x55b0afa464b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.363+0000 7f60beff1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47850 0x55b0afa469f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.363+0000 7f60beff1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b0af9aa330 con 0x55b0afa47850 2024-03-30T13:15:25.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.363+0000 7f60beff1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b0af952620 con 0x55b0afa6e4e0 2024-03-30T13:15:25.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.363+0000 7f60beff1740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55b0af9a6440 con 0x55b0afa47470 2024-03-30T13:15:25.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.364+0000 7f60ba200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47850 0x55b0afa469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.364+0000 7f60ba200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47850 0x55b0afa469f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51968/0 (socket says 172.21.15.44:51968) 2024-03-30T13:15:25.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.364+0000 7f60ba200640 1 -- 172.21.15.44:0/1497624349 learned_addr learned my addr 172.21.15.44:0/1497624349 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.364+0000 7f60b8e00640 1 --2- 172.21.15.44:0/1497624349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa6e4e0 0x55b0afa464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.364+0000 7f60b9800640 1 --2- 172.21.15.44:0/1497624349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47470 0x55b0afa6dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.364+0000 7f60ba200640 1 -- 172.21.15.44:0/1497624349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47470 msgr2=0x55b0afa6dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.364+0000 7f60ba200640 1 --2- 172.21.15.44:0/1497624349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47470 0x55b0afa6dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.364+0000 7f60ba200640 1 -- 172.21.15.44:0/1497624349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa6e4e0 msgr2=0x55b0afa464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.364+0000 7f60ba200640 1 --2- 172.21.15.44:0/1497624349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa6e4e0 0x55b0afa464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.364+0000 7f60ba200640 1 -- 172.21.15.44:0/1497624349 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0af78a920 con 0x55b0afa47850 2024-03-30T13:15:25.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.365+0000 7f60ba200640 1 --2- 172.21.15.44:0/1497624349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47850 0x55b0afa469f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f60ac07b790 tx=0x7f60ac07b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79626760f15a49cb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.365+0000 7f60a6000640 1 -- 172.21.15.44:0/1497624349 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0aa070 con 0x55b0afa47850 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.365+0000 7f60a6000640 1 -- 172.21.15.44:0/1497624349 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ac03a040 con 0x55b0afa47850 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.365+0000 7f60a6000640 1 -- 172.21.15.44:0/1497624349 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac07bf00 con 0x55b0afa47850 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.366+0000 7f60beff1740 1 -- 172.21.15.44:0/1497624349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47850 msgr2=0x55b0afa469f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.366+0000 7f60beff1740 1 --2- 172.21.15.44:0/1497624349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47850 0x55b0afa469f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f60ac07b790 tx=0x7f60ac07b340 comp rx=0 tx=0).stop 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.366+0000 7f60beff1740 1 -- 172.21.15.44:0/1497624349 shutdown_connections 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.366+0000 7f60beff1740 1 --2- 172.21.15.44:0/1497624349 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47850 0x55b0afa469f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.366+0000 7f60beff1740 1 --2- 172.21.15.44:0/1497624349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa6e4e0 0x55b0afa464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.366+0000 7f60beff1740 1 --2- 172.21.15.44:0/1497624349 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47470 0x55b0afa6dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.366+0000 7f60beff1740 1 -- 172.21.15.44:0/1497624349 >> 172.21.15.44:0/1497624349 conn(0x55b0afa0dbe0 msgr2=0x55b0afa8c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.366+0000 7f60beff1740 1 -- 172.21.15.44:0/1497624349 shutdown_connections 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.366+0000 7f60beff1740 1 -- 172.21.15.44:0/1497624349 wait complete. 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.367+0000 7f60beff1740 1 -- start start 2024-03-30T13:15:25.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.367+0000 7f60beff1740 1 Processor -- start 2024-03-30T13:15:25.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.368+0000 7f60beff1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47470 0x55b0afa65940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.368+0000 7f60beff1740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47850 0x55b0afa8c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.368+0000 7f60beff1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 0x55b0afa460a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.368+0000 7f60beff1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b0af952620 con 0x55b0afa8ca50 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.368+0000 7f60beff1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b0af9659d0 con 0x55b0afa47470 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.368+0000 7f60beff1740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55b0af9aa330 con 0x55b0afa47850 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.368+0000 7f60beff1740 10 client.0 _ll_register_callbacks cb 0x55b0af9a1fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.368+0000 7f60ba200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 0x55b0afa460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.368+0000 7f60ba200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 0x55b0afa460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51980/0 (socket says 172.21.15.44:51980) 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.368+0000 7f60ba200640 1 -- 172.21.15.44:0/69565373 learned_addr learned my addr 172.21.15.44:0/69565373 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.368+0000 7f60b9800640 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47470 0x55b0afa65940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.368+0000 7f60b8e00640 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47850 0x55b0afa8c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f60ba200640 1 -- 172.21.15.44:0/69565373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47850 msgr2=0x55b0afa8c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f60ba200640 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47850 0x55b0afa8c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f60ba200640 1 -- 172.21.15.44:0/69565373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47470 msgr2=0x55b0afa65940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f60ba200640 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47470 0x55b0afa65940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f60ba200640 1 -- 172.21.15.44:0/69565373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0af67e210 con 0x55b0afa8ca50 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f60b9800640 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47470 0x55b0afa65940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f60b8e00640 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47850 0x55b0afa8c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f60ba200640 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 0x55b0afa460a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0347d0 tx=0x7f60ac041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ade5326e8f8875 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f609aa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f609aa00640 1 -- 172.21.15.44:0/69565373 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0aa030 con 0x55b0afa8ca50 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f609aa00640 1 -- 172.21.15.44:0/69565373 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f60ac077e70 con 0x55b0afa8ca50 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f60beff1740 1 -- 172.21.15.44:0/69565373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60ac03a040 con 0x55b0afa8ca50 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f609aa00640 1 -- 172.21.15.44:0/69565373 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f60ac0a1050 con 0x55b0afa8ca50 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f60beff1740 10 client.6105 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.369+0000 7f60beff1740 1 -- 172.21.15.44:0/69565373 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55b0af7eb0b0 con 0x55b0afa8ca50 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.370+0000 7f609aa00640 1 -- 172.21.15.44:0/69565373 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ac03a040 con 0x55b0afa8ca50 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.370+0000 7f609aa00640 1 -- 172.21.15.44:0/69565373 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f60ac07cb30 con 0x55b0afa8ca50 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.370+0000 7f60beff1740 10 client.6105 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:25.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.370+0000 7f60beff1740 10 client.6105 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:25.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.370+0000 7f60beff1740 20 client.6105 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:25.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.370+0000 7f60beff1740 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b0afa727e0 0x55b0afa72bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.370+0000 7f60beff1740 4 client.6105 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:25.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.370+0000 7f60beff1740 1 -- 172.21.15.44:0/69565373 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0af9b7870 con 0x55b0afa727e0 2024-03-30T13:15:25.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.370+0000 7f60b9800640 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b0afa727e0 0x55b0afa72bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.371+0000 7f60b9800640 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b0afa727e0 0x55b0afa72bf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=444983d25bb5dd58 server_cookie=749d59caba70958b in_seq=0 out_seq=0 2024-03-30T13:15:25.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.371+0000 7f609aa00640 10 client.6105 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:25.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f609aa00640 1 -- 172.21.15.44:0/69565373 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b0af9b7870 con 0x55b0afa727e0 2024-03-30T13:15:25.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f609aa00640 10 client.6105 handle_command_reply: tid=0 2024-03-30T13:15:25.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f60beff1740 1 client.6105 shutdown 2024-03-30T13:15:25.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f60beff1740 1 -- 172.21.15.44:0/69565373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 msgr2=0x55b0afa460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f60beff1740 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 0x55b0afa460a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0347d0 tx=0x7f60ac041040 comp rx=0 tx=0).stop 2024-03-30T13:15:25.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f60beff1740 1 -- 172.21.15.44:0/69565373 shutdown_connections 2024-03-30T13:15:25.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f60beff1740 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b0afa727e0 0x55b0afa72bf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f60beff1740 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 0x55b0afa460a0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f60beff1740 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47850 0x55b0afa8c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f60beff1740 1 --2- 172.21.15.44:0/69565373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47470 0x55b0afa65940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f60beff1740 1 -- 172.21.15.44:0/69565373 >> 172.21.15.44:0/69565373 conn(0x55b0afa0dbe0 msgr2=0x55b0afa40b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f609aa00640 0 client.6105 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:25.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f60beff1740 1 -- 172.21.15.44:0/69565373 shutdown_connections 2024-03-30T13:15:25.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f60beff1740 1 -- 172.21.15.44:0/69565373 wait complete. 2024-03-30T13:15:25.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.372+0000 7f60beff1740 20 client.6105 trim_cache size 0 max 16384 2024-03-30T13:15:25.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.388+0000 7f60beff1740 1 Processor -- start 2024-03-30T13:15:25.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.388+0000 7f60beff1740 1 -- start start 2024-03-30T13:15:25.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.389+0000 7f60beff1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47470 0x55b0afa8ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.389+0000 7f60beff1740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47850 0x55b0afa71370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.389+0000 7f60beff1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 0x55b0afa718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.389+0000 7f60beff1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60b4201a10 con 0x55b0afa8ca50 2024-03-30T13:15:25.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.389+0000 7f60beff1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f60b4200a10 con 0x55b0afa47470 2024-03-30T13:15:25.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.389+0000 7f60beff1740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f60b41ffe00 con 0x55b0afa47850 2024-03-30T13:15:25.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.390+0000 7f60ba200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 0x55b0afa718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.390+0000 7f60ba200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 0x55b0afa718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51986/0 (socket says 172.21.15.44:51986) 2024-03-30T13:15:25.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.390+0000 7f60ba200640 1 -- 172.21.15.44:0/2794426108 learned_addr learned my addr 172.21.15.44:0/2794426108 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.390+0000 7f60ba200640 1 -- 172.21.15.44:0/2794426108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47850 msgr2=0x55b0afa71370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.390+0000 7f60ba200640 1 --2- 172.21.15.44:0/2794426108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47850 0x55b0afa71370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.390+0000 7f60b9800640 1 --2- 172.21.15.44:0/2794426108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47470 0x55b0afa8ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.390+0000 7f60ba200640 1 -- 172.21.15.44:0/2794426108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47470 msgr2=0x55b0afa8ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.390+0000 7f60ba200640 1 --2- 172.21.15.44:0/2794426108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47470 0x55b0afa8ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.390+0000 7f60ba200640 1 -- 172.21.15.44:0/2794426108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0af6572d0 con 0x55b0afa8ca50 2024-03-30T13:15:25.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.390+0000 7f60ba200640 1 --2- 172.21.15.44:0/2794426108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 0x55b0afa718b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00a850 tx=0x7f60ac0a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63faab392c155846 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.391+0000 7f60a5600640 1 -- 172.21.15.44:0/2794426108 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0aa030 con 0x55b0afa8ca50 2024-03-30T13:15:25.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.391+0000 7f60a5600640 1 -- 172.21.15.44:0/2794426108 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ac098070 con 0x55b0afa8ca50 2024-03-30T13:15:25.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.391+0000 7f60a5600640 1 -- 172.21.15.44:0/2794426108 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac07fbb0 con 0x55b0afa8ca50 2024-03-30T13:15:25.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.391+0000 7f60beff1740 1 -- 172.21.15.44:0/2794426108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 msgr2=0x55b0afa718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.391+0000 7f60beff1740 1 --2- 172.21.15.44:0/2794426108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 0x55b0afa718b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00a850 tx=0x7f60ac0a7070 comp rx=0 tx=0).stop 2024-03-30T13:15:25.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.391+0000 7f60beff1740 1 -- 172.21.15.44:0/2794426108 shutdown_connections 2024-03-30T13:15:25.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.391+0000 7f60beff1740 1 --2- 172.21.15.44:0/2794426108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa8ca50 0x55b0afa718b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.391+0000 7f60beff1740 1 --2- 172.21.15.44:0/2794426108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa47850 0x55b0afa71370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.391+0000 7f60beff1740 1 --2- 172.21.15.44:0/2794426108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47470 0x55b0afa8ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.391+0000 7f60beff1740 1 -- 172.21.15.44:0/2794426108 >> 172.21.15.44:0/2794426108 conn(0x55b0afa0dbe0 msgr2=0x55b0afa64cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.391+0000 7f60beff1740 1 -- 172.21.15.44:0/2794426108 shutdown_connections 2024-03-30T13:15:25.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.391+0000 7f60beff1740 1 -- 172.21.15.44:0/2794426108 wait complete. 2024-03-30T13:15:25.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.392+0000 7f60beff1740 1 -- start start 2024-03-30T13:15:25.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.392+0000 7f60beff1740 1 Processor -- start 2024-03-30T13:15:25.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.393+0000 7f60beff1740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47470 0x55b0afa6bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.393+0000 7f60beff1740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47850 0x55b0afa71770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.393+0000 7f60beff1740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa8ca50 0x55b0afafba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.393+0000 7f60beff1740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f60b42003c0 con 0x55b0afa47470 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.393+0000 7f60beff1740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b0af9ac7d0 con 0x55b0afa47850 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.393+0000 7f60beff1740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55b0afb084b0 con 0x55b0afa8ca50 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.393+0000 7f60beff1740 10 client.0 _ll_register_callbacks cb 0x7f60ac0a8070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60b9800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47470 0x55b0afa6bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60b9800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47470 0x55b0afa6bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51990/0 (socket says 172.21.15.44:51990) 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60b9800640 1 -- 172.21.15.44:0/1827853082 learned_addr learned my addr 172.21.15.44:0/1827853082 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60ba200640 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa8ca50 0x55b0afafba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60b8e00640 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47850 0x55b0afa71770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60b9800640 1 -- 172.21.15.44:0/1827853082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa8ca50 msgr2=0x55b0afafba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60b9800640 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa8ca50 0x55b0afafba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60b9800640 1 -- 172.21.15.44:0/1827853082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47850 msgr2=0x55b0afa71770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60b9800640 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47850 0x55b0afa71770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60b9800640 1 -- 172.21.15.44:0/1827853082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0afa71cb0 con 0x55b0afa47470 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60ba200640 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa8ca50 0x55b0afafba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60b8e00640 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47850 0x55b0afa71770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f60b9800640 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47470 0x55b0afa6bc50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55b0af7eb250 tx=0x7f60a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99d429a408d6dcf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.394+0000 7f609aa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f609aa00640 1 -- 172.21.15.44:0/1827853082 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a8011e90 con 0x55b0afa47470 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f609aa00640 1 -- 172.21.15.44:0/1827853082 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f60a8003ae0 con 0x55b0afa47470 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f60beff1740 1 -- 172.21.15.44:0/1827853082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60ac098070 con 0x55b0afa47470 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f609aa00640 1 -- 172.21.15.44:0/1827853082 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f60a8038050 con 0x55b0afa47470 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f60beff1740 10 client.6111 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f60beff1740 1 -- 172.21.15.44:0/1827853082 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55b0afb081f0 con 0x55b0afa47470 2024-03-30T13:15:25.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f609aa00640 1 -- 172.21.15.44:0/1827853082 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60ac098070 con 0x55b0afa47470 2024-03-30T13:15:25.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f609aa00640 1 -- 172.21.15.44:0/1827853082 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f60a803b020 con 0x55b0afa47470 2024-03-30T13:15:25.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f60beff1740 10 client.6111 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:25.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f60beff1740 10 client.6111 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:25.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f60beff1740 20 client.6111 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:25.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f60beff1740 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b0afa8ab20 0x55b0afafbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f60beff1740 4 client.6111 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628358}] 2024-03-30T13:15:25.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.395+0000 7f60beff1740 1 -- 172.21.15.44:0/1827853082 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628358}) -- 0x55b0af9b1bc0 con 0x55b0afa8ab20 2024-03-30T13:15:25.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.396+0000 7f60b8e00640 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b0afa8ab20 0x55b0afafbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.396+0000 7f609aa00640 10 client.6111 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:25.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.396+0000 7f60b8e00640 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b0afa8ab20 0x55b0afafbf70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea65e301e4a16726 server_cookie=ebbb0af45ab00c1d in_seq=0 out_seq=0 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f609aa00640 1 -- 172.21.15.44:0/1827853082 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4755 (crc 0 0 0) 0x55b0af9b1bc0 con 0x55b0afa8ab20 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f609aa00640 10 client.6111 handle_command_reply: tid=0 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f60beff1740 1 client.6111 shutdown 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f60beff1740 1 -- 172.21.15.44:0/1827853082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47470 msgr2=0x55b0afa6bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f60beff1740 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47470 0x55b0afa6bc50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55b0af7eb250 tx=0x7f60a8004730 comp rx=0 tx=0).stop 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f60beff1740 1 -- 172.21.15.44:0/1827853082 shutdown_connections 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f60beff1740 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b0afa8ab20 0x55b0afafbf70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f60beff1740 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b0afa8ca50 0x55b0afafba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f60beff1740 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0afa47850 0x55b0afa71770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f60beff1740 1 --2- 172.21.15.44:0/1827853082 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b0afa47470 0x55b0afa6bc50 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f60beff1740 1 -- 172.21.15.44:0/1827853082 >> 172.21.15.44:0/1827853082 conn(0x55b0afa0dbe0 msgr2=0x55b0afa8ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f609aa00640 0 client.6111 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f60beff1740 1 -- 172.21.15.44:0/1827853082 shutdown_connections 2024-03-30T13:15:25.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f60beff1740 1 -- 172.21.15.44:0/1827853082 wait complete. 2024-03-30T13:15:25.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.397+0000 7f60beff1740 20 client.6111 trim_cache size 0 max 16384 2024-03-30T13:15:25.406 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:25.406 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ceph/Kconfig", 2024-03-30T13:15:25.406 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628358, 2024-03-30T13:15:25.406 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:25.406 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.441677+0000", 2024-03-30T13:15:25.406 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.429535+0000", 2024-03-30T13:15:25.406 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:25.406 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:25.406 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.407 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 1481, 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.429535+0000", 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:25.408 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:25.409 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1481, 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.441677+0000" 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1481, 2024-03-30T13:15:25.410 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.441677+0000" 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 196, 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 2, 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:25.411 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.412 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:25.413 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:25.414 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:25.415 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.416 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.417 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:25.418 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:25.419 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:25.420 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:25.420 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:25.420 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:25.420 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:25.420 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:25.420 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.420 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:25.420 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:25.420 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:25.420 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:25.420 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.398+0000 7f60bac00640 1 -- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f609406c580 msgr2=0x7f609406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.398+0000 7f60bac00640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f609406c580 0x7f609406ea40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f60a8006fd0 tx=0x7f60a8008040 comp rx=0 tx=0).stop 2024-03-30T13:15:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.398+0000 7f60bac00640 1 -- 172.21.15.44:0/3826723059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60b40cac10 msgr2=0x7f60b406c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.398+0000 7f60bac00640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60b40cac10 0x7f60b406c690 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00a970 tx=0x7f60ac001dc0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.398+0000 7f60bac00640 1 -- 172.21.15.44:0/3826723059 shutdown_connections 2024-03-30T13:15:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.398+0000 7f60bac00640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f60b40cac10 0x7f60b406c690 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.398+0000 7f60bac00640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f609406c580 0x7f609406ea40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.398+0000 7f60bac00640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b40afd70 0x7f60b40ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.398+0000 7f60bac00640 1 --2- 172.21.15.44:0/3826723059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b41565d0 0x7f60b40af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.398+0000 7f60bac00640 1 -- 172.21.15.44:0/3826723059 >> 172.21.15.44:0/3826723059 conn(0x7f60b40cea50 msgr2=0x7f60b406f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.398+0000 7f60bac00640 1 -- 172.21.15.44:0/3826723059 shutdown_connections 2024-03-30T13:15:25.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.398+0000 7f60bac00640 1 -- 172.21.15.44:0/3826723059 wait complete. 2024-03-30T13:15:25.423 DEBUG:tasks.cephfs.test_uninlining:getting inode info #2 of 23:1099511628359 2024-03-30T13:15:25.423 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628359 2024-03-30T13:15:25.423 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628359 2024-03-30T13:15:25.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.619+0000 7fc36ee00640 1 Processor -- start 2024-03-30T13:15:25.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.619+0000 7fc36ee00640 1 -- start start 2024-03-30T13:15:25.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.621+0000 7fc36ee00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc3680d18f0 0x7fc3680d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.621+0000 7fc36ee00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3680d46b0 0x7fc3680b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.621+0000 7fc36ee00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3680d32b0 con 0x7fc36815c040 2024-03-30T13:15:25.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.621+0000 7fc36ee00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fc36815fa70 con 0x7fc3680d18f0 2024-03-30T13:15:25.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.621+0000 7fc36ee00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc3680d2210 con 0x7fc3680d46b0 2024-03-30T13:15:25.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.621+0000 7fc36d000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc3680d18f0 0x7fc3680d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.621+0000 7fc36e400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3680d46b0 0x7fc3680b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.621+0000 7fc36d000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc3680d18f0 0x7fc3680d4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:58568/0 (socket says 172.21.15.44:58568) 2024-03-30T13:15:25.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.621+0000 7fc36d000640 1 -- 172.21.15.44:0/2289359892 learned_addr learned my addr 172.21.15.44:0/2289359892 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.622+0000 7fc367e00640 1 -- 172.21.15.44:0/2289359892 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2122098647 0 0) 0x7fc3680d32b0 con 0x7fc36815c040 2024-03-30T13:15:25.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.622+0000 7fc367e00640 1 -- 172.21.15.44:0/2289359892 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc350003520 con 0x7fc36815c040 2024-03-30T13:15:25.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.622+0000 7fc36d000640 1 -- 172.21.15.44:0/2289359892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3680d46b0 msgr2=0x7fc3680b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.622+0000 7fc36d000640 1 --2- 172.21.15.44:0/2289359892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3680d46b0 0x7fc3680b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.622+0000 7fc36d000640 1 -- 172.21.15.44:0/2289359892 >> v1:172.21.15.151:6789/0 conn(0x7fc36815c040 legacy=0x7fc36815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.622+0000 7fc36d000640 1 -- 172.21.15.44:0/2289359892 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3680d24f0 con 0x7fc3680d18f0 2024-03-30T13:15:25.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.624+0000 7fc36d000640 1 --2- 172.21.15.44:0/2289359892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3680d18f0 0x7fc3680d4170 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc3540098a0 tx=0x7fc35402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faf35fb494571cdf server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.625+0000 7fc367e00640 1 -- 172.21.15.44:0/2289359892 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc354035020 con 0x7fc3680d18f0 2024-03-30T13:15:25.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.625+0000 7fc367e00640 1 -- 172.21.15.44:0/2289359892 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc354031640 con 0x7fc3680d18f0 2024-03-30T13:15:25.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.625+0000 7fc367e00640 1 -- 172.21.15.44:0/2289359892 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35402d040 con 0x7fc3680d18f0 2024-03-30T13:15:25.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.625+0000 7fc36ee00640 1 -- 172.21.15.44:0/2289359892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3680d18f0 msgr2=0x7fc3680d4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.625+0000 7fc36ee00640 1 --2- 172.21.15.44:0/2289359892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3680d18f0 0x7fc3680d4170 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc3540098a0 tx=0x7fc35402b8f0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.625+0000 7fc36ee00640 1 -- 172.21.15.44:0/2289359892 shutdown_connections 2024-03-30T13:15:25.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.625+0000 7fc36ee00640 1 --2- 172.21.15.44:0/2289359892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3680d46b0 0x7fc3680b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.625+0000 7fc36ee00640 1 --2- 172.21.15.44:0/2289359892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3680d18f0 0x7fc3680d4170 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.625+0000 7fc36ee00640 1 -- 172.21.15.44:0/2289359892 >> 172.21.15.44:0/2289359892 conn(0x7fc36808dbf0 msgr2=0x7fc36809d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.625+0000 7fc36ee00640 1 -- 172.21.15.44:0/2289359892 shutdown_connections 2024-03-30T13:15:25.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.626+0000 7fc36ee00640 1 -- 172.21.15.44:0/2289359892 wait complete. 2024-03-30T13:15:25.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.627+0000 7fc36ee00640 1 Processor -- start 2024-03-30T13:15:25.632 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.627+0000 7fc36ee00640 1 -- start start 2024-03-30T13:15:25.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.628+0000 7fc36ee00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3680d18f0 0x7fc368160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.628+0000 7fc36ee00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3680d46b0 0x7fc368161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.628+0000 7fc36ee00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc36815c040 0x7fc368149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.628+0000 7fc36ee00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc3680d2d90 con 0x7fc36815c040 2024-03-30T13:15:25.633 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.628+0000 7fc36ee00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc3680d2ab0 con 0x7fc3680d46b0 2024-03-30T13:15:25.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.628+0000 7fc36ee00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc36815c420 con 0x7fc3680d18f0 2024-03-30T13:15:25.634 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.629+0000 7fc36e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc36815c040 0x7fc368149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.629+0000 7fc36e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc36815c040 0x7fc368149e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51992/0 (socket says 172.21.15.44:51992) 2024-03-30T13:15:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.629+0000 7fc36e400640 1 -- 172.21.15.44:0/1605850928 learned_addr learned my addr 172.21.15.44:0/1605850928 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.629+0000 7fc36da00640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3680d18f0 0x7fc368160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.629+0000 7fc36d000640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3680d46b0 0x7fc368161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.629+0000 7fc36e400640 1 -- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3680d18f0 msgr2=0x7fc368160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.629+0000 7fc36e400640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3680d18f0 0x7fc368160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.629+0000 7fc36e400640 1 -- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3680d46b0 msgr2=0x7fc368161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.629+0000 7fc36e400640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3680d46b0 0x7fc368161360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.629+0000 7fc36e400640 1 -- 172.21.15.44:0/1605850928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36815b750 con 0x7fc36815c040 2024-03-30T13:15:25.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.630+0000 7fc36e400640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc36815c040 0x7fc368149e60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc360009d30 tx=0x7fc36000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.630+0000 7fc365600640 1 -- 172.21.15.44:0/1605850928 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360018020 con 0x7fc36815c040 2024-03-30T13:15:25.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.630+0000 7fc365600640 1 -- 172.21.15.44:0/1605850928 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc360014480 con 0x7fc36815c040 2024-03-30T13:15:25.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.630+0000 7fc365600640 1 -- 172.21.15.44:0/1605850928 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360014870 con 0x7fc36815c040 2024-03-30T13:15:25.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.630+0000 7fc36ee00640 1 -- 172.21.15.44:0/1605850928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36814aa70 con 0x7fc36815c040 2024-03-30T13:15:25.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.630+0000 7fc36ee00640 1 -- 172.21.15.44:0/1605850928 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc368147e70 con 0x7fc36815c040 2024-03-30T13:15:25.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.633+0000 7fc365600640 1 -- 172.21.15.44:0/1605850928 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc360005d10 con 0x7fc36815c040 2024-03-30T13:15:25.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.634+0000 7fc373199740 1 Processor -- start 2024-03-30T13:15:25.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.634+0000 7fc373199740 1 -- start start 2024-03-30T13:15:25.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.634+0000 7fc365600640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc34806c560 0x7fc34806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.634+0000 7fc365600640 1 -- 172.21.15.44:0/1605850928 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc36008c410 con 0x7fc36815c040 2024-03-30T13:15:25.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.635+0000 7fc373199740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 0x562a3bb1cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.635+0000 7fc36d000640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc34806c560 0x7fc34806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.635+0000 7fc373199740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3bb1d4e0 0x562a3baf54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.635+0000 7fc373199740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6850 0x562a3baf59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.635+0000 7fc373199740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562a3ba59330 con 0x562a3baf6470 2024-03-30T13:15:25.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.635+0000 7fc373199740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562a3ba01620 con 0x562a3bb1d4e0 2024-03-30T13:15:25.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.635+0000 7fc373199740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x562a3ba55440 con 0x562a3baf6850 2024-03-30T13:15:25.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.635+0000 7fc36da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 0x562a3bb1cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.635+0000 7fc36da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 0x562a3bb1cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52006/0 (socket says 172.21.15.44:52006) 2024-03-30T13:15:25.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.635+0000 7fc36da00640 1 -- 172.21.15.44:0/1267788047 learned_addr learned my addr 172.21.15.44:0/1267788047 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.636+0000 7fc36d000640 1 --2- 172.21.15.44:0/1267788047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3bb1d4e0 0x562a3baf54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.636+0000 7fc36da00640 1 -- 172.21.15.44:0/1267788047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6850 msgr2=0x562a3baf59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.636+0000 7fc36da00640 1 --2- 172.21.15.44:0/1267788047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6850 0x562a3baf59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.636+0000 7fc36da00640 1 -- 172.21.15.44:0/1267788047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3bb1d4e0 msgr2=0x562a3baf54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.636+0000 7fc36da00640 1 --2- 172.21.15.44:0/1267788047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3bb1d4e0 0x562a3baf54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.636+0000 7fc36da00640 1 -- 172.21.15.44:0/1267788047 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3b839920 con 0x562a3baf6470 2024-03-30T13:15:25.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.636+0000 7fc36da00640 1 --2- 172.21.15.44:0/1267788047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 0x562a3bb1cfa0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0015c0 tx=0x7fc35c001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6af320cf548c6b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.642 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.636+0000 7fc36d000640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc34806c560 0x7fc34806ea20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc354036000 tx=0x7fc354030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.636+0000 7fc35a000640 1 -- 172.21.15.44:0/1267788047 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35c019070 con 0x562a3baf6470 2024-03-30T13:15:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.636+0000 7fc35a000640 1 -- 172.21.15.44:0/1267788047 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35c0050d0 con 0x562a3baf6470 2024-03-30T13:15:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.636+0000 7fc35a000640 1 -- 172.21.15.44:0/1267788047 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35c005480 con 0x562a3baf6470 2024-03-30T13:15:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.637+0000 7fc373199740 1 -- 172.21.15.44:0/1267788047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 msgr2=0x562a3bb1cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.637+0000 7fc373199740 1 --2- 172.21.15.44:0/1267788047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 0x562a3bb1cfa0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0015c0 tx=0x7fc35c001a80 comp rx=0 tx=0).stop 2024-03-30T13:15:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.637+0000 7fc373199740 1 -- 172.21.15.44:0/1267788047 shutdown_connections 2024-03-30T13:15:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.637+0000 7fc373199740 1 --2- 172.21.15.44:0/1267788047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6850 0x562a3baf59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.637+0000 7fc373199740 1 --2- 172.21.15.44:0/1267788047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3bb1d4e0 0x562a3baf54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.637+0000 7fc373199740 1 --2- 172.21.15.44:0/1267788047 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 0x562a3bb1cfa0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.637+0000 7fc373199740 1 -- 172.21.15.44:0/1267788047 >> 172.21.15.44:0/1267788047 conn(0x562a3babcbe0 msgr2=0x562a3bb3b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.637+0000 7fc373199740 1 -- 172.21.15.44:0/1267788047 shutdown_connections 2024-03-30T13:15:25.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.637+0000 7fc373199740 1 -- 172.21.15.44:0/1267788047 wait complete. 2024-03-30T13:15:25.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.638+0000 7fc373199740 1 -- start start 2024-03-30T13:15:25.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.638+0000 7fc373199740 1 Processor -- start 2024-03-30T13:15:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.639+0000 7fc373199740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6470 0x562a3bb1c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.639+0000 7fc373199740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6850 0x562a3bb212e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.639+0000 7fc373199740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 0x562a3bb22a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.639+0000 7fc373199740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562a3bb1cb10 con 0x562a3bb1c590 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.639+0000 7fc373199740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562a3ba149d0 con 0x562a3baf6850 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.639+0000 7fc373199740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x562a3bb15890 con 0x562a3baf6470 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.639+0000 7fc373199740 10 client.0 _ll_register_callbacks cb 0x562a3ba50fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.640+0000 7fc36e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 0x562a3bb22a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.640+0000 7fc36e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 0x562a3bb22a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52022/0 (socket says 172.21.15.44:52022) 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.640+0000 7fc36e400640 1 -- 172.21.15.44:0/4221132572 learned_addr learned my addr 172.21.15.44:0/4221132572 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.640+0000 7fc36d000640 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6850 0x562a3bb212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.640+0000 7fc36da00640 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6470 0x562a3bb1c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.640+0000 7fc36e400640 1 -- 172.21.15.44:0/4221132572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6470 msgr2=0x562a3bb1c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.640+0000 7fc36e400640 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6470 0x562a3bb1c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.640+0000 7fc36e400640 1 -- 172.21.15.44:0/4221132572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6850 msgr2=0x562a3bb212e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.640+0000 7fc36e400640 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6850 0x562a3bb212e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.640+0000 7fc36e400640 1 -- 172.21.15.44:0/4221132572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a3b72d210 con 0x562a3bb1c590 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.640+0000 7fc36e400640 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 0x562a3bb22a10 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc360062790 tx=0x7fc36005a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198e139d171b5e3f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.641+0000 7fc34ea00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.641+0000 7fc34ea00640 1 -- 172.21.15.44:0/4221132572 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360062cc0 con 0x562a3bb1c590 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.641+0000 7fc34ea00640 1 -- 172.21.15.44:0/4221132572 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc36008c0c0 con 0x562a3bb1c590 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.641+0000 7fc373199740 1 -- 172.21.15.44:0/4221132572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc35c0050d0 con 0x562a3bb1c590 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.641+0000 7fc34ea00640 1 -- 172.21.15.44:0/4221132572 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc36008ab50 con 0x562a3bb1c590 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.641+0000 7fc373199740 10 client.6120 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.641+0000 7fc373199740 1 -- 172.21.15.44:0/4221132572 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x562a3b89a0b0 con 0x562a3bb1c590 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.641+0000 7fc34ea00640 1 -- 172.21.15.44:0/4221132572 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35c0050d0 con 0x562a3bb1c590 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.641+0000 7fc34ea00640 1 -- 172.21.15.44:0/4221132572 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc3600594a0 con 0x562a3bb1c590 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.641+0000 7fc373199740 10 client.6120 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.641+0000 7fc373199740 10 client.6120 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.641+0000 7fc373199740 20 client.6120 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:25.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.642+0000 7fc373199740 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562a3bb55b50 0x562a3bb57f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.642+0000 7fc373199740 4 client.6120 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:25.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.642+0000 7fc373199740 1 -- 172.21.15.44:0/4221132572 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a3ba66870 con 0x562a3bb55b50 2024-03-30T13:15:25.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.642+0000 7fc36da00640 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562a3bb55b50 0x562a3bb57f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.642+0000 7fc36da00640 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562a3bb55b50 0x562a3bb57f40 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b2650c274a2386 server_cookie=29453657d8d1296c in_seq=0 out_seq=0 2024-03-30T13:15:25.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.642+0000 7fc34ea00640 10 client.6120 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.643+0000 7fc34ea00640 1 -- 172.21.15.44:0/4221132572 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x562a3ba66870 con 0x562a3bb55b50 2024-03-30T13:15:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.643+0000 7fc34ea00640 10 client.6120 handle_command_reply: tid=0 2024-03-30T13:15:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.643+0000 7fc373199740 1 client.6120 shutdown 2024-03-30T13:15:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.643+0000 7fc373199740 1 -- 172.21.15.44:0/4221132572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 msgr2=0x562a3bb22a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.643+0000 7fc373199740 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 0x562a3bb22a10 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc360062790 tx=0x7fc36005a890 comp rx=0 tx=0).stop 2024-03-30T13:15:25.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.643+0000 7fc373199740 1 -- 172.21.15.44:0/4221132572 shutdown_connections 2024-03-30T13:15:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.643+0000 7fc373199740 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562a3bb55b50 0x562a3bb57f40 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.643+0000 7fc373199740 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 0x562a3bb22a10 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.643+0000 7fc373199740 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6850 0x562a3bb212e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.643+0000 7fc373199740 1 --2- 172.21.15.44:0/4221132572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6470 0x562a3bb1c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.643+0000 7fc34ea00640 0 client.6120 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.644+0000 7fc373199740 1 -- 172.21.15.44:0/4221132572 >> 172.21.15.44:0/4221132572 conn(0x562a3babcbe0 msgr2=0x562a3baefb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.644+0000 7fc373199740 1 -- 172.21.15.44:0/4221132572 shutdown_connections 2024-03-30T13:15:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.644+0000 7fc373199740 1 -- 172.21.15.44:0/4221132572 wait complete. 2024-03-30T13:15:25.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.644+0000 7fc373199740 20 client.6120 trim_cache size 0 max 16384 2024-03-30T13:15:25.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.661+0000 7fc373199740 1 Processor -- start 2024-03-30T13:15:25.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.661+0000 7fc373199740 1 -- start start 2024-03-30T13:15:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.661+0000 7fc373199740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6470 0x562a3bb37a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.661+0000 7fc373199740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6850 0x562a3bbb1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc373199740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 0x562a3bbb1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc373199740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc368200fe0 con 0x562a3bb1c590 2024-03-30T13:15:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc373199740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc368200080 con 0x562a3baf6470 2024-03-30T13:15:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc373199740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc368149af0 con 0x562a3baf6850 2024-03-30T13:15:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc36e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 0x562a3bbb1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc36e400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 0x562a3bbb1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52038/0 (socket says 172.21.15.44:52038) 2024-03-30T13:15:25.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc36e400640 1 -- 172.21.15.44:0/2301217723 learned_addr learned my addr 172.21.15.44:0/2301217723 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc36e400640 1 -- 172.21.15.44:0/2301217723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6850 msgr2=0x562a3bbb1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc36da00640 1 --2- 172.21.15.44:0/2301217723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6470 0x562a3bb37a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc36e400640 1 --2- 172.21.15.44:0/2301217723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6850 0x562a3bbb1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc36e400640 1 -- 172.21.15.44:0/2301217723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6470 msgr2=0x562a3bb37a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc36e400640 1 --2- 172.21.15.44:0/2301217723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6470 0x562a3bb37a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc36e400640 1 -- 172.21.15.44:0/2301217723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a3b7062d0 con 0x562a3bb1c590 2024-03-30T13:15:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.662+0000 7fc36da00640 1 --2- 172.21.15.44:0/2301217723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6470 0x562a3bb37a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.663+0000 7fc36e400640 1 --2- 172.21.15.44:0/2301217723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 0x562a3bbb1a50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc36000d010 tx=0x7fc360071000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fce4a6421ecb1b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.663+0000 7fc359600640 1 -- 172.21.15.44:0/2301217723 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36008c0c0 con 0x562a3bb1c590 2024-03-30T13:15:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.663+0000 7fc359600640 1 -- 172.21.15.44:0/2301217723 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3600594a0 con 0x562a3bb1c590 2024-03-30T13:15:25.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.663+0000 7fc359600640 1 -- 172.21.15.44:0/2301217723 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36008a340 con 0x562a3bb1c590 2024-03-30T13:15:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.664+0000 7fc373199740 1 -- 172.21.15.44:0/2301217723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 msgr2=0x562a3bbb1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.664+0000 7fc373199740 1 --2- 172.21.15.44:0/2301217723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 0x562a3bbb1a50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc36000d010 tx=0x7fc360071000 comp rx=0 tx=0).stop 2024-03-30T13:15:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.664+0000 7fc373199740 1 -- 172.21.15.44:0/2301217723 shutdown_connections 2024-03-30T13:15:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.664+0000 7fc373199740 1 --2- 172.21.15.44:0/2301217723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3bb1c590 0x562a3bbb1a50 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.664+0000 7fc373199740 1 --2- 172.21.15.44:0/2301217723 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3baf6850 0x562a3bbb1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.664+0000 7fc373199740 1 --2- 172.21.15.44:0/2301217723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6470 0x562a3bb37a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.664+0000 7fc373199740 1 -- 172.21.15.44:0/2301217723 >> 172.21.15.44:0/2301217723 conn(0x562a3babcbe0 msgr2=0x562a3bb1be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.664+0000 7fc373199740 1 -- 172.21.15.44:0/2301217723 shutdown_connections 2024-03-30T13:15:25.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.664+0000 7fc373199740 1 -- 172.21.15.44:0/2301217723 wait complete. 2024-03-30T13:15:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.664+0000 7fc373199740 1 -- start start 2024-03-30T13:15:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.665+0000 7fc373199740 1 Processor -- start 2024-03-30T13:15:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc373199740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 0x562a3bbb0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc373199740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6850 0x562a3bb3aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc373199740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3bb1c590 0x562a3bb35b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc373199740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc3681ffa30 con 0x562a3baf6470 2024-03-30T13:15:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc373199740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562a3bb5cbf0 con 0x562a3baf6850 2024-03-30T13:15:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc373199740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x562a3bb30e50 con 0x562a3bb1c590 2024-03-30T13:15:25.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc373199740 10 client.0 _ll_register_callbacks cb 0x7fc360009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc36da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 0x562a3bbb0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc36da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 0x562a3bbb0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52046/0 (socket says 172.21.15.44:52046) 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc36da00640 1 -- 172.21.15.44:0/1372156359 learned_addr learned my addr 172.21.15.44:0/1372156359 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc36da00640 1 -- 172.21.15.44:0/1372156359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3bb1c590 msgr2=0x562a3bb35b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc36da00640 1 --2- 172.21.15.44:0/1372156359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3bb1c590 0x562a3bb35b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc36da00640 1 -- 172.21.15.44:0/1372156359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6850 msgr2=0x562a3bb3aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc36da00640 1 --2- 172.21.15.44:0/1372156359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6850 0x562a3bb3aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.666+0000 7fc36da00640 1 -- 172.21.15.44:0/1372156359 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a3bbb0e30 con 0x562a3baf6470 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.667+0000 7fc36da00640 1 --2- 172.21.15.44:0/1372156359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 0x562a3bbb0170 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009010 tx=0x7fc35c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac4d440b5835d5f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.667+0000 7fc34ea00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.667+0000 7fc34ea00640 1 -- 172.21.15.44:0/1372156359 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35c019040 con 0x562a3baf6470 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.667+0000 7fc34ea00640 1 -- 172.21.15.44:0/1372156359 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fc35c005070 con 0x562a3baf6470 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.667+0000 7fc373199740 1 -- 172.21.15.44:0/1372156359 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3600594a0 con 0x562a3baf6470 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.667+0000 7fc34ea00640 1 -- 172.21.15.44:0/1372156359 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc35c030050 con 0x562a3baf6470 2024-03-30T13:15:25.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.667+0000 7fc373199740 10 client.6126 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:25.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.667+0000 7fc373199740 1 -- 172.21.15.44:0/1372156359 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x562a3bb4ac40 con 0x562a3baf6470 2024-03-30T13:15:25.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.667+0000 7fc34ea00640 1 -- 172.21.15.44:0/1372156359 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3600594a0 con 0x562a3baf6470 2024-03-30T13:15:25.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.667+0000 7fc34ea00640 1 -- 172.21.15.44:0/1372156359 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc35c033020 con 0x562a3baf6470 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.668+0000 7fc373199740 10 client.6126 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.668+0000 7fc373199740 10 client.6126 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.668+0000 7fc373199740 20 client.6126 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.668+0000 7fc373199740 1 --2- 172.21.15.44:0/1372156359 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562a3bb360a0 0x562a3bb32390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.668+0000 7fc373199740 4 client.6126 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628359}] 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.668+0000 7fc373199740 1 -- 172.21.15.44:0/1372156359 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628359}) -- 0x562a3ba60bc0 con 0x562a3bb360a0 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.668+0000 7fc36d000640 1 --2- 172.21.15.44:0/1372156359 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562a3bb360a0 0x562a3bb32390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.668+0000 7fc36d000640 1 --2- 172.21.15.44:0/1372156359 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562a3bb360a0 0x562a3bb32390 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d88d95b08c8a0523 server_cookie=24a128748e49f80c in_seq=0 out_seq=0 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.668+0000 7fc34ea00640 10 client.6126 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc34ea00640 1 -- 172.21.15.44:0/1372156359 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4753 (crc 0 0 0) 0x562a3ba60bc0 con 0x562a3bb360a0 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc34ea00640 10 client.6126 handle_command_reply: tid=0 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc373199740 1 client.6126 shutdown 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc373199740 1 -- 172.21.15.44:0/1372156359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 msgr2=0x562a3bbb0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc373199740 1 --2- 172.21.15.44:0/1372156359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 0x562a3bbb0170 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009010 tx=0x7fc35c000bc0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc373199740 1 -- 172.21.15.44:0/1372156359 shutdown_connections 2024-03-30T13:15:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc373199740 1 --2- 172.21.15.44:0/1372156359 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562a3bb360a0 0x562a3bb32390 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc373199740 1 --2- 172.21.15.44:0/1372156359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562a3bb1c590 0x562a3bb35b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc373199740 1 --2- 172.21.15.44:0/1372156359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a3baf6850 0x562a3bb3aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc373199740 1 --2- 172.21.15.44:0/1372156359 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562a3baf6470 0x562a3bbb0170 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc34ea00640 0 client.6126 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc373199740 1 -- 172.21.15.44:0/1372156359 >> 172.21.15.44:0/1372156359 conn(0x562a3babcbe0 msgr2=0x562a3bb23c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc373199740 1 -- 172.21.15.44:0/1372156359 shutdown_connections 2024-03-30T13:15:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc373199740 1 -- 172.21.15.44:0/1372156359 wait complete. 2024-03-30T13:15:25.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.669+0000 7fc373199740 20 client.6126 trim_cache size 0 max 16384 2024-03-30T13:15:25.677 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ceph/Makefile", 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628359, 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.476362+0000", 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.431535+0000", 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:25.678 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 356, 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:25.679 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.431535+0000", 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:25.680 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 356, 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:25.681 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.476362+0000" 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 356, 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.476362+0000" 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 240, 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 4, 2024-03-30T13:15:25.682 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:25.683 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:25.684 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:25.685 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.686 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:25.687 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.688 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:25.689 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:25.690 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:25.691 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:25.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.670+0000 7fc36ee00640 1 -- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc34806c560 msgr2=0x7fc34806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.670+0000 7fc36ee00640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc34806c560 0x7fc34806ea20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc354036000 tx=0x7fc354030000 comp rx=0 tx=0).stop 2024-03-30T13:15:25.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.670+0000 7fc36ee00640 1 -- 172.21.15.44:0/1605850928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc36815c040 msgr2=0x7fc368149e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.670+0000 7fc36ee00640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc36815c040 0x7fc368149e60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc360009d30 tx=0x7fc36000c490 comp rx=0 tx=0).stop 2024-03-30T13:15:25.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.670+0000 7fc36ee00640 1 -- 172.21.15.44:0/1605850928 shutdown_connections 2024-03-30T13:15:25.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.670+0000 7fc36ee00640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc36815c040 0x7fc368149e60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.670+0000 7fc36ee00640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc34806c560 0x7fc34806ea20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.670+0000 7fc36ee00640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3680d46b0 0x7fc368161360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.670+0000 7fc36ee00640 1 --2- 172.21.15.44:0/1605850928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3680d18f0 0x7fc368160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.670+0000 7fc36ee00640 1 -- 172.21.15.44:0/1605850928 >> 172.21.15.44:0/1605850928 conn(0x7fc36808dbf0 msgr2=0x7fc3680b61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.670+0000 7fc36ee00640 1 -- 172.21.15.44:0/1605850928 shutdown_connections 2024-03-30T13:15:25.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.671+0000 7fc36ee00640 1 -- 172.21.15.44:0/1605850928 wait complete. 2024-03-30T13:15:25.694 DEBUG:tasks.cephfs.test_uninlining:getting inode info #3 of 23:1099511628365 2024-03-30T13:15:25.694 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628365 2024-03-30T13:15:25.694 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628365 2024-03-30T13:15:25.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.883+0000 7fb53be00640 1 Processor -- start 2024-03-30T13:15:25.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.883+0000 7fb53be00640 1 -- start start 2024-03-30T13:15:25.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.884+0000 7fb53be00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb53c15c040 0x7fb53c15f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.885+0000 7fb53be00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb53c0d4880 0x7fb53c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.885+0000 7fb53be00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb53c0d32b0 con 0x7fb53c0d18f0 2024-03-30T13:15:25.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.885+0000 7fb53be00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb53c0d2210 con 0x7fb53c0d4880 2024-03-30T13:15:25.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.885+0000 7fb53be00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fb53c0d24f0 con 0x7fb53c15c040 2024-03-30T13:15:25.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.885+0000 7fb53b400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb53c0d4880 0x7fb53c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.885+0000 7fb533e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb53c0d18f0 0x7fb53c0d4170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49254/0 (socket says 172.21.15.44:49254) 2024-03-30T13:15:25.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.885+0000 7fb533e00640 1 -- 172.21.15.44:0/1326073591 learned_addr learned my addr 172.21.15.44:0/1326073591 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:25.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.885+0000 7fb53aa00640 1 --2- 172.21.15.44:0/1326073591 >> v2:172.21.15.151:3300/0 conn(0x7fb53c15c040 0x7fb53c15f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.885+0000 7fb53b400640 1 -- 172.21.15.44:0/1326073591 >> v2:172.21.15.151:3300/0 conn(0x7fb53c15c040 msgr2=0x7fb53c15f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.885+0000 7fb53b400640 1 --2- 172.21.15.44:0/1326073591 >> v2:172.21.15.151:3300/0 conn(0x7fb53c15c040 0x7fb53c15f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.885+0000 7fb53b400640 1 -- 172.21.15.44:0/1326073591 >> v1:172.21.15.44:6789/0 conn(0x7fb53c0d18f0 legacy=0x7fb53c0d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.885+0000 7fb53b400640 1 -- 172.21.15.44:0/1326073591 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53c0d27d0 con 0x7fb53c0d4880 2024-03-30T13:15:25.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.886+0000 7fb53aa00640 1 --2- 172.21.15.44:0/1326073591 >> v2:172.21.15.151:3300/0 conn(0x7fb53c15c040 0x7fb53c15f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:25.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.887+0000 7fb53b400640 1 --2- 172.21.15.44:0/1326073591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb53c0d4880 0x7fb53c0b4f10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb534009d90 tx=0x7fb53402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a40776e93e1c46 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.887+0000 7fb53a000640 1 -- 172.21.15.44:0/1326073591 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534039070 con 0x7fb53c0d4880 2024-03-30T13:15:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.887+0000 7fb53a000640 1 -- 172.21.15.44:0/1326073591 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53402cbd0 con 0x7fb53c0d4880 2024-03-30T13:15:25.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.887+0000 7fb53a000640 1 -- 172.21.15.44:0/1326073591 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534034440 con 0x7fb53c0d4880 2024-03-30T13:15:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.888+0000 7fb53be00640 1 -- 172.21.15.44:0/1326073591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb53c0d4880 msgr2=0x7fb53c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.888+0000 7fb53be00640 1 --2- 172.21.15.44:0/1326073591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb53c0d4880 0x7fb53c0b4f10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb534009d90 tx=0x7fb53402be20 comp rx=0 tx=0).stop 2024-03-30T13:15:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.888+0000 7fb53be00640 1 -- 172.21.15.44:0/1326073591 shutdown_connections 2024-03-30T13:15:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.888+0000 7fb53be00640 1 --2- 172.21.15.44:0/1326073591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb53c0d4880 0x7fb53c0b4f10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.888+0000 7fb53be00640 1 --2- 172.21.15.44:0/1326073591 >> v2:172.21.15.151:3300/0 conn(0x7fb53c15c040 0x7fb53c15f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.888+0000 7fb53be00640 1 -- 172.21.15.44:0/1326073591 >> 172.21.15.44:0/1326073591 conn(0x7fb53c08dbf0 msgr2=0x7fb53c09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.888+0000 7fb53be00640 1 -- 172.21.15.44:0/1326073591 shutdown_connections 2024-03-30T13:15:25.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.888+0000 7fb53be00640 1 -- 172.21.15.44:0/1326073591 wait complete. 2024-03-30T13:15:25.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.890+0000 7fb53be00640 1 Processor -- start 2024-03-30T13:15:25.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.890+0000 7fb53be00640 1 -- start start 2024-03-30T13:15:25.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb53be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb53c0d18f0 0x7fb53c0b9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb53be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb53c0d4880 0x7fb53c0c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb53be00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb53c15c040 0x7fb53c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb53be00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c15c420 con 0x7fb53c0d4880 2024-03-30T13:15:25.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb53be00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c0d2d90 con 0x7fb53c0d18f0 2024-03-30T13:15:25.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb53be00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb53c15f8a0 con 0x7fb53c15c040 2024-03-30T13:15:25.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb533e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb53c0d4880 0x7fb53c0c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb533e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb53c0d4880 0x7fb53c0c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52062/0 (socket says 172.21.15.44:52062) 2024-03-30T13:15:25.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb533e00640 1 -- 172.21.15.44:0/866306086 learned_addr learned my addr 172.21.15.44:0/866306086 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb53aa00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb53c0d18f0 0x7fb53c0b9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb53b400640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb53c15c040 0x7fb53c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb533e00640 1 -- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb53c15c040 msgr2=0x7fb53c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb533e00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb53c15c040 0x7fb53c0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb533e00640 1 -- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb53c0d18f0 msgr2=0x7fb53c0b9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb533e00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb53c0d18f0 0x7fb53c0b9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.891+0000 7fb533e00640 1 -- 172.21.15.44:0/866306086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53c0cc3b0 con 0x7fb53c0d4880 2024-03-30T13:15:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.892+0000 7fb53b400640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb53c15c040 0x7fb53c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.892+0000 7fb533e00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb53c0d4880 0x7fb53c0c8510 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb52400c3c0 tx=0x7fb52400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.892+0000 7fb532a00640 1 -- 172.21.15.44:0/866306086 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524017070 con 0x7fb53c0d4880 2024-03-30T13:15:25.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.892+0000 7fb532a00640 1 -- 172.21.15.44:0/866306086 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb524005ce0 con 0x7fb53c0d4880 2024-03-30T13:15:25.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.892+0000 7fb532a00640 1 -- 172.21.15.44:0/866306086 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5240072f0 con 0x7fb53c0d4880 2024-03-30T13:15:25.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.892+0000 7fb53be00640 1 -- 172.21.15.44:0/866306086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53c0cc650 con 0x7fb53c0d4880 2024-03-30T13:15:25.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.892+0000 7fb53be00640 1 -- 172.21.15.44:0/866306086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb53c0c7a30 con 0x7fb53c0d4880 2024-03-30T13:15:25.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.895+0000 7fb532a00640 1 -- 172.21.15.44:0/866306086 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb52401a070 con 0x7fb53c0d4880 2024-03-30T13:15:25.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.895+0000 7fb532a00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb51806c530 0x7fb51806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.896+0000 7fb532a00640 1 -- 172.21.15.44:0/866306086 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fb52408ac70 con 0x7fb53c0d4880 2024-03-30T13:15:25.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.896+0000 7fb53aa00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb51806c530 0x7fb51806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.897+0000 7fb5443ff740 1 Processor -- start 2024-03-30T13:15:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.897+0000 7fb5443ff740 1 -- start start 2024-03-30T13:15:25.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.897+0000 7fb53aa00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb51806c530 0x7fb51806e9f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00a990 tx=0x7fb52c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.898+0000 7fb5443ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261af7470 0x55d261b1dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.898+0000 7fb5443ff740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b1e4e0 0x55d261af64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.898+0000 7fb5443ff740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7850 0x55d261af69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.898+0000 7fb5443ff740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d261a5a330 con 0x55d261b1e4e0 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.898+0000 7fb5443ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d261a02620 con 0x55d261af7470 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.898+0000 7fb5443ff740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55d261a56440 con 0x55d261af7850 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.898+0000 7fb533e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b1e4e0 0x55d261af64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.898+0000 7fb533e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b1e4e0 0x55d261af64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52078/0 (socket says 172.21.15.44:52078) 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.898+0000 7fb533e00640 1 -- 172.21.15.44:0/1490045133 learned_addr learned my addr 172.21.15.44:0/1490045133 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.899+0000 7fb53b400640 1 --2- 172.21.15.44:0/1490045133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7850 0x55d261af69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.899+0000 7fb53aa00640 1 --2- 172.21.15.44:0/1490045133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261af7470 0x55d261b1dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.899+0000 7fb533e00640 1 -- 172.21.15.44:0/1490045133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7850 msgr2=0x55d261af69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.899+0000 7fb533e00640 1 --2- 172.21.15.44:0/1490045133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7850 0x55d261af69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.899+0000 7fb533e00640 1 -- 172.21.15.44:0/1490045133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261af7470 msgr2=0x55d261b1dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.899+0000 7fb533e00640 1 --2- 172.21.15.44:0/1490045133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261af7470 0x55d261b1dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.899+0000 7fb533e00640 1 -- 172.21.15.44:0/1490045133 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d26183a920 con 0x55d261b1e4e0 2024-03-30T13:15:25.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.899+0000 7fb53aa00640 1 --2- 172.21.15.44:0/1490045133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261af7470 0x55d261b1dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:25.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.899+0000 7fb53b400640 1 --2- 172.21.15.44:0/1490045133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7850 0x55d261af69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:25.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.899+0000 7fb533e00640 1 --2- 172.21.15.44:0/1490045133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b1e4e0 0x55d261af64b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb5240070a0 tx=0x7fb524058940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619d760acaed2ae8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.899+0000 7fb52b000640 1 -- 172.21.15.44:0/1490045133 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524056c40 con 0x55d261b1e4e0 2024-03-30T13:15:25.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.900+0000 7fb52b000640 1 -- 172.21.15.44:0/1490045133 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb524054fb0 con 0x55d261b1e4e0 2024-03-30T13:15:25.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.900+0000 7fb52b000640 1 -- 172.21.15.44:0/1490045133 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524007490 con 0x55d261b1e4e0 2024-03-30T13:15:25.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.900+0000 7fb5443ff740 1 -- 172.21.15.44:0/1490045133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b1e4e0 msgr2=0x55d261af64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.900+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1490045133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b1e4e0 0x55d261af64b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb5240070a0 tx=0x7fb524058940 comp rx=0 tx=0).stop 2024-03-30T13:15:25.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.900+0000 7fb5443ff740 1 -- 172.21.15.44:0/1490045133 shutdown_connections 2024-03-30T13:15:25.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.900+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1490045133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7850 0x55d261af69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.900+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1490045133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b1e4e0 0x55d261af64b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.900+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1490045133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261af7470 0x55d261b1dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.900+0000 7fb5443ff740 1 -- 172.21.15.44:0/1490045133 >> 172.21.15.44:0/1490045133 conn(0x55d261abdbe0 msgr2=0x55d261b3c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.900+0000 7fb5443ff740 1 -- 172.21.15.44:0/1490045133 shutdown_connections 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.900+0000 7fb5443ff740 1 -- 172.21.15.44:0/1490045133 wait complete. 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.901+0000 7fb5443ff740 1 -- start start 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.901+0000 7fb5443ff740 1 Processor -- start 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.902+0000 7fb5443ff740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7470 0x55d261b15a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.902+0000 7fb5443ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261af7850 0x55d261b23ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.902+0000 7fb5443ff740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b39120 0x55d261b24020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.902+0000 7fb5443ff740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d261a5a330 con 0x55d261b39120 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.902+0000 7fb5443ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d261a159d0 con 0x55d261af7850 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.902+0000 7fb5443ff740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55d261b1db10 con 0x55d261af7470 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.902+0000 7fb5443ff740 10 client.0 _ll_register_callbacks cb 0x55d261a51fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.903+0000 7fb53b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b39120 0x55d261b24020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.903+0000 7fb53b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b39120 0x55d261b24020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52090/0 (socket says 172.21.15.44:52090) 2024-03-30T13:15:25.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.903+0000 7fb53b400640 1 -- 172.21.15.44:0/2683394462 learned_addr learned my addr 172.21.15.44:0/2683394462 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.903+0000 7fb533e00640 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261af7850 0x55d261b23ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.903+0000 7fb53aa00640 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7470 0x55d261b15a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.903+0000 7fb53b400640 1 -- 172.21.15.44:0/2683394462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7470 msgr2=0x55d261b15a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.903+0000 7fb53b400640 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7470 0x55d261b15a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.903+0000 7fb53b400640 1 -- 172.21.15.44:0/2683394462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261af7850 msgr2=0x55d261b23ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.903+0000 7fb53b400640 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261af7850 0x55d261b23ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.903+0000 7fb53b400640 1 -- 172.21.15.44:0/2683394462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d26172e210 con 0x55d261b39120 2024-03-30T13:15:25.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.904+0000 7fb53b400640 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b39120 0x55d261b24020 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb534037040 tx=0x7fb534004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c28e326d045fe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.904+0000 7fb51f400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:25.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.904+0000 7fb51f400640 1 -- 172.21.15.44:0/2683394462 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534044070 con 0x55d261b39120 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.904+0000 7fb51f400640 1 -- 172.21.15.44:0/2683394462 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fb534034af0 con 0x55d261b39120 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.904+0000 7fb5443ff740 1 -- 172.21.15.44:0/2683394462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb524054fb0 con 0x55d261b39120 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.904+0000 7fb51f400640 1 -- 172.21.15.44:0/2683394462 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb534039040 con 0x55d261b39120 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.904+0000 7fb5443ff740 10 client.6141 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.904+0000 7fb5443ff740 1 -- 172.21.15.44:0/2683394462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55d26189b0b0 con 0x55d261b39120 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.905+0000 7fb51f400640 1 -- 172.21.15.44:0/2683394462 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb524054fb0 con 0x55d261b39120 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.905+0000 7fb51f400640 1 -- 172.21.15.44:0/2683394462 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fb534052020 con 0x55d261b39120 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.905+0000 7fb5443ff740 10 client.6141 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.905+0000 7fb5443ff740 10 client.6141 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.905+0000 7fb5443ff740 20 client.6141 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.905+0000 7fb5443ff740 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55d261b227b0 0x55d261b22bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.905+0000 7fb5443ff740 4 client.6141 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:25.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.905+0000 7fb5443ff740 1 -- 172.21.15.44:0/2683394462 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d261a67870 con 0x55d261b227b0 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.905+0000 7fb53aa00640 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55d261b227b0 0x55d261b22bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.906+0000 7fb53aa00640 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55d261b227b0 0x55d261b22bc0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5c71388ca8d3631 server_cookie=eb762bc9089446c3 in_seq=0 out_seq=0 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.906+0000 7fb51f400640 10 client.6141 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.906+0000 7fb51f400640 1 -- 172.21.15.44:0/2683394462 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55d261a67870 con 0x55d261b227b0 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.906+0000 7fb51f400640 10 client.6141 handle_command_reply: tid=0 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.906+0000 7fb5443ff740 1 client.6141 shutdown 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.907+0000 7fb5443ff740 1 -- 172.21.15.44:0/2683394462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b39120 msgr2=0x55d261b24020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.907+0000 7fb5443ff740 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b39120 0x55d261b24020 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb534037040 tx=0x7fb534004ab0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.907+0000 7fb5443ff740 1 -- 172.21.15.44:0/2683394462 shutdown_connections 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.907+0000 7fb5443ff740 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55d261b227b0 0x55d261b22bc0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.907+0000 7fb5443ff740 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261b39120 0x55d261b24020 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.907+0000 7fb5443ff740 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261af7850 0x55d261b23ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.907+0000 7fb5443ff740 1 --2- 172.21.15.44:0/2683394462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7470 0x55d261b15a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.907+0000 7fb5443ff740 1 -- 172.21.15.44:0/2683394462 >> 172.21.15.44:0/2683394462 conn(0x55d261abdbe0 msgr2=0x55d261af0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.907+0000 7fb51f400640 0 client.6141 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.907+0000 7fb5443ff740 1 -- 172.21.15.44:0/2683394462 shutdown_connections 2024-03-30T13:15:25.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.907+0000 7fb5443ff740 1 -- 172.21.15.44:0/2683394462 wait complete. 2024-03-30T13:15:25.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.907+0000 7fb5443ff740 20 client.6141 trim_cache size 0 max 16384 2024-03-30T13:15:25.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.923+0000 7fb5443ff740 1 Processor -- start 2024-03-30T13:15:25.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.923+0000 7fb5443ff740 1 -- start start 2024-03-30T13:15:25.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.924+0000 7fb5443ff740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7470 0x55d261af05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.924+0000 7fb5443ff740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7850 0x55d261b551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.924+0000 7fb5443ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261b39120 0x55d261b55720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.924+0000 7fb5443ff740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c201180 con 0x55d261af7470 2024-03-30T13:15:25.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.924+0000 7fb5443ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c2001a0 con 0x55d261b39120 2024-03-30T13:15:25.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.924+0000 7fb5443ff740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb53c1f89e0 con 0x55d261af7850 2024-03-30T13:15:25.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.925+0000 7fb53aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7470 0x55d261af05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.925+0000 7fb53aa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7470 0x55d261af05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52094/0 (socket says 172.21.15.44:52094) 2024-03-30T13:15:25.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.925+0000 7fb53aa00640 1 -- 172.21.15.44:0/1555249113 learned_addr learned my addr 172.21.15.44:0/1555249113 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.925+0000 7fb53b400640 1 --2- 172.21.15.44:0/1555249113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261b39120 0x55d261b55720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.925+0000 7fb53aa00640 1 -- 172.21.15.44:0/1555249113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7850 msgr2=0x55d261b551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.925+0000 7fb53aa00640 1 --2- 172.21.15.44:0/1555249113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7850 0x55d261b551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.925+0000 7fb53aa00640 1 -- 172.21.15.44:0/1555249113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261b39120 msgr2=0x55d261b55720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.925+0000 7fb53aa00640 1 --2- 172.21.15.44:0/1555249113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261b39120 0x55d261b55720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.925+0000 7fb53aa00640 1 -- 172.21.15.44:0/1555249113 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2617072d0 con 0x55d261af7470 2024-03-30T13:15:25.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.925+0000 7fb53aa00640 1 --2- 172.21.15.44:0/1555249113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7470 0x55d261af05e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x55d261b1f140 tx=0x7fb52c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c457b57ba58b9e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.926+0000 7fb52a600640 1 -- 172.21.15.44:0/1555249113 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52c02e070 con 0x55d261af7470 2024-03-30T13:15:25.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.926+0000 7fb52a600640 1 -- 172.21.15.44:0/1555249113 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb52c00fd80 con 0x55d261af7470 2024-03-30T13:15:25.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.926+0000 7fb52a600640 1 -- 172.21.15.44:0/1555249113 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52c014b30 con 0x55d261af7470 2024-03-30T13:15:25.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.926+0000 7fb5443ff740 1 -- 172.21.15.44:0/1555249113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7470 msgr2=0x55d261af05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.926+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1555249113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7470 0x55d261af05e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x55d261b1f140 tx=0x7fb52c015000 comp rx=0 tx=0).stop 2024-03-30T13:15:25.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.927+0000 7fb5443ff740 1 -- 172.21.15.44:0/1555249113 shutdown_connections 2024-03-30T13:15:25.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.927+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1555249113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261b39120 0x55d261b55720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.927+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1555249113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7850 0x55d261b551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.927+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1555249113 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7470 0x55d261af05e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.927+0000 7fb5443ff740 1 -- 172.21.15.44:0/1555249113 >> 172.21.15.44:0/1555249113 conn(0x55d261abdbe0 msgr2=0x55d261b14e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.927+0000 7fb5443ff740 1 -- 172.21.15.44:0/1555249113 shutdown_connections 2024-03-30T13:15:25.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.927+0000 7fb5443ff740 1 -- 172.21.15.44:0/1555249113 wait complete. 2024-03-30T13:15:25.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.927+0000 7fb5443ff740 1 -- start start 2024-03-30T13:15:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.928+0000 7fb5443ff740 1 Processor -- start 2024-03-30T13:15:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb5443ff740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7470 0x55d261baaa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb5443ff740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7850 0x55d261bbc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb5443ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261b39120 0x55d261b23830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb5443ff740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d261a10fc0 con 0x55d261af7850 2024-03-30T13:15:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb5443ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb53c0c9e60 con 0x55d261b39120 2024-03-30T13:15:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb5443ff740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55d261b1da10 con 0x55d261af7470 2024-03-30T13:15:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb5443ff740 10 client.0 _ll_register_callbacks cb 0x7fb5340344f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb533e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7850 0x55d261bbc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb533e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7850 0x55d261bbc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52106/0 (socket says 172.21.15.44:52106) 2024-03-30T13:15:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb533e00640 1 -- 172.21.15.44:0/1263306022 learned_addr learned my addr 172.21.15.44:0/1263306022 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:25.936 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb53b400640 1 --2- 172.21.15.44:0/1263306022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261b39120 0x55d261b23830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb533e00640 1 -- 172.21.15.44:0/1263306022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7470 msgr2=0x55d261baaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb533e00640 1 --2- 172.21.15.44:0/1263306022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7470 0x55d261baaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb533e00640 1 -- 172.21.15.44:0/1263306022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261b39120 msgr2=0x55d261b23830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb533e00640 1 --2- 172.21.15.44:0/1263306022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261b39120 0x55d261b23830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.929+0000 7fb533e00640 1 -- 172.21.15.44:0/1263306022 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d261baaf70 con 0x55d261af7850 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.930+0000 7fb533e00640 1 --2- 172.21.15.44:0/1263306022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7850 0x55d261bbc2d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb52400cd80 tx=0x7fb524000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f38f8302d7afe63 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.930+0000 7fb51f400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.930+0000 7fb51f400640 1 -- 172.21.15.44:0/1263306022 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524007490 con 0x55d261af7850 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.930+0000 7fb51f400640 1 -- 172.21.15.44:0/1263306022 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7fb524007630 con 0x55d261af7850 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.930+0000 7fb5443ff740 1 -- 172.21.15.44:0/1263306022 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb52c00fd80 con 0x55d261af7850 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.930+0000 7fb51f400640 1 -- 172.21.15.44:0/1263306022 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb524057d90 con 0x55d261af7850 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.930+0000 7fb5443ff740 10 client.6147 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.930+0000 7fb5443ff740 1 -- 172.21.15.44:0/1263306022 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55d261bbbdb0 con 0x55d261af7850 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.930+0000 7fb51f400640 1 -- 172.21.15.44:0/1263306022 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb52c00fd80 con 0x55d261af7850 2024-03-30T13:15:25.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.930+0000 7fb51f400640 1 -- 172.21.15.44:0/1263306022 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fb524057f30 con 0x55d261af7850 2024-03-30T13:15:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.931+0000 7fb5443ff740 10 client.6147 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.931+0000 7fb5443ff740 10 client.6147 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.931+0000 7fb5443ff740 20 client.6147 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.931+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1263306022 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55d261b24aa0 0x55d261b23d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.931+0000 7fb5443ff740 4 client.6147 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628365}] 2024-03-30T13:15:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.931+0000 7fb5443ff740 1 -- 172.21.15.44:0/1263306022 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628365}) -- 0x55d261a61bc0 con 0x55d261b24aa0 2024-03-30T13:15:25.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.931+0000 7fb53aa00640 1 --2- 172.21.15.44:0/1263306022 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55d261b24aa0 0x55d261b23d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:25.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.931+0000 7fb53aa00640 1 --2- 172.21.15.44:0/1263306022 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55d261b24aa0 0x55d261b23d70 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1ab1f88cc9ca9fa server_cookie=6f21e1cbf6586335 in_seq=0 out_seq=0 2024-03-30T13:15:25.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.931+0000 7fb51f400640 10 client.6147 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:25.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb51f400640 1 -- 172.21.15.44:0/1263306022 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4757 (crc 0 0 0) 0x55d261a61bc0 con 0x55d261b24aa0 2024-03-30T13:15:25.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb51f400640 10 client.6147 handle_command_reply: tid=0 2024-03-30T13:15:25.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb5443ff740 1 client.6147 shutdown 2024-03-30T13:15:25.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb5443ff740 1 -- 172.21.15.44:0/1263306022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7850 msgr2=0x55d261bbc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1263306022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7850 0x55d261bbc2d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb52400cd80 tx=0x7fb524000bc0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb5443ff740 1 -- 172.21.15.44:0/1263306022 shutdown_connections 2024-03-30T13:15:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1263306022 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55d261b24aa0 0x55d261b23d70 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1263306022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261b39120 0x55d261b23830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1263306022 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d261af7850 0x55d261bbc2d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb5443ff740 1 --2- 172.21.15.44:0/1263306022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d261af7470 0x55d261baaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb51f400640 0 client.6147 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb5443ff740 1 -- 172.21.15.44:0/1263306022 >> 172.21.15.44:0/1263306022 conn(0x55d261abdbe0 msgr2=0x55d261b4b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb5443ff740 1 -- 172.21.15.44:0/1263306022 shutdown_connections 2024-03-30T13:15:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb5443ff740 1 -- 172.21.15.44:0/1263306022 wait complete. 2024-03-30T13:15:25.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.932+0000 7fb5443ff740 20 client.6147 trim_cache size 0 max 16384 2024-03-30T13:15:25.940 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ceph/ceph_frag.c", 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628365, 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.514435+0000", 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.444535+0000", 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:25.941 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 401, 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:25.942 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.444535+0000", 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:25.943 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:25.944 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 401, 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.514435+0000" 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 401, 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.514435+0000" 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 260, 2024-03-30T13:15:25.945 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 16, 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:25.946 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:25.947 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:25.948 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.949 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.950 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:25.951 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.952 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:25.953 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:25.954 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:25.955 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:25.955 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:25.955 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:25.955 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:25.955 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:25.955 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:25.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.933+0000 7fb53be00640 1 -- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb51806c530 msgr2=0x7fb51806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.933+0000 7fb53be00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb51806c530 0x7fb51806e9f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb52c00a990 tx=0x7fb52c008040 comp rx=0 tx=0).stop 2024-03-30T13:15:25.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.933+0000 7fb53be00640 1 -- 172.21.15.44:0/866306086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb53c0d4880 msgr2=0x7fb53c0c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:25.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.933+0000 7fb53be00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb53c0d4880 0x7fb53c0c8510 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb52400c3c0 tx=0x7fb52400c880 comp rx=0 tx=0).stop 2024-03-30T13:15:25.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.933+0000 7fb53be00640 1 -- 172.21.15.44:0/866306086 shutdown_connections 2024-03-30T13:15:25.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.933+0000 7fb53be00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb53c15c040 0x7fb53c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.933+0000 7fb53be00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb53c0d4880 0x7fb53c0c8510 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.933+0000 7fb53be00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb51806c530 0x7fb51806e9f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.933+0000 7fb53be00640 1 --2- 172.21.15.44:0/866306086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb53c0d18f0 0x7fb53c0b9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:25.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.933+0000 7fb53be00640 1 -- 172.21.15.44:0/866306086 >> 172.21.15.44:0/866306086 conn(0x7fb53c08dbf0 msgr2=0x7fb53c160fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:25.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.933+0000 7fb53be00640 1 -- 172.21.15.44:0/866306086 shutdown_connections 2024-03-30T13:15:25.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:25.933+0000 7fb53be00640 1 -- 172.21.15.44:0/866306086 wait complete. 2024-03-30T13:15:25.957 DEBUG:tasks.cephfs.test_uninlining:getting inode info #4 of 23:1099511628372 2024-03-30T13:15:25.957 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628372 2024-03-30T13:15:25.957 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628372 2024-03-30T13:15:26.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.166+0000 7f4ffc000640 1 Processor -- start 2024-03-30T13:15:26.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.167+0000 7f4ffc000640 1 -- start start 2024-03-30T13:15:26.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.168+0000 7f4ffc000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ff406d8f0 0x7f4ff415fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.168+0000 7f4ffc000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4ff41603d0 0x7f4ff40cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.168+0000 7f4ffc000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff40ce9c0 con 0x7f4ff413f0c0 2024-03-30T13:15:26.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.168+0000 7f4ffc000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f4ff4160e30 con 0x7f4ff41603d0 2024-03-30T13:15:26.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.168+0000 7f4ffc000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff4160b50 con 0x7f4ff406d8f0 2024-03-30T13:15:26.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.169+0000 7f4ffa000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4ff41603d0 0x7f4ff40cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.169+0000 7f4ffa000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4ff41603d0 0x7f4ff40cfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:58666/0 (socket says 172.21.15.44:58666) 2024-03-30T13:15:26.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.169+0000 7f4ffa000640 1 -- 172.21.15.44:0/3141457339 learned_addr learned my addr 172.21.15.44:0/3141457339 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.169+0000 7f4ff8c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ff406d8f0 0x7f4ff415fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.169+0000 7f4ff9600640 1 --1- 172.21.15.44:0/3141457339 >> v1:172.21.15.151:6789/0 conn(0x7f4ff413f0c0 0x7f4ff406d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:43060/0 (socket says 172.21.15.44:43060) 2024-03-30T13:15:26.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.170+0000 7f4ff3e00640 1 -- 172.21.15.44:0/3141457339 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180103821 0 0) 0x7f4fe8001110 con 0x7f4ff413f0c0 2024-03-30T13:15:26.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.170+0000 7f4ff3e00640 1 -- 172.21.15.44:0/3141457339 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fdc003520 con 0x7f4ff413f0c0 2024-03-30T13:15:26.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.170+0000 7f4ffa000640 1 -- 172.21.15.44:0/3141457339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ff406d8f0 msgr2=0x7f4ff415fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.170+0000 7f4ffa000640 1 --2- 172.21.15.44:0/3141457339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ff406d8f0 0x7f4ff415fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.170+0000 7f4ffa000640 1 -- 172.21.15.44:0/3141457339 >> v1:172.21.15.151:6789/0 conn(0x7f4ff413f0c0 legacy=0x7f4ff406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.170+0000 7f4ffa000640 1 -- 172.21.15.44:0/3141457339 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff413fa40 con 0x7f4ff41603d0 2024-03-30T13:15:26.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.170+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/3141457339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ff406d8f0 0x7f4ff415fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:15:26.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.171+0000 7f4ffa000640 1 --2- 172.21.15.44:0/3141457339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ff41603d0 0x7f4ff40cfbb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009e50 tx=0x7f4fec02be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eee5857801a8c3df server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.172+0000 7f4ff3e00640 1 -- 172.21.15.44:0/3141457339 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec02c9e0 con 0x7f4ff41603d0 2024-03-30T13:15:26.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.172+0000 7f4ff3e00640 1 -- 172.21.15.44:0/3141457339 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec02cb80 con 0x7f4ff41603d0 2024-03-30T13:15:26.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.172+0000 7f4ff3e00640 1 -- 172.21.15.44:0/3141457339 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0343f0 con 0x7f4ff41603d0 2024-03-30T13:15:26.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.172+0000 7f4ffc000640 1 -- 172.21.15.44:0/3141457339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ff41603d0 msgr2=0x7f4ff40cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.172+0000 7f4ffc000640 1 --2- 172.21.15.44:0/3141457339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ff41603d0 0x7f4ff40cfbb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009e50 tx=0x7f4fec02be40 comp rx=0 tx=0).stop 2024-03-30T13:15:26.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.172+0000 7f4ffc000640 1 -- 172.21.15.44:0/3141457339 shutdown_connections 2024-03-30T13:15:26.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.172+0000 7f4ffc000640 1 --2- 172.21.15.44:0/3141457339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ff41603d0 0x7f4ff40cfbb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.172+0000 7f4ffc000640 1 --2- 172.21.15.44:0/3141457339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ff406d8f0 0x7f4ff415fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.172+0000 7f4ffc000640 1 -- 172.21.15.44:0/3141457339 >> 172.21.15.44:0/3141457339 conn(0x7f4ff40b5b00 msgr2=0x7f4ff406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.172+0000 7f4ffc000640 1 -- 172.21.15.44:0/3141457339 shutdown_connections 2024-03-30T13:15:26.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.173+0000 7f4ffc000640 1 -- 172.21.15.44:0/3141457339 wait complete. 2024-03-30T13:15:26.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.174+0000 7f4ffc000640 1 Processor -- start 2024-03-30T13:15:26.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.174+0000 7f4ffc000640 1 -- start start 2024-03-30T13:15:26.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.175+0000 7f4ffc000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff406d8f0 0x7f4ff40b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.175+0000 7f4ffc000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ff413f0c0 0x7f4ff413c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.175+0000 7f4ffc000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ff41603d0 0x7f4ff415b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.175+0000 7f4ffc000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff4160820 con 0x7f4ff406d8f0 2024-03-30T13:15:26.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.175+0000 7f4ffc000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff4140000 con 0x7f4ff413f0c0 2024-03-30T13:15:26.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.175+0000 7f4ffc000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff413f4a0 con 0x7f4ff41603d0 2024-03-30T13:15:26.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.176+0000 7f4ff9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff406d8f0 0x7f4ff40b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.176+0000 7f4ff9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff406d8f0 0x7f4ff40b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52108/0 (socket says 172.21.15.44:52108) 2024-03-30T13:15:26.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.176+0000 7f4ff9600640 1 -- 172.21.15.44:0/3286145527 learned_addr learned my addr 172.21.15.44:0/3286145527 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.176+0000 7f4ffa000640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ff41603d0 0x7f4ff415b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.176+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ff413f0c0 0x7f4ff413c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.176+0000 7f4ff9600640 1 -- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ff41603d0 msgr2=0x7f4ff415b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.176+0000 7f4ff9600640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ff41603d0 0x7f4ff415b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.176+0000 7f4ff9600640 1 -- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ff413f0c0 msgr2=0x7f4ff413c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.176+0000 7f4ff9600640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ff413f0c0 0x7f4ff413c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.176+0000 7f4ff9600640 1 -- 172.21.15.44:0/3286145527 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff40b5040 con 0x7f4ff406d8f0 2024-03-30T13:15:26.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.177+0000 7f4ff9600640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff406d8f0 0x7f4ff40b4b00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800c760 tx=0x7f4fe800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.177+0000 7f4ff1600640 1 -- 172.21.15.44:0/3286145527 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8018070 con 0x7f4ff406d8f0 2024-03-30T13:15:26.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.177+0000 7f4ff1600640 1 -- 172.21.15.44:0/3286145527 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe8007070 con 0x7f4ff406d8f0 2024-03-30T13:15:26.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.177+0000 7f4ff1600640 1 -- 172.21.15.44:0/3286145527 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8007460 con 0x7f4ff406d8f0 2024-03-30T13:15:26.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.177+0000 7f4ffc000640 1 -- 172.21.15.44:0/3286145527 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff413c5d0 con 0x7f4ff406d8f0 2024-03-30T13:15:26.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.177+0000 7f4ffc000640 1 -- 172.21.15.44:0/3286145527 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff40b3790 con 0x7f4ff406d8f0 2024-03-30T13:15:26.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.180+0000 7f4ff1600640 1 -- 172.21.15.44:0/3286145527 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4fe801b070 con 0x7f4ff406d8f0 2024-03-30T13:15:26.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.181+0000 7f4ff1600640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4fd406c530 0x7f4fd406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.181+0000 7f4ff1600640 1 -- 172.21.15.44:0/3286145527 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f4fe808ab70 con 0x7f4ff406d8f0 2024-03-30T13:15:26.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.182+0000 7f4ffedc3740 1 Processor -- start 2024-03-30T13:15:26.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.182+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4fd406c530 0x7f4fd406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.182+0000 7f4ffedc3740 1 -- start start 2024-03-30T13:15:26.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.183+0000 7f4ffedc3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc3691290 0x555cc36b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.183+0000 7f4ffedc3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36b8300 0x555cc36902d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.183+0000 7f4ffedc3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc3690810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.183+0000 7f4ffedc3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555cc35f4330 con 0x555cc36b8300 2024-03-30T13:15:26.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.183+0000 7f4ffedc3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555cc359c620 con 0x555cc3691670 2024-03-30T13:15:26.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.183+0000 7f4ffedc3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x555cc35f0440 con 0x555cc3691290 2024-03-30T13:15:26.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.183+0000 7f4ff8c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36b8300 0x555cc36902d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.183+0000 7f4ff8c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36b8300 0x555cc36902d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52116/0 (socket says 172.21.15.44:52116) 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.183+0000 7f4ff8c00640 1 -- 172.21.15.44:0/1115160062 learned_addr learned my addr 172.21.15.44:0/1115160062 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.183+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4fd406c530 0x7f4fd406e9f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4145000 tx=0x7f4fe0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.183+0000 7f4ffa000640 1 --2- 172.21.15.44:0/1115160062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc3690810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.184+0000 7f4ff8c00640 1 -- 172.21.15.44:0/1115160062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc3691290 msgr2=0x555cc36b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.184+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/1115160062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc3691290 0x555cc36b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.184+0000 7f4ff8c00640 1 -- 172.21.15.44:0/1115160062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 msgr2=0x555cc3690810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.184+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/1115160062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc3690810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.184+0000 7f4ff8c00640 1 -- 172.21.15.44:0/1115160062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc33d4920 con 0x555cc36b8300 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.184+0000 7f4ffa000640 1 --2- 172.21.15.44:0/1115160062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc3690810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.184+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/1115160062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36b8300 0x555cc36902d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0011cf0 tx=0x7f4fe0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878d34b6f0cd387c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.184+0000 7f4fe5c00640 1 -- 172.21.15.44:0/1115160062 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0011d20 con 0x555cc36b8300 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.184+0000 7f4fe5c00640 1 -- 172.21.15.44:0/1115160062 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe0026070 con 0x555cc36b8300 2024-03-30T13:15:26.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.184+0000 7f4fe5c00640 1 -- 172.21.15.44:0/1115160062 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe0021640 con 0x555cc36b8300 2024-03-30T13:15:26.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.185+0000 7f4ffedc3740 1 -- 172.21.15.44:0/1115160062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36b8300 msgr2=0x555cc36902d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.185+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/1115160062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36b8300 0x555cc36902d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0011cf0 tx=0x7f4fe0014000 comp rx=0 tx=0).stop 2024-03-30T13:15:26.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.185+0000 7f4ffedc3740 1 -- 172.21.15.44:0/1115160062 shutdown_connections 2024-03-30T13:15:26.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.185+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/1115160062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc3690810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.185+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/1115160062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36b8300 0x555cc36902d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.185+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/1115160062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc3691290 0x555cc36b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.185+0000 7f4ffedc3740 1 -- 172.21.15.44:0/1115160062 >> 172.21.15.44:0/1115160062 conn(0x555cc3657be0 msgr2=0x555cc36d5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.185+0000 7f4ffedc3740 1 -- 172.21.15.44:0/1115160062 shutdown_connections 2024-03-30T13:15:26.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.185+0000 7f4ffedc3740 1 -- 172.21.15.44:0/1115160062 wait complete. 2024-03-30T13:15:26.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.186+0000 7f4ffedc3740 1 -- start start 2024-03-30T13:15:26.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.186+0000 7f4ffedc3740 1 Processor -- start 2024-03-30T13:15:26.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.187+0000 7f4ffedc3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691290 0x555cc36d9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.187+0000 7f4ffedc3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc36be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.187+0000 7f4ffedc3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc36d56c0 0x555cc36be6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.187+0000 7f4ffedc3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555cc36b7930 con 0x555cc3691290 2024-03-30T13:15:26.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.187+0000 7f4ffedc3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555cc35af9d0 con 0x555cc3691670 2024-03-30T13:15:26.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.187+0000 7f4ffedc3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x555cc36b06b0 con 0x555cc36d56c0 2024-03-30T13:15:26.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.187+0000 7f4ffedc3740 10 client.0 _ll_register_callbacks cb 0x555cc35ebfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:26.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.187+0000 7f4ff9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691290 0x555cc36d9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.187+0000 7f4ff9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691290 0x555cc36d9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52120/0 (socket says 172.21.15.44:52120) 2024-03-30T13:15:26.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.187+0000 7f4ff9600640 1 -- 172.21.15.44:0/3089346093 learned_addr learned my addr 172.21.15.44:0/3089346093 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.188+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc36be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.188+0000 7f4ff9600640 1 -- 172.21.15.44:0/3089346093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc36d56c0 msgr2=0x555cc36be6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.188+0000 7f4ffa000640 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc36d56c0 0x555cc36be6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.188+0000 7f4ff9600640 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc36d56c0 0x555cc36be6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.188+0000 7f4ff9600640 1 -- 172.21.15.44:0/3089346093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 msgr2=0x555cc36be1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.188+0000 7f4ff9600640 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc36be1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.188+0000 7f4ff9600640 1 -- 172.21.15.44:0/3089346093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc32c8210 con 0x555cc3691290 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.188+0000 7f4ff9600640 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691290 0x555cc36d9a50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8020030 tx=0x7f4fe8058980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d334cafb14edde server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.188+0000 7f4fda000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.188+0000 7f4fda000640 1 -- 172.21.15.44:0/3089346093 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8007600 con 0x555cc3691290 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.188+0000 7f4fda000640 1 -- 172.21.15.44:0/3089346093 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f4fe8060f90 con 0x555cc3691290 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.188+0000 7f4ffedc3740 1 -- 172.21.15.44:0/3089346093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fe0026070 con 0x555cc3691290 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.189+0000 7f4fda000640 1 -- 172.21.15.44:0/3089346093 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4fe80611b0 con 0x555cc3691290 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.189+0000 7f4ffedc3740 10 client.6156 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:26.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.189+0000 7f4ffedc3740 1 -- 172.21.15.44:0/3089346093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x555cc34350b0 con 0x555cc3691290 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.189+0000 7f4fda000640 1 -- 172.21.15.44:0/3089346093 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe0026070 con 0x555cc3691290 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.189+0000 7f4fda000640 1 -- 172.21.15.44:0/3089346093 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f4fe8059b70 con 0x555cc3691290 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.189+0000 7f4ffedc3740 10 client.6156 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.189+0000 7f4ffedc3740 10 client.6156 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.189+0000 7f4ffedc3740 20 client.6156 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.189+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555cc36e5b60 0x555cc36e5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.189+0000 7f4ffedc3740 4 client.6156 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.189+0000 7f4ffedc3740 1 -- 172.21.15.44:0/3089346093 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cc3601870 con 0x555cc36e5b60 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.190+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555cc36e5b60 0x555cc36e5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.190+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555cc36e5b60 0x555cc36e5f60 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cddcea898de38be6 server_cookie=260587e7d22569b7 in_seq=0 out_seq=0 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.190+0000 7f4fda000640 10 client.6156 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.191+0000 7f4fda000640 1 -- 172.21.15.44:0/3089346093 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x555cc3601870 con 0x555cc36e5b60 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.191+0000 7f4fda000640 10 client.6156 handle_command_reply: tid=0 2024-03-30T13:15:26.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.191+0000 7f4ffedc3740 1 client.6156 shutdown 2024-03-30T13:15:26.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.191+0000 7f4ffedc3740 1 -- 172.21.15.44:0/3089346093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691290 msgr2=0x555cc36d9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.191+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691290 0x555cc36d9a50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8020030 tx=0x7f4fe8058980 comp rx=0 tx=0).stop 2024-03-30T13:15:26.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.191+0000 7f4ffedc3740 1 -- 172.21.15.44:0/3089346093 shutdown_connections 2024-03-30T13:15:26.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.191+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555cc36e5b60 0x555cc36e5f60 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.191+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc36d56c0 0x555cc36be6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.191+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc36be1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.191+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/3089346093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691290 0x555cc36d9a50 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.191+0000 7f4fda000640 0 client.6156 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:26.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.191+0000 7f4ffedc3740 1 -- 172.21.15.44:0/3089346093 >> 172.21.15.44:0/3089346093 conn(0x555cc3657be0 msgr2=0x555cc36b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.192+0000 7f4ffedc3740 1 -- 172.21.15.44:0/3089346093 shutdown_connections 2024-03-30T13:15:26.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.192+0000 7f4ffedc3740 1 -- 172.21.15.44:0/3089346093 wait complete. 2024-03-30T13:15:26.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.192+0000 7f4ffedc3740 20 client.6156 trim_cache size 0 max 16384 2024-03-30T13:15:26.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.224+0000 7f4ffedc3740 1 Processor -- start 2024-03-30T13:15:26.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.224+0000 7f4ffedc3740 1 -- start start 2024-03-30T13:15:26.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.226+0000 7f4ffedc3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691290 0x555cc36af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.226+0000 7f4ffedc3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691670 0x555cc36d9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.226+0000 7f4ffedc3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc36d56c0 0x555cc368a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.226+0000 7f4ffedc3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff42010c0 con 0x555cc3691670 2024-03-30T13:15:26.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.226+0000 7f4ffedc3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff42000a0 con 0x555cc3691290 2024-03-30T13:15:26.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.226+0000 7f4ffedc3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff40cfd60 con 0x555cc36d56c0 2024-03-30T13:15:26.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.226+0000 7f4ff8c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691670 0x555cc36d9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.226+0000 7f4ff8c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691670 0x555cc36d9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52122/0 (socket says 172.21.15.44:52122) 2024-03-30T13:15:26.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.226+0000 7f4ff8c00640 1 -- 172.21.15.44:0/4120907499 learned_addr learned my addr 172.21.15.44:0/4120907499 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.226+0000 7f4ff9600640 1 --2- 172.21.15.44:0/4120907499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691290 0x555cc36af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.226+0000 7f4ffa000640 1 --2- 172.21.15.44:0/4120907499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc36d56c0 0x555cc368a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.227+0000 7f4ff8c00640 1 -- 172.21.15.44:0/4120907499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc36d56c0 msgr2=0x555cc368a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.227+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/4120907499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc36d56c0 0x555cc368a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.227+0000 7f4ff8c00640 1 -- 172.21.15.44:0/4120907499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691290 msgr2=0x555cc36af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.227+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/4120907499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691290 0x555cc36af2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.227+0000 7f4ff8c00640 1 -- 172.21.15.44:0/4120907499 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc32a12d0 con 0x555cc3691670 2024-03-30T13:15:26.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.227+0000 7f4ffa000640 1 --2- 172.21.15.44:0/4120907499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc36d56c0 0x555cc368a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:26.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.227+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/4120907499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691670 0x555cc36d9080 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009810 tx=0x7f4fe0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bef1d708f5b5ca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.227+0000 7f4fe5200640 1 -- 172.21.15.44:0/4120907499 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe003d070 con 0x555cc3691670 2024-03-30T13:15:26.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.227+0000 7f4fe5200640 1 -- 172.21.15.44:0/4120907499 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe0026040 con 0x555cc3691670 2024-03-30T13:15:26.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.227+0000 7f4fe5200640 1 -- 172.21.15.44:0/4120907499 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe00373c0 con 0x555cc3691670 2024-03-30T13:15:26.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.228+0000 7f4ffedc3740 1 -- 172.21.15.44:0/4120907499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691670 msgr2=0x555cc36d9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.228+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/4120907499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691670 0x555cc36d9080 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009810 tx=0x7f4fe0017000 comp rx=0 tx=0).stop 2024-03-30T13:15:26.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.228+0000 7f4ffedc3740 1 -- 172.21.15.44:0/4120907499 shutdown_connections 2024-03-30T13:15:26.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.228+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/4120907499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc36d56c0 0x555cc368a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.228+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/4120907499 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc3691670 0x555cc36d9080 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.228+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/4120907499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691290 0x555cc36af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.228+0000 7f4ffedc3740 1 -- 172.21.15.44:0/4120907499 >> 172.21.15.44:0/4120907499 conn(0x555cc3657be0 msgr2=0x555cc36bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.228+0000 7f4ffedc3740 1 -- 172.21.15.44:0/4120907499 shutdown_connections 2024-03-30T13:15:26.234 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.228+0000 7f4ffedc3740 1 -- 172.21.15.44:0/4120907499 wait complete. 2024-03-30T13:15:26.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.229+0000 7f4ffedc3740 1 -- start start 2024-03-30T13:15:26.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.229+0000 7f4ffedc3740 1 Processor -- start 2024-03-30T13:15:26.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.230+0000 7f4ffedc3740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc3691290 0x555cc36a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.230+0000 7f4ffedc3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc36b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.230+0000 7f4ffedc3740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36d56c0 0x555cc368aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.230+0000 7f4ffedc3740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff41ffb20 con 0x555cc36d56c0 2024-03-30T13:15:26.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.230+0000 7f4ffedc3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555cc36a34a0 con 0x555cc3691670 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.230+0000 7f4ffedc3740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x555cc3754a60 con 0x555cc3691290 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.230+0000 7f4ffedc3740 10 client.0 _ll_register_callbacks cb 0x7f4fe8054b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.231+0000 7f4ffa000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36d56c0 0x555cc368aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.231+0000 7f4ffa000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36d56c0 0x555cc368aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52136/0 (socket says 172.21.15.44:52136) 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.231+0000 7f4ffa000640 1 -- 172.21.15.44:0/490885370 learned_addr learned my addr 172.21.15.44:0/490885370 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.231+0000 7f4ff8c00640 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc36b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.231+0000 7f4ff9600640 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc3691290 0x555cc36a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.231+0000 7f4ffa000640 1 -- 172.21.15.44:0/490885370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc3691290 msgr2=0x555cc36a2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.231+0000 7f4ffa000640 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc3691290 0x555cc36a2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.231+0000 7f4ffa000640 1 -- 172.21.15.44:0/490885370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 msgr2=0x555cc36b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.231+0000 7f4ffa000640 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc36b73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.231+0000 7f4ffa000640 1 -- 172.21.15.44:0/490885370 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc3755550 con 0x555cc36d56c0 2024-03-30T13:15:26.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.231+0000 7f4ff9600640 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc3691290 0x555cc36a2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:26.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.232+0000 7f4ffa000640 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36d56c0 0x555cc368aa40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4fec02c450 tx=0x7f4fec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb509ceec59f2bf3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.232+0000 7f4fda000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:26.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.232+0000 7f4fda000640 1 -- 172.21.15.44:0/490885370 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec02c9e0 con 0x555cc36d56c0 2024-03-30T13:15:26.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.232+0000 7f4fda000640 1 -- 172.21.15.44:0/490885370 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6130+0+0 (secure 0 0 0) 0x7f4fec049c90 con 0x555cc36d56c0 2024-03-30T13:15:26.240 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.232+0000 7f4ffedc3740 1 -- 172.21.15.44:0/490885370 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fe0026040 con 0x555cc36d56c0 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.232+0000 7f4fda000640 1 -- 172.21.15.44:0/490885370 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f4fec009af0 con 0x555cc36d56c0 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.232+0000 7f4ffedc3740 10 client.6162 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.232+0000 7f4ffedc3740 1 -- 172.21.15.44:0/490885370 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x555cc37545f0 con 0x555cc36d56c0 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.233+0000 7f4fda000640 1 -- 172.21.15.44:0/490885370 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe0026040 con 0x555cc36d56c0 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.233+0000 7f4fda000640 1 -- 172.21.15.44:0/490885370 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f4fec050050 con 0x555cc36d56c0 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.233+0000 7f4ffedc3740 10 client.6162 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.233+0000 7f4ffedc3740 10 client.6162 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.233+0000 7f4ffedc3740 20 client.6162 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.233+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555cc37518f0 0x555cc36bdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.233+0000 7f4ffedc3740 4 client.6162 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628372}] 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.233+0000 7f4ffedc3740 1 -- 172.21.15.44:0/490885370 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628372}) -- 0x555cc35fbbc0 con 0x555cc37518f0 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.233+0000 7f4ff9600640 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555cc37518f0 0x555cc36bdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4fda000640 10 client.6162 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4ff9600640 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555cc37518f0 0x555cc36bdf30 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b48c4daffc64c20 server_cookie=5cb86c622cc721ae in_seq=0 out_seq=0 2024-03-30T13:15:26.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4fda000640 1 -- 172.21.15.44:0/490885370 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4750 (crc 0 0 0) 0x555cc35fbbc0 con 0x555cc37518f0 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4fda000640 10 client.6162 handle_command_reply: tid=0 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4ffedc3740 1 client.6162 shutdown 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4ffedc3740 1 -- 172.21.15.44:0/490885370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36d56c0 msgr2=0x555cc368aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36d56c0 0x555cc368aa40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f4fec02c450 tx=0x7f4fec004ab0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4ffedc3740 1 -- 172.21.15.44:0/490885370 shutdown_connections 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555cc37518f0 0x555cc36bdf30 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555cc36d56c0 0x555cc368aa40 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc3691670 0x555cc36b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4ffedc3740 1 --2- 172.21.15.44:0/490885370 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555cc3691290 0x555cc36a2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4ffedc3740 1 -- 172.21.15.44:0/490885370 >> 172.21.15.44:0/490885370 conn(0x555cc3657be0 msgr2=0x555cc36aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.234+0000 7f4fda000640 0 client.6162 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.235+0000 7f4ffedc3740 1 -- 172.21.15.44:0/490885370 shutdown_connections 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.235+0000 7f4ffedc3740 1 -- 172.21.15.44:0/490885370 wait complete. 2024-03-30T13:15:26.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.235+0000 7f4ffedc3740 20 client.6162 trim_cache size 0 max 16384 2024-03-30T13:15:26.243 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:26.243 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ceph/io.h", 2024-03-30T13:15:26.243 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628372, 2024-03-30T13:15:26.243 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:26.243 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.523169+0000", 2024-03-30T13:15:26.243 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.457535+0000", 2024-03-30T13:15:26.243 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:26.243 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:26.243 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:26.243 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:26.243 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:26.244 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:26.244 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:26.244 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:26.244 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:26.244 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.244 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:26.244 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:26.244 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:26.244 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:26.244 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:26.244 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 387, 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.457535+0000", 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:26.245 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:26.246 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:26.246 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:26.246 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:26.246 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:26.246 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:26.246 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:26.246 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:26.246 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.246 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:26.246 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:26.246 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.246 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 387, 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.523169+0000" 2024-03-30T13:15:26.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 387, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.523169+0000" 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 264, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 30, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:26.248 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.249 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:26.250 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:26.251 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.252 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.253 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.254 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.255 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:26.256 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:26.257 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.258 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:26.258 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:26.258 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:26.258 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:26.258 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.235+0000 7f4ffc000640 1 -- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4fd406c530 msgr2=0x7f4fd406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.235+0000 7f4ffc000640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4fd406c530 0x7f4fd406e9f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4145000 tx=0x7f4fe0008040 comp rx=0 tx=0).stop 2024-03-30T13:15:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.235+0000 7f4ffc000640 1 -- 172.21.15.44:0/3286145527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff406d8f0 msgr2=0x7f4ff40b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.235+0000 7f4ffc000640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff406d8f0 0x7f4ff40b4b00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800c760 tx=0x7f4fe800cc20 comp rx=0 tx=0).stop 2024-03-30T13:15:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.236+0000 7f4ffc000640 1 -- 172.21.15.44:0/3286145527 shutdown_connections 2024-03-30T13:15:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.236+0000 7f4ffc000640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ff41603d0 0x7f4ff415b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.236+0000 7f4ffc000640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4fd406c530 0x7f4fd406e9f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.236+0000 7f4ffc000640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ff413f0c0 0x7f4ff413c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.236+0000 7f4ffc000640 1 --2- 172.21.15.44:0/3286145527 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4ff406d8f0 0x7f4ff40b4b00 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.236+0000 7f4ffc000640 1 -- 172.21.15.44:0/3286145527 >> 172.21.15.44:0/3286145527 conn(0x7f4ff40b5b00 msgr2=0x7f4ff406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.236+0000 7f4ffc000640 1 -- 172.21.15.44:0/3286145527 shutdown_connections 2024-03-30T13:15:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.236+0000 7f4ffc000640 1 -- 172.21.15.44:0/3286145527 wait complete. 2024-03-30T13:15:26.260 DEBUG:tasks.cephfs.test_uninlining:getting inode info #5 of 23:1099511628374 2024-03-30T13:15:26.260 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628374 2024-03-30T13:15:26.261 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628374 2024-03-30T13:15:26.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.465+0000 7ff422800640 1 Processor -- start 2024-03-30T13:15:26.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.465+0000 7ff422800640 1 -- start start 2024-03-30T13:15:26.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.467+0000 7ff422800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff41c1606d0 0x7ff41c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.468+0000 7ff422800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41c06de60 con 0x7ff41c159e50 2024-03-30T13:15:26.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.468+0000 7ff422800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41c0701e0 con 0x7ff41c06b940 2024-03-30T13:15:26.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.468+0000 7ff422800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7ff41c06e140 con 0x7ff41c1606d0 2024-03-30T13:15:26.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.468+0000 7ff41b400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff41c159e50 0x7ff41c15ffc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49264/0 (socket says 172.21.15.44:49264) 2024-03-30T13:15:26.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.468+0000 7ff41b400640 1 -- 172.21.15.44:0/2060494431 learned_addr learned my addr 172.21.15.44:0/2060494431 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:26.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.468+0000 7ff41aa00640 1 --2- 172.21.15.44:0/2060494431 >> v2:172.21.15.151:3300/0 conn(0x7ff41c1606d0 0x7ff41c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.469+0000 7ff41aa00640 1 -- 172.21.15.44:0/2060494431 >> v1:172.21.15.151:6789/0 conn(0x7ff41c06b940 legacy=0x7ff41c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.469+0000 7ff41aa00640 1 -- 172.21.15.44:0/2060494431 >> v1:172.21.15.44:6789/0 conn(0x7ff41c159e50 legacy=0x7ff41c15ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.469+0000 7ff41aa00640 1 -- 172.21.15.44:0/2060494431 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c0704c0 con 0x7ff41c1606d0 2024-03-30T13:15:26.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.471+0000 7ff41aa00640 1 --2- 172.21.15.44:0/2060494431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c1606d0 0x7ff41c0cde00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff4080097a0 tx=0x7ff40802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f53aea3e090d661 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.479+0000 7ff41a000640 1 -- 172.21.15.44:0/2060494431 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408035020 con 0x7ff41c1606d0 2024-03-30T13:15:26.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.479+0000 7ff41a000640 1 -- 172.21.15.44:0/2060494431 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff408031830 con 0x7ff41c1606d0 2024-03-30T13:15:26.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.479+0000 7ff41a000640 1 -- 172.21.15.44:0/2060494431 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408031c00 con 0x7ff41c1606d0 2024-03-30T13:15:26.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.481+0000 7ff422800640 1 -- 172.21.15.44:0/2060494431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c1606d0 msgr2=0x7ff41c0cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.481+0000 7ff422800640 1 --2- 172.21.15.44:0/2060494431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c1606d0 0x7ff41c0cde00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff4080097a0 tx=0x7ff40802b8d0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.481+0000 7ff422800640 1 -- 172.21.15.44:0/2060494431 shutdown_connections 2024-03-30T13:15:26.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.481+0000 7ff422800640 1 --2- 172.21.15.44:0/2060494431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c1606d0 0x7ff41c0cde00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.481+0000 7ff422800640 1 -- 172.21.15.44:0/2060494431 >> 172.21.15.44:0/2060494431 conn(0x7ff41c0cd310 msgr2=0x7ff41c0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.481+0000 7ff422800640 1 -- 172.21.15.44:0/2060494431 shutdown_connections 2024-03-30T13:15:26.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.481+0000 7ff422800640 1 -- 172.21.15.44:0/2060494431 wait complete. 2024-03-30T13:15:26.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.483+0000 7ff422800640 1 Processor -- start 2024-03-30T13:15:26.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.483+0000 7ff422800640 1 -- start start 2024-03-30T13:15:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.484+0000 7ff422800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c06b940 0x7ff41c14f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.484+0000 7ff422800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c159e50 0x7ff41c155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.484+0000 7ff422800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c1606d0 0x7ff41c15df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.484+0000 7ff422800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c15a3b0 con 0x7ff41c1606d0 2024-03-30T13:15:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.484+0000 7ff422800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c15a230 con 0x7ff41c159e50 2024-03-30T13:15:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.484+0000 7ff422800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff41c06da80 con 0x7ff41c06b940 2024-03-30T13:15:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.485+0000 7ff41be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c1606d0 0x7ff41c15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.485+0000 7ff41be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c1606d0 0x7ff41c15df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52144/0 (socket says 172.21.15.44:52144) 2024-03-30T13:15:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.485+0000 7ff41be00640 1 -- 172.21.15.44:0/1096131722 learned_addr learned my addr 172.21.15.44:0/1096131722 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.485+0000 7ff41b400640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c06b940 0x7ff41c14f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.485+0000 7ff41be00640 1 -- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c06b940 msgr2=0x7ff41c14f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.485+0000 7ff41be00640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c06b940 0x7ff41c14f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.485+0000 7ff41be00640 1 -- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c159e50 msgr2=0x7ff41c155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.485+0000 7ff41be00640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c159e50 0x7ff41c155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.485+0000 7ff41be00640 1 -- 172.21.15.44:0/1096131722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c155100 con 0x7ff41c1606d0 2024-03-30T13:15:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.486+0000 7ff41be00640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c1606d0 0x7ff41c15df90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c6e0 tx=0x7ff41400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.486+0000 7ff413400640 1 -- 172.21.15.44:0/1096131722 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414003b70 con 0x7ff41c1606d0 2024-03-30T13:15:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.486+0000 7ff413400640 1 -- 172.21.15.44:0/1096131722 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff414003d10 con 0x7ff41c1606d0 2024-03-30T13:15:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.486+0000 7ff413400640 1 -- 172.21.15.44:0/1096131722 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414005310 con 0x7ff41c1606d0 2024-03-30T13:15:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.486+0000 7ff422800640 1 -- 172.21.15.44:0/1096131722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41c1553e0 con 0x7ff41c1606d0 2024-03-30T13:15:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.486+0000 7ff422800640 1 -- 172.21.15.44:0/1096131722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41c1559a0 con 0x7ff41c1606d0 2024-03-30T13:15:26.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.489+0000 7ff413400640 1 -- 172.21.15.44:0/1096131722 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff4140054b0 con 0x7ff41c1606d0 2024-03-30T13:15:26.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.489+0000 7ff413400640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3fc06c560 0x7ff3fc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.490+0000 7ff413400640 1 -- 172.21.15.44:0/1096131722 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6218+0+0 (secure 0 0 0) 0x7ff41408b800 con 0x7ff41c1606d0 2024-03-30T13:15:26.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.491+0000 7ff41b400640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3fc06c560 0x7ff3fc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.491+0000 7ff4255ff740 1 Processor -- start 2024-03-30T13:15:26.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.492+0000 7ff4255ff740 1 -- start start 2024-03-30T13:15:26.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.493+0000 7ff4255ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e556a0 0x555676e7c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.493+0000 7ff4255ff740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e7c710 0x555676e546e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.493+0000 7ff4255ff740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 0x555676e54c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.493+0000 7ff4255ff740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555676db4330 con 0x555676e55a80 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.493+0000 7ff4255ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555676d5c620 con 0x555676e556a0 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.493+0000 7ff4255ff740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x555676db0440 con 0x555676e7c710 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.493+0000 7ff41be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 0x555676e54c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.493+0000 7ff41be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 0x555676e54c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52150/0 (socket says 172.21.15.44:52150) 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.493+0000 7ff41be00640 1 -- 172.21.15.44:0/3975054153 learned_addr learned my addr 172.21.15.44:0/3975054153 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.494+0000 7ff41be00640 1 -- 172.21.15.44:0/3975054153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e7c710 msgr2=0x555676e546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.494+0000 7ff41be00640 1 --2- 172.21.15.44:0/3975054153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e7c710 0x555676e546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.494+0000 7ff41be00640 1 -- 172.21.15.44:0/3975054153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e556a0 msgr2=0x555676e7c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.494+0000 7ff41be00640 1 --2- 172.21.15.44:0/3975054153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e556a0 0x555676e7c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.494+0000 7ff41be00640 1 -- 172.21.15.44:0/3975054153 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555676b94920 con 0x555676e55a80 2024-03-30T13:15:26.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.494+0000 7ff41be00640 1 --2- 172.21.15.44:0/3975054153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 0x555676e54c20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff414089ad0 tx=0x7ff414059190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980657fab0dd470a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.495+0000 7ff407e00640 1 -- 172.21.15.44:0/3975054153 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414088070 con 0x555676e55a80 2024-03-30T13:15:26.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.496+0000 7ff407e00640 1 -- 172.21.15.44:0/3975054153 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff414062100 con 0x555676e55a80 2024-03-30T13:15:26.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.496+0000 7ff407e00640 1 -- 172.21.15.44:0/3975054153 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414071070 con 0x555676e55a80 2024-03-30T13:15:26.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.497+0000 7ff4255ff740 1 -- 172.21.15.44:0/3975054153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 msgr2=0x555676e54c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.497+0000 7ff4255ff740 1 --2- 172.21.15.44:0/3975054153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 0x555676e54c20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff414089ad0 tx=0x7ff414059190 comp rx=0 tx=0).stop 2024-03-30T13:15:26.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.497+0000 7ff41b400640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3fc06c560 0x7ff3fc06ea20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff40c000f60 tx=0x7ff40c001a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.498+0000 7ff4255ff740 1 -- 172.21.15.44:0/3975054153 shutdown_connections 2024-03-30T13:15:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.498+0000 7ff4255ff740 1 --2- 172.21.15.44:0/3975054153 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 0x555676e54c20 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.498+0000 7ff4255ff740 1 --2- 172.21.15.44:0/3975054153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e7c710 0x555676e546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.498+0000 7ff4255ff740 1 --2- 172.21.15.44:0/3975054153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e556a0 0x555676e7c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.498+0000 7ff4255ff740 1 -- 172.21.15.44:0/3975054153 >> 172.21.15.44:0/3975054153 conn(0x555676e17be0 msgr2=0x555676e9a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.499+0000 7ff4255ff740 1 -- 172.21.15.44:0/3975054153 shutdown_connections 2024-03-30T13:15:26.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.499+0000 7ff4255ff740 1 -- 172.21.15.44:0/3975054153 wait complete. 2024-03-30T13:15:26.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.501+0000 7ff4255ff740 1 -- start start 2024-03-30T13:15:26.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.501+0000 7ff4255ff740 1 Processor -- start 2024-03-30T13:15:26.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.503+0000 7ff4255ff740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e556a0 0x555676e66190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.503+0000 7ff4255ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e55a80 0x555676e80ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.503+0000 7ff4255ff740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e65b70 0x555676e99130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.503+0000 7ff4255ff740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555676e7bd40 con 0x555676e556a0 2024-03-30T13:15:26.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.503+0000 7ff4255ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555676d6f9d0 con 0x555676e55a80 2024-03-30T13:15:26.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.503+0000 7ff4255ff740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x555676e74ac0 con 0x555676e65b70 2024-03-30T13:15:26.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.503+0000 7ff4255ff740 10 client.0 _ll_register_callbacks cb 0x555676dabfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:26.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.504+0000 7ff41be00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e65b70 0x555676e99130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.504+0000 7ff41be00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e65b70 0x555676e99130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:46430/0 (socket says 172.21.15.44:46430) 2024-03-30T13:15:26.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.504+0000 7ff41be00640 1 -- 172.21.15.44:0/1093196442 learned_addr learned my addr 172.21.15.44:0/1093196442 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.504+0000 7ff41b400640 1 --2- 172.21.15.44:0/1093196442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e556a0 0x555676e66190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.505+0000 7ff41be00640 1 -- 172.21.15.44:0/1093196442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e55a80 msgr2=0x555676e80ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.505+0000 7ff41be00640 1 --2- 172.21.15.44:0/1093196442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e55a80 0x555676e80ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.505+0000 7ff41be00640 1 -- 172.21.15.44:0/1093196442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e556a0 msgr2=0x555676e66190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.505+0000 7ff41be00640 1 --2- 172.21.15.44:0/1093196442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e556a0 0x555676e66190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.505+0000 7ff41be00640 1 -- 172.21.15.44:0/1093196442 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) -- 0x555676a88210 con 0x555676e65b70 2024-03-30T13:15:26.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.507+0000 7ff41be00640 1 --2- 172.21.15.44:0/1093196442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e65b70 0x555676e99130 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff41400a430 tx=0x7ff414001250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c400b591052836a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.508+0000 7ff404c00640 10 client.0 ms_handle_connect on v2:172.21.15.151:3301/0 2024-03-30T13:15:26.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.509+0000 7ff404c00640 1 -- 172.21.15.44:0/1093196442 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414076060 con 0x555676e65b70 2024-03-30T13:15:26.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.509+0000 7ff404c00640 1 -- 172.21.15.44:0/1093196442 <== mon.2 v2:172.21.15.151:3301/0 2 ==== osd_map(44..44 src has 1..44) ==== 6218+0+0 (secure 0 0 0) 0x7ff414057820 con 0x555676e65b70 2024-03-30T13:15:26.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.510+0000 7ff4255ff740 1 -- 172.21.15.44:0/1093196442 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff414062100 con 0x555676e65b70 2024-03-30T13:15:26.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.511+0000 7ff404c00640 1 -- 172.21.15.44:0/1093196442 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff414088030 con 0x555676e65b70 2024-03-30T13:15:26.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.512+0000 7ff4255ff740 10 client.5024 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:26.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.512+0000 7ff4255ff740 1 -- 172.21.15.44:0/1093196442 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x555676bf50b0 con 0x555676e65b70 2024-03-30T13:15:26.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.514+0000 7ff404c00640 1 -- 172.21.15.44:0/1093196442 <== mon.2 v2:172.21.15.151:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff414062100 con 0x555676e65b70 2024-03-30T13:15:26.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.514+0000 7ff404c00640 1 -- 172.21.15.44:0/1093196442 <== mon.2 v2:172.21.15.151:3301/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7ff414055b90 con 0x555676e65b70 2024-03-30T13:15:26.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.515+0000 7ff4255ff740 10 client.5024 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:26.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.515+0000 7ff4255ff740 10 client.5024 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:26.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.515+0000 7ff4255ff740 20 client.5024 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:26.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.515+0000 7ff4255ff740 1 --2- 172.21.15.44:0/1093196442 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555676e9d6c0 0x555676e82190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.515+0000 7ff4255ff740 4 client.5024 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:26.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.515+0000 7ff4255ff740 1 -- 172.21.15.44:0/1093196442 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555676dc1870 con 0x555676e9d6c0 2024-03-30T13:15:26.521 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.516+0000 7ff41b400640 1 --2- 172.21.15.44:0/1093196442 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555676e9d6c0 0x555676e82190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.519+0000 7ff41b400640 1 --2- 172.21.15.44:0/1093196442 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555676e9d6c0 0x555676e82190 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=676a793460ce575a server_cookie=330e455b0f9e54f9 in_seq=0 out_seq=0 2024-03-30T13:15:26.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.520+0000 7ff404c00640 10 client.5024 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:26.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.522+0000 7ff404c00640 1 -- 172.21.15.44:0/1093196442 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x555676dc1870 con 0x555676e9d6c0 2024-03-30T13:15:26.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.522+0000 7ff404c00640 10 client.5024 handle_command_reply: tid=0 2024-03-30T13:15:26.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.522+0000 7ff4255ff740 1 client.5024 shutdown 2024-03-30T13:15:26.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.527+0000 7ff4255ff740 1 -- 172.21.15.44:0/1093196442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e65b70 msgr2=0x555676e99130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.527+0000 7ff4255ff740 1 --2- 172.21.15.44:0/1093196442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e65b70 0x555676e99130 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff41400a430 tx=0x7ff414001250 comp rx=0 tx=0).stop 2024-03-30T13:15:26.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.528+0000 7ff4255ff740 1 -- 172.21.15.44:0/1093196442 shutdown_connections 2024-03-30T13:15:26.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.528+0000 7ff4255ff740 1 --2- 172.21.15.44:0/1093196442 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555676e9d6c0 0x555676e82190 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.528+0000 7ff4255ff740 1 --2- 172.21.15.44:0/1093196442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e65b70 0x555676e99130 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.528+0000 7ff4255ff740 1 --2- 172.21.15.44:0/1093196442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e55a80 0x555676e80ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.528+0000 7ff4255ff740 1 --2- 172.21.15.44:0/1093196442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e556a0 0x555676e66190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.528+0000 7ff4255ff740 1 -- 172.21.15.44:0/1093196442 >> 172.21.15.44:0/1093196442 conn(0x555676e17be0 msgr2=0x555676e7b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.528+0000 7ff404c00640 0 client.5024 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:26.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.529+0000 7ff4255ff740 1 -- 172.21.15.44:0/1093196442 shutdown_connections 2024-03-30T13:15:26.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.531+0000 7ff4255ff740 1 -- 172.21.15.44:0/1093196442 wait complete. 2024-03-30T13:15:26.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.532+0000 7ff4255ff740 20 client.5024 trim_cache size 0 max 16384 2024-03-30T13:15:26.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.566+0000 7ff4255ff740 1 Processor -- start 2024-03-30T13:15:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.567+0000 7ff4255ff740 1 -- start start 2024-03-30T13:15:26.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.570+0000 7ff4255ff740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e556a0 0x555676e7f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.570+0000 7ff4255ff740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 0x555676f10530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.570+0000 7ff4255ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e65b70 0x555676f10a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.570+0000 7ff4255ff740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c1fd230 con 0x555676e55a80 2024-03-30T13:15:26.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.570+0000 7ff4255ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c1500e0 con 0x555676e65b70 2024-03-30T13:15:26.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.570+0000 7ff4255ff740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff41c0b4f20 con 0x555676e556a0 2024-03-30T13:15:26.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.570+0000 7ff41b400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e556a0 0x555676e7f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.571+0000 7ff41b400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e556a0 0x555676e7f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:46440/0 (socket says 172.21.15.44:46440) 2024-03-30T13:15:26.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.571+0000 7ff41b400640 1 -- 172.21.15.44:0/3249267296 learned_addr learned my addr 172.21.15.44:0/3249267296 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.572+0000 7ff41aa00640 1 --2- 172.21.15.44:0/3249267296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 0x555676f10530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.572+0000 7ff41be00640 1 --2- 172.21.15.44:0/3249267296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e65b70 0x555676f10a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.572+0000 7ff41aa00640 1 -- 172.21.15.44:0/3249267296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e556a0 msgr2=0x555676e7f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.572+0000 7ff41aa00640 1 --2- 172.21.15.44:0/3249267296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e556a0 0x555676e7f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.572+0000 7ff41aa00640 1 -- 172.21.15.44:0/3249267296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e65b70 msgr2=0x555676f10a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.572+0000 7ff41aa00640 1 --2- 172.21.15.44:0/3249267296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e65b70 0x555676f10a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.573+0000 7ff41aa00640 1 -- 172.21.15.44:0/3249267296 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555676a612d0 con 0x555676e55a80 2024-03-30T13:15:26.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.573+0000 7ff41aa00640 1 --2- 172.21.15.44:0/3249267296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 0x555676f10530 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff408033000 tx=0x7ff4080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa01b53f24433f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.574+0000 7ff407400640 1 -- 172.21.15.44:0/3249267296 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408035070 con 0x555676e55a80 2024-03-30T13:15:26.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.574+0000 7ff407400640 1 -- 172.21.15.44:0/3249267296 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40803e030 con 0x555676e55a80 2024-03-30T13:15:26.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.574+0000 7ff407400640 1 -- 172.21.15.44:0/3249267296 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408031cc0 con 0x555676e55a80 2024-03-30T13:15:26.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.575+0000 7ff4255ff740 1 -- 172.21.15.44:0/3249267296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 msgr2=0x555676f10530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.575+0000 7ff4255ff740 1 --2- 172.21.15.44:0/3249267296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 0x555676f10530 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff408033000 tx=0x7ff4080046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.576+0000 7ff4255ff740 1 -- 172.21.15.44:0/3249267296 shutdown_connections 2024-03-30T13:15:26.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.576+0000 7ff4255ff740 1 --2- 172.21.15.44:0/3249267296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e65b70 0x555676f10a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.576+0000 7ff4255ff740 1 --2- 172.21.15.44:0/3249267296 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e55a80 0x555676f10530 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.576+0000 7ff4255ff740 1 --2- 172.21.15.44:0/3249267296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e556a0 0x555676e7f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.576+0000 7ff4255ff740 1 -- 172.21.15.44:0/3249267296 >> 172.21.15.44:0/3249267296 conn(0x555676e17be0 msgr2=0x555676e98ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.576+0000 7ff4255ff740 1 -- 172.21.15.44:0/3249267296 shutdown_connections 2024-03-30T13:15:26.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.576+0000 7ff4255ff740 1 -- 172.21.15.44:0/3249267296 wait complete. 2024-03-30T13:15:26.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.577+0000 7ff4255ff740 1 -- start start 2024-03-30T13:15:26.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.578+0000 7ff4255ff740 1 Processor -- start 2024-03-30T13:15:26.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.579+0000 7ff4255ff740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e556a0 0x555676efed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.579+0000 7ff4255ff740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e55a80 0x555676f15a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.579+0000 7ff4255ff740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e65b70 0x555676ea9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.579+0000 7ff4255ff740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c0b5570 con 0x555676e556a0 2024-03-30T13:15:26.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.579+0000 7ff4255ff740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555676de8490 con 0x555676e65b70 2024-03-30T13:15:26.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.579+0000 7ff4255ff740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x555676e99b90 con 0x555676e55a80 2024-03-30T13:15:26.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.580+0000 7ff4255ff740 10 client.0 _ll_register_callbacks cb 0x7ff414086070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:26.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.581+0000 7ff41b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e556a0 0x555676efed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.581+0000 7ff41b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e556a0 0x555676efed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52188/0 (socket says 172.21.15.44:52188) 2024-03-30T13:15:26.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.581+0000 7ff41b400640 1 -- 172.21.15.44:0/1675479325 learned_addr learned my addr 172.21.15.44:0/1675479325 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.581+0000 7ff41be00640 1 --2- 172.21.15.44:0/1675479325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e65b70 0x555676ea9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.582+0000 7ff41b400640 1 -- 172.21.15.44:0/1675479325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e55a80 msgr2=0x555676f15a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.582+0000 7ff41b400640 1 --2- 172.21.15.44:0/1675479325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e55a80 0x555676f15a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.582+0000 7ff41b400640 1 -- 172.21.15.44:0/1675479325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e65b70 msgr2=0x555676ea9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.582+0000 7ff41b400640 1 --2- 172.21.15.44:0/1675479325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e65b70 0x555676ea9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.582+0000 7ff41b400640 1 -- 172.21.15.44:0/1675479325 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555676ea8b30 con 0x555676e556a0 2024-03-30T13:15:26.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.582+0000 7ff41b400640 1 --2- 172.21.15.44:0/1675479325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e556a0 0x555676efed40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00d520 tx=0x7ff40c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a52efd80cb53917 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.583+0000 7ff404c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:26.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.583+0000 7ff404c00640 1 -- 172.21.15.44:0/1675479325 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c026070 con 0x555676e556a0 2024-03-30T13:15:26.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.583+0000 7ff4255ff740 1 -- 172.21.15.44:0/1675479325 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff40803e030 con 0x555676e556a0 2024-03-30T13:15:26.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.584+0000 7ff404c00640 1 -- 172.21.15.44:0/1675479325 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6218+0+0 (secure 0 0 0) 0x7ff40c0070d0 con 0x555676e556a0 2024-03-30T13:15:26.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.585+0000 7ff404c00640 1 -- 172.21.15.44:0/1675479325 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff40c030050 con 0x555676e556a0 2024-03-30T13:15:26.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.585+0000 7ff4255ff740 10 client.6174 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:26.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.585+0000 7ff4255ff740 1 -- 172.21.15.44:0/1675479325 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x555676f15f90 con 0x555676e556a0 2024-03-30T13:15:26.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.585+0000 7ff404c00640 1 -- 172.21.15.44:0/1675479325 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40803e030 con 0x555676e556a0 2024-03-30T13:15:26.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.586+0000 7ff404c00640 1 -- 172.21.15.44:0/1675479325 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7ff40c013070 con 0x555676e556a0 2024-03-30T13:15:26.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.586+0000 7ff4255ff740 10 client.6174 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:26.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.586+0000 7ff4255ff740 10 client.6174 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:26.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.586+0000 7ff4255ff740 20 client.6174 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:26.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.586+0000 7ff4255ff740 1 --2- 172.21.15.44:0/1675479325 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555676e99100 0x555676ea9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.586+0000 7ff4255ff740 4 client.6174 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628374}] 2024-03-30T13:15:26.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.586+0000 7ff4255ff740 1 -- 172.21.15.44:0/1675479325 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628374}) -- 0x555676dbbbc0 con 0x555676e99100 2024-03-30T13:15:26.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.587+0000 7ff41aa00640 1 --2- 172.21.15.44:0/1675479325 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555676e99100 0x555676ea9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.589+0000 7ff41aa00640 1 --2- 172.21.15.44:0/1675479325 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555676e99100 0x555676ea9550 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9649f11bc7c36bcc server_cookie=590a925725f275ba in_seq=0 out_seq=0 2024-03-30T13:15:26.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.589+0000 7ff404c00640 10 client.6174 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:26.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.590+0000 7ff404c00640 1 -- 172.21.15.44:0/1675479325 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4756 (crc 0 0 0) 0x555676dbbbc0 con 0x555676e99100 2024-03-30T13:15:26.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.590+0000 7ff404c00640 10 client.6174 handle_command_reply: tid=0 2024-03-30T13:15:26.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.590+0000 7ff4255ff740 1 client.6174 shutdown 2024-03-30T13:15:26.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.590+0000 7ff4255ff740 1 -- 172.21.15.44:0/1675479325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e556a0 msgr2=0x555676efed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.590+0000 7ff4255ff740 1 --2- 172.21.15.44:0/1675479325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e556a0 0x555676efed40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00d520 tx=0x7ff40c000ed0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.591+0000 7ff4255ff740 1 -- 172.21.15.44:0/1675479325 shutdown_connections 2024-03-30T13:15:26.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.591+0000 7ff4255ff740 1 --2- 172.21.15.44:0/1675479325 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555676e99100 0x555676ea9550 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.591+0000 7ff4255ff740 1 --2- 172.21.15.44:0/1675479325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555676e65b70 0x555676ea9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.591+0000 7ff4255ff740 1 --2- 172.21.15.44:0/1675479325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555676e55a80 0x555676f15a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.591+0000 7ff4255ff740 1 --2- 172.21.15.44:0/1675479325 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555676e556a0 0x555676efed40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.591+0000 7ff404c00640 0 client.6174 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:26.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.591+0000 7ff4255ff740 1 -- 172.21.15.44:0/1675479325 >> 172.21.15.44:0/1675479325 conn(0x555676e17be0 msgr2=0x555676e9c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.591+0000 7ff4255ff740 1 -- 172.21.15.44:0/1675479325 shutdown_connections 2024-03-30T13:15:26.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.592+0000 7ff4255ff740 1 -- 172.21.15.44:0/1675479325 wait complete. 2024-03-30T13:15:26.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.592+0000 7ff4255ff740 20 client.6174 trim_cache size 0 max 16384 2024-03-30T13:15:26.598 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:26.598 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ceph/ioctl.h", 2024-03-30T13:15:26.598 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628374, 2024-03-30T13:15:26.598 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:26.598 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.524129+0000", 2024-03-30T13:15:26.598 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.461535+0000", 2024-03-30T13:15:26.598 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:26.598 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:26.598 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:26.598 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:26.598 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.599 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 3724, 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.461535+0000", 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:26.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:26.601 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 3724, 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.524129+0000" 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 3724, 2024-03-30T13:15:26.602 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.524129+0000" 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 268, 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 34, 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:26.603 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:26.604 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:26.605 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:26.606 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.607 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.608 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.609 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.610 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:26.611 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:26.612 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:26.612 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:26.612 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.612 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:26.612 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:26.612 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:26.612 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:26.612 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:26.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.593+0000 7ff422800640 1 -- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3fc06c560 msgr2=0x7ff3fc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.593+0000 7ff422800640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3fc06c560 0x7ff3fc06ea20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff40c000f60 tx=0x7ff40c001a00 comp rx=0 tx=0).stop 2024-03-30T13:15:26.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.594+0000 7ff422800640 1 -- 172.21.15.44:0/1096131722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c1606d0 msgr2=0x7ff41c15df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.594+0000 7ff422800640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c1606d0 0x7ff41c15df90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c6e0 tx=0x7ff41400cba0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.594+0000 7ff422800640 1 -- 172.21.15.44:0/1096131722 shutdown_connections 2024-03-30T13:15:26.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.594+0000 7ff422800640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff41c1606d0 0x7ff41c15df90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.594+0000 7ff422800640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3fc06c560 0x7ff3fc06ea20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.594+0000 7ff422800640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff41c159e50 0x7ff41c155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.594+0000 7ff422800640 1 --2- 172.21.15.44:0/1096131722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff41c06b940 0x7ff41c14f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.594+0000 7ff422800640 1 -- 172.21.15.44:0/1096131722 >> 172.21.15.44:0/1096131722 conn(0x7ff41c0cd310 msgr2=0x7ff41c0af700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.595+0000 7ff422800640 1 -- 172.21.15.44:0/1096131722 shutdown_connections 2024-03-30T13:15:26.614 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.595+0000 7ff422800640 1 -- 172.21.15.44:0/1096131722 wait complete. 2024-03-30T13:15:26.630 DEBUG:tasks.cephfs.test_uninlining:getting inode info #6 of 23:1099511628386 2024-03-30T13:15:26.630 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628386 2024-03-30T13:15:26.630 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628386 2024-03-30T13:15:26.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.822+0000 7f25f1a00640 1 Processor -- start 2024-03-30T13:15:26.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.822+0000 7f25f1a00640 1 -- start start 2024-03-30T13:15:26.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.824+0000 7f25f1a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f25ec0b57f0 0x7f25ec169810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.824+0000 7f25f1a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25ec0b5c60 con 0x7f25ec0b37e0 2024-03-30T13:15:26.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.824+0000 7f25f1a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25ec0ce390 con 0x7f25ec0cca80 2024-03-30T13:15:26.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.824+0000 7f25f1a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f25ec06ea90 con 0x7f25ec0b57f0 2024-03-30T13:15:26.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.824+0000 7f25eaa00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f25ec0b37e0 0x7f25ec0b3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:49280/0 (socket says 172.21.15.44:49280) 2024-03-30T13:15:26.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.824+0000 7f25eaa00640 1 -- 172.21.15.44:0/2262873668 learned_addr learned my addr 172.21.15.44:0/2262873668 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:26.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.824+0000 7f25eb400640 1 --2- 172.21.15.44:0/2262873668 >> v2:172.21.15.151:3300/0 conn(0x7f25ec0b57f0 0x7f25ec169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.824+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811540116 0 0) 0x7f25ec0b5c60 con 0x7f25ec0b37e0 2024-03-30T13:15:26.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.824+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25d0003520 con 0x7f25ec0b37e0 2024-03-30T13:15:26.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 604315260 0 0) 0x7f25d0003520 con 0x7f25ec0b37e0 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 >> v2:172.21.15.151:3300/0 conn(0x7f25ec0b57f0 msgr2=0x7f25ec169810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 --2- 172.21.15.44:0/2262873668 >> v2:172.21.15.151:3300/0 conn(0x7f25ec0b57f0 0x7f25ec169810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 >> v1:172.21.15.151:6789/0 conn(0x7f25ec0cca80 legacy=0x7f25ec1660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ec0ccfd0 con 0x7f25ec0b37e0 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f25dc0019f0 con 0x7f25ec0b37e0 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 >> v1:172.21.15.44:6789/0 conn(0x7f25ec0b37e0 legacy=0x7f25ec0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 --2- 172.21.15.44:0/2262873668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25d0003a00 0x7f25d0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 --2- 172.21.15.44:0/2262873668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25d0004800 0x7f25d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 --2- 172.21.15.44:0/2262873668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d0005210 0x7f25d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec06ea90 con 0x7f25d0003a00 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f25d000c160 con 0x7f25d0004800 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f25d000c360 con 0x7f25d0005210 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.825+0000 7f25eaa00640 1 --2- 172.21.15.44:0/2262873668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25d0003a00 0x7f25d0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.826+0000 7f25e2000640 1 --2- 172.21.15.44:0/2262873668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25d0004800 0x7f25d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.826+0000 7f25eaa00640 1 -- 172.21.15.44:0/2262873668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d0005210 msgr2=0x7f25d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.826+0000 7f25eaa00640 1 --2- 172.21.15.44:0/2262873668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d0005210 0x7f25d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.826+0000 7f25eaa00640 1 -- 172.21.15.44:0/2262873668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25d0004800 msgr2=0x7f25d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.826+0000 7f25eaa00640 1 --2- 172.21.15.44:0/2262873668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25d0004800 0x7f25d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.826+0000 7f25eaa00640 1 -- 172.21.15.44:0/2262873668 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d0003520 con 0x7f25d0003a00 2024-03-30T13:15:26.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.826+0000 7f25eb400640 1 -- 172.21.15.44:0/2262873668 reap_dead start 2024-03-30T13:15:26.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.826+0000 7f25e2000640 1 --2- 172.21.15.44:0/2262873668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25d0004800 0x7f25d0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.827+0000 7f25eaa00640 1 --2- 172.21.15.44:0/2262873668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25d0003a00 0x7f25d0003e20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00a7b0 tx=0x7f25d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95d3bccca8ffb96 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.827+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00a3d0 con 0x7f25d0003a00 2024-03-30T13:15:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.827+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25dc034630 con 0x7f25d0003a00 2024-03-30T13:15:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.827+0000 7f25ea000640 1 -- 172.21.15.44:0/2262873668 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc034aa0 con 0x7f25d0003a00 2024-03-30T13:15:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.828+0000 7f25f1a00640 1 -- 172.21.15.44:0/2262873668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25d0003a00 msgr2=0x7f25d0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.828+0000 7f25f1a00640 1 --2- 172.21.15.44:0/2262873668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25d0003a00 0x7f25d0003e20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00a7b0 tx=0x7f25d0005830 comp rx=0 tx=0).stop 2024-03-30T13:15:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.828+0000 7f25f1a00640 1 -- 172.21.15.44:0/2262873668 shutdown_connections 2024-03-30T13:15:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.828+0000 7f25f1a00640 1 --2- 172.21.15.44:0/2262873668 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25d0003a00 0x7f25d0003e20 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.828+0000 7f25f1a00640 1 -- 172.21.15.44:0/2262873668 >> 172.21.15.44:0/2262873668 conn(0x7f25ec0cd310 msgr2=0x7f25ec0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.828+0000 7f25f1a00640 1 -- 172.21.15.44:0/2262873668 shutdown_connections 2024-03-30T13:15:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.828+0000 7f25f1a00640 1 -- 172.21.15.44:0/2262873668 wait complete. 2024-03-30T13:15:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.830+0000 7f25f1a00640 1 Processor -- start 2024-03-30T13:15:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.830+0000 7f25f1a00640 1 -- start start 2024-03-30T13:15:26.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.831+0000 7f25f1a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d0003a00 0x7f25ec15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.831+0000 7f25f1a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25ec1f7f80 0x7f25ec15c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.831+0000 7f25f1a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25ec15e4a0 0x7f25ec1f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.831+0000 7f25f1a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec06c550 con 0x7f25ec1f7f80 2024-03-30T13:15:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.831+0000 7f25f1a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec06c270 con 0x7f25ec15e4a0 2024-03-30T13:15:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.831+0000 7f25f1a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f25ec06c830 con 0x7f25d0003a00 2024-03-30T13:15:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.831+0000 7f25e2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25ec1f7f80 0x7f25ec15c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.831+0000 7f25e2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25ec1f7f80 0x7f25ec15c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52194/0 (socket says 172.21.15.44:52194) 2024-03-30T13:15:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.831+0000 7f25e2000640 1 -- 172.21.15.44:0/992491174 learned_addr learned my addr 172.21.15.44:0/992491174 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.832+0000 7f25eaa00640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d0003a00 0x7f25ec15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.832+0000 7f25eb400640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25ec15e4a0 0x7f25ec1f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.832+0000 7f25e2000640 1 -- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d0003a00 msgr2=0x7f25ec15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.832+0000 7f25e2000640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d0003a00 0x7f25ec15adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.832+0000 7f25e2000640 1 -- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25ec15e4a0 msgr2=0x7f25ec1f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.832+0000 7f25e2000640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25ec15e4a0 0x7f25ec1f4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.832+0000 7f25e2000640 1 -- 172.21.15.44:0/992491174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ec14cfe0 con 0x7f25ec1f7f80 2024-03-30T13:15:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.832+0000 7f25eb400640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25ec15e4a0 0x7f25ec1f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.832+0000 7f25eaa00640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d0003a00 0x7f25ec15adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.832+0000 7f25e2000640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25ec1f7f80 0x7f25ec15c900 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f25d400d480 tx=0x7f25d400d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.832+0000 7f25e3400640 1 -- 172.21.15.44:0/992491174 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4005480 con 0x7f25ec1f7f80 2024-03-30T13:15:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.833+0000 7f25e3400640 1 -- 172.21.15.44:0/992491174 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d4017070 con 0x7f25ec1f7f80 2024-03-30T13:15:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.833+0000 7f25e3400640 1 -- 172.21.15.44:0/992491174 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4003830 con 0x7f25ec1f7f80 2024-03-30T13:15:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.833+0000 7f25f1a00640 1 -- 172.21.15.44:0/992491174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ec1f8440 con 0x7f25ec1f7f80 2024-03-30T13:15:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.833+0000 7f25f1a00640 1 -- 172.21.15.44:0/992491174 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ec1f8a00 con 0x7f25ec1f7f80 2024-03-30T13:15:26.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.835+0000 7f25e3400640 1 -- 172.21.15.44:0/992491174 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f25d40039d0 con 0x7f25ec1f7f80 2024-03-30T13:15:26.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.836+0000 7f25e3400640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f25c806c530 0x7f25c806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.836+0000 7f25e3400640 1 -- 172.21.15.44:0/992491174 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6218+0+0 (secure 0 0 0) 0x7f25d408b6f0 con 0x7f25ec1f7f80 2024-03-30T13:15:26.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.836+0000 7f25eaa00640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f25c806c530 0x7f25c806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.838+0000 7f25eaa00640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f25c806c530 0x7f25c806e9f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00a780 tx=0x7f25dc02f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.839+0000 7f25f47dd740 1 Processor -- start 2024-03-30T13:15:26.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.839+0000 7f25f47dd740 1 -- start start 2024-03-30T13:15:26.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.840+0000 7f25f47dd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 0x557c4ab66dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.840+0000 7f25f47dd740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab67300 0x557c4ab3f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.840+0000 7f25f47dd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40670 0x557c4ab3f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.840+0000 7f25f47dd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557c4aaa3330 con 0x557c4ab40290 2024-03-30T13:15:26.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.840+0000 7f25f47dd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557c4aa4b620 con 0x557c4ab40670 2024-03-30T13:15:26.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.840+0000 7f25f47dd740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x557c4aa9f440 con 0x557c4ab67300 2024-03-30T13:15:26.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25eaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 0x557c4ab66dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25eaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 0x557c4ab66dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52198/0 (socket says 172.21.15.44:52198) 2024-03-30T13:15:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25eaa00640 1 -- 172.21.15.44:0/948622216 learned_addr learned my addr 172.21.15.44:0/948622216 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25eb400640 1 --2- 172.21.15.44:0/948622216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40670 0x557c4ab3f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25e2000640 1 --2- 172.21.15.44:0/948622216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab67300 0x557c4ab3f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25eaa00640 1 -- 172.21.15.44:0/948622216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab67300 msgr2=0x557c4ab3f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25eaa00640 1 --2- 172.21.15.44:0/948622216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab67300 0x557c4ab3f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25eaa00640 1 -- 172.21.15.44:0/948622216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40670 msgr2=0x557c4ab3f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25eaa00640 1 --2- 172.21.15.44:0/948622216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40670 0x557c4ab3f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25eaa00640 1 -- 172.21.15.44:0/948622216 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c4a883920 con 0x557c4ab40290 2024-03-30T13:15:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25eb400640 1 --2- 172.21.15.44:0/948622216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40670 0x557c4ab3f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25e2000640 1 --2- 172.21.15.44:0/948622216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab67300 0x557c4ab3f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:26.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.841+0000 7f25eaa00640 1 --2- 172.21.15.44:0/948622216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 0x557c4ab66dc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f25dc000f80 tx=0x7f25dc009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a143078c6a3f8512 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.842+0000 7f25db400640 1 -- 172.21.15.44:0/948622216 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc04c070 con 0x557c4ab40290 2024-03-30T13:15:26.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.842+0000 7f25db400640 1 -- 172.21.15.44:0/948622216 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25dc048410 con 0x557c4ab40290 2024-03-30T13:15:26.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.842+0000 7f25db400640 1 -- 172.21.15.44:0/948622216 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc043040 con 0x557c4ab40290 2024-03-30T13:15:26.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.842+0000 7f25f47dd740 1 -- 172.21.15.44:0/948622216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 msgr2=0x557c4ab66dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.842+0000 7f25f47dd740 1 --2- 172.21.15.44:0/948622216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 0x557c4ab66dc0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f25dc000f80 tx=0x7f25dc009030 comp rx=0 tx=0).stop 2024-03-30T13:15:26.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.843+0000 7f25f47dd740 1 -- 172.21.15.44:0/948622216 shutdown_connections 2024-03-30T13:15:26.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.843+0000 7f25f47dd740 1 --2- 172.21.15.44:0/948622216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40670 0x557c4ab3f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.843+0000 7f25f47dd740 1 --2- 172.21.15.44:0/948622216 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab67300 0x557c4ab3f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.843+0000 7f25f47dd740 1 --2- 172.21.15.44:0/948622216 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 0x557c4ab66dc0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.843+0000 7f25f47dd740 1 -- 172.21.15.44:0/948622216 >> 172.21.15.44:0/948622216 conn(0x557c4ab06be0 msgr2=0x557c4ab84fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.843+0000 7f25f47dd740 1 -- 172.21.15.44:0/948622216 shutdown_connections 2024-03-30T13:15:26.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.843+0000 7f25f47dd740 1 -- 172.21.15.44:0/948622216 wait complete. 2024-03-30T13:15:26.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.843+0000 7f25f47dd740 1 -- start start 2024-03-30T13:15:26.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.844+0000 7f25f47dd740 1 Processor -- start 2024-03-30T13:15:26.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.845+0000 7f25f47dd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40290 0x557c4ab5e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.845+0000 7f25f47dd740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab40670 0x557c4ab954c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.845+0000 7f25f47dd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab81b20 0x557c4ab81fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.845+0000 7f25f47dd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557c4ab66930 con 0x557c4ab81b20 2024-03-30T13:15:26.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.845+0000 7f25f47dd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557c4aa5e9d0 con 0x557c4ab40290 2024-03-30T13:15:26.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.845+0000 7f25f47dd740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x557c4ab5f6b0 con 0x557c4ab40670 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.845+0000 7f25f47dd740 10 client.0 _ll_register_callbacks cb 0x557c4aa9afd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.845+0000 7f25eb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab81b20 0x557c4ab81fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.845+0000 7f25eb400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab81b20 0x557c4ab81fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52214/0 (socket says 172.21.15.44:52214) 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.845+0000 7f25eb400640 1 -- 172.21.15.44:0/4069976376 learned_addr learned my addr 172.21.15.44:0/4069976376 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.845+0000 7f25eaa00640 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40290 0x557c4ab5e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.845+0000 7f25e2000640 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab40670 0x557c4ab954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.846+0000 7f25eb400640 1 -- 172.21.15.44:0/4069976376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab40670 msgr2=0x557c4ab954c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.846+0000 7f25eb400640 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab40670 0x557c4ab954c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.846+0000 7f25eb400640 1 -- 172.21.15.44:0/4069976376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40290 msgr2=0x557c4ab5e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.846+0000 7f25eb400640 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40290 0x557c4ab5e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.846+0000 7f25eb400640 1 -- 172.21.15.44:0/4069976376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c4a777210 con 0x557c4ab81b20 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.846+0000 7f25eb400640 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab81b20 0x557c4ab81fa0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0ce630 tx=0x7f25e400f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72ec2952119eb48 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.846+0000 7f25cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.846+0000 7f25cfe00640 1 -- 172.21.15.44:0/4069976376 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e4018070 con 0x557c4ab81b20 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.846+0000 7f25cfe00640 1 -- 172.21.15.44:0/4069976376 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6218+0+0 (secure 0 0 0) 0x7f25e4014480 con 0x557c4ab81b20 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.846+0000 7f25f47dd740 1 -- 172.21.15.44:0/4069976376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25dc048410 con 0x557c4ab81b20 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.847+0000 7f25cfe00640 1 -- 172.21.15.44:0/4069976376 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f25e4023050 con 0x557c4ab81b20 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.847+0000 7f25f47dd740 10 client.6186 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.847+0000 7f25f47dd740 1 -- 172.21.15.44:0/4069976376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x557c4a8e40b0 con 0x557c4ab81b20 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.847+0000 7f25cfe00640 1 -- 172.21.15.44:0/4069976376 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25dc048410 con 0x557c4ab81b20 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.847+0000 7f25cfe00640 1 -- 172.21.15.44:0/4069976376 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f25e4026020 con 0x557c4ab81b20 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.847+0000 7f25f47dd740 10 client.6186 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.847+0000 7f25f47dd740 10 client.6186 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.847+0000 7f25f47dd740 20 client.6186 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.847+0000 7f25f47dd740 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557c4ab7d260 0x557c4ab7d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.847+0000 7f25f47dd740 4 client.6186 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:26.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.847+0000 7f25f47dd740 1 -- 172.21.15.44:0/4069976376 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c4aab0870 con 0x557c4ab7d260 2024-03-30T13:15:26.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.848+0000 7f25eaa00640 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557c4ab7d260 0x557c4ab7d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.848+0000 7f25eaa00640 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557c4ab7d260 0x557c4ab7d640 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=617dd4eb1255792d server_cookie=c58c62f4f13b54f2 in_seq=0 out_seq=0 2024-03-30T13:15:26.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.848+0000 7f25cfe00640 10 client.6186 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:26.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.849+0000 7f25cfe00640 1 -- 172.21.15.44:0/4069976376 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x557c4aab0870 con 0x557c4ab7d260 2024-03-30T13:15:26.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.849+0000 7f25cfe00640 10 client.6186 handle_command_reply: tid=0 2024-03-30T13:15:26.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.849+0000 7f25f47dd740 1 client.6186 shutdown 2024-03-30T13:15:26.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.849+0000 7f25f47dd740 1 -- 172.21.15.44:0/4069976376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab81b20 msgr2=0x557c4ab81fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.849+0000 7f25f47dd740 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab81b20 0x557c4ab81fa0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0ce630 tx=0x7f25e400f5b0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.850+0000 7f25f47dd740 1 -- 172.21.15.44:0/4069976376 shutdown_connections 2024-03-30T13:15:26.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.850+0000 7f25f47dd740 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557c4ab7d260 0x557c4ab7d640 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.850+0000 7f25f47dd740 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab81b20 0x557c4ab81fa0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.850+0000 7f25f47dd740 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab40670 0x557c4ab954c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.850+0000 7f25f47dd740 1 --2- 172.21.15.44:0/4069976376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40290 0x557c4ab5e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.850+0000 7f25f47dd740 1 -- 172.21.15.44:0/4069976376 >> 172.21.15.44:0/4069976376 conn(0x557c4ab06be0 msgr2=0x557c4ab66150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.850+0000 7f25cfe00640 0 client.6186 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:26.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.850+0000 7f25f47dd740 1 -- 172.21.15.44:0/4069976376 shutdown_connections 2024-03-30T13:15:26.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.850+0000 7f25f47dd740 1 -- 172.21.15.44:0/4069976376 wait complete. 2024-03-30T13:15:26.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.850+0000 7f25f47dd740 20 client.6186 trim_cache size 0 max 16384 2024-03-30T13:15:26.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.882+0000 7f25f47dd740 1 Processor -- start 2024-03-30T13:15:26.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.882+0000 7f25f47dd740 1 -- start start 2024-03-30T13:15:26.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.884+0000 7f25f47dd740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab40290 0x557c4ab5d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.884+0000 7f25f47dd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40670 0x557c4ab80be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.884+0000 7f25f47dd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab81b20 0x557c4ab87510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.884+0000 7f25f47dd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec2019c0 con 0x557c4ab40670 2024-03-30T13:15:26.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.884+0000 7f25f47dd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec2009f0 con 0x557c4ab81b20 2024-03-30T13:15:26.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.884+0000 7f25f47dd740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f25ec1464e0 con 0x557c4ab40290 2024-03-30T13:15:26.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.884+0000 7f25e2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40670 0x557c4ab80be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.884+0000 7f25e2000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40670 0x557c4ab80be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52216/0 (socket says 172.21.15.44:52216) 2024-03-30T13:15:26.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.884+0000 7f25e2000640 1 -- 172.21.15.44:0/4061390689 learned_addr learned my addr 172.21.15.44:0/4061390689 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.884+0000 7f25e2000640 1 -- 172.21.15.44:0/4061390689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab40290 msgr2=0x557c4ab5d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.885+0000 7f25e2000640 1 --2- 172.21.15.44:0/4061390689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab40290 0x557c4ab5d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.885+0000 7f25e2000640 1 -- 172.21.15.44:0/4061390689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab81b20 msgr2=0x557c4ab87510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.885+0000 7f25eb400640 1 --2- 172.21.15.44:0/4061390689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab81b20 0x557c4ab87510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.885+0000 7f25e2000640 1 --2- 172.21.15.44:0/4061390689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab81b20 0x557c4ab87510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.885+0000 7f25e2000640 1 -- 172.21.15.44:0/4061390689 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c4a7502d0 con 0x557c4ab40670 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.885+0000 7f25e2000640 1 --2- 172.21.15.44:0/4061390689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40670 0x557c4ab80be0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f25d40011d0 tx=0x7f25d4059680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef185b1e93d199f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.885+0000 7f25daa00640 1 -- 172.21.15.44:0/4061390689 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4055be0 con 0x557c4ab40670 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.885+0000 7f25daa00640 1 -- 172.21.15.44:0/4061390689 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d4089070 con 0x557c4ab40670 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.885+0000 7f25daa00640 1 -- 172.21.15.44:0/4061390689 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4055d80 con 0x557c4ab40670 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.886+0000 7f25f47dd740 1 -- 172.21.15.44:0/4061390689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40670 msgr2=0x557c4ab80be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.886+0000 7f25f47dd740 1 --2- 172.21.15.44:0/4061390689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40670 0x557c4ab80be0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f25d40011d0 tx=0x7f25d4059680 comp rx=0 tx=0).stop 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.886+0000 7f25f47dd740 1 -- 172.21.15.44:0/4061390689 shutdown_connections 2024-03-30T13:15:26.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.886+0000 7f25f47dd740 1 --2- 172.21.15.44:0/4061390689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab81b20 0x557c4ab87510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.886+0000 7f25f47dd740 1 --2- 172.21.15.44:0/4061390689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40670 0x557c4ab80be0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.886+0000 7f25f47dd740 1 --2- 172.21.15.44:0/4061390689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab40290 0x557c4ab5d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.886+0000 7f25f47dd740 1 -- 172.21.15.44:0/4061390689 >> 172.21.15.44:0/4061390689 conn(0x557c4ab06be0 msgr2=0x557c4ab7d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.886+0000 7f25f47dd740 1 -- 172.21.15.44:0/4061390689 shutdown_connections 2024-03-30T13:15:26.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.886+0000 7f25f47dd740 1 -- 172.21.15.44:0/4061390689 wait complete. 2024-03-30T13:15:26.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.887+0000 7f25f47dd740 1 -- start start 2024-03-30T13:15:26.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.887+0000 7f25f47dd740 1 Processor -- start 2024-03-30T13:15:26.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.889+0000 7f25f47dd740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 0x557c4ab5bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.889+0000 7f25f47dd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40670 0x557c4ab6d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.889+0000 7f25f47dd740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab81b20 0x557c4ab7afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.889+0000 7f25f47dd740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x557c4ab85d10 con 0x557c4ab40290 2024-03-30T13:15:26.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.889+0000 7f25f47dd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f25ec200590 con 0x557c4ab40670 2024-03-30T13:15:26.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.889+0000 7f25f47dd740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x557c4ab3c670 con 0x557c4ab81b20 2024-03-30T13:15:26.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.889+0000 7f25f47dd740 10 client.0 _ll_register_callbacks cb 0x7f25e400d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:26.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.889+0000 7f25eaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 0x557c4ab5bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.889+0000 7f25eaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 0x557c4ab5bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52220/0 (socket says 172.21.15.44:52220) 2024-03-30T13:15:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.889+0000 7f25eaa00640 1 -- 172.21.15.44:0/3838998884 learned_addr learned my addr 172.21.15.44:0/3838998884 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.890+0000 7f25eaa00640 1 -- 172.21.15.44:0/3838998884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab81b20 msgr2=0x557c4ab7afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.890+0000 7f25eaa00640 1 --2- 172.21.15.44:0/3838998884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab81b20 0x557c4ab7afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.890+0000 7f25eaa00640 1 -- 172.21.15.44:0/3838998884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40670 msgr2=0x557c4ab6d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.890+0000 7f25eaa00640 1 --2- 172.21.15.44:0/3838998884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40670 0x557c4ab6d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.890+0000 7f25eaa00640 1 -- 172.21.15.44:0/3838998884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c4ab7f730 con 0x557c4ab40290 2024-03-30T13:15:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.890+0000 7f25eaa00640 1 --2- 172.21.15.44:0/3838998884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 0x557c4ab5bc60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00a620 tx=0x7f25dc001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8a57a79ed8af8b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:26.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.890+0000 7f25cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.890+0000 7f25cfe00640 1 -- 172.21.15.44:0/3838998884 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc043040 con 0x557c4ab40290 2024-03-30T13:15:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.890+0000 7f25cfe00640 1 -- 172.21.15.44:0/3838998884 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6218+0+0 (secure 0 0 0) 0x7f25dc048610 con 0x557c4ab40290 2024-03-30T13:15:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.890+0000 7f25f47dd740 1 -- 172.21.15.44:0/3838998884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25d4089070 con 0x557c4ab40290 2024-03-30T13:15:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.891+0000 7f25cfe00640 1 -- 172.21.15.44:0/3838998884 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f25dc060050 con 0x557c4ab40290 2024-03-30T13:15:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.891+0000 7f25f47dd740 10 client.6192 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.891+0000 7f25f47dd740 1 -- 172.21.15.44:0/3838998884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x557c4ab7e660 con 0x557c4ab40290 2024-03-30T13:15:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.891+0000 7f25cfe00640 1 -- 172.21.15.44:0/3838998884 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d4089070 con 0x557c4ab40290 2024-03-30T13:15:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.891+0000 7f25cfe00640 1 -- 172.21.15.44:0/3838998884 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f25dc063020 con 0x557c4ab40290 2024-03-30T13:15:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.891+0000 7f25f47dd740 10 client.6192 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:26.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.891+0000 7f25f47dd740 10 client.6192 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:26.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.891+0000 7f25f47dd740 20 client.6192 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:26.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.891+0000 7f25f47dd740 1 --2- 172.21.15.44:0/3838998884 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557c4ab6d870 0x557c4ab7b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:26.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.891+0000 7f25f47dd740 4 client.6192 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628386}] 2024-03-30T13:15:26.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.891+0000 7f25f47dd740 1 -- 172.21.15.44:0/3838998884 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628386}) -- 0x557c4aaaabc0 con 0x557c4ab6d870 2024-03-30T13:15:26.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.891+0000 7f25e2000640 1 --2- 172.21.15.44:0/3838998884 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557c4ab6d870 0x557c4ab7b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:26.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.892+0000 7f25e2000640 1 --2- 172.21.15.44:0/3838998884 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557c4ab6d870 0x557c4ab7b4f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d71ff9110bb51f11 server_cookie=4b59b4fcaf8d9f6 in_seq=0 out_seq=0 2024-03-30T13:15:26.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.892+0000 7f25cfe00640 10 client.6192 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:26.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.892+0000 7f25cfe00640 1 -- 172.21.15.44:0/3838998884 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4755 (crc 0 0 0) 0x557c4aaaabc0 con 0x557c4ab6d870 2024-03-30T13:15:26.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.892+0000 7f25cfe00640 10 client.6192 handle_command_reply: tid=0 2024-03-30T13:15:26.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.892+0000 7f25f47dd740 1 client.6192 shutdown 2024-03-30T13:15:26.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.892+0000 7f25f47dd740 1 -- 172.21.15.44:0/3838998884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 msgr2=0x557c4ab5bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.892+0000 7f25f47dd740 1 --2- 172.21.15.44:0/3838998884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 0x557c4ab5bc60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00a620 tx=0x7f25dc001cf0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f47dd740 1 -- 172.21.15.44:0/3838998884 shutdown_connections 2024-03-30T13:15:26.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f47dd740 1 --2- 172.21.15.44:0/3838998884 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x557c4ab6d870 0x557c4ab7b4f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f47dd740 1 --2- 172.21.15.44:0/3838998884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c4ab81b20 0x557c4ab7afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f47dd740 1 --2- 172.21.15.44:0/3838998884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c4ab40670 0x557c4ab6d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f47dd740 1 --2- 172.21.15.44:0/3838998884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x557c4ab40290 0x557c4ab5bc60 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f47dd740 1 -- 172.21.15.44:0/3838998884 >> 172.21.15.44:0/3838998884 conn(0x557c4ab06be0 msgr2=0x557c4ab80e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25cfe00640 0 client.6192 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:26.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f47dd740 1 -- 172.21.15.44:0/3838998884 shutdown_connections 2024-03-30T13:15:26.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f47dd740 1 -- 172.21.15.44:0/3838998884 wait complete. 2024-03-30T13:15:26.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f47dd740 20 client.6192 trim_cache size 0 max 16384 2024-03-30T13:15:26.901 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:26.902 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/Kconfig", 2024-03-30T13:15:26.902 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628386, 2024-03-30T13:15:26.902 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:26.902 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.533109+0000", 2024-03-30T13:15:26.902 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.534534+0000", 2024-03-30T13:15:26.902 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:26.902 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:26.902 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:26.902 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:26.902 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:26.903 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:26.903 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:26.903 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:26.903 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:26.903 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.903 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:26.903 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:26.903 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:26.903 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:26.903 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 1240, 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.534534+0000", 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:26.904 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:26.905 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:26.906 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:26.906 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:26.906 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:26.906 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.906 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:26.906 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1240, 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.533109+0000" 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1240, 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.533109+0000" 2024-03-30T13:15:26.907 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.908 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 150, 2024-03-30T13:15:26.908 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:26.908 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:26.908 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 2, 2024-03-30T13:15:26.908 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:26.908 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:26.908 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:26.908 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:26.908 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:26.908 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:26.908 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:26.908 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.909 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:26.909 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:26.909 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:26.909 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:26.909 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:26.909 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:26.910 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:26.910 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:26.910 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.910 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:26.910 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:26.910 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.911 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:26.911 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:26.911 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:26.911 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:26.911 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:26.911 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:26.911 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.911 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:26.911 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:26.911 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:26.911 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:26.912 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.912 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:26.912 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.912 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:26.912 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:26.912 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:26.912 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:26.912 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:26.912 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:26.912 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:26.912 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:26.913 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:26.913 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:26.913 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:26.913 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:26.913 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:26.913 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.913 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:26.913 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:26.913 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.913 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:26.913 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.914 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.915 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:26.916 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:26.917 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:26.918 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:26.919 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:26.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f1a00640 1 -- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f25c806c530 msgr2=0x7f25c806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f1a00640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f25c806c530 0x7f25c806e9f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00a780 tx=0x7f25dc02f000 comp rx=0 tx=0).stop 2024-03-30T13:15:26.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f1a00640 1 -- 172.21.15.44:0/992491174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25ec1f7f80 msgr2=0x7f25ec15c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:26.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.893+0000 7f25f1a00640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25ec1f7f80 0x7f25ec15c900 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f25d400d480 tx=0x7f25d400d940 comp rx=0 tx=0).stop 2024-03-30T13:15:26.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.894+0000 7f25f1a00640 1 -- 172.21.15.44:0/992491174 shutdown_connections 2024-03-30T13:15:26.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.894+0000 7f25f1a00640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f25c806c530 0x7f25c806e9f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.894+0000 7f25f1a00640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25ec15e4a0 0x7f25ec1f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.894+0000 7f25f1a00640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f25ec1f7f80 0x7f25ec15c900 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.894+0000 7f25f1a00640 1 --2- 172.21.15.44:0/992491174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25d0003a00 0x7f25ec15adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:26.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.894+0000 7f25f1a00640 1 -- 172.21.15.44:0/992491174 >> 172.21.15.44:0/992491174 conn(0x7f25ec0cd310 msgr2=0x7f25ec0d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:26.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.894+0000 7f25f1a00640 1 -- 172.21.15.44:0/992491174 shutdown_connections 2024-03-30T13:15:26.922 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:26.894+0000 7f25f1a00640 1 -- 172.21.15.44:0/992491174 wait complete. 2024-03-30T13:15:26.922 DEBUG:tasks.cephfs.test_uninlining:getting inode info #7 of 23:1099511628404 2024-03-30T13:15:26.922 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628404 2024-03-30T13:15:26.922 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628404 2024-03-30T13:15:27.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.127+0000 7fc29b000640 1 Processor -- start 2024-03-30T13:15:27.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.127+0000 7fc29b000640 1 -- start start 2024-03-30T13:15:27.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.129+0000 7fc29b000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc2940b4920 0x7fc2940b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.129+0000 7fc29b000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc2940b4d00 0x7fc2940d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.129+0000 7fc29b000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2940b54b0 con 0x7fc2940d0b90 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.129+0000 7fc29b000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc2940d0260 con 0x7fc2940b4920 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.129+0000 7fc29b000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fc2940cfca0 con 0x7fc2940b4d00 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.129+0000 7fc299c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc2940b4920 0x7fc2940b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.129+0000 7fc299c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc2940b4920 0x7fc2940b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53872/0 (socket says 172.21.15.44:53872) 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.129+0000 7fc299c00640 1 -- 172.21.15.44:0/732863137 learned_addr learned my addr 172.21.15.44:0/732863137 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.130+0000 7fc299200640 1 --2- 172.21.15.44:0/732863137 >> v2:172.21.15.151:3300/0 conn(0x7fc2940b4d00 0x7fc2940d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.130+0000 7fc299c00640 1 -- 172.21.15.44:0/732863137 >> v2:172.21.15.151:3300/0 conn(0x7fc2940b4d00 msgr2=0x7fc2940d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.130+0000 7fc299c00640 1 --2- 172.21.15.44:0/732863137 >> v2:172.21.15.151:3300/0 conn(0x7fc2940b4d00 0x7fc2940d4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.130+0000 7fc299c00640 1 -- 172.21.15.44:0/732863137 >> v1:172.21.15.151:6789/0 conn(0x7fc2940d0b90 legacy=0x7fc2940d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.130+0000 7fc299c00640 1 -- 172.21.15.44:0/732863137 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2940cff80 con 0x7fc2940b4920 2024-03-30T13:15:27.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.130+0000 7fc299200640 1 --2- 172.21.15.44:0/732863137 >> v2:172.21.15.151:3300/0 conn(0x7fc2940b4d00 0x7fc2940d4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.131+0000 7fc299c00640 1 --2- 172.21.15.44:0/732863137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2940b4920 0x7fc2940b3ab0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc2941621f0 tx=0x7fc28802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d283375fff478a2c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.131+0000 7fc293e00640 1 -- 172.21.15.44:0/732863137 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28802e070 con 0x7fc2940b4920 2024-03-30T13:15:27.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.131+0000 7fc293e00640 1 -- 172.21.15.44:0/732863137 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc288037070 con 0x7fc2940b4920 2024-03-30T13:15:27.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.131+0000 7fc293e00640 1 -- 172.21.15.44:0/732863137 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288031a00 con 0x7fc2940b4920 2024-03-30T13:15:27.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.132+0000 7fc29b000640 1 -- 172.21.15.44:0/732863137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2940b4920 msgr2=0x7fc2940b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.132+0000 7fc29b000640 1 --2- 172.21.15.44:0/732863137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2940b4920 0x7fc2940b3ab0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc2941621f0 tx=0x7fc28802b880 comp rx=0 tx=0).stop 2024-03-30T13:15:27.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.132+0000 7fc29b000640 1 -- 172.21.15.44:0/732863137 shutdown_connections 2024-03-30T13:15:27.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.132+0000 7fc29b000640 1 --2- 172.21.15.44:0/732863137 >> v2:172.21.15.151:3300/0 conn(0x7fc2940b4d00 0x7fc2940d4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.132+0000 7fc29b000640 1 --2- 172.21.15.44:0/732863137 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2940b4920 0x7fc2940b3ab0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.132+0000 7fc29b000640 1 -- 172.21.15.44:0/732863137 >> 172.21.15.44:0/732863137 conn(0x7fc29409d4e0 msgr2=0x7fc2940d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.132+0000 7fc29b000640 1 -- 172.21.15.44:0/732863137 shutdown_connections 2024-03-30T13:15:27.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.132+0000 7fc29b000640 1 -- 172.21.15.44:0/732863137 wait complete. 2024-03-30T13:15:27.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.134+0000 7fc29b000640 1 Processor -- start 2024-03-30T13:15:27.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.134+0000 7fc29b000640 1 -- start start 2024-03-30T13:15:27.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.135+0000 7fc29b000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2940b4920 0x7fc29414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.135+0000 7fc29b000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2940b4d00 0x7fc2940b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.135+0000 7fc29b000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2940d0b90 0x7fc2940b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.136+0000 7fc29b000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940b3ff0 con 0x7fc2940b4920 2024-03-30T13:15:27.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.136+0000 7fc29b000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940d2180 con 0x7fc2940b4d00 2024-03-30T13:15:27.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.136+0000 7fc29b000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc2940d5000 con 0x7fc2940d0b90 2024-03-30T13:15:27.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.136+0000 7fc299c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2940b4920 0x7fc29414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.136+0000 7fc299c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2940b4920 0x7fc29414f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53876/0 (socket says 172.21.15.44:53876) 2024-03-30T13:15:27.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.136+0000 7fc299c00640 1 -- 172.21.15.44:0/481285118 learned_addr learned my addr 172.21.15.44:0/481285118 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.136+0000 7fc299200640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2940b4d00 0x7fc2940b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.136+0000 7fc299c00640 1 -- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2940d0b90 msgr2=0x7fc2940b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.136+0000 7fc299c00640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2940d0b90 0x7fc2940b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.136+0000 7fc299c00640 1 -- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2940b4d00 msgr2=0x7fc2940b86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.136+0000 7fc299c00640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2940b4d00 0x7fc2940b86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.136+0000 7fc299c00640 1 -- 172.21.15.44:0/481285118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc294150fa0 con 0x7fc2940b4920 2024-03-30T13:15:27.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.137+0000 7fc299c00640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2940b4920 0x7fc29414f660 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc288000c00 tx=0x7fc2880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.137+0000 7fc291600640 1 -- 172.21.15.44:0/481285118 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288032880 con 0x7fc2940b4920 2024-03-30T13:15:27.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.137+0000 7fc291600640 1 -- 172.21.15.44:0/481285118 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc288032a20 con 0x7fc2940b4920 2024-03-30T13:15:27.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.137+0000 7fc291600640 1 -- 172.21.15.44:0/481285118 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288032e10 con 0x7fc2940b4920 2024-03-30T13:15:27.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.137+0000 7fc29b000640 1 -- 172.21.15.44:0/481285118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc294151280 con 0x7fc2940b4920 2024-03-30T13:15:27.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.137+0000 7fc29b000640 1 -- 172.21.15.44:0/481285118 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc294151840 con 0x7fc2940b4920 2024-03-30T13:15:27.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.139+0000 7fc291600640 1 -- 172.21.15.44:0/481285118 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc28804c060 con 0x7fc2940b4920 2024-03-30T13:15:27.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.140+0000 7fc291600640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc27406c530 0x7fc27406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.140+0000 7fc291600640 1 -- 172.21.15.44:0/481285118 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6218+0+0 (secure 0 0 0) 0x7fc2880ad1b0 con 0x7fc2940b4920 2024-03-30T13:15:27.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.141+0000 7fc299200640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc27406c530 0x7fc27406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.141+0000 7fc29f3df740 1 Processor -- start 2024-03-30T13:15:27.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.141+0000 7fc29f3df740 1 -- start start 2024-03-30T13:15:27.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc29f3df740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664470 0x5563bb68afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc29f3df740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb68b4e0 0x5563bb6634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc29f3df740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb664850 0x5563bb6639f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc29f3df740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5563bb5c7330 con 0x5563bb664470 2024-03-30T13:15:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc299200640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc27406c530 0x7fc27406e9f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2940cdf80 tx=0x7fc280008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc29f3df740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5563bb56f620 con 0x5563bb68b4e0 2024-03-30T13:15:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc29f3df740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5563bb5c3440 con 0x5563bb664850 2024-03-30T13:15:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc299c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664470 0x5563bb68afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc299c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664470 0x5563bb68afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53880/0 (socket says 172.21.15.44:53880) 2024-03-30T13:15:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc299c00640 1 -- 172.21.15.44:0/3730314180 learned_addr learned my addr 172.21.15.44:0/3730314180 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc299200640 1 --2- 172.21.15.44:0/3730314180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb68b4e0 0x5563bb6634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc29a600640 1 --2- 172.21.15.44:0/3730314180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb664850 0x5563bb6639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc299c00640 1 -- 172.21.15.44:0/3730314180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb664850 msgr2=0x5563bb6639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc299c00640 1 --2- 172.21.15.44:0/3730314180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb664850 0x5563bb6639f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc299c00640 1 -- 172.21.15.44:0/3730314180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb68b4e0 msgr2=0x5563bb6634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.142+0000 7fc299c00640 1 --2- 172.21.15.44:0/3730314180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb68b4e0 0x5563bb6634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.143+0000 7fc299c00640 1 -- 172.21.15.44:0/3730314180 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563bb3a7920 con 0x5563bb664470 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.143+0000 7fc29a600640 1 --2- 172.21.15.44:0/3730314180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb664850 0x5563bb6639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.143+0000 7fc299200640 1 --2- 172.21.15.44:0/3730314180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb68b4e0 0x5563bb6634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.143+0000 7fc299c00640 1 --2- 172.21.15.44:0/3730314180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664470 0x5563bb68afa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc28802be90 tx=0x7fc28807ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162267d20115a34 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.143+0000 7fc286000640 1 -- 172.21.15.44:0/3730314180 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288093020 con 0x5563bb664470 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.143+0000 7fc286000640 1 -- 172.21.15.44:0/3730314180 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc288037050 con 0x5563bb664470 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.143+0000 7fc286000640 1 -- 172.21.15.44:0/3730314180 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28807f1e0 con 0x5563bb664470 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.144+0000 7fc29f3df740 1 -- 172.21.15.44:0/3730314180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664470 msgr2=0x5563bb68afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.144+0000 7fc29f3df740 1 --2- 172.21.15.44:0/3730314180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664470 0x5563bb68afa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc28802be90 tx=0x7fc28807ad30 comp rx=0 tx=0).stop 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.144+0000 7fc29f3df740 1 -- 172.21.15.44:0/3730314180 shutdown_connections 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.144+0000 7fc29f3df740 1 --2- 172.21.15.44:0/3730314180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb664850 0x5563bb6639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.144+0000 7fc29f3df740 1 --2- 172.21.15.44:0/3730314180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb68b4e0 0x5563bb6634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.144+0000 7fc29f3df740 1 --2- 172.21.15.44:0/3730314180 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664470 0x5563bb68afa0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.144+0000 7fc29f3df740 1 -- 172.21.15.44:0/3730314180 >> 172.21.15.44:0/3730314180 conn(0x5563bb62abe0 msgr2=0x5563bb6a9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.144+0000 7fc29f3df740 1 -- 172.21.15.44:0/3730314180 shutdown_connections 2024-03-30T13:15:27.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.144+0000 7fc29f3df740 1 -- 172.21.15.44:0/3730314180 wait complete. 2024-03-30T13:15:27.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.145+0000 7fc29f3df740 1 -- start start 2024-03-30T13:15:27.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.145+0000 7fc29f3df740 1 Processor -- start 2024-03-30T13:15:27.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.146+0000 7fc29f3df740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb664470 0x5563bb6ab720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.146+0000 7fc29f3df740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.146+0000 7fc29f3df740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb682cd0 0x5563bb6a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.146+0000 7fc29f3df740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5563bb56f620 con 0x5563bb664850 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.146+0000 7fc29f3df740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5563bb5829d0 con 0x5563bb664470 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.146+0000 7fc29f3df740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5563bb5c7330 con 0x5563bb682cd0 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.146+0000 7fc29f3df740 10 client.0 _ll_register_callbacks cb 0x5563bb5befd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.146+0000 7fc299200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.146+0000 7fc299200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6acfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53886/0 (socket says 172.21.15.44:53886) 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.146+0000 7fc299200640 1 -- 172.21.15.44:0/1815009986 learned_addr learned my addr 172.21.15.44:0/1815009986 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.146+0000 7fc299c00640 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb664470 0x5563bb6ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.147+0000 7fc29a600640 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb682cd0 0x5563bb6a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.147+0000 7fc299200640 1 -- 172.21.15.44:0/1815009986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb682cd0 msgr2=0x5563bb6a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.147+0000 7fc299200640 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb682cd0 0x5563bb6a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.147+0000 7fc299200640 1 -- 172.21.15.44:0/1815009986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb664470 msgr2=0x5563bb6ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.147+0000 7fc299200640 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb664470 0x5563bb6ab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.147+0000 7fc299200640 1 -- 172.21.15.44:0/1815009986 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563bb29b210 con 0x5563bb664850 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.147+0000 7fc29a600640 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb682cd0 0x5563bb6a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.147+0000 7fc299200640 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6acfc0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc2800126c0 tx=0x7fc280004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b143afb8e0a9cc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.147+0000 7fc27aa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.147+0000 7fc27aa00640 1 -- 172.21.15.44:0/1815009986 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28001f610 con 0x5563bb664850 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.147+0000 7fc29f3df740 1 -- 172.21.15.44:0/1815009986 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc288037050 con 0x5563bb664850 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.147+0000 7fc27aa00640 1 -- 172.21.15.44:0/1815009986 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6218+0+0 (secure 0 0 0) 0x7fc28001f7b0 con 0x5563bb664850 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.148+0000 7fc27aa00640 1 -- 172.21.15.44:0/1815009986 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc28002c050 con 0x5563bb664850 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.148+0000 7fc29f3df740 10 client.6204 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.148+0000 7fc29f3df740 1 -- 172.21.15.44:0/1815009986 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5563bb4080b0 con 0x5563bb664850 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.148+0000 7fc27aa00640 1 -- 172.21.15.44:0/1815009986 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc288037050 con 0x5563bb664850 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.148+0000 7fc27aa00640 1 -- 172.21.15.44:0/1815009986 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc28002f020 con 0x5563bb664850 2024-03-30T13:15:27.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.148+0000 7fc29f3df740 10 client.6204 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.148+0000 7fc29f3df740 10 client.6204 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.148+0000 7fc29f3df740 20 client.6204 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.148+0000 7fc29f3df740 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5563bb68f7b0 0x5563bb690a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.148+0000 7fc29f3df740 4 client.6204 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.148+0000 7fc29f3df740 1 -- 172.21.15.44:0/1815009986 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563bb5d4870 con 0x5563bb68f7b0 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.149+0000 7fc299c00640 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5563bb68f7b0 0x5563bb690a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.149+0000 7fc299c00640 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5563bb68f7b0 0x5563bb690a10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72d10b6da948142b server_cookie=cc095d45c572e85e in_seq=0 out_seq=0 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.149+0000 7fc27aa00640 10 client.6204 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc27aa00640 1 -- 172.21.15.44:0/1815009986 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5563bb5d4870 con 0x5563bb68f7b0 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc27aa00640 10 client.6204 handle_command_reply: tid=0 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc29f3df740 1 client.6204 shutdown 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc29f3df740 1 -- 172.21.15.44:0/1815009986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 msgr2=0x5563bb6acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc29f3df740 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6acfc0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc2800126c0 tx=0x7fc280004730 comp rx=0 tx=0).stop 2024-03-30T13:15:27.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc29f3df740 1 -- 172.21.15.44:0/1815009986 shutdown_connections 2024-03-30T13:15:27.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc29f3df740 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5563bb68f7b0 0x5563bb690a10 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc29f3df740 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb682cd0 0x5563bb6a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc29f3df740 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6acfc0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc29f3df740 1 --2- 172.21.15.44:0/1815009986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb664470 0x5563bb6ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc29f3df740 1 -- 172.21.15.44:0/1815009986 >> 172.21.15.44:0/1815009986 conn(0x5563bb62abe0 msgr2=0x5563bb65db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc27aa00640 0 client.6204 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc29f3df740 1 -- 172.21.15.44:0/1815009986 shutdown_connections 2024-03-30T13:15:27.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc29f3df740 1 -- 172.21.15.44:0/1815009986 wait complete. 2024-03-30T13:15:27.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.150+0000 7fc29f3df740 20 client.6204 trim_cache size 0 max 16384 2024-03-30T13:15:27.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.166+0000 7fc29f3df740 1 Processor -- start 2024-03-30T13:15:27.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.166+0000 7fc29f3df740 1 -- start start 2024-03-30T13:15:27.172 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.167+0000 7fc29f3df740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb664470 0x5563bb65d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.167+0000 7fc29f3df740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.167+0000 7fc29f3df740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb682cd0 0x5563bb6aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.167+0000 7fc29f3df740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc294201230 con 0x5563bb664850 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.167+0000 7fc29f3df740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc2942002b0 con 0x5563bb682cd0 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.167+0000 7fc29f3df740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc2940b7d80 con 0x5563bb664470 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.167+0000 7fc299200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.167+0000 7fc299200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6aa1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53890/0 (socket says 172.21.15.44:53890) 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.167+0000 7fc299200640 1 -- 172.21.15.44:0/3704625802 learned_addr learned my addr 172.21.15.44:0/3704625802 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.168+0000 7fc299200640 1 -- 172.21.15.44:0/3704625802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb664470 msgr2=0x5563bb65d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.168+0000 7fc299200640 1 --2- 172.21.15.44:0/3704625802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb664470 0x5563bb65d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.168+0000 7fc299200640 1 -- 172.21.15.44:0/3704625802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb682cd0 msgr2=0x5563bb6aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.168+0000 7fc299200640 1 --2- 172.21.15.44:0/3704625802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb682cd0 0x5563bb6aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.168+0000 7fc299200640 1 -- 172.21.15.44:0/3704625802 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563bb2742d0 con 0x5563bb664850 2024-03-30T13:15:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.168+0000 7fc299200640 1 --2- 172.21.15.44:0/3704625802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6aa1a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc280008260 tx=0x7fc28001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9627ff745f4adabe server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.168+0000 7fc285600640 1 -- 172.21.15.44:0/3704625802 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280034070 con 0x5563bb664850 2024-03-30T13:15:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.168+0000 7fc285600640 1 -- 172.21.15.44:0/3704625802 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc280024070 con 0x5563bb664850 2024-03-30T13:15:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.168+0000 7fc285600640 1 -- 172.21.15.44:0/3704625802 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2800139b0 con 0x5563bb664850 2024-03-30T13:15:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.169+0000 7fc29f3df740 1 -- 172.21.15.44:0/3704625802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 msgr2=0x5563bb6aa1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.169+0000 7fc29f3df740 1 --2- 172.21.15.44:0/3704625802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6aa1a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc280008260 tx=0x7fc28001d000 comp rx=0 tx=0).stop 2024-03-30T13:15:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.169+0000 7fc29f3df740 1 -- 172.21.15.44:0/3704625802 shutdown_connections 2024-03-30T13:15:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.169+0000 7fc29f3df740 1 --2- 172.21.15.44:0/3704625802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb682cd0 0x5563bb6aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.169+0000 7fc29f3df740 1 --2- 172.21.15.44:0/3704625802 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6aa1a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.169+0000 7fc29f3df740 1 --2- 172.21.15.44:0/3704625802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb664470 0x5563bb65d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.169+0000 7fc29f3df740 1 -- 172.21.15.44:0/3704625802 >> 172.21.15.44:0/3704625802 conn(0x5563bb62abe0 msgr2=0x5563bb6a2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.169+0000 7fc29f3df740 1 -- 172.21.15.44:0/3704625802 shutdown_connections 2024-03-30T13:15:27.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.169+0000 7fc29f3df740 1 -- 172.21.15.44:0/3704625802 wait complete. 2024-03-30T13:15:27.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.170+0000 7fc29f3df740 1 -- start start 2024-03-30T13:15:27.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.170+0000 7fc29f3df740 1 Processor -- start 2024-03-30T13:15:27.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.171+0000 7fc29f3df740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb664470 0x5563bb6aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.171+0000 7fc29f3df740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.171+0000 7fc29f3df740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb682cd0 0x5563bb680080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.171+0000 7fc29f3df740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5563bb5d4870 con 0x5563bb664850 2024-03-30T13:15:27.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.171+0000 7fc29f3df740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940b83d0 con 0x5563bb664470 2024-03-30T13:15:27.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.171+0000 7fc29f3df740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5563bb6611b0 con 0x5563bb682cd0 2024-03-30T13:15:27.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.171+0000 7fc29f3df740 10 client.0 _ll_register_callbacks cb 0x7fc280008e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.171+0000 7fc299200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.171+0000 7fc299200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6aa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53904/0 (socket says 172.21.15.44:53904) 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.171+0000 7fc299200640 1 -- 172.21.15.44:0/855049695 learned_addr learned my addr 172.21.15.44:0/855049695 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc299c00640 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb664470 0x5563bb6aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc29a600640 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb682cd0 0x5563bb680080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc299200640 1 -- 172.21.15.44:0/855049695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb682cd0 msgr2=0x5563bb680080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc299200640 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb682cd0 0x5563bb680080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc299200640 1 -- 172.21.15.44:0/855049695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb664470 msgr2=0x5563bb6aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc299200640 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb664470 0x5563bb6aa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc299200640 1 -- 172.21.15.44:0/855049695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563bb6a2990 con 0x5563bb664850 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc299c00640 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb664470 0x5563bb6aa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc299200640 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6aa6e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc280006fd0 tx=0x7fc280012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7c902279c6c420 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc27aa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:27.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc27aa00640 1 -- 172.21.15.44:0/855049695 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280034070 con 0x5563bb664850 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc29f3df740 1 -- 172.21.15.44:0/855049695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc280024070 con 0x5563bb664850 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.172+0000 7fc27aa00640 1 -- 172.21.15.44:0/855049695 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6218+0+0 (secure 0 0 0) 0x7fc280039650 con 0x5563bb664850 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.173+0000 7fc27aa00640 1 -- 172.21.15.44:0/855049695 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc28004a050 con 0x5563bb664850 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.173+0000 7fc29f3df740 10 client.6210 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.173+0000 7fc29f3df740 1 -- 172.21.15.44:0/855049695 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5563bb730910 con 0x5563bb664850 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.173+0000 7fc27aa00640 1 -- 172.21.15.44:0/855049695 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc280024070 con 0x5563bb664850 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.173+0000 7fc27aa00640 1 -- 172.21.15.44:0/855049695 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc28004d020 con 0x5563bb664850 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.173+0000 7fc29f3df740 10 client.6210 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.173+0000 7fc29f3df740 10 client.6210 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.173+0000 7fc29f3df740 20 client.6210 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.173+0000 7fc29f3df740 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5563bb68dd10 0x5563bb6805c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.173+0000 7fc29f3df740 4 client.6210 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628404}] 2024-03-30T13:15:27.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.173+0000 7fc29f3df740 1 -- 172.21.15.44:0/855049695 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628404}) -- 0x5563bb5cebc0 con 0x5563bb68dd10 2024-03-30T13:15:27.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.173+0000 7fc299c00640 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5563bb68dd10 0x5563bb6805c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.174+0000 7fc299c00640 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5563bb68dd10 0x5563bb6805c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ab37c6bf08e8e71 server_cookie=f90b7101d826822c in_seq=0 out_seq=0 2024-03-30T13:15:27.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.174+0000 7fc27aa00640 10 client.6210 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.174+0000 7fc27aa00640 1 -- 172.21.15.44:0/855049695 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4761 (crc 0 0 0) 0x5563bb5cebc0 con 0x5563bb68dd10 2024-03-30T13:15:27.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.174+0000 7fc27aa00640 10 client.6210 handle_command_reply: tid=0 2024-03-30T13:15:27.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.174+0000 7fc29f3df740 1 client.6210 shutdown 2024-03-30T13:15:27.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.174+0000 7fc29f3df740 1 -- 172.21.15.44:0/855049695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 msgr2=0x5563bb6aa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.174+0000 7fc29f3df740 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6aa6e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc280006fd0 tx=0x7fc280012000 comp rx=0 tx=0).stop 2024-03-30T13:15:27.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.175+0000 7fc29f3df740 1 -- 172.21.15.44:0/855049695 shutdown_connections 2024-03-30T13:15:27.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.175+0000 7fc29f3df740 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5563bb68dd10 0x5563bb6805c0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.175+0000 7fc29f3df740 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5563bb682cd0 0x5563bb680080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.175+0000 7fc29f3df740 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563bb664850 0x5563bb6aa6e0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.175+0000 7fc29f3df740 1 --2- 172.21.15.44:0/855049695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5563bb664470 0x5563bb6aa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.175+0000 7fc27aa00640 0 client.6210 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.175+0000 7fc29f3df740 1 -- 172.21.15.44:0/855049695 >> 172.21.15.44:0/855049695 conn(0x5563bb62abe0 msgr2=0x5563bb689d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.175+0000 7fc29f3df740 1 -- 172.21.15.44:0/855049695 shutdown_connections 2024-03-30T13:15:27.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.175+0000 7fc29f3df740 1 -- 172.21.15.44:0/855049695 wait complete. 2024-03-30T13:15:27.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.175+0000 7fc29f3df740 20 client.6210 trim_cache size 0 max 16384 2024-03-30T13:15:27.183 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:27.183 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/xattr_user.c", 2024-03-30T13:15:27.183 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628404, 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.534445+0000", 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.580533+0000", 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.184 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 1232, 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.580533+0000", 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:27.185 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:27.186 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1232, 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.534445+0000" 2024-03-30T13:15:27.187 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1232, 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.534445+0000" 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 158, 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 38, 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:27.188 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:27.189 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:27.190 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:27.191 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:27.192 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:27.193 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.194 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:27.195 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:27.197 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.176+0000 7fc29b000640 1 -- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc27406c530 msgr2=0x7fc27406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.176+0000 7fc29b000640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc27406c530 0x7fc27406e9f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2940cdf80 tx=0x7fc280008040 comp rx=0 tx=0).stop 2024-03-30T13:15:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.176+0000 7fc29b000640 1 -- 172.21.15.44:0/481285118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2940b4920 msgr2=0x7fc29414f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.176+0000 7fc29b000640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2940b4920 0x7fc29414f660 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fc288000c00 tx=0x7fc2880046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.176+0000 7fc29b000640 1 -- 172.21.15.44:0/481285118 shutdown_connections 2024-03-30T13:15:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.176+0000 7fc29b000640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc2940d0b90 0x7fc2940b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.176+0000 7fc29b000640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc27406c530 0x7fc27406e9f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.176+0000 7fc29b000640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2940b4d00 0x7fc2940b86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.176+0000 7fc29b000640 1 --2- 172.21.15.44:0/481285118 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc2940b4920 0x7fc29414f660 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.176+0000 7fc29b000640 1 -- 172.21.15.44:0/481285118 >> 172.21.15.44:0/481285118 conn(0x7fc29409d4e0 msgr2=0x7fc2940b9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.176+0000 7fc29b000640 1 -- 172.21.15.44:0/481285118 shutdown_connections 2024-03-30T13:15:27.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.176+0000 7fc29b000640 1 -- 172.21.15.44:0/481285118 wait complete. 2024-03-30T13:15:27.200 DEBUG:tasks.cephfs.test_uninlining:getting inode info #8 of 23:1099511628402 2024-03-30T13:15:27.200 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628402 2024-03-30T13:15:27.200 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628402 2024-03-30T13:15:27.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.411+0000 7f56e4a00640 1 Processor -- start 2024-03-30T13:15:27.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.411+0000 7f56e4a00640 1 -- start start 2024-03-30T13:15:27.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.412+0000 7f56e4a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f56e006e980 0x7f56e0072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.413+0000 7f56e4a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e00ad2e0 con 0x7f56e00ae9d0 2024-03-30T13:15:27.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.413+0000 7f56e4a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e00716a0 con 0x7f56e00acd60 2024-03-30T13:15:27.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.413+0000 7f56e4a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f56e00ad5c0 con 0x7f56e006e980 2024-03-30T13:15:27.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.413+0000 7f56dfe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f56e00ae9d0 0x7f56e00aee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42948/0 (socket says 172.21.15.44:42948) 2024-03-30T13:15:27.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.413+0000 7f56dfe00640 1 -- 172.21.15.44:0/1520023020 learned_addr learned my addr 172.21.15.44:0/1520023020 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:27.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.413+0000 7f56df400640 1 --2- 172.21.15.44:0/1520023020 >> v2:172.21.15.151:3300/0 conn(0x7f56e006e980 0x7f56e0072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.414+0000 7f56dea00640 1 -- 172.21.15.44:0/1520023020 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2660754159 0 0) 0x7f56e00ad2e0 con 0x7f56e00ae9d0 2024-03-30T13:15:27.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.414+0000 7f56dea00640 1 -- 172.21.15.44:0/1520023020 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56c4003520 con 0x7f56e00ae9d0 2024-03-30T13:15:27.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.414+0000 7f56df400640 1 -- 172.21.15.44:0/1520023020 >> v1:172.21.15.151:6789/0 conn(0x7f56e00acd60 legacy=0x7f56e015d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.414+0000 7f56df400640 1 -- 172.21.15.44:0/1520023020 >> v1:172.21.15.44:6789/0 conn(0x7f56e00ae9d0 legacy=0x7f56e00aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.414+0000 7f56df400640 1 -- 172.21.15.44:0/1520023020 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e0071980 con 0x7f56e006e980 2024-03-30T13:15:27.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.415+0000 7f56df400640 1 --2- 172.21.15.44:0/1520023020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56e006e980 0x7f56e0072180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f56d00097a0 tx=0x7f56d002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9240ea1f7ebebed server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.416+0000 7f56dea00640 1 -- 172.21.15.44:0/1520023020 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0035020 con 0x7f56e006e980 2024-03-30T13:15:27.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.416+0000 7f56dea00640 1 -- 172.21.15.44:0/1520023020 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d0031830 con 0x7f56e006e980 2024-03-30T13:15:27.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.416+0000 7f56dea00640 1 -- 172.21.15.44:0/1520023020 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0031c00 con 0x7f56e006e980 2024-03-30T13:15:27.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.416+0000 7f56e4a00640 1 -- 172.21.15.44:0/1520023020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56e006e980 msgr2=0x7f56e0072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.416+0000 7f56e4a00640 1 --2- 172.21.15.44:0/1520023020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56e006e980 0x7f56e0072180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f56d00097a0 tx=0x7f56d002b8d0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.416+0000 7f56e4a00640 1 -- 172.21.15.44:0/1520023020 shutdown_connections 2024-03-30T13:15:27.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.416+0000 7f56e4a00640 1 --2- 172.21.15.44:0/1520023020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56e006e980 0x7f56e0072180 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.416+0000 7f56e4a00640 1 -- 172.21.15.44:0/1520023020 >> 172.21.15.44:0/1520023020 conn(0x7f56e00cfd90 msgr2=0x7f56e00d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.416+0000 7f56e4a00640 1 -- 172.21.15.44:0/1520023020 shutdown_connections 2024-03-30T13:15:27.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.417+0000 7f56e4a00640 1 -- 172.21.15.44:0/1520023020 wait complete. 2024-03-30T13:15:27.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.418+0000 7f56e4a00640 1 Processor -- start 2024-03-30T13:15:27.423 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.418+0000 7f56e4a00640 1 -- start start 2024-03-30T13:15:27.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.419+0000 7f56e4a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56e006e980 0x7f56e0158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.419+0000 7f56e4a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56e00acd60 0x7f56e015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.419+0000 7f56e4a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56e00ae9d0 0x7f56e00cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.419+0000 7f56e4a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0156020 con 0x7f56e006e980 2024-03-30T13:15:27.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.419+0000 7f56e4a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0071450 con 0x7f56e00ae9d0 2024-03-30T13:15:27.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.419+0000 7f56e4a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f56e01561a0 con 0x7f56e00acd60 2024-03-30T13:15:27.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.419+0000 7f56df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56e006e980 0x7f56e0158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.419+0000 7f56df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56e006e980 0x7f56e0158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53910/0 (socket says 172.21.15.44:53910) 2024-03-30T13:15:27.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.419+0000 7f56df400640 1 -- 172.21.15.44:0/1034507689 learned_addr learned my addr 172.21.15.44:0/1034507689 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.420+0000 7f56dfe00640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56e00ae9d0 0x7f56e00cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.420+0000 7f56df400640 1 -- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56e00acd60 msgr2=0x7f56e015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.420+0000 7f56df400640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56e00acd60 0x7f56e015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.420+0000 7f56df400640 1 -- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56e00ae9d0 msgr2=0x7f56e00cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.420+0000 7f56df400640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56e00ae9d0 0x7f56e00cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.420+0000 7f56df400640 1 -- 172.21.15.44:0/1034507689 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e015ed30 con 0x7f56e006e980 2024-03-30T13:15:27.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.420+0000 7f56dfe00640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56e00ae9d0 0x7f56e00cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.420+0000 7f56df400640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56e006e980 0x7f56e0158280 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009890 tx=0x7f56d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.420+0000 7f56d7400640 1 -- 172.21.15.44:0/1034507689 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0035040 con 0x7f56e006e980 2024-03-30T13:15:27.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.421+0000 7f56d7400640 1 -- 172.21.15.44:0/1034507689 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d003b920 con 0x7f56e006e980 2024-03-30T13:15:27.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.421+0000 7f56d7400640 1 -- 172.21.15.44:0/1034507689 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d003bd10 con 0x7f56e006e980 2024-03-30T13:15:27.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.421+0000 7f56e4a00640 1 -- 172.21.15.44:0/1034507689 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e01571e0 con 0x7f56e006e980 2024-03-30T13:15:27.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.421+0000 7f56e4a00640 1 -- 172.21.15.44:0/1034507689 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e01577a0 con 0x7f56e006e980 2024-03-30T13:15:27.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.423+0000 7f56d7400640 1 -- 172.21.15.44:0/1034507689 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f56d0038020 con 0x7f56e006e980 2024-03-30T13:15:27.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.424+0000 7f56d7400640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f56bc06c530 0x7f56bc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.424+0000 7f56d7400640 1 -- 172.21.15.44:0/1034507689 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 6218+0+0 (secure 0 0 0) 0x7f56d00adaf0 con 0x7f56e006e980 2024-03-30T13:15:27.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.424+0000 7f56e8e23740 1 Processor -- start 2024-03-30T13:15:27.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.424+0000 7f56e8e23740 1 -- start start 2024-03-30T13:15:27.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.425+0000 7f56d7e00640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f56bc06c530 0x7f56bc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.425+0000 7f56e8e23740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 0x561ac7c03fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.425+0000 7f56e8e23740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7c044e0 0x561ac7bdc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.425+0000 7f56e8e23740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7bdd850 0x561ac7bdc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.425+0000 7f56e8e23740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561ac7b40330 con 0x561ac7bdd470 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.425+0000 7f56e8e23740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561ac7ae8620 con 0x561ac7c044e0 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.425+0000 7f56e8e23740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x561ac7b3c440 con 0x561ac7bdd850 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.426+0000 7f56df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 0x561ac7c03fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.426+0000 7f56df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 0x561ac7c03fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53922/0 (socket says 172.21.15.44:53922) 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.426+0000 7f56df400640 1 -- 172.21.15.44:0/442356020 learned_addr learned my addr 172.21.15.44:0/442356020 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.426+0000 7f56d7e00640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f56bc06c530 0x7f56bc06e9f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f56c8000f60 tx=0x7f56c80079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.426+0000 7f56d7e00640 1 --2- 172.21.15.44:0/442356020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7c044e0 0x561ac7bdc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.426+0000 7f56df400640 1 -- 172.21.15.44:0/442356020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7bdd850 msgr2=0x561ac7bdc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.426+0000 7f56df400640 1 --2- 172.21.15.44:0/442356020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7bdd850 0x561ac7bdc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.426+0000 7f56df400640 1 -- 172.21.15.44:0/442356020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7c044e0 msgr2=0x561ac7bdc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.426+0000 7f56df400640 1 --2- 172.21.15.44:0/442356020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7c044e0 0x561ac7bdc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.426+0000 7f56df400640 1 -- 172.21.15.44:0/442356020 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ac7920920 con 0x561ac7bdd470 2024-03-30T13:15:27.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.426+0000 7f56d7e00640 1 --2- 172.21.15.44:0/442356020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7c044e0 0x561ac7bdc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.426+0000 7f56df400640 1 --2- 172.21.15.44:0/442356020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 0x561ac7c03fa0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f56d0083e30 tx=0x7f56d007b1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7648170116638f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.427+0000 7f56cf400640 1 -- 172.21.15.44:0/442356020 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d004b030 con 0x561ac7bdd470 2024-03-30T13:15:27.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.427+0000 7f56cf400640 1 -- 172.21.15.44:0/442356020 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d0031800 con 0x561ac7bdd470 2024-03-30T13:15:27.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.427+0000 7f56cf400640 1 -- 172.21.15.44:0/442356020 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d007b780 con 0x561ac7bdd470 2024-03-30T13:15:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.427+0000 7f56e8e23740 1 -- 172.21.15.44:0/442356020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 msgr2=0x561ac7c03fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.427+0000 7f56e8e23740 1 --2- 172.21.15.44:0/442356020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 0x561ac7c03fa0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f56d0083e30 tx=0x7f56d007b1a0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.427+0000 7f56e8e23740 1 -- 172.21.15.44:0/442356020 shutdown_connections 2024-03-30T13:15:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.427+0000 7f56e8e23740 1 --2- 172.21.15.44:0/442356020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7bdd850 0x561ac7bdc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.427+0000 7f56e8e23740 1 --2- 172.21.15.44:0/442356020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7c044e0 0x561ac7bdc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.427+0000 7f56e8e23740 1 --2- 172.21.15.44:0/442356020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 0x561ac7c03fa0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.427+0000 7f56e8e23740 1 -- 172.21.15.44:0/442356020 >> 172.21.15.44:0/442356020 conn(0x561ac7ba3be0 msgr2=0x561ac7c22190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.427+0000 7f56e8e23740 1 -- 172.21.15.44:0/442356020 shutdown_connections 2024-03-30T13:15:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.427+0000 7f56e8e23740 1 -- 172.21.15.44:0/442356020 wait complete. 2024-03-30T13:15:27.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.428+0000 7f56e8e23740 1 -- start start 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.428+0000 7f56e8e23740 1 Processor -- start 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.429+0000 7f56e8e23740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7bdd470 0x561ac7c1a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.429+0000 7f56e8e23740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 0x561ac7c1c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.429+0000 7f56e8e23740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7c31e50 0x561ac7c09a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.429+0000 7f56e8e23740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561ac7c03b10 con 0x561ac7bdd850 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.429+0000 7f56e8e23740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561ac7afb9d0 con 0x561ac7bdd470 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.429+0000 7f56e8e23740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x561ac7bfc890 con 0x561ac7c31e50 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.429+0000 7f56e8e23740 10 client.0 _ll_register_callbacks cb 0x561ac7b37fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.429+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 0x561ac7c1c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.430+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 0x561ac7c1c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53928/0 (socket says 172.21.15.44:53928) 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.430+0000 7f56d7e00640 1 -- 172.21.15.44:0/1038052006 learned_addr learned my addr 172.21.15.44:0/1038052006 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.430+0000 7f56d7e00640 1 -- 172.21.15.44:0/1038052006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7c31e50 msgr2=0x561ac7c09a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.430+0000 7f56df400640 1 --2- 172.21.15.44:0/1038052006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7bdd470 0x561ac7c1a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.430+0000 7f56d7e00640 1 --2- 172.21.15.44:0/1038052006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7c31e50 0x561ac7c09a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.430+0000 7f56d7e00640 1 -- 172.21.15.44:0/1038052006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7bdd470 msgr2=0x561ac7c1a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.430+0000 7f56d7e00640 1 --2- 172.21.15.44:0/1038052006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7bdd470 0x561ac7c1a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.430+0000 7f56d7e00640 1 -- 172.21.15.44:0/1038052006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ac7814210 con 0x561ac7bdd850 2024-03-30T13:15:27.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.430+0000 7f56d7e00640 1 --2- 172.21.15.44:0/1038052006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 0x561ac7c1c030 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f56e00af120 tx=0x7f56c8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2487f4e02360f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.430+0000 7f56c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:27.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56c3e00640 1 -- 172.21.15.44:0/1038052006 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8005310 con 0x561ac7bdd850 2024-03-30T13:15:27.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56c3e00640 1 -- 172.21.15.44:0/1038052006 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6218+0+0 (secure 0 0 0) 0x7f56c8022cd0 con 0x561ac7bdd850 2024-03-30T13:15:27.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56e8e23740 1 -- 172.21.15.44:0/1038052006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56d0031800 con 0x561ac7bdd850 2024-03-30T13:15:27.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56c3e00640 1 -- 172.21.15.44:0/1038052006 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f56c80035f0 con 0x561ac7bdd850 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56e8e23740 10 client.6222 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56e8e23740 1 -- 172.21.15.44:0/1038052006 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x561ac79810b0 con 0x561ac7bdd850 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56c3e00640 1 -- 172.21.15.44:0/1038052006 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56d0031800 con 0x561ac7bdd850 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56c3e00640 1 -- 172.21.15.44:0/1038052006 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f56c8029050 con 0x561ac7bdd850 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56e8e23740 10 client.6222 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56e8e23740 10 client.6222 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56e8e23740 20 client.6222 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56e8e23740 1 --2- 172.21.15.44:0/1038052006 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x561ac7c082e0 0x561ac7c08730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56e8e23740 4 client.6222 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.431+0000 7f56e8e23740 1 -- 172.21.15.44:0/1038052006 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ac7b4d870 con 0x561ac7c082e0 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.432+0000 7f56df400640 1 --2- 172.21.15.44:0/1038052006 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x561ac7c082e0 0x561ac7c08730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.432+0000 7f56df400640 1 --2- 172.21.15.44:0/1038052006 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x561ac7c082e0 0x561ac7c08730 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0fa0ed91de41873 server_cookie=a32e4cc6dcae7973 in_seq=0 out_seq=0 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.432+0000 7f56c3e00640 10 client.6222 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.433+0000 7f56c3e00640 1 -- 172.21.15.44:0/1038052006 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x561ac7b4d870 con 0x561ac7c082e0 2024-03-30T13:15:27.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.433+0000 7f56c3e00640 10 client.6222 handle_command_reply: tid=0 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.433+0000 7f56e8e23740 1 client.6222 shutdown 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.434+0000 7f56e8e23740 1 -- 172.21.15.44:0/1038052006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 msgr2=0x561ac7c1c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.434+0000 7f56e8e23740 1 --2- 172.21.15.44:0/1038052006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 0x561ac7c1c030 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f56e00af120 tx=0x7f56c8000ed0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.434+0000 7f56e8e23740 1 -- 172.21.15.44:0/1038052006 shutdown_connections 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.434+0000 7f56e8e23740 1 --2- 172.21.15.44:0/1038052006 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x561ac7c082e0 0x561ac7c08730 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.434+0000 7f56e8e23740 1 --2- 172.21.15.44:0/1038052006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7c31e50 0x561ac7c09a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.434+0000 7f56e8e23740 1 --2- 172.21.15.44:0/1038052006 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 0x561ac7c1c030 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.434+0000 7f56e8e23740 1 --2- 172.21.15.44:0/1038052006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7bdd470 0x561ac7c1a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.434+0000 7f56c3e00640 0 client.6222 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.434+0000 7f56e8e23740 1 -- 172.21.15.44:0/1038052006 >> 172.21.15.44:0/1038052006 conn(0x561ac7ba3be0 msgr2=0x561ac7bd6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.434+0000 7f56e8e23740 1 -- 172.21.15.44:0/1038052006 shutdown_connections 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.434+0000 7f56e8e23740 1 -- 172.21.15.44:0/1038052006 wait complete. 2024-03-30T13:15:27.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.434+0000 7f56e8e23740 20 client.6222 trim_cache size 0 max 16384 2024-03-30T13:15:27.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.463+0000 7f56e8e23740 1 Processor -- start 2024-03-30T13:15:27.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.463+0000 7f56e8e23740 1 -- start start 2024-03-30T13:15:27.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56e8e23740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7bdd470 0x561ac7c25ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56e8e23740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 0x561ac7c02660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56e8e23740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7c31e50 0x561ac7bd2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56e8e23740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0201000 con 0x561ac7bdd850 2024-03-30T13:15:27.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56e8e23740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f56e0200030 con 0x561ac7c31e50 2024-03-30T13:15:27.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56e8e23740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f56e01f80a0 con 0x561ac7bdd470 2024-03-30T13:15:27.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 0x561ac7c02660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 0x561ac7c02660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53936/0 (socket says 172.21.15.44:53936) 2024-03-30T13:15:27.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56d7e00640 1 -- 172.21.15.44:0/1917224757 learned_addr learned my addr 172.21.15.44:0/1917224757 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56d7e00640 1 -- 172.21.15.44:0/1917224757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7bdd470 msgr2=0x561ac7c25ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56d7e00640 1 --2- 172.21.15.44:0/1917224757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7bdd470 0x561ac7c25ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56d7e00640 1 -- 172.21.15.44:0/1917224757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7c31e50 msgr2=0x561ac7bd2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56d7e00640 1 --2- 172.21.15.44:0/1917224757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7c31e50 0x561ac7bd2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.464+0000 7f56d7e00640 1 -- 172.21.15.44:0/1917224757 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ac77ed2d0 con 0x561ac7bdd850 2024-03-30T13:15:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.465+0000 7f56d7e00640 1 --2- 172.21.15.44:0/1917224757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 0x561ac7c02660 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f56c80053b0 tx=0x7f56c801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=215da93b92ad0339 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.465+0000 7f56cea00640 1 -- 172.21.15.44:0/1917224757 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c80069d0 con 0x561ac7bdd850 2024-03-30T13:15:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.465+0000 7f56cea00640 1 -- 172.21.15.44:0/1917224757 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c8006b70 con 0x561ac7bdd850 2024-03-30T13:15:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.465+0000 7f56cea00640 1 -- 172.21.15.44:0/1917224757 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8003790 con 0x561ac7bdd850 2024-03-30T13:15:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.465+0000 7f56e8e23740 1 -- 172.21.15.44:0/1917224757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 msgr2=0x561ac7c02660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.465+0000 7f56e8e23740 1 --2- 172.21.15.44:0/1917224757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 0x561ac7c02660 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f56c80053b0 tx=0x7f56c801c000 comp rx=0 tx=0).stop 2024-03-30T13:15:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.465+0000 7f56e8e23740 1 -- 172.21.15.44:0/1917224757 shutdown_connections 2024-03-30T13:15:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.465+0000 7f56e8e23740 1 --2- 172.21.15.44:0/1917224757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7c31e50 0x561ac7bd2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.465+0000 7f56e8e23740 1 --2- 172.21.15.44:0/1917224757 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd850 0x561ac7c02660 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.465+0000 7f56e8e23740 1 --2- 172.21.15.44:0/1917224757 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7bdd470 0x561ac7c25ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.466+0000 7f56e8e23740 1 -- 172.21.15.44:0/1917224757 >> 172.21.15.44:0/1917224757 conn(0x561ac7ba3be0 msgr2=0x561ac7bd82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.466+0000 7f56e8e23740 1 -- 172.21.15.44:0/1917224757 shutdown_connections 2024-03-30T13:15:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.466+0000 7f56e8e23740 1 -- 172.21.15.44:0/1917224757 wait complete. 2024-03-30T13:15:27.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.466+0000 7f56e8e23740 1 -- start start 2024-03-30T13:15:27.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.466+0000 7f56e8e23740 1 Processor -- start 2024-03-30T13:15:27.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.468+0000 7f56e8e23740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 0x561ac7bd67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.468+0000 7f56e8e23740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7bdd850 0x561ac7c086c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.468+0000 7f56e8e23740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7c31e50 0x561ac7c3b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.468+0000 7f56e8e23740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x561ac7c31a80 con 0x561ac7bdd470 2024-03-30T13:15:27.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.468+0000 7f56e8e23740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f56e01ff9e0 con 0x561ac7bdd850 2024-03-30T13:15:27.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.468+0000 7f56e8e23740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x561ac7bd3050 con 0x561ac7c31e50 2024-03-30T13:15:27.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.468+0000 7f56e8e23740 10 client.0 _ll_register_callbacks cb 0x7f56c8001260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:27.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.468+0000 7f56df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 0x561ac7bd67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.468+0000 7f56df400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 0x561ac7bd67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53946/0 (socket says 172.21.15.44:53946) 2024-03-30T13:15:27.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.468+0000 7f56df400640 1 -- 172.21.15.44:0/3028832634 learned_addr learned my addr 172.21.15.44:0/3028832634 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.469+0000 7f56df400640 1 -- 172.21.15.44:0/3028832634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7c31e50 msgr2=0x561ac7c3b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.469+0000 7f56df400640 1 --2- 172.21.15.44:0/3028832634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7c31e50 0x561ac7c3b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.469+0000 7f56df400640 1 -- 172.21.15.44:0/3028832634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7bdd850 msgr2=0x561ac7c086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.469+0000 7f56df400640 1 --2- 172.21.15.44:0/3028832634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7bdd850 0x561ac7c086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.469+0000 7f56df400640 1 -- 172.21.15.44:0/3028832634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ac7bd6d30 con 0x561ac7bdd470 2024-03-30T13:15:27.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.469+0000 7f56df400640 1 --2- 172.21.15.44:0/3028832634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 0x561ac7bd67f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f56d002b910 tx=0x7f56d002bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff1fc1e8ff72062 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.469+0000 7f56c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:27.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.471+0000 7f56c3e00640 1 -- 172.21.15.44:0/3028832634 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0098060 con 0x561ac7bdd470 2024-03-30T13:15:27.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.471+0000 7f56c3e00640 1 -- 172.21.15.44:0/3028832634 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(44..44 src has 1..44) ==== 6218+0+0 (secure 0 0 0) 0x7f56d0079a80 con 0x561ac7bdd470 2024-03-30T13:15:27.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.471+0000 7f56e8e23740 1 -- 172.21.15.44:0/3028832634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c8006b70 con 0x561ac7bdd470 2024-03-30T13:15:27.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.471+0000 7f56c3e00640 1 -- 172.21.15.44:0/3028832634 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f56d00ab050 con 0x561ac7bdd470 2024-03-30T13:15:27.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.471+0000 7f56e8e23740 10 client.6228 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:27.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.471+0000 7f56e8e23740 1 -- 172.21.15.44:0/3028832634 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x561ac7c08f50 con 0x561ac7bdd470 2024-03-30T13:15:27.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.472+0000 7f56c3e00640 1 -- 172.21.15.44:0/3028832634 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c8006b70 con 0x561ac7bdd470 2024-03-30T13:15:27.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.472+0000 7f56c3e00640 1 -- 172.21.15.44:0/3028832634 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f56d0077df0 con 0x561ac7bdd470 2024-03-30T13:15:27.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.472+0000 7f56e8e23740 10 client.6228 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:27.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.472+0000 7f56e8e23740 10 client.6228 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.472+0000 7f56e8e23740 20 client.6228 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.472+0000 7f56e8e23740 1 --2- 172.21.15.44:0/3028832634 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x561ac7c1ea80 0x561ac7c9cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.472+0000 7f56e8e23740 4 client.6228 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628402}] 2024-03-30T13:15:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.472+0000 7f56e8e23740 1 -- 172.21.15.44:0/3028832634 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628402}) -- 0x561ac7b47bc0 con 0x561ac7c1ea80 2024-03-30T13:15:27.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.472+0000 7f56d7e00640 1 --2- 172.21.15.44:0/3028832634 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x561ac7c1ea80 0x561ac7c9cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56d7e00640 1 --2- 172.21.15.44:0/3028832634 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x561ac7c1ea80 0x561ac7c9cad0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f98eba24ac868fd1 server_cookie=3de587ca58d6a2d3 in_seq=0 out_seq=0 2024-03-30T13:15:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56c3e00640 10 client.6228 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56c3e00640 1 -- 172.21.15.44:0/3028832634 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4765 (crc 0 0 0) 0x561ac7b47bc0 con 0x561ac7c1ea80 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56c3e00640 10 client.6228 handle_command_reply: tid=0 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56e8e23740 1 client.6228 shutdown 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56e8e23740 1 -- 172.21.15.44:0/3028832634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 msgr2=0x561ac7bd67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56e8e23740 1 --2- 172.21.15.44:0/3028832634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 0x561ac7bd67f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f56d002b910 tx=0x7f56d002bdf0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56e8e23740 1 -- 172.21.15.44:0/3028832634 shutdown_connections 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56e8e23740 1 --2- 172.21.15.44:0/3028832634 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x561ac7c1ea80 0x561ac7c9cad0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56e8e23740 1 --2- 172.21.15.44:0/3028832634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac7c31e50 0x561ac7c3b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56e8e23740 1 --2- 172.21.15.44:0/3028832634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac7bdd850 0x561ac7c086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56c3e00640 0 client.6228 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56e8e23740 1 --2- 172.21.15.44:0/3028832634 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x561ac7bdd470 0x561ac7bd67f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56e8e23740 1 -- 172.21.15.44:0/3028832634 >> 172.21.15.44:0/3028832634 conn(0x561ac7ba3be0 msgr2=0x561ac7bfbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.473+0000 7f56e8e23740 1 -- 172.21.15.44:0/3028832634 shutdown_connections 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.474+0000 7f56e8e23740 1 -- 172.21.15.44:0/3028832634 wait complete. 2024-03-30T13:15:27.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.474+0000 7f56e8e23740 20 client.6228 trim_cache size 0 max 16384 2024-03-30T13:15:27.481 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:27.481 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/xattr_security.c", 2024-03-30T13:15:27.481 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628402, 2024-03-30T13:15:27.481 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:27.481 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.544266+0000", 2024-03-30T13:15:27.481 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.576533+0000", 2024-03-30T13:15:27.481 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:27.481 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:27.481 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:27.481 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:27.481 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.482 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 1473, 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.576533+0000", 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:27.483 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:27.484 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1473, 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.544266+0000" 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1473, 2024-03-30T13:15:27.485 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.544266+0000" 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 162, 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 34, 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:27.486 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.487 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:27.488 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.489 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.491 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:27.492 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.493 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:27.494 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:27.494 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.494 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.494 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.494 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.494 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.494 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:27.494 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:27.494 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:27.494 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:27.495 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:27.496 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:27.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.474+0000 7f56e4a00640 1 -- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f56bc06c530 msgr2=0x7f56bc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.474+0000 7f56e4a00640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f56bc06c530 0x7f56bc06e9f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f56c8000f60 tx=0x7f56c80079d0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.474+0000 7f56e4a00640 1 -- 172.21.15.44:0/1034507689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56e006e980 msgr2=0x7f56e0158280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.474+0000 7f56e4a00640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56e006e980 0x7f56e0158280 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f56d0009890 tx=0x7f56d00046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.474+0000 7f56e4a00640 1 -- 172.21.15.44:0/1034507689 shutdown_connections 2024-03-30T13:15:27.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.474+0000 7f56e4a00640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f56bc06c530 0x7f56bc06e9f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.474+0000 7f56e4a00640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56e00ae9d0 0x7f56e00cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.474+0000 7f56e4a00640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56e00acd60 0x7f56e015e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.474+0000 7f56e4a00640 1 --2- 172.21.15.44:0/1034507689 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f56e006e980 0x7f56e0158280 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.474+0000 7f56e4a00640 1 -- 172.21.15.44:0/1034507689 >> 172.21.15.44:0/1034507689 conn(0x7f56e00cfd90 msgr2=0x7f56e00d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.475+0000 7f56e4a00640 1 -- 172.21.15.44:0/1034507689 shutdown_connections 2024-03-30T13:15:27.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.475+0000 7f56e4a00640 1 -- 172.21.15.44:0/1034507689 wait complete. 2024-03-30T13:15:27.498 DEBUG:tasks.cephfs.test_uninlining:getting inode info #9 of 23:1099511628387 2024-03-30T13:15:27.498 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628387 2024-03-30T13:15:27.499 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628387 2024-03-30T13:15:27.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.687+0000 7f52c8400640 1 Processor -- start 2024-03-30T13:15:27.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.688+0000 7f52c8400640 1 -- start start 2024-03-30T13:15:27.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.689+0000 7f52c8400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52c015e7c0 0x7f52c006c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.689+0000 7f52c8400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f52c015eba0 0x7f52c006cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.689+0000 7f52c8400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f52c00b4800 0x7f52c006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.689+0000 7f52c8400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f52c00cc840 con 0x7f52c00b4800 2024-03-30T13:15:27.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.689+0000 7f52c8400640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f52c00d1170 con 0x7f52c015eba0 2024-03-30T13:15:27.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.689+0000 7f52c8400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f52c00d1450 con 0x7f52c015e7c0 2024-03-30T13:15:27.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.689+0000 7f52c6400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f52c00b4800 0x7f52c006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.689+0000 7f52c6400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f52c00b4800 0x7f52c006d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53950/0 (socket says 172.21.15.44:53950) 2024-03-30T13:15:27.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.689+0000 7f52c6400640 1 -- 172.21.15.44:0/2649209720 learned_addr learned my addr 172.21.15.44:0/2649209720 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.690+0000 7f52c5000640 1 --2- 172.21.15.44:0/2649209720 >> v2:172.21.15.151:3300/0 conn(0x7f52c015eba0 0x7f52c006cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.690+0000 7f52c6400640 1 -- 172.21.15.44:0/2649209720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52c015e7c0 msgr2=0x7f52c006c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.690+0000 7f52c5a00640 1 --2- 172.21.15.44:0/2649209720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52c015e7c0 0x7f52c006c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.690+0000 7f52c6400640 1 --2- 172.21.15.44:0/2649209720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52c015e7c0 0x7f52c006c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.690+0000 7f52c6400640 1 -- 172.21.15.44:0/2649209720 >> v2:172.21.15.151:3300/0 conn(0x7f52c015eba0 msgr2=0x7f52c006cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.690+0000 7f52c6400640 1 --2- 172.21.15.44:0/2649209720 >> v2:172.21.15.151:3300/0 conn(0x7f52c015eba0 0x7f52c006cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.690+0000 7f52c6400640 1 -- 172.21.15.44:0/2649209720 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c00d1730 con 0x7f52c00b4800 2024-03-30T13:15:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.690+0000 7f52c5000640 1 --2- 172.21.15.44:0/2649209720 >> v2:172.21.15.151:3300/0 conn(0x7f52c015eba0 0x7f52c006cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.690+0000 7f52c5a00640 1 --2- 172.21.15.44:0/2649209720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52c015e7c0 0x7f52c006c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.691+0000 7f52c6400640 1 --2- 172.21.15.44:0/2649209720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52c00b4800 0x7f52c006d2e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f52c006f120 tx=0x7f52b802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0633665c19a2af server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.692+0000 7f52bfe00640 1 -- 172.21.15.44:0/2649209720 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b802ca80 con 0x7f52c00b4800 2024-03-30T13:15:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.692+0000 7f52bfe00640 1 -- 172.21.15.44:0/2649209720 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b802cc20 con 0x7f52c00b4800 2024-03-30T13:15:27.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.692+0000 7f52bfe00640 1 -- 172.21.15.44:0/2649209720 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b80343f0 con 0x7f52c00b4800 2024-03-30T13:15:27.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.692+0000 7f52c8400640 1 -- 172.21.15.44:0/2649209720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52c00b4800 msgr2=0x7f52c006d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.692+0000 7f52c8400640 1 --2- 172.21.15.44:0/2649209720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52c00b4800 0x7f52c006d2e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f52c006f120 tx=0x7f52b802bee0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.692+0000 7f52c8400640 1 -- 172.21.15.44:0/2649209720 shutdown_connections 2024-03-30T13:15:27.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.692+0000 7f52c8400640 1 --2- 172.21.15.44:0/2649209720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52c00b4800 0x7f52c006d2e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.692+0000 7f52c8400640 1 --2- 172.21.15.44:0/2649209720 >> v2:172.21.15.151:3300/0 conn(0x7f52c015eba0 0x7f52c006cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.692+0000 7f52c8400640 1 --2- 172.21.15.44:0/2649209720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52c015e7c0 0x7f52c006c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.692+0000 7f52c8400640 1 -- 172.21.15.44:0/2649209720 >> 172.21.15.44:0/2649209720 conn(0x7f52c00b3ce0 msgr2=0x7f52c00b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.693+0000 7f52c8400640 1 -- 172.21.15.44:0/2649209720 shutdown_connections 2024-03-30T13:15:27.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.693+0000 7f52c8400640 1 -- 172.21.15.44:0/2649209720 wait complete. 2024-03-30T13:15:27.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.695+0000 7f52c8400640 1 Processor -- start 2024-03-30T13:15:27.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.696+0000 7f52c8400640 1 -- start start 2024-03-30T13:15:27.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.697+0000 7f52c8400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52c00b4800 0x7f52c0156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.697+0000 7f52c8400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52c015e7c0 0x7f52c00b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.697+0000 7f52c8400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52c015eba0 0x7f52c00b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.697+0000 7f52c8400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f52c009abb0 con 0x7f52c00b4800 2024-03-30T13:15:27.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.697+0000 7f52c8400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f52c009aa30 con 0x7f52c015eba0 2024-03-30T13:15:27.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.697+0000 7f52c8400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f52c009ad30 con 0x7f52c015e7c0 2024-03-30T13:15:27.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.697+0000 7f52c5a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52c00b4800 0x7f52c0156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.697+0000 7f52c5a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52c00b4800 0x7f52c0156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53954/0 (socket says 172.21.15.44:53954) 2024-03-30T13:15:27.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.697+0000 7f52c5a00640 1 -- 172.21.15.44:0/3669478176 learned_addr learned my addr 172.21.15.44:0/3669478176 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.698+0000 7f52c5a00640 1 -- 172.21.15.44:0/3669478176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52c015e7c0 msgr2=0x7f52c00b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.698+0000 7f52c5a00640 1 --2- 172.21.15.44:0/3669478176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52c015e7c0 0x7f52c00b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.698+0000 7f52c5a00640 1 -- 172.21.15.44:0/3669478176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52c015eba0 msgr2=0x7f52c00b5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.698+0000 7f52c5a00640 1 --2- 172.21.15.44:0/3669478176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52c015eba0 0x7f52c00b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.698+0000 7f52c5a00640 1 -- 172.21.15.44:0/3669478176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c00c9360 con 0x7f52c00b4800 2024-03-30T13:15:27.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.698+0000 7f52c5a00640 1 --2- 172.21.15.44:0/3669478176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52c00b4800 0x7f52c0156510 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f52b400c7f0 tx=0x7f52b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.699+0000 7f52bd600640 1 -- 172.21.15.44:0/3669478176 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4015070 con 0x7f52c00b4800 2024-03-30T13:15:27.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.699+0000 7f52bd600640 1 -- 172.21.15.44:0/3669478176 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b4007a30 con 0x7f52c00b4800 2024-03-30T13:15:27.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.699+0000 7f52bd600640 1 -- 172.21.15.44:0/3669478176 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4007e00 con 0x7f52c00b4800 2024-03-30T13:15:27.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.699+0000 7f52c8400640 1 -- 172.21.15.44:0/3669478176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c00c9640 con 0x7f52c00b4800 2024-03-30T13:15:27.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.699+0000 7f52c8400640 1 -- 172.21.15.44:0/3669478176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c00c9c00 con 0x7f52c00b4800 2024-03-30T13:15:27.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.701+0000 7f52bd600640 1 -- 172.21.15.44:0/3669478176 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f52b4018070 con 0x7f52c00b4800 2024-03-30T13:15:27.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.703+0000 7f52cb1ee740 1 Processor -- start 2024-03-30T13:15:27.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.703+0000 7f52cb1ee740 1 -- start start 2024-03-30T13:15:27.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.703+0000 7f52bd600640 1 --2- 172.21.15.44:0/3669478176 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f52a006c530 0x7f52a006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.703+0000 7f52bd600640 1 -- 172.21.15.44:0/3669478176 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f52b408b790 con 0x7f52c00b4800 2024-03-30T13:15:27.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52c6400640 1 --2- 172.21.15.44:0/3669478176 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f52a006c530 0x7f52a006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52cb1ee740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2290 0x55e0d2cc8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52cb1ee740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2cc9300 0x55e0d2ca12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52cb1ee740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2670 0x55e0d2ca1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52cb1ee740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e0d2c05330 con 0x55e0d2ca2290 2024-03-30T13:15:27.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52cb1ee740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e0d2bad620 con 0x55e0d2cc9300 2024-03-30T13:15:27.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52cb1ee740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55e0d2c01440 con 0x55e0d2ca2670 2024-03-30T13:15:27.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52c5a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2290 0x55e0d2cc8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52c5a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2290 0x55e0d2cc8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53968/0 (socket says 172.21.15.44:53968) 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52c5a00640 1 -- 172.21.15.44:0/865972545 learned_addr learned my addr 172.21.15.44:0/865972545 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52c5000640 1 --2- 172.21.15.44:0/865972545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2cc9300 0x55e0d2ca12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52c5a00640 1 -- 172.21.15.44:0/865972545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2670 msgr2=0x55e0d2ca1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52c6400640 1 --2- 172.21.15.44:0/865972545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2670 0x55e0d2ca1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52c5a00640 1 --2- 172.21.15.44:0/865972545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2670 0x55e0d2ca1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.704+0000 7f52c5a00640 1 -- 172.21.15.44:0/865972545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2cc9300 msgr2=0x55e0d2ca12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.705+0000 7f52c5a00640 1 --2- 172.21.15.44:0/865972545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2cc9300 0x55e0d2ca12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.705+0000 7f52c5a00640 1 -- 172.21.15.44:0/865972545 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d29e5920 con 0x55e0d2ca2290 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.705+0000 7f52c5000640 1 --2- 172.21.15.44:0/865972545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2cc9300 0x55e0d2ca12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.705+0000 7f52c5a00640 1 --2- 172.21.15.44:0/865972545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2290 0x55e0d2cc8dc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f52b40559b0 tx=0x7f52b4059d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9047e1c28039e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.705+0000 7f52c6400640 1 --2- 172.21.15.44:0/3669478176 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f52a006c530 0x7f52a006e9f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f52b8035000 tx=0x7f52b802e070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.705+0000 7f52b2000640 1 -- 172.21.15.44:0/865972545 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b401f040 con 0x55e0d2ca2290 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.705+0000 7f52b2000640 1 -- 172.21.15.44:0/865972545 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b4062130 con 0x55e0d2ca2290 2024-03-30T13:15:27.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.705+0000 7f52b2000640 1 -- 172.21.15.44:0/865972545 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4055bc0 con 0x55e0d2ca2290 2024-03-30T13:15:27.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.706+0000 7f52cb1ee740 1 -- 172.21.15.44:0/865972545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2290 msgr2=0x55e0d2cc8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.706+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/865972545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2290 0x55e0d2cc8dc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f52b40559b0 tx=0x7f52b4059d90 comp rx=0 tx=0).stop 2024-03-30T13:15:27.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.706+0000 7f52cb1ee740 1 -- 172.21.15.44:0/865972545 shutdown_connections 2024-03-30T13:15:27.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.706+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/865972545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2670 0x55e0d2ca1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.706+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/865972545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2cc9300 0x55e0d2ca12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.706+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/865972545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2290 0x55e0d2cc8dc0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.706+0000 7f52cb1ee740 1 -- 172.21.15.44:0/865972545 >> 172.21.15.44:0/865972545 conn(0x55e0d2c68be0 msgr2=0x55e0d2ce6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.706+0000 7f52cb1ee740 1 -- 172.21.15.44:0/865972545 shutdown_connections 2024-03-30T13:15:27.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.706+0000 7f52cb1ee740 1 -- 172.21.15.44:0/865972545 wait complete. 2024-03-30T13:15:27.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.707+0000 7f52cb1ee740 1 -- start start 2024-03-30T13:15:27.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.707+0000 7f52cb1ee740 1 Processor -- start 2024-03-30T13:15:27.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.708+0000 7f52cb1ee740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 0x55e0d2cbf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.708+0000 7f52cb1ee740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2ca2670 0x55e0d2cf6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.708+0000 7f52cb1ee740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 0x55e0d2ce3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.708+0000 7f52cb1ee740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e0d2cc8930 con 0x55e0d2cbff40 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.708+0000 7f52cb1ee740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e0d2bc09d0 con 0x55e0d2ca2670 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.708+0000 7f52cb1ee740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55e0d2cc16b0 con 0x55e0d2ca2290 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.708+0000 7f52cb1ee740 10 client.0 _ll_register_callbacks cb 0x55e0d2bfcfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.708+0000 7f52c6400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 0x55e0d2ce3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.708+0000 7f52c6400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 0x55e0d2ce3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53980/0 (socket says 172.21.15.44:53980) 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.708+0000 7f52c6400640 1 -- 172.21.15.44:0/260216165 learned_addr learned my addr 172.21.15.44:0/260216165 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.708+0000 7f52c5000640 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2ca2670 0x55e0d2cf6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.708+0000 7f52c5a00640 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 0x55e0d2cbf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52c6400640 1 -- 172.21.15.44:0/260216165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 msgr2=0x55e0d2cbf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52c6400640 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 0x55e0d2cbf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52c6400640 1 -- 172.21.15.44:0/260216165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2ca2670 msgr2=0x55e0d2cf6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52c6400640 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2ca2670 0x55e0d2cf6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52c6400640 1 -- 172.21.15.44:0/260216165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d28d9210 con 0x55e0d2cbff40 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52c5000640 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2ca2670 0x55e0d2cf6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52c6400640 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 0x55e0d2ce3900 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f52b802c4f0 tx=0x7f52b8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177f86688ca4ad76 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52a6a00640 1 -- 172.21.15.44:0/260216165 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8051060 con 0x55e0d2cbff40 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52a6a00640 1 -- 172.21.15.44:0/260216165 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f52b8004250 con 0x55e0d2cbff40 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52cb1ee740 1 -- 172.21.15.44:0/260216165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52b4062130 con 0x55e0d2cbff40 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52a6a00640 1 -- 172.21.15.44:0/260216165 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f52b8057050 con 0x55e0d2cbff40 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.709+0000 7f52cb1ee740 10 client.6240 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.710+0000 7f52cb1ee740 1 -- 172.21.15.44:0/260216165 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55e0d2a460b0 con 0x55e0d2cbff40 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.710+0000 7f52a6a00640 1 -- 172.21.15.44:0/260216165 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b4062130 con 0x55e0d2cbff40 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.710+0000 7f52a6a00640 1 -- 172.21.15.44:0/260216165 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f52b805a020 con 0x55e0d2cbff40 2024-03-30T13:15:27.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.710+0000 7f52cb1ee740 10 client.6240 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:27.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.710+0000 7f52cb1ee740 10 client.6240 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:27.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.710+0000 7f52cb1ee740 20 client.6240 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:27.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.710+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e0d2ce9460 0x55e0d2ce9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.710+0000 7f52cb1ee740 4 client.6240 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:27.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.710+0000 7f52cb1ee740 1 -- 172.21.15.44:0/260216165 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0d2c12870 con 0x55e0d2ce9460 2024-03-30T13:15:27.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.710+0000 7f52c5a00640 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e0d2ce9460 0x55e0d2ce9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.711+0000 7f52c5a00640 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e0d2ce9460 0x55e0d2ce9840 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86fd6614307e13ca server_cookie=a4d15c86c8a68 in_seq=0 out_seq=0 2024-03-30T13:15:27.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.711+0000 7f52a6a00640 10 client.6240 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.711+0000 7f52a6a00640 1 -- 172.21.15.44:0/260216165 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55e0d2c12870 con 0x55e0d2ce9460 2024-03-30T13:15:27.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.711+0000 7f52a6a00640 10 client.6240 handle_command_reply: tid=0 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52cb1ee740 1 client.6240 shutdown 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52cb1ee740 1 -- 172.21.15.44:0/260216165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 msgr2=0x55e0d2ce3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 0x55e0d2ce3900 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f52b802c4f0 tx=0x7f52b8004ab0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52cb1ee740 1 -- 172.21.15.44:0/260216165 shutdown_connections 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e0d2ce9460 0x55e0d2ce9840 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 0x55e0d2ce3900 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2ca2670 0x55e0d2cf6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/260216165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 0x55e0d2cbf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52cb1ee740 1 -- 172.21.15.44:0/260216165 >> 172.21.15.44:0/260216165 conn(0x55e0d2c68be0 msgr2=0x55e0d2cc7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52a6a00640 0 client.6240 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52cb1ee740 1 -- 172.21.15.44:0/260216165 shutdown_connections 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52cb1ee740 1 -- 172.21.15.44:0/260216165 wait complete. 2024-03-30T13:15:27.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.712+0000 7f52cb1ee740 20 client.6240 trim_cache size 0 max 16384 2024-03-30T13:15:27.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.728+0000 7f52cb1ee740 1 Processor -- start 2024-03-30T13:15:27.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.728+0000 7f52cb1ee740 1 -- start start 2024-03-30T13:15:27.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.729+0000 7f52cb1ee740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 0x55e0d2ce0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.729+0000 7f52cb1ee740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2ca2670 0x55e0d2ce5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.729+0000 7f52cb1ee740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 0x55e0d2ce67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.729+0000 7f52cb1ee740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f52c0201150 con 0x55e0d2cbff40 2024-03-30T13:15:27.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.729+0000 7f52cb1ee740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f52c0200130 con 0x55e0d2ca2670 2024-03-30T13:15:27.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.729+0000 7f52cb1ee740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f52c01ff530 con 0x55e0d2ca2290 2024-03-30T13:15:27.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.729+0000 7f52c6400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 0x55e0d2ce67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.729+0000 7f52c6400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 0x55e0d2ce67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53992/0 (socket says 172.21.15.44:53992) 2024-03-30T13:15:27.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.729+0000 7f52c6400640 1 -- 172.21.15.44:0/1324366953 learned_addr learned my addr 172.21.15.44:0/1324366953 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.730+0000 7f52c6400640 1 -- 172.21.15.44:0/1324366953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 msgr2=0x55e0d2ce0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.730+0000 7f52c6400640 1 --2- 172.21.15.44:0/1324366953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 0x55e0d2ce0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.730+0000 7f52c6400640 1 -- 172.21.15.44:0/1324366953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2ca2670 msgr2=0x55e0d2ce5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.730+0000 7f52c6400640 1 --2- 172.21.15.44:0/1324366953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2ca2670 0x55e0d2ce5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.730+0000 7f52c6400640 1 -- 172.21.15.44:0/1324366953 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d28b22d0 con 0x55e0d2cbff40 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.730+0000 7f52c6400640 1 --2- 172.21.15.44:0/1324366953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 0x55e0d2ce67f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f52b802c5d0 tx=0x7f52b8049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb193925fd8fde8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.730+0000 7f52b1600640 1 -- 172.21.15.44:0/1324366953 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8003a60 con 0x55e0d2cbff40 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.730+0000 7f52b1600640 1 -- 172.21.15.44:0/1324366953 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b805f020 con 0x55e0d2cbff40 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.730+0000 7f52b1600640 1 -- 172.21.15.44:0/1324366953 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8004250 con 0x55e0d2cbff40 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.731+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1324366953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 msgr2=0x55e0d2ce67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.731+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/1324366953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 0x55e0d2ce67f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f52b802c5d0 tx=0x7f52b8049000 comp rx=0 tx=0).stop 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.731+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1324366953 shutdown_connections 2024-03-30T13:15:27.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.731+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/1324366953 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2cbff40 0x55e0d2ce67f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.731+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/1324366953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2ca2670 0x55e0d2ce5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.731+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/1324366953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 0x55e0d2ce0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.731+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1324366953 >> 172.21.15.44:0/1324366953 conn(0x55e0d2c68be0 msgr2=0x55e0d2ce5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.731+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1324366953 shutdown_connections 2024-03-30T13:15:27.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.732+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1324366953 wait complete. 2024-03-30T13:15:27.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.733+0000 7f52cb1ee740 1 -- start start 2024-03-30T13:15:27.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.733+0000 7f52cb1ee740 1 Processor -- start 2024-03-30T13:15:27.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.735+0000 7f52cb1ee740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 0x55e0d2c9fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.735+0000 7f52cb1ee740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2670 0x55e0d2cbeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.735+0000 7f52cb1ee740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2cbff40 0x55e0d2ca0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.735+0000 7f52cb1ee740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e0d2ceae10 con 0x55e0d2ca2670 2024-03-30T13:15:27.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.735+0000 7f52cb1ee740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f52c01ffab0 con 0x55e0d2cbff40 2024-03-30T13:15:27.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.735+0000 7f52cb1ee740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55e0d2cc7f70 con 0x55e0d2ca2290 2024-03-30T13:15:27.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.735+0000 7f52cb1ee740 10 client.0 _ll_register_callbacks cb 0x7f52b8009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:27.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.735+0000 7f52c5000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2670 0x55e0d2cbeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.735+0000 7f52c5000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2670 0x55e0d2cbeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54008/0 (socket says 172.21.15.44:54008) 2024-03-30T13:15:27.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.735+0000 7f52c5000640 1 -- 172.21.15.44:0/1486890822 learned_addr learned my addr 172.21.15.44:0/1486890822 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.735+0000 7f52c5a00640 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 0x55e0d2c9fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.735+0000 7f52c6400640 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2cbff40 0x55e0d2ca0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.736+0000 7f52c5000640 1 -- 172.21.15.44:0/1486890822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 msgr2=0x55e0d2c9fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.736+0000 7f52c5000640 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 0x55e0d2c9fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.736+0000 7f52c5000640 1 -- 172.21.15.44:0/1486890822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2cbff40 msgr2=0x55e0d2ca0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.736+0000 7f52c5000640 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2cbff40 0x55e0d2ca0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.736+0000 7f52c5000640 1 -- 172.21.15.44:0/1486890822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d2ceabf0 con 0x55e0d2ca2670 2024-03-30T13:15:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.736+0000 7f52c6400640 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2cbff40 0x55e0d2ca0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.736+0000 7f52c5000640 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2670 0x55e0d2cbeae0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x55e0d2c9ec40 tx=0x7f52ac00e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48beec543a209d7f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.736+0000 7f52a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:27.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.736+0000 7f52a6a00640 1 -- 172.21.15.44:0/1486890822 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac012630 con 0x55e0d2ca2670 2024-03-30T13:15:27.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.736+0000 7f52a6a00640 1 -- 172.21.15.44:0/1486890822 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f52ac0127d0 con 0x55e0d2ca2670 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.736+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1486890822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52b805f020 con 0x55e0d2ca2670 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.737+0000 7f52a6a00640 1 -- 172.21.15.44:0/1486890822 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f52ac022050 con 0x55e0d2ca2670 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.737+0000 7f52cb1ee740 10 client.6246 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.737+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1486890822 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55e0d2cc80f0 con 0x55e0d2ca2670 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.737+0000 7f52a6a00640 1 -- 172.21.15.44:0/1486890822 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b805f020 con 0x55e0d2ca2670 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.737+0000 7f52a6a00640 1 -- 172.21.15.44:0/1486890822 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f52ac025020 con 0x55e0d2ca2670 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.737+0000 7f52cb1ee740 10 client.6246 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.737+0000 7f52cb1ee740 10 client.6246 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.737+0000 7f52cb1ee740 20 client.6246 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.737+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e0d2ccedd0 0x55e0d2ccf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.737+0000 7f52cb1ee740 4 client.6246 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628387}] 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.737+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1486890822 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628387}) -- 0x55e0d2c0cbc0 con 0x55e0d2ccedd0 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.737+0000 7f52c5a00640 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e0d2ccedd0 0x55e0d2ccf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.738+0000 7f52c5a00640 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e0d2ccedd0 0x55e0d2ccf1b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2f950a1307e257 server_cookie=cf47e83836a12d4b in_seq=0 out_seq=0 2024-03-30T13:15:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.738+0000 7f52a6a00640 10 client.6246 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.738+0000 7f52a6a00640 1 -- 172.21.15.44:0/1486890822 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4753 (crc 0 0 0) 0x55e0d2c0cbc0 con 0x55e0d2ccedd0 2024-03-30T13:15:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.738+0000 7f52a6a00640 10 client.6246 handle_command_reply: tid=0 2024-03-30T13:15:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.738+0000 7f52cb1ee740 1 client.6246 shutdown 2024-03-30T13:15:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.738+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1486890822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2670 msgr2=0x55e0d2cbeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.738+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2670 0x55e0d2cbeae0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x55e0d2c9ec40 tx=0x7f52ac00e600 comp rx=0 tx=0).stop 2024-03-30T13:15:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.738+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1486890822 shutdown_connections 2024-03-30T13:15:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.738+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e0d2ccedd0 0x55e0d2ccf1b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.739+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d2cbff40 0x55e0d2ca0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.739+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e0d2ca2670 0x55e0d2cbeae0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.739+0000 7f52cb1ee740 1 --2- 172.21.15.44:0/1486890822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0d2ca2290 0x55e0d2c9fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.739+0000 7f52a6a00640 0 client.6246 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.739+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1486890822 >> 172.21.15.44:0/1486890822 conn(0x55e0d2c68be0 msgr2=0x55e0d2ce67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.739+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1486890822 shutdown_connections 2024-03-30T13:15:27.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.739+0000 7f52cb1ee740 1 -- 172.21.15.44:0/1486890822 wait complete. 2024-03-30T13:15:27.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.739+0000 7f52cb1ee740 20 client.6246 trim_cache size 0 max 16384 2024-03-30T13:15:27.747 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/Makefile", 2024-03-30T13:15:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628387, 2024-03-30T13:15:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.571718+0000", 2024-03-30T13:15:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.537534+0000", 2024-03-30T13:15:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:27.748 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 378, 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.537534+0000", 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:27.749 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:27.750 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 378, 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.571718+0000" 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.751 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 378, 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.571718+0000" 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 176, 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 4, 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:27.752 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:27.753 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.754 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:27.755 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.756 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.757 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.758 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:27.759 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:27.759 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.759 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:27.762 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:27.763 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:27.764 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:27.764 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:27.764 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:27.764 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:27.764 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:27.764 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:27.764 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:27.764 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:27.764 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:27.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.740+0000 7f52c8400640 1 -- 172.21.15.44:0/3669478176 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f52a006c530 msgr2=0x7f52a006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.740+0000 7f52c8400640 1 --2- 172.21.15.44:0/3669478176 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f52a006c530 0x7f52a006e9f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f52b8035000 tx=0x7f52b802e070 comp rx=0 tx=0).stop 2024-03-30T13:15:27.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.740+0000 7f52c8400640 1 -- 172.21.15.44:0/3669478176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52c00b4800 msgr2=0x7f52c0156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.740+0000 7f52c8400640 1 --2- 172.21.15.44:0/3669478176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52c00b4800 0x7f52c0156510 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f52b400c7f0 tx=0x7f52b400ccb0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.740+0000 7f52c8400640 1 -- 172.21.15.44:0/3669478176 shutdown_connections 2024-03-30T13:15:27.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.740+0000 7f52c8400640 1 --2- 172.21.15.44:0/3669478176 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f52a006c530 0x7f52a006e9f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.740+0000 7f52c8400640 1 --2- 172.21.15.44:0/3669478176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52c015eba0 0x7f52c00b5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.740+0000 7f52c8400640 1 --2- 172.21.15.44:0/3669478176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52c015e7c0 0x7f52c00b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.740+0000 7f52c8400640 1 --2- 172.21.15.44:0/3669478176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f52c00b4800 0x7f52c0156510 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.740+0000 7f52c8400640 1 -- 172.21.15.44:0/3669478176 >> 172.21.15.44:0/3669478176 conn(0x7f52c00b3ce0 msgr2=0x7f52c00702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.740+0000 7f52c8400640 1 -- 172.21.15.44:0/3669478176 shutdown_connections 2024-03-30T13:15:27.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.740+0000 7f52c8400640 1 -- 172.21.15.44:0/3669478176 wait complete. 2024-03-30T13:15:27.767 DEBUG:tasks.cephfs.test_uninlining:getting inode info #10 of 23:1099511628399 2024-03-30T13:15:27.767 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628399 2024-03-30T13:15:27.767 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628399 2024-03-30T13:15:27.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.956+0000 7f80d9200640 1 Processor -- start 2024-03-30T13:15:27.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.956+0000 7f80d9200640 1 -- start start 2024-03-30T13:15:27.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.958+0000 7f80d9200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d40b4920 0x7f80d40b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.958+0000 7f80d9200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f80d40b4d00 0x7f80d40d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.958+0000 7f80d9200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80d40b54b0 con 0x7f80d40d0b90 2024-03-30T13:15:27.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.958+0000 7f80d9200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f80d40d0260 con 0x7f80d40b4d00 2024-03-30T13:15:27.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.958+0000 7f80d9200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f80d40cfca0 con 0x7f80d40b4920 2024-03-30T13:15:27.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.958+0000 7f80caa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f80d40b4d00 0x7f80d40d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.958+0000 7f80d3e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f80d40d0b90 0x7f80d40d26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42964/0 (socket says 172.21.15.44:42964) 2024-03-30T13:15:27.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.958+0000 7f80d3e00640 1 -- 172.21.15.44:0/1562094498 learned_addr learned my addr 172.21.15.44:0/1562094498 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:27.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.958+0000 7f80d3400640 1 --2- 172.21.15.44:0/1562094498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d40b4920 0x7f80d40b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.959+0000 7f80caa00640 1 -- 172.21.15.44:0/1562094498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d40b4920 msgr2=0x7f80d40b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.959+0000 7f80caa00640 1 --2- 172.21.15.44:0/1562094498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d40b4920 0x7f80d40b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.959+0000 7f80caa00640 1 -- 172.21.15.44:0/1562094498 >> v1:172.21.15.44:6789/0 conn(0x7f80d40d0b90 legacy=0x7f80d40d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.959+0000 7f80caa00640 1 -- 172.21.15.44:0/1562094498 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d40cff80 con 0x7f80d40b4d00 2024-03-30T13:15:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.960+0000 7f80caa00640 1 --2- 172.21.15.44:0/1562094498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80d40b4d00 0x7f80d40d4ac0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0097a0 tx=0x7f80bc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876c37d405dbf5bc server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.960+0000 7f80d2a00640 1 -- 172.21.15.44:0/1562094498 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc031780 con 0x7f80d40b4d00 2024-03-30T13:15:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.960+0000 7f80d2a00640 1 -- 172.21.15.44:0/1562094498 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80bc037070 con 0x7f80d40b4d00 2024-03-30T13:15:27.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.960+0000 7f80d2a00640 1 -- 172.21.15.44:0/1562094498 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc031b40 con 0x7f80d40b4d00 2024-03-30T13:15:27.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.960+0000 7f80d9200640 1 -- 172.21.15.44:0/1562094498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80d40b4d00 msgr2=0x7f80d40d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.960+0000 7f80d9200640 1 --2- 172.21.15.44:0/1562094498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80d40b4d00 0x7f80d40d4ac0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0097a0 tx=0x7f80bc02b820 comp rx=0 tx=0).stop 2024-03-30T13:15:27.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.961+0000 7f80d9200640 1 -- 172.21.15.44:0/1562094498 shutdown_connections 2024-03-30T13:15:27.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.961+0000 7f80d9200640 1 --2- 172.21.15.44:0/1562094498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80d40b4d00 0x7f80d40d4ac0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.961+0000 7f80d9200640 1 --2- 172.21.15.44:0/1562094498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d40b4920 0x7f80d40b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.961+0000 7f80d9200640 1 -- 172.21.15.44:0/1562094498 >> 172.21.15.44:0/1562094498 conn(0x7f80d409d4e0 msgr2=0x7f80d40d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.961+0000 7f80d9200640 1 -- 172.21.15.44:0/1562094498 shutdown_connections 2024-03-30T13:15:27.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.961+0000 7f80d9200640 1 -- 172.21.15.44:0/1562094498 wait complete. 2024-03-30T13:15:27.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.962+0000 7f80d9200640 1 Processor -- start 2024-03-30T13:15:27.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.962+0000 7f80d9200640 1 -- start start 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.963+0000 7f80d9200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d40b4920 0x7f80d41488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.963+0000 7f80d9200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d40b4d00 0x7f80d40b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.963+0000 7f80d9200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80d40d0b90 0x7f80d40b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.963+0000 7f80d9200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f80d40b3ff0 con 0x7f80d40d0b90 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.963+0000 7f80d9200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f80d40d2180 con 0x7f80d40b4d00 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.963+0000 7f80d9200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f80d40d5000 con 0x7f80d40b4920 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.963+0000 7f80d3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80d40d0b90 0x7f80d40b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.964+0000 7f80d3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80d40d0b90 0x7f80d40b5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54014/0 (socket says 172.21.15.44:54014) 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.964+0000 7f80d3e00640 1 -- 172.21.15.44:0/2418708386 learned_addr learned my addr 172.21.15.44:0/2418708386 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.964+0000 7f80d3e00640 1 -- 172.21.15.44:0/2418708386 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d40b4920 msgr2=0x7f80d41488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.964+0000 7f80d3e00640 1 --2- 172.21.15.44:0/2418708386 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d40b4920 0x7f80d41488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.964+0000 7f80d3e00640 1 -- 172.21.15.44:0/2418708386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d40b4d00 msgr2=0x7f80d40b8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.964+0000 7f80d3e00640 1 --2- 172.21.15.44:0/2418708386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d40b4d00 0x7f80d40b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.964+0000 7f80d3e00640 1 -- 172.21.15.44:0/2418708386 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d40b9730 con 0x7f80d40d0b90 2024-03-30T13:15:27.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.964+0000 7f80d3e00640 1 --2- 172.21.15.44:0/2418708386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80d40d0b90 0x7f80d40b5ea0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00cab0 tx=0x7f80cc00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.964+0000 7f80cbe00640 1 -- 172.21.15.44:0/2418708386 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc017070 con 0x7f80d40d0b90 2024-03-30T13:15:27.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.964+0000 7f80cbe00640 1 -- 172.21.15.44:0/2418708386 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80cc00ac30 con 0x7f80d40d0b90 2024-03-30T13:15:27.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.965+0000 7f80cbe00640 1 -- 172.21.15.44:0/2418708386 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc012400 con 0x7f80d40d0b90 2024-03-30T13:15:27.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.965+0000 7f80d9200640 1 -- 172.21.15.44:0/2418708386 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d40b9a10 con 0x7f80d40d0b90 2024-03-30T13:15:27.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.965+0000 7f80d9200640 1 -- 172.21.15.44:0/2418708386 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d40b9fd0 con 0x7f80d40d0b90 2024-03-30T13:15:27.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.968+0000 7f80cbe00640 1 -- 172.21.15.44:0/2418708386 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f80cc01a070 con 0x7f80d40d0b90 2024-03-30T13:15:27.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.969+0000 7f80cbe00640 1 --2- 172.21.15.44:0/2418708386 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f80b006c530 0x7f80b006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.969+0000 7f80cbe00640 1 -- 172.21.15.44:0/2418708386 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f80cc08b530 con 0x7f80d40d0b90 2024-03-30T13:15:27.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.969+0000 7f80dd44c740 1 Processor -- start 2024-03-30T13:15:27.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.969+0000 7f80dd44c740 1 -- start start 2024-03-30T13:15:27.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.969+0000 7f80d3400640 1 --2- 172.21.15.44:0/2418708386 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f80b006c530 0x7f80b006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.970+0000 7f80dd44c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb470 0x55c62a3f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.970+0000 7f80dd44c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a3f24e0 0x55c62a3ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.970+0000 7f80dd44c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb850 0x55c62a3ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.970+0000 7f80dd44c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c62a32e330 con 0x55c62a3cb470 2024-03-30T13:15:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.970+0000 7f80dd44c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c62a2d6620 con 0x55c62a3cb850 2024-03-30T13:15:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.970+0000 7f80dd44c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55c62a32a440 con 0x55c62a3f24e0 2024-03-30T13:15:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.970+0000 7f80d3400640 1 --2- 172.21.15.44:0/2418708386 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f80b006c530 0x7f80b006e9f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f80c40098f0 tx=0x7f80c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.970+0000 7f80d3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb470 0x55c62a3f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.971+0000 7f80d3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb470 0x55c62a3f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54022/0 (socket says 172.21.15.44:54022) 2024-03-30T13:15:27.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.971+0000 7f80d3400640 1 -- 172.21.15.44:0/4128938966 learned_addr learned my addr 172.21.15.44:0/4128938966 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.971+0000 7f80d3e00640 1 --2- 172.21.15.44:0/4128938966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb850 0x55c62a3ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.971+0000 7f80caa00640 1 --2- 172.21.15.44:0/4128938966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a3f24e0 0x55c62a3ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.971+0000 7f80d3400640 1 -- 172.21.15.44:0/4128938966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a3f24e0 msgr2=0x55c62a3ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.971+0000 7f80d3400640 1 --2- 172.21.15.44:0/4128938966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a3f24e0 0x55c62a3ca4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.971+0000 7f80d3400640 1 -- 172.21.15.44:0/4128938966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb850 msgr2=0x55c62a3ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.971+0000 7f80d3400640 1 --2- 172.21.15.44:0/4128938966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb850 0x55c62a3ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.971+0000 7f80d3400640 1 -- 172.21.15.44:0/4128938966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62a10e920 con 0x55c62a3cb470 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.971+0000 7f80d3e00640 1 --2- 172.21.15.44:0/4128938966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb850 0x55c62a3ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.971+0000 7f80d3400640 1 --2- 172.21.15.44:0/4128938966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb470 0x55c62a3f1fa0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009290 tx=0x7f80c4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285dc913a903927 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.972+0000 7f80c3e00640 1 -- 172.21.15.44:0/4128938966 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4024070 con 0x55c62a3cb470 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.972+0000 7f80c3e00640 1 -- 172.21.15.44:0/4128938966 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c400de30 con 0x55c62a3cb470 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.972+0000 7f80c3e00640 1 -- 172.21.15.44:0/4128938966 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80c4014dc0 con 0x55c62a3cb470 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.972+0000 7f80dd44c740 1 -- 172.21.15.44:0/4128938966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb470 msgr2=0x55c62a3f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.972+0000 7f80dd44c740 1 --2- 172.21.15.44:0/4128938966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb470 0x55c62a3f1fa0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f80c4009290 tx=0x7f80c4010000 comp rx=0 tx=0).stop 2024-03-30T13:15:27.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.972+0000 7f80dd44c740 1 -- 172.21.15.44:0/4128938966 shutdown_connections 2024-03-30T13:15:27.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.972+0000 7f80dd44c740 1 --2- 172.21.15.44:0/4128938966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb850 0x55c62a3ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.972+0000 7f80dd44c740 1 --2- 172.21.15.44:0/4128938966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a3f24e0 0x55c62a3ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.972+0000 7f80dd44c740 1 --2- 172.21.15.44:0/4128938966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb470 0x55c62a3f1fa0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.972+0000 7f80dd44c740 1 -- 172.21.15.44:0/4128938966 >> 172.21.15.44:0/4128938966 conn(0x55c62a391be0 msgr2=0x55c62a410190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.973+0000 7f80dd44c740 1 -- 172.21.15.44:0/4128938966 shutdown_connections 2024-03-30T13:15:27.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.973+0000 7f80dd44c740 1 -- 172.21.15.44:0/4128938966 wait complete. 2024-03-30T13:15:27.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.973+0000 7f80dd44c740 1 -- start start 2024-03-30T13:15:27.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.973+0000 7f80dd44c740 1 Processor -- start 2024-03-30T13:15:27.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.974+0000 7f80dd44c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb470 0x55c62a410ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.974+0000 7f80dd44c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a3de760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.974+0000 7f80dd44c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a41fee0 0x55c62a3ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.974+0000 7f80dd44c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c62a3f1b10 con 0x55c62a3cb850 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.974+0000 7f80dd44c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c62a2e99d0 con 0x55c62a3cb470 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.974+0000 7f80dd44c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55c62a3ea890 con 0x55c62a41fee0 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.975+0000 7f80dd44c740 10 client.0 _ll_register_callbacks cb 0x55c62a325fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.975+0000 7f80caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a3de760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.975+0000 7f80caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a3de760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54030/0 (socket says 172.21.15.44:54030) 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.975+0000 7f80caa00640 1 -- 172.21.15.44:0/3089842620 learned_addr learned my addr 172.21.15.44:0/3089842620 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.975+0000 7f80d3400640 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb470 0x55c62a410ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.975+0000 7f80d3e00640 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a41fee0 0x55c62a3ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.975+0000 7f80caa00640 1 -- 172.21.15.44:0/3089842620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a41fee0 msgr2=0x55c62a3ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.975+0000 7f80caa00640 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a41fee0 0x55c62a3ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.975+0000 7f80caa00640 1 -- 172.21.15.44:0/3089842620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb470 msgr2=0x55c62a410ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.975+0000 7f80caa00640 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb470 0x55c62a410ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.975+0000 7f80caa00640 1 -- 172.21.15.44:0/3089842620 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c62a002210 con 0x55c62a3cb850 2024-03-30T13:15:27.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.975+0000 7f80d3400640 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb470 0x55c62a410ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.976+0000 7f80caa00640 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a3de760 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0098c0 tx=0x7f80bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8e4cee5c81af01 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.976+0000 7f80c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.976+0000 7f80c0c00640 1 -- 172.21.15.44:0/3089842620 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc006e10 con 0x55c62a3cb850 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.976+0000 7f80c0c00640 1 -- 172.21.15.44:0/3089842620 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f80bc046c90 con 0x55c62a3cb850 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.976+0000 7f80dd44c740 1 -- 172.21.15.44:0/3089842620 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80c400de30 con 0x55c62a3cb850 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.976+0000 7f80c0c00640 1 -- 172.21.15.44:0/3089842620 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f80bc046e90 con 0x55c62a3cb850 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.976+0000 7f80dd44c740 10 client.6261 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.976+0000 7f80dd44c740 1 -- 172.21.15.44:0/3089842620 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55c62a16f0b0 con 0x55c62a3cb850 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.976+0000 7f80c0c00640 1 -- 172.21.15.44:0/3089842620 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c400de30 con 0x55c62a3cb850 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.977+0000 7f80c0c00640 1 -- 172.21.15.44:0/3089842620 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f80bc032610 con 0x55c62a3cb850 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.977+0000 7f80dd44c740 10 client.6261 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.977+0000 7f80dd44c740 10 client.6261 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.977+0000 7f80dd44c740 20 client.6261 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.977+0000 7f80dd44c740 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c62a3f8510 0x55c62a3f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:27.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.977+0000 7f80dd44c740 4 client.6261 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:27.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.977+0000 7f80dd44c740 1 -- 172.21.15.44:0/3089842620 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c62a33b870 con 0x55c62a3f8510 2024-03-30T13:15:27.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.977+0000 7f80d3400640 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c62a3f8510 0x55c62a3f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:27.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.978+0000 7f80d3400640 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c62a3f8510 0x55c62a3f88f0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1943d857058808e server_cookie=3fa3400beef76c0b in_seq=0 out_seq=0 2024-03-30T13:15:27.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.978+0000 7f80c0c00640 10 client.6261 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.978+0000 7f80c0c00640 1 -- 172.21.15.44:0/3089842620 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55c62a33b870 con 0x55c62a3f8510 2024-03-30T13:15:27.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.978+0000 7f80c0c00640 10 client.6261 handle_command_reply: tid=0 2024-03-30T13:15:27.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.978+0000 7f80dd44c740 1 client.6261 shutdown 2024-03-30T13:15:27.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.978+0000 7f80dd44c740 1 -- 172.21.15.44:0/3089842620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 msgr2=0x55c62a3de760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:27.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.978+0000 7f80dd44c740 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a3de760 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0098c0 tx=0x7f80bc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.979+0000 7f80dd44c740 1 -- 172.21.15.44:0/3089842620 shutdown_connections 2024-03-30T13:15:27.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.979+0000 7f80dd44c740 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c62a3f8510 0x55c62a3f88f0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.979+0000 7f80dd44c740 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a41fee0 0x55c62a3ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.979+0000 7f80dd44c740 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a3de760 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.979+0000 7f80dd44c740 1 --2- 172.21.15.44:0/3089842620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb470 0x55c62a410ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:27.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.979+0000 7f80dd44c740 1 -- 172.21.15.44:0/3089842620 >> 172.21.15.44:0/3089842620 conn(0x55c62a391be0 msgr2=0x55c62a3f1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:27.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.979+0000 7f80c0c00640 0 client.6261 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:27.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.979+0000 7f80dd44c740 1 -- 172.21.15.44:0/3089842620 shutdown_connections 2024-03-30T13:15:27.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.979+0000 7f80dd44c740 1 -- 172.21.15.44:0/3089842620 wait complete. 2024-03-30T13:15:27.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.979+0000 7f80dd44c740 20 client.6261 trim_cache size 0 max 16384 2024-03-30T13:15:27.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.994+0000 7f80dd44c740 1 Processor -- start 2024-03-30T13:15:27.999 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.995+0000 7f80dd44c740 1 -- start start 2024-03-30T13:15:28.001 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.995+0000 7f80dd44c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb470 0x55c62a4327c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.995+0000 7f80dd44c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a432d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.995+0000 7f80dd44c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a41fee0 0x55c62a405b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.995+0000 7f80dd44c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f80d4201160 con 0x55c62a3cb850 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.995+0000 7f80dd44c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f80d42001a0 con 0x55c62a3cb470 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.995+0000 7f80dd44c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f80d414a4f0 con 0x55c62a41fee0 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.996+0000 7f80caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a432d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.996+0000 7f80caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a432d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54040/0 (socket says 172.21.15.44:54040) 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.996+0000 7f80caa00640 1 -- 172.21.15.44:0/1611935870 learned_addr learned my addr 172.21.15.44:0/1611935870 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.996+0000 7f80caa00640 1 -- 172.21.15.44:0/1611935870 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a41fee0 msgr2=0x55c62a405b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.996+0000 7f80caa00640 1 --2- 172.21.15.44:0/1611935870 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a41fee0 0x55c62a405b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.996+0000 7f80caa00640 1 -- 172.21.15.44:0/1611935870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb470 msgr2=0x55c62a4327c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.996+0000 7f80caa00640 1 --2- 172.21.15.44:0/1611935870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb470 0x55c62a4327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.996+0000 7f80caa00640 1 -- 172.21.15.44:0/1611935870 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c62a3ca410 con 0x55c62a3cb850 2024-03-30T13:15:28.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.996+0000 7f80caa00640 1 --2- 172.21.15.44:0/1611935870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a432d00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f80bc006f40 tx=0x7f80bc03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318a4eb318410edb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.996+0000 7f80c3400640 1 -- 172.21.15.44:0/1611935870 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc053070 con 0x55c62a3cb850 2024-03-30T13:15:28.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.997+0000 7f80c3400640 1 -- 172.21.15.44:0/1611935870 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80bc037040 con 0x55c62a3cb850 2024-03-30T13:15:28.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.997+0000 7f80c3400640 1 -- 172.21.15.44:0/1611935870 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc02bea0 con 0x55c62a3cb850 2024-03-30T13:15:28.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.997+0000 7f80dd44c740 1 -- 172.21.15.44:0/1611935870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 msgr2=0x55c62a432d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.997+0000 7f80dd44c740 1 --2- 172.21.15.44:0/1611935870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a432d00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f80bc006f40 tx=0x7f80bc03e000 comp rx=0 tx=0).stop 2024-03-30T13:15:28.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.997+0000 7f80dd44c740 1 -- 172.21.15.44:0/1611935870 shutdown_connections 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.997+0000 7f80dd44c740 1 --2- 172.21.15.44:0/1611935870 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a41fee0 0x55c62a405b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.997+0000 7f80dd44c740 1 --2- 172.21.15.44:0/1611935870 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a432d00 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.997+0000 7f80dd44c740 1 --2- 172.21.15.44:0/1611935870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a3cb470 0x55c62a4327c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.997+0000 7f80dd44c740 1 -- 172.21.15.44:0/1611935870 >> 172.21.15.44:0/1611935870 conn(0x55c62a391be0 msgr2=0x55c62a3e8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.997+0000 7f80dd44c740 1 -- 172.21.15.44:0/1611935870 shutdown_connections 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.997+0000 7f80dd44c740 1 -- 172.21.15.44:0/1611935870 wait complete. 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.998+0000 7f80dd44c740 1 -- start start 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.998+0000 7f80dd44c740 1 Processor -- start 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.999+0000 7f80dd44c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a3cb470 0x55c62a428ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.999+0000 7f80dd44c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a41f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.999+0000 7f80dd44c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a41fee0 0x55c62a40e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.999+0000 7f80dd44c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c62a33c030 con 0x55c62a3cb850 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.999+0000 7f80dd44c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f80d41ffc20 con 0x55c62a41fee0 2024-03-30T13:15:28.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.999+0000 7f80dd44c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55c62a4297f0 con 0x55c62a3cb470 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.999+0000 7f80dd44c740 10 client.0 _ll_register_callbacks cb 0x7f80bc009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.999+0000 7f80caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a41f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.999+0000 7f80caa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a41f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54050/0 (socket says 172.21.15.44:54050) 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:27.999+0000 7f80caa00640 1 -- 172.21.15.44:0/2452995904 learned_addr learned my addr 172.21.15.44:0/2452995904 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.000+0000 7f80caa00640 1 -- 172.21.15.44:0/2452995904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a3cb470 msgr2=0x55c62a428ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.000+0000 7f80caa00640 1 --2- 172.21.15.44:0/2452995904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a3cb470 0x55c62a428ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.000+0000 7f80caa00640 1 -- 172.21.15.44:0/2452995904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a41fee0 msgr2=0x55c62a40e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.000+0000 7f80caa00640 1 --2- 172.21.15.44:0/2452995904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a41fee0 0x55c62a40e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.000+0000 7f80caa00640 1 -- 172.21.15.44:0/2452995904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c629fdb2d0 con 0x55c62a3cb850 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.000+0000 7f80caa00640 1 --2- 172.21.15.44:0/2452995904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a41f0b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x55c62a406db0 tx=0x7f80bc031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23acff57d71083 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.000+0000 7f80c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.000+0000 7f80c0c00640 1 -- 172.21.15.44:0/2452995904 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc05d060 con 0x55c62a3cb850 2024-03-30T13:15:28.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.000+0000 7f80c0c00640 1 -- 172.21.15.44:0/2452995904 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f80bc004230 con 0x55c62a3cb850 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.000+0000 7f80dd44c740 1 -- 172.21.15.44:0/2452995904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80bc037040 con 0x55c62a3cb850 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.001+0000 7f80c0c00640 1 -- 172.21.15.44:0/2452995904 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f80bc063050 con 0x55c62a3cb850 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.001+0000 7f80dd44c740 10 client.6267 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.001+0000 7f80dd44c740 1 -- 172.21.15.44:0/2452995904 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55c62a3c9890 con 0x55c62a3cb850 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.001+0000 7f80c0c00640 1 -- 172.21.15.44:0/2452995904 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80bc037040 con 0x55c62a3cb850 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.001+0000 7f80c0c00640 1 -- 172.21.15.44:0/2452995904 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f80bc032000 con 0x55c62a3cb850 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.001+0000 7f80dd44c740 10 client.6267 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.001+0000 7f80dd44c740 10 client.6267 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.001+0000 7f80dd44c740 20 client.6267 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.001+0000 7f80dd44c740 1 --2- 172.21.15.44:0/2452995904 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c62a41f5f0 0x55c62a40eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.001+0000 7f80dd44c740 4 client.6267 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628399}] 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.001+0000 7f80dd44c740 1 -- 172.21.15.44:0/2452995904 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628399}) -- 0x55c62a410850 con 0x55c62a41f5f0 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.001+0000 7f80d3400640 1 --2- 172.21.15.44:0/2452995904 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c62a41f5f0 0x55c62a40eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80d3400640 1 --2- 172.21.15.44:0/2452995904 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c62a41f5f0 0x55c62a40eb80 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c5ea37f8106d64a server_cookie=39cac8627929128d in_seq=0 out_seq=0 2024-03-30T13:15:28.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80c0c00640 10 client.6267 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80c0c00640 1 -- 172.21.15.44:0/2452995904 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4755 (crc 0 0 0) 0x55c62a410850 con 0x55c62a41f5f0 2024-03-30T13:15:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80c0c00640 10 client.6267 handle_command_reply: tid=0 2024-03-30T13:15:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80dd44c740 1 client.6267 shutdown 2024-03-30T13:15:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80dd44c740 1 -- 172.21.15.44:0/2452995904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 msgr2=0x55c62a41f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80dd44c740 1 --2- 172.21.15.44:0/2452995904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a41f0b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x55c62a406db0 tx=0x7f80bc031000 comp rx=0 tx=0).stop 2024-03-30T13:15:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80dd44c740 1 -- 172.21.15.44:0/2452995904 shutdown_connections 2024-03-30T13:15:28.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80dd44c740 1 --2- 172.21.15.44:0/2452995904 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c62a41f5f0 0x55c62a40eb80 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80dd44c740 1 --2- 172.21.15.44:0/2452995904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c62a41fee0 0x55c62a40e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80dd44c740 1 --2- 172.21.15.44:0/2452995904 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c62a3cb850 0x55c62a41f0b0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80dd44c740 1 --2- 172.21.15.44:0/2452995904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c62a3cb470 0x55c62a428ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80dd44c740 1 -- 172.21.15.44:0/2452995904 >> 172.21.15.44:0/2452995904 conn(0x55c62a391be0 msgr2=0x55c62a3e8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80c0c00640 0 client.6267 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.002+0000 7f80dd44c740 1 -- 172.21.15.44:0/2452995904 shutdown_connections 2024-03-30T13:15:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80dd44c740 1 -- 172.21.15.44:0/2452995904 wait complete. 2024-03-30T13:15:28.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80dd44c740 20 client.6267 trim_cache size 0 max 16384 2024-03-30T13:15:28.012 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/symlink.c", 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628399, 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.577991+0000", 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.569533+0000", 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:28.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 916, 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:28.014 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.569533+0000", 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.015 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 916, 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:28.016 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.577991+0000" 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 916, 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.577991+0000" 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 178, 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 28, 2024-03-30T13:15:28.017 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:28.018 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:28.019 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:28.020 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.021 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:28.022 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:28.023 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.024 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.025 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:28.026 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.027 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:28.027 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:28.027 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:28.027 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:28.027 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:28.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80d9200640 1 -- 172.21.15.44:0/2418708386 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f80b006c530 msgr2=0x7f80b006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80d9200640 1 --2- 172.21.15.44:0/2418708386 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f80b006c530 0x7f80b006e9f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f80c40098f0 tx=0x7f80c4008040 comp rx=0 tx=0).stop 2024-03-30T13:15:28.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80d9200640 1 -- 172.21.15.44:0/2418708386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80d40d0b90 msgr2=0x7f80d40b5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80d9200640 1 --2- 172.21.15.44:0/2418708386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80d40d0b90 0x7f80d40b5ea0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f80cc00cab0 tx=0x7f80cc00cf70 comp rx=0 tx=0).stop 2024-03-30T13:15:28.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80d9200640 1 -- 172.21.15.44:0/2418708386 shutdown_connections 2024-03-30T13:15:28.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80d9200640 1 --2- 172.21.15.44:0/2418708386 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80d40d0b90 0x7f80d40b5ea0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80d9200640 1 --2- 172.21.15.44:0/2418708386 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f80b006c530 0x7f80b006e9f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80d9200640 1 --2- 172.21.15.44:0/2418708386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d40b4d00 0x7f80d40b8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80d9200640 1 --2- 172.21.15.44:0/2418708386 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d40b4920 0x7f80d41488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80d9200640 1 -- 172.21.15.44:0/2418708386 >> 172.21.15.44:0/2418708386 conn(0x7f80d409d4e0 msgr2=0x7f80d406ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80d9200640 1 -- 172.21.15.44:0/2418708386 shutdown_connections 2024-03-30T13:15:28.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.003+0000 7f80d9200640 1 -- 172.21.15.44:0/2418708386 wait complete. 2024-03-30T13:15:28.029 DEBUG:tasks.cephfs.test_uninlining:getting inode info #11 of 23:1099511628389 2024-03-30T13:15:28.029 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628389 2024-03-30T13:15:28.030 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628389 2024-03-30T13:15:28.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.237+0000 7ff2f4e00640 1 Processor -- start 2024-03-30T13:15:28.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.237+0000 7ff2f4e00640 1 -- start start 2024-03-30T13:15:28.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.239+0000 7ff2f4e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff2f006c890 0x7ff2f00b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.239+0000 7ff2f4e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff2f006cc70 0x7ff2f015f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.239+0000 7ff2f4e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2f00b4660 con 0x7ff2f00ad910 2024-03-30T13:15:28.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.239+0000 7ff2f4e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f00b4430 con 0x7ff2f006cc70 2024-03-30T13:15:28.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.239+0000 7ff2f4e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7ff2f00b4940 con 0x7ff2f006c890 2024-03-30T13:15:28.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.240+0000 7ff2e7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff2f006cc70 0x7ff2f015f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.240+0000 7ff2efe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff2f00ad910 0x7ff2f00ae260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42976/0 (socket says 172.21.15.44:42976) 2024-03-30T13:15:28.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.240+0000 7ff2efe00640 1 -- 172.21.15.44:0/2814318831 learned_addr learned my addr 172.21.15.44:0/2814318831 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:28.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.240+0000 7ff2ef400640 1 --2- 172.21.15.44:0/2814318831 >> v2:172.21.15.151:3300/0 conn(0x7ff2f006c890 0x7ff2f00b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.240+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2814318831 >> v2:172.21.15.151:3300/0 conn(0x7ff2f006c890 msgr2=0x7ff2f00b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.240+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/2814318831 >> v2:172.21.15.151:3300/0 conn(0x7ff2f006c890 0x7ff2f00b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.240+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2814318831 >> v1:172.21.15.44:6789/0 conn(0x7ff2f00ad910 legacy=0x7ff2f00ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.240+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2814318831 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f00b4c20 con 0x7ff2f006cc70 2024-03-30T13:15:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.242+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/2814318831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f006cc70 0x7ff2f015f360 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00b38d0 tx=0x7ff2d802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c37e0954014d0e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.242+0000 7ff2eea00640 1 -- 172.21.15.44:0/2814318831 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80315a0 con 0x7ff2f006cc70 2024-03-30T13:15:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.242+0000 7ff2eea00640 1 -- 172.21.15.44:0/2814318831 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d8037070 con 0x7ff2f006cc70 2024-03-30T13:15:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.242+0000 7ff2eea00640 1 -- 172.21.15.44:0/2814318831 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8031960 con 0x7ff2f006cc70 2024-03-30T13:15:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.242+0000 7ff2f4e00640 1 -- 172.21.15.44:0/2814318831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f006cc70 msgr2=0x7ff2f015f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.242+0000 7ff2f4e00640 1 --2- 172.21.15.44:0/2814318831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f006cc70 0x7ff2f015f360 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00b38d0 tx=0x7ff2d802b840 comp rx=0 tx=0).stop 2024-03-30T13:15:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.243+0000 7ff2f4e00640 1 -- 172.21.15.44:0/2814318831 shutdown_connections 2024-03-30T13:15:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.243+0000 7ff2f4e00640 1 --2- 172.21.15.44:0/2814318831 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f006cc70 0x7ff2f015f360 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.243+0000 7ff2f4e00640 1 --2- 172.21.15.44:0/2814318831 >> v2:172.21.15.151:3300/0 conn(0x7ff2f006c890 0x7ff2f00b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.243+0000 7ff2f4e00640 1 -- 172.21.15.44:0/2814318831 >> 172.21.15.44:0/2814318831 conn(0x7ff2f00d0b20 msgr2=0x7ff2f00d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.243+0000 7ff2f4e00640 1 -- 172.21.15.44:0/2814318831 shutdown_connections 2024-03-30T13:15:28.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.243+0000 7ff2f4e00640 1 -- 172.21.15.44:0/2814318831 wait complete. 2024-03-30T13:15:28.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.244+0000 7ff2f4e00640 1 Processor -- start 2024-03-30T13:15:28.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.244+0000 7ff2f4e00640 1 -- start start 2024-03-30T13:15:28.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.245+0000 7ff2f4e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2f006c890 0x7ff2f014a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.245+0000 7ff2f4e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2f006cc70 0x7ff2f0160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.245+0000 7ff2f4e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f00ad910 0x7ff2f015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.245+0000 7ff2f4e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00ae970 con 0x7ff2f00ad910 2024-03-30T13:15:28.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.245+0000 7ff2f4e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f00b51e0 con 0x7ff2f006cc70 2024-03-30T13:15:28.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.245+0000 7ff2f4e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f00aeaf0 con 0x7ff2f006c890 2024-03-30T13:15:28.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.246+0000 7ff2efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f00ad910 0x7ff2f015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.246+0000 7ff2efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f00ad910 0x7ff2f015bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54062/0 (socket says 172.21.15.44:54062) 2024-03-30T13:15:28.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.246+0000 7ff2efe00640 1 -- 172.21.15.44:0/1697560702 learned_addr learned my addr 172.21.15.44:0/1697560702 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.246+0000 7ff2ef400640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2f006c890 0x7ff2f014a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.246+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2f006cc70 0x7ff2f0160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.246+0000 7ff2efe00640 1 -- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2f006c890 msgr2=0x7ff2f014a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.246+0000 7ff2efe00640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2f006c890 0x7ff2f014a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.246+0000 7ff2efe00640 1 -- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2f006cc70 msgr2=0x7ff2f0160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.246+0000 7ff2efe00640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2f006cc70 0x7ff2f0160460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.246+0000 7ff2efe00640 1 -- 172.21.15.44:0/1697560702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f01613e0 con 0x7ff2f00ad910 2024-03-30T13:15:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.247+0000 7ff2efe00640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f00ad910 0x7ff2f015bb90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800cbf0 tx=0x7ff2e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.247+0000 7ff2e7400640 1 -- 172.21.15.44:0/1697560702 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8017070 con 0x7ff2f00ad910 2024-03-30T13:15:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.247+0000 7ff2e7400640 1 -- 172.21.15.44:0/1697560702 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e800ad40 con 0x7ff2f00ad910 2024-03-30T13:15:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.247+0000 7ff2f4e00640 1 -- 172.21.15.44:0/1697560702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f0154a90 con 0x7ff2f00ad910 2024-03-30T13:15:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.247+0000 7ff2e7400640 1 -- 172.21.15.44:0/1697560702 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8012600 con 0x7ff2f00ad910 2024-03-30T13:15:28.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.247+0000 7ff2f4e00640 1 -- 172.21.15.44:0/1697560702 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f0160e20 con 0x7ff2f00ad910 2024-03-30T13:15:28.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.250+0000 7ff2e7400640 1 -- 172.21.15.44:0/1697560702 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff2e801a070 con 0x7ff2f00ad910 2024-03-30T13:15:28.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.251+0000 7ff2f91e8740 1 Processor -- start 2024-03-30T13:15:28.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.251+0000 7ff2f91e8740 1 -- start start 2024-03-30T13:15:28.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.251+0000 7ff2e7400640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff2cc06c530 0x7ff2cc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.251+0000 7ff2e7400640 1 -- 172.21.15.44:0/1697560702 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7ff2e808b560 con 0x7ff2f00ad910 2024-03-30T13:15:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.252+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff2cc06c530 0x7ff2cc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.252+0000 7ff2f91e8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 0x5622fd96cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.252+0000 7ff2f91e8740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd96d4e0 0x5622fd9454b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.252+0000 7ff2f91e8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946850 0x5622fd9459f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.252+0000 7ff2f91e8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5622fd8a9330 con 0x5622fd946470 2024-03-30T13:15:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.252+0000 7ff2f91e8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5622fd851620 con 0x5622fd946850 2024-03-30T13:15:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.252+0000 7ff2f91e8740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5622fd8a5440 con 0x5622fd96d4e0 2024-03-30T13:15:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.252+0000 7ff2ef400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 0x5622fd96cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.252+0000 7ff2ef400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 0x5622fd96cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54070/0 (socket says 172.21.15.44:54070) 2024-03-30T13:15:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.252+0000 7ff2ef400640 1 -- 172.21.15.44:0/1977882949 learned_addr learned my addr 172.21.15.44:0/1977882949 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.253+0000 7ff2ef400640 1 -- 172.21.15.44:0/1977882949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd96d4e0 msgr2=0x5622fd9454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.253+0000 7ff2ef400640 1 --2- 172.21.15.44:0/1977882949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd96d4e0 0x5622fd9454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.253+0000 7ff2efe00640 1 --2- 172.21.15.44:0/1977882949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946850 0x5622fd9459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.253+0000 7ff2ef400640 1 -- 172.21.15.44:0/1977882949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946850 msgr2=0x5622fd9459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.253+0000 7ff2ef400640 1 --2- 172.21.15.44:0/1977882949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946850 0x5622fd9459f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.253+0000 7ff2ef400640 1 -- 172.21.15.44:0/1977882949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622fd689920 con 0x5622fd946470 2024-03-30T13:15:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.253+0000 7ff2ef400640 1 --2- 172.21.15.44:0/1977882949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 0x5622fd96cfa0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000b8a0 tx=0x7ff2e000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9c070d52b96428 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.253+0000 7ff2dfe00640 1 -- 172.21.15.44:0/1977882949 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0018020 con 0x5622fd946470 2024-03-30T13:15:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.253+0000 7ff2dfe00640 1 -- 172.21.15.44:0/1977882949 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e000f960 con 0x5622fd946470 2024-03-30T13:15:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.253+0000 7ff2dfe00640 1 -- 172.21.15.44:0/1977882949 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000fd30 con 0x5622fd946470 2024-03-30T13:15:28.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.254+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1977882949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 msgr2=0x5622fd96cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.254+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/1977882949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 0x5622fd96cfa0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000b8a0 tx=0x7ff2e000bd60 comp rx=0 tx=0).stop 2024-03-30T13:15:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.254+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff2cc06c530 0x7ff2cc06e9f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8036000 tx=0x7ff2d8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.254+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1977882949 shutdown_connections 2024-03-30T13:15:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.254+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/1977882949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946850 0x5622fd9459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.254+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/1977882949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd96d4e0 0x5622fd9454b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.254+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/1977882949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 0x5622fd96cfa0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.254+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1977882949 >> 172.21.15.44:0/1977882949 conn(0x5622fd90cbe0 msgr2=0x5622fd98b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.254+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1977882949 shutdown_connections 2024-03-30T13:15:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.254+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1977882949 wait complete. 2024-03-30T13:15:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.255+0000 7ff2f91e8740 1 -- start start 2024-03-30T13:15:28.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.255+0000 7ff2f91e8740 1 Processor -- start 2024-03-30T13:15:28.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.256+0000 7ff2f91e8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 0x5622fd9740e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.256+0000 7ff2f91e8740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd946850 0x5622fd988aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.256+0000 7ff2f91e8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd9712e0 0x5622fd971740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.256+0000 7ff2f91e8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5622fd96cb10 con 0x5622fd946470 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.256+0000 7ff2f91e8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5622fd8649d0 con 0x5622fd9712e0 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.256+0000 7ff2f91e8740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5622fd965890 con 0x5622fd946850 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.256+0000 7ff2f91e8740 10 client.0 _ll_register_callbacks cb 0x5622fd8a0fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.257+0000 7ff2ef400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 0x5622fd9740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.257+0000 7ff2ef400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 0x5622fd9740e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54078/0 (socket says 172.21.15.44:54078) 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.257+0000 7ff2ef400640 1 -- 172.21.15.44:0/1442799409 learned_addr learned my addr 172.21.15.44:0/1442799409 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.257+0000 7ff2ef400640 1 -- 172.21.15.44:0/1442799409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd946850 msgr2=0x5622fd988aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.257+0000 7ff2efe00640 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd9712e0 0x5622fd971740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.257+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd946850 0x5622fd988aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.257+0000 7ff2ef400640 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd946850 0x5622fd988aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.257+0000 7ff2ef400640 1 -- 172.21.15.44:0/1442799409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd9712e0 msgr2=0x5622fd971740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.257+0000 7ff2ef400640 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd9712e0 0x5622fd971740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.257+0000 7ff2ef400640 1 -- 172.21.15.44:0/1442799409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622fd57d210 con 0x5622fd946470 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.257+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd946850 0x5622fd988aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.257+0000 7ff2efe00640 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd9712e0 0x5622fd971740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.258+0000 7ff2ef400640 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 0x5622fd9740e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x5622fd974850 tx=0x7ff2e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10702bad26c67985 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.258+0000 7ff2dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.258+0000 7ff2dcc00640 1 -- 172.21.15.44:0/1442799409 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0018050 con 0x5622fd946470 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.258+0000 7ff2dcc00640 1 -- 172.21.15.44:0/1442799409 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7ff2e000f760 con 0x5622fd946470 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.258+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1442799409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2e000f960 con 0x5622fd946470 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.258+0000 7ff2dcc00640 1 -- 172.21.15.44:0/1442799409 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff2e002f050 con 0x5622fd946470 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.258+0000 7ff2f91e8740 10 client.6282 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.258+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1442799409 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5622fd6ea0b0 con 0x5622fd946470 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.258+0000 7ff2dcc00640 1 -- 172.21.15.44:0/1442799409 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2e000f960 con 0x5622fd946470 2024-03-30T13:15:28.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.259+0000 7ff2dcc00640 1 -- 172.21.15.44:0/1442799409 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7ff2e0032020 con 0x5622fd946470 2024-03-30T13:15:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.259+0000 7ff2f91e8740 10 client.6282 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.259+0000 7ff2f91e8740 10 client.6282 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.259+0000 7ff2f91e8740 20 client.6282 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.259+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5622fd96bb20 0x5622fd98a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.259+0000 7ff2f91e8740 4 client.6282 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.259+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1442799409 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622fd8b6870 con 0x5622fd96bb20 2024-03-30T13:15:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.259+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5622fd96bb20 0x5622fd98a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.260+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5622fd96bb20 0x5622fd98a580 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=320d5a57cd17dc14 server_cookie=b6523a91c7c06c69 in_seq=0 out_seq=0 2024-03-30T13:15:28.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.260+0000 7ff2dcc00640 10 client.6282 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.260+0000 7ff2dcc00640 1 -- 172.21.15.44:0/1442799409 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5622fd8b6870 con 0x5622fd96bb20 2024-03-30T13:15:28.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.260+0000 7ff2dcc00640 10 client.6282 handle_command_reply: tid=0 2024-03-30T13:15:28.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.260+0000 7ff2f91e8740 1 client.6282 shutdown 2024-03-30T13:15:28.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.261+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1442799409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 msgr2=0x5622fd9740e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.261+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 0x5622fd9740e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x5622fd974850 tx=0x7ff2e0004730 comp rx=0 tx=0).stop 2024-03-30T13:15:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.261+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1442799409 shutdown_connections 2024-03-30T13:15:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.261+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5622fd96bb20 0x5622fd98a580 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.261+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd9712e0 0x5622fd971740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.261+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd946850 0x5622fd988aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.261+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/1442799409 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946470 0x5622fd9740e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.261+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1442799409 >> 172.21.15.44:0/1442799409 conn(0x5622fd90cbe0 msgr2=0x5622fd9707e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.261+0000 7ff2dcc00640 0 client.6282 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.261+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1442799409 shutdown_connections 2024-03-30T13:15:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.261+0000 7ff2f91e8740 1 -- 172.21.15.44:0/1442799409 wait complete. 2024-03-30T13:15:28.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.261+0000 7ff2f91e8740 20 client.6282 trim_cache size 0 max 16384 2024-03-30T13:15:28.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.277+0000 7ff2f91e8740 1 Processor -- start 2024-03-30T13:15:28.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.277+0000 7ff2f91e8740 1 -- start start 2024-03-30T13:15:28.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.278+0000 7ff2f91e8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946470 0x5622fd9652c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.278+0000 7ff2f91e8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 0x5622fd9ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.278+0000 7ff2f91e8740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd9712e0 0x5622fd9ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.278+0000 7ff2f91e8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f02011e0 con 0x5622fd946850 2024-03-30T13:15:28.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.278+0000 7ff2f91e8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f02001c0 con 0x5622fd946470 2024-03-30T13:15:28.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.278+0000 7ff2f91e8740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff2f015a9d0 con 0x5622fd9712e0 2024-03-30T13:15:28.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.278+0000 7ff2e7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 0x5622fd9ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.278+0000 7ff2e7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 0x5622fd9ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54090/0 (socket says 172.21.15.44:54090) 2024-03-30T13:15:28.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.278+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2122980819 learned_addr learned my addr 172.21.15.44:0/2122980819 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.279+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2122980819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd9712e0 msgr2=0x5622fd9ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.279+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/2122980819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd9712e0 0x5622fd9ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.279+0000 7ff2ef400640 1 --2- 172.21.15.44:0/2122980819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946470 0x5622fd9652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.279+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2122980819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946470 msgr2=0x5622fd9652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.279+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/2122980819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946470 0x5622fd9652c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.279+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2122980819 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622fd971ab0 con 0x5622fd946850 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.279+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/2122980819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 0x5622fd9ac8c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff2d802b880 tx=0x7ff2d8031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e69f978054ae589 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.279+0000 7ff2df400640 1 -- 172.21.15.44:0/2122980819 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8049b00 con 0x5622fd946850 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.279+0000 7ff2df400640 1 -- 172.21.15.44:0/2122980819 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d8058070 con 0x5622fd946850 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.279+0000 7ff2df400640 1 -- 172.21.15.44:0/2122980819 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8052340 con 0x5622fd946850 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.280+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2122980819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 msgr2=0x5622fd9ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.280+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/2122980819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 0x5622fd9ac8c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff2d802b880 tx=0x7ff2d8031000 comp rx=0 tx=0).stop 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.280+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2122980819 shutdown_connections 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.280+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/2122980819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd9712e0 0x5622fd9ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.280+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/2122980819 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 0x5622fd9ac8c0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.280+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/2122980819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946470 0x5622fd9652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.280+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2122980819 >> 172.21.15.44:0/2122980819 conn(0x5622fd90cbe0 msgr2=0x5622fd98e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.280+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2122980819 shutdown_connections 2024-03-30T13:15:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.280+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2122980819 wait complete. 2024-03-30T13:15:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.281+0000 7ff2f91e8740 1 -- start start 2024-03-30T13:15:28.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.281+0000 7ff2f91e8740 1 Processor -- start 2024-03-30T13:15:28.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.283+0000 7ff2f91e8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946470 0x5622fd9f4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.283+0000 7ff2f91e8740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 0x5622fd980ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.283+0000 7ff2f91e8740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd9712e0 0x5622fd981400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.283+0000 7ff2f91e8740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5622fd98ab80 con 0x5622fd946850 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.283+0000 7ff2f91e8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f01ffba0 con 0x5622fd946470 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.283+0000 7ff2f91e8740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5622fd9a43b0 con 0x5622fd9712e0 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.283+0000 7ff2f91e8740 10 client.0 _ll_register_callbacks cb 0x7ff2e000b6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.283+0000 7ff2e7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 0x5622fd980ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.283+0000 7ff2e7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 0x5622fd980ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54098/0 (socket says 172.21.15.44:54098) 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.283+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2621516156 learned_addr learned my addr 172.21.15.44:0/2621516156 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.284+0000 7ff2ef400640 1 --2- 172.21.15.44:0/2621516156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946470 0x5622fd9f4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.284+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2621516156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd9712e0 msgr2=0x5622fd981400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.284+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/2621516156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd9712e0 0x5622fd981400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.284+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2621516156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946470 msgr2=0x5622fd9f4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.284+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/2621516156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946470 0x5622fd9f4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.284+0000 7ff2e7e00640 1 -- 172.21.15.44:0/2621516156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622fd5562d0 con 0x5622fd946850 2024-03-30T13:15:28.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.284+0000 7ff2e7e00640 1 --2- 172.21.15.44:0/2621516156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 0x5622fd980ec0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009890 tx=0x7ff2d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5ae19f11bc459c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.284+0000 7ff2dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.284+0000 7ff2dcc00640 1 -- 172.21.15.44:0/2621516156 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8060070 con 0x5622fd946850 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2dcc00640 1 -- 172.21.15.44:0/2621516156 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7ff2d8005d50 con 0x5622fd946850 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2621516156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2d8058070 con 0x5622fd946850 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2dcc00640 1 -- 172.21.15.44:0/2621516156 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7ff2d8049900 con 0x5622fd946850 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2f91e8740 10 client.6288 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2621516156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5622fd972bc0 con 0x5622fd946850 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2dcc00640 1 -- 172.21.15.44:0/2621516156 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d8058070 con 0x5622fd946850 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2dcc00640 1 -- 172.21.15.44:0/2621516156 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7ff2d8066ce0 con 0x5622fd946850 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2f91e8740 10 client.6288 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2f91e8740 10 client.6288 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2f91e8740 20 client.6288 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/2621516156 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5622fd945de0 0x5622fd973470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2f91e8740 4 client.6288 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628389}] 2024-03-30T13:15:28.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.285+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2621516156 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628389}) -- 0x5622fd8b0bc0 con 0x5622fd945de0 2024-03-30T13:15:28.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.286+0000 7ff2ef400640 1 --2- 172.21.15.44:0/2621516156 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5622fd945de0 0x5622fd973470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.286+0000 7ff2ef400640 1 --2- 172.21.15.44:0/2621516156 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5622fd945de0 0x5622fd973470 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21dfcf63d1d2834e server_cookie=a36267f715a8272e in_seq=0 out_seq=0 2024-03-30T13:15:28.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.286+0000 7ff2dcc00640 10 client.6288 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2dcc00640 1 -- 172.21.15.44:0/2621516156 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4753 (crc 0 0 0) 0x5622fd8b0bc0 con 0x5622fd945de0 2024-03-30T13:15:28.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2dcc00640 10 client.6288 handle_command_reply: tid=0 2024-03-30T13:15:28.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2f91e8740 1 client.6288 shutdown 2024-03-30T13:15:28.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2621516156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 msgr2=0x5622fd980ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/2621516156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 0x5622fd980ec0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009890 tx=0x7ff2d8004730 comp rx=0 tx=0).stop 2024-03-30T13:15:28.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2621516156 shutdown_connections 2024-03-30T13:15:28.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/2621516156 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5622fd945de0 0x5622fd973470 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/2621516156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622fd9712e0 0x5622fd981400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/2621516156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5622fd946850 0x5622fd980ec0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2f91e8740 1 --2- 172.21.15.44:0/2621516156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622fd946470 0x5622fd9f4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2dcc00640 0 client.6288 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2621516156 >> 172.21.15.44:0/2621516156 conn(0x5622fd90cbe0 msgr2=0x5622fd9652c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2621516156 shutdown_connections 2024-03-30T13:15:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2f91e8740 1 -- 172.21.15.44:0/2621516156 wait complete. 2024-03-30T13:15:28.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.287+0000 7ff2f91e8740 20 client.6288 trim_cache size 0 max 16384 2024-03-30T13:15:28.295 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:28.295 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/acl.h", 2024-03-30T13:15:28.295 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628389, 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.585334+0000", 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.544533+0000", 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.296 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 1502, 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:28.297 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.544533+0000", 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.298 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1502, 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:28.299 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.585334+0000" 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1502, 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.585334+0000" 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 184, 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:28.300 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 8, 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:28.301 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:28.302 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:28.303 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.304 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:28.305 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:28.306 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.307 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:28.308 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.309 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:28.310 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:28.310 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:28.310 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:28.310 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:28.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.288+0000 7ff2f4e00640 1 -- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff2cc06c530 msgr2=0x7ff2cc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.288+0000 7ff2f4e00640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff2cc06c530 0x7ff2cc06e9f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8036000 tx=0x7ff2d8030000 comp rx=0 tx=0).stop 2024-03-30T13:15:28.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.288+0000 7ff2f4e00640 1 -- 172.21.15.44:0/1697560702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f00ad910 msgr2=0x7ff2f015bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.288+0000 7ff2f4e00640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f00ad910 0x7ff2f015bb90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800cbf0 tx=0x7ff2e800a430 comp rx=0 tx=0).stop 2024-03-30T13:15:28.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.288+0000 7ff2f4e00640 1 -- 172.21.15.44:0/1697560702 shutdown_connections 2024-03-30T13:15:28.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.288+0000 7ff2f4e00640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff2f00ad910 0x7ff2f015bb90 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.288+0000 7ff2f4e00640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff2cc06c530 0x7ff2cc06e9f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.288+0000 7ff2f4e00640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2f006cc70 0x7ff2f0160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.288+0000 7ff2f4e00640 1 --2- 172.21.15.44:0/1697560702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2f006c890 0x7ff2f014a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.288+0000 7ff2f4e00640 1 -- 172.21.15.44:0/1697560702 >> 172.21.15.44:0/1697560702 conn(0x7ff2f00d0b20 msgr2=0x7ff2f00b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.289+0000 7ff2f4e00640 1 -- 172.21.15.44:0/1697560702 shutdown_connections 2024-03-30T13:15:28.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.289+0000 7ff2f4e00640 1 -- 172.21.15.44:0/1697560702 wait complete. 2024-03-30T13:15:28.312 DEBUG:tasks.cephfs.test_uninlining:getting inode info #12 of 23:1099511628403 2024-03-30T13:15:28.312 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628403 2024-03-30T13:15:28.313 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628403 2024-03-30T13:15:28.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.524+0000 7fd3f6800640 1 Processor -- start 2024-03-30T13:15:28.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.524+0000 7fd3f6800640 1 -- start start 2024-03-30T13:15:28.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.526+0000 7fd3f6800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3f013f0c0 0x7fd3f006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.526+0000 7fd3f6800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd3f006d720 0x7fd3f015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.526+0000 7fd3f6800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f00ce9c0 con 0x7fd3f01603d0 2024-03-30T13:15:28.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.526+0000 7fd3f6800640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd3f0160e30 con 0x7fd3f006d720 2024-03-30T13:15:28.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.526+0000 7fd3f6800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f0160b50 con 0x7fd3f013f0c0 2024-03-30T13:15:28.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.526+0000 7fd3eea00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd3f006d720 0x7fd3f015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.526+0000 7fd3eea00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd3f006d720 0x7fd3f015fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54114/0 (socket says 172.21.15.44:54114) 2024-03-30T13:15:28.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.526+0000 7fd3eea00640 1 -- 172.21.15.44:0/2528772200 learned_addr learned my addr 172.21.15.44:0/2528772200 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.527+0000 7fd3ef400640 1 --2- 172.21.15.44:0/2528772200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3f013f0c0 0x7fd3f006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.527+0000 7fd3eea00640 1 -- 172.21.15.44:0/2528772200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3f013f0c0 msgr2=0x7fd3f006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.527+0000 7fd3eea00640 1 --2- 172.21.15.44:0/2528772200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3f013f0c0 0x7fd3f006d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.527+0000 7fd3eea00640 1 -- 172.21.15.44:0/2528772200 >> v1:172.21.15.151:6789/0 conn(0x7fd3f01603d0 legacy=0x7fd3f00cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.527+0000 7fd3eea00640 1 -- 172.21.15.44:0/2528772200 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f013fa40 con 0x7fd3f006d720 2024-03-30T13:15:28.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.528+0000 7fd3eea00640 1 --2- 172.21.15.44:0/2528772200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3f006d720 0x7fd3f015fe90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009870 tx=0x7fd3dc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479efb340e818918 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.529+0000 7fd3ee000640 1 -- 172.21.15.44:0/2528772200 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0317c0 con 0x7fd3f006d720 2024-03-30T13:15:28.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.529+0000 7fd3ee000640 1 -- 172.21.15.44:0/2528772200 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3dc037070 con 0x7fd3f006d720 2024-03-30T13:15:28.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.529+0000 7fd3ee000640 1 -- 172.21.15.44:0/2528772200 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc031b80 con 0x7fd3f006d720 2024-03-30T13:15:28.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.529+0000 7fd3f6800640 1 -- 172.21.15.44:0/2528772200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3f006d720 msgr2=0x7fd3f015fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.529+0000 7fd3f6800640 1 --2- 172.21.15.44:0/2528772200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3f006d720 0x7fd3f015fe90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009870 tx=0x7fd3dc02b860 comp rx=0 tx=0).stop 2024-03-30T13:15:28.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.530+0000 7fd3f6800640 1 -- 172.21.15.44:0/2528772200 shutdown_connections 2024-03-30T13:15:28.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.530+0000 7fd3f6800640 1 --2- 172.21.15.44:0/2528772200 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3f006d720 0x7fd3f015fe90 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.530+0000 7fd3f6800640 1 --2- 172.21.15.44:0/2528772200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3f013f0c0 0x7fd3f006d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.530+0000 7fd3f6800640 1 -- 172.21.15.44:0/2528772200 >> 172.21.15.44:0/2528772200 conn(0x7fd3f00b5b00 msgr2=0x7fd3f006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.530+0000 7fd3f6800640 1 -- 172.21.15.44:0/2528772200 shutdown_connections 2024-03-30T13:15:28.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.530+0000 7fd3f6800640 1 -- 172.21.15.44:0/2528772200 wait complete. 2024-03-30T13:15:28.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.532+0000 7fd3f6800640 1 Processor -- start 2024-03-30T13:15:28.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.532+0000 7fd3f6800640 1 -- start start 2024-03-30T13:15:28.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3f6800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3f006d720 0x7fd3f013e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3f6800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3f013f0c0 0x7fd3f015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3f6800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3f01603d0 0x7fd3f015e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3f6800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f0160820 con 0x7fd3f013f0c0 2024-03-30T13:15:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3f6800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f0140000 con 0x7fd3f006d720 2024-03-30T13:15:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3f6800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f013f4a0 con 0x7fd3f01603d0 2024-03-30T13:15:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3eea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3f013f0c0 0x7fd3f015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3eea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3f013f0c0 0x7fd3f015e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54122/0 (socket says 172.21.15.44:54122) 2024-03-30T13:15:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3eea00640 1 -- 172.21.15.44:0/3017667803 learned_addr learned my addr 172.21.15.44:0/3017667803 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3eea00640 1 -- 172.21.15.44:0/3017667803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3f01603d0 msgr2=0x7fd3f015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3eea00640 1 --2- 172.21.15.44:0/3017667803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3f01603d0 0x7fd3f015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3eea00640 1 -- 172.21.15.44:0/3017667803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3f006d720 msgr2=0x7fd3f013e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3eea00640 1 --2- 172.21.15.44:0/3017667803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3f006d720 0x7fd3f013e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.533+0000 7fd3eea00640 1 -- 172.21.15.44:0/3017667803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f00b31c0 con 0x7fd3f013f0c0 2024-03-30T13:15:28.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.534+0000 7fd3eea00640 1 --2- 172.21.15.44:0/3017667803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3f013f0c0 0x7fd3f015e2e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc000c00 tx=0x7fd3dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.534+0000 7fd3e7400640 1 -- 172.21.15.44:0/3017667803 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc032860 con 0x7fd3f013f0c0 2024-03-30T13:15:28.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.534+0000 7fd3e7400640 1 -- 172.21.15.44:0/3017667803 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3dc032a20 con 0x7fd3f013f0c0 2024-03-30T13:15:28.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.534+0000 7fd3f6800640 1 -- 172.21.15.44:0/3017667803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f00b34a0 con 0x7fd3f013f0c0 2024-03-30T13:15:28.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.534+0000 7fd3e7400640 1 -- 172.21.15.44:0/3017667803 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc032e10 con 0x7fd3f013f0c0 2024-03-30T13:15:28.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.534+0000 7fd3f6800640 1 -- 172.21.15.44:0/3017667803 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3f00b3a60 con 0x7fd3f013f0c0 2024-03-30T13:15:28.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.537+0000 7fd3e7400640 1 -- 172.21.15.44:0/3017667803 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd3dc04c060 con 0x7fd3f013f0c0 2024-03-30T13:15:28.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.537+0000 7fd3e7400640 1 --2- 172.21.15.44:0/3017667803 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd3d006c530 0x7fd3d006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.538+0000 7fd3e7400640 1 -- 172.21.15.44:0/3017667803 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7fd3dc0ad040 con 0x7fd3f013f0c0 2024-03-30T13:15:28.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.538+0000 7fd3ef400640 1 --2- 172.21.15.44:0/3017667803 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd3d006c530 0x7fd3d006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.538+0000 7fd3f93fc740 1 Processor -- start 2024-03-30T13:15:28.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.538+0000 7fd3f93fc740 1 -- start start 2024-03-30T13:15:28.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.539+0000 7fd3f93fc740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 0x55c5a2116dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.539+0000 7fd3f93fc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a2117300 0x55c5a20ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.539+0000 7fd3f93fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 0x55c5a20ef810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.539+0000 7fd3f93fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c5a2053330 con 0x55c5a20f0670 2024-03-30T13:15:28.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.539+0000 7fd3f93fc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c5a1ffb620 con 0x55c5a2117300 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.539+0000 7fd3f93fc740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55c5a204f440 con 0x55c5a20f0290 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.539+0000 7fd3ef400640 1 --2- 172.21.15.44:0/3017667803 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd3d006c530 0x7fd3d006e9f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0073560 tx=0x7fd3e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.540+0000 7fd3efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 0x55c5a20ef810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.540+0000 7fd3efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 0x55c5a20ef810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54128/0 (socket says 172.21.15.44:54128) 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.540+0000 7fd3efe00640 1 -- 172.21.15.44:0/3939336611 learned_addr learned my addr 172.21.15.44:0/3939336611 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.540+0000 7fd3eea00640 1 --2- 172.21.15.44:0/3939336611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a2117300 0x55c5a20ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.540+0000 7fd3ef400640 1 --2- 172.21.15.44:0/3939336611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 0x55c5a2116dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.540+0000 7fd3efe00640 1 -- 172.21.15.44:0/3939336611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 msgr2=0x55c5a2116dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.540+0000 7fd3efe00640 1 --2- 172.21.15.44:0/3939336611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 0x55c5a2116dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.540+0000 7fd3efe00640 1 -- 172.21.15.44:0/3939336611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a2117300 msgr2=0x55c5a20ef2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.540+0000 7fd3efe00640 1 --2- 172.21.15.44:0/3939336611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a2117300 0x55c5a20ef2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.540+0000 7fd3efe00640 1 -- 172.21.15.44:0/3939336611 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5a1e33920 con 0x55c5a20f0670 2024-03-30T13:15:28.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.540+0000 7fd3efe00640 1 --2- 172.21.15.44:0/3939336611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 0x55c5a20ef810 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8001cf0 tx=0x7fd3e80021b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb7ac223e308c5b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.541+0000 7fd3dbe00640 1 -- 172.21.15.44:0/3939336611 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8017070 con 0x55c5a20f0670 2024-03-30T13:15:28.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.541+0000 7fd3dbe00640 1 -- 172.21.15.44:0/3939336611 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e800cc70 con 0x55c5a20f0670 2024-03-30T13:15:28.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.541+0000 7fd3dbe00640 1 -- 172.21.15.44:0/3939336611 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8003bd0 con 0x55c5a20f0670 2024-03-30T13:15:28.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.542+0000 7fd3f93fc740 1 -- 172.21.15.44:0/3939336611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 msgr2=0x55c5a20ef810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.542+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/3939336611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 0x55c5a20ef810 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8001cf0 tx=0x7fd3e80021b0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.542+0000 7fd3f93fc740 1 -- 172.21.15.44:0/3939336611 shutdown_connections 2024-03-30T13:15:28.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.542+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/3939336611 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 0x55c5a20ef810 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.542+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/3939336611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a2117300 0x55c5a20ef2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.542+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/3939336611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 0x55c5a2116dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.542+0000 7fd3f93fc740 1 -- 172.21.15.44:0/3939336611 >> 172.21.15.44:0/3939336611 conn(0x55c5a20b6be0 msgr2=0x55c5a2134fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.542+0000 7fd3f93fc740 1 -- 172.21.15.44:0/3939336611 shutdown_connections 2024-03-30T13:15:28.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.542+0000 7fd3f93fc740 1 -- 172.21.15.44:0/3939336611 wait complete. 2024-03-30T13:15:28.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.543+0000 7fd3f93fc740 1 -- start start 2024-03-30T13:15:28.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.543+0000 7fd3f93fc740 1 Processor -- start 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.544+0000 7fd3f93fc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a20f0290 0x55c5a210e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.544+0000 7fd3f93fc740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0670 0x55c5a211ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.544+0000 7fd3f93fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 0x55c5a211cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.544+0000 7fd3f93fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55c5a2116930 con 0x55c5a2111110 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.544+0000 7fd3f93fc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c5a200e9d0 con 0x55c5a20f0290 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.544+0000 7fd3f93fc740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55c5a210f6b0 con 0x55c5a20f0670 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.544+0000 7fd3f93fc740 10 client.0 _ll_register_callbacks cb 0x55c5a204afd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.544+0000 7fd3efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 0x55c5a211cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.544+0000 7fd3efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 0x55c5a211cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54138/0 (socket says 172.21.15.44:54138) 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.544+0000 7fd3efe00640 1 -- 172.21.15.44:0/1836668560 learned_addr learned my addr 172.21.15.44:0/1836668560 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.544+0000 7fd3ef400640 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a20f0290 0x55c5a210e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.544+0000 7fd3eea00640 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0670 0x55c5a211ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.545+0000 7fd3efe00640 1 -- 172.21.15.44:0/1836668560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0670 msgr2=0x55c5a211ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.545+0000 7fd3efe00640 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0670 0x55c5a211ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.545+0000 7fd3efe00640 1 -- 172.21.15.44:0/1836668560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a20f0290 msgr2=0x55c5a210e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.545+0000 7fd3efe00640 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a20f0290 0x55c5a210e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.545+0000 7fd3efe00640 1 -- 172.21.15.44:0/1836668560 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5a1d27210 con 0x55c5a2111110 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.545+0000 7fd3efe00640 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 0x55c5a211cf50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8004000 tx=0x7fd3e8001510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2244f40fb0d3216e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.545+0000 7fd3d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.545+0000 7fd3d8c00640 1 -- 172.21.15.44:0/1836668560 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8022020 con 0x55c5a2111110 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.545+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1836668560 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3e800cc70 con 0x55c5a2111110 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.545+0000 7fd3d8c00640 1 -- 172.21.15.44:0/1836668560 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7fd3e8003970 con 0x55c5a2111110 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.546+0000 7fd3d8c00640 1 -- 172.21.15.44:0/1836668560 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd3e802c050 con 0x55c5a2111110 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.546+0000 7fd3f93fc740 10 client.6300 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.546+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1836668560 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55c5a1e940b0 con 0x55c5a2111110 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.546+0000 7fd3d8c00640 1 -- 172.21.15.44:0/1836668560 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e800cc70 con 0x55c5a2111110 2024-03-30T13:15:28.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.546+0000 7fd3d8c00640 1 -- 172.21.15.44:0/1836668560 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fd3e802f020 con 0x55c5a2111110 2024-03-30T13:15:28.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.546+0000 7fd3f93fc740 10 client.6300 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:28.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.546+0000 7fd3f93fc740 10 client.6300 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:28.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.546+0000 7fd3f93fc740 20 client.6300 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:28.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.546+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c5a2145210 0x55c5a2145620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.546+0000 7fd3f93fc740 4 client.6300 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:28.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.546+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1836668560 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5a2060870 con 0x55c5a2145210 2024-03-30T13:15:28.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.546+0000 7fd3ef400640 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c5a2145210 0x55c5a2145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.547+0000 7fd3ef400640 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c5a2145210 0x55c5a2145620 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d8ef7e9f4312a15 server_cookie=c2809118036e1ae in_seq=0 out_seq=0 2024-03-30T13:15:28.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.547+0000 7fd3d8c00640 10 client.6300 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3d8c00640 1 -- 172.21.15.44:0/1836668560 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55c5a2060870 con 0x55c5a2145210 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3d8c00640 10 client.6300 handle_command_reply: tid=0 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3f93fc740 1 client.6300 shutdown 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1836668560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 msgr2=0x55c5a211cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 0x55c5a211cf50 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8004000 tx=0x7fd3e8001510 comp rx=0 tx=0).stop 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1836668560 shutdown_connections 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c5a2145210 0x55c5a2145620 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 0x55c5a211cf50 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0670 0x55c5a211ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/1836668560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a20f0290 0x55c5a210e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3d8c00640 0 client.6300 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1836668560 >> 172.21.15.44:0/1836668560 conn(0x55c5a20b6be0 msgr2=0x55c5a2117f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1836668560 shutdown_connections 2024-03-30T13:15:28.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.548+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1836668560 wait complete. 2024-03-30T13:15:28.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.549+0000 7fd3f93fc740 20 client.6300 trim_cache size 0 max 16384 2024-03-30T13:15:28.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.565+0000 7fd3f93fc740 1 Processor -- start 2024-03-30T13:15:28.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.565+0000 7fd3f93fc740 1 -- start start 2024-03-30T13:15:28.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.565+0000 7fd3f93fc740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 0x55c5a2158b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.565+0000 7fd3f93fc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a20f0670 0x55c5a21181d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3f93fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 0x55c5a211c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3f93fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f0201260 con 0x55c5a2111110 2024-03-30T13:15:28.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3f93fc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f0200240 con 0x55c5a20f0670 2024-03-30T13:15:28.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3f93fc740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd3f0159470 con 0x55c5a20f0290 2024-03-30T13:15:28.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 0x55c5a211c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3efe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 0x55c5a211c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54150/0 (socket says 172.21.15.44:54150) 2024-03-30T13:15:28.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3efe00640 1 -- 172.21.15.44:0/1573309170 learned_addr learned my addr 172.21.15.44:0/1573309170 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3efe00640 1 -- 172.21.15.44:0/1573309170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 msgr2=0x55c5a2158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3efe00640 1 --2- 172.21.15.44:0/1573309170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 0x55c5a2158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3eea00640 1 --2- 172.21.15.44:0/1573309170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a20f0670 0x55c5a21181d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3efe00640 1 -- 172.21.15.44:0/1573309170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a20f0670 msgr2=0x55c5a21181d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3efe00640 1 --2- 172.21.15.44:0/1573309170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a20f0670 0x55c5a21181d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.566+0000 7fd3efe00640 1 -- 172.21.15.44:0/1573309170 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5a2145990 con 0x55c5a2111110 2024-03-30T13:15:28.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.567+0000 7fd3efe00640 1 --2- 172.21.15.44:0/1573309170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 0x55c5a211c950 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd3e802a040 tx=0x7fd3e801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a7af574f359275 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.567+0000 7fd3db400640 1 -- 172.21.15.44:0/1573309170 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8022070 con 0x55c5a2111110 2024-03-30T13:15:28.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.567+0000 7fd3db400640 1 -- 172.21.15.44:0/1573309170 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e8018040 con 0x55c5a2111110 2024-03-30T13:15:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.567+0000 7fd3db400640 1 -- 172.21.15.44:0/1573309170 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8017070 con 0x55c5a2111110 2024-03-30T13:15:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.567+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1573309170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 msgr2=0x55c5a211c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.568+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/1573309170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 0x55c5a211c950 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd3e802a040 tx=0x7fd3e801c000 comp rx=0 tx=0).stop 2024-03-30T13:15:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.568+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1573309170 shutdown_connections 2024-03-30T13:15:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.568+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/1573309170 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a2111110 0x55c5a211c950 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.568+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/1573309170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a20f0670 0x55c5a21181d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.568+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/1573309170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 0x55c5a2158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.568+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1573309170 >> 172.21.15.44:0/1573309170 conn(0x55c5a20b6be0 msgr2=0x55c5a21382b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.568+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1573309170 shutdown_connections 2024-03-30T13:15:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.568+0000 7fd3f93fc740 1 -- 172.21.15.44:0/1573309170 wait complete. 2024-03-30T13:15:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.568+0000 7fd3f93fc740 1 -- start start 2024-03-30T13:15:28.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.569+0000 7fd3f93fc740 1 Processor -- start 2024-03-30T13:15:28.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3f93fc740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 0x55c5a21afb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3f93fc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 0x55c5a210bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3f93fc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a2111110 0x55c5a210c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3f93fc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3f01ffcd0 con 0x55c5a20f0670 2024-03-30T13:15:28.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3f93fc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c5a21b0550 con 0x55c5a2111110 2024-03-30T13:15:28.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3f93fc740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55c5a211b280 con 0x55c5a20f0290 2024-03-30T13:15:28.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3f93fc740 10 client.0 _ll_register_callbacks cb 0x7fd3e8015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3eea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 0x55c5a210bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3eea00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 0x55c5a210bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54156/0 (socket says 172.21.15.44:54156) 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3eea00640 1 -- 172.21.15.44:0/2240758189 learned_addr learned my addr 172.21.15.44:0/2240758189 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3efe00640 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a2111110 0x55c5a210c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3ef400640 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 0x55c5a21afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3eea00640 1 -- 172.21.15.44:0/2240758189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 msgr2=0x55c5a21afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3eea00640 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 0x55c5a21afb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3eea00640 1 -- 172.21.15.44:0/2240758189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a2111110 msgr2=0x55c5a210c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3eea00640 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a2111110 0x55c5a210c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.570+0000 7fd3eea00640 1 -- 172.21.15.44:0/2240758189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5a1d002d0 con 0x55c5a20f0670 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.571+0000 7fd3eea00640 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 0x55c5a210bb40 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0771d0 tx=0x7fd3dc031f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a38c25c601c523 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.571+0000 7fd3d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.571+0000 7fd3d8c00640 1 -- 172.21.15.44:0/2240758189 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0a8070 con 0x55c5a20f0670 2024-03-30T13:15:28.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.571+0000 7fd3d8c00640 1 -- 172.21.15.44:0/2240758189 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7fd3dc095ca0 con 0x55c5a20f0670 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.571+0000 7fd3f93fc740 1 -- 172.21.15.44:0/2240758189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3e8018040 con 0x55c5a20f0670 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.571+0000 7fd3d8c00640 1 -- 172.21.15.44:0/2240758189 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd3dc07f120 con 0x55c5a20f0670 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.571+0000 7fd3f93fc740 10 client.6306 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.571+0000 7fd3f93fc740 1 -- 172.21.15.44:0/2240758189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55c5a21b02d0 con 0x55c5a20f0670 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.572+0000 7fd3d8c00640 1 -- 172.21.15.44:0/2240758189 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3e8018040 con 0x55c5a20f0670 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.572+0000 7fd3d8c00640 1 -- 172.21.15.44:0/2240758189 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fd3dc0a4ce0 con 0x55c5a20f0670 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.572+0000 7fd3f93fc740 10 client.6306 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.572+0000 7fd3f93fc740 10 client.6306 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.572+0000 7fd3f93fc740 20 client.6306 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.572+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c5a214e050 0x55c5a210d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.572+0000 7fd3f93fc740 4 client.6306 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628403}] 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.572+0000 7fd3f93fc740 1 -- 172.21.15.44:0/2240758189 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628403}) -- 0x55c5a2110f60 con 0x55c5a214e050 2024-03-30T13:15:28.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.572+0000 7fd3ef400640 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c5a214e050 0x55c5a210d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3ef400640 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c5a214e050 0x55c5a210d6d0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=444299a84fe2af2d server_cookie=95bc76b1b939ca97 in_seq=0 out_seq=0 2024-03-30T13:15:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3d8c00640 10 client.6306 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3d8c00640 1 -- 172.21.15.44:0/2240758189 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4764 (crc 0 0 0) 0x55c5a2110f60 con 0x55c5a214e050 2024-03-30T13:15:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3d8c00640 10 client.6306 handle_command_reply: tid=0 2024-03-30T13:15:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3f93fc740 1 client.6306 shutdown 2024-03-30T13:15:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3f93fc740 1 -- 172.21.15.44:0/2240758189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 msgr2=0x55c5a210bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 0x55c5a210bb40 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0771d0 tx=0x7fd3dc031f50 comp rx=0 tx=0).stop 2024-03-30T13:15:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3f93fc740 1 -- 172.21.15.44:0/2240758189 shutdown_connections 2024-03-30T13:15:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55c5a214e050 0x55c5a210d6d0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5a2111110 0x55c5a210c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55c5a20f0670 0x55c5a210bb40 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3d8c00640 0 client.6306 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3f93fc740 1 --2- 172.21.15.44:0/2240758189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c5a20f0290 0x55c5a21afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3f93fc740 1 -- 172.21.15.44:0/2240758189 >> 172.21.15.44:0/2240758189 conn(0x55c5a20b6be0 msgr2=0x55c5a214e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.573+0000 7fd3f93fc740 1 -- 172.21.15.44:0/2240758189 shutdown_connections 2024-03-30T13:15:28.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.574+0000 7fd3f93fc740 1 -- 172.21.15.44:0/2240758189 wait complete. 2024-03-30T13:15:28.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.574+0000 7fd3f93fc740 20 client.6306 trim_cache size 0 max 16384 2024-03-30T13:15:28.582 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:28.582 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/xattr_trusted.c", 2024-03-30T13:15:28.582 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628403, 2024-03-30T13:15:28.582 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.589806+0000", 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.578533+0000", 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:28.583 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 1094, 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.578533+0000", 2024-03-30T13:15:28.584 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:28.585 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1094, 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:28.586 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.589806+0000" 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 1094, 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.589806+0000" 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 186, 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:28.587 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 36, 2024-03-30T13:15:28.588 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:28.588 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:28.588 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:28.588 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:28.588 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:28.588 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:28.588 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:28.588 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.588 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:28.588 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:28.589 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:28.590 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.591 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.592 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.593 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:28.594 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.595 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:28.596 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:28.597 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:28.597 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:28.597 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.597 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:28.597 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:28.597 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:28.597 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:28.597 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:28.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.574+0000 7fd3f6800640 1 -- 172.21.15.44:0/3017667803 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd3d006c530 msgr2=0x7fd3d006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.574+0000 7fd3f6800640 1 --2- 172.21.15.44:0/3017667803 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd3d006c530 0x7fd3d006e9f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0073560 tx=0x7fd3e0008040 comp rx=0 tx=0).stop 2024-03-30T13:15:28.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.574+0000 7fd3f6800640 1 -- 172.21.15.44:0/3017667803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3f013f0c0 msgr2=0x7fd3f015e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.574+0000 7fd3f6800640 1 --2- 172.21.15.44:0/3017667803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3f013f0c0 0x7fd3f015e2e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc000c00 tx=0x7fd3dc0046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.574+0000 7fd3f6800640 1 -- 172.21.15.44:0/3017667803 shutdown_connections 2024-03-30T13:15:28.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.574+0000 7fd3f6800640 1 --2- 172.21.15.44:0/3017667803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3f01603d0 0x7fd3f015e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.574+0000 7fd3f6800640 1 --2- 172.21.15.44:0/3017667803 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3f013f0c0 0x7fd3f015e2e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.574+0000 7fd3f6800640 1 --2- 172.21.15.44:0/3017667803 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd3d006c530 0x7fd3d006e9f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.574+0000 7fd3f6800640 1 --2- 172.21.15.44:0/3017667803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3f006d720 0x7fd3f013e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.574+0000 7fd3f6800640 1 -- 172.21.15.44:0/3017667803 >> 172.21.15.44:0/3017667803 conn(0x7fd3f00b5b00 msgr2=0x7fd3f00cee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.575+0000 7fd3f6800640 1 -- 172.21.15.44:0/3017667803 shutdown_connections 2024-03-30T13:15:28.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.575+0000 7fd3f6800640 1 -- 172.21.15.44:0/3017667803 wait complete. 2024-03-30T13:15:28.600 DEBUG:tasks.cephfs.test_uninlining:getting inode info #13 of 23:1099511628401 2024-03-30T13:15:28.600 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628401 2024-03-30T13:15:28.600 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628401 2024-03-30T13:15:28.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.807+0000 7f76bdc00640 1 Processor -- start 2024-03-30T13:15:28.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.807+0000 7f76bdc00640 1 -- start start 2024-03-30T13:15:28.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.809+0000 7f76bdc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b80ba090 0x7f76b80d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.809+0000 7f76bdc00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76b80d2ff0 con 0x7f76b80b5dc0 2024-03-30T13:15:28.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.809+0000 7f76bdc00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76b80d32d0 con 0x7f76b80b73d0 2024-03-30T13:15:28.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.809+0000 7f76bdc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f76b80d35b0 con 0x7f76b80ba090 2024-03-30T13:15:28.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.810+0000 7f76b6a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f76b80b5dc0 0x7f76b80b61a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42978/0 (socket says 172.21.15.44:42978) 2024-03-30T13:15:28.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.810+0000 7f76b6a00640 1 -- 172.21.15.44:0/767971476 learned_addr learned my addr 172.21.15.44:0/767971476 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:28.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.810+0000 7f76afe00640 1 --2- 172.21.15.44:0/767971476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b80ba090 0x7f76b80d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.810+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904605828 0 0) 0x7f76b80d2ff0 con 0x7f76b80b5dc0 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.810+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f769c003520 con 0x7f76b80b5dc0 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3139656477 0 0) 0x7f76b80d32d0 con 0x7f76b80b73d0 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76b80d2ff0 con 0x7f76b80b73d0 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2309704063 0 0) 0x7f769c003520 con 0x7f76b80b5dc0 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b80ba090 msgr2=0x7f76b80d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 --2- 172.21.15.44:0/767971476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b80ba090 0x7f76b80d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 >> v1:172.21.15.151:6789/0 conn(0x7f76b80b73d0 legacy=0x7f76b80b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b80d3890 con 0x7f76b80b5dc0 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f76a8001670 con 0x7f76b80b5dc0 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 >> v1:172.21.15.44:6789/0 conn(0x7f76b80b5dc0 legacy=0x7f76b80b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 --2- 172.21.15.44:0/767971476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f769c003b70 0x7f769c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 --2- 172.21.15.44:0/767971476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b80ba090 0x7f769c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 --2- 172.21.15.44:0/767971476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f769c004d40 0x7f769c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76b80d35b0 con 0x7f769c003b70 2024-03-30T13:15:28.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f769c00baa0 con 0x7f769c004d40 2024-03-30T13:15:28.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f769c00bca0 con 0x7f76b80ba090 2024-03-30T13:15:28.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.811+0000 7f76b6a00640 1 --2- 172.21.15.44:0/767971476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f769c003b70 0x7f769c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.812+0000 7f76b7400640 1 --2- 172.21.15.44:0/767971476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f769c004d40 0x7f769c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.812+0000 7f76afe00640 1 --2- 172.21.15.44:0/767971476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b80ba090 0x7f769c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.812+0000 7f76b6a00640 1 -- 172.21.15.44:0/767971476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b80ba090 msgr2=0x7f769c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.812+0000 7f76b6a00640 1 --2- 172.21.15.44:0/767971476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b80ba090 0x7f769c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.812+0000 7f76b6a00640 1 -- 172.21.15.44:0/767971476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f769c004d40 msgr2=0x7f769c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.812+0000 7f76b6a00640 1 --2- 172.21.15.44:0/767971476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f769c004d40 0x7f769c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.812+0000 7f76b6a00640 1 -- 172.21.15.44:0/767971476 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c003520 con 0x7f769c003b70 2024-03-30T13:15:28.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.814+0000 7f76b6a00640 1 --2- 172.21.15.44:0/767971476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f769c003b70 0x7f769c003f70 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f76a8007fc0 tx=0x7f769c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492c091f2f66d19d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.814+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8007be0 con 0x7f769c003b70 2024-03-30T13:15:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.814+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a8030070 con 0x7f769c003b70 2024-03-30T13:15:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.814+0000 7f76b6000640 1 -- 172.21.15.44:0/767971476 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8005d30 con 0x7f769c003b70 2024-03-30T13:15:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.815+0000 7f76bdc00640 1 -- 172.21.15.44:0/767971476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f769c003b70 msgr2=0x7f769c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.815+0000 7f76bdc00640 1 --2- 172.21.15.44:0/767971476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f769c003b70 0x7f769c003f70 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f76a8007fc0 tx=0x7f769c005830 comp rx=0 tx=0).stop 2024-03-30T13:15:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.815+0000 7f76b7400640 1 -- 172.21.15.44:0/767971476 reap_dead start 2024-03-30T13:15:28.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.815+0000 7f76bdc00640 1 -- 172.21.15.44:0/767971476 shutdown_connections 2024-03-30T13:15:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.815+0000 7f76bdc00640 1 -- 172.21.15.44:0/767971476 >> 172.21.15.44:0/767971476 conn(0x7f76b80678f0 msgr2=0x7f76b80d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.815+0000 7f76bdc00640 1 -- 172.21.15.44:0/767971476 shutdown_connections 2024-03-30T13:15:28.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.815+0000 7f76bdc00640 1 -- 172.21.15.44:0/767971476 wait complete. 2024-03-30T13:15:28.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.817+0000 7f76bdc00640 1 Processor -- start 2024-03-30T13:15:28.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.817+0000 7f76bdc00640 1 -- start start 2024-03-30T13:15:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.818+0000 7f76bdc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f769c003b70 0x7f76b80cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.818+0000 7f76bdc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b814df80 0x7f76b80cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.818+0000 7f76bdc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ccc50 0x7f76b815eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.818+0000 7f76bdc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76b815e880 con 0x7f76b80ccc50 2024-03-30T13:15:28.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.818+0000 7f76bdc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f76b80d4090 con 0x7f769c003b70 2024-03-30T13:15:28.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.818+0000 7f76bdc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f76b815ea00 con 0x7f76b814df80 2024-03-30T13:15:28.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.818+0000 7f76b7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ccc50 0x7f76b815eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.818+0000 7f76b7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ccc50 0x7f76b815eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54178/0 (socket says 172.21.15.44:54178) 2024-03-30T13:15:28.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.819+0000 7f76b7400640 1 -- 172.21.15.44:0/55712805 learned_addr learned my addr 172.21.15.44:0/55712805 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.819+0000 7f76b6a00640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f769c003b70 0x7f76b80cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.819+0000 7f76afe00640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b814df80 0x7f76b80cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.819+0000 7f76b7400640 1 -- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b814df80 msgr2=0x7f76b80cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.819+0000 7f76b7400640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b814df80 0x7f76b80cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.819+0000 7f76b7400640 1 -- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f769c003b70 msgr2=0x7f76b80cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.819+0000 7f76b7400640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f769c003b70 0x7f76b80cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.819+0000 7f76b7400640 1 -- 172.21.15.44:0/55712805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b814d1c0 con 0x7f76b80ccc50 2024-03-30T13:15:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.819+0000 7f76b7400640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ccc50 0x7f76b815eed0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f76b80cb3a0 tx=0x7f76b000fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.820+0000 7f76aea00640 1 -- 172.21.15.44:0/55712805 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0019070 con 0x7f76b80ccc50 2024-03-30T13:15:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.820+0000 7f76aea00640 1 -- 172.21.15.44:0/55712805 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b0006e20 con 0x7f76b80ccc50 2024-03-30T13:15:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.820+0000 7f76aea00640 1 -- 172.21.15.44:0/55712805 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0003b70 con 0x7f76b80ccc50 2024-03-30T13:15:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.820+0000 7f76bdc00640 1 -- 172.21.15.44:0/55712805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b814d4a0 con 0x7f76b80ccc50 2024-03-30T13:15:28.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.820+0000 7f76bdc00640 1 -- 172.21.15.44:0/55712805 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b814da60 con 0x7f76b80ccc50 2024-03-30T13:15:28.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.822+0000 7f76aea00640 1 -- 172.21.15.44:0/55712805 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f76b0003d10 con 0x7f76b80ccc50 2024-03-30T13:15:28.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.823+0000 7f76aea00640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f769406c560 0x7f769406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.823+0000 7f76aea00640 1 -- 172.21.15.44:0/55712805 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f76b008adb0 con 0x7f76b80ccc50 2024-03-30T13:15:28.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.824+0000 7f76b6a00640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f769406c560 0x7f769406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.825+0000 7f76c0a28740 1 Processor -- start 2024-03-30T13:15:28.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.825+0000 7f76c0a28740 1 -- start start 2024-03-30T13:15:28.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.825+0000 7f76b6a00640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f769406c560 0x7f769406ea20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f76a8034000 tx=0x7f76a8009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.826+0000 7f76c0a28740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283290 0x5644892a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.826+0000 7f76c0a28740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644892aa300 0x5644892822d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.826+0000 7f76c0a28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 0x564489282810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.826+0000 7f76c0a28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5644891e6330 con 0x564489283670 2024-03-30T13:15:28.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.826+0000 7f76c0a28740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56448918e620 con 0x564489283290 2024-03-30T13:15:28.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.826+0000 7f76c0a28740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5644891e2440 con 0x5644892aa300 2024-03-30T13:15:28.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.827+0000 7f76b7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 0x564489282810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.827+0000 7f76b7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 0x564489282810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54184/0 (socket says 172.21.15.44:54184) 2024-03-30T13:15:28.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.827+0000 7f76b7400640 1 -- 172.21.15.44:0/799917423 learned_addr learned my addr 172.21.15.44:0/799917423 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.827+0000 7f76b6a00640 1 --2- 172.21.15.44:0/799917423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283290 0x5644892a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.827+0000 7f76afe00640 1 --2- 172.21.15.44:0/799917423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644892aa300 0x5644892822d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.827+0000 7f76b7400640 1 -- 172.21.15.44:0/799917423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644892aa300 msgr2=0x5644892822d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.827+0000 7f76b7400640 1 --2- 172.21.15.44:0/799917423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644892aa300 0x5644892822d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.827+0000 7f76b7400640 1 -- 172.21.15.44:0/799917423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283290 msgr2=0x5644892a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.827+0000 7f76b7400640 1 --2- 172.21.15.44:0/799917423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283290 0x5644892a9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.827+0000 7f76b7400640 1 -- 172.21.15.44:0/799917423 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564488fc6920 con 0x564489283670 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.827+0000 7f76b6a00640 1 --2- 172.21.15.44:0/799917423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283290 0x5644892a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.828+0000 7f76b7400640 1 --2- 172.21.15.44:0/799917423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 0x564489282810 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f76b0010010 tx=0x7f76b0059290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04f4d8b8b9d8edd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.828+0000 7f76a7400640 1 -- 172.21.15.44:0/799917423 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b00616b0 con 0x564489283670 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.828+0000 7f76a7400640 1 -- 172.21.15.44:0/799917423 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b0056b70 con 0x564489283670 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.828+0000 7f76a7400640 1 -- 172.21.15.44:0/799917423 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0055140 con 0x564489283670 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.829+0000 7f76c0a28740 1 -- 172.21.15.44:0/799917423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 msgr2=0x564489282810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.829+0000 7f76c0a28740 1 --2- 172.21.15.44:0/799917423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 0x564489282810 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f76b0010010 tx=0x7f76b0059290 comp rx=0 tx=0).stop 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.829+0000 7f76c0a28740 1 -- 172.21.15.44:0/799917423 shutdown_connections 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.829+0000 7f76c0a28740 1 --2- 172.21.15.44:0/799917423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 0x564489282810 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.829+0000 7f76c0a28740 1 --2- 172.21.15.44:0/799917423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644892aa300 0x5644892822d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.829+0000 7f76c0a28740 1 --2- 172.21.15.44:0/799917423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283290 0x5644892a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.829+0000 7f76c0a28740 1 -- 172.21.15.44:0/799917423 >> 172.21.15.44:0/799917423 conn(0x564489249be0 msgr2=0x5644892c7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.829+0000 7f76c0a28740 1 -- 172.21.15.44:0/799917423 shutdown_connections 2024-03-30T13:15:28.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.829+0000 7f76c0a28740 1 -- 172.21.15.44:0/799917423 wait complete. 2024-03-30T13:15:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.830+0000 7f76c0a28740 1 -- start start 2024-03-30T13:15:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.831+0000 7f76c0a28740 1 Processor -- start 2024-03-30T13:15:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.832+0000 7f76c0a28740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283290 0x5644892b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.832+0000 7f76c0a28740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283670 0x5644892cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.832+0000 7f76c0a28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892d7a40 0x5644892c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.832+0000 7f76c0a28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5644892a9930 con 0x5644892d7a40 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.832+0000 7f76c0a28740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5644891a19d0 con 0x564489283290 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.832+0000 7f76c0a28740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5644892a26b0 con 0x564489283670 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.832+0000 7f76c0a28740 10 client.0 _ll_register_callbacks cb 0x5644891ddfd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.833+0000 7f76b7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892d7a40 0x5644892c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.833+0000 7f76b7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892d7a40 0x5644892c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54196/0 (socket says 172.21.15.44:54196) 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.833+0000 7f76b7400640 1 -- 172.21.15.44:0/1243999613 learned_addr learned my addr 172.21.15.44:0/1243999613 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.833+0000 7f76b6a00640 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283290 0x5644892b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.833+0000 7f76afe00640 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283670 0x5644892cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.833+0000 7f76b7400640 1 -- 172.21.15.44:0/1243999613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283670 msgr2=0x5644892cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.833+0000 7f76b7400640 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283670 0x5644892cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.833+0000 7f76b7400640 1 -- 172.21.15.44:0/1243999613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283290 msgr2=0x5644892b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.833+0000 7f76b7400640 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283290 0x5644892b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.833+0000 7f76b7400640 1 -- 172.21.15.44:0/1243999613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564488eba210 con 0x5644892d7a40 2024-03-30T13:15:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.833+0000 7f76b6a00640 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283290 0x5644892b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.834+0000 7f76b7400640 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892d7a40 0x5644892c6bb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f76b00587d0 tx=0x7f76b0001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff89522922d7e92 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.834+0000 7f769be00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.834+0000 7f769be00640 1 -- 172.21.15.44:0/1243999613 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0058120 con 0x5644892d7a40 2024-03-30T13:15:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.834+0000 7f769be00640 1 -- 172.21.15.44:0/1243999613 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f76b0054820 con 0x5644892d7a40 2024-03-30T13:15:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.834+0000 7f76c0a28740 1 -- 172.21.15.44:0/1243999613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76b0056b70 con 0x5644892d7a40 2024-03-30T13:15:28.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.834+0000 7f769be00640 1 -- 172.21.15.44:0/1243999613 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f76b0054a20 con 0x5644892d7a40 2024-03-30T13:15:28.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.834+0000 7f76c0a28740 10 client.6318 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:28.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.834+0000 7f76c0a28740 1 -- 172.21.15.44:0/1243999613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5644890270b0 con 0x5644892d7a40 2024-03-30T13:15:28.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.834+0000 7f769be00640 1 -- 172.21.15.44:0/1243999613 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b0056b70 con 0x5644892d7a40 2024-03-30T13:15:28.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.835+0000 7f769be00640 1 -- 172.21.15.44:0/1243999613 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f76b006e070 con 0x5644892d7a40 2024-03-30T13:15:28.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.835+0000 7f76c0a28740 10 client.6318 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:28.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.835+0000 7f76c0a28740 10 client.6318 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:28.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.835+0000 7f76c0a28740 20 client.6318 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:28.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.835+0000 7f76c0a28740 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5644892ae130 0x5644892ae560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.835+0000 7f76c0a28740 4 client.6318 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:28.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.835+0000 7f76c0a28740 1 -- 172.21.15.44:0/1243999613 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644891f3870 con 0x5644892ae130 2024-03-30T13:15:28.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.835+0000 7f76b6a00640 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5644892ae130 0x5644892ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.836+0000 7f76b6a00640 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5644892ae130 0x5644892ae560 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a56ef92d9bb3f3a server_cookie=696548844b643682 in_seq=0 out_seq=0 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.836+0000 7f769be00640 10 client.6318 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.836+0000 7f769be00640 1 -- 172.21.15.44:0/1243999613 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5644891f3870 con 0x5644892ae130 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.836+0000 7f769be00640 10 client.6318 handle_command_reply: tid=0 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f76c0a28740 1 client.6318 shutdown 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f76c0a28740 1 -- 172.21.15.44:0/1243999613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892d7a40 msgr2=0x5644892c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f76c0a28740 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892d7a40 0x5644892c6bb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f76b00587d0 tx=0x7f76b0001650 comp rx=0 tx=0).stop 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f76c0a28740 1 -- 172.21.15.44:0/1243999613 shutdown_connections 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f76c0a28740 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5644892ae130 0x5644892ae560 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f76c0a28740 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892d7a40 0x5644892c6bb0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f76c0a28740 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283670 0x5644892cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f76c0a28740 1 --2- 172.21.15.44:0/1243999613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283290 0x5644892b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f76c0a28740 1 -- 172.21.15.44:0/1243999613 >> 172.21.15.44:0/1243999613 conn(0x564489249be0 msgr2=0x5644892a9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f769be00640 0 client.6318 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f76c0a28740 1 -- 172.21.15.44:0/1243999613 shutdown_connections 2024-03-30T13:15:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f76c0a28740 1 -- 172.21.15.44:0/1243999613 wait complete. 2024-03-30T13:15:28.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.837+0000 7f76c0a28740 20 client.6318 trim_cache size 0 max 16384 2024-03-30T13:15:28.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.853+0000 7f76c0a28740 1 Processor -- start 2024-03-30T13:15:28.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.853+0000 7f76c0a28740 1 -- start start 2024-03-30T13:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.854+0000 7f76c0a28740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283290 0x5644892af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.854+0000 7f76c0a28740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283670 0x5644892c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.854+0000 7f76c0a28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892a8a10 0x5644892b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.854+0000 7f76c0a28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76b8201990 con 0x5644892a8a10 2024-03-30T13:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.854+0000 7f76c0a28740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f76b82009c0 con 0x564489283670 2024-03-30T13:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.854+0000 7f76c0a28740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f76b80cbf80 con 0x564489283290 2024-03-30T13:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76b7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892a8a10 0x5644892b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76b7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892a8a10 0x5644892b0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54212/0 (socket says 172.21.15.44:54212) 2024-03-30T13:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76b7400640 1 -- 172.21.15.44:0/1890109886 learned_addr learned my addr 172.21.15.44:0/1890109886 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76b6a00640 1 --2- 172.21.15.44:0/1890109886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283290 0x5644892af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76afe00640 1 --2- 172.21.15.44:0/1890109886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283670 0x5644892c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76b7400640 1 -- 172.21.15.44:0/1890109886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283290 msgr2=0x5644892af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76b7400640 1 --2- 172.21.15.44:0/1890109886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283290 0x5644892af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76b7400640 1 -- 172.21.15.44:0/1890109886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283670 msgr2=0x5644892c51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76b7400640 1 --2- 172.21.15.44:0/1890109886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283670 0x5644892c51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76b7400640 1 -- 172.21.15.44:0/1890109886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564488e932d0 con 0x5644892a8a10 2024-03-30T13:15:28.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76b6a00640 1 --2- 172.21.15.44:0/1890109886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283290 0x5644892af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76b7400640 1 --2- 172.21.15.44:0/1890109886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892a8a10 0x5644892b0780 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f76b0059380 tx=0x7f76b0084070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc98668b208a2788 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.855+0000 7f76a6a00640 1 -- 172.21.15.44:0/1890109886 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b00616b0 con 0x5644892a8a10 2024-03-30T13:15:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.856+0000 7f76a6a00640 1 -- 172.21.15.44:0/1890109886 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b0086070 con 0x5644892a8a10 2024-03-30T13:15:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.856+0000 7f76a6a00640 1 -- 172.21.15.44:0/1890109886 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b0057d40 con 0x5644892a8a10 2024-03-30T13:15:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.856+0000 7f76c0a28740 1 -- 172.21.15.44:0/1890109886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892a8a10 msgr2=0x5644892b0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.856+0000 7f76c0a28740 1 --2- 172.21.15.44:0/1890109886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892a8a10 0x5644892b0780 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f76b0059380 tx=0x7f76b0084070 comp rx=0 tx=0).stop 2024-03-30T13:15:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.856+0000 7f76c0a28740 1 -- 172.21.15.44:0/1890109886 shutdown_connections 2024-03-30T13:15:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.856+0000 7f76c0a28740 1 --2- 172.21.15.44:0/1890109886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5644892a8a10 0x5644892b0780 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.856+0000 7f76c0a28740 1 --2- 172.21.15.44:0/1890109886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564489283670 0x5644892c51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.856+0000 7f76c0a28740 1 --2- 172.21.15.44:0/1890109886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283290 0x5644892af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.856+0000 7f76c0a28740 1 -- 172.21.15.44:0/1890109886 >> 172.21.15.44:0/1890109886 conn(0x564489249be0 msgr2=0x5644892cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.857+0000 7f76c0a28740 1 -- 172.21.15.44:0/1890109886 shutdown_connections 2024-03-30T13:15:28.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.857+0000 7f76c0a28740 1 -- 172.21.15.44:0/1890109886 wait complete. 2024-03-30T13:15:28.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.857+0000 7f76c0a28740 1 -- start start 2024-03-30T13:15:28.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.857+0000 7f76c0a28740 1 Processor -- start 2024-03-30T13:15:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.858+0000 7f76c0a28740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283290 0x564489339620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.858+0000 7f76c0a28740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 0x5644892b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.858+0000 7f76c0a28740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644892a8a10 0x5644892b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.858+0000 7f76c0a28740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f76b8200370 con 0x564489283670 2024-03-30T13:15:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.858+0000 7f76c0a28740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5644892c8c30 con 0x5644892a8a10 2024-03-30T13:15:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.858+0000 7f76c0a28740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x564489343100 con 0x564489283290 2024-03-30T13:15:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.859+0000 7f76c0a28740 10 client.0 _ll_register_callbacks cb 0x7f76b00584c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.859+0000 7f76afe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 0x5644892b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.859+0000 7f76afe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 0x5644892b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54220/0 (socket says 172.21.15.44:54220) 2024-03-30T13:15:28.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.859+0000 7f76afe00640 1 -- 172.21.15.44:0/3472525980 learned_addr learned my addr 172.21.15.44:0/3472525980 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.859+0000 7f76b7400640 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644892a8a10 0x5644892b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.859+0000 7f76b6a00640 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283290 0x564489339620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.859+0000 7f76afe00640 1 -- 172.21.15.44:0/3472525980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283290 msgr2=0x564489339620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.859+0000 7f76afe00640 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283290 0x564489339620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.859+0000 7f76afe00640 1 -- 172.21.15.44:0/3472525980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644892a8a10 msgr2=0x5644892b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.859+0000 7f76afe00640 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644892a8a10 0x5644892b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.859+0000 7f76afe00640 1 -- 172.21.15.44:0/3472525980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644892da450 con 0x564489283670 2024-03-30T13:15:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.859+0000 7f76b6a00640 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283290 0x564489339620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:28.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.860+0000 7f76afe00640 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 0x5644892b0750 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f76b8150650 tx=0x7f76a0016b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263b2b74d457d7b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.860+0000 7f769be00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.860+0000 7f769be00640 1 -- 172.21.15.44:0/3472525980 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0004240 con 0x564489283670 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.860+0000 7f769be00640 1 -- 172.21.15.44:0/3472525980 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f76a00043e0 con 0x564489283670 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.860+0000 7f76c0a28740 1 -- 172.21.15.44:0/3472525980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76b0086070 con 0x564489283670 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.860+0000 7f769be00640 1 -- 172.21.15.44:0/3472525980 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f76a00148e0 con 0x564489283670 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.860+0000 7f76c0a28740 10 client.6324 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.860+0000 7f76c0a28740 1 -- 172.21.15.44:0/3472525980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x564489342e40 con 0x564489283670 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.861+0000 7f769be00640 1 -- 172.21.15.44:0/3472525980 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b0086070 con 0x564489283670 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.861+0000 7f769be00640 1 -- 172.21.15.44:0/3472525980 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f76a0027050 con 0x564489283670 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.861+0000 7f76c0a28740 10 client.6324 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.861+0000 7f76c0a28740 10 client.6324 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.861+0000 7f76c0a28740 20 client.6324 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:28.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.861+0000 7f76c0a28740 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5644892c6900 0x564489346470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.861+0000 7f76c0a28740 4 client.6324 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628401}] 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.861+0000 7f76c0a28740 1 -- 172.21.15.44:0/3472525980 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628401}) -- 0x56448927d680 con 0x5644892c6900 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.861+0000 7f76b6a00640 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5644892c6900 0x564489346470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f76b6a00640 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5644892c6900 0x564489346470 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cf8c8e68eb95bae server_cookie=3b5d8b8707712a37 in_seq=0 out_seq=0 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f769be00640 10 client.6324 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f769be00640 1 -- 172.21.15.44:0/3472525980 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4756 (crc 0 0 0) 0x56448927d680 con 0x5644892c6900 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f769be00640 10 client.6324 handle_command_reply: tid=0 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f76c0a28740 1 client.6324 shutdown 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f76c0a28740 1 -- 172.21.15.44:0/3472525980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 msgr2=0x5644892b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f76c0a28740 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 0x5644892b0750 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f76b8150650 tx=0x7f76a0016b40 comp rx=0 tx=0).stop 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f76c0a28740 1 -- 172.21.15.44:0/3472525980 shutdown_connections 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f76c0a28740 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5644892c6900 0x564489346470 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f76c0a28740 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644892a8a10 0x5644892b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f76c0a28740 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x564489283670 0x5644892b0750 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f76c0a28740 1 --2- 172.21.15.44:0/3472525980 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564489283290 0x564489339620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f769be00640 0 client.6324 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.862+0000 7f76c0a28740 1 -- 172.21.15.44:0/3472525980 >> 172.21.15.44:0/3472525980 conn(0x564489249be0 msgr2=0x5644892cb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76c0a28740 1 -- 172.21.15.44:0/3472525980 shutdown_connections 2024-03-30T13:15:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76c0a28740 1 -- 172.21.15.44:0/3472525980 wait complete. 2024-03-30T13:15:28.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76c0a28740 20 client.6324 trim_cache size 0 max 16384 2024-03-30T13:15:28.872 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/ext2/xattr.h", 2024-03-30T13:15:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628401, 2024-03-30T13:15:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.595012+0000", 2024-03-30T13:15:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.574533+0000", 2024-03-30T13:15:28.872 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:28.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 3340, 2024-03-30T13:15:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.574533+0000", 2024-03-30T13:15:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:28.874 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:28.875 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 3340, 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.595012+0000" 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.876 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 3340, 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.595012+0000" 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 188, 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 32, 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:28.877 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:28.878 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:28.879 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:28.880 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.881 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:28.882 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.883 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.884 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:28.885 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:28.886 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:28.887 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:28.887 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76bdc00640 1 -- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f769406c560 msgr2=0x7f769406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76bdc00640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f769406c560 0x7f769406ea20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f76a8034000 tx=0x7f76a8009030 comp rx=0 tx=0).stop 2024-03-30T13:15:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76bdc00640 1 -- 172.21.15.44:0/55712805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ccc50 msgr2=0x7f76b815eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76bdc00640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ccc50 0x7f76b815eed0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f76b80cb3a0 tx=0x7f76b000fd60 comp rx=0 tx=0).stop 2024-03-30T13:15:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76bdc00640 1 -- 172.21.15.44:0/55712805 shutdown_connections 2024-03-30T13:15:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76bdc00640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f76b80ccc50 0x7f76b815eed0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76bdc00640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76b814df80 0x7f76b80cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76bdc00640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f769406c560 0x7f769406ea20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76bdc00640 1 --2- 172.21.15.44:0/55712805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f769c003b70 0x7f76b80cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.863+0000 7f76bdc00640 1 -- 172.21.15.44:0/55712805 >> 172.21.15.44:0/55712805 conn(0x7f76b80678f0 msgr2=0x7f76b80cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.864+0000 7f76bdc00640 1 -- 172.21.15.44:0/55712805 shutdown_connections 2024-03-30T13:15:28.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:28.864+0000 7f76bdc00640 1 -- 172.21.15.44:0/55712805 wait complete. 2024-03-30T13:15:28.890 DEBUG:tasks.cephfs.test_uninlining:getting inode info #14 of 23:1099511628406 2024-03-30T13:15:28.890 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628406 2024-03-30T13:15:28.890 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628406 2024-03-30T13:15:29.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.095+0000 7f5bd1000640 1 Processor -- start 2024-03-30T13:15:29.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.096+0000 7f5bd1000640 1 -- start start 2024-03-30T13:15:29.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.097+0000 7f5bd1000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5bcc0b4920 0x7f5bcc0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.097+0000 7f5bd1000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5bcc0b4d00 0x7f5bcc0d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.097+0000 7f5bd1000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bcc0b54b0 con 0x7f5bcc0d0b90 2024-03-30T13:15:29.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.097+0000 7f5bd1000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f5bcc0d0260 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.097+0000 7f5bd1000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f5bcc0cfca0 con 0x7f5bcc0b4920 2024-03-30T13:15:29.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.097+0000 7f5bcaa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5bcc0b4d00 0x7f5bcc0d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.097+0000 7f5bcaa00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f5bcc0b4d00 0x7f5bcc0d4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54234/0 (socket says 172.21.15.44:54234) 2024-03-30T13:15:29.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.097+0000 7f5bcaa00640 1 -- 172.21.15.44:0/4131202530 learned_addr learned my addr 172.21.15.44:0/4131202530 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.097+0000 7f5bcb400640 1 --2- 172.21.15.44:0/4131202530 >> v2:172.21.15.151:3300/0 conn(0x7f5bcc0b4920 0x7f5bcc0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.098+0000 7f5bcaa00640 1 -- 172.21.15.44:0/4131202530 >> v2:172.21.15.151:3300/0 conn(0x7f5bcc0b4920 msgr2=0x7f5bcc0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.098+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/4131202530 >> v2:172.21.15.151:3300/0 conn(0x7f5bcc0b4920 0x7f5bcc0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.098+0000 7f5bcaa00640 1 -- 172.21.15.44:0/4131202530 >> v1:172.21.15.151:6789/0 conn(0x7f5bcc0d0b90 legacy=0x7f5bcc0d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.098+0000 7f5bcaa00640 1 -- 172.21.15.44:0/4131202530 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bcc0cff80 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.099+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/4131202530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bcc0b4d00 0x7f5bcc0d4ac0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc09dc10 tx=0x7f5bb802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa235c9a66b5316 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.099+0000 7f5bca000640 1 -- 172.21.15.44:0/4131202530 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb802e070 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.099+0000 7f5bca000640 1 -- 172.21.15.44:0/4131202530 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb8037070 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.099+0000 7f5bca000640 1 -- 172.21.15.44:0/4131202530 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8031a00 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.100+0000 7f5bd1000640 1 -- 172.21.15.44:0/4131202530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bcc0b4d00 msgr2=0x7f5bcc0d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.100+0000 7f5bd1000640 1 --2- 172.21.15.44:0/4131202530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bcc0b4d00 0x7f5bcc0d4ac0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc09dc10 tx=0x7f5bb802b880 comp rx=0 tx=0).stop 2024-03-30T13:15:29.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.100+0000 7f5bd1000640 1 -- 172.21.15.44:0/4131202530 shutdown_connections 2024-03-30T13:15:29.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.100+0000 7f5bd1000640 1 --2- 172.21.15.44:0/4131202530 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bcc0b4d00 0x7f5bcc0d4ac0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.100+0000 7f5bd1000640 1 --2- 172.21.15.44:0/4131202530 >> v2:172.21.15.151:3300/0 conn(0x7f5bcc0b4920 0x7f5bcc0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.100+0000 7f5bd1000640 1 -- 172.21.15.44:0/4131202530 >> 172.21.15.44:0/4131202530 conn(0x7f5bcc09d4e0 msgr2=0x7f5bcc0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.100+0000 7f5bd1000640 1 -- 172.21.15.44:0/4131202530 shutdown_connections 2024-03-30T13:15:29.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.100+0000 7f5bd1000640 1 -- 172.21.15.44:0/4131202530 wait complete. 2024-03-30T13:15:29.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.102+0000 7f5bd1000640 1 Processor -- start 2024-03-30T13:15:29.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.102+0000 7f5bd1000640 1 -- start start 2024-03-30T13:15:29.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.103+0000 7f5bd1000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bcc0b4920 0x7f5bcc150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.103+0000 7f5bd1000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bcc0b4d00 0x7f5bcc151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.103+0000 7f5bd1000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bcc0d0b90 0x7f5bcc1f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.103+0000 7f5bd1000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc0b3ff0 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.103+0000 7f5bd1000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc0d2180 con 0x7f5bcc0d0b90 2024-03-30T13:15:29.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.103+0000 7f5bd1000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5bcc0d5000 con 0x7f5bcc0b4920 2024-03-30T13:15:29.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.103+0000 7f5bcaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bcc0b4d00 0x7f5bcc151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.104+0000 7f5bcaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bcc0b4d00 0x7f5bcc151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54238/0 (socket says 172.21.15.44:54238) 2024-03-30T13:15:29.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.104+0000 7f5bcaa00640 1 -- 172.21.15.44:0/2939676367 learned_addr learned my addr 172.21.15.44:0/2939676367 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.104+0000 7f5bcb400640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bcc0b4920 0x7f5bcc150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.104+0000 7f5bcaa00640 1 -- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bcc0b4920 msgr2=0x7f5bcc150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.104+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bcc0b4920 0x7f5bcc150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.104+0000 7f5bcaa00640 1 -- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bcc0d0b90 msgr2=0x7f5bcc1f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.104+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bcc0d0b90 0x7f5bcc1f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.104+0000 7f5bcaa00640 1 -- 172.21.15.44:0/2939676367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bcc1e7a00 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.104+0000 7f5bcb400640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bcc0b4920 0x7f5bcc150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.104+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bcc0b4d00 0x7f5bcc151260 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8000c00 tx=0x7f5bb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.105+0000 7f5bc3400640 1 -- 172.21.15.44:0/2939676367 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8032880 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.105+0000 7f5bc3400640 1 -- 172.21.15.44:0/2939676367 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb8032a20 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.105+0000 7f5bc3400640 1 -- 172.21.15.44:0/2939676367 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8032e10 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.105+0000 7f5bd1000640 1 -- 172.21.15.44:0/2939676367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bcc0b80b0 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.105+0000 7f5bd1000640 1 -- 172.21.15.44:0/2939676367 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bcc1e7690 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.107+0000 7f5bc3400640 1 -- 172.21.15.44:0/2939676367 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5bb804c060 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.108+0000 7f5bc3400640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5bac06c530 0x7f5bac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.108+0000 7f5bc3400640 1 -- 172.21.15.44:0/2939676367 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f5bb80acfe0 con 0x7f5bcc0b4d00 2024-03-30T13:15:29.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.109+0000 7f5bd53f4740 1 Processor -- start 2024-03-30T13:15:29.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.109+0000 7f5bcb400640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5bac06c530 0x7f5bac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.109+0000 7f5bd53f4740 1 -- start start 2024-03-30T13:15:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.110+0000 7f5bd53f4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c7ba470 0x55f15c7e0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.110+0000 7f5bd53f4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7e14e0 0x55f15c7b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.110+0000 7f5bd53f4740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba850 0x55f15c7b99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.110+0000 7f5bd53f4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f15c71d330 con 0x55f15c7e14e0 2024-03-30T13:15:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.110+0000 7f5bd53f4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f15c6c5620 con 0x55f15c7ba470 2024-03-30T13:15:29.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.110+0000 7f5bd53f4740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55f15c719440 con 0x55f15c7ba850 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.110+0000 7f5bcb400640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5bac06c530 0x7f5bac06e9f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc006fd0 tx=0x7f5bbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.110+0000 7f5bcaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7e14e0 0x55f15c7b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.110+0000 7f5bcaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7e14e0 0x55f15c7b94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54240/0 (socket says 172.21.15.44:54240) 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.111+0000 7f5bcaa00640 1 -- 172.21.15.44:0/1436536889 learned_addr learned my addr 172.21.15.44:0/1436536889 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.111+0000 7f5bcb400640 1 --2- 172.21.15.44:0/1436536889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c7ba470 0x55f15c7e0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.111+0000 7f5bcbe00640 1 --2- 172.21.15.44:0/1436536889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba850 0x55f15c7b99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.111+0000 7f5bcaa00640 1 -- 172.21.15.44:0/1436536889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba850 msgr2=0x55f15c7b99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.111+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/1436536889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba850 0x55f15c7b99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.111+0000 7f5bcaa00640 1 -- 172.21.15.44:0/1436536889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c7ba470 msgr2=0x55f15c7e0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.111+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/1436536889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c7ba470 0x55f15c7e0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.111+0000 7f5bcaa00640 1 -- 172.21.15.44:0/1436536889 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f15c4fd920 con 0x55f15c7e14e0 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.111+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/1436536889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7e14e0 0x55f15c7b94b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80771a0 tx=0x7f5bb807a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8760b949a101702 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.111+0000 7f5bb7e00640 1 -- 172.21.15.44:0/1436536889 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80a9070 con 0x55f15c7e14e0 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.111+0000 7f5bb7e00640 1 -- 172.21.15.44:0/1436536889 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb8037070 con 0x55f15c7e14e0 2024-03-30T13:15:29.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.111+0000 7f5bb7e00640 1 -- 172.21.15.44:0/1436536889 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8093070 con 0x55f15c7e14e0 2024-03-30T13:15:29.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.112+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1436536889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7e14e0 msgr2=0x55f15c7b94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.112+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/1436536889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7e14e0 0x55f15c7b94b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80771a0 tx=0x7f5bb807a9b0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.112+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1436536889 shutdown_connections 2024-03-30T13:15:29.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.112+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/1436536889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba850 0x55f15c7b99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.112+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/1436536889 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7e14e0 0x55f15c7b94b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.112+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/1436536889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c7ba470 0x55f15c7e0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.112+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1436536889 >> 172.21.15.44:0/1436536889 conn(0x55f15c780be0 msgr2=0x55f15c7ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.112+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1436536889 shutdown_connections 2024-03-30T13:15:29.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.112+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1436536889 wait complete. 2024-03-30T13:15:29.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.113+0000 7f5bd53f4740 1 -- start start 2024-03-30T13:15:29.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.113+0000 7f5bd53f4740 1 Processor -- start 2024-03-30T13:15:29.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.114+0000 7f5bd53f4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c7ba470 0x55f15c7e4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.114+0000 7f5bd53f4740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba850 0x55f15c80eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.114+0000 7f5bd53f4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c801c50 0x55f15c7e6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.114+0000 7f5bd53f4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f15c6c5620 con 0x55f15c801c50 2024-03-30T13:15:29.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.114+0000 7f5bd53f4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f15c6d89d0 con 0x55f15c7ba470 2024-03-30T13:15:29.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.114+0000 7f5bd53f4740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55f15c71d330 con 0x55f15c7ba850 2024-03-30T13:15:29.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.114+0000 7f5bd53f4740 10 client.0 _ll_register_callbacks cb 0x55f15c714fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.115+0000 7f5bcbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c801c50 0x55f15c7e6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.115+0000 7f5bcbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c801c50 0x55f15c7e6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54242/0 (socket says 172.21.15.44:54242) 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.115+0000 7f5bcbe00640 1 -- 172.21.15.44:0/2843834758 learned_addr learned my addr 172.21.15.44:0/2843834758 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.115+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba850 0x55f15c80eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.115+0000 7f5bcb400640 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c7ba470 0x55f15c7e4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.115+0000 7f5bcbe00640 1 -- 172.21.15.44:0/2843834758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba850 msgr2=0x55f15c80eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.115+0000 7f5bcbe00640 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba850 0x55f15c80eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.115+0000 7f5bcbe00640 1 -- 172.21.15.44:0/2843834758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c7ba470 msgr2=0x55f15c7e4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.115+0000 7f5bcbe00640 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c7ba470 0x55f15c7e4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.115+0000 7f5bcbe00640 1 -- 172.21.15.44:0/2843834758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f15c3f1210 con 0x55f15c801c50 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.115+0000 7f5bcbe00640 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c801c50 0x55f15c7e6b80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400c5a0 tx=0x7f5bc400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7e1ebdda328b0a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.115+0000 7f5bb4c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:29.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.116+0000 7f5bb4c00640 1 -- 172.21.15.44:0/2843834758 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4015070 con 0x55f15c801c50 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.116+0000 7f5bb4c00640 1 -- 172.21.15.44:0/2843834758 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f5bc4011800 con 0x55f15c801c50 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.116+0000 7f5bd53f4740 1 -- 172.21.15.44:0/2843834758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bb8037070 con 0x55f15c801c50 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.116+0000 7f5bb4c00640 1 -- 172.21.15.44:0/2843834758 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5bc4020050 con 0x55f15c801c50 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.116+0000 7f5bd53f4740 10 client.6336 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.116+0000 7f5bd53f4740 1 -- 172.21.15.44:0/2843834758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55f15c55e0b0 con 0x55f15c801c50 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.116+0000 7f5bb4c00640 1 -- 172.21.15.44:0/2843834758 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb8037070 con 0x55f15c801c50 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.116+0000 7f5bb4c00640 1 -- 172.21.15.44:0/2843834758 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f5bc4023020 con 0x55f15c801c50 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.117+0000 7f5bd53f4740 10 client.6336 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.117+0000 7f5bd53f4740 10 client.6336 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.117+0000 7f5bd53f4740 20 client.6336 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.117+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55f15c7d7c00 0x55f15c8002c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.117+0000 7f5bd53f4740 4 client.6336 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.117+0000 7f5bd53f4740 1 -- 172.21.15.44:0/2843834758 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f15c72a870 con 0x55f15c7d7c00 2024-03-30T13:15:29.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.117+0000 7f5bcb400640 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55f15c7d7c00 0x55f15c8002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.118+0000 7f5bcb400640 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55f15c7d7c00 0x55f15c8002c0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b1294cd55848953 server_cookie=171dfed588134394 in_seq=0 out_seq=0 2024-03-30T13:15:29.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.118+0000 7f5bb4c00640 10 client.6336 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.118+0000 7f5bb4c00640 1 -- 172.21.15.44:0/2843834758 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55f15c72a870 con 0x55f15c7d7c00 2024-03-30T13:15:29.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.118+0000 7f5bb4c00640 10 client.6336 handle_command_reply: tid=0 2024-03-30T13:15:29.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.118+0000 7f5bd53f4740 1 client.6336 shutdown 2024-03-30T13:15:29.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.119+0000 7f5bd53f4740 1 -- 172.21.15.44:0/2843834758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c801c50 msgr2=0x55f15c7e6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.119+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c801c50 0x55f15c7e6b80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400c5a0 tx=0x7f5bc400ca60 comp rx=0 tx=0).stop 2024-03-30T13:15:29.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.119+0000 7f5bd53f4740 1 -- 172.21.15.44:0/2843834758 shutdown_connections 2024-03-30T13:15:29.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.119+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55f15c7d7c00 0x55f15c8002c0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.119+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c801c50 0x55f15c7e6b80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.119+0000 7f5bb4c00640 0 client.6336 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.119+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba850 0x55f15c80eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.119+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/2843834758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c7ba470 0x55f15c7e4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.119+0000 7f5bd53f4740 1 -- 172.21.15.44:0/2843834758 >> 172.21.15.44:0/2843834758 conn(0x55f15c780be0 msgr2=0x55f15c7b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.119+0000 7f5bd53f4740 1 -- 172.21.15.44:0/2843834758 shutdown_connections 2024-03-30T13:15:29.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.119+0000 7f5bd53f4740 1 -- 172.21.15.44:0/2843834758 wait complete. 2024-03-30T13:15:29.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.119+0000 7f5bd53f4740 20 client.6336 trim_cache size 0 max 16384 2024-03-30T13:15:29.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.135+0000 7f5bd53f4740 1 Processor -- start 2024-03-30T13:15:29.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.135+0000 7f5bd53f4740 1 -- start start 2024-03-30T13:15:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.136+0000 7f5bd53f4740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba470 0x55f15c7e0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.136+0000 7f5bd53f4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 0x55f15c7e0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.136+0000 7f5bd53f4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c801c50 0x55f15c7b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.136+0000 7f5bd53f4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc201150 con 0x55f15c7ba850 2024-03-30T13:15:29.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.136+0000 7f5bd53f4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc2001d0 con 0x55f15c801c50 2024-03-30T13:15:29.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.136+0000 7f5bd53f4740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5bcc0b9b90 con 0x55f15c7ba470 2024-03-30T13:15:29.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.136+0000 7f5bcaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 0x55f15c7e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.136+0000 7f5bcaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 0x55f15c7e0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54244/0 (socket says 172.21.15.44:54244) 2024-03-30T13:15:29.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.136+0000 7f5bcaa00640 1 -- 172.21.15.44:0/68657472 learned_addr learned my addr 172.21.15.44:0/68657472 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.137+0000 7f5bcb400640 1 --2- 172.21.15.44:0/68657472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba470 0x55f15c7e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.137+0000 7f5bcaa00640 1 -- 172.21.15.44:0/68657472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba470 msgr2=0x55f15c7e0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.137+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/68657472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba470 0x55f15c7e0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.137+0000 7f5bcaa00640 1 -- 172.21.15.44:0/68657472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c801c50 msgr2=0x55f15c7b8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.137+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/68657472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c801c50 0x55f15c7b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.137+0000 7f5bcaa00640 1 -- 172.21.15.44:0/68657472 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f15c3ca2d0 con 0x55f15c7ba850 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.137+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/68657472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 0x55f15c7e0540 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80771a0 tx=0x7f5bb8090000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329c79b5b383c62d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.137+0000 7f5bb7400640 1 -- 172.21.15.44:0/68657472 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80a9070 con 0x55f15c7ba850 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.137+0000 7f5bb7400640 1 -- 172.21.15.44:0/68657472 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb80ab050 con 0x55f15c7ba850 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.137+0000 7f5bb7400640 1 -- 172.21.15.44:0/68657472 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8093040 con 0x55f15c7ba850 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.138+0000 7f5bd53f4740 1 -- 172.21.15.44:0/68657472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 msgr2=0x55f15c7e0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.138+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/68657472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 0x55f15c7e0540 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80771a0 tx=0x7f5bb8090000 comp rx=0 tx=0).stop 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.138+0000 7f5bd53f4740 1 -- 172.21.15.44:0/68657472 shutdown_connections 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.138+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/68657472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c801c50 0x55f15c7b8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.138+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/68657472 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 0x55f15c7e0540 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.138+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/68657472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba470 0x55f15c7e0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.138+0000 7f5bd53f4740 1 -- 172.21.15.44:0/68657472 >> 172.21.15.44:0/68657472 conn(0x55f15c780be0 msgr2=0x55f15c7afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.138+0000 7f5bd53f4740 1 -- 172.21.15.44:0/68657472 shutdown_connections 2024-03-30T13:15:29.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.138+0000 7f5bd53f4740 1 -- 172.21.15.44:0/68657472 wait complete. 2024-03-30T13:15:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.139+0000 7f5bd53f4740 1 -- start start 2024-03-30T13:15:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.139+0000 7f5bd53f4740 1 Processor -- start 2024-03-30T13:15:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.140+0000 7f5bd53f4740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba470 0x55f15c7f87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.140+0000 7f5bd53f4740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 0x55f15c821a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.140+0000 7f5bd53f4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c801c50 0x55f15c7d5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.140+0000 7f5bd53f4740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55f15c7b0320 con 0x55f15c7ba850 2024-03-30T13:15:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.140+0000 7f5bd53f4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1ffb80 con 0x55f15c801c50 2024-03-30T13:15:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.140+0000 7f5bd53f4740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55f15c7b4130 con 0x55f15c7ba470 2024-03-30T13:15:29.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.140+0000 7f5bd53f4740 10 client.0 _ll_register_callbacks cb 0x7f5bc4007510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.140+0000 7f5bcaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 0x55f15c821a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.140+0000 7f5bcaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 0x55f15c821a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54250/0 (socket says 172.21.15.44:54250) 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.140+0000 7f5bcaa00640 1 -- 172.21.15.44:0/1017112387 learned_addr learned my addr 172.21.15.44:0/1017112387 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.141+0000 7f5bcb400640 1 --2- 172.21.15.44:0/1017112387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba470 0x55f15c7f87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.141+0000 7f5bcaa00640 1 -- 172.21.15.44:0/1017112387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba470 msgr2=0x55f15c7f87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.141+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/1017112387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba470 0x55f15c7f87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.141+0000 7f5bcaa00640 1 -- 172.21.15.44:0/1017112387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c801c50 msgr2=0x55f15c7d5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.141+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/1017112387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c801c50 0x55f15c7d5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.141+0000 7f5bcaa00640 1 -- 172.21.15.44:0/1017112387 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f15c7e40f0 con 0x55f15c7ba850 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.141+0000 7f5bcaa00640 1 --2- 172.21.15.44:0/1017112387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 0x55f15c821a90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5bb802be90 tx=0x7f5bb803dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54070043df62a72 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.141+0000 7f5bb4c00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.141+0000 7f5bb4c00640 1 -- 172.21.15.44:0/1017112387 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80a9070 con 0x55f15c7ba850 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.141+0000 7f5bb4c00640 1 -- 172.21.15.44:0/1017112387 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f5bb8083490 con 0x55f15c7ba850 2024-03-30T13:15:29.148 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.141+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1017112387 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bb80ab050 con 0x55f15c7ba850 2024-03-30T13:15:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.142+0000 7f5bb4c00640 1 -- 172.21.15.44:0/1017112387 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f5bb8093040 con 0x55f15c7ba850 2024-03-30T13:15:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.142+0000 7f5bd53f4740 10 client.6342 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.142+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1017112387 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55f15c7fc420 con 0x55f15c7ba850 2024-03-30T13:15:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.142+0000 7f5bb4c00640 1 -- 172.21.15.44:0/1017112387 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb80ab050 con 0x55f15c7ba850 2024-03-30T13:15:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.142+0000 7f5bb4c00640 1 -- 172.21.15.44:0/1017112387 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f5bb8083b70 con 0x55f15c7ba850 2024-03-30T13:15:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.142+0000 7f5bd53f4740 10 client.6342 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.142+0000 7f5bd53f4740 10 client.6342 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.142+0000 7f5bd53f4740 20 client.6342 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.142+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/1017112387 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55f15c87ab50 0x55f15c7fb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.142+0000 7f5bd53f4740 4 client.6342 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628406}] 2024-03-30T13:15:29.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.142+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1017112387 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628406}) -- 0x55f15c724bc0 con 0x55f15c87ab50 2024-03-30T13:15:29.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.142+0000 7f5bcb400640 1 --2- 172.21.15.44:0/1017112387 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55f15c87ab50 0x55f15c7fb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.143+0000 7f5bcb400640 1 --2- 172.21.15.44:0/1017112387 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55f15c87ab50 0x55f15c7fb7d0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2383ddb8be94288f server_cookie=d9ad4ca69a550d0c in_seq=0 out_seq=0 2024-03-30T13:15:29.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.143+0000 7f5bb4c00640 10 client.6342 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.143+0000 7f5bb4c00640 1 -- 172.21.15.44:0/1017112387 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4756 (crc 0 0 0) 0x55f15c724bc0 con 0x55f15c87ab50 2024-03-30T13:15:29.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.143+0000 7f5bb4c00640 10 client.6342 handle_command_reply: tid=0 2024-03-30T13:15:29.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.143+0000 7f5bd53f4740 1 client.6342 shutdown 2024-03-30T13:15:29.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.144+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1017112387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 msgr2=0x55f15c821a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.144+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/1017112387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 0x55f15c821a90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5bb802be90 tx=0x7f5bb803dfd0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.144+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1017112387 shutdown_connections 2024-03-30T13:15:29.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.144+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/1017112387 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55f15c87ab50 0x55f15c7fb7d0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.144+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/1017112387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f15c801c50 0x55f15c7d5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.144+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/1017112387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55f15c7ba850 0x55f15c821a90 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.144+0000 7f5bd53f4740 1 --2- 172.21.15.44:0/1017112387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f15c7ba470 0x55f15c7f87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.144+0000 7f5bb4c00640 0 client.6342 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.144+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1017112387 >> 172.21.15.44:0/1017112387 conn(0x55f15c780be0 msgr2=0x55f15c7f4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.144+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1017112387 shutdown_connections 2024-03-30T13:15:29.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.144+0000 7f5bd53f4740 1 -- 172.21.15.44:0/1017112387 wait complete. 2024-03-30T13:15:29.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.144+0000 7f5bd53f4740 20 client.6342 trim_cache size 0 max 16384 2024-03-30T13:15:29.152 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:29.152 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/Kconfig", 2024-03-30T13:15:29.152 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628406, 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.597940+0000", 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.732530+0000", 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.153 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 228, 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:29.154 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.732530+0000", 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.155 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 228, 2024-03-30T13:15:29.156 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.597940+0000" 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 228, 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.597940+0000" 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 200, 2024-03-30T13:15:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 2, 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:29.158 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:29.159 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:29.160 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.161 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.162 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:29.163 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.164 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.165 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:29.166 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:29.167 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.167 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:29.167 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:29.167 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:29.167 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:29.167 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:29.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.145+0000 7f5bd1000640 1 -- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5bac06c530 msgr2=0x7f5bac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.145+0000 7f5bd1000640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5bac06c530 0x7f5bac06e9f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc006fd0 tx=0x7f5bbc008040 comp rx=0 tx=0).stop 2024-03-30T13:15:29.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.145+0000 7f5bd1000640 1 -- 172.21.15.44:0/2939676367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bcc0b4d00 msgr2=0x7f5bcc151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.145+0000 7f5bd1000640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bcc0b4d00 0x7f5bcc151260 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8000c00 tx=0x7f5bb80046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.145+0000 7f5bd1000640 1 -- 172.21.15.44:0/2939676367 shutdown_connections 2024-03-30T13:15:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.145+0000 7f5bd1000640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f5bac06c530 0x7f5bac06e9f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.145+0000 7f5bd1000640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bcc0d0b90 0x7f5bcc1f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.145+0000 7f5bd1000640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5bcc0b4d00 0x7f5bcc151260 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.145+0000 7f5bd1000640 1 --2- 172.21.15.44:0/2939676367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bcc0b4920 0x7f5bcc150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.145+0000 7f5bd1000640 1 -- 172.21.15.44:0/2939676367 >> 172.21.15.44:0/2939676367 conn(0x7f5bcc09d4e0 msgr2=0x7f5bcc0b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.145+0000 7f5bd1000640 1 -- 172.21.15.44:0/2939676367 shutdown_connections 2024-03-30T13:15:29.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.145+0000 7f5bd1000640 1 -- 172.21.15.44:0/2939676367 wait complete. 2024-03-30T13:15:29.169 DEBUG:tasks.cephfs.test_uninlining:getting inode info #15 of 23:1099511628419 2024-03-30T13:15:29.169 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628419 2024-03-30T13:15:29.170 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628419 2024-03-30T13:15:29.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.379+0000 7f32ab200640 1 Processor -- start 2024-03-30T13:15:29.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.379+0000 7f32ab200640 1 -- start start 2024-03-30T13:15:29.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.381+0000 7f32ab200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f32ac0d18f0 0x7f32ac0d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.381+0000 7f32ab200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f32ac0d46b0 0x7f32ac0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.381+0000 7f32ab200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ac0d32b0 con 0x7f32ac15c040 2024-03-30T13:15:29.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.381+0000 7f32ab200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f32ac0d4b20 con 0x7f32ac0d18f0 2024-03-30T13:15:29.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.381+0000 7f32ab200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f32ac15fa70 con 0x7f32ac0d46b0 2024-03-30T13:15:29.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.381+0000 7f32a9e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f32ac15c040 0x7f32ac15f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42990/0 (socket says 172.21.15.44:42990) 2024-03-30T13:15:29.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.381+0000 7f32a9e00640 1 -- 172.21.15.44:0/2560900213 learned_addr learned my addr 172.21.15.44:0/2560900213 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:29.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.381+0000 7f32a1400640 1 --2- 172.21.15.44:0/2560900213 >> v2:172.21.15.44:3300/0 conn(0x7f32ac0d18f0 0x7f32ac0d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.382+0000 7f32aa800640 1 --2- 172.21.15.44:0/2560900213 >> v2:172.21.15.151:3300/0 conn(0x7f32ac0d46b0 0x7f32ac0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.382+0000 7f32a9400640 1 -- 172.21.15.44:0/2560900213 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078506568 0 0) 0x7f32ac0d32b0 con 0x7f32ac15c040 2024-03-30T13:15:29.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.382+0000 7f32a9400640 1 -- 172.21.15.44:0/2560900213 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3290003520 con 0x7f32ac15c040 2024-03-30T13:15:29.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.382+0000 7f32a1400640 1 -- 172.21.15.44:0/2560900213 >> v2:172.21.15.151:3300/0 conn(0x7f32ac0d46b0 msgr2=0x7f32ac0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.382+0000 7f32a1400640 1 --2- 172.21.15.44:0/2560900213 >> v2:172.21.15.151:3300/0 conn(0x7f32ac0d46b0 0x7f32ac0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.382+0000 7f32a1400640 1 -- 172.21.15.44:0/2560900213 >> v1:172.21.15.44:6789/0 conn(0x7f32ac15c040 legacy=0x7f32ac15f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.382+0000 7f32a1400640 1 -- 172.21.15.44:0/2560900213 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac0d2210 con 0x7f32ac0d18f0 2024-03-30T13:15:29.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.383+0000 7f32a1400640 1 --2- 172.21.15.44:0/2560900213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ac0d18f0 0x7f32ac0d4170 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f32940097a0 tx=0x7f329402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbeb8f35dc8dea8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.384+0000 7f32a9400640 1 -- 172.21.15.44:0/2560900213 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32940315a0 con 0x7f32ac0d18f0 2024-03-30T13:15:29.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.384+0000 7f32a9400640 1 -- 172.21.15.44:0/2560900213 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3294037070 con 0x7f32ac0d18f0 2024-03-30T13:15:29.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.384+0000 7f32a9400640 1 -- 172.21.15.44:0/2560900213 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294031940 con 0x7f32ac0d18f0 2024-03-30T13:15:29.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.384+0000 7f32ab200640 1 -- 172.21.15.44:0/2560900213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ac0d18f0 msgr2=0x7f32ac0d4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.384+0000 7f32ab200640 1 --2- 172.21.15.44:0/2560900213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ac0d18f0 0x7f32ac0d4170 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f32940097a0 tx=0x7f329402b840 comp rx=0 tx=0).stop 2024-03-30T13:15:29.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.384+0000 7f32ab200640 1 -- 172.21.15.44:0/2560900213 shutdown_connections 2024-03-30T13:15:29.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.384+0000 7f32ab200640 1 --2- 172.21.15.44:0/2560900213 >> v2:172.21.15.151:3300/0 conn(0x7f32ac0d46b0 0x7f32ac0b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.384+0000 7f32ab200640 1 --2- 172.21.15.44:0/2560900213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ac0d18f0 0x7f32ac0d4170 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.384+0000 7f32ab200640 1 -- 172.21.15.44:0/2560900213 >> 172.21.15.44:0/2560900213 conn(0x7f32ac08dbf0 msgr2=0x7f32ac09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.384+0000 7f32ab200640 1 -- 172.21.15.44:0/2560900213 shutdown_connections 2024-03-30T13:15:29.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.384+0000 7f32ab200640 1 -- 172.21.15.44:0/2560900213 wait complete. 2024-03-30T13:15:29.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.386+0000 7f32ab200640 1 Processor -- start 2024-03-30T13:15:29.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.386+0000 7f32ab200640 1 -- start start 2024-03-30T13:15:29.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.387+0000 7f32ab200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ac0d18f0 0x7f32ac15b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.387+0000 7f32ab200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32ac0d46b0 0x7f32ac0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.387+0000 7f32ab200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15c040 0x7f32ac0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.387+0000 7f32ab200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac0d2ab0 con 0x7f32ac0d18f0 2024-03-30T13:15:29.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.387+0000 7f32ab200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac0d27d0 con 0x7f32ac0d46b0 2024-03-30T13:15:29.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.387+0000 7f32ab200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f32ac0d2d90 con 0x7f32ac15c040 2024-03-30T13:15:29.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.387+0000 7f32a9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ac0d18f0 0x7f32ac15b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.388+0000 7f32a9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ac0d18f0 0x7f32ac15b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54266/0 (socket says 172.21.15.44:54266) 2024-03-30T13:15:29.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.388+0000 7f32a9e00640 1 -- 172.21.15.44:0/2093194648 learned_addr learned my addr 172.21.15.44:0/2093194648 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.388+0000 7f32a9e00640 1 -- 172.21.15.44:0/2093194648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15c040 msgr2=0x7f32ac0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.388+0000 7f32a9e00640 1 --2- 172.21.15.44:0/2093194648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15c040 0x7f32ac0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.388+0000 7f32a9e00640 1 -- 172.21.15.44:0/2093194648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32ac0d46b0 msgr2=0x7f32ac0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.388+0000 7f32a9e00640 1 --2- 172.21.15.44:0/2093194648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32ac0d46b0 0x7f32ac0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.388+0000 7f32a9e00640 1 -- 172.21.15.44:0/2093194648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac0b4ed0 con 0x7f32ac0d18f0 2024-03-30T13:15:29.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.388+0000 7f32a9e00640 1 --2- 172.21.15.44:0/2093194648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ac0d18f0 0x7f32ac15b3a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f329c00cb40 tx=0x7f329c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.388+0000 7f32a2a00640 1 -- 172.21.15.44:0/2093194648 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c017070 con 0x7f32ac0d18f0 2024-03-30T13:15:29.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.389+0000 7f32a2a00640 1 -- 172.21.15.44:0/2093194648 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c00aca0 con 0x7f32ac0d18f0 2024-03-30T13:15:29.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.389+0000 7f32a2a00640 1 -- 172.21.15.44:0/2093194648 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c012620 con 0x7f32ac0d18f0 2024-03-30T13:15:29.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.389+0000 7f32ab200640 1 -- 172.21.15.44:0/2093194648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ac0b51b0 con 0x7f32ac0d18f0 2024-03-30T13:15:29.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.389+0000 7f32ab200640 1 -- 172.21.15.44:0/2093194648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ac0b5770 con 0x7f32ac0d18f0 2024-03-30T13:15:29.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.392+0000 7f32a2a00640 1 -- 172.21.15.44:0/2093194648 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f329c01a070 con 0x7f32ac0d18f0 2024-03-30T13:15:29.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.393+0000 7f32a2a00640 1 --2- 172.21.15.44:0/2093194648 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f328806c530 0x7f328806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.393+0000 7f32a2a00640 1 -- 172.21.15.44:0/2093194648 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f329c08b7f0 con 0x7f32ac0d18f0 2024-03-30T13:15:29.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.393+0000 7f32b3a2d740 1 Processor -- start 2024-03-30T13:15:29.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.393+0000 7f32a1400640 1 --2- 172.21.15.44:0/2093194648 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f328806c530 0x7f328806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.393+0000 7f32b3a2d740 1 -- start start 2024-03-30T13:15:29.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.394+0000 7f32b3a2d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7470 0x55b63baedfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.394+0000 7f32b3a2d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63baee4e0 0x55b63bac64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.394+0000 7f32b3a2d740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7850 0x55b63bac69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.394+0000 7f32b3a2d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b63ba2a330 con 0x55b63baee4e0 2024-03-30T13:15:29.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.394+0000 7f32b3a2d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b63b9d2620 con 0x55b63bac7470 2024-03-30T13:15:29.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.394+0000 7f32b3a2d740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55b63ba26440 con 0x55b63bac7850 2024-03-30T13:15:29.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.395+0000 7f32a1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63baee4e0 0x55b63bac64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.395+0000 7f32a1400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63baee4e0 0x55b63bac64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54268/0 (socket says 172.21.15.44:54268) 2024-03-30T13:15:29.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.395+0000 7f32a1400640 1 -- 172.21.15.44:0/44132625 learned_addr learned my addr 172.21.15.44:0/44132625 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.395+0000 7f32a1400640 1 --2- 172.21.15.44:0/2093194648 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f328806c530 0x7f328806e9f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3294036000 tx=0x7f3294030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.395+0000 7f32aa800640 1 --2- 172.21.15.44:0/44132625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7850 0x55b63bac69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.400 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.395+0000 7f32a9e00640 1 --2- 172.21.15.44:0/44132625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7470 0x55b63baedfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.395+0000 7f32a1400640 1 -- 172.21.15.44:0/44132625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7850 msgr2=0x55b63bac69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.395+0000 7f32a1400640 1 --2- 172.21.15.44:0/44132625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7850 0x55b63bac69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.395+0000 7f32a1400640 1 -- 172.21.15.44:0/44132625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7470 msgr2=0x55b63baedfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.395+0000 7f32a1400640 1 --2- 172.21.15.44:0/44132625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7470 0x55b63baedfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.395+0000 7f32a1400640 1 -- 172.21.15.44:0/44132625 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b63b80a920 con 0x55b63baee4e0 2024-03-30T13:15:29.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.395+0000 7f32a9e00640 1 --2- 172.21.15.44:0/44132625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7470 0x55b63baedfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:29.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.396+0000 7f32a1400640 1 --2- 172.21.15.44:0/44132625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63baee4e0 0x55b63bac64b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f329402be50 tx=0x7f3294008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9595cf3266572114 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.396+0000 7f329aa00640 1 -- 172.21.15.44:0/44132625 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294041070 con 0x55b63baee4e0 2024-03-30T13:15:29.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.396+0000 7f329aa00640 1 -- 172.21.15.44:0/44132625 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3294037040 con 0x55b63baee4e0 2024-03-30T13:15:29.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.396+0000 7f329aa00640 1 -- 172.21.15.44:0/44132625 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294032bc0 con 0x55b63baee4e0 2024-03-30T13:15:29.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.396+0000 7f32b3a2d740 1 -- 172.21.15.44:0/44132625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63baee4e0 msgr2=0x55b63bac64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.396+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/44132625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63baee4e0 0x55b63bac64b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f329402be50 tx=0x7f3294008030 comp rx=0 tx=0).stop 2024-03-30T13:15:29.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.397+0000 7f32b3a2d740 1 -- 172.21.15.44:0/44132625 shutdown_connections 2024-03-30T13:15:29.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.397+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/44132625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7850 0x55b63bac69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.397+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/44132625 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63baee4e0 0x55b63bac64b0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.397+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/44132625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7470 0x55b63baedfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.397+0000 7f32b3a2d740 1 -- 172.21.15.44:0/44132625 >> 172.21.15.44:0/44132625 conn(0x55b63ba8dbe0 msgr2=0x55b63bb0c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.397+0000 7f32b3a2d740 1 -- 172.21.15.44:0/44132625 shutdown_connections 2024-03-30T13:15:29.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.397+0000 7f32b3a2d740 1 -- 172.21.15.44:0/44132625 wait complete. 2024-03-30T13:15:29.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.397+0000 7f32b3a2d740 1 -- start start 2024-03-30T13:15:29.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.398+0000 7f32b3a2d740 1 Processor -- start 2024-03-30T13:15:29.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32b3a2d740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7470 0x55b63bb1be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32b3a2d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7850 0x55b63baecd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32b3a2d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 0x55b63bb08aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32b3a2d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b63baedb10 con 0x55b63bae5a20 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32b3a2d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b63b9e59d0 con 0x55b63bac7850 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32b3a2d740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55b63bae6890 con 0x55b63bac7470 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32b3a2d740 10 client.0 _ll_register_callbacks cb 0x55b63ba21fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32aa800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 0x55b63bb08aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32aa800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 0x55b63bb08aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54278/0 (socket says 172.21.15.44:54278) 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32aa800640 1 -- 172.21.15.44:0/3911055062 learned_addr learned my addr 172.21.15.44:0/3911055062 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32a9e00640 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7470 0x55b63bb1be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32a1400640 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7850 0x55b63baecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32aa800640 1 -- 172.21.15.44:0/3911055062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7470 msgr2=0x55b63bb1be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32aa800640 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7470 0x55b63bb1be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32aa800640 1 -- 172.21.15.44:0/3911055062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7850 msgr2=0x55b63baecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32aa800640 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7850 0x55b63baecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.399+0000 7f32aa800640 1 -- 172.21.15.44:0/3911055062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b63b6fe210 con 0x55b63bae5a20 2024-03-30T13:15:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.400+0000 7f32aa800640 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 0x55b63bb08aa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f32a400bf20 tx=0x7f32a400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a0f0c6ddbee77a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.400+0000 7f328f400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.400+0000 7f328f400640 1 -- 172.21.15.44:0/3911055062 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4018030 con 0x55b63bae5a20 2024-03-30T13:15:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.400+0000 7f32b3a2d740 1 -- 172.21.15.44:0/3911055062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3294037040 con 0x55b63bae5a20 2024-03-30T13:15:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.400+0000 7f328f400640 1 -- 172.21.15.44:0/3911055062 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f32a4004020 con 0x55b63bae5a20 2024-03-30T13:15:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.400+0000 7f328f400640 1 -- 172.21.15.44:0/3911055062 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f32a4021050 con 0x55b63bae5a20 2024-03-30T13:15:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.400+0000 7f32b3a2d740 10 client.6357 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.401+0000 7f32b3a2d740 1 -- 172.21.15.44:0/3911055062 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55b63b86b0b0 con 0x55b63bae5a20 2024-03-30T13:15:29.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.401+0000 7f328f400640 1 -- 172.21.15.44:0/3911055062 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3294037040 con 0x55b63bae5a20 2024-03-30T13:15:29.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.401+0000 7f328f400640 1 -- 172.21.15.44:0/3911055062 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f32a4024020 con 0x55b63bae5a20 2024-03-30T13:15:29.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.401+0000 7f32b3a2d740 10 client.6357 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:29.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.401+0000 7f32b3a2d740 10 client.6357 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:29.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.401+0000 7f32b3a2d740 20 client.6357 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.401+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b63bb03c80 0x55b63bb04060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.401+0000 7f32b3a2d740 4 client.6357 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.401+0000 7f32b3a2d740 1 -- 172.21.15.44:0/3911055062 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b63ba37870 con 0x55b63bb03c80 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.401+0000 7f32a9e00640 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b63bb03c80 0x55b63bb04060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.402+0000 7f32a9e00640 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b63bb03c80 0x55b63bb04060 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42bc104f86b6b088 server_cookie=a6d7e2feb3929165 in_seq=0 out_seq=0 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.402+0000 7f328f400640 10 client.6357 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f328f400640 1 -- 172.21.15.44:0/3911055062 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55b63ba37870 con 0x55b63bb03c80 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f328f400640 10 client.6357 handle_command_reply: tid=0 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f32b3a2d740 1 client.6357 shutdown 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f32b3a2d740 1 -- 172.21.15.44:0/3911055062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 msgr2=0x55b63bb08aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 0x55b63bb08aa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f32a400bf20 tx=0x7f32a400f670 comp rx=0 tx=0).stop 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f32b3a2d740 1 -- 172.21.15.44:0/3911055062 shutdown_connections 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b63bb03c80 0x55b63bb04060 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 0x55b63bb08aa0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7850 0x55b63baecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/3911055062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7470 0x55b63bb1be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f32b3a2d740 1 -- 172.21.15.44:0/3911055062 >> 172.21.15.44:0/3911055062 conn(0x55b63ba8dbe0 msgr2=0x55b63bac0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f328f400640 0 client.6357 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f32b3a2d740 1 -- 172.21.15.44:0/3911055062 shutdown_connections 2024-03-30T13:15:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f32b3a2d740 1 -- 172.21.15.44:0/3911055062 wait complete. 2024-03-30T13:15:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.403+0000 7f32b3a2d740 20 client.6357 trim_cache size 0 max 16384 2024-03-30T13:15:29.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.420+0000 7f32b3a2d740 1 Processor -- start 2024-03-30T13:15:29.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.420+0000 7f32b3a2d740 1 -- start start 2024-03-30T13:15:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.420+0000 7f32b3a2d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bac7470 0x55b63bb0fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.420+0000 7f32b3a2d740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7850 0x55b63bac5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32b3a2d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bae5a20 0x55b63bac5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32b3a2d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac200e90 con 0x55b63bac7470 2024-03-30T13:15:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32b3a2d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac1ffee0 con 0x55b63bae5a20 2024-03-30T13:15:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32b3a2d740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f32ac0ccf20 con 0x55b63bac7850 2024-03-30T13:15:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32a9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bac7470 0x55b63bb0fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32a9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bac7470 0x55b63bb0fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54286/0 (socket says 172.21.15.44:54286) 2024-03-30T13:15:29.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32a9e00640 1 -- 172.21.15.44:0/478039249 learned_addr learned my addr 172.21.15.44:0/478039249 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32aa800640 1 --2- 172.21.15.44:0/478039249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bae5a20 0x55b63bac5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32a9e00640 1 -- 172.21.15.44:0/478039249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7850 msgr2=0x55b63bac5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32a1400640 1 --2- 172.21.15.44:0/478039249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7850 0x55b63bac5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32a9e00640 1 --2- 172.21.15.44:0/478039249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7850 0x55b63bac5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32a9e00640 1 -- 172.21.15.44:0/478039249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bae5a20 msgr2=0x55b63bac5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32a9e00640 1 --2- 172.21.15.44:0/478039249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bae5a20 0x55b63bac5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32a9e00640 1 -- 172.21.15.44:0/478039249 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b63bb105f0 con 0x55b63bac7470 2024-03-30T13:15:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.421+0000 7f32aa800640 1 --2- 172.21.15.44:0/478039249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bae5a20 0x55b63bac5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.422+0000 7f32a9e00640 1 --2- 172.21.15.44:0/478039249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bac7470 0x55b63bb0fb60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f329c059410 tx=0x7f329c089960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6052f92a5074fd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.428 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.422+0000 7f329a000640 1 -- 172.21.15.44:0/478039249 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c057780 con 0x55b63bac7470 2024-03-30T13:15:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.422+0000 7f329a000640 1 -- 172.21.15.44:0/478039249 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c088070 con 0x55b63bac7470 2024-03-30T13:15:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.422+0000 7f329a000640 1 -- 172.21.15.44:0/478039249 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c061bd0 con 0x55b63bac7470 2024-03-30T13:15:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.423+0000 7f32b3a2d740 1 -- 172.21.15.44:0/478039249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bac7470 msgr2=0x55b63bb0fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.423+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/478039249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bac7470 0x55b63bb0fb60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f329c059410 tx=0x7f329c089960 comp rx=0 tx=0).stop 2024-03-30T13:15:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.423+0000 7f32b3a2d740 1 -- 172.21.15.44:0/478039249 shutdown_connections 2024-03-30T13:15:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.423+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/478039249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bae5a20 0x55b63bac5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.423+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/478039249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7850 0x55b63bac5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.423+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/478039249 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bac7470 0x55b63bb0fb60 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.423+0000 7f32b3a2d740 1 -- 172.21.15.44:0/478039249 >> 172.21.15.44:0/478039249 conn(0x55b63ba8dbe0 msgr2=0x55b63bae4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.423+0000 7f32b3a2d740 1 -- 172.21.15.44:0/478039249 shutdown_connections 2024-03-30T13:15:29.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.423+0000 7f32b3a2d740 1 -- 172.21.15.44:0/478039249 wait complete. 2024-03-30T13:15:29.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.423+0000 7f32b3a2d740 1 -- start start 2024-03-30T13:15:29.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.424+0000 7f32b3a2d740 1 Processor -- start 2024-03-30T13:15:29.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.425+0000 7f32b3a2d740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7470 0x55b63bb1af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.425+0000 7f32b3a2d740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7850 0x55b63bb1b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.425+0000 7f32b3a2d740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 0x55b63bb04950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.425+0000 7f32b3a2d740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55b63bb1bbe0 con 0x55b63bae5a20 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.425+0000 7f32b3a2d740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f32ac1ff890 con 0x55b63bac7850 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.425+0000 7f32b3a2d740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55b63bb0cb30 con 0x55b63bac7470 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.425+0000 7f32b3a2d740 10 client.0 _ll_register_callbacks cb 0x7f32a400b300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f32aa800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 0x55b63bb04950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f32aa800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 0x55b63bb04950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54288/0 (socket says 172.21.15.44:54288) 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f32aa800640 1 -- 172.21.15.44:0/2542711276 learned_addr learned my addr 172.21.15.44:0/2542711276 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f32a1400640 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7850 0x55b63bb1b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f32a9e00640 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7470 0x55b63bb1af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f32aa800640 1 -- 172.21.15.44:0/2542711276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7470 msgr2=0x55b63bb1af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f32aa800640 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7470 0x55b63bb1af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f32aa800640 1 -- 172.21.15.44:0/2542711276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7850 msgr2=0x55b63bb1b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f32aa800640 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7850 0x55b63bb1b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f32aa800640 1 -- 172.21.15.44:0/2542711276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b63b6d72d0 con 0x55b63bae5a20 2024-03-30T13:15:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f32a9e00640 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7470 0x55b63bb1af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f32aa800640 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 0x55b63bb04950 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f32a401f040 tx=0x7f32a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bbdd16de76184 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.426+0000 7f328f400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f328f400640 1 -- 172.21.15.44:0/2542711276 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4018040 con 0x55b63bae5a20 2024-03-30T13:15:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f328f400640 1 -- 172.21.15.44:0/2542711276 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f32a401c5f0 con 0x55b63bae5a20 2024-03-30T13:15:29.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f32b3a2d740 1 -- 172.21.15.44:0/2542711276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f329c088070 con 0x55b63bae5a20 2024-03-30T13:15:29.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f328f400640 1 -- 172.21.15.44:0/2542711276 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f32a4035050 con 0x55b63bae5a20 2024-03-30T13:15:29.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f32b3a2d740 10 client.6363 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:29.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f32b3a2d740 1 -- 172.21.15.44:0/2542711276 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55b63bb0c870 con 0x55b63bae5a20 2024-03-30T13:15:29.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f328f400640 1 -- 172.21.15.44:0/2542711276 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c088070 con 0x55b63bae5a20 2024-03-30T13:15:29.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f328f400640 1 -- 172.21.15.44:0/2542711276 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f32a4038020 con 0x55b63bae5a20 2024-03-30T13:15:29.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f32b3a2d740 10 client.6363 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f32b3a2d740 10 client.6363 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f32b3a2d740 20 client.6363 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b63bac87b0 0x55b63bb04e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.427+0000 7f32b3a2d740 4 client.6363 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628419}] 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.428+0000 7f32b3a2d740 1 -- 172.21.15.44:0/2542711276 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628419}) -- 0x55b63ba31bc0 con 0x55b63bac87b0 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.428+0000 7f32a9e00640 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b63bac87b0 0x55b63bb04e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.428+0000 7f32a9e00640 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b63bac87b0 0x55b63bb04e90 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6372da8185051c30 server_cookie=83460f31cc090b01 in_seq=0 out_seq=0 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.428+0000 7f328f400640 10 client.6363 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f328f400640 1 -- 172.21.15.44:0/2542711276 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4769 (crc 0 0 0) 0x55b63ba31bc0 con 0x55b63bac87b0 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f328f400640 10 client.6363 handle_command_reply: tid=0 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f32b3a2d740 1 client.6363 shutdown 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f32b3a2d740 1 -- 172.21.15.44:0/2542711276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 msgr2=0x55b63bb04950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 0x55b63bb04950 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f32a401f040 tx=0x7f32a40046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f32b3a2d740 1 -- 172.21.15.44:0/2542711276 shutdown_connections 2024-03-30T13:15:29.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55b63bac87b0 0x55b63bb04e90 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55b63bae5a20 0x55b63bb04950 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b63bac7850 0x55b63bb1b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f32b3a2d740 1 --2- 172.21.15.44:0/2542711276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b63bac7470 0x55b63bb1af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f328f400640 0 client.6363 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f32b3a2d740 1 -- 172.21.15.44:0/2542711276 >> 172.21.15.44:0/2542711276 conn(0x55b63ba8dbe0 msgr2=0x55b63bb087d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f32b3a2d740 1 -- 172.21.15.44:0/2542711276 shutdown_connections 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f32b3a2d740 1 -- 172.21.15.44:0/2542711276 wait complete. 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.429+0000 7f32b3a2d740 20 client.6363 trim_cache size 0 max 16384 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-debug.h", 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628419, 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:29.437 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.602906+0000", 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.764530+0000", 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:29.438 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2579, 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.764530+0000", 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 4, 2024-03-30T13:15:29.439 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.440 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 2579, 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.602906+0000" 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.441 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 2579, 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.602906+0000" 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 202, 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 28, 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:29.442 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:29.443 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:29.444 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:29.445 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.446 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:29.447 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.448 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.449 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:29.450 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:29.451 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:29.451 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:29.451 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:29.451 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:29.451 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:29.451 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:29.451 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.451 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:29.451 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:29.451 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:29.451 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:29.451 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.430+0000 7f32ab200640 1 -- 172.21.15.44:0/2093194648 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f328806c530 msgr2=0x7f328806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.430+0000 7f32ab200640 1 --2- 172.21.15.44:0/2093194648 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f328806c530 0x7f328806e9f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3294036000 tx=0x7f3294030000 comp rx=0 tx=0).stop 2024-03-30T13:15:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.430+0000 7f32ab200640 1 -- 172.21.15.44:0/2093194648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ac0d18f0 msgr2=0x7f32ac15b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.430+0000 7f32ab200640 1 --2- 172.21.15.44:0/2093194648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ac0d18f0 0x7f32ac15b3a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f329c00cb40 tx=0x7f329c00a060 comp rx=0 tx=0).stop 2024-03-30T13:15:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.430+0000 7f32ab200640 1 -- 172.21.15.44:0/2093194648 shutdown_connections 2024-03-30T13:15:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.430+0000 7f32ab200640 1 --2- 172.21.15.44:0/2093194648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32ac15c040 0x7f32ac0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.430+0000 7f32ab200640 1 --2- 172.21.15.44:0/2093194648 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f328806c530 0x7f328806e9f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.430+0000 7f32ab200640 1 --2- 172.21.15.44:0/2093194648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32ac0d46b0 0x7f32ac0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.430+0000 7f32ab200640 1 --2- 172.21.15.44:0/2093194648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f32ac0d18f0 0x7f32ac15b3a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.430+0000 7f32ab200640 1 -- 172.21.15.44:0/2093194648 >> 172.21.15.44:0/2093194648 conn(0x7f32ac08dbf0 msgr2=0x7f32ac15e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.430+0000 7f32ab200640 1 -- 172.21.15.44:0/2093194648 shutdown_connections 2024-03-30T13:15:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.430+0000 7f32ab200640 1 -- 172.21.15.44:0/2093194648 wait complete. 2024-03-30T13:15:29.454 DEBUG:tasks.cephfs.test_uninlining:getting inode info #16 of 23:1099511628426 2024-03-30T13:15:29.454 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628426 2024-03-30T13:15:29.454 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628426 2024-03-30T13:15:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.660+0000 7f0b39000640 1 Processor -- start 2024-03-30T13:15:29.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.660+0000 7f0b39000640 1 -- start start 2024-03-30T13:15:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.662+0000 7f0b39000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0b3415e570 0x7f0b340b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.662+0000 7f0b39000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0b340ba0b0 0x7f0b340cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.662+0000 7f0b39000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b340cfad0 con 0x7f0b340cf620 2024-03-30T13:15:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.662+0000 7f0b39000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0b340b94a0 con 0x7f0b3415e570 2024-03-30T13:15:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.662+0000 7f0b39000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f0b3415e950 con 0x7f0b340ba0b0 2024-03-30T13:15:29.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.662+0000 7f0b31e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0b3415e570 0x7f0b340b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.662+0000 7f0b31e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0b3415e570 0x7f0b340b7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54292/0 (socket says 172.21.15.44:54292) 2024-03-30T13:15:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.662+0000 7f0b31e00640 1 -- 172.21.15.44:0/3952534156 learned_addr learned my addr 172.21.15.44:0/3952534156 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.662+0000 7f0b29400640 1 --2- 172.21.15.44:0/3952534156 >> v2:172.21.15.151:3300/0 conn(0x7f0b340ba0b0 0x7f0b340cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.662+0000 7f0b31e00640 1 -- 172.21.15.44:0/3952534156 >> v2:172.21.15.151:3300/0 conn(0x7f0b340ba0b0 msgr2=0x7f0b340cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.663+0000 7f0b31e00640 1 --2- 172.21.15.44:0/3952534156 >> v2:172.21.15.151:3300/0 conn(0x7f0b340ba0b0 0x7f0b340cf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.663+0000 7f0b31e00640 1 -- 172.21.15.44:0/3952534156 >> v1:172.21.15.44:6789/0 conn(0x7f0b340cf620 legacy=0x7f0b340b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.663+0000 7f0b31e00640 1 -- 172.21.15.44:0/3952534156 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b340b8890 con 0x7f0b3415e570 2024-03-30T13:15:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.663+0000 7f0b29400640 1 --2- 172.21.15.44:0/3952534156 >> v2:172.21.15.151:3300/0 conn(0x7f0b340ba0b0 0x7f0b340cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.664+0000 7f0b31e00640 1 --2- 172.21.15.44:0/3952534156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b3415e570 0x7f0b340b7f90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009e50 tx=0x7f0b2402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8019f3f84f95762 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.664+0000 7f0b31400640 1 -- 172.21.15.44:0/3952534156 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2402cb00 con 0x7f0b3415e570 2024-03-30T13:15:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.664+0000 7f0b31400640 1 -- 172.21.15.44:0/3952534156 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b2402cca0 con 0x7f0b3415e570 2024-03-30T13:15:29.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.664+0000 7f0b31400640 1 -- 172.21.15.44:0/3952534156 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24034610 con 0x7f0b3415e570 2024-03-30T13:15:29.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.665+0000 7f0b39000640 1 -- 172.21.15.44:0/3952534156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b3415e570 msgr2=0x7f0b340b7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.665+0000 7f0b39000640 1 --2- 172.21.15.44:0/3952534156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b3415e570 0x7f0b340b7f90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009e50 tx=0x7f0b2402bf60 comp rx=0 tx=0).stop 2024-03-30T13:15:29.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.665+0000 7f0b39000640 1 -- 172.21.15.44:0/3952534156 shutdown_connections 2024-03-30T13:15:29.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.665+0000 7f0b39000640 1 --2- 172.21.15.44:0/3952534156 >> v2:172.21.15.151:3300/0 conn(0x7f0b340ba0b0 0x7f0b340cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.665+0000 7f0b39000640 1 --2- 172.21.15.44:0/3952534156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b3415e570 0x7f0b340b7f90 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.665+0000 7f0b39000640 1 -- 172.21.15.44:0/3952534156 >> 172.21.15.44:0/3952534156 conn(0x7f0b340676e0 msgr2=0x7f0b34067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.666+0000 7f0b39000640 1 -- 172.21.15.44:0/3952534156 shutdown_connections 2024-03-30T13:15:29.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.666+0000 7f0b39000640 1 -- 172.21.15.44:0/3952534156 wait complete. 2024-03-30T13:15:29.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.667+0000 7f0b39000640 1 Processor -- start 2024-03-30T13:15:29.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.667+0000 7f0b39000640 1 -- start start 2024-03-30T13:15:29.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.668+0000 7f0b39000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b340ba0b0 0x7f0b34148410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.668+0000 7f0b39000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b340cf620 0x7f0b340c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.668+0000 7f0b39000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b3415e570 0x7f0b34157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.668+0000 7f0b39000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0b340b9130 con 0x7f0b340ba0b0 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b39000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0b340b8e50 con 0x7f0b3415e570 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b39000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0b340b84d0 con 0x7f0b340cf620 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b31e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b340ba0b0 0x7f0b34148410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b31e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b340ba0b0 0x7f0b34148410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54306/0 (socket says 172.21.15.44:54306) 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b31e00640 1 -- 172.21.15.44:0/2356162995 learned_addr learned my addr 172.21.15.44:0/2356162995 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b29400640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b340cf620 0x7f0b340c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b32800640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b3415e570 0x7f0b34157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b31e00640 1 -- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b340cf620 msgr2=0x7f0b340c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b31e00640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b340cf620 0x7f0b340c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b31e00640 1 -- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b3415e570 msgr2=0x7f0b34157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b31e00640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b3415e570 0x7f0b34157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b31e00640 1 -- 172.21.15.44:0/2356162995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b340cce70 con 0x7f0b340ba0b0 2024-03-30T13:15:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.669+0000 7f0b29400640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b340cf620 0x7f0b340c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.670+0000 7f0b31e00640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b340ba0b0 0x7f0b34148410 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009f70 tx=0x7f0b24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.670+0000 7f0b2aa00640 1 -- 172.21.15.44:0/2356162995 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24043020 con 0x7f0b340ba0b0 2024-03-30T13:15:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.670+0000 7f0b2aa00640 1 -- 172.21.15.44:0/2356162995 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b2402ce50 con 0x7f0b340ba0b0 2024-03-30T13:15:29.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.670+0000 7f0b39000640 1 -- 172.21.15.44:0/2356162995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b34145980 con 0x7f0b340ba0b0 2024-03-30T13:15:29.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.670+0000 7f0b2aa00640 1 -- 172.21.15.44:0/2356162995 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24009510 con 0x7f0b340ba0b0 2024-03-30T13:15:29.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.670+0000 7f0b39000640 1 -- 172.21.15.44:0/2356162995 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b34145f40 con 0x7f0b340ba0b0 2024-03-30T13:15:29.678 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.673+0000 7f0b2aa00640 1 -- 172.21.15.44:0/2356162995 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0b24046020 con 0x7f0b340ba0b0 2024-03-30T13:15:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.674+0000 7f0b2aa00640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0b1006c530 0x7f0b1006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.675+0000 7f0b3bdfc740 1 Processor -- start 2024-03-30T13:15:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.675+0000 7f0b2aa00640 1 -- 172.21.15.44:0/2356162995 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f0b240ae020 con 0x7f0b340ba0b0 2024-03-30T13:15:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.675+0000 7f0b3bdfc740 1 -- start start 2024-03-30T13:15:29.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.675+0000 7f0b29400640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0b1006c530 0x7f0b1006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.676+0000 7f0b3bdfc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc3b290 0x555c6fc61dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.676+0000 7f0b3bdfc740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc62300 0x555c6fc3a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.676+0000 7f0b3bdfc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc3a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.676+0000 7f0b3bdfc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555c6fb9e330 con 0x555c6fc3b670 2024-03-30T13:15:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.676+0000 7f0b3bdfc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555c6fb46620 con 0x555c6fc3b290 2024-03-30T13:15:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.676+0000 7f0b3bdfc740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x555c6fb9a440 con 0x555c6fc62300 2024-03-30T13:15:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.676+0000 7f0b32800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc3a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.676+0000 7f0b32800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc3a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54322/0 (socket says 172.21.15.44:54322) 2024-03-30T13:15:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.676+0000 7f0b32800640 1 -- 172.21.15.44:0/3895739063 learned_addr learned my addr 172.21.15.44:0/3895739063 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.676+0000 7f0b29400640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0b1006c530 0x7f0b1006e9f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0b340caf40 tx=0x7f0b1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.676+0000 7f0b31e00640 1 --2- 172.21.15.44:0/3895739063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc3b290 0x555c6fc61dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.676+0000 7f0b29400640 1 --2- 172.21.15.44:0/3895739063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc62300 0x555c6fc3a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.677+0000 7f0b32800640 1 -- 172.21.15.44:0/3895739063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc62300 msgr2=0x555c6fc3a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.677+0000 7f0b32800640 1 --2- 172.21.15.44:0/3895739063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc62300 0x555c6fc3a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.677+0000 7f0b32800640 1 -- 172.21.15.44:0/3895739063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc3b290 msgr2=0x555c6fc61dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.677+0000 7f0b32800640 1 --2- 172.21.15.44:0/3895739063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc3b290 0x555c6fc61dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.677+0000 7f0b32800640 1 -- 172.21.15.44:0/3895739063 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c6f97e920 con 0x555c6fc3b670 2024-03-30T13:15:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.677+0000 7f0b29400640 1 --2- 172.21.15.44:0/3895739063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc62300 0x555c6fc3a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:29.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.677+0000 7f0b32800640 1 --2- 172.21.15.44:0/3895739063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc3a810 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c001670 tx=0x7f0b2c001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5091b13157cae60d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.677+0000 7f0b22a00640 1 -- 172.21.15.44:0/3895739063 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0052d0 con 0x555c6fc3b670 2024-03-30T13:15:29.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.677+0000 7f0b22a00640 1 -- 172.21.15.44:0/3895739063 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b2c005470 con 0x555c6fc3b670 2024-03-30T13:15:29.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.677+0000 7f0b22a00640 1 -- 172.21.15.44:0/3895739063 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c00db20 con 0x555c6fc3b670 2024-03-30T13:15:29.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.678+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3895739063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 msgr2=0x555c6fc3a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.678+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3895739063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc3a810 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c001670 tx=0x7f0b2c001b30 comp rx=0 tx=0).stop 2024-03-30T13:15:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.678+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3895739063 shutdown_connections 2024-03-30T13:15:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.678+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3895739063 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc3a810 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.678+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3895739063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc62300 0x555c6fc3a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.678+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3895739063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc3b290 0x555c6fc61dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.678+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3895739063 >> 172.21.15.44:0/3895739063 conn(0x555c6fc01be0 msgr2=0x555c6fc7ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.678+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3895739063 shutdown_connections 2024-03-30T13:15:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.678+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3895739063 wait complete. 2024-03-30T13:15:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.679+0000 7f0b3bdfc740 1 -- start start 2024-03-30T13:15:29.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.679+0000 7f0b3bdfc740 1 Processor -- start 2024-03-30T13:15:29.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.680+0000 7f0b3bdfc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc3b290 0x555c6fc5ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.680+0000 7f0b3bdfc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc5f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.680+0000 7f0b3bdfc740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc5f920 0x555c6fc5e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.680+0000 7f0b3bdfc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555c6fc61930 con 0x555c6fc3b670 2024-03-30T13:15:29.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.680+0000 7f0b3bdfc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555c6fb599d0 con 0x555c6fc3b290 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.680+0000 7f0b3bdfc740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x555c6fc5a6b0 con 0x555c6fc5f920 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.680+0000 7f0b3bdfc740 10 client.0 _ll_register_callbacks cb 0x555c6fb95fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.680+0000 7f0b29400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc5f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.680+0000 7f0b29400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc5f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54330/0 (socket says 172.21.15.44:54330) 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.680+0000 7f0b29400640 1 -- 172.21.15.44:0/3953623213 learned_addr learned my addr 172.21.15.44:0/3953623213 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b31e00640 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc3b290 0x555c6fc5ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b32800640 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc5f920 0x555c6fc5e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b29400640 1 -- 172.21.15.44:0/3953623213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc5f920 msgr2=0x555c6fc5e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b29400640 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc5f920 0x555c6fc5e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b29400640 1 -- 172.21.15.44:0/3953623213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc3b290 msgr2=0x555c6fc5ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b29400640 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc3b290 0x555c6fc5ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b29400640 1 -- 172.21.15.44:0/3953623213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c6f872210 con 0x555c6fc3b670 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b31e00640 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc3b290 0x555c6fc5ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b32800640 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc5f920 0x555c6fc5e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:29.689 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b29400640 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc5f3e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0b340ba520 tx=0x7f0b1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca0d1b791ce2635 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b17400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b17400640 1 -- 172.21.15.44:0/3953623213 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c004020 con 0x555c6fc3b670 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b17400640 1 -- 172.21.15.44:0/3953623213 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f0b1c0041c0 con 0x555c6fc3b670 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.681+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3953623213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b2c005470 con 0x555c6fc3b670 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.682+0000 7f0b17400640 1 -- 172.21.15.44:0/3953623213 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0b1c0043c0 con 0x555c6fc3b670 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.682+0000 7f0b3bdfc740 10 client.6378 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.682+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3953623213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x555c6f9df0b0 con 0x555c6fc3b670 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.682+0000 7f0b17400640 1 -- 172.21.15.44:0/3953623213 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b2c005470 con 0x555c6fc3b670 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.682+0000 7f0b17400640 1 -- 172.21.15.44:0/3953623213 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f0b1c003610 con 0x555c6fc3b670 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.682+0000 7f0b3bdfc740 10 client.6378 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.682+0000 7f0b3bdfc740 10 client.6378 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.682+0000 7f0b3bdfc740 20 client.6378 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.682+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555c6fc5ad60 0x555c6fc5b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.682+0000 7f0b3bdfc740 4 client.6378 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:29.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.682+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3953623213 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c6fbab870 con 0x555c6fc5ad60 2024-03-30T13:15:29.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.682+0000 7f0b31e00640 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555c6fc5ad60 0x555c6fc5b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.683+0000 7f0b31e00640 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555c6fc5ad60 0x555c6fc5b170 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0d0d2b25831b631 server_cookie=3aae6ac2370d2337 in_seq=0 out_seq=0 2024-03-30T13:15:29.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.683+0000 7f0b17400640 10 client.6378 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b17400640 1 -- 172.21.15.44:0/3953623213 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x555c6fbab870 con 0x555c6fc5ad60 2024-03-30T13:15:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b17400640 10 client.6378 handle_command_reply: tid=0 2024-03-30T13:15:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b3bdfc740 1 client.6378 shutdown 2024-03-30T13:15:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3953623213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 msgr2=0x555c6fc5f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc5f3e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0b340ba520 tx=0x7f0b1c004730 comp rx=0 tx=0).stop 2024-03-30T13:15:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3953623213 shutdown_connections 2024-03-30T13:15:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555c6fc5ad60 0x555c6fc5b170 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc5f920 0x555c6fc5e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc5f3e0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3953623213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc3b290 0x555c6fc5ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3953623213 >> 172.21.15.44:0/3953623213 conn(0x555c6fc01be0 msgr2=0x555c6fc60dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b17400640 0 client.6378 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3953623213 shutdown_connections 2024-03-30T13:15:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.684+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3953623213 wait complete. 2024-03-30T13:15:29.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.685+0000 7f0b3bdfc740 20 client.6378 trim_cache size 0 max 16384 2024-03-30T13:15:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.700+0000 7f0b3bdfc740 1 Processor -- start 2024-03-30T13:15:29.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.701+0000 7f0b3bdfc740 1 -- start start 2024-03-30T13:15:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.701+0000 7f0b3bdfc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b290 0x555c6fc5b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.701+0000 7f0b3bdfc740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc3b670 0x555c6fc8f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.701+0000 7f0b3bdfc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc5f920 0x555c6fc60fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.701+0000 7f0b3bdfc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0b34201350 con 0x555c6fc3b290 2024-03-30T13:15:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.701+0000 7f0b3bdfc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0b34200350 con 0x555c6fc5f920 2024-03-30T13:15:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.701+0000 7f0b3bdfc740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0b341472e0 con 0x555c6fc3b670 2024-03-30T13:15:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.702+0000 7f0b31e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b290 0x555c6fc5b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.702+0000 7f0b31e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b290 0x555c6fc5b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54334/0 (socket says 172.21.15.44:54334) 2024-03-30T13:15:29.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.702+0000 7f0b31e00640 1 -- 172.21.15.44:0/3499031731 learned_addr learned my addr 172.21.15.44:0/3499031731 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.702+0000 7f0b31e00640 1 -- 172.21.15.44:0/3499031731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc3b670 msgr2=0x555c6fc8f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.702+0000 7f0b31e00640 1 --2- 172.21.15.44:0/3499031731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc3b670 0x555c6fc8f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.702+0000 7f0b31e00640 1 -- 172.21.15.44:0/3499031731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc5f920 msgr2=0x555c6fc60fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.702+0000 7f0b31e00640 1 --2- 172.21.15.44:0/3499031731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc5f920 0x555c6fc60fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.702+0000 7f0b31e00640 1 -- 172.21.15.44:0/3499031731 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c6fc59500 con 0x555c6fc3b290 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.702+0000 7f0b31e00640 1 --2- 172.21.15.44:0/3499031731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b290 0x555c6fc5b140 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009e50 tx=0x7f0b240ac230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4a762d9c038a46 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.703+0000 7f0b22000640 1 -- 172.21.15.44:0/3499031731 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24080100 con 0x555c6fc3b290 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.703+0000 7f0b22000640 1 -- 172.21.15.44:0/3499031731 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b240aa070 con 0x555c6fc3b290 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.703+0000 7f0b22000640 1 -- 172.21.15.44:0/3499031731 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b24084930 con 0x555c6fc3b290 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.703+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3499031731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b290 msgr2=0x555c6fc5b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.703+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3499031731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b290 0x555c6fc5b140 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009e50 tx=0x7f0b240ac230 comp rx=0 tx=0).stop 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.703+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3499031731 shutdown_connections 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.703+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3499031731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc5f920 0x555c6fc60fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.703+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3499031731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc3b670 0x555c6fc8f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.703+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/3499031731 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b290 0x555c6fc5b140 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.703+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3499031731 >> 172.21.15.44:0/3499031731 conn(0x555c6fc01be0 msgr2=0x555c6fca33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.703+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3499031731 shutdown_connections 2024-03-30T13:15:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.703+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/3499031731 wait complete. 2024-03-30T13:15:29.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.704+0000 7f0b3bdfc740 1 -- start start 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.704+0000 7f0b3bdfc740 1 Processor -- start 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.705+0000 7f0b3bdfc740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc3b290 0x555c6fc34b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.705+0000 7f0b3bdfc740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc38fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.705+0000 7f0b3bdfc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc5f920 0x555c6fc39500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.705+0000 7f0b3bdfc740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555c6fb54fc0 con 0x555c6fc3b670 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.705+0000 7f0b3bdfc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0b341ffd30 con 0x555c6fc5f920 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.705+0000 7f0b3bdfc740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x555c6fbabfa0 con 0x555c6fc3b290 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.705+0000 7f0b3bdfc740 10 client.0 _ll_register_callbacks cb 0x7f0b1c008f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b29400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc38fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b29400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc38fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54336/0 (socket says 172.21.15.44:54336) 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b29400640 1 -- 172.21.15.44:0/2445597337 learned_addr learned my addr 172.21.15.44:0/2445597337 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b31e00640 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc3b290 0x555c6fc34b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b29400640 1 -- 172.21.15.44:0/2445597337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc3b290 msgr2=0x555c6fc34b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b29400640 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc3b290 0x555c6fc34b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b29400640 1 -- 172.21.15.44:0/2445597337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc5f920 msgr2=0x555c6fc39500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b32800640 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc5f920 0x555c6fc39500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b29400640 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc5f920 0x555c6fc39500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b29400640 1 -- 172.21.15.44:0/2445597337 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c6fc5f750 con 0x555c6fc3b670 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b31e00640 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc3b290 0x555c6fc34b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b29400640 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc38fc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c000c00 tx=0x7f0b1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37695868ecb2057d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.706+0000 7f0b17400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.707+0000 7f0b17400640 1 -- 172.21.15.44:0/2445597337 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c02b020 con 0x555c6fc3b670 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.707+0000 7f0b17400640 1 -- 172.21.15.44:0/2445597337 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7f0b1c038640 con 0x555c6fc3b670 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.707+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/2445597337 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b240aa070 con 0x555c6fc3b670 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.707+0000 7f0b17400640 1 -- 172.21.15.44:0/2445597337 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f0b1c0081f0 con 0x555c6fc3b670 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.707+0000 7f0b3bdfc740 10 client.6384 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:29.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.707+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/2445597337 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x555c6f84b2d0 con 0x555c6fc3b670 2024-03-30T13:15:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.707+0000 7f0b17400640 1 -- 172.21.15.44:0/2445597337 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b240aa070 con 0x555c6fc3b670 2024-03-30T13:15:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.707+0000 7f0b17400640 1 -- 172.21.15.44:0/2445597337 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f0b1c036020 con 0x555c6fc3b670 2024-03-30T13:15:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.707+0000 7f0b3bdfc740 10 client.6384 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.707+0000 7f0b3bdfc740 10 client.6384 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.707+0000 7f0b3bdfc740 20 client.6384 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.707+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555c6fc75940 0x555c6fc64b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.708+0000 7f0b3bdfc740 4 client.6384 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628426}] 2024-03-30T13:15:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.708+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/2445597337 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628426}) -- 0x555c6fba5bc0 con 0x555c6fc75940 2024-03-30T13:15:29.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.708+0000 7f0b31e00640 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555c6fc75940 0x555c6fc64b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.708+0000 7f0b31e00640 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555c6fc75940 0x555c6fc64b30 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e37e0a20c1a14a61 server_cookie=3bab5e6370d6f3c4 in_seq=0 out_seq=0 2024-03-30T13:15:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.708+0000 7f0b17400640 10 client.6384 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b17400640 1 -- 172.21.15.44:0/2445597337 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4763 (crc 0 0 0) 0x555c6fba5bc0 con 0x555c6fc75940 2024-03-30T13:15:29.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b17400640 10 client.6384 handle_command_reply: tid=0 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b3bdfc740 1 client.6384 shutdown 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/2445597337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 msgr2=0x555c6fc38fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc38fc0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c000c00 tx=0x7f0b1c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/2445597337 shutdown_connections 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x555c6fc75940 0x555c6fc64b30 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555c6fc5f920 0x555c6fc39500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555c6fc3b670 0x555c6fc38fc0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b3bdfc740 1 --2- 172.21.15.44:0/2445597337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555c6fc3b290 0x555c6fc34b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b17400640 0 client.6384 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/2445597337 >> 172.21.15.44:0/2445597337 conn(0x555c6fc01be0 msgr2=0x555c6fca33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/2445597337 shutdown_connections 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b3bdfc740 1 -- 172.21.15.44:0/2445597337 wait complete. 2024-03-30T13:15:29.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.709+0000 7f0b3bdfc740 20 client.6384 trim_cache size 0 max 16384 2024-03-30T13:15:29.718 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:29.718 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-sysfs.h", 2024-03-30T13:15:29.718 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628426, 2024-03-30T13:15:29.718 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:29.718 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.610546+0000", 2024-03-30T13:15:29.718 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.782530+0000", 2024-03-30T13:15:29.718 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:29.718 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:29.718 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:29.719 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 77, 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.782530+0000", 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:29.720 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:29.721 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 77, 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.610546+0000" 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 77, 2024-03-30T13:15:29.722 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.610546+0000" 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 208, 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 42, 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:29.723 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:29.724 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:29.725 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:29.726 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.727 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:29.728 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.729 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:29.730 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:29.731 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:29.732 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:29.732 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:29.732 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:29.732 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:29.732 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:29.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.710+0000 7f0b39000640 1 -- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0b1006c530 msgr2=0x7f0b1006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.710+0000 7f0b39000640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0b1006c530 0x7f0b1006e9f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0b340caf40 tx=0x7f0b1c008040 comp rx=0 tx=0).stop 2024-03-30T13:15:29.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.710+0000 7f0b39000640 1 -- 172.21.15.44:0/2356162995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b340ba0b0 msgr2=0x7f0b34148410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.710+0000 7f0b39000640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b340ba0b0 0x7f0b34148410 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009f70 tx=0x7f0b24004a40 comp rx=0 tx=0).stop 2024-03-30T13:15:29.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.710+0000 7f0b39000640 1 -- 172.21.15.44:0/2356162995 shutdown_connections 2024-03-30T13:15:29.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.710+0000 7f0b39000640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0b1006c530 0x7f0b1006e9f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.710+0000 7f0b39000640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b3415e570 0x7f0b34157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.710+0000 7f0b39000640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b340cf620 0x7f0b340c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.710+0000 7f0b39000640 1 --2- 172.21.15.44:0/2356162995 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0b340ba0b0 0x7f0b34148410 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.710+0000 7f0b39000640 1 -- 172.21.15.44:0/2356162995 >> 172.21.15.44:0/2356162995 conn(0x7f0b340676e0 msgr2=0x7f0b340b7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.710+0000 7f0b39000640 1 -- 172.21.15.44:0/2356162995 shutdown_connections 2024-03-30T13:15:29.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.710+0000 7f0b39000640 1 -- 172.21.15.44:0/2356162995 wait complete. 2024-03-30T13:15:29.735 DEBUG:tasks.cephfs.test_uninlining:getting inode info #17 of 23:1099511628409 2024-03-30T13:15:29.735 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628409 2024-03-30T13:15:29.735 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628409 2024-03-30T13:15:29.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.936+0000 7fa772600640 1 Processor -- start 2024-03-30T13:15:29.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.937+0000 7fa772600640 1 -- start start 2024-03-30T13:15:29.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.938+0000 7fa772600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c0b4920 0x7fa76c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.938+0000 7fa772600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76c0b54b0 con 0x7fa76c0d0b90 2024-03-30T13:15:29.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.938+0000 7fa772600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76c0cfca0 con 0x7fa76c0b4d00 2024-03-30T13:15:29.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.938+0000 7fa772600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa76c0d0260 con 0x7fa76c0b4920 2024-03-30T13:15:29.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.938+0000 7fa771c00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fa76c0d0b90 0x7fa76c0d26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43008/0 (socket says 172.21.15.44:43008) 2024-03-30T13:15:29.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.938+0000 7fa771c00640 1 -- 172.21.15.44:0/1499030533 learned_addr learned my addr 172.21.15.44:0/1499030533 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.939+0000 7fa771200640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c0b4920 0x7fa76c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.939+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 283351498 0 0) 0x7fa764001490 con 0x7fa76c0d0b90 2024-03-30T13:15:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.939+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa754003520 con 0x7fa76c0d0b90 2024-03-30T13:15:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.939+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3538501305 0 0) 0x7fa754003520 con 0x7fa76c0d0b90 2024-03-30T13:15:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.939+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c0b4920 msgr2=0x7fa76c0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.939+0000 7fa76b400640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c0b4920 0x7fa76c0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.939+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 >> v1:172.21.15.151:6789/0 conn(0x7fa76c0b4d00 legacy=0x7fa76c0d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.939+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c0cff80 con 0x7fa76c0d0b90 2024-03-30T13:15:29.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.939+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fa764001bc0 con 0x7fa76c0d0b90 2024-03-30T13:15:29.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.939+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 >> v1:172.21.15.44:6789/0 conn(0x7fa76c0d0b90 legacy=0x7fa76c0d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.939+0000 7fa76b400640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7540039e0 0x7fa754003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.939+0000 7fa76b400640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa754004800 0x7fa754004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.940+0000 7fa76b400640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c0b4920 0x7fa754005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.940+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c0d0260 con 0x7fa754004800 2024-03-30T13:15:29.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.940+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa75400bb80 con 0x7fa7540039e0 2024-03-30T13:15:29.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.940+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa75400bd80 con 0x7fa76c0b4920 2024-03-30T13:15:29.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.940+0000 7fa76be00640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa754004800 0x7fa754004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.940+0000 7fa771200640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7540039e0 0x7fa754003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.940+0000 7fa771c00640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c0b4920 0x7fa754005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.941+0000 7fa76be00640 1 -- 172.21.15.44:0/1499030533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c0b4920 msgr2=0x7fa754005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.941+0000 7fa76be00640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c0b4920 0x7fa754005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.941+0000 7fa76be00640 1 -- 172.21.15.44:0/1499030533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7540039e0 msgr2=0x7fa754003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.941+0000 7fa76be00640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7540039e0 0x7fa754003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.941+0000 7fa76be00640 1 -- 172.21.15.44:0/1499030533 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa754003520 con 0x7fa754004800 2024-03-30T13:15:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.941+0000 7fa771200640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7540039e0 0x7fa754003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.942+0000 7fa76be00640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa754004800 0x7fa754004c80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa758001720 tx=0x7fa754005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17af9225b08a0aef server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.943+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758001370 con 0x7fa754004800 2024-03-30T13:15:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.943+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7580052d0 con 0x7fa754004800 2024-03-30T13:15:29.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.943+0000 7fa76b400640 1 -- 172.21.15.44:0/1499030533 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758003830 con 0x7fa754004800 2024-03-30T13:15:29.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.943+0000 7fa772600640 1 -- 172.21.15.44:0/1499030533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa754004800 msgr2=0x7fa754004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.943+0000 7fa772600640 1 --2- 172.21.15.44:0/1499030533 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa754004800 0x7fa754004c80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa758001720 tx=0x7fa754005830 comp rx=0 tx=0).stop 2024-03-30T13:15:29.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.944+0000 7fa771c00640 1 -- 172.21.15.44:0/1499030533 reap_dead start 2024-03-30T13:15:29.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.944+0000 7fa772600640 1 -- 172.21.15.44:0/1499030533 shutdown_connections 2024-03-30T13:15:29.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.944+0000 7fa772600640 1 -- 172.21.15.44:0/1499030533 >> 172.21.15.44:0/1499030533 conn(0x7fa76c09d4e0 msgr2=0x7fa76c0d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.944+0000 7fa772600640 1 -- 172.21.15.44:0/1499030533 shutdown_connections 2024-03-30T13:15:29.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.944+0000 7fa772600640 1 -- 172.21.15.44:0/1499030533 wait complete. 2024-03-30T13:15:29.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.947+0000 7fa772600640 1 Processor -- start 2024-03-30T13:15:29.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.947+0000 7fa772600640 1 -- start start 2024-03-30T13:15:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.949+0000 7fa772600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c15b6a0 0x7fa76c15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.949+0000 7fa772600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa76c15cc80 0x7fa76c15ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.949+0000 7fa772600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa76c15bfc0 0x7fa76c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.949+0000 7fa772600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c0cf8c0 con 0x7fa76c15cc80 2024-03-30T13:15:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.949+0000 7fa772600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c0d2180 con 0x7fa76c15bfc0 2024-03-30T13:15:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.949+0000 7fa772600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa76c0cfa40 con 0x7fa76c15b6a0 2024-03-30T13:15:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.949+0000 7fa76be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa76c15cc80 0x7fa76c15ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.949+0000 7fa76be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa76c15cc80 0x7fa76c15ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54352/0 (socket says 172.21.15.44:54352) 2024-03-30T13:15:29.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.949+0000 7fa76be00640 1 -- 172.21.15.44:0/621015511 learned_addr learned my addr 172.21.15.44:0/621015511 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.949+0000 7fa771c00640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa76c15bfc0 0x7fa76c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.949+0000 7fa771200640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c15b6a0 0x7fa76c15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.950+0000 7fa76be00640 1 -- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c15b6a0 msgr2=0x7fa76c15c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.950+0000 7fa76be00640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c15b6a0 0x7fa76c15c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.950+0000 7fa76be00640 1 -- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa76c15bfc0 msgr2=0x7fa76c0cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.950+0000 7fa76be00640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa76c15bfc0 0x7fa76c0cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.950+0000 7fa76be00640 1 -- 172.21.15.44:0/621015511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c0c8990 con 0x7fa76c15cc80 2024-03-30T13:15:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.950+0000 7fa76be00640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa76c15cc80 0x7fa76c15ba80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa758005040 tx=0x7fa758001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.950+0000 7fa768c00640 1 -- 172.21.15.44:0/621015511 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758001370 con 0x7fa76c15cc80 2024-03-30T13:15:29.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.950+0000 7fa768c00640 1 -- 172.21.15.44:0/621015511 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa758042070 con 0x7fa76c15cc80 2024-03-30T13:15:29.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.950+0000 7fa768c00640 1 -- 172.21.15.44:0/621015511 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758007a30 con 0x7fa76c15cc80 2024-03-30T13:15:29.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.950+0000 7fa772600640 1 -- 172.21.15.44:0/621015511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76c0c8c70 con 0x7fa76c15cc80 2024-03-30T13:15:29.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.951+0000 7fa772600640 1 -- 172.21.15.44:0/621015511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76c0c9230 con 0x7fa76c15cc80 2024-03-30T13:15:29.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.953+0000 7fa768c00640 1 -- 172.21.15.44:0/621015511 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa75803b040 con 0x7fa76c15cc80 2024-03-30T13:15:29.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.954+0000 7fa768c00640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa74c06c530 0x7fa74c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.954+0000 7fa768c00640 1 -- 172.21.15.44:0/621015511 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7fa7580acf80 con 0x7fa76c15cc80 2024-03-30T13:15:29.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.955+0000 7fa771200640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa74c06c530 0x7fa74c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.955+0000 7fa77684b740 1 Processor -- start 2024-03-30T13:15:29.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.955+0000 7fa77684b740 1 -- start start 2024-03-30T13:15:29.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.956+0000 7fa77684b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 0x56341fb0efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.956+0000 7fa77684b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fb0f4e0 0x56341fae74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.956+0000 7fa77684b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fae8850 0x56341fae79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.956+0000 7fa77684b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56341fa4b330 con 0x56341fae8470 2024-03-30T13:15:29.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.956+0000 7fa77684b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56341f9f3620 con 0x56341fb0f4e0 2024-03-30T13:15:29.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.956+0000 7fa77684b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x56341fa47440 con 0x56341fae8850 2024-03-30T13:15:29.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.956+0000 7fa771200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 0x56341fb0efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.956+0000 7fa771200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 0x56341fb0efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54358/0 (socket says 172.21.15.44:54358) 2024-03-30T13:15:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.956+0000 7fa771200640 1 -- 172.21.15.44:0/3018744385 learned_addr learned my addr 172.21.15.44:0/3018744385 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.956+0000 7fa771200640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa74c06c530 0x7fa74c06e9f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa760009990 tx=0x7fa760008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.957+0000 7fa771c00640 1 --2- 172.21.15.44:0/3018744385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fae8850 0x56341fae79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.957+0000 7fa76be00640 1 --2- 172.21.15.44:0/3018744385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fb0f4e0 0x56341fae74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.957+0000 7fa771200640 1 -- 172.21.15.44:0/3018744385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fae8850 msgr2=0x56341fae79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.957+0000 7fa771200640 1 --2- 172.21.15.44:0/3018744385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fae8850 0x56341fae79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.957+0000 7fa771200640 1 -- 172.21.15.44:0/3018744385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fb0f4e0 msgr2=0x56341fae74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.957+0000 7fa771200640 1 --2- 172.21.15.44:0/3018744385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fb0f4e0 0x56341fae74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.957+0000 7fa771200640 1 -- 172.21.15.44:0/3018744385 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56341f82b920 con 0x56341fae8470 2024-03-30T13:15:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.957+0000 7fa76be00640 1 --2- 172.21.15.44:0/3018744385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fb0f4e0 0x56341fae74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:29.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.957+0000 7fa771200640 1 --2- 172.21.15.44:0/3018744385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 0x56341fb0efa0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa7600093d0 tx=0x7fa760016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef1e3d4f984ab9f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.957+0000 7fa75d600640 1 -- 172.21.15.44:0/3018744385 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760023440 con 0x56341fae8470 2024-03-30T13:15:29.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.958+0000 7fa75d600640 1 -- 172.21.15.44:0/3018744385 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760028070 con 0x56341fae8470 2024-03-30T13:15:29.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.958+0000 7fa75d600640 1 -- 172.21.15.44:0/3018744385 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760023800 con 0x56341fae8470 2024-03-30T13:15:29.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.958+0000 7fa77684b740 1 -- 172.21.15.44:0/3018744385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 msgr2=0x56341fb0efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.958+0000 7fa77684b740 1 --2- 172.21.15.44:0/3018744385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 0x56341fb0efa0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa7600093d0 tx=0x7fa760016000 comp rx=0 tx=0).stop 2024-03-30T13:15:29.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.958+0000 7fa77684b740 1 -- 172.21.15.44:0/3018744385 shutdown_connections 2024-03-30T13:15:29.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.958+0000 7fa77684b740 1 --2- 172.21.15.44:0/3018744385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fae8850 0x56341fae79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.958+0000 7fa77684b740 1 --2- 172.21.15.44:0/3018744385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fb0f4e0 0x56341fae74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.958+0000 7fa77684b740 1 --2- 172.21.15.44:0/3018744385 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 0x56341fb0efa0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.958+0000 7fa77684b740 1 -- 172.21.15.44:0/3018744385 >> 172.21.15.44:0/3018744385 conn(0x56341faaebe0 msgr2=0x56341fb2d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.958+0000 7fa77684b740 1 -- 172.21.15.44:0/3018744385 shutdown_connections 2024-03-30T13:15:29.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.958+0000 7fa77684b740 1 -- 172.21.15.44:0/3018744385 wait complete. 2024-03-30T13:15:29.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.959+0000 7fa77684b740 1 -- start start 2024-03-30T13:15:29.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.959+0000 7fa77684b740 1 Processor -- start 2024-03-30T13:15:29.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.960+0000 7fa77684b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fae8470 0x56341fb2a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.960+0000 7fa77684b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 0x56341fb06bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.960+0000 7fa77684b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fb0e550 0x56341fb28cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.960+0000 7fa77684b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56341fb0eb10 con 0x56341fae8850 2024-03-30T13:15:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.960+0000 7fa77684b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56341fa069d0 con 0x56341fae8470 2024-03-30T13:15:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.960+0000 7fa77684b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x56341fb07890 con 0x56341fb0e550 2024-03-30T13:15:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.960+0000 7fa77684b740 10 client.0 _ll_register_callbacks cb 0x56341fa42fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa76be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 0x56341fb06bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa76be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 0x56341fb06bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54364/0 (socket says 172.21.15.44:54364) 2024-03-30T13:15:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa76be00640 1 -- 172.21.15.44:0/3403994722 learned_addr learned my addr 172.21.15.44:0/3403994722 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa771c00640 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fb0e550 0x56341fb28cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.972 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa771200640 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fae8470 0x56341fb2a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa76be00640 1 -- 172.21.15.44:0/3403994722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fb0e550 msgr2=0x56341fb28cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa76be00640 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fb0e550 0x56341fb28cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa76be00640 1 -- 172.21.15.44:0/3403994722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fae8470 msgr2=0x56341fb2a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa76be00640 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fae8470 0x56341fb2a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa76be00640 1 -- 172.21.15.44:0/3403994722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56341f71f210 con 0x56341fae8850 2024-03-30T13:15:29.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa771200640 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fae8470 0x56341fb2a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:29.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa76be00640 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 0x56341fb06bd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa7580ab190 tx=0x7fa75807a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86ac7ccd31f2726 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.961+0000 7fa752000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.962+0000 7fa752000640 1 -- 172.21.15.44:0/3403994722 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580837f0 con 0x56341fae8850 2024-03-30T13:15:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.962+0000 7fa752000640 1 -- 172.21.15.44:0/3403994722 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7fa758083360 con 0x56341fae8850 2024-03-30T13:15:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.962+0000 7fa77684b740 1 -- 172.21.15.44:0/3403994722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa760028070 con 0x56341fae8850 2024-03-30T13:15:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.962+0000 7fa752000640 1 -- 172.21.15.44:0/3403994722 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa75809a050 con 0x56341fae8850 2024-03-30T13:15:29.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.962+0000 7fa77684b740 10 client.6396 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.962+0000 7fa77684b740 1 -- 172.21.15.44:0/3403994722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x56341f88c0b0 con 0x56341fae8850 2024-03-30T13:15:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.962+0000 7fa752000640 1 -- 172.21.15.44:0/3403994722 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760028070 con 0x56341fae8850 2024-03-30T13:15:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.962+0000 7fa752000640 1 -- 172.21.15.44:0/3403994722 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fa7580a4b80 con 0x56341fae8850 2024-03-30T13:15:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.962+0000 7fa77684b740 10 client.6396 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.962+0000 7fa77684b740 10 client.6396 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.962+0000 7fa77684b740 20 client.6396 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:29.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.963+0000 7fa77684b740 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56341fb15a10 0x56341fb132e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.963+0000 7fa77684b740 4 client.6396 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.963+0000 7fa77684b740 1 -- 172.21.15.44:0/3403994722 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56341fa58870 con 0x56341fb15a10 2024-03-30T13:15:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.963+0000 7fa771200640 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56341fb15a10 0x56341fb132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.964+0000 7fa771200640 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56341fb15a10 0x56341fb132e0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0865979c6a3141f server_cookie=f0867dccd9440d1d in_seq=0 out_seq=0 2024-03-30T13:15:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.964+0000 7fa752000640 10 client.6396 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.964+0000 7fa752000640 1 -- 172.21.15.44:0/3403994722 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x56341fa58870 con 0x56341fb15a10 2024-03-30T13:15:29.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.964+0000 7fa752000640 10 client.6396 handle_command_reply: tid=0 2024-03-30T13:15:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.964+0000 7fa77684b740 1 client.6396 shutdown 2024-03-30T13:15:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.965+0000 7fa77684b740 1 -- 172.21.15.44:0/3403994722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 msgr2=0x56341fb06bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.965+0000 7fa77684b740 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 0x56341fb06bd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa7580ab190 tx=0x7fa75807a6a0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.965+0000 7fa77684b740 1 -- 172.21.15.44:0/3403994722 shutdown_connections 2024-03-30T13:15:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.965+0000 7fa77684b740 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56341fb15a10 0x56341fb132e0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.965+0000 7fa77684b740 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fb0e550 0x56341fb28cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.965+0000 7fa77684b740 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 0x56341fb06bd0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.965+0000 7fa77684b740 1 --2- 172.21.15.44:0/3403994722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fae8470 0x56341fb2a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.965+0000 7fa752000640 0 client.6396 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.965+0000 7fa77684b740 1 -- 172.21.15.44:0/3403994722 >> 172.21.15.44:0/3403994722 conn(0x56341faaebe0 msgr2=0x56341fae1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.965+0000 7fa77684b740 1 -- 172.21.15.44:0/3403994722 shutdown_connections 2024-03-30T13:15:29.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.965+0000 7fa77684b740 1 -- 172.21.15.44:0/3403994722 wait complete. 2024-03-30T13:15:29.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.965+0000 7fa77684b740 20 client.6396 trim_cache size 0 max 16384 2024-03-30T13:15:29.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.981+0000 7fa77684b740 1 Processor -- start 2024-03-30T13:15:29.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.981+0000 7fa77684b740 1 -- start start 2024-03-30T13:15:29.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.982+0000 7fa77684b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 0x56341fb28c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.982+0000 7fa77684b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fae8850 0x56341fae1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.982+0000 7fa77684b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fb0e550 0x56341fb069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.982+0000 7fa77684b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c206410 con 0x56341fae8470 2024-03-30T13:15:29.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.982+0000 7fa77684b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c205470 con 0x56341fae8850 2024-03-30T13:15:29.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.982+0000 7fa77684b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa76c2047d0 con 0x56341fb0e550 2024-03-30T13:15:29.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.982+0000 7fa771200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 0x56341fb28c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.982+0000 7fa771200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 0x56341fb28c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54370/0 (socket says 172.21.15.44:54370) 2024-03-30T13:15:29.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.982+0000 7fa771200640 1 -- 172.21.15.44:0/159936028 learned_addr learned my addr 172.21.15.44:0/159936028 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.983+0000 7fa771200640 1 -- 172.21.15.44:0/159936028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fb0e550 msgr2=0x56341fb069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.983+0000 7fa771200640 1 --2- 172.21.15.44:0/159936028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fb0e550 0x56341fb069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.983+0000 7fa771200640 1 -- 172.21.15.44:0/159936028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fae8850 msgr2=0x56341fae1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.983+0000 7fa771200640 1 --2- 172.21.15.44:0/159936028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fae8850 0x56341fae1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.983+0000 7fa771200640 1 -- 172.21.15.44:0/159936028 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56341f6f82d0 con 0x56341fae8470 2024-03-30T13:15:29.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.983+0000 7fa771200640 1 --2- 172.21.15.44:0/159936028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 0x56341fb28c90 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x56341fb16850 tx=0x7fa760019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d3c392ba4de68a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.983+0000 7fa75cc00640 1 -- 172.21.15.44:0/159936028 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760004030 con 0x56341fae8470 2024-03-30T13:15:29.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.983+0000 7fa75cc00640 1 -- 172.21.15.44:0/159936028 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760028050 con 0x56341fae8470 2024-03-30T13:15:29.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.983+0000 7fa75cc00640 1 -- 172.21.15.44:0/159936028 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760004410 con 0x56341fae8470 2024-03-30T13:15:29.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.984+0000 7fa77684b740 1 -- 172.21.15.44:0/159936028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 msgr2=0x56341fb28c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.984+0000 7fa77684b740 1 --2- 172.21.15.44:0/159936028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 0x56341fb28c90 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x56341fb16850 tx=0x7fa760019000 comp rx=0 tx=0).stop 2024-03-30T13:15:29.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.984+0000 7fa77684b740 1 -- 172.21.15.44:0/159936028 shutdown_connections 2024-03-30T13:15:29.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.984+0000 7fa77684b740 1 --2- 172.21.15.44:0/159936028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fb0e550 0x56341fb069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.984+0000 7fa77684b740 1 --2- 172.21.15.44:0/159936028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fae8850 0x56341fae1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.984+0000 7fa77684b740 1 --2- 172.21.15.44:0/159936028 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8470 0x56341fb28c90 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.984+0000 7fa77684b740 1 -- 172.21.15.44:0/159936028 >> 172.21.15.44:0/159936028 conn(0x56341faaebe0 msgr2=0x56341faddb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.984+0000 7fa77684b740 1 -- 172.21.15.44:0/159936028 shutdown_connections 2024-03-30T13:15:29.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.984+0000 7fa77684b740 1 -- 172.21.15.44:0/159936028 wait complete. 2024-03-30T13:15:29.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.985+0000 7fa77684b740 1 -- start start 2024-03-30T13:15:29.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.985+0000 7fa77684b740 1 Processor -- start 2024-03-30T13:15:29.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa77684b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fae8470 0x56341fba7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa77684b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 0x56341fb05b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa77684b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fb0e550 0x56341fb22e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa77684b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c204e20 con 0x56341fae8850 2024-03-30T13:15:29.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa77684b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56341fb256b0 con 0x56341fb0e550 2024-03-30T13:15:29.993 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa77684b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x56341fb23b60 con 0x56341fae8470 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa77684b740 10 client.0 _ll_register_callbacks cb 0x7fa758000f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa76be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 0x56341fb05b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa76be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 0x56341fb05b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54378/0 (socket says 172.21.15.44:54378) 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa76be00640 1 -- 172.21.15.44:0/979946648 learned_addr learned my addr 172.21.15.44:0/979946648 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa76be00640 1 -- 172.21.15.44:0/979946648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fae8470 msgr2=0x56341fba7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa76be00640 1 --2- 172.21.15.44:0/979946648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fae8470 0x56341fba7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa76be00640 1 -- 172.21.15.44:0/979946648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fb0e550 msgr2=0x56341fb22e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa76be00640 1 --2- 172.21.15.44:0/979946648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fb0e550 0x56341fb22e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.986+0000 7fa76be00640 1 -- 172.21.15.44:0/979946648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56341fb06090 con 0x56341fae8850 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.987+0000 7fa76be00640 1 --2- 172.21.15.44:0/979946648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 0x56341fb05b50 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa75807a9c0 tx=0x7fa758007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b64be03f85d6418 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.987+0000 7fa752000640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.987+0000 7fa752000640 1 -- 172.21.15.44:0/979946648 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580a0070 con 0x56341fae8850 2024-03-30T13:15:29.994 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.987+0000 7fa752000640 1 -- 172.21.15.44:0/979946648 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7fa75809dce0 con 0x56341fae8850 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.987+0000 7fa77684b740 1 -- 172.21.15.44:0/979946648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa760028050 con 0x56341fae8850 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.987+0000 7fa752000640 1 -- 172.21.15.44:0/979946648 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fa75807a800 con 0x56341fae8850 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.987+0000 7fa77684b740 10 client.6402 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.987+0000 7fa77684b740 1 -- 172.21.15.44:0/979946648 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x56341fb06090 con 0x56341fae8850 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.988+0000 7fa752000640 1 -- 172.21.15.44:0/979946648 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760028050 con 0x56341fae8850 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.988+0000 7fa752000640 1 -- 172.21.15.44:0/979946648 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fa7580a3020 con 0x56341fae8850 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.988+0000 7fa77684b740 10 client.6402 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.988+0000 7fa77684b740 10 client.6402 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.988+0000 7fa77684b740 20 client.6402 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.988+0000 7fa77684b740 1 --2- 172.21.15.44:0/979946648 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56341fae1580 0x56341fb23340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.988+0000 7fa77684b740 4 client.6402 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628409}] 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.988+0000 7fa77684b740 1 -- 172.21.15.44:0/979946648 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628409}) -- 0x56341fa52bc0 con 0x56341fae1580 2024-03-30T13:15:29.995 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.988+0000 7fa771200640 1 --2- 172.21.15.44:0/979946648 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56341fae1580 0x56341fb23340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.988+0000 7fa771200640 1 --2- 172.21.15.44:0/979946648 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56341fae1580 0x56341fb23340 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a0190da3195c61e server_cookie=95c198dd5b31edaf in_seq=0 out_seq=0 2024-03-30T13:15:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.988+0000 7fa752000640 10 client.6402 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa752000640 1 -- 172.21.15.44:0/979946648 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4760 (crc 0 0 0) 0x56341fa52bc0 con 0x56341fae1580 2024-03-30T13:15:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa752000640 10 client.6402 handle_command_reply: tid=0 2024-03-30T13:15:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa77684b740 1 client.6402 shutdown 2024-03-30T13:15:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa77684b740 1 -- 172.21.15.44:0/979946648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 msgr2=0x56341fb05b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa77684b740 1 --2- 172.21.15.44:0/979946648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 0x56341fb05b50 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa75807a9c0 tx=0x7fa758007c80 comp rx=0 tx=0).stop 2024-03-30T13:15:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa77684b740 1 -- 172.21.15.44:0/979946648 shutdown_connections 2024-03-30T13:15:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa77684b740 1 --2- 172.21.15.44:0/979946648 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x56341fae1580 0x56341fb23340 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa77684b740 1 --2- 172.21.15.44:0/979946648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56341fb0e550 0x56341fb22e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa77684b740 1 --2- 172.21.15.44:0/979946648 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x56341fae8850 0x56341fb05b50 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.997 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa77684b740 1 --2- 172.21.15.44:0/979946648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56341fae8470 0x56341fba7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:29.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa752000640 0 client.6402 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:29.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa77684b740 1 -- 172.21.15.44:0/979946648 >> 172.21.15.44:0/979946648 conn(0x56341faaebe0 msgr2=0x56341fb29d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:29.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa77684b740 1 -- 172.21.15.44:0/979946648 shutdown_connections 2024-03-30T13:15:29.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.989+0000 7fa77684b740 1 -- 172.21.15.44:0/979946648 wait complete. 2024-03-30T13:15:29.998 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa77684b740 20 client.6402 trim_cache size 0 max 16384 2024-03-30T13:15:29.998 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:29.998 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/dcache.c", 2024-03-30T13:15:29.998 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628409, 2024-03-30T13:15:29.998 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.613196+0000", 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.738530+0000", 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:29.999 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 3670, 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.738530+0000", 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:30.000 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 4, 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:30.001 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.002 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:30.002 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:30.002 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:30.002 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:30.002 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:30.002 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:30.002 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:30.002 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:30.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 3670, 2024-03-30T13:15:30.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:30.002 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.613196+0000" 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 3670, 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.613196+0000" 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 212, 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:30.003 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 8, 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:30.004 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:30.005 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:30.006 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:30.007 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.008 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.008 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.008 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.008 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.008 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.008 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:30.008 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.008 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:30.009 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:30.009 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.009 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.009 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.009 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.009 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.009 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.009 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:30.009 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:30.010 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:30.010 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.010 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:30.010 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:30.010 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.010 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.010 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.010 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.010 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.011 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.011 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:30.011 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.011 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:30.011 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:30.011 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.011 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.011 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.011 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.012 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.012 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.012 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:30.012 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:30.012 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.012 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:30.012 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:30.012 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.012 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.013 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.013 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.013 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.013 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.013 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:30.013 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:30.013 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:30.013 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.013 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:30.014 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:30.014 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.014 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.014 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.014 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.014 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.014 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.014 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:30.015 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:30.015 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:30.015 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:30.015 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:30.015 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.015 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:30.015 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:30.015 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:30.015 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:30.016 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:30.016 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:30.016 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:30.016 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:30.016 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.016 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:30.016 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:30.016 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:30.016 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:30.017 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa772600640 1 -- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa74c06c530 msgr2=0x7fa74c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa772600640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa74c06c530 0x7fa74c06e9f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa760009990 tx=0x7fa760008040 comp rx=0 tx=0).stop 2024-03-30T13:15:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa772600640 1 -- 172.21.15.44:0/621015511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa76c15cc80 msgr2=0x7fa76c15ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa772600640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa76c15cc80 0x7fa76c15ba80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa758005040 tx=0x7fa758001120 comp rx=0 tx=0).stop 2024-03-30T13:15:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa772600640 1 -- 172.21.15.44:0/621015511 shutdown_connections 2024-03-30T13:15:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa772600640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa74c06c530 0x7fa74c06e9f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa772600640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa76c15bfc0 0x7fa76c0cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa772600640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa76c15cc80 0x7fa76c15ba80 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa772600640 1 --2- 172.21.15.44:0/621015511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa76c15b6a0 0x7fa76c15c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa772600640 1 -- 172.21.15.44:0/621015511 >> 172.21.15.44:0/621015511 conn(0x7fa76c09d4e0 msgr2=0x7fa76c160120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa772600640 1 -- 172.21.15.44:0/621015511 shutdown_connections 2024-03-30T13:15:30.020 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:29.990+0000 7fa772600640 1 -- 172.21.15.44:0/621015511 wait complete. 2024-03-30T13:15:30.020 DEBUG:tasks.cephfs.test_uninlining:getting inode info #18 of 23:1099511628417 2024-03-30T13:15:30.021 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628417 2024-03-30T13:15:30.021 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628417 2024-03-30T13:15:30.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.242+0000 7fb8bb200640 1 Processor -- start 2024-03-30T13:15:30.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.242+0000 7fb8bb200640 1 -- start start 2024-03-30T13:15:30.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.244+0000 7fb8bb200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb8bc0acd60 0x7fb8bc072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.244+0000 7fb8bb200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc0ad2e0 con 0x7fb8bc06e980 2024-03-30T13:15:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.244+0000 7fb8bb200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8bc0716a0 con 0x7fb8bc0ae9d0 2024-03-30T13:15:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.244+0000 7fb8bb200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fb8bc0ad5c0 con 0x7fb8bc0acd60 2024-03-30T13:15:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.245+0000 7fb8b9e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb8bc06e980 0x7fb8bc15d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43012/0 (socket says 172.21.15.44:43012) 2024-03-30T13:15:30.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.245+0000 7fb8b9e00640 1 -- 172.21.15.44:0/4221790348 learned_addr learned my addr 172.21.15.44:0/4221790348 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.245+0000 7fb8b9400640 1 --2- 172.21.15.44:0/4221790348 >> v2:172.21.15.151:3300/0 conn(0x7fb8bc0acd60 0x7fb8bc072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.245+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2112872761 0 0) 0x7fb8bc0ad2e0 con 0x7fb8bc06e980 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.245+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a0003520 con 0x7fb8bc06e980 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3559172969 0 0) 0x7fb8a0003520 con 0x7fb8bc06e980 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 >> v2:172.21.15.151:3300/0 conn(0x7fb8bc0acd60 msgr2=0x7fb8bc072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 --2- 172.21.15.44:0/4221790348 >> v2:172.21.15.151:3300/0 conn(0x7fb8bc0acd60 0x7fb8bc072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 >> v1:172.21.15.151:6789/0 conn(0x7fb8bc0ae9d0 legacy=0x7fb8bc0aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc071980 con 0x7fb8bc06e980 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fb8ac001670 con 0x7fb8bc06e980 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 >> v1:172.21.15.44:6789/0 conn(0x7fb8bc06e980 legacy=0x7fb8bc15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 --2- 172.21.15.44:0/4221790348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8a0003a00 0x7fb8a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 --2- 172.21.15.44:0/4221790348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8a0004800 0x7fb8a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 --2- 172.21.15.44:0/4221790348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a0005210 0x7fb8a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a000c130 con 0x7fb8a0005210 2024-03-30T13:15:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a000c2e0 con 0x7fb8a0004800 2024-03-30T13:15:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a000c4e0 con 0x7fb8a0003a00 2024-03-30T13:15:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8ba800640 1 --2- 172.21.15.44:0/4221790348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a0005210 0x7fb8a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.246+0000 7fb8b9400640 1 --2- 172.21.15.44:0/4221790348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8a0004800 0x7fb8a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.247+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/4221790348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8a0003a00 0x7fb8a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.247+0000 7fb8ba800640 1 -- 172.21.15.44:0/4221790348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8a0003a00 msgr2=0x7fb8a0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.247+0000 7fb8ba800640 1 --2- 172.21.15.44:0/4221790348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8a0003a00 0x7fb8a0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.254 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.247+0000 7fb8ba800640 1 -- 172.21.15.44:0/4221790348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8a0004800 msgr2=0x7fb8a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.247+0000 7fb8ba800640 1 --2- 172.21.15.44:0/4221790348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8a0004800 0x7fb8a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.247+0000 7fb8ba800640 1 -- 172.21.15.44:0/4221790348 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a0003520 con 0x7fb8a0005210 2024-03-30T13:15:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.249+0000 7fb8ba800640 1 -- 172.21.15.44:0/4221790348 reap_dead start 2024-03-30T13:15:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.250+0000 7fb8ba800640 1 --2- 172.21.15.44:0/4221790348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a0005210 0x7fb8a000b9c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4001e20 tx=0x7fb8a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de41b378ddd84072 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.250+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4001a70 con 0x7fb8a0005210 2024-03-30T13:15:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.250+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8b4003b70 con 0x7fb8a0005210 2024-03-30T13:15:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.250+0000 7fb8b8a00640 1 -- 172.21.15.44:0/4221790348 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40050d0 con 0x7fb8a0005210 2024-03-30T13:15:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.250+0000 7fb8bb200640 1 -- 172.21.15.44:0/4221790348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a0005210 msgr2=0x7fb8a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.250+0000 7fb8bb200640 1 --2- 172.21.15.44:0/4221790348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a0005210 0x7fb8a000b9c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4001e20 tx=0x7fb8a0005830 comp rx=0 tx=0).stop 2024-03-30T13:15:30.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.251+0000 7fb8bb200640 1 -- 172.21.15.44:0/4221790348 shutdown_connections 2024-03-30T13:15:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.251+0000 7fb8bb200640 1 --2- 172.21.15.44:0/4221790348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8a0005210 0x7fb8a000b9c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.251+0000 7fb8bb200640 1 -- 172.21.15.44:0/4221790348 >> 172.21.15.44:0/4221790348 conn(0x7fb8bc0cfd90 msgr2=0x7fb8bc0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.251+0000 7fb8bb200640 1 -- 172.21.15.44:0/4221790348 shutdown_connections 2024-03-30T13:15:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.251+0000 7fb8bb200640 1 -- 172.21.15.44:0/4221790348 wait complete. 2024-03-30T13:15:30.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.252+0000 7fb8bb200640 1 Processor -- start 2024-03-30T13:15:30.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.253+0000 7fb8bb200640 1 -- start start 2024-03-30T13:15:30.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.253+0000 7fb8bb200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8a0005210 0x7fb8bc0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8bb200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8bc148320 0x7fb8bc1487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8bb200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0cc9d0 0x7fb8bc0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8bb200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc072180 con 0x7fb8bc148320 2024-03-30T13:15:30.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8bb200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc071450 con 0x7fb8bc0cc9d0 2024-03-30T13:15:30.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8bb200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb8bc072300 con 0x7fb8a0005210 2024-03-30T13:15:30.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8b9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8bc148320 0x7fb8bc1487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8b9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8bc148320 0x7fb8bc1487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54394/0 (socket says 172.21.15.44:54394) 2024-03-30T13:15:30.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8b9400640 1 -- 172.21.15.44:0/1731605451 learned_addr learned my addr 172.21.15.44:0/1731605451 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8ba800640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0cc9d0 0x7fb8bc0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8a0005210 0x7fb8bc0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8b9400640 1 -- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8a0005210 msgr2=0x7fb8bc0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8b9400640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8a0005210 0x7fb8bc0cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8b9400640 1 -- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0cc9d0 msgr2=0x7fb8bc0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8b9400640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0cc9d0 0x7fb8bc0cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.254+0000 7fb8b9400640 1 -- 172.21.15.44:0/1731605451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8bc0cd740 con 0x7fb8bc148320 2024-03-30T13:15:30.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.255+0000 7fb8b9400640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8bc148320 0x7fb8bc1487a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8011910 tx=0x7fb8a8011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.255+0000 7fb8b2000640 1 -- 172.21.15.44:0/1731605451 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800faf0 con 0x7fb8bc148320 2024-03-30T13:15:30.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.255+0000 7fb8b2000640 1 -- 172.21.15.44:0/1731605451 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a800fc90 con 0x7fb8bc148320 2024-03-30T13:15:30.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.255+0000 7fb8bb200640 1 -- 172.21.15.44:0/1731605451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8bc0cda20 con 0x7fb8bc148320 2024-03-30T13:15:30.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.255+0000 7fb8b2000640 1 -- 172.21.15.44:0/1731605451 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8014440 con 0x7fb8bc148320 2024-03-30T13:15:30.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.255+0000 7fb8bb200640 1 -- 172.21.15.44:0/1731605451 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8bc0cdfe0 con 0x7fb8bc148320 2024-03-30T13:15:30.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.258+0000 7fb8b2000640 1 -- 172.21.15.44:0/1731605451 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb8a8012040 con 0x7fb8bc148320 2024-03-30T13:15:30.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.259+0000 7fb8b2000640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb89c06c530 0x7fb89c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.259+0000 7fb8b2000640 1 -- 172.21.15.44:0/1731605451 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7fb8a808c060 con 0x7fb8bc148320 2024-03-30T13:15:30.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.259+0000 7fb8c3e3a740 1 Processor -- start 2024-03-30T13:15:30.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.259+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb89c06c530 0x7fb89c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.259+0000 7fb8c3e3a740 1 -- start start 2024-03-30T13:15:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb89c06c530 0x7fb89c06e9f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac000c00 tx=0x7fb8ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8c3e3a740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213f880 0x5563321663b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8c3e3a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563321668f0 0x55633213e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8c3e3a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55633213fc60 0x55633213ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8c3e3a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55633209e330 con 0x5563321668f0 2024-03-30T13:15:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8c3e3a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556332046620 con 0x55633213fc60 2024-03-30T13:15:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8c3e3a740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55633209a440 con 0x55633213f880 2024-03-30T13:15:30.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8b9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563321668f0 0x55633213e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8b9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563321668f0 0x55633213e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54410/0 (socket says 172.21.15.44:54410) 2024-03-30T13:15:30.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8b9400640 1 -- 172.21.15.44:0/161473397 learned_addr learned my addr 172.21.15.44:0/161473397 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8b9400640 1 -- 172.21.15.44:0/161473397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213f880 msgr2=0x5563321663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8b9400640 1 --2- 172.21.15.44:0/161473397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213f880 0x5563321663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8b9400640 1 -- 172.21.15.44:0/161473397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55633213fc60 msgr2=0x55633213ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8b9400640 1 --2- 172.21.15.44:0/161473397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55633213fc60 0x55633213ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.261+0000 7fb8b9400640 1 -- 172.21.15.44:0/161473397 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556331e7e920 con 0x5563321668f0 2024-03-30T13:15:30.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.262+0000 7fb8b9400640 1 --2- 172.21.15.44:0/161473397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563321668f0 0x55633213e8c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80623a0 tx=0x7fb8a8059db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139395b7ae468346 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.262+0000 7fb8a6a00640 1 -- 172.21.15.44:0/161473397 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80628d0 con 0x5563321668f0 2024-03-30T13:15:30.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.262+0000 7fb8a6a00640 1 -- 172.21.15.44:0/161473397 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a8057ff0 con 0x5563321668f0 2024-03-30T13:15:30.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.262+0000 7fb8a6a00640 1 -- 172.21.15.44:0/161473397 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8059f50 con 0x5563321668f0 2024-03-30T13:15:30.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.262+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/161473397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563321668f0 msgr2=0x55633213e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.271 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.262+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/161473397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563321668f0 0x55633213e8c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80623a0 tx=0x7fb8a8059db0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.263+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/161473397 shutdown_connections 2024-03-30T13:15:30.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.263+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/161473397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55633213fc60 0x55633213ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.263+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/161473397 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5563321668f0 0x55633213e8c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.263+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/161473397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213f880 0x5563321663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.263+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/161473397 >> 172.21.15.44:0/161473397 conn(0x556332101be0 msgr2=0x5563321845a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.263+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/161473397 shutdown_connections 2024-03-30T13:15:30.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.263+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/161473397 wait complete. 2024-03-30T13:15:30.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.263+0000 7fb8c3e3a740 1 -- start start 2024-03-30T13:15:30.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.264+0000 7fb8c3e3a740 1 Processor -- start 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.265+0000 7fb8c3e3a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 0x556332181f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.265+0000 7fb8c3e3a740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213fc60 0x55633213e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.265+0000 7fb8c3e3a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556332184fd0 0x55633216d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.265+0000 7fb8c3e3a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556332165f20 con 0x55633213f880 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.265+0000 7fb8c3e3a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5563320599d0 con 0x556332184fd0 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.265+0000 7fb8c3e3a740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55633215eca0 con 0x55633213fc60 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.265+0000 7fb8c3e3a740 10 client.0 _ll_register_callbacks cb 0x556332095fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.265+0000 7fb8b9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 0x556332181f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.265+0000 7fb8b9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 0x556332181f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54426/0 (socket says 172.21.15.44:54426) 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.265+0000 7fb8b9e00640 1 -- 172.21.15.44:0/2932740289 learned_addr learned my addr 172.21.15.44:0/2932740289 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.265+0000 7fb8b9400640 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213fc60 0x55633213e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.265+0000 7fb8ba800640 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556332184fd0 0x55633216d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.266+0000 7fb8b9e00640 1 -- 172.21.15.44:0/2932740289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213fc60 msgr2=0x55633213e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.273 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.266+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213fc60 0x55633213e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.266+0000 7fb8b9e00640 1 -- 172.21.15.44:0/2932740289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556332184fd0 msgr2=0x55633216d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.266+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556332184fd0 0x55633216d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.266+0000 7fb8b9e00640 1 -- 172.21.15.44:0/2932740289 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556331d72210 con 0x55633213f880 2024-03-30T13:15:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.266+0000 7fb8b9400640 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213fc60 0x55633213e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.266+0000 7fb8ba800640 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556332184fd0 0x55633216d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.266+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 0x556332181f60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac017740 tx=0x7fb8ac001dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e0915ce54f0544 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.266+0000 7fb89b400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.266+0000 7fb89b400640 1 -- 172.21.15.44:0/2932740289 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0170d0 con 0x55633213f880 2024-03-30T13:15:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.266+0000 7fb89b400640 1 -- 172.21.15.44:0/2932740289 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7fb8ac017270 con 0x55633213f880 2024-03-30T13:15:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.266+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2932740289 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8a8057ff0 con 0x55633213f880 2024-03-30T13:15:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.267+0000 7fb89b400640 1 -- 172.21.15.44:0/2932740289 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb8ac0146a0 con 0x55633213f880 2024-03-30T13:15:30.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.267+0000 7fb8c3e3a740 10 client.6414 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:30.275 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.267+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2932740289 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x556331edf0b0 con 0x55633213f880 2024-03-30T13:15:30.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.267+0000 7fb89b400640 1 -- 172.21.15.44:0/2932740289 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a8057ff0 con 0x55633213f880 2024-03-30T13:15:30.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.267+0000 7fb89b400640 1 -- 172.21.15.44:0/2932740289 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fb8ac014840 con 0x55633213f880 2024-03-30T13:15:30.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.267+0000 7fb8c3e3a740 10 client.6414 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:30.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.267+0000 7fb8c3e3a740 10 client.6414 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.267+0000 7fb8c3e3a740 20 client.6414 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.267+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55633215d340 0x55633216b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.267+0000 7fb8c3e3a740 4 client.6414 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.267+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2932740289 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563320ab870 con 0x55633215d340 2024-03-30T13:15:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.267+0000 7fb8b9400640 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55633215d340 0x55633216b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.268+0000 7fb8b9400640 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55633215d340 0x55633216b740 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=160450b1128a3e66 server_cookie=1dd0da647e20eec9 in_seq=0 out_seq=0 2024-03-30T13:15:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.268+0000 7fb89b400640 10 client.6414 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb89b400640 1 -- 172.21.15.44:0/2932740289 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5563320ab870 con 0x55633215d340 2024-03-30T13:15:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb89b400640 10 client.6414 handle_command_reply: tid=0 2024-03-30T13:15:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb8c3e3a740 1 client.6414 shutdown 2024-03-30T13:15:30.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2932740289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 msgr2=0x556332181f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 0x556332181f60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac017740 tx=0x7fb8ac001dd0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2932740289 shutdown_connections 2024-03-30T13:15:30.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55633215d340 0x55633216b740 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556332184fd0 0x55633216d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213fc60 0x55633213e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/2932740289 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 0x556332181f60 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb89b400640 0 client.6414 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:30.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2932740289 >> 172.21.15.44:0/2932740289 conn(0x556332101be0 msgr2=0x556332134b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2932740289 shutdown_connections 2024-03-30T13:15:30.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2932740289 wait complete. 2024-03-30T13:15:30.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.269+0000 7fb8c3e3a740 20 client.6414 trim_cache size 0 max 16384 2024-03-30T13:15:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.285+0000 7fb8c3e3a740 1 Processor -- start 2024-03-30T13:15:30.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.286+0000 7fb8c3e3a740 1 -- start start 2024-03-30T13:15:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.286+0000 7fb8c3e3a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 0x5563321827c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.286+0000 7fb8c3e3a740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213fc60 0x55633213d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.286+0000 7fb8c3e3a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556332184fd0 0x55633215c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.286+0000 7fb8c3e3a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc1fd390 con 0x55633213f880 2024-03-30T13:15:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.286+0000 7fb8c3e3a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc0b4da0 con 0x556332184fd0 2024-03-30T13:15:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.286+0000 7fb8c3e3a740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb8bc0b4100 con 0x55633213fc60 2024-03-30T13:15:30.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.287+0000 7fb8b9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 0x5563321827c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.287+0000 7fb8b9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 0x5563321827c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54432/0 (socket says 172.21.15.44:54432) 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.287+0000 7fb8b9e00640 1 -- 172.21.15.44:0/1396122143 learned_addr learned my addr 172.21.15.44:0/1396122143 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.287+0000 7fb8b9400640 1 --2- 172.21.15.44:0/1396122143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213fc60 0x55633213d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.287+0000 7fb8b9e00640 1 -- 172.21.15.44:0/1396122143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213fc60 msgr2=0x55633213d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.287+0000 7fb8ba800640 1 --2- 172.21.15.44:0/1396122143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556332184fd0 0x55633215c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.287+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/1396122143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213fc60 0x55633213d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.287+0000 7fb8b9e00640 1 -- 172.21.15.44:0/1396122143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556332184fd0 msgr2=0x55633215c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.287+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/1396122143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556332184fd0 0x55633215c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.287+0000 7fb8b9e00640 1 -- 172.21.15.44:0/1396122143 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556331d4b2d0 con 0x55633213f880 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.287+0000 7fb8b9400640 1 --2- 172.21.15.44:0/1396122143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213fc60 0x55633213d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.288+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/1396122143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 0x5563321827c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac001720 tx=0x7fb8ac01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b55bb262598e5c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.288+0000 7fb8a6000640 1 -- 172.21.15.44:0/1396122143 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac014840 con 0x55633213f880 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.288+0000 7fb8a6000640 1 -- 172.21.15.44:0/1396122143 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ac0170d0 con 0x55633213f880 2024-03-30T13:15:30.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.288+0000 7fb8a6000640 1 -- 172.21.15.44:0/1396122143 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0154c0 con 0x55633213f880 2024-03-30T13:15:30.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.288+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/1396122143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 msgr2=0x5563321827c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.288+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/1396122143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 0x5563321827c0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac001720 tx=0x7fb8ac01f000 comp rx=0 tx=0).stop 2024-03-30T13:15:30.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.289+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/1396122143 shutdown_connections 2024-03-30T13:15:30.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.289+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/1396122143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556332184fd0 0x55633215c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.289+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/1396122143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55633213fc60 0x55633213d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.289+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/1396122143 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213f880 0x5563321827c0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.289+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/1396122143 >> 172.21.15.44:0/1396122143 conn(0x556332101be0 msgr2=0x55633215d720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.289+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/1396122143 shutdown_connections 2024-03-30T13:15:30.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.289+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/1396122143 wait complete. 2024-03-30T13:15:30.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.290+0000 7fb8c3e3a740 1 -- start start 2024-03-30T13:15:30.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.290+0000 7fb8c3e3a740 1 Processor -- start 2024-03-30T13:15:30.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.292+0000 7fb8c3e3a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55633213f880 0x5563321f6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.292+0000 7fb8c3e3a740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213fc60 0x556332182470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.292+0000 7fb8c3e3a740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556332184fd0 0x55633213d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.292+0000 7fb8c3e3a740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556332184b40 con 0x55633213fc60 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.292+0000 7fb8c3e3a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb8bc0b4750 con 0x55633213f880 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.292+0000 7fb8c3e3a740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x556332166ce0 con 0x556332184fd0 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.292+0000 7fb8c3e3a740 10 client.0 _ll_register_callbacks cb 0x7fb8ac001590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.292+0000 7fb8b9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213fc60 0x556332182470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.292+0000 7fb8b9400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213fc60 0x556332182470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54446/0 (socket says 172.21.15.44:54446) 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.292+0000 7fb8b9400640 1 -- 172.21.15.44:0/2376535849 learned_addr learned my addr 172.21.15.44:0/2376535849 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.292+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55633213f880 0x5563321f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.292+0000 7fb8ba800640 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556332184fd0 0x55633213d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.293+0000 7fb8b9400640 1 -- 172.21.15.44:0/2376535849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556332184fd0 msgr2=0x55633213d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.293+0000 7fb8b9400640 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556332184fd0 0x55633213d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.293+0000 7fb8b9400640 1 -- 172.21.15.44:0/2376535849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55633213f880 msgr2=0x5563321f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.293+0000 7fb8b9400640 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55633213f880 0x5563321f6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.293+0000 7fb8b9400640 1 -- 172.21.15.44:0/2376535849 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556332203400 con 0x55633213fc60 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.293+0000 7fb8b9400640 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213fc60 0x556332182470 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8072250 tx=0x7fb8a8071000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31151211f892200 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.293+0000 7fb89b400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.293+0000 7fb89b400640 1 -- 172.21.15.44:0/2376535849 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8079080 con 0x55633213fc60 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.293+0000 7fb89b400640 1 -- 172.21.15.44:0/2376535849 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7fb8a8056360 con 0x55633213fc60 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.293+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2376535849 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8ac0170d0 con 0x55633213fc60 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.294+0000 7fb89b400640 1 -- 172.21.15.44:0/2376535849 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb8a8080050 con 0x55633213fc60 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.294+0000 7fb8c3e3a740 10 client.6420 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.294+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2376535849 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5563322041a0 con 0x55633213fc60 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.294+0000 7fb89b400640 1 -- 172.21.15.44:0/2376535849 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ac0170d0 con 0x55633213fc60 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.294+0000 7fb89b400640 1 -- 172.21.15.44:0/2376535849 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fb8a8083020 con 0x55633213fc60 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.294+0000 7fb8c3e3a740 10 client.6420 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.294+0000 7fb8c3e3a740 10 client.6420 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.294+0000 7fb8c3e3a740 20 client.6420 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.294+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55633213da40 0x5563322002d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.294+0000 7fb8c3e3a740 4 client.6420 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628417}] 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.294+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2376535849 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628417}) -- 0x5563320a5bc0 con 0x55633213da40 2024-03-30T13:15:30.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.294+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55633213da40 0x5563322002d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.295+0000 7fb8b9e00640 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55633213da40 0x5563322002d0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6575befa94c5143a server_cookie=2d7f6842d92f1e56 in_seq=0 out_seq=0 2024-03-30T13:15:30.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.295+0000 7fb89b400640 10 client.6420 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:30.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.295+0000 7fb89b400640 1 -- 172.21.15.44:0/2376535849 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4767 (crc 0 0 0) 0x5563320a5bc0 con 0x55633213da40 2024-03-30T13:15:30.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.295+0000 7fb89b400640 10 client.6420 handle_command_reply: tid=0 2024-03-30T13:15:30.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.295+0000 7fb8c3e3a740 1 client.6420 shutdown 2024-03-30T13:15:30.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.296+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2376535849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213fc60 msgr2=0x556332182470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.296+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213fc60 0x556332182470 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8072250 tx=0x7fb8a8071000 comp rx=0 tx=0).stop 2024-03-30T13:15:30.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.296+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2376535849 shutdown_connections 2024-03-30T13:15:30.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.296+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55633213da40 0x5563322002d0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.296+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556332184fd0 0x55633213d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.296+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55633213fc60 0x556332182470 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.296+0000 7fb8c3e3a740 1 --2- 172.21.15.44:0/2376535849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55633213f880 0x5563321f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.296+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2376535849 >> 172.21.15.44:0/2376535849 conn(0x556332101be0 msgr2=0x556332130b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.296+0000 7fb89b400640 0 client.6420 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:30.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.296+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2376535849 shutdown_connections 2024-03-30T13:15:30.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.296+0000 7fb8c3e3a740 1 -- 172.21.15.44:0/2376535849 wait complete. 2024-03-30T13:15:30.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.296+0000 7fb8c3e3a740 20 client.6420 trim_cache size 0 max 16384 2024-03-30T13:15:30.304 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-bufmap.h", 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628417, 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.615647+0000", 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.759530+0000", 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:30.305 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 925, 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:30.306 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.759530+0000", 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.307 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 925, 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:30.308 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.615647+0000" 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 925, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.615647+0000" 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 218, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 24, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:30.309 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:30.310 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:30.311 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:30.312 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.313 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:30.314 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.315 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:30.316 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:30.317 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:30.318 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.297+0000 7fb8bb200640 1 -- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb89c06c530 msgr2=0x7fb89c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.297+0000 7fb8bb200640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb89c06c530 0x7fb89c06e9f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac000c00 tx=0x7fb8ac009040 comp rx=0 tx=0).stop 2024-03-30T13:15:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.297+0000 7fb8bb200640 1 -- 172.21.15.44:0/1731605451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8bc148320 msgr2=0x7fb8bc1487a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.297+0000 7fb8bb200640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8bc148320 0x7fb8bc1487a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8011910 tx=0x7fb8a8011dd0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.297+0000 7fb8bb200640 1 -- 172.21.15.44:0/1731605451 shutdown_connections 2024-03-30T13:15:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.297+0000 7fb8bb200640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb89c06c530 0x7fb89c06e9f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.297+0000 7fb8bb200640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0cc9d0 0x7fb8bc0cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.297+0000 7fb8bb200640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8bc148320 0x7fb8bc1487a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.297+0000 7fb8bb200640 1 --2- 172.21.15.44:0/1731605451 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8a0005210 0x7fb8bc0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.297+0000 7fb8bb200640 1 -- 172.21.15.44:0/1731605451 >> 172.21.15.44:0/1731605451 conn(0x7fb8bc0cfd90 msgr2=0x7fb8bc0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.297+0000 7fb8bb200640 1 -- 172.21.15.44:0/1731605451 shutdown_connections 2024-03-30T13:15:30.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.297+0000 7fb8bb200640 1 -- 172.21.15.44:0/1731605451 wait complete. 2024-03-30T13:15:30.322 DEBUG:tasks.cephfs.test_uninlining:getting inode info #19 of 23:1099511628421 2024-03-30T13:15:30.322 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628421 2024-03-30T13:15:30.322 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628421 2024-03-30T13:15:30.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.523+0000 7fb1ef200640 1 Processor -- start 2024-03-30T13:15:30.529 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.523+0000 7fb1ef200640 1 -- start start 2024-03-30T13:15:30.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.525+0000 7fb1ef200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80b4920 0x7fb1e80b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.525+0000 7fb1ef200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb1e80b4d00 0x7fb1e80d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.530 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.525+0000 7fb1ef200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb1e80d0b90 0x7fb1e80d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.525+0000 7fb1ef200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e80d0260 con 0x7fb1e80b4d00 2024-03-30T13:15:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.525+0000 7fb1ef200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fb1e80b54b0 con 0x7fb1e80d0b90 2024-03-30T13:15:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.525+0000 7fb1ef200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e80cfca0 con 0x7fb1e80b4920 2024-03-30T13:15:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.525+0000 7fb1ed400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb1e80b4d00 0x7fb1e80d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.525+0000 7fb1ed400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb1e80b4d00 0x7fb1e80d4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54450/0 (socket says 172.21.15.44:54450) 2024-03-30T13:15:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.525+0000 7fb1ed400640 1 -- 172.21.15.44:0/810723093 learned_addr learned my addr 172.21.15.44:0/810723093 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.525+0000 7fb1ede00640 1 --2- 172.21.15.44:0/810723093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80b4920 0x7fb1e80b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.525+0000 7fb1ee800640 1 --2- 172.21.15.44:0/810723093 >> v2:172.21.15.151:3300/0 conn(0x7fb1e80d0b90 0x7fb1e80d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.526+0000 7fb1ed400640 1 -- 172.21.15.44:0/810723093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80b4920 msgr2=0x7fb1e80b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.526+0000 7fb1ed400640 1 --2- 172.21.15.44:0/810723093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80b4920 0x7fb1e80b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.526+0000 7fb1ed400640 1 -- 172.21.15.44:0/810723093 >> v2:172.21.15.151:3300/0 conn(0x7fb1e80d0b90 msgr2=0x7fb1e80d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.526+0000 7fb1ed400640 1 --2- 172.21.15.44:0/810723093 >> v2:172.21.15.151:3300/0 conn(0x7fb1e80d0b90 0x7fb1e80d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.526+0000 7fb1ed400640 1 -- 172.21.15.44:0/810723093 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e80cff80 con 0x7fb1e80b4d00 2024-03-30T13:15:30.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.526+0000 7fb1ede00640 1 --2- 172.21.15.44:0/810723093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80b4920 0x7fb1e80b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:30.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.526+0000 7fb1ee800640 1 --2- 172.21.15.44:0/810723093 >> v2:172.21.15.151:3300/0 conn(0x7fb1e80d0b90 0x7fb1e80d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:30.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.527+0000 7fb1ed400640 1 --2- 172.21.15.44:0/810723093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1e80b4d00 0x7fb1e80d4ac0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb1e808c940 tx=0x7fb1d802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7577bf0b3b61dc90 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.528+0000 7fb1eca00640 1 -- 172.21.15.44:0/810723093 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d802e070 con 0x7fb1e80b4d00 2024-03-30T13:15:30.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.528+0000 7fb1eca00640 1 -- 172.21.15.44:0/810723093 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d8037070 con 0x7fb1e80b4d00 2024-03-30T13:15:30.533 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.528+0000 7fb1eca00640 1 -- 172.21.15.44:0/810723093 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8031a00 con 0x7fb1e80b4d00 2024-03-30T13:15:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.529+0000 7fb1ef200640 1 -- 172.21.15.44:0/810723093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1e80b4d00 msgr2=0x7fb1e80d4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.529+0000 7fb1ef200640 1 --2- 172.21.15.44:0/810723093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1e80b4d00 0x7fb1e80d4ac0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb1e808c940 tx=0x7fb1d802b880 comp rx=0 tx=0).stop 2024-03-30T13:15:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.529+0000 7fb1ef200640 1 -- 172.21.15.44:0/810723093 shutdown_connections 2024-03-30T13:15:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.529+0000 7fb1ef200640 1 --2- 172.21.15.44:0/810723093 >> v2:172.21.15.151:3300/0 conn(0x7fb1e80d0b90 0x7fb1e80d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.529+0000 7fb1ef200640 1 --2- 172.21.15.44:0/810723093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1e80b4d00 0x7fb1e80d4ac0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.529+0000 7fb1ef200640 1 --2- 172.21.15.44:0/810723093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80b4920 0x7fb1e80b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.529+0000 7fb1ef200640 1 -- 172.21.15.44:0/810723093 >> 172.21.15.44:0/810723093 conn(0x7fb1e809d4e0 msgr2=0x7fb1e80d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.529+0000 7fb1ef200640 1 -- 172.21.15.44:0/810723093 shutdown_connections 2024-03-30T13:15:30.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.529+0000 7fb1ef200640 1 -- 172.21.15.44:0/810723093 wait complete. 2024-03-30T13:15:30.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.532+0000 7fb1ef200640 1 Processor -- start 2024-03-30T13:15:30.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.532+0000 7fb1ef200640 1 -- start start 2024-03-30T13:15:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.533+0000 7fb1ef200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1e80b4920 0x7fb1e80b8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.533+0000 7fb1ef200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1e80b4d00 0x7fb1e81525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ef200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80d0b90 0x7fb1e80b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ef200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e80b3ff0 con 0x7fb1e80b4920 2024-03-30T13:15:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ef200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e80d2180 con 0x7fb1e80b4d00 2024-03-30T13:15:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ef200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e80d5000 con 0x7fb1e80d0b90 2024-03-30T13:15:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ede00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1e80b4920 0x7fb1e80b8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ede00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1e80b4920 0x7fb1e80b8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54458/0 (socket says 172.21.15.44:54458) 2024-03-30T13:15:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ede00640 1 -- 172.21.15.44:0/780797040 learned_addr learned my addr 172.21.15.44:0/780797040 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ee800640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80d0b90 0x7fb1e80b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ed400640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1e80b4d00 0x7fb1e81525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ede00640 1 -- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80d0b90 msgr2=0x7fb1e80b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ede00640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80d0b90 0x7fb1e80b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ede00640 1 -- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1e80b4d00 msgr2=0x7fb1e81525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ede00640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1e80b4d00 0x7fb1e81525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.534+0000 7fb1ede00640 1 -- 172.21.15.44:0/780797040 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e80b9810 con 0x7fb1e80b4920 2024-03-30T13:15:30.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.535+0000 7fb1ede00640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1e80b4920 0x7fb1e80b8740 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00d800 tx=0x7fb1dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.535+0000 7fb1e2000640 1 -- 172.21.15.44:0/780797040 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc018070 con 0x7fb1e80b4920 2024-03-30T13:15:30.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.535+0000 7fb1e2000640 1 -- 172.21.15.44:0/780797040 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1dc004030 con 0x7fb1e80b4920 2024-03-30T13:15:30.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.535+0000 7fb1ef200640 1 -- 172.21.15.44:0/780797040 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e80b8f70 con 0x7fb1e80b4920 2024-03-30T13:15:30.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.535+0000 7fb1e2000640 1 -- 172.21.15.44:0/780797040 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc004400 con 0x7fb1e80b4920 2024-03-30T13:15:30.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.535+0000 7fb1ef200640 1 -- 172.21.15.44:0/780797040 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e80b9530 con 0x7fb1e80b4920 2024-03-30T13:15:30.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.538+0000 7fb1e2000640 1 -- 172.21.15.44:0/780797040 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb1dc0096a0 con 0x7fb1e80b4920 2024-03-30T13:15:30.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.539+0000 7fb1f3607740 1 Processor -- start 2024-03-30T13:15:30.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.539+0000 7fb1f3607740 1 -- start start 2024-03-30T13:15:30.544 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.539+0000 7fb1e2000640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb1cc06c560 0x7fb1cc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.539+0000 7fb1e2000640 1 -- 172.21.15.44:0/780797040 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7fb1dc08bbe0 con 0x7fb1e80b4920 2024-03-30T13:15:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.540+0000 7fb1ee800640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb1cc06c560 0x7fb1cc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.540+0000 7fb1f3607740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bb4470 0x563f26bdafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.540+0000 7fb1f3607740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bdb4e0 0x563f26bb34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.540+0000 7fb1f3607740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4850 0x563f26bb39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.540+0000 7fb1f3607740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563f26b17330 con 0x563f26bb4470 2024-03-30T13:15:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.540+0000 7fb1f3607740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563f26abf620 con 0x563f26bb4850 2024-03-30T13:15:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.540+0000 7fb1f3607740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x563f26b13440 con 0x563f26bdb4e0 2024-03-30T13:15:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.540+0000 7fb1ede00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bb4470 0x563f26bdafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.540+0000 7fb1ede00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bb4470 0x563f26bdafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54462/0 (socket says 172.21.15.44:54462) 2024-03-30T13:15:30.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.541+0000 7fb1ede00640 1 -- 172.21.15.44:0/3388827761 learned_addr learned my addr 172.21.15.44:0/3388827761 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.541+0000 7fb1ed400640 1 --2- 172.21.15.44:0/3388827761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bdb4e0 0x563f26bb34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.541+0000 7fb1ee800640 1 --2- 172.21.15.44:0/3388827761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4850 0x563f26bb39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.541+0000 7fb1ede00640 1 -- 172.21.15.44:0/3388827761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bdb4e0 msgr2=0x563f26bb34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.541+0000 7fb1ede00640 1 --2- 172.21.15.44:0/3388827761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bdb4e0 0x563f26bb34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.541+0000 7fb1ede00640 1 -- 172.21.15.44:0/3388827761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4850 msgr2=0x563f26bb39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.541+0000 7fb1ede00640 1 --2- 172.21.15.44:0/3388827761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4850 0x563f26bb39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.541+0000 7fb1ede00640 1 -- 172.21.15.44:0/3388827761 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f268f7920 con 0x563f26bb4470 2024-03-30T13:15:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.541+0000 7fb1ee800640 1 --2- 172.21.15.44:0/3388827761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4850 0x563f26bb39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:30.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.541+0000 7fb1ede00640 1 --2- 172.21.15.44:0/3388827761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bb4470 0x563f26bdafa0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc061fc0 tx=0x7fb1dc059380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfac31f2c5593f2a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.541+0000 7fb1ee800640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb1cc06c560 0x7fb1cc06ea20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4003fd0 tx=0x7fb1e4003d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.542+0000 7fb1d6600640 1 -- 172.21.15.44:0/3388827761 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc0045a0 con 0x563f26bb4470 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.542+0000 7fb1d6600640 1 -- 172.21.15.44:0/3388827761 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1dc05ee50 con 0x563f26bb4470 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.542+0000 7fb1d6600640 1 -- 172.21.15.44:0/3388827761 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc057c10 con 0x563f26bb4470 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.542+0000 7fb1f3607740 1 -- 172.21.15.44:0/3388827761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bb4470 msgr2=0x563f26bdafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.542+0000 7fb1f3607740 1 --2- 172.21.15.44:0/3388827761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bb4470 0x563f26bdafa0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc061fc0 tx=0x7fb1dc059380 comp rx=0 tx=0).stop 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.542+0000 7fb1f3607740 1 -- 172.21.15.44:0/3388827761 shutdown_connections 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.542+0000 7fb1f3607740 1 --2- 172.21.15.44:0/3388827761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4850 0x563f26bb39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.542+0000 7fb1f3607740 1 --2- 172.21.15.44:0/3388827761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bdb4e0 0x563f26bb34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.542+0000 7fb1f3607740 1 --2- 172.21.15.44:0/3388827761 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bb4470 0x563f26bdafa0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.542+0000 7fb1f3607740 1 -- 172.21.15.44:0/3388827761 >> 172.21.15.44:0/3388827761 conn(0x563f26b7abe0 msgr2=0x563f26bf9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.542+0000 7fb1f3607740 1 -- 172.21.15.44:0/3388827761 shutdown_connections 2024-03-30T13:15:30.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.542+0000 7fb1f3607740 1 -- 172.21.15.44:0/3388827761 wait complete. 2024-03-30T13:15:30.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.544+0000 7fb1f3607740 1 -- start start 2024-03-30T13:15:30.550 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.544+0000 7fb1f3607740 1 Processor -- start 2024-03-30T13:15:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1f3607740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4470 0x563f26bd3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1f3607740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4850 0x563f26bd4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1f3607740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26bde4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1f3607740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563f26bdab10 con 0x563f26bde040 2024-03-30T13:15:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1f3607740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563f26ad29d0 con 0x563f26bb4470 2024-03-30T13:15:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1f3607740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x563f26bd3890 con 0x563f26bb4850 2024-03-30T13:15:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1f3607740 10 client.0 _ll_register_callbacks cb 0x563f26b0efd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1ee800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26bde4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1ee800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26bde4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54470/0 (socket says 172.21.15.44:54470) 2024-03-30T13:15:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1ee800640 1 -- 172.21.15.44:0/1889352300 learned_addr learned my addr 172.21.15.44:0/1889352300 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.552 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1ede00640 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4470 0x563f26bd3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1ed400640 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4850 0x563f26bd4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1ee800640 1 -- 172.21.15.44:0/1889352300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4850 msgr2=0x563f26bd4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1ee800640 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4850 0x563f26bd4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1ee800640 1 -- 172.21.15.44:0/1889352300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4470 msgr2=0x563f26bd3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1ee800640 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4470 0x563f26bd3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.546+0000 7fb1ee800640 1 -- 172.21.15.44:0/1889352300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f267eb210 con 0x563f26bde040 2024-03-30T13:15:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.547+0000 7fb1ee800640 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26bde4c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4018be0 tx=0x7fb1e4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60017c0e8320cca server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.547+0000 7fb1caa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.547+0000 7fb1caa00640 1 -- 172.21.15.44:0/1889352300 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4028060 con 0x563f26bde040 2024-03-30T13:15:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.547+0000 7fb1caa00640 1 -- 172.21.15.44:0/1889352300 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7fb1e4016b40 con 0x563f26bde040 2024-03-30T13:15:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.547+0000 7fb1f3607740 1 -- 172.21.15.44:0/1889352300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1dc05ee50 con 0x563f26bde040 2024-03-30T13:15:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.548+0000 7fb1caa00640 1 -- 172.21.15.44:0/1889352300 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb1e4012040 con 0x563f26bde040 2024-03-30T13:15:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.548+0000 7fb1f3607740 10 client.6432 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.548+0000 7fb1f3607740 1 -- 172.21.15.44:0/1889352300 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x563f269580b0 con 0x563f26bde040 2024-03-30T13:15:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.548+0000 7fb1caa00640 1 -- 172.21.15.44:0/1889352300 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1dc05ee50 con 0x563f26bde040 2024-03-30T13:15:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.548+0000 7fb1caa00640 1 -- 172.21.15.44:0/1889352300 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fb1e4031080 con 0x563f26bde040 2024-03-30T13:15:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.548+0000 7fb1f3607740 10 client.6432 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.548+0000 7fb1f3607740 10 client.6432 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.548+0000 7fb1f3607740 20 client.6432 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:30.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.548+0000 7fb1f3607740 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563f26be11e0 0x563f26be1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.548+0000 7fb1f3607740 4 client.6432 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.548+0000 7fb1f3607740 1 -- 172.21.15.44:0/1889352300 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f26b24870 con 0x563f26be11e0 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.549+0000 7fb1ede00640 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563f26be11e0 0x563f26be1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.549+0000 7fb1ede00640 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563f26be11e0 0x563f26be1650 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4cc030c688bb1e1 server_cookie=9609e969f1511c16 in_seq=0 out_seq=0 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.549+0000 7fb1caa00640 10 client.6432 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1caa00640 1 -- 172.21.15.44:0/1889352300 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x563f26b24870 con 0x563f26be11e0 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1caa00640 10 client.6432 handle_command_reply: tid=0 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1f3607740 1 client.6432 shutdown 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1f3607740 1 -- 172.21.15.44:0/1889352300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 msgr2=0x563f26bde4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1f3607740 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26bde4c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4018be0 tx=0x7fb1e4004ab0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1f3607740 1 -- 172.21.15.44:0/1889352300 shutdown_connections 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1f3607740 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563f26be11e0 0x563f26be1650 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1f3607740 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26bde4c0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1f3607740 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4850 0x563f26bd4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1caa00640 0 client.6432 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:30.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1f3607740 1 --2- 172.21.15.44:0/1889352300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4470 0x563f26bd3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1f3607740 1 -- 172.21.15.44:0/1889352300 >> 172.21.15.44:0/1889352300 conn(0x563f26b7abe0 msgr2=0x563f26bda340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1f3607740 1 -- 172.21.15.44:0/1889352300 shutdown_connections 2024-03-30T13:15:30.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.550+0000 7fb1f3607740 1 -- 172.21.15.44:0/1889352300 wait complete. 2024-03-30T13:15:30.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.551+0000 7fb1f3607740 20 client.6432 trim_cache size 0 max 16384 2024-03-30T13:15:30.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.567+0000 7fb1f3607740 1 Processor -- start 2024-03-30T13:15:30.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.567+0000 7fb1f3607740 1 -- start start 2024-03-30T13:15:30.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1f3607740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4470 0x563f26bf93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1f3607740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4850 0x563f26bb1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1f3607740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26bb2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1f3607740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e82011f0 con 0x563f26bde040 2024-03-30T13:15:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1f3607740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e8200270 con 0x563f26bb4470 2024-03-30T13:15:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1f3607740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb1e80cc5c0 con 0x563f26bb4850 2024-03-30T13:15:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1ee800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26bb2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1ee800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26bb2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54486/0 (socket says 172.21.15.44:54486) 2024-03-30T13:15:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1ee800640 1 -- 172.21.15.44:0/4016259215 learned_addr learned my addr 172.21.15.44:0/4016259215 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1ee800640 1 -- 172.21.15.44:0/4016259215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4850 msgr2=0x563f26bb1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1ee800640 1 --2- 172.21.15.44:0/4016259215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4850 0x563f26bb1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1ee800640 1 -- 172.21.15.44:0/4016259215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4470 msgr2=0x563f26bf93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1ee800640 1 --2- 172.21.15.44:0/4016259215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4470 0x563f26bf93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.568+0000 7fb1ee800640 1 -- 172.21.15.44:0/4016259215 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f267c42d0 con 0x563f26bde040 2024-03-30T13:15:30.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.569+0000 7fb1ee800640 1 --2- 172.21.15.44:0/4016259215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26bb2420 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40099b0 tx=0x7fb1e4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d0a9a7dd23b759 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.569+0000 7fb1d5c00640 1 -- 172.21.15.44:0/4016259215 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4016990 con 0x563f26bde040 2024-03-30T13:15:30.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.569+0000 7fb1d5c00640 1 -- 172.21.15.44:0/4016259215 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e4016b30 con 0x563f26bde040 2024-03-30T13:15:30.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.569+0000 7fb1d5c00640 1 -- 172.21.15.44:0/4016259215 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4038410 con 0x563f26bde040 2024-03-30T13:15:30.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.570+0000 7fb1f3607740 1 -- 172.21.15.44:0/4016259215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 msgr2=0x563f26bb2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.570+0000 7fb1f3607740 1 --2- 172.21.15.44:0/4016259215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26bb2420 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40099b0 tx=0x7fb1e4021000 comp rx=0 tx=0).stop 2024-03-30T13:15:30.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.570+0000 7fb1f3607740 1 -- 172.21.15.44:0/4016259215 shutdown_connections 2024-03-30T13:15:30.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.570+0000 7fb1f3607740 1 --2- 172.21.15.44:0/4016259215 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26bb2420 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.570+0000 7fb1f3607740 1 --2- 172.21.15.44:0/4016259215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4850 0x563f26bb1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.570+0000 7fb1f3607740 1 --2- 172.21.15.44:0/4016259215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4470 0x563f26bf93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.570+0000 7fb1f3607740 1 -- 172.21.15.44:0/4016259215 >> 172.21.15.44:0/4016259215 conn(0x563f26b7abe0 msgr2=0x563f26bb30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.570+0000 7fb1f3607740 1 -- 172.21.15.44:0/4016259215 shutdown_connections 2024-03-30T13:15:30.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.570+0000 7fb1f3607740 1 -- 172.21.15.44:0/4016259215 wait complete. 2024-03-30T13:15:30.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.571+0000 7fb1f3607740 1 -- start start 2024-03-30T13:15:30.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.571+0000 7fb1f3607740 1 Processor -- start 2024-03-30T13:15:30.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.572+0000 7fb1f3607740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4470 0x563f26bfc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.572+0000 7fb1f3607740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4850 0x563f26bf8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.572+0000 7fb1f3607740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26c1c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.572+0000 7fb1f3607740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563f26bdb150 con 0x563f26bde040 2024-03-30T13:15:30.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.572+0000 7fb1f3607740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e81ffd70 con 0x563f26bb4850 2024-03-30T13:15:30.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.572+0000 7fb1f3607740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x563f26bdf420 con 0x563f26bb4470 2024-03-30T13:15:30.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.572+0000 7fb1f3607740 10 client.0 _ll_register_callbacks cb 0x7fb1e4003b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:30.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.572+0000 7fb1ee800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26c1c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.572+0000 7fb1ee800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26c1c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54498/0 (socket says 172.21.15.44:54498) 2024-03-30T13:15:30.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.572+0000 7fb1ee800640 1 -- 172.21.15.44:0/1840796544 learned_addr learned my addr 172.21.15.44:0/1840796544 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.572+0000 7fb1ede00640 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4470 0x563f26bfc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.572+0000 7fb1ed400640 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4850 0x563f26bf8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.573+0000 7fb1ee800640 1 -- 172.21.15.44:0/1840796544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4470 msgr2=0x563f26bfc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.573+0000 7fb1ee800640 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4470 0x563f26bfc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.573+0000 7fb1ee800640 1 -- 172.21.15.44:0/1840796544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4850 msgr2=0x563f26bf8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.573+0000 7fb1ee800640 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4850 0x563f26bf8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.573+0000 7fb1ee800640 1 -- 172.21.15.44:0/1840796544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f26bfca60 con 0x563f26bde040 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.573+0000 7fb1ed400640 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4850 0x563f26bf8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.573+0000 7fb1ee800640 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26c1c5f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009540 tx=0x7fb1e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92aa0df16a4cfe4b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.573+0000 7fb1caa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.573+0000 7fb1caa00640 1 -- 172.21.15.44:0/1840796544 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4046060 con 0x563f26bde040 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.573+0000 7fb1caa00640 1 -- 172.21.15.44:0/1840796544 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 6202+0+0 (secure 0 0 0) 0x7fb1e4038950 con 0x563f26bde040 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.573+0000 7fb1f3607740 1 -- 172.21.15.44:0/1840796544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1e4016b30 con 0x563f26bde040 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.573+0000 7fb1caa00640 1 -- 172.21.15.44:0/1840796544 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fb1e4038b50 con 0x563f26bde040 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.574+0000 7fb1f3607740 10 client.6438 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.574+0000 7fb1f3607740 1 -- 172.21.15.44:0/1840796544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x563f26c0c1d0 con 0x563f26bde040 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.574+0000 7fb1caa00640 1 -- 172.21.15.44:0/1840796544 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e4016b30 con 0x563f26bde040 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.574+0000 7fb1caa00640 1 -- 172.21.15.44:0/1840796544 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fb1e4031040 con 0x563f26bde040 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.574+0000 7fb1f3607740 10 client.6438 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.574+0000 7fb1f3607740 10 client.6438 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:30.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.574+0000 7fb1f3607740 20 client.6438 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.574+0000 7fb1f3607740 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563f26c08a20 0x563f26beeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.574+0000 7fb1f3607740 4 client.6438 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628421}] 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.574+0000 7fb1f3607740 1 -- 172.21.15.44:0/1840796544 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628421}) -- 0x563f26b1ebc0 con 0x563f26c08a20 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.574+0000 7fb1ede00640 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563f26c08a20 0x563f26beeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.575+0000 7fb1ede00640 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563f26c08a20 0x563f26beeb20 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=554b3928a5ff9d4b server_cookie=35e1abaa8e14995a in_seq=0 out_seq=0 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.575+0000 7fb1caa00640 10 client.6438 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.575+0000 7fb1caa00640 1 -- 172.21.15.44:0/1840796544 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4768 (crc 0 0 0) 0x563f26b1ebc0 con 0x563f26c08a20 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.575+0000 7fb1caa00640 10 client.6438 handle_command_reply: tid=0 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.575+0000 7fb1f3607740 1 client.6438 shutdown 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.575+0000 7fb1f3607740 1 -- 172.21.15.44:0/1840796544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 msgr2=0x563f26c1c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.575+0000 7fb1f3607740 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26c1c5f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4009540 tx=0x7fb1e4018000 comp rx=0 tx=0).stop 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.576+0000 7fb1f3607740 1 -- 172.21.15.44:0/1840796544 shutdown_connections 2024-03-30T13:15:30.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.576+0000 7fb1f3607740 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x563f26c08a20 0x563f26beeb20 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.576+0000 7fb1f3607740 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563f26bde040 0x563f26c1c5f0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.576+0000 7fb1f3607740 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563f26bb4850 0x563f26bf8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.576+0000 7fb1f3607740 1 --2- 172.21.15.44:0/1840796544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563f26bb4470 0x563f26bfc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.576+0000 7fb1f3607740 1 -- 172.21.15.44:0/1840796544 >> 172.21.15.44:0/1840796544 conn(0x563f26b7abe0 msgr2=0x563f26bb3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.576+0000 7fb1caa00640 0 client.6438 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:30.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.576+0000 7fb1f3607740 1 -- 172.21.15.44:0/1840796544 shutdown_connections 2024-03-30T13:15:30.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.576+0000 7fb1f3607740 1 -- 172.21.15.44:0/1840796544 wait complete. 2024-03-30T13:15:30.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.576+0000 7fb1f3607740 20 client.6438 trim_cache size 0 max 16384 2024-03-30T13:15:30.586 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:30.586 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-debugfs.h", 2024-03-30T13:15:30.586 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628421, 2024-03-30T13:15:30.586 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:30.586 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.645061+0000", 2024-03-30T13:15:30.586 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.768530+0000", 2024-03-30T13:15:30.586 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:30.586 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:30.586 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:30.586 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:30.587 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 311, 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.768530+0000", 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:30.588 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:30.589 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 311, 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.645061+0000" 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 311, 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:30.590 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.645061+0000" 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 252, 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 32, 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.591 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:30.592 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:30.593 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.594 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.595 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.596 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.597 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:30.598 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.599 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.599 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.599 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.599 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.599 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.599 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:30.599 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:30.599 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:30.599 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:30.599 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:30.599 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.599 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:30.600 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:30.600 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:30.600 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:30.600 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:30.600 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:30.600 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:30.600 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:30.600 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.600 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:30.600 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:30.600 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:30.601 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:30.601 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:30.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.576+0000 7fb1ef200640 1 -- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb1cc06c560 msgr2=0x7fb1cc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.576+0000 7fb1ef200640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb1cc06c560 0x7fb1cc06ea20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4003fd0 tx=0x7fb1e4003d40 comp rx=0 tx=0).stop 2024-03-30T13:15:30.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.577+0000 7fb1ef200640 1 -- 172.21.15.44:0/780797040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1e80b4920 msgr2=0x7fb1e80b8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.577+0000 7fb1ef200640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1e80b4920 0x7fb1e80b8740 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00d800 tx=0x7fb1dc00dcc0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.577+0000 7fb1ef200640 1 -- 172.21.15.44:0/780797040 shutdown_connections 2024-03-30T13:15:30.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.577+0000 7fb1ef200640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80d0b90 0x7fb1e80b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.577+0000 7fb1ef200640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb1cc06c560 0x7fb1cc06ea20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.577+0000 7fb1ef200640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1e80b4d00 0x7fb1e81525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.577+0000 7fb1ef200640 1 --2- 172.21.15.44:0/780797040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1e80b4920 0x7fb1e80b8740 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.577+0000 7fb1ef200640 1 -- 172.21.15.44:0/780797040 >> 172.21.15.44:0/780797040 conn(0x7fb1e809d4e0 msgr2=0x7fb1e80d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.577+0000 7fb1ef200640 1 -- 172.21.15.44:0/780797040 shutdown_connections 2024-03-30T13:15:30.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.577+0000 7fb1ef200640 1 -- 172.21.15.44:0/780797040 wait complete. 2024-03-30T13:15:30.604 DEBUG:tasks.cephfs.test_uninlining:getting inode info #20 of 23:1099511628422 2024-03-30T13:15:30.604 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628422 2024-03-30T13:15:30.604 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628422 2024-03-30T13:15:30.715 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:15:30.721 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:15:30.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.810+0000 7fd3cac00640 1 Processor -- start 2024-03-30T13:15:30.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.810+0000 7fd3cac00640 1 -- start start 2024-03-30T13:15:30.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.813+0000 7fd3cac00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd3c4158d10 0x7fd3c40b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.813+0000 7fd3cac00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd3c415f560 0x7fd3c406fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.813+0000 7fd3cac00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3c40b52d0 con 0x7fd3c40b4d50 2024-03-30T13:15:30.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.813+0000 7fd3cac00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c40b5890 con 0x7fd3c415f560 2024-03-30T13:15:30.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.813+0000 7fd3cac00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c406f720 con 0x7fd3c4158d10 2024-03-30T13:15:30.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.813+0000 7fd3c8e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd3c40b4d50 0x7fd3c415ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43014/0 (socket says 172.21.15.44:43014) 2024-03-30T13:15:30.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.813+0000 7fd3c8e00640 1 -- 172.21.15.44:0/2633021107 learned_addr learned my addr 172.21.15.44:0/2633021107 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:30.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.814+0000 7fd3ca200640 1 --2- 172.21.15.44:0/2633021107 >> v2:172.21.15.44:3300/0 conn(0x7fd3c415f560 0x7fd3c406fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.814+0000 7fd3c9800640 1 --2- 172.21.15.44:0/2633021107 >> v2:172.21.15.151:3300/0 conn(0x7fd3c4158d10 0x7fd3c40b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.814+0000 7fd3c3e00640 1 -- 172.21.15.44:0/2633021107 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961812074 0 0) 0x7fd3c40b52d0 con 0x7fd3c40b4d50 2024-03-30T13:15:30.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.814+0000 7fd3ca200640 1 -- 172.21.15.44:0/2633021107 >> v2:172.21.15.151:3300/0 conn(0x7fd3c4158d10 msgr2=0x7fd3c40b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.814+0000 7fd3ca200640 1 --2- 172.21.15.44:0/2633021107 >> v2:172.21.15.151:3300/0 conn(0x7fd3c4158d10 0x7fd3c40b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.814+0000 7fd3ca200640 1 -- 172.21.15.44:0/2633021107 >> v1:172.21.15.44:6789/0 conn(0x7fd3c40b4d50 legacy=0x7fd3c415ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.814+0000 7fd3ca200640 1 -- 172.21.15.44:0/2633021107 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c40b55b0 con 0x7fd3c415f560 2024-03-30T13:15:30.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.815+0000 7fd3ca200640 1 --2- 172.21.15.44:0/2633021107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3c415f560 0x7fd3c406fbb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00be30 tx=0x7fd3bc0092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e71d106eadf5eae server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.816+0000 7fd3c3e00640 1 -- 172.21.15.44:0/2633021107 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc02c840 con 0x7fd3c415f560 2024-03-30T13:15:30.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.816+0000 7fd3c3e00640 1 -- 172.21.15.44:0/2633021107 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3bc02c9e0 con 0x7fd3c415f560 2024-03-30T13:15:30.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.816+0000 7fd3c3e00640 1 -- 172.21.15.44:0/2633021107 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc02cdd0 con 0x7fd3c415f560 2024-03-30T13:15:30.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.816+0000 7fd3cac00640 1 -- 172.21.15.44:0/2633021107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3c415f560 msgr2=0x7fd3c406fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.816+0000 7fd3cac00640 1 --2- 172.21.15.44:0/2633021107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3c415f560 0x7fd3c406fbb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00be30 tx=0x7fd3bc0092f0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.816+0000 7fd3cac00640 1 -- 172.21.15.44:0/2633021107 shutdown_connections 2024-03-30T13:15:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.816+0000 7fd3cac00640 1 --2- 172.21.15.44:0/2633021107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3c415f560 0x7fd3c406fbb0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.816+0000 7fd3cac00640 1 --2- 172.21.15.44:0/2633021107 >> v2:172.21.15.151:3300/0 conn(0x7fd3c4158d10 0x7fd3c40b4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.816+0000 7fd3cac00640 1 -- 172.21.15.44:0/2633021107 >> 172.21.15.44:0/2633021107 conn(0x7fd3c40d0ed0 msgr2=0x7fd3c40d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.817+0000 7fd3cac00640 1 -- 172.21.15.44:0/2633021107 shutdown_connections 2024-03-30T13:15:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.817+0000 7fd3cac00640 1 -- 172.21.15.44:0/2633021107 wait complete. 2024-03-30T13:15:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.818+0000 7fd3cac00640 1 Processor -- start 2024-03-30T13:15:30.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.818+0000 7fd3cac00640 1 -- start start 2024-03-30T13:15:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.820+0000 7fd3cac00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3c40b4d50 0x7fd3c4153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.820+0000 7fd3cac00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3c4158d10 0x7fd3c414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.820+0000 7fd3cac00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3c415f560 0x7fd3c41f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.820+0000 7fd3cac00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41590f0 con 0x7fd3c4158d10 2024-03-30T13:15:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.820+0000 7fd3cac00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c415fc10 con 0x7fd3c40b4d50 2024-03-30T13:15:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.820+0000 7fd3cac00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c4159270 con 0x7fd3c415f560 2024-03-30T13:15:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.820+0000 7fd3c8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3c4158d10 0x7fd3c414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.820+0000 7fd3c8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3c4158d10 0x7fd3c414fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54506/0 (socket says 172.21.15.44:54506) 2024-03-30T13:15:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.820+0000 7fd3c8e00640 1 -- 172.21.15.44:0/1886858094 learned_addr learned my addr 172.21.15.44:0/1886858094 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.821+0000 7fd3c9800640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3c40b4d50 0x7fd3c4153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.821+0000 7fd3ca200640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3c415f560 0x7fd3c41f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.821+0000 7fd3c8e00640 1 -- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3c415f560 msgr2=0x7fd3c41f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.821+0000 7fd3c8e00640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3c415f560 0x7fd3c41f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.821+0000 7fd3c8e00640 1 -- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3c40b4d50 msgr2=0x7fd3c4153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.821+0000 7fd3c8e00640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3c40b4d50 0x7fd3c4153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.821+0000 7fd3c8e00640 1 -- 172.21.15.44:0/1886858094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c4150d70 con 0x7fd3c4158d10 2024-03-30T13:15:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.821+0000 7fd3c8e00640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3c4158d10 0x7fd3c414fcc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000c4d0 tx=0x7fd3b000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.821+0000 7fd3c1600640 1 -- 172.21.15.44:0/1886858094 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0018070 con 0x7fd3c4158d10 2024-03-30T13:15:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.822+0000 7fd3c1600640 1 -- 172.21.15.44:0/1886858094 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b0007500 con 0x7fd3c4158d10 2024-03-30T13:15:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.822+0000 7fd3c1600640 1 -- 172.21.15.44:0/1886858094 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0004a20 con 0x7fd3c4158d10 2024-03-30T13:15:30.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.822+0000 7fd3cac00640 1 -- 172.21.15.44:0/1886858094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c4151050 con 0x7fd3c4158d10 2024-03-30T13:15:30.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.822+0000 7fd3cac00640 1 -- 172.21.15.44:0/1886858094 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c4151610 con 0x7fd3c4158d10 2024-03-30T13:15:30.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.825+0000 7fd3c1600640 1 -- 172.21.15.44:0/1886858094 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd3b0004bc0 con 0x7fd3c4158d10 2024-03-30T13:15:30.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.826+0000 7fd3cee1b740 1 Processor -- start 2024-03-30T13:15:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.826+0000 7fd3cee1b740 1 -- start start 2024-03-30T13:15:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.826+0000 7fd3c1600640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd3a406c530 0x7fd3a406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.826+0000 7fd3c1600640 1 -- 172.21.15.44:0/1886858094 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fd3b008abb0 con 0x7fd3c4158d10 2024-03-30T13:15:30.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.827+0000 7fd3ca200640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd3a406c530 0x7fd3a406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.827+0000 7fd3cee1b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8470 0x55ac5b6cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.827+0000 7fd3cee1b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6cf4e0 0x55ac5b6a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.827+0000 7fd3cee1b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8850 0x55ac5b6a79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.827+0000 7fd3cee1b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ac5b60b330 con 0x55ac5b6cf4e0 2024-03-30T13:15:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.827+0000 7fd3cee1b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ac5b5b3620 con 0x55ac5b6a8470 2024-03-30T13:15:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.827+0000 7fd3cee1b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55ac5b607440 con 0x55ac5b6a8850 2024-03-30T13:15:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.827+0000 7fd3c8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6cf4e0 0x55ac5b6a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.827+0000 7fd3c8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6cf4e0 0x55ac5b6a74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54508/0 (socket says 172.21.15.44:54508) 2024-03-30T13:15:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.827+0000 7fd3c8e00640 1 -- 172.21.15.44:0/3339656986 learned_addr learned my addr 172.21.15.44:0/3339656986 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.827+0000 7fd3c9800640 1 --2- 172.21.15.44:0/3339656986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8470 0x55ac5b6cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.828+0000 7fd3ca200640 1 --2- 172.21.15.44:0/3339656986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8850 0x55ac5b6a79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.828+0000 7fd3c8e00640 1 -- 172.21.15.44:0/3339656986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8850 msgr2=0x55ac5b6a79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.828+0000 7fd3c8e00640 1 --2- 172.21.15.44:0/3339656986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8850 0x55ac5b6a79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.828+0000 7fd3c8e00640 1 -- 172.21.15.44:0/3339656986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8470 msgr2=0x55ac5b6cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.828+0000 7fd3c8e00640 1 --2- 172.21.15.44:0/3339656986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8470 0x55ac5b6cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.828+0000 7fd3c8e00640 1 -- 172.21.15.44:0/3339656986 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac5b3eb920 con 0x55ac5b6cf4e0 2024-03-30T13:15:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.828+0000 7fd3ca200640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd3a406c530 0x7fd3a406e9f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc035000 tx=0x7fd3bc02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.828+0000 7fd3c8e00640 1 --2- 172.21.15.44:0/3339656986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6cf4e0 0x55ac5b6a74b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00077e0 tx=0x7fd3b00589e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51948ee49a3e765 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.828+0000 7fd3b6000640 1 -- 172.21.15.44:0/3339656986 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0056c20 con 0x55ac5b6cf4e0 2024-03-30T13:15:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.828+0000 7fd3b6000640 1 -- 172.21.15.44:0/3339656986 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b005f020 con 0x55ac5b6cf4e0 2024-03-30T13:15:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.828+0000 7fd3b6000640 1 -- 172.21.15.44:0/3339656986 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0059ba0 con 0x55ac5b6cf4e0 2024-03-30T13:15:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.829+0000 7fd3cee1b740 1 -- 172.21.15.44:0/3339656986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6cf4e0 msgr2=0x55ac5b6a74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.829+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/3339656986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6cf4e0 0x55ac5b6a74b0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd3b00077e0 tx=0x7fd3b00589e0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.829+0000 7fd3cee1b740 1 -- 172.21.15.44:0/3339656986 shutdown_connections 2024-03-30T13:15:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.829+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/3339656986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8850 0x55ac5b6a79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.829+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/3339656986 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6cf4e0 0x55ac5b6a74b0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.829+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/3339656986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8470 0x55ac5b6cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.829+0000 7fd3cee1b740 1 -- 172.21.15.44:0/3339656986 >> 172.21.15.44:0/3339656986 conn(0x55ac5b66ebe0 msgr2=0x55ac5b6ed190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.829+0000 7fd3cee1b740 1 -- 172.21.15.44:0/3339656986 shutdown_connections 2024-03-30T13:15:30.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.829+0000 7fd3cee1b740 1 -- 172.21.15.44:0/3339656986 wait complete. 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.830+0000 7fd3cee1b740 1 -- start start 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.830+0000 7fd3cee1b740 1 Processor -- start 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.831+0000 7fd3cee1b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8470 0x55ac5b6e6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.831+0000 7fd3cee1b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8850 0x55ac5b6c6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.831+0000 7fd3cee1b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 0x55ac5b6e9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.831+0000 7fd3cee1b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ac5b6ceb10 con 0x55ac5b6c67a0 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.831+0000 7fd3cee1b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ac5b5c69d0 con 0x55ac5b6a8850 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.831+0000 7fd3cee1b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55ac5b6c7890 con 0x55ac5b6a8470 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.831+0000 7fd3cee1b740 10 client.0 _ll_register_callbacks cb 0x55ac5b602fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.831+0000 7fd3ca200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 0x55ac5b6e9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.832+0000 7fd3ca200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 0x55ac5b6e9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54512/0 (socket says 172.21.15.44:54512) 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.832+0000 7fd3ca200640 1 -- 172.21.15.44:0/845661106 learned_addr learned my addr 172.21.15.44:0/845661106 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.832+0000 7fd3c9800640 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8470 0x55ac5b6e6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.832+0000 7fd3c8e00640 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8850 0x55ac5b6c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.832+0000 7fd3ca200640 1 -- 172.21.15.44:0/845661106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8470 msgr2=0x55ac5b6e6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.832+0000 7fd3ca200640 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8470 0x55ac5b6e6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.832+0000 7fd3ca200640 1 -- 172.21.15.44:0/845661106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8850 msgr2=0x55ac5b6c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.832+0000 7fd3ca200640 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8850 0x55ac5b6c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.832+0000 7fd3ca200640 1 -- 172.21.15.44:0/845661106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac5b2df210 con 0x55ac5b6c67a0 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.833+0000 7fd3ca200640 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 0x55ac5b6e9ae0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00bf20 tx=0x7fd3bc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ba119c12cf58dd server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.833+0000 7fd3aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.833+0000 7fd3aaa00640 1 -- 172.21.15.44:0/845661106 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc041d70 con 0x55ac5b6c67a0 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.833+0000 7fd3aaa00640 1 -- 172.21.15.44:0/845661106 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fd3bc04c470 con 0x55ac5b6c67a0 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.833+0000 7fd3cee1b740 1 -- 172.21.15.44:0/845661106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3b005f020 con 0x55ac5b6c67a0 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.833+0000 7fd3aaa00640 1 -- 172.21.15.44:0/845661106 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd3bc04c670 con 0x55ac5b6c67a0 2024-03-30T13:15:30.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.833+0000 7fd3cee1b740 10 client.6453 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.833+0000 7fd3cee1b740 1 -- 172.21.15.44:0/845661106 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55ac5b44c0b0 con 0x55ac5b6c67a0 2024-03-30T13:15:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.834+0000 7fd3aaa00640 1 -- 172.21.15.44:0/845661106 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b005f020 con 0x55ac5b6c67a0 2024-03-30T13:15:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.834+0000 7fd3aaa00640 1 -- 172.21.15.44:0/845661106 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fd3bc05c020 con 0x55ac5b6c67a0 2024-03-30T13:15:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.834+0000 7fd3cee1b740 10 client.6453 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.834+0000 7fd3cee1b740 10 client.6453 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.834+0000 7fd3cee1b740 20 client.6453 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.834+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ac5b6e4310 0x55ac5b6e46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.834+0000 7fd3cee1b740 4 client.6453 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.834+0000 7fd3cee1b740 1 -- 172.21.15.44:0/845661106 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac5b618870 con 0x55ac5b6e4310 2024-03-30T13:15:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.834+0000 7fd3c9800640 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ac5b6e4310 0x55ac5b6e46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.835+0000 7fd3c9800640 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ac5b6e4310 0x55ac5b6e46f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0a7458ae8f3a1b2 server_cookie=bbf0d0810e511642 in_seq=0 out_seq=0 2024-03-30T13:15:30.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.835+0000 7fd3aaa00640 10 client.6453 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:30.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3aaa00640 1 -- 172.21.15.44:0/845661106 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55ac5b618870 con 0x55ac5b6e4310 2024-03-30T13:15:30.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3aaa00640 10 client.6453 handle_command_reply: tid=0 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3cee1b740 1 client.6453 shutdown 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3cee1b740 1 -- 172.21.15.44:0/845661106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 msgr2=0x55ac5b6e9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 0x55ac5b6e9ae0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00bf20 tx=0x7fd3bc004ab0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3cee1b740 1 -- 172.21.15.44:0/845661106 shutdown_connections 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ac5b6e4310 0x55ac5b6e46f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 0x55ac5b6e9ae0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8850 0x55ac5b6c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/845661106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8470 0x55ac5b6e6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3cee1b740 1 -- 172.21.15.44:0/845661106 >> 172.21.15.44:0/845661106 conn(0x55ac5b66ebe0 msgr2=0x55ac5b6a1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3aaa00640 0 client.6453 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3cee1b740 1 -- 172.21.15.44:0/845661106 shutdown_connections 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3cee1b740 1 -- 172.21.15.44:0/845661106 wait complete. 2024-03-30T13:15:30.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.836+0000 7fd3cee1b740 20 client.6453 trim_cache size 0 max 16384 2024-03-30T13:15:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.852+0000 7fd3cee1b740 1 Processor -- start 2024-03-30T13:15:30.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.853+0000 7fd3cee1b740 1 -- start start 2024-03-30T13:15:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.853+0000 7fd3cee1b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8470 0x55ac5b6f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.853+0000 7fd3cee1b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8850 0x55ac5b6a1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.853+0000 7fd3cee1b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 0x55ac5b6a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.853+0000 7fd3cee1b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41fc890 con 0x55ac5b6c67a0 2024-03-30T13:15:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.853+0000 7fd3cee1b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41effe0 con 0x55ac5b6a8850 2024-03-30T13:15:30.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.853+0000 7fd3cee1b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c4159d80 con 0x55ac5b6a8470 2024-03-30T13:15:30.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.854+0000 7fd3ca200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 0x55ac5b6a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.854+0000 7fd3ca200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 0x55ac5b6a1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54522/0 (socket says 172.21.15.44:54522) 2024-03-30T13:15:30.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.854+0000 7fd3ca200640 1 -- 172.21.15.44:0/2052409189 learned_addr learned my addr 172.21.15.44:0/2052409189 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.854+0000 7fd3c8e00640 1 --2- 172.21.15.44:0/2052409189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8850 0x55ac5b6a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.854+0000 7fd3c9800640 1 --2- 172.21.15.44:0/2052409189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8470 0x55ac5b6f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.854+0000 7fd3ca200640 1 -- 172.21.15.44:0/2052409189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8470 msgr2=0x55ac5b6f0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.854+0000 7fd3ca200640 1 --2- 172.21.15.44:0/2052409189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8470 0x55ac5b6f0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.854+0000 7fd3ca200640 1 -- 172.21.15.44:0/2052409189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8850 msgr2=0x55ac5b6a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.854+0000 7fd3ca200640 1 --2- 172.21.15.44:0/2052409189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8850 0x55ac5b6a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.854+0000 7fd3ca200640 1 -- 172.21.15.44:0/2052409189 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac5b2b82d0 con 0x55ac5b6c67a0 2024-03-30T13:15:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.854+0000 7fd3c9800640 1 --2- 172.21.15.44:0/2052409189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8470 0x55ac5b6f0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.855+0000 7fd3ca200640 1 --2- 172.21.15.44:0/2052409189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 0x55ac5b6a1b60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00b530 tx=0x7fd3bc04a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16321110096050f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.855+0000 7fd3b5600640 1 -- 172.21.15.44:0/2052409189 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc063070 con 0x55ac5b6c67a0 2024-03-30T13:15:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.855+0000 7fd3b5600640 1 -- 172.21.15.44:0/2052409189 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3bc061070 con 0x55ac5b6c67a0 2024-03-30T13:15:30.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.855+0000 7fd3b5600640 1 -- 172.21.15.44:0/2052409189 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc041d70 con 0x55ac5b6c67a0 2024-03-30T13:15:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.856+0000 7fd3cee1b740 1 -- 172.21.15.44:0/2052409189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 msgr2=0x55ac5b6a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.856+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/2052409189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 0x55ac5b6a1b60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00b530 tx=0x7fd3bc04a000 comp rx=0 tx=0).stop 2024-03-30T13:15:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.856+0000 7fd3cee1b740 1 -- 172.21.15.44:0/2052409189 shutdown_connections 2024-03-30T13:15:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.856+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/2052409189 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6c67a0 0x55ac5b6a1b60 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.856+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/2052409189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8850 0x55ac5b6a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.856+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/2052409189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6a8470 0x55ac5b6f0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.856+0000 7fd3cee1b740 1 -- 172.21.15.44:0/2052409189 >> 172.21.15.44:0/2052409189 conn(0x55ac5b66ebe0 msgr2=0x55ac5b69db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.856+0000 7fd3cee1b740 1 -- 172.21.15.44:0/2052409189 shutdown_connections 2024-03-30T13:15:30.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.856+0000 7fd3cee1b740 1 -- 172.21.15.44:0/2052409189 wait complete. 2024-03-30T13:15:30.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.856+0000 7fd3cee1b740 1 -- start start 2024-03-30T13:15:30.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.857+0000 7fd3cee1b740 1 Processor -- start 2024-03-30T13:15:30.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3cee1b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8470 0x55ac5b769390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3cee1b740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6a8850 0x55ac5b6fb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3cee1b740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6c67a0 0x55ac5b6fbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3cee1b740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c41ef990 con 0x55ac5b6a8850 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3cee1b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ac5b6fc6b0 con 0x55ac5b6a8470 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3cee1b740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55ac5b6a2210 con 0x55ac5b6c67a0 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3cee1b740 10 client.0 _ll_register_callbacks cb 0x7fd3bc046030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3c8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6a8850 0x55ac5b6fb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3c8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6a8850 0x55ac5b6fb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54538/0 (socket says 172.21.15.44:54538) 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3c8e00640 1 -- 172.21.15.44:0/517875548 learned_addr learned my addr 172.21.15.44:0/517875548 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3c8e00640 1 -- 172.21.15.44:0/517875548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6c67a0 msgr2=0x55ac5b6fbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3c8e00640 1 --2- 172.21.15.44:0/517875548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6c67a0 0x55ac5b6fbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3c8e00640 1 -- 172.21.15.44:0/517875548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8470 msgr2=0x55ac5b769390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3c8e00640 1 --2- 172.21.15.44:0/517875548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8470 0x55ac5b769390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.858+0000 7fd3c8e00640 1 -- 172.21.15.44:0/517875548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac5b6a1f30 con 0x55ac5b6a8850 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.859+0000 7fd3c8e00640 1 --2- 172.21.15.44:0/517875548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6a8850 0x55ac5b6fb8b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000ce90 tx=0x7fd3b0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2735b921d34453b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.859+0000 7fd3aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.859+0000 7fd3aaa00640 1 -- 172.21.15.44:0/517875548 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0070e60 con 0x55ac5b6a8850 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.859+0000 7fd3aaa00640 1 -- 172.21.15.44:0/517875548 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fd3b0054f90 con 0x55ac5b6a8850 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.859+0000 7fd3cee1b740 1 -- 172.21.15.44:0/517875548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3bc061070 con 0x55ac5b6a8850 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.859+0000 7fd3aaa00640 1 -- 172.21.15.44:0/517875548 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd3b0059ba0 con 0x55ac5b6a8850 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.859+0000 7fd3cee1b740 10 client.6459 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.859+0000 7fd3cee1b740 1 -- 172.21.15.44:0/517875548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55ac5b6f0b90 con 0x55ac5b6a8850 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.859+0000 7fd3aaa00640 1 -- 172.21.15.44:0/517875548 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3bc061070 con 0x55ac5b6a8850 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.860+0000 7fd3aaa00640 1 -- 172.21.15.44:0/517875548 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fd3b0057d70 con 0x55ac5b6a8850 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.860+0000 7fd3cee1b740 10 client.6459 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.860+0000 7fd3cee1b740 10 client.6459 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.860+0000 7fd3cee1b740 20 client.6459 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:30.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.860+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/517875548 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ac5b6a5d20 0x55ac5b70f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.860+0000 7fd3cee1b740 4 client.6459 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628422}] 2024-03-30T13:15:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.860+0000 7fd3cee1b740 1 -- 172.21.15.44:0/517875548 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628422}) -- 0x55ac5b6d6450 con 0x55ac5b6a5d20 2024-03-30T13:15:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.860+0000 7fd3c9800640 1 --2- 172.21.15.44:0/517875548 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ac5b6a5d20 0x55ac5b70f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.860+0000 7fd3c9800640 1 --2- 172.21.15.44:0/517875548 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ac5b6a5d20 0x55ac5b70f2f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=581f942221efda77 server_cookie=36eee4f120363c4f in_seq=0 out_seq=0 2024-03-30T13:15:30.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3aaa00640 10 client.6459 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3aaa00640 1 -- 172.21.15.44:0/517875548 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4773 (crc 0 0 0) 0x55ac5b6d6450 con 0x55ac5b6a5d20 2024-03-30T13:15:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3aaa00640 10 client.6459 handle_command_reply: tid=0 2024-03-30T13:15:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3cee1b740 1 client.6459 shutdown 2024-03-30T13:15:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3cee1b740 1 -- 172.21.15.44:0/517875548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6a8850 msgr2=0x55ac5b6fb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/517875548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6a8850 0x55ac5b6fb8b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000ce90 tx=0x7fd3b0000ed0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3cee1b740 1 -- 172.21.15.44:0/517875548 shutdown_connections 2024-03-30T13:15:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/517875548 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55ac5b6a5d20 0x55ac5b70f2f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/517875548 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac5b6c67a0 0x55ac5b6fbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/517875548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ac5b6a8850 0x55ac5b6fb8b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3aaa00640 0 client.6459 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3cee1b740 1 --2- 172.21.15.44:0/517875548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac5b6a8470 0x55ac5b769390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.861+0000 7fd3cee1b740 1 -- 172.21.15.44:0/517875548 >> 172.21.15.44:0/517875548 conn(0x55ac5b66ebe0 msgr2=0x55ac5b6ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cee1b740 1 -- 172.21.15.44:0/517875548 shutdown_connections 2024-03-30T13:15:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cee1b740 1 -- 172.21.15.44:0/517875548 wait complete. 2024-03-30T13:15:30.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cee1b740 20 client.6459 trim_cache size 0 max 16384 2024-03-30T13:15:30.870 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:30.870 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/orangefs-dev-proto.h", 2024-03-30T13:15:30.870 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628422, 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.657917+0000", 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.771530+0000", 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.871 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2111, 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:30.872 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.771530+0000", 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 4, 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:30.873 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:30.874 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.874 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:30.874 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:30.874 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:30.874 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:30.874 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:30.874 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:30.874 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.874 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:30.874 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:30.874 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 2111, 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.657917+0000" 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 2111, 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.657917+0000" 2024-03-30T13:15:30.875 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 260, 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 34, 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:30.876 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:30.877 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:30.878 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:30.879 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:30.880 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.881 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.882 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:30.883 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:30.884 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:30.885 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:30.885 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cac00640 1 -- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd3a406c530 msgr2=0x7fd3a406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cac00640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd3a406c530 0x7fd3a406e9f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc035000 tx=0x7fd3bc02e000 comp rx=0 tx=0).stop 2024-03-30T13:15:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cac00640 1 -- 172.21.15.44:0/1886858094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3c4158d10 msgr2=0x7fd3c414fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cac00640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3c4158d10 0x7fd3c414fcc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd3b000c4d0 tx=0x7fd3b000c990 comp rx=0 tx=0).stop 2024-03-30T13:15:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cac00640 1 -- 172.21.15.44:0/1886858094 shutdown_connections 2024-03-30T13:15:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cac00640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3c415f560 0x7fd3c41f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cac00640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd3c4158d10 0x7fd3c414fcc0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cac00640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd3a406c530 0x7fd3a406e9f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cac00640 1 --2- 172.21.15.44:0/1886858094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3c40b4d50 0x7fd3c4153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.862+0000 7fd3cac00640 1 -- 172.21.15.44:0/1886858094 >> 172.21.15.44:0/1886858094 conn(0x7fd3c40d0ed0 msgr2=0x7fd3c415bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:30.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.863+0000 7fd3cac00640 1 -- 172.21.15.44:0/1886858094 shutdown_connections 2024-03-30T13:15:30.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:30.863+0000 7fd3cac00640 1 -- 172.21.15.44:0/1886858094 wait complete. 2024-03-30T13:15:30.888 DEBUG:tasks.cephfs.test_uninlining:getting inode info #21 of 23:1099511628407 2024-03-30T13:15:30.888 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628407 2024-03-30T13:15:30.888 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628407 2024-03-30T13:15:31.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.145+0000 7fc63d800640 1 Processor -- start 2024-03-30T13:15:31.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.145+0000 7fc63d800640 1 -- start start 2024-03-30T13:15:31.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.146+0000 7fc63d800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc63813f0c0 0x7fc63806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.147+0000 7fc63d800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc63806d720 0x7fc63815fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.147+0000 7fc63d800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6380ce9c0 con 0x7fc6381603d0 2024-03-30T13:15:31.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.147+0000 7fc63d800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fc638160e30 con 0x7fc63806d720 2024-03-30T13:15:31.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.147+0000 7fc63d800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc638160b50 con 0x7fc63813f0c0 2024-03-30T13:15:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.147+0000 7fc636000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc63806d720 0x7fc63815fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.147+0000 7fc636000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc63806d720 0x7fc63815fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:51192/0 (socket says 172.21.15.44:51192) 2024-03-30T13:15:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.147+0000 7fc636000640 1 -- 172.21.15.44:0/2507694138 learned_addr learned my addr 172.21.15.44:0/2507694138 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.147+0000 7fc636a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc63813f0c0 0x7fc63806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.148+0000 7fc636000640 1 -- 172.21.15.44:0/2507694138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc63813f0c0 msgr2=0x7fc63806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.148+0000 7fc636000640 1 --2- 172.21.15.44:0/2507694138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc63813f0c0 0x7fc63806d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.148+0000 7fc636000640 1 -- 172.21.15.44:0/2507694138 >> v1:172.21.15.151:6789/0 conn(0x7fc6381603d0 legacy=0x7fc6380cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.148+0000 7fc636000640 1 -- 172.21.15.44:0/2507694138 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63813fa40 con 0x7fc63806d720 2024-03-30T13:15:31.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.150+0000 7fc636000640 1 --2- 172.21.15.44:0/2507694138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc63806d720 0x7fc63815fe90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc624009870 tx=0x7fc62402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6bde4457eb75bd2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.150+0000 7fc635600640 1 -- 172.21.15.44:0/2507694138 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6240317c0 con 0x7fc63806d720 2024-03-30T13:15:31.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.150+0000 7fc635600640 1 -- 172.21.15.44:0/2507694138 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc624037070 con 0x7fc63806d720 2024-03-30T13:15:31.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.150+0000 7fc635600640 1 -- 172.21.15.44:0/2507694138 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc624031b80 con 0x7fc63806d720 2024-03-30T13:15:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.151+0000 7fc63d800640 1 -- 172.21.15.44:0/2507694138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc63806d720 msgr2=0x7fc63815fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.151+0000 7fc63d800640 1 --2- 172.21.15.44:0/2507694138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc63806d720 0x7fc63815fe90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc624009870 tx=0x7fc62402b860 comp rx=0 tx=0).stop 2024-03-30T13:15:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.151+0000 7fc63d800640 1 -- 172.21.15.44:0/2507694138 shutdown_connections 2024-03-30T13:15:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.151+0000 7fc63d800640 1 --2- 172.21.15.44:0/2507694138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc63806d720 0x7fc63815fe90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.151+0000 7fc63d800640 1 --2- 172.21.15.44:0/2507694138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc63813f0c0 0x7fc63806d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.151+0000 7fc63d800640 1 -- 172.21.15.44:0/2507694138 >> 172.21.15.44:0/2507694138 conn(0x7fc6380b5b00 msgr2=0x7fc63806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.151+0000 7fc63d800640 1 -- 172.21.15.44:0/2507694138 shutdown_connections 2024-03-30T13:15:31.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.151+0000 7fc63d800640 1 -- 172.21.15.44:0/2507694138 wait complete. 2024-03-30T13:15:31.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.153+0000 7fc63d800640 1 Processor -- start 2024-03-30T13:15:31.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.153+0000 7fc63d800640 1 -- start start 2024-03-30T13:15:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.154+0000 7fc63d800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc63806d720 0x7fc63813ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.154+0000 7fc63d800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc63813f0c0 0x7fc6380b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.154+0000 7fc63d800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6381603d0 0x7fc6381415b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.154+0000 7fc63d800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc638160820 con 0x7fc63806d720 2024-03-30T13:15:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.154+0000 7fc63d800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc638140000 con 0x7fc63813f0c0 2024-03-30T13:15:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.154+0000 7fc63d800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc63813f4a0 con 0x7fc6381603d0 2024-03-30T13:15:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.154+0000 7fc636a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc63806d720 0x7fc63813ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.154+0000 7fc636a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc63806d720 0x7fc63813ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54550/0 (socket says 172.21.15.44:54550) 2024-03-30T13:15:31.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.154+0000 7fc636a00640 1 -- 172.21.15.44:0/1237925945 learned_addr learned my addr 172.21.15.44:0/1237925945 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.155+0000 7fc636000640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc63813f0c0 0x7fc6380b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.155+0000 7fc637400640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6381603d0 0x7fc6381415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.155+0000 7fc636a00640 1 -- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6381603d0 msgr2=0x7fc6381415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.155+0000 7fc636a00640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6381603d0 0x7fc6381415b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.155+0000 7fc636a00640 1 -- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc63813f0c0 msgr2=0x7fc6380b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.155+0000 7fc636a00640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc63813f0c0 0x7fc6380b3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.155+0000 7fc636a00640 1 -- 172.21.15.44:0/1237925945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc638140510 con 0x7fc63806d720 2024-03-30T13:15:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.155+0000 7fc636000640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc63813f0c0 0x7fc6380b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.155+0000 7fc636a00640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc63806d720 0x7fc63813ea10 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc62800efc0 tx=0x7fc62800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.155+0000 7fc62ea00640 1 -- 172.21.15.44:0/1237925945 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628018020 con 0x7fc63806d720 2024-03-30T13:15:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.155+0000 7fc62ea00640 1 -- 172.21.15.44:0/1237925945 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc628014480 con 0x7fc63806d720 2024-03-30T13:15:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.155+0000 7fc63d800640 1 -- 172.21.15.44:0/1237925945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6381407f0 con 0x7fc63806d720 2024-03-30T13:15:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.156+0000 7fc62ea00640 1 -- 172.21.15.44:0/1237925945 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628014850 con 0x7fc63806d720 2024-03-30T13:15:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.156+0000 7fc63d800640 1 -- 172.21.15.44:0/1237925945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc638140db0 con 0x7fc63806d720 2024-03-30T13:15:31.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.158+0000 7fc62ea00640 1 -- 172.21.15.44:0/1237925945 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc628005d10 con 0x7fc63806d720 2024-03-30T13:15:31.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.159+0000 7fc64058c740 1 Processor -- start 2024-03-30T13:15:31.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.160+0000 7fc64058c740 1 -- start start 2024-03-30T13:15:31.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.160+0000 7fc62ea00640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc61806c530 0x7fc61806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.160+0000 7fc62ea00640 1 -- 172.21.15.44:0/1237925945 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fc62808c4d0 con 0x7fc63806d720 2024-03-30T13:15:31.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.160+0000 7fc637400640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc61806c530 0x7fc61806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc64058c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825290 0x56246984bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc64058c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56246984c300 0x5624698242d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc64058c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 0x562469824810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc64058c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562469788330 con 0x562469825670 2024-03-30T13:15:31.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc64058c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562469730620 con 0x562469825290 2024-03-30T13:15:31.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc64058c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x562469784440 con 0x56246984c300 2024-03-30T13:15:31.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc637400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 0x562469824810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc637400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 0x562469824810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54562/0 (socket says 172.21.15.44:54562) 2024-03-30T13:15:31.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc637400640 1 -- 172.21.15.44:0/1907869004 learned_addr learned my addr 172.21.15.44:0/1907869004 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc636a00640 1 --2- 172.21.15.44:0/1907869004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825290 0x56246984bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.167 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc636000640 1 --2- 172.21.15.44:0/1907869004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56246984c300 0x5624698242d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc637400640 1 -- 172.21.15.44:0/1907869004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56246984c300 msgr2=0x5624698242d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc637400640 1 --2- 172.21.15.44:0/1907869004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56246984c300 0x5624698242d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc637400640 1 -- 172.21.15.44:0/1907869004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825290 msgr2=0x56246984bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc637400640 1 --2- 172.21.15.44:0/1907869004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825290 0x56246984bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc637400640 1 -- 172.21.15.44:0/1907869004 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562469568920 con 0x562469825670 2024-03-30T13:15:31.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.161+0000 7fc636a00640 1 --2- 172.21.15.44:0/1907869004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825290 0x56246984bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:31.168 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.162+0000 7fc637400640 1 --2- 172.21.15.44:0/1907869004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 0x562469824810 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc630016640 tx=0x7fc630016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bdd3c42c3e8552 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.162+0000 7fc623400640 1 -- 172.21.15.44:0/1907869004 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630010040 con 0x562469825670 2024-03-30T13:15:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.162+0000 7fc623400640 1 -- 172.21.15.44:0/1907869004 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc630005310 con 0x562469825670 2024-03-30T13:15:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.162+0000 7fc637400640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc61806c530 0x7fc61806e9f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc630014280 tx=0x7fc63000d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.162+0000 7fc623400640 1 -- 172.21.15.44:0/1907869004 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630001360 con 0x562469825670 2024-03-30T13:15:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.163+0000 7fc64058c740 1 -- 172.21.15.44:0/1907869004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 msgr2=0x562469824810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.163+0000 7fc64058c740 1 --2- 172.21.15.44:0/1907869004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 0x562469824810 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc630016640 tx=0x7fc630016b00 comp rx=0 tx=0).stop 2024-03-30T13:15:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.163+0000 7fc64058c740 1 -- 172.21.15.44:0/1907869004 shutdown_connections 2024-03-30T13:15:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.163+0000 7fc64058c740 1 --2- 172.21.15.44:0/1907869004 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 0x562469824810 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.163+0000 7fc64058c740 1 --2- 172.21.15.44:0/1907869004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56246984c300 0x5624698242d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.163+0000 7fc64058c740 1 --2- 172.21.15.44:0/1907869004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825290 0x56246984bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.163+0000 7fc64058c740 1 -- 172.21.15.44:0/1907869004 >> 172.21.15.44:0/1907869004 conn(0x5624697ebbe0 msgr2=0x562469869fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.170 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.163+0000 7fc64058c740 1 -- 172.21.15.44:0/1907869004 shutdown_connections 2024-03-30T13:15:31.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.163+0000 7fc64058c740 1 -- 172.21.15.44:0/1907869004 wait complete. 2024-03-30T13:15:31.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.164+0000 7fc64058c740 1 -- start start 2024-03-30T13:15:31.171 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.165+0000 7fc64058c740 1 Processor -- start 2024-03-30T13:15:31.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.166+0000 7fc64058c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825290 0x562469867270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.166+0000 7fc64058c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 0x562469843960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.166+0000 7fc64058c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469844a60 0x5624698658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.166+0000 7fc64058c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x56246984b930 con 0x562469825670 2024-03-30T13:15:31.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.166+0000 7fc64058c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5624697439d0 con 0x562469825290 2024-03-30T13:15:31.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.166+0000 7fc64058c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5624698446b0 con 0x562469844a60 2024-03-30T13:15:31.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.166+0000 7fc64058c740 10 client.0 _ll_register_callbacks cb 0x56246977ffd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:31.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.167+0000 7fc636000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 0x562469843960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.167+0000 7fc636000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 0x562469843960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54576/0 (socket says 172.21.15.44:54576) 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.167+0000 7fc636000640 1 -- 172.21.15.44:0/2018001573 learned_addr learned my addr 172.21.15.44:0/2018001573 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.167+0000 7fc637400640 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469844a60 0x5624698658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.167+0000 7fc636a00640 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825290 0x562469867270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.167+0000 7fc636000640 1 -- 172.21.15.44:0/2018001573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469844a60 msgr2=0x5624698658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.167+0000 7fc636000640 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469844a60 0x5624698658d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.167+0000 7fc636000640 1 -- 172.21.15.44:0/2018001573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825290 msgr2=0x562469867270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.167+0000 7fc636000640 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825290 0x562469867270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.167+0000 7fc636000640 1 -- 172.21.15.44:0/2018001573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56246945c210 con 0x562469825670 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.168+0000 7fc636000640 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 0x562469843960 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc62402b8a0 tx=0x7fc62402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590bc6ddc42c781c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.168+0000 7fc617e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.168+0000 7fc617e00640 1 -- 172.21.15.44:0/2018001573 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62404a060 con 0x562469825670 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.168+0000 7fc617e00640 1 -- 172.21.15.44:0/2018001573 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fc624032660 con 0x562469825670 2024-03-30T13:15:31.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.168+0000 7fc64058c740 1 -- 172.21.15.44:0/2018001573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc630005310 con 0x562469825670 2024-03-30T13:15:31.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.168+0000 7fc617e00640 1 -- 172.21.15.44:0/2018001573 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc624050050 con 0x562469825670 2024-03-30T13:15:31.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.168+0000 7fc64058c740 10 client.6468 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:31.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.168+0000 7fc64058c740 1 -- 172.21.15.44:0/2018001573 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5624695c90b0 con 0x562469825670 2024-03-30T13:15:31.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.169+0000 7fc617e00640 1 -- 172.21.15.44:0/2018001573 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc630005310 con 0x562469825670 2024-03-30T13:15:31.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.169+0000 7fc617e00640 1 -- 172.21.15.44:0/2018001573 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc624053020 con 0x562469825670 2024-03-30T13:15:31.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.169+0000 7fc64058c740 10 client.6468 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:31.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.169+0000 7fc64058c740 10 client.6468 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:31.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.169+0000 7fc64058c740 20 client.6468 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:31.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.169+0000 7fc64058c740 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562469861130 0x562469861570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.169+0000 7fc64058c740 4 client.6468 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:31.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.169+0000 7fc64058c740 1 -- 172.21.15.44:0/2018001573 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562469795870 con 0x562469861130 2024-03-30T13:15:31.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.169+0000 7fc636a00640 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562469861130 0x562469861570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.170+0000 7fc636a00640 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562469861130 0x562469861570 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c436019c5a72a4d8 server_cookie=a4d2a88bf12712ba in_seq=0 out_seq=0 2024-03-30T13:15:31.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.170+0000 7fc617e00640 10 client.6468 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:31.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.170+0000 7fc617e00640 1 -- 172.21.15.44:0/2018001573 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x562469795870 con 0x562469861130 2024-03-30T13:15:31.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.170+0000 7fc617e00640 10 client.6468 handle_command_reply: tid=0 2024-03-30T13:15:31.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.170+0000 7fc64058c740 1 client.6468 shutdown 2024-03-30T13:15:31.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.171+0000 7fc64058c740 1 -- 172.21.15.44:0/2018001573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 msgr2=0x562469843960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.171+0000 7fc64058c740 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 0x562469843960 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fc62402b8a0 tx=0x7fc62402e000 comp rx=0 tx=0).stop 2024-03-30T13:15:31.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.171+0000 7fc64058c740 1 -- 172.21.15.44:0/2018001573 shutdown_connections 2024-03-30T13:15:31.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.171+0000 7fc64058c740 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562469861130 0x562469861570 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.171+0000 7fc64058c740 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469844a60 0x5624698658d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.171+0000 7fc64058c740 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825670 0x562469843960 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.171+0000 7fc64058c740 1 --2- 172.21.15.44:0/2018001573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825290 0x562469867270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.171+0000 7fc64058c740 1 -- 172.21.15.44:0/2018001573 >> 172.21.15.44:0/2018001573 conn(0x5624697ebbe0 msgr2=0x56246984af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.171+0000 7fc617e00640 0 client.6468 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:31.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.171+0000 7fc64058c740 1 -- 172.21.15.44:0/2018001573 shutdown_connections 2024-03-30T13:15:31.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.171+0000 7fc64058c740 1 -- 172.21.15.44:0/2018001573 wait complete. 2024-03-30T13:15:31.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.171+0000 7fc64058c740 20 client.6468 trim_cache size 0 max 16384 2024-03-30T13:15:31.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.187+0000 7fc64058c740 1 Processor -- start 2024-03-30T13:15:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.187+0000 7fc64058c740 1 -- start start 2024-03-30T13:15:31.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.188+0000 7fc64058c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825290 0x562469852bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.188+0000 7fc64058c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469825670 0x56246984f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.188+0000 7fc64058c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469844a60 0x56246984f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.188+0000 7fc64058c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc6382011e0 con 0x562469825290 2024-03-30T13:15:31.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.188+0000 7fc64058c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc6382001e0 con 0x562469844a60 2024-03-30T13:15:31.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.188+0000 7fc64058c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc6381f81e0 con 0x562469825670 2024-03-30T13:15:31.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.189+0000 7fc636a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825290 0x562469852bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.189+0000 7fc636a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825290 0x562469852bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54588/0 (socket says 172.21.15.44:54588) 2024-03-30T13:15:31.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.189+0000 7fc636a00640 1 -- 172.21.15.44:0/2467702193 learned_addr learned my addr 172.21.15.44:0/2467702193 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.189+0000 7fc636000640 1 --2- 172.21.15.44:0/2467702193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469825670 0x56246984f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.189+0000 7fc636a00640 1 -- 172.21.15.44:0/2467702193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469825670 msgr2=0x56246984f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.189+0000 7fc637400640 1 --2- 172.21.15.44:0/2467702193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469844a60 0x56246984f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.189+0000 7fc636a00640 1 --2- 172.21.15.44:0/2467702193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469825670 0x56246984f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.189+0000 7fc636a00640 1 -- 172.21.15.44:0/2467702193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469844a60 msgr2=0x56246984f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.189+0000 7fc636a00640 1 --2- 172.21.15.44:0/2467702193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469844a60 0x56246984f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.189+0000 7fc636a00640 1 -- 172.21.15.44:0/2467702193 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624694352d0 con 0x562469825290 2024-03-30T13:15:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.190+0000 7fc636a00640 1 --2- 172.21.15.44:0/2467702193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825290 0x562469852bd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc62808a7a0 tx=0x7fc628009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cea2b44b0133f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.190+0000 7fc622a00640 1 -- 172.21.15.44:0/2467702193 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628058490 con 0x562469825290 2024-03-30T13:15:31.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.190+0000 7fc622a00640 1 -- 172.21.15.44:0/2467702193 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc628072030 con 0x562469825290 2024-03-30T13:15:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.190+0000 7fc622a00640 1 -- 172.21.15.44:0/2467702193 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62808c0b0 con 0x562469825290 2024-03-30T13:15:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.190+0000 7fc64058c740 1 -- 172.21.15.44:0/2467702193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825290 msgr2=0x562469852bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.190+0000 7fc64058c740 1 --2- 172.21.15.44:0/2467702193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825290 0x562469852bd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fc62808a7a0 tx=0x7fc628009a00 comp rx=0 tx=0).stop 2024-03-30T13:15:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.190+0000 7fc64058c740 1 -- 172.21.15.44:0/2467702193 shutdown_connections 2024-03-30T13:15:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.190+0000 7fc64058c740 1 --2- 172.21.15.44:0/2467702193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469844a60 0x56246984f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.190+0000 7fc64058c740 1 --2- 172.21.15.44:0/2467702193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469825670 0x56246984f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.190+0000 7fc64058c740 1 --2- 172.21.15.44:0/2467702193 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469825290 0x562469852bd0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.190+0000 7fc64058c740 1 -- 172.21.15.44:0/2467702193 >> 172.21.15.44:0/2467702193 conn(0x5624697ebbe0 msgr2=0x56246981a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.191+0000 7fc64058c740 1 -- 172.21.15.44:0/2467702193 shutdown_connections 2024-03-30T13:15:31.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.191+0000 7fc64058c740 1 -- 172.21.15.44:0/2467702193 wait complete. 2024-03-30T13:15:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.191+0000 7fc64058c740 1 -- start start 2024-03-30T13:15:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.192+0000 7fc64058c740 1 Processor -- start 2024-03-30T13:15:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.193+0000 7fc64058c740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469825290 0x56246981e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.193+0000 7fc64058c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825670 0x5624698e4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.193+0000 7fc64058c740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469844a60 0x562469883010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.193+0000 7fc64058c740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562469826800 con 0x562469844a60 2024-03-30T13:15:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.193+0000 7fc64058c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc6381ffbc0 con 0x562469825670 2024-03-30T13:15:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.193+0000 7fc64058c740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x56246988dab0 con 0x562469825290 2024-03-30T13:15:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.193+0000 7fc64058c740 10 client.0 _ll_register_callbacks cb 0x7fc6280095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.193+0000 7fc637400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469844a60 0x562469883010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.193+0000 7fc637400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469844a60 0x562469883010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54604/0 (socket says 172.21.15.44:54604) 2024-03-30T13:15:31.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.193+0000 7fc637400640 1 -- 172.21.15.44:0/180045023 learned_addr learned my addr 172.21.15.44:0/180045023 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.193+0000 7fc636a00640 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469825290 0x56246981e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.193+0000 7fc636000640 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825670 0x5624698e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.194+0000 7fc637400640 1 -- 172.21.15.44:0/180045023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469825290 msgr2=0x56246981e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.194+0000 7fc637400640 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469825290 0x56246981e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.194+0000 7fc637400640 1 -- 172.21.15.44:0/180045023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825670 msgr2=0x5624698e4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.194+0000 7fc637400640 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825670 0x5624698e4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.194+0000 7fc637400640 1 -- 172.21.15.44:0/180045023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562469865d80 con 0x562469844a60 2024-03-30T13:15:31.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.194+0000 7fc637400640 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469844a60 0x562469883010 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fc630005040 tx=0x7fc630007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b716bdeb8fc53191 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.194+0000 7fc617e00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:31.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.194+0000 7fc617e00640 1 -- 172.21.15.44:0/180045023 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630035060 con 0x562469844a60 2024-03-30T13:15:31.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.194+0000 7fc617e00640 1 -- 172.21.15.44:0/180045023 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fc630001300 con 0x562469844a60 2024-03-30T13:15:31.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.194+0000 7fc64058c740 1 -- 172.21.15.44:0/180045023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc628072030 con 0x562469844a60 2024-03-30T13:15:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.195+0000 7fc617e00640 1 -- 172.21.15.44:0/180045023 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc63003b050 con 0x562469844a60 2024-03-30T13:15:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.195+0000 7fc64058c740 10 client.6474 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.195+0000 7fc64058c740 1 -- 172.21.15.44:0/180045023 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5624698e4e50 con 0x562469844a60 2024-03-30T13:15:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.195+0000 7fc617e00640 1 -- 172.21.15.44:0/180045023 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc628072030 con 0x562469844a60 2024-03-30T13:15:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.195+0000 7fc617e00640 1 -- 172.21.15.44:0/180045023 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc63003e020 con 0x562469844a60 2024-03-30T13:15:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.195+0000 7fc64058c740 10 client.6474 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.195+0000 7fc64058c740 10 client.6474 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.195+0000 7fc64058c740 20 client.6474 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.195+0000 7fc64058c740 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562469883550 0x56246984af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.195+0000 7fc64058c740 4 client.6474 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628407}] 2024-03-30T13:15:31.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.195+0000 7fc64058c740 1 -- 172.21.15.44:0/180045023 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628407}) -- 0x56246978fbc0 con 0x562469883550 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.195+0000 7fc636a00640 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562469883550 0x56246984af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.196+0000 7fc636a00640 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562469883550 0x56246984af20 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e2e9b1052d3075a server_cookie=bb4c24369a8d6a36 in_seq=0 out_seq=0 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.196+0000 7fc617e00640 10 client.6474 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.196+0000 7fc617e00640 1 -- 172.21.15.44:0/180045023 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4757 (crc 0 0 0) 0x56246978fbc0 con 0x562469883550 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.196+0000 7fc617e00640 10 client.6474 handle_command_reply: tid=0 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.196+0000 7fc64058c740 1 client.6474 shutdown 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.197+0000 7fc64058c740 1 -- 172.21.15.44:0/180045023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469844a60 msgr2=0x562469883010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.197+0000 7fc64058c740 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469844a60 0x562469883010 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fc630005040 tx=0x7fc630007ea0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.197+0000 7fc64058c740 1 -- 172.21.15.44:0/180045023 shutdown_connections 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.197+0000 7fc64058c740 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x562469883550 0x56246984af20 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.197+0000 7fc64058c740 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562469844a60 0x562469883010 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.197+0000 7fc64058c740 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562469825670 0x5624698e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.197+0000 7fc64058c740 1 --2- 172.21.15.44:0/180045023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562469825290 0x56246981e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.197+0000 7fc617e00640 0 client.6474 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:31.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.197+0000 7fc64058c740 1 -- 172.21.15.44:0/180045023 >> 172.21.15.44:0/180045023 conn(0x5624697ebbe0 msgr2=0x562469852bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.197+0000 7fc64058c740 1 -- 172.21.15.44:0/180045023 shutdown_connections 2024-03-30T13:15:31.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.197+0000 7fc64058c740 1 -- 172.21.15.44:0/180045023 wait complete. 2024-03-30T13:15:31.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.197+0000 7fc64058c740 20 client.6474 trim_cache size 0 max 16384 2024-03-30T13:15:31.205 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:31.205 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/Makefile", 2024-03-30T13:15:31.205 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628407, 2024-03-30T13:15:31.205 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:31.205 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.658466+0000", 2024-03-30T13:15:31.205 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.734530+0000", 2024-03-30T13:15:31.205 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:31.206 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 356, 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.734530+0000", 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:31.207 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:31.208 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 356, 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.658466+0000" 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:31.209 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 356, 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.658466+0000" 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 262, 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 4, 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:31.210 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:31.211 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.212 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.213 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:31.214 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.215 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:31.216 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.217 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:31.218 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:31.219 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:31.219 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:31.219 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:31.219 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:31.219 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:31.219 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:31.219 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.219 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:31.219 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:31.219 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:31.219 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:31.219 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.198+0000 7fc63d800640 1 -- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc61806c530 msgr2=0x7fc61806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.198+0000 7fc63d800640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc61806c530 0x7fc61806e9f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc630014280 tx=0x7fc63000d000 comp rx=0 tx=0).stop 2024-03-30T13:15:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.198+0000 7fc63d800640 1 -- 172.21.15.44:0/1237925945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc63806d720 msgr2=0x7fc63813ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.198+0000 7fc63d800640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc63806d720 0x7fc63813ea10 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc62800efc0 tx=0x7fc62800c490 comp rx=0 tx=0).stop 2024-03-30T13:15:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.198+0000 7fc63d800640 1 -- 172.21.15.44:0/1237925945 shutdown_connections 2024-03-30T13:15:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.198+0000 7fc63d800640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6381603d0 0x7fc6381415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.198+0000 7fc63d800640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc61806c530 0x7fc61806e9f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.198+0000 7fc63d800640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc63813f0c0 0x7fc6380b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.198+0000 7fc63d800640 1 --2- 172.21.15.44:0/1237925945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc63806d720 0x7fc63813ea10 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.198+0000 7fc63d800640 1 -- 172.21.15.44:0/1237925945 >> 172.21.15.44:0/1237925945 conn(0x7fc6380b5b00 msgr2=0x7fc63806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.198+0000 7fc63d800640 1 -- 172.21.15.44:0/1237925945 shutdown_connections 2024-03-30T13:15:31.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.198+0000 7fc63d800640 1 -- 172.21.15.44:0/1237925945 wait complete. 2024-03-30T13:15:31.222 DEBUG:tasks.cephfs.test_uninlining:getting inode info #22 of 23:1099511628430 2024-03-30T13:15:31.222 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628430 2024-03-30T13:15:31.222 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628430 2024-03-30T13:15:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.427+0000 7fd0ed600640 1 Processor -- start 2024-03-30T13:15:31.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.428+0000 7fd0ed600640 1 -- start start 2024-03-30T13:15:31.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.429+0000 7fd0ed600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd0e806d8f0 0x7fd0e815fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.429+0000 7fd0ed600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd0e81603d0 0x7fd0e80cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.429+0000 7fd0ed600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e80ce9c0 con 0x7fd0e813f0c0 2024-03-30T13:15:31.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.429+0000 7fd0ed600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e8160e30 con 0x7fd0e81603d0 2024-03-30T13:15:31.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.429+0000 7fd0ed600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e8160b50 con 0x7fd0e806d8f0 2024-03-30T13:15:31.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.430+0000 7fd0e7400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd0e81603d0 0x7fd0e80cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.430+0000 7fd0e6a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd0e813f0c0 0x7fd0e806d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:43016/0 (socket says 172.21.15.44:43016) 2024-03-30T13:15:31.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.430+0000 7fd0e6a00640 1 -- 172.21.15.44:0/2101665793 learned_addr learned my addr 172.21.15.44:0/2101665793 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:31.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.430+0000 7fd0e6000640 1 --2- 172.21.15.44:0/2101665793 >> v2:172.21.15.151:3300/0 conn(0x7fd0e806d8f0 0x7fd0e815fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.430+0000 7fd0e7400640 1 -- 172.21.15.44:0/2101665793 >> v2:172.21.15.151:3300/0 conn(0x7fd0e806d8f0 msgr2=0x7fd0e815fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.431+0000 7fd0e7400640 1 --2- 172.21.15.44:0/2101665793 >> v2:172.21.15.151:3300/0 conn(0x7fd0e806d8f0 0x7fd0e815fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.431+0000 7fd0e7400640 1 -- 172.21.15.44:0/2101665793 >> v1:172.21.15.44:6789/0 conn(0x7fd0e813f0c0 legacy=0x7fd0e806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.431+0000 7fd0e7400640 1 -- 172.21.15.44:0/2101665793 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e813fa40 con 0x7fd0e81603d0 2024-03-30T13:15:31.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.432+0000 7fd0e7400640 1 --2- 172.21.15.44:0/2101665793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e81603d0 0x7fd0e80cfbb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd0e806e3a0 tx=0x7fd0e002b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769b07929db1e9c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.432+0000 7fd0e5600640 1 -- 172.21.15.44:0/2101665793 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0038070 con 0x7fd0e81603d0 2024-03-30T13:15:31.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.432+0000 7fd0e5600640 1 -- 172.21.15.44:0/2101665793 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e0031520 con 0x7fd0e81603d0 2024-03-30T13:15:31.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.432+0000 7fd0e5600640 1 -- 172.21.15.44:0/2101665793 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00318f0 con 0x7fd0e81603d0 2024-03-30T13:15:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.433+0000 7fd0ed600640 1 -- 172.21.15.44:0/2101665793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e81603d0 msgr2=0x7fd0e80cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.433+0000 7fd0ed600640 1 --2- 172.21.15.44:0/2101665793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e81603d0 0x7fd0e80cfbb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd0e806e3a0 tx=0x7fd0e002b7c0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.433+0000 7fd0ed600640 1 -- 172.21.15.44:0/2101665793 shutdown_connections 2024-03-30T13:15:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.433+0000 7fd0ed600640 1 --2- 172.21.15.44:0/2101665793 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e81603d0 0x7fd0e80cfbb0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.433+0000 7fd0ed600640 1 --2- 172.21.15.44:0/2101665793 >> v2:172.21.15.151:3300/0 conn(0x7fd0e806d8f0 0x7fd0e815fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.433+0000 7fd0ed600640 1 -- 172.21.15.44:0/2101665793 >> 172.21.15.44:0/2101665793 conn(0x7fd0e80b5b00 msgr2=0x7fd0e806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.433+0000 7fd0ed600640 1 -- 172.21.15.44:0/2101665793 shutdown_connections 2024-03-30T13:15:31.438 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.433+0000 7fd0ed600640 1 -- 172.21.15.44:0/2101665793 wait complete. 2024-03-30T13:15:31.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.435+0000 7fd0ed600640 1 Processor -- start 2024-03-30T13:15:31.440 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.435+0000 7fd0ed600640 1 -- start start 2024-03-30T13:15:31.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.436+0000 7fd0ed600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e806d8f0 0x7fd0e80726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.436+0000 7fd0ed600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0e813f0c0 0x7fd0e813a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.436+0000 7fd0ed600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0e81603d0 0x7fd0e813aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.436+0000 7fd0ed600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8160840 con 0x7fd0e806d8f0 2024-03-30T13:15:31.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.436+0000 7fd0ed600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8140000 con 0x7fd0e813f0c0 2024-03-30T13:15:31.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.436+0000 7fd0ed600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e813f4a0 con 0x7fd0e81603d0 2024-03-30T13:15:31.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.436+0000 7fd0e6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e806d8f0 0x7fd0e80726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.436+0000 7fd0e6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e806d8f0 0x7fd0e80726e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54624/0 (socket says 172.21.15.44:54624) 2024-03-30T13:15:31.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.436+0000 7fd0e6a00640 1 -- 172.21.15.44:0/2479987922 learned_addr learned my addr 172.21.15.44:0/2479987922 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.436+0000 7fd0e7400640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0e81603d0 0x7fd0e813aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0e6000640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0e813f0c0 0x7fd0e813a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0e6a00640 1 -- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0e81603d0 msgr2=0x7fd0e813aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0e6a00640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0e81603d0 0x7fd0e813aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0e6a00640 1 -- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0e813f0c0 msgr2=0x7fd0e813a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0e6a00640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0e813f0c0 0x7fd0e813a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0e6a00640 1 -- 172.21.15.44:0/2479987922 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e813afb0 con 0x7fd0e806d8f0 2024-03-30T13:15:31.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0e6000640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0e813f0c0 0x7fd0e813a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:31.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0e6a00640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e806d8f0 0x7fd0e80726e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800c3c0 tx=0x7fd0d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0dea00640 1 -- 172.21.15.44:0/2479987922 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8017070 con 0x7fd0e806d8f0 2024-03-30T13:15:31.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0dea00640 1 -- 172.21.15.44:0/2479987922 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d8005ce0 con 0x7fd0e806d8f0 2024-03-30T13:15:31.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0dea00640 1 -- 172.21.15.44:0/2479987922 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80072f0 con 0x7fd0e806d8f0 2024-03-30T13:15:31.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0ed600640 1 -- 172.21.15.44:0/2479987922 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e8142bc0 con 0x7fd0e806d8f0 2024-03-30T13:15:31.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.437+0000 7fd0ed600640 1 -- 172.21.15.44:0/2479987922 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e8143180 con 0x7fd0e806d8f0 2024-03-30T13:15:31.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.440+0000 7fd0dea00640 1 -- 172.21.15.44:0/2479987922 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd0d801a070 con 0x7fd0e806d8f0 2024-03-30T13:15:31.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.441+0000 7fd0dea00640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd0c406c530 0x7fd0c406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.441+0000 7fd0dea00640 1 -- 172.21.15.44:0/2479987922 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fd0d808ac40 con 0x7fd0e806d8f0 2024-03-30T13:15:31.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.441+0000 7fd0e6000640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd0c406c530 0x7fd0c406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.443+0000 7fd0e6000640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd0c406c530 0x7fd0c406e9f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80b4920 tx=0x7fd0d000b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.444+0000 7fd0f042e740 1 Processor -- start 2024-03-30T13:15:31.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.444+0000 7fd0f042e740 1 -- start start 2024-03-30T13:15:31.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.445+0000 7fd0f042e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c290 0x5579b58c2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.445+0000 7fd0f042e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58c3300 0x5579b589b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.445+0000 7fd0f042e740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c670 0x5579b589b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.445+0000 7fd0f042e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5579b57ff330 con 0x5579b58c3300 2024-03-30T13:15:31.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.445+0000 7fd0f042e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5579b57a7620 con 0x5579b589c290 2024-03-30T13:15:31.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.445+0000 7fd0f042e740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5579b57fb440 con 0x5579b589c670 2024-03-30T13:15:31.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.446+0000 7fd0e6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58c3300 0x5579b589b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.446+0000 7fd0e6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58c3300 0x5579b589b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54634/0 (socket says 172.21.15.44:54634) 2024-03-30T13:15:31.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.446+0000 7fd0e6000640 1 -- 172.21.15.44:0/175297449 learned_addr learned my addr 172.21.15.44:0/175297449 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.446+0000 7fd0e6a00640 1 --2- 172.21.15.44:0/175297449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c290 0x5579b58c2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.446+0000 7fd0e7400640 1 --2- 172.21.15.44:0/175297449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c670 0x5579b589b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.446+0000 7fd0e6000640 1 -- 172.21.15.44:0/175297449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c670 msgr2=0x5579b589b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.446+0000 7fd0e6000640 1 --2- 172.21.15.44:0/175297449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c670 0x5579b589b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.446+0000 7fd0e6000640 1 -- 172.21.15.44:0/175297449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c290 msgr2=0x5579b58c2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.446+0000 7fd0e6000640 1 --2- 172.21.15.44:0/175297449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c290 0x5579b58c2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.446+0000 7fd0e6000640 1 -- 172.21.15.44:0/175297449 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579b55df920 con 0x5579b58c3300 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.447+0000 7fd0e6000640 1 --2- 172.21.15.44:0/175297449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58c3300 0x5579b589b2d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0016740 tx=0x7fd0d0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973f78f933430b4f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.447+0000 7fd0d7000640 1 -- 172.21.15.44:0/175297449 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0026070 con 0x5579b58c3300 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.447+0000 7fd0d7000640 1 -- 172.21.15.44:0/175297449 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d0014a20 con 0x5579b58c3300 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.447+0000 7fd0d7000640 1 -- 172.21.15.44:0/175297449 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0014dd0 con 0x5579b58c3300 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.447+0000 7fd0f042e740 1 -- 172.21.15.44:0/175297449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58c3300 msgr2=0x5579b589b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.447+0000 7fd0f042e740 1 --2- 172.21.15.44:0/175297449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58c3300 0x5579b589b2d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0016740 tx=0x7fd0d0012000 comp rx=0 tx=0).stop 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.448+0000 7fd0f042e740 1 -- 172.21.15.44:0/175297449 shutdown_connections 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.448+0000 7fd0f042e740 1 --2- 172.21.15.44:0/175297449 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c670 0x5579b589b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.448+0000 7fd0f042e740 1 --2- 172.21.15.44:0/175297449 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58c3300 0x5579b589b2d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.448+0000 7fd0f042e740 1 --2- 172.21.15.44:0/175297449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c290 0x5579b58c2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.448+0000 7fd0f042e740 1 -- 172.21.15.44:0/175297449 >> 172.21.15.44:0/175297449 conn(0x5579b5862be0 msgr2=0x5579b58e0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.448+0000 7fd0f042e740 1 -- 172.21.15.44:0/175297449 shutdown_connections 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.448+0000 7fd0f042e740 1 -- 172.21.15.44:0/175297449 wait complete. 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.448+0000 7fd0f042e740 1 -- start start 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.449+0000 7fd0f042e740 1 Processor -- start 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0f042e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c290 0x5579b58b9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0f042e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c670 0x5579b58e4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0f042e740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b58ded50 0x5579b58c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0f042e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5579b58c2930 con 0x5579b589c290 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0f042e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5579b57ba9d0 con 0x5579b589c670 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0f042e740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5579b58bb6b0 con 0x5579b58ded50 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0f042e740 10 client.0 _ll_register_callbacks cb 0x5579b57f6fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:31.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0e6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c290 0x5579b58b9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0e6a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c290 0x5579b58b9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54650/0 (socket says 172.21.15.44:54650) 2024-03-30T13:15:31.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0e6a00640 1 -- 172.21.15.44:0/3599197817 learned_addr learned my addr 172.21.15.44:0/3599197817 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0e6000640 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c670 0x5579b58e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0e7400640 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b58ded50 0x5579b58c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0e6a00640 1 -- 172.21.15.44:0/3599197817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b58ded50 msgr2=0x5579b58c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0e6a00640 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b58ded50 0x5579b58c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0e6a00640 1 -- 172.21.15.44:0/3599197817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c670 msgr2=0x5579b58e4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0e6a00640 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c670 0x5579b58e4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.450+0000 7fd0e6a00640 1 -- 172.21.15.44:0/3599197817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579b54d3210 con 0x5579b589c290 2024-03-30T13:15:31.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.451+0000 7fd0e6a00640 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c290 0x5579b58b9e30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8000fb0 tx=0x7fd0d80591d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd471facbbe2bd8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.451+0000 7fd0cf400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:31.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.451+0000 7fd0cf400640 1 -- 172.21.15.44:0/3599197817 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80612e0 con 0x5579b589c290 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.451+0000 7fd0cf400640 1 -- 172.21.15.44:0/3599197817 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fd0d8007490 con 0x5579b589c290 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.451+0000 7fd0f042e740 1 -- 172.21.15.44:0/3599197817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0d0014a20 con 0x5579b589c290 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.451+0000 7fd0cf400640 1 -- 172.21.15.44:0/3599197817 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd0d8007690 con 0x5579b589c290 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.451+0000 7fd0f042e740 10 client.6489 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.451+0000 7fd0f042e740 1 -- 172.21.15.44:0/3599197817 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5579b56400b0 con 0x5579b589c290 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.451+0000 7fd0cf400640 1 -- 172.21.15.44:0/3599197817 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d0014a20 con 0x5579b589c290 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.452+0000 7fd0cf400640 1 -- 172.21.15.44:0/3599197817 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fd0d8057de0 con 0x5579b589c290 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.452+0000 7fd0f042e740 10 client.6489 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.452+0000 7fd0f042e740 10 client.6489 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.452+0000 7fd0f042e740 20 client.6489 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.452+0000 7fd0f042e740 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5579b58e3730 0x5579b58fe180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.452+0000 7fd0f042e740 4 client.6489 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:31.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.452+0000 7fd0f042e740 1 -- 172.21.15.44:0/3599197817 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579b580c870 con 0x5579b58e3730 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.452+0000 7fd0e6000640 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5579b58e3730 0x5579b58fe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.453+0000 7fd0e6000640 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5579b58e3730 0x5579b58fe180 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=293b2e2f33be142d server_cookie=bf9538f23d495f4e in_seq=0 out_seq=0 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.453+0000 7fd0cf400640 10 client.6489 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.453+0000 7fd0cf400640 1 -- 172.21.15.44:0/3599197817 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5579b580c870 con 0x5579b58e3730 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.453+0000 7fd0cf400640 10 client.6489 handle_command_reply: tid=0 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.453+0000 7fd0f042e740 1 client.6489 shutdown 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.454+0000 7fd0f042e740 1 -- 172.21.15.44:0/3599197817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c290 msgr2=0x5579b58b9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.454+0000 7fd0f042e740 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c290 0x5579b58b9e30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8000fb0 tx=0x7fd0d80591d0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.454+0000 7fd0f042e740 1 -- 172.21.15.44:0/3599197817 shutdown_connections 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.454+0000 7fd0f042e740 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5579b58e3730 0x5579b58fe180 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.454+0000 7fd0f042e740 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b58ded50 0x5579b58c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.454+0000 7fd0f042e740 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c670 0x5579b58e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.454+0000 7fd0f042e740 1 --2- 172.21.15.44:0/3599197817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c290 0x5579b58b9e30 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.454+0000 7fd0f042e740 1 -- 172.21.15.44:0/3599197817 >> 172.21.15.44:0/3599197817 conn(0x5579b5862be0 msgr2=0x5579b58c1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.454+0000 7fd0cf400640 0 client.6489 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:31.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.454+0000 7fd0f042e740 1 -- 172.21.15.44:0/3599197817 shutdown_connections 2024-03-30T13:15:31.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.454+0000 7fd0f042e740 1 -- 172.21.15.44:0/3599197817 wait complete. 2024-03-30T13:15:31.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.454+0000 7fd0f042e740 20 client.6489 trim_cache size 0 max 16384 2024-03-30T13:15:31.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.470+0000 7fd0f042e740 1 Processor -- start 2024-03-30T13:15:31.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.470+0000 7fd0f042e740 1 -- start start 2024-03-30T13:15:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.471+0000 7fd0f042e740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c290 0x5579b58b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.471+0000 7fd0f042e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c670 0x5579b58c1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.471+0000 7fd0f042e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58ded50 0x5579b58c9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.471+0000 7fd0f042e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5579b58ddeb0 con 0x5579b58ded50 2024-03-30T13:15:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.471+0000 7fd0f042e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8201370 con 0x5579b589c670 2024-03-30T13:15:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.471+0000 7fd0f042e740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e8200390 con 0x5579b589c290 2024-03-30T13:15:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.471+0000 7fd0e7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58ded50 0x5579b58c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.471+0000 7fd0e7400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58ded50 0x5579b58c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54664/0 (socket says 172.21.15.44:54664) 2024-03-30T13:15:31.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.471+0000 7fd0e7400640 1 -- 172.21.15.44:0/1244403921 learned_addr learned my addr 172.21.15.44:0/1244403921 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.472+0000 7fd0e6000640 1 --2- 172.21.15.44:0/1244403921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c670 0x5579b58c1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.472+0000 7fd0e7400640 1 -- 172.21.15.44:0/1244403921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c290 msgr2=0x5579b58b9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.472+0000 7fd0e6a00640 1 --2- 172.21.15.44:0/1244403921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c290 0x5579b58b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.472+0000 7fd0e7400640 1 --2- 172.21.15.44:0/1244403921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c290 0x5579b58b9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.472+0000 7fd0e7400640 1 -- 172.21.15.44:0/1244403921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c670 msgr2=0x5579b58c1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.472+0000 7fd0e7400640 1 --2- 172.21.15.44:0/1244403921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c670 0x5579b58c1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.472+0000 7fd0e7400640 1 -- 172.21.15.44:0/1244403921 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579b54ac2d0 con 0x5579b58ded50 2024-03-30T13:15:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.472+0000 7fd0e7400640 1 --2- 172.21.15.44:0/1244403921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58ded50 0x5579b58c9060 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009890 tx=0x7fd0e002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660fb7790b6fa4e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.473+0000 7fd0d6600640 1 -- 172.21.15.44:0/1244403921 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0038040 con 0x5579b58ded50 2024-03-30T13:15:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.473+0000 7fd0d6600640 1 -- 172.21.15.44:0/1244403921 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e0031820 con 0x5579b58ded50 2024-03-30T13:15:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.473+0000 7fd0d6600640 1 -- 172.21.15.44:0/1244403921 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0031c10 con 0x5579b58ded50 2024-03-30T13:15:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.473+0000 7fd0f042e740 1 -- 172.21.15.44:0/1244403921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58ded50 msgr2=0x5579b58c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.473+0000 7fd0f042e740 1 --2- 172.21.15.44:0/1244403921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58ded50 0x5579b58c9060 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009890 tx=0x7fd0e002e000 comp rx=0 tx=0).stop 2024-03-30T13:15:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.473+0000 7fd0f042e740 1 -- 172.21.15.44:0/1244403921 shutdown_connections 2024-03-30T13:15:31.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.473+0000 7fd0f042e740 1 --2- 172.21.15.44:0/1244403921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b58ded50 0x5579b58c9060 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.473+0000 7fd0f042e740 1 --2- 172.21.15.44:0/1244403921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b589c670 0x5579b58c1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.473+0000 7fd0f042e740 1 --2- 172.21.15.44:0/1244403921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c290 0x5579b58b9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.473+0000 7fd0f042e740 1 -- 172.21.15.44:0/1244403921 >> 172.21.15.44:0/1244403921 conn(0x5579b5862be0 msgr2=0x5579b58ef6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.473+0000 7fd0f042e740 1 -- 172.21.15.44:0/1244403921 shutdown_connections 2024-03-30T13:15:31.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.473+0000 7fd0f042e740 1 -- 172.21.15.44:0/1244403921 wait complete. 2024-03-30T13:15:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.474+0000 7fd0f042e740 1 -- start start 2024-03-30T13:15:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.474+0000 7fd0f042e740 1 Processor -- start 2024-03-30T13:15:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.475+0000 7fd0f042e740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c290 0x5579b5895070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.475+0000 7fd0f042e740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c670 0x5579b593eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.475+0000 7fd0f042e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b58ded50 0x5579b58d9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.475+0000 7fd0f042e740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e81445a0 con 0x5579b589c670 2024-03-30T13:15:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.475+0000 7fd0f042e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e81f8c00 con 0x5579b58ded50 2024-03-30T13:15:31.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.475+0000 7fd0f042e740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x5579b5903e80 con 0x5579b589c290 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.475+0000 7fd0f042e740 10 client.0 _ll_register_callbacks cb 0x7fd0d8058380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.475+0000 7fd0e6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c670 0x5579b593eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0e6000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c670 0x5579b593eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54666/0 (socket says 172.21.15.44:54666) 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0e6000640 1 -- 172.21.15.44:0/2960801037 learned_addr learned my addr 172.21.15.44:0/2960801037 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0e7400640 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b58ded50 0x5579b58d9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0e6a00640 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c290 0x5579b5895070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0e6000640 1 -- 172.21.15.44:0/2960801037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c290 msgr2=0x5579b5895070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0e6000640 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c290 0x5579b5895070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0e6000640 1 -- 172.21.15.44:0/2960801037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b58ded50 msgr2=0x5579b58d9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0e6000640 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b58ded50 0x5579b58d9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0e6000640 1 -- 172.21.15.44:0/2960801037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579b5902760 con 0x5579b589c670 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0e7400640 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b58ded50 0x5579b58d9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0e6a00640 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c290 0x5579b5895070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:31.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0e6000640 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c670 0x5579b593eb30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x5579b58ca670 tx=0x7fd0d0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b81cd265fbdea2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.476+0000 7fd0cf400640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0cf400640 1 -- 172.21.15.44:0/2960801037 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0026040 con 0x5579b589c670 2024-03-30T13:15:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0cf400640 1 -- 172.21.15.44:0/2960801037 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fd0d0014c50 con 0x5579b589c670 2024-03-30T13:15:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0f042e740 1 -- 172.21.15.44:0/2960801037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0e0031820 con 0x5579b589c670 2024-03-30T13:15:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0cf400640 1 -- 172.21.15.44:0/2960801037 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fd0d0014e50 con 0x5579b589c670 2024-03-30T13:15:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0f042e740 10 client.6495 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0f042e740 1 -- 172.21.15.44:0/2960801037 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5579b58da450 con 0x5579b589c670 2024-03-30T13:15:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0cf400640 1 -- 172.21.15.44:0/2960801037 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e0031820 con 0x5579b589c670 2024-03-30T13:15:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0cf400640 1 -- 172.21.15.44:0/2960801037 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fd0d0033280 con 0x5579b589c670 2024-03-30T13:15:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0f042e740 10 client.6495 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:31.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0f042e740 10 client.6495 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0f042e740 20 client.6495 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0f042e740 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5579b59419d0 0x5579b5941de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0f042e740 4 client.6495 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628430}] 2024-03-30T13:15:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.477+0000 7fd0f042e740 1 -- 172.21.15.44:0/2960801037 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628430}) -- 0x5579b5806bc0 con 0x5579b59419d0 2024-03-30T13:15:31.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.478+0000 7fd0e6a00640 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5579b59419d0 0x5579b5941de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.478+0000 7fd0e6a00640 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5579b59419d0 0x5579b5941de0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7733e7a9048e345e server_cookie=20bb3bb845af100f in_seq=0 out_seq=0 2024-03-30T13:15:31.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.478+0000 7fd0cf400640 10 client.6495 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:31.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0cf400640 1 -- 172.21.15.44:0/2960801037 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4759 (crc 0 0 0) 0x5579b5806bc0 con 0x5579b59419d0 2024-03-30T13:15:31.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0cf400640 10 client.6495 handle_command_reply: tid=0 2024-03-30T13:15:31.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0f042e740 1 client.6495 shutdown 2024-03-30T13:15:31.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0f042e740 1 -- 172.21.15.44:0/2960801037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c670 msgr2=0x5579b593eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0f042e740 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c670 0x5579b593eb30 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x5579b58ca670 tx=0x7fd0d0004ab0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0f042e740 1 -- 172.21.15.44:0/2960801037 shutdown_connections 2024-03-30T13:15:31.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0f042e740 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x5579b59419d0 0x5579b5941de0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0f042e740 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5579b58ded50 0x5579b58d9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0f042e740 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5579b589c670 0x5579b593eb30 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0f042e740 1 --2- 172.21.15.44:0/2960801037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5579b589c290 0x5579b5895070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0cf400640 0 client.6495 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:31.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0f042e740 1 -- 172.21.15.44:0/2960801037 >> 172.21.15.44:0/2960801037 conn(0x5579b5862be0 msgr2=0x5579b58de030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0f042e740 1 -- 172.21.15.44:0/2960801037 shutdown_connections 2024-03-30T13:15:31.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0f042e740 1 -- 172.21.15.44:0/2960801037 wait complete. 2024-03-30T13:15:31.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.479+0000 7fd0f042e740 20 client.6495 trim_cache size 0 max 16384 2024-03-30T13:15:31.490 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:31.490 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/symlink.c", 2024-03-30T13:15:31.490 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628430, 2024-03-30T13:15:31.490 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:31.490 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.661720+0000", 2024-03-30T13:15:31.490 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.792530+0000", 2024-03-30T13:15:31.491 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:31.491 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:31.491 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:31.491 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:31.491 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:31.491 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:31.491 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:31.491 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:31.491 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:31.491 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.491 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:31.491 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:31.492 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:31.492 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:31.492 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:31.492 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:31.492 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 497, 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.792530+0000", 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:31.493 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:31.494 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 497, 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.661720+0000" 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:31.495 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 497, 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.661720+0000" 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 264, 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 50, 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:31.496 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.497 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:31.498 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:31.499 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.500 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.501 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.502 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:31.503 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:31.504 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:31.505 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:31.505 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:31.505 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:31.505 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:31.505 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:31.505 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.505 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:31.505 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:31.505 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:31.505 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:31.505 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.480+0000 7fd0ed600640 1 -- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd0c406c530 msgr2=0x7fd0c406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.480+0000 7fd0ed600640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd0c406c530 0x7fd0c406e9f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80b4920 tx=0x7fd0d000b040 comp rx=0 tx=0).stop 2024-03-30T13:15:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.480+0000 7fd0ed600640 1 -- 172.21.15.44:0/2479987922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e806d8f0 msgr2=0x7fd0e80726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.480+0000 7fd0ed600640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e806d8f0 0x7fd0e80726e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd0d800c3c0 tx=0x7fd0d800c880 comp rx=0 tx=0).stop 2024-03-30T13:15:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.480+0000 7fd0ed600640 1 -- 172.21.15.44:0/2479987922 shutdown_connections 2024-03-30T13:15:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.480+0000 7fd0ed600640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0e81603d0 0x7fd0e813aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.480+0000 7fd0ed600640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd0c406c530 0x7fd0c406e9f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.480+0000 7fd0ed600640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0e813f0c0 0x7fd0e813a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.480+0000 7fd0ed600640 1 --2- 172.21.15.44:0/2479987922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd0e806d8f0 0x7fd0e80726e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.480+0000 7fd0ed600640 1 -- 172.21.15.44:0/2479987922 >> 172.21.15.44:0/2479987922 conn(0x7fd0e80b5b00 msgr2=0x7fd0e80b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.480+0000 7fd0ed600640 1 -- 172.21.15.44:0/2479987922 shutdown_connections 2024-03-30T13:15:31.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.480+0000 7fd0ed600640 1 -- 172.21.15.44:0/2479987922 wait complete. 2024-03-30T13:15:31.508 DEBUG:tasks.cephfs.test_uninlining:getting inode info #23 of 23:1099511628412 2024-03-30T13:15:31.508 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511628412 2024-03-30T13:15:31.508 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump inode 1099511628412 2024-03-30T13:15:31.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.717+0000 7fc5fb200640 1 Processor -- start 2024-03-30T13:15:31.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.718+0000 7fc5fb200640 1 -- start start 2024-03-30T13:15:31.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.719+0000 7fc5fb200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5f40b4920 0x7fc5f40b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.719+0000 7fc5fb200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40b4d00 0x7fc5f40d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.719+0000 7fc5fb200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc5f40d0b90 0x7fc5f40d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.719+0000 7fc5fb200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f40d0260 con 0x7fc5f40b4920 2024-03-30T13:15:31.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.719+0000 7fc5fb200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f40b54b0 con 0x7fc5f40d0b90 2024-03-30T13:15:31.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.719+0000 7fc5fb200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f40cfca0 con 0x7fc5f40b4d00 2024-03-30T13:15:31.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.719+0000 7fc5f9e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5f40b4920 0x7fc5f40b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.719+0000 7fc5f9e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc5f40b4920 0x7fc5f40b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54670/0 (socket says 172.21.15.44:54670) 2024-03-30T13:15:31.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.719+0000 7fc5f9e00640 1 -- 172.21.15.44:0/2261314631 learned_addr learned my addr 172.21.15.44:0/2261314631 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.720+0000 7fc5fa800640 1 --2- 172.21.15.44:0/2261314631 >> v2:172.21.15.151:3300/0 conn(0x7fc5f40d0b90 0x7fc5f40d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.720+0000 7fc5f9400640 1 --2- 172.21.15.44:0/2261314631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40b4d00 0x7fc5f40d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.720+0000 7fc5f9e00640 1 -- 172.21.15.44:0/2261314631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40b4d00 msgr2=0x7fc5f40d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.720+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/2261314631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40b4d00 0x7fc5f40d4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.720+0000 7fc5f9e00640 1 -- 172.21.15.44:0/2261314631 >> v2:172.21.15.151:3300/0 conn(0x7fc5f40d0b90 msgr2=0x7fc5f40d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.720+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/2261314631 >> v2:172.21.15.151:3300/0 conn(0x7fc5f40d0b90 0x7fc5f40d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.720+0000 7fc5f9e00640 1 -- 172.21.15.44:0/2261314631 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f40cff80 con 0x7fc5f40b4920 2024-03-30T13:15:31.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.721+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/2261314631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f40b4920 0x7fc5f40b3ab0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc5f408c940 tx=0x7fc5e802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afaa85f50a222b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.722+0000 7fc5f8a00640 1 -- 172.21.15.44:0/2261314631 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e802e070 con 0x7fc5f40b4920 2024-03-30T13:15:31.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.722+0000 7fc5f8a00640 1 -- 172.21.15.44:0/2261314631 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8037070 con 0x7fc5f40b4920 2024-03-30T13:15:31.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.722+0000 7fc5f8a00640 1 -- 172.21.15.44:0/2261314631 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8031a00 con 0x7fc5f40b4920 2024-03-30T13:15:31.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.722+0000 7fc5fb200640 1 -- 172.21.15.44:0/2261314631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f40b4920 msgr2=0x7fc5f40b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.722+0000 7fc5fb200640 1 --2- 172.21.15.44:0/2261314631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f40b4920 0x7fc5f40b3ab0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc5f408c940 tx=0x7fc5e802b880 comp rx=0 tx=0).stop 2024-03-30T13:15:31.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.723+0000 7fc5fb200640 1 -- 172.21.15.44:0/2261314631 shutdown_connections 2024-03-30T13:15:31.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.723+0000 7fc5fb200640 1 --2- 172.21.15.44:0/2261314631 >> v2:172.21.15.151:3300/0 conn(0x7fc5f40d0b90 0x7fc5f40d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.723+0000 7fc5fb200640 1 --2- 172.21.15.44:0/2261314631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40b4d00 0x7fc5f40d4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.723+0000 7fc5fb200640 1 --2- 172.21.15.44:0/2261314631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f40b4920 0x7fc5f40b3ab0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.723+0000 7fc5fb200640 1 -- 172.21.15.44:0/2261314631 >> 172.21.15.44:0/2261314631 conn(0x7fc5f409d4e0 msgr2=0x7fc5f40d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.723+0000 7fc5fb200640 1 -- 172.21.15.44:0/2261314631 shutdown_connections 2024-03-30T13:15:31.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.723+0000 7fc5fb200640 1 -- 172.21.15.44:0/2261314631 wait complete. 2024-03-30T13:15:31.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.724+0000 7fc5fb200640 1 Processor -- start 2024-03-30T13:15:31.729 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.725+0000 7fc5fb200640 1 -- start start 2024-03-30T13:15:31.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.726+0000 7fc5fb200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f40b4920 0x7fc5f415bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.726+0000 7fc5fb200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f40b4d00 0x7fc5f40b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.726+0000 7fc5fb200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40d0b90 0x7fc5f40b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.726+0000 7fc5fb200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f40b3ff0 con 0x7fc5f40b4920 2024-03-30T13:15:31.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.726+0000 7fc5fb200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f40d2180 con 0x7fc5f40b4d00 2024-03-30T13:15:31.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.726+0000 7fc5fb200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f40d5000 con 0x7fc5f40d0b90 2024-03-30T13:15:31.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.727+0000 7fc5f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f40b4920 0x7fc5f415bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.727+0000 7fc5f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f40b4920 0x7fc5f415bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54680/0 (socket says 172.21.15.44:54680) 2024-03-30T13:15:31.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.727+0000 7fc5f9e00640 1 -- 172.21.15.44:0/2210703696 learned_addr learned my addr 172.21.15.44:0/2210703696 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.727+0000 7fc5f9e00640 1 -- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40d0b90 msgr2=0x7fc5f40b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.727+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40d0b90 0x7fc5f40b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.727+0000 7fc5f9400640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f40b4d00 0x7fc5f40b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.733 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.727+0000 7fc5f9e00640 1 -- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f40b4d00 msgr2=0x7fc5f40b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.727+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f40b4d00 0x7fc5f40b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.727+0000 7fc5f9e00640 1 -- 172.21.15.44:0/2210703696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f40b7a40 con 0x7fc5f40b4920 2024-03-30T13:15:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.727+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f40b4920 0x7fc5f415bad0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8000c00 tx=0x7fc5e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.728+0000 7fc5ee000640 1 -- 172.21.15.44:0/2210703696 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8032670 con 0x7fc5f40b4920 2024-03-30T13:15:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.728+0000 7fc5ee000640 1 -- 172.21.15.44:0/2210703696 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8032850 con 0x7fc5f40b4920 2024-03-30T13:15:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.728+0000 7fc5ee000640 1 -- 172.21.15.44:0/2210703696 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8032c40 con 0x7fc5f40b4920 2024-03-30T13:15:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.728+0000 7fc5fb200640 1 -- 172.21.15.44:0/2210703696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f40b7d20 con 0x7fc5f40b4920 2024-03-30T13:15:31.734 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.728+0000 7fc5fb200640 1 -- 172.21.15.44:0/2210703696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f40cb380 con 0x7fc5f40b4920 2024-03-30T13:15:31.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.730+0000 7fc5ee000640 1 -- 172.21.15.44:0/2210703696 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc5e804c060 con 0x7fc5f40b4920 2024-03-30T13:15:31.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.732+0000 7fc5ee000640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc5d806c530 0x7fc5d806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.732+0000 7fc5ee000640 1 -- 172.21.15.44:0/2210703696 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fc5e80ad3d0 con 0x7fc5f40b4920 2024-03-30T13:15:31.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.732+0000 7fc5f9400640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc5d806c530 0x7fc5d806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.733+0000 7fc5ff449740 1 Processor -- start 2024-03-30T13:15:31.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.733+0000 7fc5ff449740 1 -- start start 2024-03-30T13:15:31.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5ff449740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 0x55e113e22fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5ff449740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113e234e0 0x55e113dfb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5ff449740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113dfb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5f9400640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc5d806c530 0x7fc5d806e9f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40b2f40 tx=0x7fc5e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5ff449740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e113d5f330 con 0x55e113dfc470 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5ff449740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e113d07620 con 0x55e113dfc850 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5ff449740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55e113d5b440 con 0x55e113e234e0 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 0x55e113e22fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 0x55e113e22fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54682/0 (socket says 172.21.15.44:54682) 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5f9e00640 1 -- 172.21.15.44:0/1568147342 learned_addr learned my addr 172.21.15.44:0/1568147342 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5fa800640 1 --2- 172.21.15.44:0/1568147342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113dfb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5f9400640 1 --2- 172.21.15.44:0/1568147342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113e234e0 0x55e113dfb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5f9e00640 1 -- 172.21.15.44:0/1568147342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113e234e0 msgr2=0x55e113dfb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/1568147342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113e234e0 0x55e113dfb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5f9e00640 1 -- 172.21.15.44:0/1568147342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 msgr2=0x55e113dfb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.734+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/1568147342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113dfb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.735+0000 7fc5f9e00640 1 -- 172.21.15.44:0/1568147342 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e113b3f920 con 0x55e113dfc470 2024-03-30T13:15:31.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.735+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/1568147342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 0x55e113e22fa0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc5e807ad90 tx=0x7fc5e8009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50601b4c69e9223 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.735+0000 7fc5e2600640 1 -- 172.21.15.44:0/1568147342 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e807f440 con 0x55e113dfc470 2024-03-30T13:15:31.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.735+0000 7fc5e2600640 1 -- 172.21.15.44:0/1568147342 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8037070 con 0x55e113dfc470 2024-03-30T13:15:31.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.735+0000 7fc5e2600640 1 -- 172.21.15.44:0/1568147342 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8083c70 con 0x55e113dfc470 2024-03-30T13:15:31.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.736+0000 7fc5ff449740 1 -- 172.21.15.44:0/1568147342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 msgr2=0x55e113e22fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.736+0000 7fc5ff449740 1 --2- 172.21.15.44:0/1568147342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 0x55e113e22fa0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc5e807ad90 tx=0x7fc5e8009240 comp rx=0 tx=0).stop 2024-03-30T13:15:31.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.736+0000 7fc5ff449740 1 -- 172.21.15.44:0/1568147342 shutdown_connections 2024-03-30T13:15:31.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.736+0000 7fc5ff449740 1 --2- 172.21.15.44:0/1568147342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113dfb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.736+0000 7fc5ff449740 1 --2- 172.21.15.44:0/1568147342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113e234e0 0x55e113dfb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.736+0000 7fc5ff449740 1 --2- 172.21.15.44:0/1568147342 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 0x55e113e22fa0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.736+0000 7fc5ff449740 1 -- 172.21.15.44:0/1568147342 >> 172.21.15.44:0/1568147342 conn(0x55e113dc2be0 msgr2=0x55e113e41190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.736+0000 7fc5ff449740 1 -- 172.21.15.44:0/1568147342 shutdown_connections 2024-03-30T13:15:31.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.736+0000 7fc5ff449740 1 -- 172.21.15.44:0/1568147342 wait complete. 2024-03-30T13:15:31.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.737+0000 7fc5ff449740 1 -- start start 2024-03-30T13:15:31.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.737+0000 7fc5ff449740 1 Processor -- start 2024-03-30T13:15:31.745 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.738+0000 7fc5ff449740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113dfc470 0x55e113e37670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.738+0000 7fc5ff449740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113e291d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.738+0000 7fc5ff449740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 0x55e113e21fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.738+0000 7fc5ff449740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e113d5b440 con 0x55e113e0c210 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.738+0000 7fc5ff449740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e113d1a9d0 con 0x55e113dfc850 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.738+0000 7fc5ff449740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55e113d5f330 con 0x55e113dfc470 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.738+0000 7fc5ff449740 10 client.0 _ll_register_callbacks cb 0x55e113d56fd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.738+0000 7fc5fa800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 0x55e113e21fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.738+0000 7fc5fa800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 0x55e113e21fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54694/0 (socket says 172.21.15.44:54694) 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.738+0000 7fc5fa800640 1 -- 172.21.15.44:0/145090510 learned_addr learned my addr 172.21.15.44:0/145090510 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.739+0000 7fc5fa800640 1 -- 172.21.15.44:0/145090510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113dfc470 msgr2=0x55e113e37670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.739+0000 7fc5fa800640 1 --2- 172.21.15.44:0/145090510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113dfc470 0x55e113e37670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.739+0000 7fc5fa800640 1 -- 172.21.15.44:0/145090510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 msgr2=0x55e113e291d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.739+0000 7fc5fa800640 1 --2- 172.21.15.44:0/145090510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113e291d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.739+0000 7fc5fa800640 1 -- 172.21.15.44:0/145090510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e113a33210 con 0x55e113e0c210 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.739+0000 7fc5fa800640 1 --2- 172.21.15.44:0/145090510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 0x55e113e21fe0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0007a30 tx=0x7fc5f0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec18cb14ef4e47 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.739+0000 7fc5d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.739+0000 7fc5d6a00640 1 -- 172.21.15.44:0/145090510 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000fcc0 con 0x55e113e0c210 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.739+0000 7fc5d6a00640 1 -- 172.21.15.44:0/145090510 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fc5f0016420 con 0x55e113e0c210 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.739+0000 7fc5ff449740 1 -- 172.21.15.44:0/145090510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5e8037070 con 0x55e113e0c210 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.739+0000 7fc5d6a00640 1 -- 172.21.15.44:0/145090510 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc5f0023050 con 0x55e113e0c210 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.740+0000 7fc5ff449740 10 client.6507 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.740+0000 7fc5ff449740 1 -- 172.21.15.44:0/145090510 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55e113ba00b0 con 0x55e113e0c210 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.740+0000 7fc5d6a00640 1 -- 172.21.15.44:0/145090510 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8037070 con 0x55e113e0c210 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.740+0000 7fc5d6a00640 1 -- 172.21.15.44:0/145090510 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc5f0026020 con 0x55e113e0c210 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.740+0000 7fc5ff449740 10 client.6507 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.740+0000 7fc5ff449740 10 client.6507 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.740+0000 7fc5ff449740 20 client.6507 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:31.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.740+0000 7fc5ff449740 1 --2- 172.21.15.44:0/145090510 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e113e277e0 0x55e113e27c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.740+0000 7fc5ff449740 4 client.6507 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-30T13:15:31.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.740+0000 7fc5ff449740 1 -- 172.21.15.44:0/145090510 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e113d6c870 con 0x55e113e277e0 2024-03-30T13:15:31.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.740+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/145090510 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e113e277e0 0x55e113e27c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.741+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/145090510 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e113e277e0 0x55e113e27c70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d43a1d8b1639fe server_cookie=5a9ec1436ecacb90 in_seq=0 out_seq=0 2024-03-30T13:15:31.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.741+0000 7fc5d6a00640 10 client.6507 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:31.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.741+0000 7fc5d6a00640 1 -- 172.21.15.44:0/145090510 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55e113d6c870 con 0x55e113e277e0 2024-03-30T13:15:31.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.741+0000 7fc5d6a00640 10 client.6507 handle_command_reply: tid=0 2024-03-30T13:15:31.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.741+0000 7fc5ff449740 1 client.6507 shutdown 2024-03-30T13:15:31.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.742+0000 7fc5ff449740 1 -- 172.21.15.44:0/145090510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 msgr2=0x55e113e21fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.742+0000 7fc5ff449740 1 --2- 172.21.15.44:0/145090510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 0x55e113e21fe0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0007a30 tx=0x7fc5f0007ef0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.742+0000 7fc5ff449740 1 -- 172.21.15.44:0/145090510 shutdown_connections 2024-03-30T13:15:31.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.742+0000 7fc5ff449740 1 --2- 172.21.15.44:0/145090510 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e113e277e0 0x55e113e27c70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.742+0000 7fc5ff449740 1 --2- 172.21.15.44:0/145090510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 0x55e113e21fe0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.742+0000 7fc5ff449740 1 --2- 172.21.15.44:0/145090510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113e291d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.742+0000 7fc5ff449740 1 --2- 172.21.15.44:0/145090510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113dfc470 0x55e113e37670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.742+0000 7fc5d6a00640 0 client.6507 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:31.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.742+0000 7fc5ff449740 1 -- 172.21.15.44:0/145090510 >> 172.21.15.44:0/145090510 conn(0x55e113dc2be0 msgr2=0x55e113df5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.742+0000 7fc5ff449740 1 -- 172.21.15.44:0/145090510 shutdown_connections 2024-03-30T13:15:31.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.742+0000 7fc5ff449740 1 -- 172.21.15.44:0/145090510 wait complete. 2024-03-30T13:15:31.750 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.742+0000 7fc5ff449740 20 client.6507 trim_cache size 0 max 16384 2024-03-30T13:15:31.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.758+0000 7fc5ff449740 1 Processor -- start 2024-03-30T13:15:31.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.758+0000 7fc5ff449740 1 -- start start 2024-03-30T13:15:31.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.759+0000 7fc5ff449740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 0x55e113e19f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.759+0000 7fc5ff449740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113e1a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.759+0000 7fc5ff449740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113e0c210 0x55e113e211c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.759+0000 7fc5ff449740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f4201050 con 0x55e113dfc470 2024-03-30T13:15:31.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.759+0000 7fc5ff449740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f40ccac0 con 0x55e113dfc850 2024-03-30T13:15:31.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.759+0000 7fc5ff449740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f41f57e0 con 0x55e113e0c210 2024-03-30T13:15:31.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.759+0000 7fc5f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 0x55e113e19f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.759+0000 7fc5f9e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 0x55e113e19f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54702/0 (socket says 172.21.15.44:54702) 2024-03-30T13:15:31.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.759+0000 7fc5f9e00640 1 -- 172.21.15.44:0/1574368590 learned_addr learned my addr 172.21.15.44:0/1574368590 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.760+0000 7fc5f9400640 1 --2- 172.21.15.44:0/1574368590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113e1a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.760+0000 7fc5f9e00640 1 -- 172.21.15.44:0/1574368590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113e0c210 msgr2=0x55e113e211c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.760+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/1574368590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113e0c210 0x55e113e211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.760+0000 7fc5f9e00640 1 -- 172.21.15.44:0/1574368590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 msgr2=0x55e113e1a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.760+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/1574368590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113e1a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.760+0000 7fc5f9e00640 1 -- 172.21.15.44:0/1574368590 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e113a0c2d0 con 0x55e113dfc470 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.760+0000 7fc5f9400640 1 --2- 172.21.15.44:0/1574368590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113e1a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.760+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/1574368590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 0x55e113e19f10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc5e802be90 tx=0x7fc5e8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81e62418513599b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.760+0000 7fc5e1c00640 1 -- 172.21.15.44:0/1574368590 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8097030 con 0x55e113dfc470 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.760+0000 7fc5e1c00640 1 -- 172.21.15.44:0/1574368590 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8032de0 con 0x55e113dfc470 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.760+0000 7fc5e1c00640 1 -- 172.21.15.44:0/1574368590 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8079130 con 0x55e113dfc470 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.761+0000 7fc5ff449740 1 -- 172.21.15.44:0/1574368590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 msgr2=0x55e113e19f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.761+0000 7fc5ff449740 1 --2- 172.21.15.44:0/1574368590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 0x55e113e19f10 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc5e802be90 tx=0x7fc5e8037000 comp rx=0 tx=0).stop 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.761+0000 7fc5ff449740 1 -- 172.21.15.44:0/1574368590 shutdown_connections 2024-03-30T13:15:31.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.761+0000 7fc5ff449740 1 --2- 172.21.15.44:0/1574368590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113e0c210 0x55e113e211c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.761+0000 7fc5ff449740 1 --2- 172.21.15.44:0/1574368590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113e1a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.761+0000 7fc5ff449740 1 --2- 172.21.15.44:0/1574368590 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113dfc470 0x55e113e19f10 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.761+0000 7fc5ff449740 1 -- 172.21.15.44:0/1574368590 >> 172.21.15.44:0/1574368590 conn(0x55e113dc2be0 msgr2=0x55e113e37480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.761+0000 7fc5ff449740 1 -- 172.21.15.44:0/1574368590 shutdown_connections 2024-03-30T13:15:31.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.761+0000 7fc5ff449740 1 -- 172.21.15.44:0/1574368590 wait complete. 2024-03-30T13:15:31.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.762+0000 7fc5ff449740 1 -- start start 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.762+0000 7fc5ff449740 1 Processor -- start 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.763+0000 7fc5ff449740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113dfc470 0x55e113df57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.763+0000 7fc5ff449740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113ebeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.763+0000 7fc5ff449740 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 0x55e113ebf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.763+0000 7fc5ff449740 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55e113d07620 con 0x55e113e0c210 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.763+0000 7fc5ff449740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f40cc470 con 0x55e113dfc850 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.763+0000 7fc5ff449740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x55e113e36e60 con 0x55e113dfc470 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.763+0000 7fc5ff449740 10 client.0 _ll_register_callbacks cb 0x7fc5f0009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.763+0000 7fc5fa800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 0x55e113ebf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.763+0000 7fc5fa800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 0x55e113ebf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54708/0 (socket says 172.21.15.44:54708) 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.763+0000 7fc5fa800640 1 -- 172.21.15.44:0/356887488 learned_addr learned my addr 172.21.15.44:0/356887488 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.764+0000 7fc5f9400640 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113ebeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.764+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113dfc470 0x55e113df57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.764+0000 7fc5fa800640 1 -- 172.21.15.44:0/356887488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113dfc470 msgr2=0x55e113df57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.764+0000 7fc5fa800640 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113dfc470 0x55e113df57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.764+0000 7fc5fa800640 1 -- 172.21.15.44:0/356887488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 msgr2=0x55e113ebeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.764+0000 7fc5fa800640 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113ebeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.764+0000 7fc5fa800640 1 -- 172.21.15.44:0/356887488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e113df5d30 con 0x55e113e0c210 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.764+0000 7fc5f9400640 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113ebeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.764+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113dfc470 0x55e113df57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.764+0000 7fc5fa800640 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 0x55e113ebf030 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0002230 tx=0x7fc5f0007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c895c0c89cf6009 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.764+0000 7fc5d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.765+0000 7fc5d6a00640 1 -- 172.21.15.44:0/356887488 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f002d070 con 0x55e113e0c210 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.765+0000 7fc5d6a00640 1 -- 172.21.15.44:0/356887488 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fc5f0003da0 con 0x55e113e0c210 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.765+0000 7fc5ff449740 1 -- 172.21.15.44:0/356887488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5e8032de0 con 0x55e113e0c210 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.765+0000 7fc5d6a00640 1 -- 172.21.15.44:0/356887488 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fc5f0009610 con 0x55e113e0c210 2024-03-30T13:15:31.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.765+0000 7fc5ff449740 10 client.6513 fetch_fsmap learned FSMap version 20 2024-03-30T13:15:31.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.765+0000 7fc5ff449740 1 -- 172.21.15.44:0/356887488 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55e113e23210 con 0x55e113e0c210 2024-03-30T13:15:31.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.765+0000 7fc5d6a00640 1 -- 172.21.15.44:0/356887488 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8032de0 con 0x55e113e0c210 2024-03-30T13:15:31.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.765+0000 7fc5d6a00640 1 -- 172.21.15.44:0/356887488 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7fc5f003a020 con 0x55e113e0c210 2024-03-30T13:15:31.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.765+0000 7fc5ff449740 10 client.6513 fetch_fsmap finished waiting for FSMap version 20 2024-03-30T13:15:31.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.765+0000 7fc5ff449740 10 client.6513 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-30T13:15:31.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.765+0000 7fc5ff449740 20 client.6513 populate_metadata read hostname 'smithi044' 2024-03-30T13:15:31.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.765+0000 7fc5ff449740 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e113e44290 0x55e113e446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:31.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.766+0000 7fc5ff449740 4 client.6513 mds_command: new command op to 5298 tid=0 multi_id=0 [{"prefix": "dump inode", "number": 1099511628412}] 2024-03-30T13:15:31.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.766+0000 7fc5ff449740 1 -- 172.21.15.44:0/356887488 --> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] -- command(tid 0: {"prefix": "dump inode", "number": 1099511628412}) -- 0x55e113d66bc0 con 0x55e113e44290 2024-03-30T13:15:31.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.766+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e113e44290 0x55e113e446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:31.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.766+0000 7fc5f9e00640 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e113e44290 0x55e113e446a0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f7b14bf35327036 server_cookie=a55bdd244eba0f36 in_seq=0 out_seq=0 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.766+0000 7fc5d6a00640 10 client.6513 ms_handle_connect on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5d6a00640 1 -- 172.21.15.44:0/356887488 <== mds.0 v2:172.21.15.44:6834/585602782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4763 (crc 0 0 0) 0x55e113d66bc0 con 0x55e113e44290 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5d6a00640 10 client.6513 handle_command_reply: tid=0 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5ff449740 1 client.6513 shutdown 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5ff449740 1 -- 172.21.15.44:0/356887488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 msgr2=0x55e113ebf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5ff449740 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 0x55e113ebf030 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0002230 tx=0x7fc5f0007040 comp rx=0 tx=0).stop 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5ff449740 1 -- 172.21.15.44:0/356887488 shutdown_connections 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5ff449740 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.44:6834/585602782,v1:172.21.15.44:6835/585602782] conn(0x55e113e44290 0x55e113e446a0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5ff449740 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55e113e0c210 0x55e113ebf030 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5ff449740 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e113dfc850 0x55e113ebeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5ff449740 1 --2- 172.21.15.44:0/356887488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e113dfc470 0x55e113df57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5ff449740 1 -- 172.21.15.44:0/356887488 >> 172.21.15.44:0/356887488 conn(0x55e113dc2be0 msgr2=0x55e113e19750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5d6a00640 0 client.6513 ms_handle_reset on v2:172.21.15.44:6834/585602782 2024-03-30T13:15:31.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5ff449740 1 -- 172.21.15.44:0/356887488 shutdown_connections 2024-03-30T13:15:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5ff449740 1 -- 172.21.15.44:0/356887488 wait complete. 2024-03-30T13:15:31.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.767+0000 7fc5ff449740 20 client.6513 trim_cache size 0 max 16384 2024-03-30T13:15:31.776 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:31.776 INFO:teuthology.orchestra.run.smithi044.stdout: "path": "/linux-5.4/fs/orangefs/downcall.h", 2024-03-30T13:15:31.776 INFO:teuthology.orchestra.run.smithi044.stdout: "ino": 1099511628412, 2024-03-30T13:15:31.776 INFO:teuthology.orchestra.run.smithi044.stdout: "rdev": 0, 2024-03-30T13:15:31.776 INFO:teuthology.orchestra.run.smithi044.stdout: "ctime": "2024-03-30T13:14:52.666780+0000", 2024-03-30T13:15:31.776 INFO:teuthology.orchestra.run.smithi044.stdout: "btime": "2024-03-30T13:14:50.745530+0000", 2024-03-30T13:15:31.776 INFO:teuthology.orchestra.run.smithi044.stdout: "mode": 33188, 2024-03-30T13:15:31.776 INFO:teuthology.orchestra.run.smithi044.stdout: "uid": 1000, 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "gid": 1301, 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "nlink": 1, 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_layout": { 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "dir_hash": 0, 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "unused1": 0, 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "unused2": 0, 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "unused3": 0 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "layout": { 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_unit": 4194304, 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "stripe_count": 1, 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "object_size": 4194304, 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_id": 6, 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: "pool_ns": "" 2024-03-30T13:15:31.777 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "old_pools": [], 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "size": 2953, 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_seq": 1, 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_size": 18446744073709551615, 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_from": 0, 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "truncate_pending": 0, 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "2019-11-25T00:32:01.000000+0000", 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "atime": "2024-03-30T13:14:50.745530+0000", 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "time_warp_seq": 1, 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 3, 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "export_pin": -1, 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_random_pin": 0, 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "export_ephemeral_distributed_pin": false, 2024-03-30T13:15:31.778 INFO:teuthology.orchestra.run.smithi044.stdout: "quiesce_block": false, 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: "client_ranges": [ 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: "client": 5161, 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: "byte range": { 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: "first": 0, 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: "last": 4194304 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: "follows": 7 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: "dirstat": { 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:31.779 INFO:teuthology.orchestra.run.smithi044.stdout: "mtime": "0.000000", 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "num_files": 0, 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "num_subdirs": 0, 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "change_attr": 0 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "rstat": { 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 2953, 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.666780+0000" 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "accounted_rstat": { 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 0, 2024-03-30T13:15:31.780 INFO:teuthology.orchestra.run.smithi044.stdout: "rbytes": 2953, 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "rfiles": 1, 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "rsubdirs": 0, 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "rsnaps": 0, 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "rctime": "2024-03-30T13:14:52.666780+0000" 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "version": 270, 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "file_data_version": 0, 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "xattr_version": 1, 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "backtrace_version": 14, 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_version": 18446744073709551615, 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "inline_data_length": 0, 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "stray_prior_path": "", 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "max_size_ever": 0, 2024-03-30T13:15:31.781 INFO:teuthology.orchestra.run.smithi044.stdout: "quota": { 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: "max_bytes": 0, 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: "max_files": 0 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_stamp": "0.000000", 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: "last_scrub_version": 0, 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: "symlink": "", 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrs": [ 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: "key": "security.selinux", 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtree": { 2024-03-30T13:15:31.782 INFO:teuthology.orchestra.run.smithi044.stdout: "splits": [] 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: "old_inodes": [], 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: "oldest_snap": 6, 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: "damage_flags": 0, 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: "is_auth": true, 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_state": { 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: "replicas": {} 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_state": { 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: "authority": [ 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: 0, 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: -2 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: "replica_nonce": 0 2024-03-30T13:15:31.783 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "auth_pins": 0, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "is_frozen": false, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "is_freezing": false, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "pins": { 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "ptrwaiter": 0, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "request": 0, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "lock": 0, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "caps": 1, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent": 1, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty": 1, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "waiter": 0, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "authpin": 0, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "scrubqueue": 0 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.784 INFO:teuthology.orchestra.run.smithi044.stdout: "nref": 3, 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "versionlock": { 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iversion", 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "authlock": { 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iauth", 2024-03-30T13:15:31.785 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "linklock": {}, 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "dirfragtreelock": {}, 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "filelock": { 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ifile", 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.786 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "xattrlock": { 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "excl", 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "ixattr", 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "snaplock": {}, 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "nestlock": { 2024-03-30T13:15:31.787 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "inest", 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "flocklock": {}, 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "policylock": {}, 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "quiescelock": { 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "gather_set": [], 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "lock", 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "iquiesce", 2024-03-30T13:15:31.788 INFO:teuthology.orchestra.run.smithi044.stdout: "is_leased": false, 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: "num_rdlocks": 0, 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: "num_wrlocks": 0, 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: "num_xlocks": 0, 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: "xlock_by": {} 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: "states": [ 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: "auth", 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: "dirty", 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtyparent", 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: "dirtypool" 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: "client_caps": [ 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: "client_id": 5161, 2024-03-30T13:15:31.789 INFO:teuthology.orchestra.run.smithi044.stdout: "pending": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:31.790 INFO:teuthology.orchestra.run.smithi044.stdout: "issued": "pAsxLsXsxFsxcrwb", 2024-03-30T13:15:31.790 INFO:teuthology.orchestra.run.smithi044.stdout: "wanted": "pAsxXsxFxwb", 2024-03-30T13:15:31.790 INFO:teuthology.orchestra.run.smithi044.stdout: "last_sent": 6 2024-03-30T13:15:31.790 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-03-30T13:15:31.790 INFO:teuthology.orchestra.run.smithi044.stdout: ], 2024-03-30T13:15:31.790 INFO:teuthology.orchestra.run.smithi044.stdout: "loner": 5161, 2024-03-30T13:15:31.790 INFO:teuthology.orchestra.run.smithi044.stdout: "want_loner": 5161, 2024-03-30T13:15:31.790 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_caps_wanted": [], 2024-03-30T13:15:31.790 INFO:teuthology.orchestra.run.smithi044.stdout: "is_subvolume": false 2024-03-30T13:15:31.790 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.768+0000 7fc5fb200640 1 -- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc5d806c530 msgr2=0x7fc5d806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.768+0000 7fc5fb200640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc5d806c530 0x7fc5d806e9f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40b2f40 tx=0x7fc5e4008040 comp rx=0 tx=0).stop 2024-03-30T13:15:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.768+0000 7fc5fb200640 1 -- 172.21.15.44:0/2210703696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f40b4920 msgr2=0x7fc5f415bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.768+0000 7fc5fb200640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f40b4920 0x7fc5f415bad0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8000c00 tx=0x7fc5e80046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.768+0000 7fc5fb200640 1 -- 172.21.15.44:0/2210703696 shutdown_connections 2024-03-30T13:15:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.768+0000 7fc5fb200640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5f40d0b90 0x7fc5f40b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.768+0000 7fc5fb200640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc5d806c530 0x7fc5d806e9f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.768+0000 7fc5fb200640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f40b4d00 0x7fc5f40b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.768+0000 7fc5fb200640 1 --2- 172.21.15.44:0/2210703696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5f40b4920 0x7fc5f415bad0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.768+0000 7fc5fb200640 1 -- 172.21.15.44:0/2210703696 >> 172.21.15.44:0/2210703696 conn(0x7fc5f409d4e0 msgr2=0x7fc5f40b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.769+0000 7fc5fb200640 1 -- 172.21.15.44:0/2210703696 shutdown_connections 2024-03-30T13:15:31.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:31.769+0000 7fc5fb200640 1 -- 172.21.15.44:0/2210703696 wait complete. 2024-03-30T13:15:31.793 DEBUG:tasks.cephfs.test_uninlining:removing dir linux-5.4 2024-03-30T13:15:31.793 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && rm -rf linux-5.4/ 2024-03-30T13:15:32.243 INFO:tasks.cephfs.test_uninlining:Found 23 files with inline_data_length == 0 2024-03-30T13:15:32.243 INFO:tasks.cephfs.test_uninlining:Found 23 files with inline_data_version == CEPH_INLINE_NONE 2024-03-30T13:15:32.243 INFO:tasks.cephfs.test_uninlining:Running Data Uninlining test with: clear cache before scrub, without unmount client, without mount.open_background, without multimds, without snapshots 2024-03-30T13:15:32.243 DEBUG:tasks.cephfs.test_uninlining:setting max_mds:1 2024-03-30T13:15:32.243 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-03-30T13:15:32.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.455+0000 7f0587000640 1 Processor -- start 2024-03-30T13:15:32.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.455+0000 7f0587000640 1 -- start start 2024-03-30T13:15:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.457+0000 7f0587000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0580159f90 0x7f05800ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.457+0000 7f0587000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f058006b580 0x7f058006b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.457+0000 7f0587000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f058015c9f0 con 0x7f058015ffe0 2024-03-30T13:15:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.457+0000 7f0587000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f058015cd00 con 0x7f0580159f90 2024-03-30T13:15:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.457+0000 7f0587000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f058006bef0 con 0x7f058006b580 2024-03-30T13:15:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.458+0000 7f057fe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0580159f90 0x7f05800ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:32.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.458+0000 7f057fe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0580159f90 0x7f05800ce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54720/0 (socket says 172.21.15.44:54720) 2024-03-30T13:15:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.458+0000 7f057fe00640 1 -- 172.21.15.44:0/2283826232 learned_addr learned my addr 172.21.15.44:0/2283826232 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.458+0000 7f0585000640 1 --2- 172.21.15.44:0/2283826232 >> v2:172.21.15.151:3300/0 conn(0x7f058006b580 0x7f058006b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.458+0000 7f057fe00640 1 -- 172.21.15.44:0/2283826232 >> v2:172.21.15.151:3300/0 conn(0x7f058006b580 msgr2=0x7f058006b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.458+0000 7f057fe00640 1 --2- 172.21.15.44:0/2283826232 >> v2:172.21.15.151:3300/0 conn(0x7f058006b580 0x7f058006b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.458+0000 7f057fe00640 1 -- 172.21.15.44:0/2283826232 >> v1:172.21.15.151:6789/0 conn(0x7f058015ffe0 legacy=0x7f058015d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.458+0000 7f057fe00640 1 -- 172.21.15.44:0/2283826232 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0580160750 con 0x7f0580159f90 2024-03-30T13:15:32.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.460+0000 7f057fe00640 1 --2- 172.21.15.44:0/2283826232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0580159f90 0x7f05800ce310 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f0580071100 tx=0x7f057002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f4f82853ceeafb server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:32.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.460+0000 7f057ea00640 1 -- 172.21.15.44:0/2283826232 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570035020 con 0x7f0580159f90 2024-03-30T13:15:32.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.460+0000 7f057ea00640 1 -- 172.21.15.44:0/2283826232 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0570031870 con 0x7f0580159f90 2024-03-30T13:15:32.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.460+0000 7f057ea00640 1 -- 172.21.15.44:0/2283826232 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570031c40 con 0x7f0580159f90 2024-03-30T13:15:32.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.461+0000 7f0587000640 1 -- 172.21.15.44:0/2283826232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0580159f90 msgr2=0x7f05800ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:32.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.461+0000 7f0587000640 1 --2- 172.21.15.44:0/2283826232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0580159f90 0x7f05800ce310 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f0580071100 tx=0x7f057002b910 comp rx=0 tx=0).stop 2024-03-30T13:15:32.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.461+0000 7f0587000640 1 -- 172.21.15.44:0/2283826232 shutdown_connections 2024-03-30T13:15:32.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.461+0000 7f0587000640 1 --2- 172.21.15.44:0/2283826232 >> v2:172.21.15.151:3300/0 conn(0x7f058006b580 0x7f058006b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:32.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.461+0000 7f0587000640 1 --2- 172.21.15.44:0/2283826232 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0580159f90 0x7f05800ce310 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:32.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.461+0000 7f0587000640 1 -- 172.21.15.44:0/2283826232 >> 172.21.15.44:0/2283826232 conn(0x7f05800d1160 msgr2=0x7f05800d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:32.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.461+0000 7f0587000640 1 -- 172.21.15.44:0/2283826232 shutdown_connections 2024-03-30T13:15:32.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.461+0000 7f0587000640 1 -- 172.21.15.44:0/2283826232 wait complete. 2024-03-30T13:15:32.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.463+0000 7f0587000640 1 Processor -- start 2024-03-30T13:15:32.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.463+0000 7f0587000640 1 -- start start 2024-03-30T13:15:32.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.464+0000 7f0587000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f058006b580 0x7f058014d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:32.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.464+0000 7f0587000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0580159f90 0x7f0580155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:32.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.464+0000 7f0587000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f058015ffe0 0x7f05800b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:32.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.464+0000 7f0587000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0580160440 con 0x7f058015ffe0 2024-03-30T13:15:32.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.464+0000 7f0587000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0580160d10 con 0x7f058006b580 2024-03-30T13:15:32.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.464+0000 7f0587000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f058015a370 con 0x7f0580159f90 2024-03-30T13:15:32.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.464+0000 7f0585000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f058015ffe0 0x7f05800b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:32.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.464+0000 7f0585000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f058015ffe0 0x7f05800b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54730/0 (socket says 172.21.15.44:54730) 2024-03-30T13:15:32.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.464+0000 7f0585000640 1 -- 172.21.15.44:0/669532760 learned_addr learned my addr 172.21.15.44:0/669532760 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:32.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.464+0000 7f057fe00640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f058006b580 0x7f058014d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:32.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.464+0000 7f0585000640 1 -- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0580159f90 msgr2=0x7f0580155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:32.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.464+0000 7f057f400640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0580159f90 0x7f0580155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:32.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.465+0000 7f0585000640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0580159f90 0x7f0580155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:32.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.465+0000 7f0585000640 1 -- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f058006b580 msgr2=0x7f058014d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:32.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.465+0000 7f0585000640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f058006b580 0x7f058014d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.465+0000 7f0585000640 1 -- 172.21.15.44:0/669532760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058014e3e0 con 0x7f058015ffe0 2024-03-30T13:15:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.465+0000 7f057fe00640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f058006b580 0x7f058014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.465+0000 7f057f400640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0580159f90 0x7f0580155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.465+0000 7f0585000640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f058015ffe0 0x7f05800b1c50 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0578007e40 tx=0x7f057800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.465+0000 7f0577e00640 1 -- 172.21.15.44:0/669532760 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578014620 con 0x7f058015ffe0 2024-03-30T13:15:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.465+0000 7f0577e00640 1 -- 172.21.15.44:0/669532760 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0578019070 con 0x7f058015ffe0 2024-03-30T13:15:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.465+0000 7f0577e00640 1 -- 172.21.15.44:0/669532760 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0578014a20 con 0x7f058015ffe0 2024-03-30T13:15:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.465+0000 7f0587000640 1 -- 172.21.15.44:0/669532760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058015b020 con 0x7f058015ffe0 2024-03-30T13:15:32.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.465+0000 7f0587000640 1 -- 172.21.15.44:0/669532760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f058015b5e0 con 0x7f058015ffe0 2024-03-30T13:15:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.467+0000 7f0587000640 1 -- 172.21.15.44:0/669532760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0580075890 con 0x7f058015ffe0 2024-03-30T13:15:32.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.468+0000 7f0577e00640 1 -- 172.21.15.44:0/669532760 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0578014bc0 con 0x7f058015ffe0 2024-03-30T13:15:32.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.469+0000 7f0577e00640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f056006c560 0x7f056006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:32.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.469+0000 7f0577e00640 1 -- 172.21.15.44:0/669532760 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f057808c180 con 0x7f058015ffe0 2024-03-30T13:15:32.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.470+0000 7f057fe00640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f056006c560 0x7f056006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:32.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.471+0000 7f057fe00640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f056006c560 0x7f056006ea20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0570036000 tx=0x7f0570008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:32.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.474+0000 7f0577e00640 1 -- 172.21.15.44:0/669532760 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f058014e3e0 con 0x7f058015ffe0 2024-03-30T13:15:32.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:32.725+0000 7f0587000640 1 -- 172.21.15.44:0/669532760 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f05800b0af0 con 0x7f058015ffe0 2024-03-30T13:15:33.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.662+0000 7f0577e00640 1 -- 172.21.15.44:0/669532760 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v21) ==== 105+0+0 (secure 0 0 0) 0x7f057805a5d0 con 0x7f058015ffe0 2024-03-30T13:15:33.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.666+0000 7f0587000640 1 -- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f056006c560 msgr2=0x7f056006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:33.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.666+0000 7f0587000640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f056006c560 0x7f056006ea20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0570036000 tx=0x7f0570008030 comp rx=0 tx=0).stop 2024-03-30T13:15:33.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.666+0000 7f0587000640 1 -- 172.21.15.44:0/669532760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f058015ffe0 msgr2=0x7f05800b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:33.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.666+0000 7f0587000640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f058015ffe0 0x7f05800b1c50 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0578007e40 tx=0x7f057800e4b0 comp rx=0 tx=0).stop 2024-03-30T13:15:33.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.666+0000 7f0587000640 1 -- 172.21.15.44:0/669532760 shutdown_connections 2024-03-30T13:15:33.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.666+0000 7f0587000640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f058015ffe0 0x7f05800b1c50 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:33.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.666+0000 7f0587000640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0580159f90 0x7f0580155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:33.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.666+0000 7f0587000640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f056006c560 0x7f056006ea20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:33.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.666+0000 7f0587000640 1 --2- 172.21.15.44:0/669532760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f058006b580 0x7f058014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:33.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.666+0000 7f0587000640 1 -- 172.21.15.44:0/669532760 >> 172.21.15.44:0/669532760 conn(0x7f05800d1160 msgr2=0x7f058006faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:33.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.666+0000 7f0587000640 1 -- 172.21.15.44:0/669532760 shutdown_connections 2024-03-30T13:15:33.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:33.666+0000 7f0587000640 1 -- 172.21.15.44:0/669532760 wait complete. 2024-03-30T13:15:33.699 DEBUG:tasks.cephfs.test_uninlining:getting client_max_inline_size 2024-03-30T13:15:33.699 DEBUG:tasks.cephfs.test_uninlining:got client_max_inline_size:4096 2024-03-30T13:15:33.700 DEBUG:tasks.cephfs.test_uninlining:extracting tarball 2024-03-30T13:15:33.700 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && tar -x -z -f linux-5.4.tar.gz linux-5.4/fs/ceph linux-5.4/fs/orangefs linux-5.4/fs/ext2 2024-03-30T13:15:38.884 DEBUG:tasks.cephfs.test_uninlining:fetching dir list 2024-03-30T13:15:38.884 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -mindepth 2 -maxdepth 2 -type d 2024-03-30T13:15:38.985 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph 2024-03-30T13:15:38.986 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2 2024-03-30T13:15:38.986 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs 2024-03-30T13:15:38.987 DEBUG:tasks.cephfs.test_uninlining:distributing dir pins 2024-03-30T13:15:38.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:38.987 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ceph) 2024-03-30T13:15:39.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:39.034 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ext2) 2024-03-30T13:15:39.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:39.126 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/orangefs) 2024-03-30T13:15:39.173 DEBUG:tasks.cephfs.test_uninlining:listing files with size <= 4096 2024-03-30T13:15:39.173 DEBUG:teuthology.orchestra.run.smithi044:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -type f -size -4097c 2024-03-30T13:15:39.239 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/Kconfig 2024-03-30T13:15:39.239 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/Makefile 2024-03-30T13:15:39.239 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/ceph_frag.c 2024-03-30T13:15:39.239 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/io.h 2024-03-30T13:15:39.239 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ceph/ioctl.h 2024-03-30T13:15:39.239 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/Kconfig 2024-03-30T13:15:39.239 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/xattr_user.c 2024-03-30T13:15:39.239 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/xattr_security.c 2024-03-30T13:15:39.239 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/Makefile 2024-03-30T13:15:39.239 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/symlink.c 2024-03-30T13:15:39.239 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/acl.h 2024-03-30T13:15:39.240 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-30T13:15:39.240 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/ext2/xattr.h 2024-03-30T13:15:39.240 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/Kconfig 2024-03-30T13:15:39.240 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-30T13:15:39.240 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-30T13:15:39.240 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/dcache.c 2024-03-30T13:15:39.240 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-30T13:15:39.240 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-30T13:15:39.240 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-30T13:15:39.240 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/Makefile 2024-03-30T13:15:39.240 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/symlink.c 2024-03-30T13:15:39.240 INFO:teuthology.orchestra.run.smithi044.stdout:linux-5.4/fs/orangefs/downcall.h 2024-03-30T13:15:39.240 INFO:tasks.cephfs.test_uninlining:Found 23 inlined files 2024-03-30T13:15:39.241 DEBUG:tasks.cephfs.test_uninlining:clearing cache 2024-03-30T13:15:39.241 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-30T13:15:39.241 DEBUG:teuthology.orchestra.run.smithi044:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T13:15:39.372 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-30T13:15:39.495 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-30T13:15:39.495 INFO:tasks.cephfs.mount:Terminating background process 2024-03-30T13:15:39.495 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:15:39.496 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:15:39.552 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:15:39.553 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:15:39.604 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:15:39.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.817+0000 7f4adaa00640 1 Processor -- start 2024-03-30T13:15:39.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.818+0000 7f4adaa00640 1 -- start start 2024-03-30T13:15:39.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.819+0000 7f4adaa00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40cd680 0x7f4ad409b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:39.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.819+0000 7f4adaa00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad40cde20 con 0x7f4ad40c6630 2024-03-30T13:15:39.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.820+0000 7f4adaa00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad40ce100 con 0x7f4ad415c640 2024-03-30T13:15:39.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.820+0000 7f4adaa00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad40c61a0 con 0x7f4ad40cd680 2024-03-30T13:15:39.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.820+0000 7f4ada000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4ad40c6630 0x7f4ad40c6ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38394/0 (socket says 172.21.15.44:38394) 2024-03-30T13:15:39.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.820+0000 7f4ada000640 1 -- 172.21.15.44:0/1746586049 learned_addr learned my addr 172.21.15.44:0/1746586049 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:39.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.820+0000 7f4ad8c00640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40cd680 0x7f4ad409b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:39.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.820+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291664254 0 0) 0x7f4ad40cde20 con 0x7f4ad40c6630 2024-03-30T13:15:39.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.820+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4abc003520 con 0x7f4ad40c6630 2024-03-30T13:15:39.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3483948176 0 0) 0x7f4abc003520 con 0x7f4ad40c6630 2024-03-30T13:15:39.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40cd680 msgr2=0x7f4ad409b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:39.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40cd680 0x7f4ad409b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 >> v1:172.21.15.151:6789/0 conn(0x7f4ad415c640 legacy=0x7f4ad409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad40c5b50 con 0x7f4ad40c6630 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f4acc0019f0 con 0x7f4ad40c6630 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 >> v1:172.21.15.44:6789/0 conn(0x7f4ad40c6630 legacy=0x7f4ad40c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc0039e0 0x7f4abc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40cd680 0x7f4abc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4abc004d40 0x7f4abc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad40c61a0 con 0x7f4abc004d40 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc00bad0 con 0x7f4abc0039e0 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4abc0100e0 con 0x7f4ad40cd680 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ada000640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4abc004d40 0x7f4abc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.821+0000 7f4ad9600640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc0039e0 0x7f4abc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.822+0000 7f4ad8c00640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40cd680 0x7f4abc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:39.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.822+0000 7f4ada000640 1 -- 172.21.15.44:0/1746586049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40cd680 msgr2=0x7f4abc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:39.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.822+0000 7f4ada000640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40cd680 0x7f4abc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:39.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.822+0000 7f4ada000640 1 -- 172.21.15.44:0/1746586049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc0039e0 msgr2=0x7f4abc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:39.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.822+0000 7f4ada000640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc0039e0 0x7f4abc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:39.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.822+0000 7f4ada000640 1 -- 172.21.15.44:0/1746586049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc003520 con 0x7f4abc004d40 2024-03-30T13:15:39.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.822+0000 7f4ad8c00640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40cd680 0x7f4abc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:39.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.823+0000 7f4ada000640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4abc004d40 0x7f4abc0051c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00a780 tx=0x7f4abc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca94cb88b365bb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:39.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.823+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc00a3d0 con 0x7f4abc004d40 2024-03-30T13:15:39.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.823+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4acc034630 con 0x7f4abc004d40 2024-03-30T13:15:39.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.823+0000 7f4ad3e00640 1 -- 172.21.15.44:0/1746586049 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc034ae0 con 0x7f4abc004d40 2024-03-30T13:15:39.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.824+0000 7f4adaa00640 1 -- 172.21.15.44:0/1746586049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4abc004d40 msgr2=0x7f4abc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:39.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.824+0000 7f4adaa00640 1 --2- 172.21.15.44:0/1746586049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4abc004d40 0x7f4abc0051c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00a780 tx=0x7f4abc005830 comp rx=0 tx=0).stop 2024-03-30T13:15:39.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.824+0000 7f4ada000640 1 -- 172.21.15.44:0/1746586049 reap_dead start 2024-03-30T13:15:39.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.824+0000 7f4adaa00640 1 -- 172.21.15.44:0/1746586049 shutdown_connections 2024-03-30T13:15:39.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.824+0000 7f4adaa00640 1 -- 172.21.15.44:0/1746586049 >> 172.21.15.44:0/1746586049 conn(0x7f4ad40b3af0 msgr2=0x7f4ad40b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:39.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.824+0000 7f4adaa00640 1 -- 172.21.15.44:0/1746586049 shutdown_connections 2024-03-30T13:15:39.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.824+0000 7f4adaa00640 1 -- 172.21.15.44:0/1746586049 wait complete. 2024-03-30T13:15:39.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.827+0000 7f4adaa00640 1 Processor -- start 2024-03-30T13:15:39.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.827+0000 7f4adaa00640 1 -- start start 2024-03-30T13:15:39.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.829+0000 7f4adaa00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4abc004d40 0x7f4ad40c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:39.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.829+0000 7f4adaa00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40b6950 0x7f4ad40caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:39.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.829+0000 7f4adaa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad40cb400 0x7f4ad414dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:39.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.829+0000 7f4adaa00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad409b140 con 0x7f4abc004d40 2024-03-30T13:15:39.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.829+0000 7f4adaa00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad40cdae0 con 0x7f4ad40cb400 2024-03-30T13:15:39.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.829+0000 7f4adaa00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad409b2c0 con 0x7f4ad40b6950 2024-03-30T13:15:39.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.829+0000 7f4ad9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4abc004d40 0x7f4ad40c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:39.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.829+0000 7f4ad9600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4abc004d40 0x7f4ad40c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59358/0 (socket says 172.21.15.44:59358) 2024-03-30T13:15:39.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.829+0000 7f4ad9600640 1 -- 172.21.15.44:0/2065697301 learned_addr learned my addr 172.21.15.44:0/2065697301 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:39.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.830+0000 7f4ad8c00640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40b6950 0x7f4ad40caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:39.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.830+0000 7f4ad9600640 1 -- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40b6950 msgr2=0x7f4ad40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:39.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.830+0000 7f4ad9600640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40b6950 0x7f4ad40caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:39.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.830+0000 7f4ada000640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad40cb400 0x7f4ad414dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:39.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.830+0000 7f4ad9600640 1 -- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad40cb400 msgr2=0x7f4ad414dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:39.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.830+0000 7f4ad9600640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad40cb400 0x7f4ad414dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:39.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.830+0000 7f4ad9600640 1 -- 172.21.15.44:0/2065697301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad40cb920 con 0x7f4abc004d40 2024-03-30T13:15:39.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.830+0000 7f4ad9600640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4abc004d40 0x7f4ad40c90d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800e500 tx=0x7f4ac800e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:39.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.830+0000 7f4ad1600640 1 -- 172.21.15.44:0/2065697301 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80052e0 con 0x7f4abc004d40 2024-03-30T13:15:39.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.831+0000 7f4ad1600640 1 -- 172.21.15.44:0/2065697301 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac8018070 con 0x7f4abc004d40 2024-03-30T13:15:39.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.831+0000 7f4adaa00640 1 -- 172.21.15.44:0/2065697301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad40cbc00 con 0x7f4abc004d40 2024-03-30T13:15:39.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.831+0000 7f4ad1600640 1 -- 172.21.15.44:0/2065697301 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8003810 con 0x7f4abc004d40 2024-03-30T13:15:39.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.831+0000 7f4adaa00640 1 -- 172.21.15.44:0/2065697301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad40b6dd0 con 0x7f4abc004d40 2024-03-30T13:15:39.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.832+0000 7f4adaa00640 1 -- 172.21.15.44:0/2065697301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad40d1790 con 0x7f4abc004d40 2024-03-30T13:15:39.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.833+0000 7f4ad1600640 1 -- 172.21.15.44:0/2065697301 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4ac80039b0 con 0x7f4abc004d40 2024-03-30T13:15:39.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.834+0000 7f4ad1600640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4ab406c530 0x7f4ab406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:39.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.834+0000 7f4ad1600640 1 -- 172.21.15.44:0/2065697301 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f4ac808b5a0 con 0x7f4abc004d40 2024-03-30T13:15:39.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.834+0000 7f4ad8c00640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4ab406c530 0x7f4ab406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:39.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.836+0000 7f4ad8c00640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4ab406c530 0x7f4ab406e9f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40c8600 tx=0x7f4ac0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:39.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:39.844+0000 7f4ad1600640 1 -- 172.21.15.44:0/2065697301 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4ac8059970 con 0x7f4abc004d40 2024-03-30T13:15:40.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.063+0000 7f4adaa00640 1 -- 172.21.15.44:0/2065697301 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ad40c75e0 con 0x7f4abc004d40 2024-03-30T13:15:40.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.065+0000 7f4ad1600640 1 -- 172.21.15.44:0/2065697301 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16978 (secure 0 0 0) 0x7f4ac8059270 con 0x7f4abc004d40 2024-03-30T13:15:40.070 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:40.071 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":46,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:15:30.641950+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:13:22.414656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-30T13:13:23.348753+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":45,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:15:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.067+0000 7f4adaa00640 1 -- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4ab406c530 msgr2=0x7f4ab406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.067+0000 7f4adaa00640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4ab406c530 0x7f4ab406e9f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40c8600 tx=0x7f4ac0008040 comp rx=0 tx=0).stop 2024-03-30T13:15:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.067+0000 7f4adaa00640 1 -- 172.21.15.44:0/2065697301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4abc004d40 msgr2=0x7f4ad40c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.067+0000 7f4adaa00640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4abc004d40 0x7f4ad40c90d0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800e500 tx=0x7f4ac800e9c0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.067+0000 7f4adaa00640 1 -- 172.21.15.44:0/2065697301 shutdown_connections 2024-03-30T13:15:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.067+0000 7f4adaa00640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4ab406c530 0x7f4ab406e9f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.067+0000 7f4adaa00640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad40cb400 0x7f4ad414dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.067+0000 7f4adaa00640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad40b6950 0x7f4ad40caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.067+0000 7f4adaa00640 1 --2- 172.21.15.44:0/2065697301 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4abc004d40 0x7f4ad40c90d0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.067+0000 7f4adaa00640 1 -- 172.21.15.44:0/2065697301 >> 172.21.15.44:0/2065697301 conn(0x7f4ad40b3af0 msgr2=0x7f4ad40b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.067+0000 7f4adaa00640 1 -- 172.21.15.44:0/2065697301 shutdown_connections 2024-03-30T13:15:40.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.068+0000 7f4adaa00640 1 -- 172.21.15.44:0/2065697301 wait complete. 2024-03-30T13:15:40.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:13:22.414656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:13:23.348753+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 45, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:15:40.095 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:15:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.308+0000 7fd478800640 1 Processor -- start 2024-03-30T13:15:40.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.308+0000 7fd478800640 1 -- start start 2024-03-30T13:15:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.310+0000 7fd478800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd47006d8f0 0x7fd47015fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.310+0000 7fd478800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4700ce9c0 con 0x7fd4701603d0 2024-03-30T13:15:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.310+0000 7fd478800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd470160b50 con 0x7fd47013f0c0 2024-03-30T13:15:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.310+0000 7fd478800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fd470160e30 con 0x7fd47006d8f0 2024-03-30T13:15:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.310+0000 7fd476800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd4701603d0 0x7fd4700cfbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38408/0 (socket says 172.21.15.44:38408) 2024-03-30T13:15:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.310+0000 7fd476800640 1 -- 172.21.15.44:0/219051176 learned_addr learned my addr 172.21.15.44:0/219051176 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.311+0000 7fd475400640 1 --2- 172.21.15.44:0/219051176 >> v2:172.21.15.151:3300/0 conn(0x7fd47006d8f0 0x7fd47015fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.311+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3842148006 0 0) 0x7fd46c001490 con 0x7fd4701603d0 2024-03-30T13:15:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.311+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd458003520 con 0x7fd4701603d0 2024-03-30T13:15:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.311+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2070358114 0 0) 0x7fd458003520 con 0x7fd4701603d0 2024-03-30T13:15:40.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.311+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 >> v2:172.21.15.151:3300/0 conn(0x7fd47006d8f0 msgr2=0x7fd47015fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:40.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.311+0000 7fd474a00640 1 --2- 172.21.15.44:0/219051176 >> v2:172.21.15.151:3300/0 conn(0x7fd47006d8f0 0x7fd47015fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.311+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 >> v1:172.21.15.151:6789/0 conn(0x7fd47013f0c0 legacy=0x7fd47006d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.311+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd47013fa40 con 0x7fd4701603d0 2024-03-30T13:15:40.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.311+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fd46c001bc0 con 0x7fd4701603d0 2024-03-30T13:15:40.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.311+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 >> v1:172.21.15.44:6789/0 conn(0x7fd4701603d0 legacy=0x7fd4700cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.311+0000 7fd474a00640 1 --2- 172.21.15.44:0/219051176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4580039b0 0x7fd458003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.311+0000 7fd474a00640 1 --2- 172.21.15.44:0/219051176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd458004800 0x7fd458004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.312+0000 7fd474a00640 1 --2- 172.21.15.44:0/219051176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4580052e0 0x7fd45800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.312+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd470160e30 con 0x7fd4580052e0 2024-03-30T13:15:40.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.312+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd45800c1b0 con 0x7fd458004800 2024-03-30T13:15:40.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.312+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd45800c3b0 con 0x7fd4580039b0 2024-03-30T13:15:40.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.312+0000 7fd476800640 1 --2- 172.21.15.44:0/219051176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4580052e0 0x7fd45800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.312+0000 7fd475400640 1 --2- 172.21.15.44:0/219051176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd458004800 0x7fd458004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.312+0000 7fd475e00640 1 --2- 172.21.15.44:0/219051176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4580039b0 0x7fd458003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.312+0000 7fd476800640 1 -- 172.21.15.44:0/219051176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4580039b0 msgr2=0x7fd458003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:40.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.312+0000 7fd476800640 1 --2- 172.21.15.44:0/219051176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4580039b0 0x7fd458003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.312+0000 7fd476800640 1 -- 172.21.15.44:0/219051176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd458004800 msgr2=0x7fd458004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:40.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.312+0000 7fd476800640 1 --2- 172.21.15.44:0/219051176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd458004800 0x7fd458004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.312+0000 7fd476800640 1 -- 172.21.15.44:0/219051176 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd458003520 con 0x7fd4580052e0 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.313+0000 7fd476800640 1 -- 172.21.15.44:0/219051176 reap_dead start 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.313+0000 7fd476800640 1 --2- 172.21.15.44:0/219051176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4580052e0 0x7fd45800b9c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00aa00 tx=0x7fd458005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552661ba411c0d5a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.314+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c00a650 con 0x7fd4580052e0 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.314+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd46c034640 con 0x7fd4580052e0 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.314+0000 7fd474a00640 1 -- 172.21.15.44:0/219051176 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c034a30 con 0x7fd4580052e0 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.314+0000 7fd478800640 1 -- 172.21.15.44:0/219051176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4580052e0 msgr2=0x7fd45800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.314+0000 7fd478800640 1 --2- 172.21.15.44:0/219051176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4580052e0 0x7fd45800b9c0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00aa00 tx=0x7fd458005830 comp rx=0 tx=0).stop 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.314+0000 7fd478800640 1 -- 172.21.15.44:0/219051176 shutdown_connections 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.314+0000 7fd478800640 1 --2- 172.21.15.44:0/219051176 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4580052e0 0x7fd45800b9c0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.314+0000 7fd478800640 1 -- 172.21.15.44:0/219051176 >> 172.21.15.44:0/219051176 conn(0x7fd4700b5b00 msgr2=0x7fd47006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.315+0000 7fd478800640 1 -- 172.21.15.44:0/219051176 shutdown_connections 2024-03-30T13:15:40.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.315+0000 7fd478800640 1 -- 172.21.15.44:0/219051176 wait complete. 2024-03-30T13:15:40.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.316+0000 7fd478800640 1 Processor -- start 2024-03-30T13:15:40.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.317+0000 7fd478800640 1 -- start start 2024-03-30T13:15:40.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.317+0000 7fd478800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4580052e0 0x7fd470156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.317+0000 7fd478800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd470131ea0 0x7fd47015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.317+0000 7fd478800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4701574a0 0x7fd47015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.317+0000 7fd478800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd470160840 con 0x7fd4701574a0 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.317+0000 7fd478800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd470140000 con 0x7fd470131ea0 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.317+0000 7fd478800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd47013f4a0 con 0x7fd4580052e0 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.318+0000 7fd476800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4701574a0 0x7fd47015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.318+0000 7fd476800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4701574a0 0x7fd47015bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59364/0 (socket says 172.21.15.44:59364) 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.318+0000 7fd476800640 1 -- 172.21.15.44:0/1948777612 learned_addr learned my addr 172.21.15.44:0/1948777612 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.318+0000 7fd475400640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd470131ea0 0x7fd47015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.318+0000 7fd475e00640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4580052e0 0x7fd470156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.318+0000 7fd476800640 1 -- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4580052e0 msgr2=0x7fd470156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.318+0000 7fd476800640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4580052e0 0x7fd470156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.318+0000 7fd476800640 1 -- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd470131ea0 msgr2=0x7fd47015b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.318+0000 7fd476800640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd470131ea0 0x7fd47015b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.318+0000 7fd476800640 1 -- 172.21.15.44:0/1948777612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd470158c00 con 0x7fd4701574a0 2024-03-30T13:15:40.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.318+0000 7fd475400640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd470131ea0 0x7fd47015b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:40.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.319+0000 7fd476800640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4701574a0 0x7fd47015bbd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00aa00 tx=0x7fd47013fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.319+0000 7fd46a000640 1 -- 172.21.15.44:0/1948777612 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c00a650 con 0x7fd4701574a0 2024-03-30T13:15:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.319+0000 7fd46a000640 1 -- 172.21.15.44:0/1948777612 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd46c044070 con 0x7fd4701574a0 2024-03-30T13:15:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.319+0000 7fd46a000640 1 -- 172.21.15.44:0/1948777612 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c004b60 con 0x7fd4701574a0 2024-03-30T13:15:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.319+0000 7fd478800640 1 -- 172.21.15.44:0/1948777612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd470158ea0 con 0x7fd4701574a0 2024-03-30T13:15:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.319+0000 7fd478800640 1 -- 172.21.15.44:0/1948777612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd470159460 con 0x7fd4701574a0 2024-03-30T13:15:40.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.320+0000 7fd478800640 1 -- 172.21.15.44:0/1948777612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd470075890 con 0x7fd4701574a0 2024-03-30T13:15:40.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.321+0000 7fd46a000640 1 -- 172.21.15.44:0/1948777612 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd46c03d040 con 0x7fd4701574a0 2024-03-30T13:15:40.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.322+0000 7fd46a000640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd45406c560 0x7fd45406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.322+0000 7fd46a000640 1 -- 172.21.15.44:0/1948777612 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fd46c0ad720 con 0x7fd4701574a0 2024-03-30T13:15:40.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.323+0000 7fd475e00640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd45406c560 0x7fd45406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.324+0000 7fd475e00640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd45406c560 0x7fd45406ea20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd464005490 tx=0x7fd464009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:40.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.327+0000 7fd46a000640 1 -- 172.21.15.44:0/1948777612 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd4700ce9c0 con 0x7fd4701574a0 2024-03-30T13:15:40.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.533+0000 7fd478800640 1 -- 172.21.15.44:0/1948777612 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd47006c2c0 con 0x7fd4701574a0 2024-03-30T13:15:40.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.534+0000 7fd46a000640 1 -- 172.21.15.44:0/1948777612 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7fd46c07bae0 con 0x7fd4701574a0 2024-03-30T13:15:40.539 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:15:40.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.536+0000 7fd478800640 1 -- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd45406c560 msgr2=0x7fd45406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.536+0000 7fd478800640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd45406c560 0x7fd45406ea20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd464005490 tx=0x7fd464009040 comp rx=0 tx=0).stop 2024-03-30T13:15:40.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.536+0000 7fd478800640 1 -- 172.21.15.44:0/1948777612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4701574a0 msgr2=0x7fd47015bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.536+0000 7fd478800640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4701574a0 0x7fd47015bbd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00aa00 tx=0x7fd47013fc10 comp rx=0 tx=0).stop 2024-03-30T13:15:40.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.536+0000 7fd478800640 1 -- 172.21.15.44:0/1948777612 shutdown_connections 2024-03-30T13:15:40.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.536+0000 7fd478800640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd4701574a0 0x7fd47015bbd0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.536+0000 7fd478800640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd45406c560 0x7fd45406ea20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.536+0000 7fd478800640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd470131ea0 0x7fd47015b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.536+0000 7fd478800640 1 --2- 172.21.15.44:0/1948777612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4580052e0 0x7fd470156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.537+0000 7fd478800640 1 -- 172.21.15.44:0/1948777612 >> 172.21.15.44:0/1948777612 conn(0x7fd4700b5b00 msgr2=0x7fd4700b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:40.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.537+0000 7fd478800640 1 -- 172.21.15.44:0/1948777612 shutdown_connections 2024-03-30T13:15:40.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.537+0000 7fd478800640 1 -- 172.21.15.44:0/1948777612 wait complete. 2024-03-30T13:15:40.561 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:15:40.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.766+0000 7fce39c00640 1 Processor -- start 2024-03-30T13:15:40.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.766+0000 7fce39c00640 1 -- start start 2024-03-30T13:15:40.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.768+0000 7fce39c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fce34072d50 0x7fce340b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.768+0000 7fce39c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce3415fc70 con 0x7fce34144cb0 2024-03-30T13:15:40.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.768+0000 7fce39c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce340b35e0 con 0x7fce3415f800 2024-03-30T13:15:40.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.768+0000 7fce39c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fce340b3e80 con 0x7fce34072d50 2024-03-30T13:15:40.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.768+0000 7fce32a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fce34144cb0 0x7fce34072640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38424/0 (socket says 172.21.15.44:38424) 2024-03-30T13:15:40.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.768+0000 7fce32a00640 1 -- 172.21.15.44:0/3788127145 learned_addr learned my addr 172.21.15.44:0/3788127145 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:40.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.769+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3237182592 0 0) 0x7fce3415fc70 con 0x7fce34144cb0 2024-03-30T13:15:40.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.769+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce18003520 con 0x7fce34144cb0 2024-03-30T13:15:40.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.769+0000 7fce2a000640 1 --2- 172.21.15.44:0/3788127145 >> v2:172.21.15.151:3300/0 conn(0x7fce34072d50 0x7fce340b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.769+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 520994670 0 0) 0x7fce18003520 con 0x7fce34144cb0 2024-03-30T13:15:40.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.769+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 >> v2:172.21.15.151:3300/0 conn(0x7fce34072d50 msgr2=0x7fce340b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:40.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.769+0000 7fce32000640 1 --2- 172.21.15.44:0/3788127145 >> v2:172.21.15.151:3300/0 conn(0x7fce34072d50 0x7fce340b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.769+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 >> v1:172.21.15.151:6789/0 conn(0x7fce3415f800 legacy=0x7fce340ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:40.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.769+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce340b38c0 con 0x7fce34144cb0 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.769+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fce240019f0 con 0x7fce34144cb0 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.769+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 >> v1:172.21.15.44:6789/0 conn(0x7fce34144cb0 legacy=0x7fce34072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.769+0000 7fce32000640 1 --2- 172.21.15.44:0/3788127145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce18003a00 0x7fce18003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.769+0000 7fce32000640 1 --2- 172.21.15.44:0/3788127145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce18004800 0x7fce18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.770+0000 7fce32000640 1 --2- 172.21.15.44:0/3788127145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 0x7fce1800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.770+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fce340b3e80 con 0x7fce180051c0 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.770+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fce1800e2d0 con 0x7fce18004800 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.770+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fce1800e4d0 con 0x7fce18003a00 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.770+0000 7fce33400640 1 --2- 172.21.15.44:0/3788127145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 0x7fce1800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.770+0000 7fce32a00640 1 --2- 172.21.15.44:0/3788127145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce18003a00 0x7fce18003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.770+0000 7fce2a000640 1 --2- 172.21.15.44:0/3788127145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce18004800 0x7fce18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.770+0000 7fce33400640 1 -- 172.21.15.44:0/3788127145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce18003a00 msgr2=0x7fce18003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.770+0000 7fce33400640 1 --2- 172.21.15.44:0/3788127145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce18003a00 0x7fce18003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.770+0000 7fce33400640 1 -- 172.21.15.44:0/3788127145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce18004800 msgr2=0x7fce18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:40.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.770+0000 7fce33400640 1 --2- 172.21.15.44:0/3788127145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce18004800 0x7fce18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.770+0000 7fce33400640 1 -- 172.21.15.44:0/3788127145 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce18003520 con 0x7fce180051c0 2024-03-30T13:15:40.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.771+0000 7fce33400640 1 -- 172.21.15.44:0/3788127145 reap_dead start 2024-03-30T13:15:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.772+0000 7fce33400640 1 --2- 172.21.15.44:0/3788127145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 0x7fce1800dbd0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fce2c003db0 tx=0x7fce18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6de655eea2c575a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.772+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c037070 con 0x7fce180051c0 2024-03-30T13:15:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.772+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2c032600 con 0x7fce180051c0 2024-03-30T13:15:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.772+0000 7fce32000640 1 -- 172.21.15.44:0/3788127145 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c003980 con 0x7fce180051c0 2024-03-30T13:15:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.773+0000 7fce39c00640 1 -- 172.21.15.44:0/3788127145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 msgr2=0x7fce1800dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.773+0000 7fce39c00640 1 --2- 172.21.15.44:0/3788127145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 0x7fce1800dbd0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fce2c003db0 tx=0x7fce18005830 comp rx=0 tx=0).stop 2024-03-30T13:15:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.773+0000 7fce39c00640 1 -- 172.21.15.44:0/3788127145 shutdown_connections 2024-03-30T13:15:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.773+0000 7fce39c00640 1 --2- 172.21.15.44:0/3788127145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 0x7fce1800dbd0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.773+0000 7fce39c00640 1 -- 172.21.15.44:0/3788127145 >> 172.21.15.44:0/3788127145 conn(0x7fce340b5b00 msgr2=0x7fce3406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.773+0000 7fce39c00640 1 -- 172.21.15.44:0/3788127145 shutdown_connections 2024-03-30T13:15:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.773+0000 7fce39c00640 1 -- 172.21.15.44:0/3788127145 wait complete. 2024-03-30T13:15:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.775+0000 7fce39c00640 1 Processor -- start 2024-03-30T13:15:40.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.775+0000 7fce39c00640 1 -- start start 2024-03-30T13:15:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.776+0000 7fce39c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 0x7fce340d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.776+0000 7fce39c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce340cef60 0x7fce340cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.776+0000 7fce39c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce340cf920 0x7fce3413a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.776+0000 7fce39c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fce340b2f20 con 0x7fce180051c0 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.776+0000 7fce39c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fce340cdb30 con 0x7fce340cef60 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.776+0000 7fce39c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fce340b30a0 con 0x7fce340cf920 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.776+0000 7fce32a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 0x7fce340d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.776+0000 7fce32a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 0x7fce340d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59390/0 (socket says 172.21.15.44:59390) 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.776+0000 7fce32a00640 1 -- 172.21.15.44:0/3748561297 learned_addr learned my addr 172.21.15.44:0/3748561297 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.777+0000 7fce2a000640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce340cef60 0x7fce340cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.777+0000 7fce33400640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce340cf920 0x7fce3413a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.777+0000 7fce32a00640 1 -- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce340cf920 msgr2=0x7fce3413a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.777+0000 7fce32a00640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce340cf920 0x7fce3413a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.777+0000 7fce32a00640 1 -- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce340cef60 msgr2=0x7fce340cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.777+0000 7fce32a00640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce340cef60 0x7fce340cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.777+0000 7fce32a00640 1 -- 172.21.15.44:0/3748561297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce340cfda0 con 0x7fce180051c0 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.777+0000 7fce2a000640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce340cef60 0x7fce340cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:40.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.777+0000 7fce32a00640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 0x7fce340d0510 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fce24007a70 tx=0x7fce2400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:40.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.778+0000 7fce2b400640 1 -- 172.21.15.44:0/3748561297 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce24019070 con 0x7fce180051c0 2024-03-30T13:15:40.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.778+0000 7fce2b400640 1 -- 172.21.15.44:0/3748561297 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce2400edf0 con 0x7fce180051c0 2024-03-30T13:15:40.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.778+0000 7fce2b400640 1 -- 172.21.15.44:0/3748561297 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce240146c0 con 0x7fce180051c0 2024-03-30T13:15:40.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.778+0000 7fce39c00640 1 -- 172.21.15.44:0/3748561297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3413c2e0 con 0x7fce180051c0 2024-03-30T13:15:40.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.778+0000 7fce39c00640 1 -- 172.21.15.44:0/3748561297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce34139890 con 0x7fce180051c0 2024-03-30T13:15:40.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.779+0000 7fce39c00640 1 -- 172.21.15.44:0/3748561297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce34075890 con 0x7fce180051c0 2024-03-30T13:15:40.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.780+0000 7fce2b400640 1 -- 172.21.15.44:0/3748561297 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fce2401c070 con 0x7fce180051c0 2024-03-30T13:15:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.781+0000 7fce2b400640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fce1006c530 0x7fce1006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:40.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.781+0000 7fce2b400640 1 -- 172.21.15.44:0/3748561297 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fce2408b880 con 0x7fce180051c0 2024-03-30T13:15:40.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.782+0000 7fce2a000640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fce1006c530 0x7fce1006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:40.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.783+0000 7fce2a000640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fce1006c530 0x7fce1006e9f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fce3415b1c0 tx=0x7fce1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:40.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:40.786+0000 7fce2b400640 1 -- 172.21.15.44:0/3748561297 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fce24059cd0 con 0x7fce180051c0 2024-03-30T13:15:41.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.004+0000 7fce39c00640 1 -- 172.21.15.44:0/3748561297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fce340b4030 con 0x7fce180051c0 2024-03-30T13:15:41.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.005+0000 7fce2b400640 1 -- 172.21.15.44:0/3748561297 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) ==== 104+0+11 (secure 0 0 0) 0x7fce240595d0 con 0x7fce180051c0 2024-03-30T13:15:41.010 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:15:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.008+0000 7fce39c00640 1 -- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fce1006c530 msgr2=0x7fce1006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.008+0000 7fce39c00640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fce1006c530 0x7fce1006e9f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fce3415b1c0 tx=0x7fce1c008040 comp rx=0 tx=0).stop 2024-03-30T13:15:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.008+0000 7fce39c00640 1 -- 172.21.15.44:0/3748561297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 msgr2=0x7fce340d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.008+0000 7fce39c00640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 0x7fce340d0510 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fce24007a70 tx=0x7fce2400e530 comp rx=0 tx=0).stop 2024-03-30T13:15:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.008+0000 7fce39c00640 1 -- 172.21.15.44:0/3748561297 shutdown_connections 2024-03-30T13:15:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.008+0000 7fce39c00640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce340cf920 0x7fce3413a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.008+0000 7fce39c00640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fce1006c530 0x7fce1006e9f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.008+0000 7fce39c00640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce340cef60 0x7fce340cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.008+0000 7fce39c00640 1 --2- 172.21.15.44:0/3748561297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fce180051c0 0x7fce340d0510 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.008+0000 7fce39c00640 1 -- 172.21.15.44:0/3748561297 >> 172.21.15.44:0/3748561297 conn(0x7fce340b5b00 msgr2=0x7fce3406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:41.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.008+0000 7fce39c00640 1 -- 172.21.15.44:0/3748561297 shutdown_connections 2024-03-30T13:15:41.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.008+0000 7fce39c00640 1 -- 172.21.15.44:0/3748561297 wait complete. 2024-03-30T13:15:41.033 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:15:41.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.248+0000 7f8cde400640 1 Processor -- start 2024-03-30T13:15:41.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.248+0000 7f8cde400640 1 -- start start 2024-03-30T13:15:41.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.250+0000 7f8cde400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8cd80b5dc0 0x7f8cd80b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.250+0000 7f8cde400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd80ba090 0x7f8cd80d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.250+0000 7f8cde400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8cd806c620 0x7f8cd806cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.250+0000 7f8cde400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd80b66e0 con 0x7f8cd806c620 2024-03-30T13:15:41.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.250+0000 7f8cde400640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd80d2ff0 con 0x7f8cd80b5dc0 2024-03-30T13:15:41.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.250+0000 7f8cde400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd80d32d0 con 0x7f8cd80ba090 2024-03-30T13:15:41.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.250+0000 7f8cd7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8cd806c620 0x7f8cd806cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.250+0000 7f8cd7e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8cd806c620 0x7f8cd806cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59406/0 (socket says 172.21.15.44:59406) 2024-03-30T13:15:41.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.250+0000 7f8cd7e00640 1 -- 172.21.15.44:0/3846445436 learned_addr learned my addr 172.21.15.44:0/3846445436 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:41.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.251+0000 7f8cd6a00640 1 --2- 172.21.15.44:0/3846445436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd80ba090 0x7f8cd80d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.251+0000 7f8cd7400640 1 --2- 172.21.15.44:0/3846445436 >> v2:172.21.15.151:3300/0 conn(0x7f8cd80b5dc0 0x7f8cd80b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.251+0000 7f8cd7e00640 1 -- 172.21.15.44:0/3846445436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd80ba090 msgr2=0x7f8cd80d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:41.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.251+0000 7f8cd7e00640 1 --2- 172.21.15.44:0/3846445436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd80ba090 0x7f8cd80d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.251+0000 7f8cd7e00640 1 -- 172.21.15.44:0/3846445436 >> v2:172.21.15.151:3300/0 conn(0x7f8cd80b5dc0 msgr2=0x7f8cd80b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:41.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.251+0000 7f8cd7e00640 1 --2- 172.21.15.44:0/3846445436 >> v2:172.21.15.151:3300/0 conn(0x7f8cd80b5dc0 0x7f8cd80b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.251+0000 7f8cd7e00640 1 -- 172.21.15.44:0/3846445436 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd80d35b0 con 0x7f8cd806c620 2024-03-30T13:15:41.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.251+0000 7f8cd6a00640 1 --2- 172.21.15.44:0/3846445436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd80ba090 0x7f8cd80d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:41.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.251+0000 7f8cd7400640 1 --2- 172.21.15.44:0/3846445436 >> v2:172.21.15.151:3300/0 conn(0x7f8cd80b5dc0 0x7f8cd80b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:41.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.252+0000 7f8cd7e00640 1 --2- 172.21.15.44:0/3846445436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806c620 0x7f8cd806cad0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f8cd806d770 tx=0x7f8cd002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e10d0f34bca67f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:41.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.252+0000 7f8cd6000640 1 -- 172.21.15.44:0/3846445436 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd002ca80 con 0x7f8cd806c620 2024-03-30T13:15:41.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.252+0000 7f8cd6000640 1 -- 172.21.15.44:0/3846445436 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd002cc20 con 0x7f8cd806c620 2024-03-30T13:15:41.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.252+0000 7f8cd6000640 1 -- 172.21.15.44:0/3846445436 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00343f0 con 0x7f8cd806c620 2024-03-30T13:15:41.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.253+0000 7f8cde400640 1 -- 172.21.15.44:0/3846445436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806c620 msgr2=0x7f8cd806cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.253+0000 7f8cde400640 1 --2- 172.21.15.44:0/3846445436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806c620 0x7f8cd806cad0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f8cd806d770 tx=0x7f8cd002bee0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.253+0000 7f8cde400640 1 -- 172.21.15.44:0/3846445436 shutdown_connections 2024-03-30T13:15:41.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.253+0000 7f8cde400640 1 --2- 172.21.15.44:0/3846445436 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd806c620 0x7f8cd806cad0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.253+0000 7f8cde400640 1 --2- 172.21.15.44:0/3846445436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd80ba090 0x7f8cd80d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.253+0000 7f8cde400640 1 --2- 172.21.15.44:0/3846445436 >> v2:172.21.15.151:3300/0 conn(0x7f8cd80b5dc0 0x7f8cd80b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.253+0000 7f8cde400640 1 -- 172.21.15.44:0/3846445436 >> 172.21.15.44:0/3846445436 conn(0x7f8cd80678f0 msgr2=0x7f8cd80d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:41.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.253+0000 7f8cde400640 1 -- 172.21.15.44:0/3846445436 shutdown_connections 2024-03-30T13:15:41.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.253+0000 7f8cde400640 1 -- 172.21.15.44:0/3846445436 wait complete. 2024-03-30T13:15:41.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.255+0000 7f8cde400640 1 Processor -- start 2024-03-30T13:15:41.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.255+0000 7f8cde400640 1 -- start start 2024-03-30T13:15:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.256+0000 7f8cde400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd806c620 0x7f8cd8151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.256+0000 7f8cde400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd80b5dc0 0x7f8cd80ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.256+0000 7f8cde400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd80ba090 0x7f8cd80ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.256+0000 7f8cde400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd80d4090 con 0x7f8cd80ba090 2024-03-30T13:15:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.256+0000 7f8cde400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd80d3b70 con 0x7f8cd80b5dc0 2024-03-30T13:15:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.256+0000 7f8cde400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd815e880 con 0x7f8cd806c620 2024-03-30T13:15:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.257+0000 7f8cd7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd80ba090 0x7f8cd80ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.257+0000 7f8cd7e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd80ba090 0x7f8cd80ae360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59416/0 (socket says 172.21.15.44:59416) 2024-03-30T13:15:41.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.257+0000 7f8cd7e00640 1 -- 172.21.15.44:0/4191831758 learned_addr learned my addr 172.21.15.44:0/4191831758 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:41.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.257+0000 7f8cd7400640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd806c620 0x7f8cd8151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.257+0000 7f8cd6a00640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd80b5dc0 0x7f8cd80ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.257+0000 7f8cd7e00640 1 -- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd806c620 msgr2=0x7f8cd8151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.257+0000 7f8cd7e00640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd806c620 0x7f8cd8151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.257+0000 7f8cd7e00640 1 -- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd80b5dc0 msgr2=0x7f8cd80ade20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.257+0000 7f8cd7e00640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd80b5dc0 0x7f8cd80ade20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.257+0000 7f8cd7e00640 1 -- 172.21.15.44:0/4191831758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd80ab650 con 0x7f8cd80ba090 2024-03-30T13:15:41.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.258+0000 7f8cd7e00640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd80ba090 0x7f8cd80ae360 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0036040 tx=0x7f8cd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:41.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.258+0000 7f8ccf400640 1 -- 172.21.15.44:0/4191831758 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0043020 con 0x7f8cd80ba090 2024-03-30T13:15:41.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.258+0000 7f8ccf400640 1 -- 172.21.15.44:0/4191831758 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd003e450 con 0x7f8cd80ba090 2024-03-30T13:15:41.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.258+0000 7f8ccf400640 1 -- 172.21.15.44:0/4191831758 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd003e820 con 0x7f8cd80ba090 2024-03-30T13:15:41.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.258+0000 7f8cde400640 1 -- 172.21.15.44:0/4191831758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd8151bc0 con 0x7f8cd80ba090 2024-03-30T13:15:41.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.258+0000 7f8cde400640 1 -- 172.21.15.44:0/4191831758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd80ab910 con 0x7f8cd80ba090 2024-03-30T13:15:41.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.260+0000 7f8cde400640 1 -- 172.21.15.44:0/4191831758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd8075890 con 0x7f8cd80ba090 2024-03-30T13:15:41.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.260+0000 7f8ccf400640 1 -- 172.21.15.44:0/4191831758 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8cd0046020 con 0x7f8cd80ba090 2024-03-30T13:15:41.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.261+0000 7f8ccf400640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8cb806c530 0x7f8cb806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.262+0000 7f8ccf400640 1 -- 172.21.15.44:0/4191831758 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f8cd00ae560 con 0x7f8cd80ba090 2024-03-30T13:15:41.267 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.262+0000 7f8cd7400640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8cb806c530 0x7f8cb806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.268 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.263+0000 7f8cd7400640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8cb806c530 0x7f8cb806e9f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8006b10 tx=0x7f8cc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:41.272 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.267+0000 7f8ccf400640 1 -- 172.21.15.44:0/4191831758 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8cd004d020 con 0x7f8cd80ba090 2024-03-30T13:15:41.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.474+0000 7f8cde400640 1 -- 172.21.15.44:0/4191831758 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8cd815de90 con 0x7f8cd80ba090 2024-03-30T13:15:41.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.475+0000 7f8ccf400640 1 -- 172.21.15.44:0/4191831758 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) ==== 100+0+11 (secure 0 0 0) 0x7f8cd007c920 con 0x7f8cd80ba090 2024-03-30T13:15:41.480 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:15:41.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.477+0000 7f8cde400640 1 -- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8cb806c530 msgr2=0x7f8cb806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.477+0000 7f8cde400640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8cb806c530 0x7f8cb806e9f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8006b10 tx=0x7f8cc8008040 comp rx=0 tx=0).stop 2024-03-30T13:15:41.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.477+0000 7f8cde400640 1 -- 172.21.15.44:0/4191831758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd80ba090 msgr2=0x7f8cd80ae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.477+0000 7f8cde400640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd80ba090 0x7f8cd80ae360 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0036040 tx=0x7f8cd0004a40 comp rx=0 tx=0).stop 2024-03-30T13:15:41.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.478+0000 7f8cde400640 1 -- 172.21.15.44:0/4191831758 shutdown_connections 2024-03-30T13:15:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.478+0000 7f8cde400640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8cd80ba090 0x7f8cd80ae360 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.478+0000 7f8cde400640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8cb806c530 0x7f8cb806e9f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.478+0000 7f8cde400640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd80b5dc0 0x7f8cd80ade20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.478+0000 7f8cde400640 1 --2- 172.21.15.44:0/4191831758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd806c620 0x7f8cd8151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.478+0000 7f8cde400640 1 -- 172.21.15.44:0/4191831758 >> 172.21.15.44:0/4191831758 conn(0x7f8cd80678f0 msgr2=0x7f8cd815b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.478+0000 7f8cde400640 1 -- 172.21.15.44:0/4191831758 shutdown_connections 2024-03-30T13:15:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.478+0000 7f8cde400640 1 -- 172.21.15.44:0/4191831758 wait complete. 2024-03-30T13:15:41.500 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:15:41.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.707+0000 7f947fe00640 1 Processor -- start 2024-03-30T13:15:41.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.707+0000 7f947fe00640 1 -- start start 2024-03-30T13:15:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.708+0000 7f947fe00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f948006c070 0x7f94800ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.708+0000 7f947fe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f9480165e10 0x7f9480168200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.708+0000 7f947fe00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94800cbc90 con 0x7f948006b580 2024-03-30T13:15:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.709+0000 7f947fe00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f948006da50 con 0x7f9480165e10 2024-03-30T13:15:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.709+0000 7f947fe00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f94800ad920 con 0x7f948006c070 2024-03-30T13:15:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.709+0000 7f947ea00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f948006b580 0x7f948006b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38428/0 (socket says 172.21.15.44:38428) 2024-03-30T13:15:41.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.709+0000 7f947ea00640 1 -- 172.21.15.44:0/1629907177 learned_addr learned my addr 172.21.15.44:0/1629907177 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:41.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.709+0000 7f947f400640 1 --2- 172.21.15.44:0/1629907177 >> v2:172.21.15.44:3300/0 conn(0x7f9480165e10 0x7f9480168200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.709+0000 7f947e000640 1 --2- 172.21.15.44:0/1629907177 >> v2:172.21.15.151:3300/0 conn(0x7f948006c070 0x7f94800ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.710+0000 7f947f400640 1 -- 172.21.15.44:0/1629907177 >> v2:172.21.15.151:3300/0 conn(0x7f948006c070 msgr2=0x7f94800ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:41.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.710+0000 7f947f400640 1 --2- 172.21.15.44:0/1629907177 >> v2:172.21.15.151:3300/0 conn(0x7f948006c070 0x7f94800ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.710+0000 7f947f400640 1 -- 172.21.15.44:0/1629907177 >> v1:172.21.15.44:6789/0 conn(0x7f948006b580 legacy=0x7f948006b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.710+0000 7f947d600640 1 -- 172.21.15.44:0/1629907177 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1540236671 0 0) 0x7f94800cbc90 con 0x7f948006b580 2024-03-30T13:15:41.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.710+0000 7f947f400640 1 -- 172.21.15.44:0/1629907177 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948006dc80 con 0x7f9480165e10 2024-03-30T13:15:41.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.712+0000 7f947f400640 1 --2- 172.21.15.44:0/1629907177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9480165e10 0x7f9480168200 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f94800cc8c0 tx=0x7f947802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e078b778a8f2655 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:41.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.712+0000 7f947d600640 1 -- 172.21.15.44:0/1629907177 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478035020 con 0x7f9480165e10 2024-03-30T13:15:41.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.712+0000 7f947d600640 1 -- 172.21.15.44:0/1629907177 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9478031830 con 0x7f9480165e10 2024-03-30T13:15:41.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.712+0000 7f947d600640 1 -- 172.21.15.44:0/1629907177 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478031c00 con 0x7f9480165e10 2024-03-30T13:15:41.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.713+0000 7f947fe00640 1 -- 172.21.15.44:0/1629907177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9480165e10 msgr2=0x7f9480168200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.713+0000 7f947fe00640 1 --2- 172.21.15.44:0/1629907177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9480165e10 0x7f9480168200 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f94800cc8c0 tx=0x7f947802b8d0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.713+0000 7f947fe00640 1 -- 172.21.15.44:0/1629907177 shutdown_connections 2024-03-30T13:15:41.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.713+0000 7f947fe00640 1 --2- 172.21.15.44:0/1629907177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9480165e10 0x7f9480168200 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.713+0000 7f947fe00640 1 --2- 172.21.15.44:0/1629907177 >> v2:172.21.15.151:3300/0 conn(0x7f948006c070 0x7f94800ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.713+0000 7f947fe00640 1 -- 172.21.15.44:0/1629907177 >> 172.21.15.44:0/1629907177 conn(0x7f94800cd080 msgr2=0x7f94800cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:41.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.713+0000 7f947fe00640 1 -- 172.21.15.44:0/1629907177 shutdown_connections 2024-03-30T13:15:41.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.713+0000 7f947fe00640 1 -- 172.21.15.44:0/1629907177 wait complete. 2024-03-30T13:15:41.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.715+0000 7f947fe00640 1 Processor -- start 2024-03-30T13:15:41.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.715+0000 7f947fe00640 1 -- start start 2024-03-30T13:15:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.716+0000 7f947fe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948006b580 0x7f948015e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.716+0000 7f947fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f948006c070 0x7f94800b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.716+0000 7f947fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9480165e10 0x7f94800c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.716+0000 7f947fe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f94800ced30 con 0x7f9480165e10 2024-03-30T13:15:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.716+0000 7f947fe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f94800cea50 con 0x7f948006c070 2024-03-30T13:15:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.716+0000 7f947fe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f94800cf010 con 0x7f948006b580 2024-03-30T13:15:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.716+0000 7f947f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9480165e10 0x7f94800c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.716+0000 7f947f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9480165e10 0x7f94800c8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59438/0 (socket says 172.21.15.44:59438) 2024-03-30T13:15:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.716+0000 7f947f400640 1 -- 172.21.15.44:0/196387633 learned_addr learned my addr 172.21.15.44:0/196387633 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.717+0000 7f947e000640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f948006c070 0x7f94800b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.717+0000 7f947f400640 1 -- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948006b580 msgr2=0x7f948015e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.717+0000 7f947ea00640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948006b580 0x7f948015e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.717+0000 7f947f400640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948006b580 0x7f948015e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.717+0000 7f947f400640 1 -- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f948006c070 msgr2=0x7f94800b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.717+0000 7f947f400640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f948006c070 0x7f94800b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.717+0000 7f947f400640 1 -- 172.21.15.44:0/196387633 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94800ca300 con 0x7f9480165e10 2024-03-30T13:15:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.717+0000 7f947e000640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f948006c070 0x7f94800b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:41.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.717+0000 7f947ea00640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948006b580 0x7f948015e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:41.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.717+0000 7f947f400640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9480165e10 0x7f94800c8330 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9478009860 tx=0x7f94780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:41.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.717+0000 7f9476a00640 1 -- 172.21.15.44:0/196387633 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478035040 con 0x7f9480165e10 2024-03-30T13:15:41.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.717+0000 7f9476a00640 1 -- 172.21.15.44:0/196387633 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947803f070 con 0x7f9480165e10 2024-03-30T13:15:41.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.718+0000 7f9476a00640 1 -- 172.21.15.44:0/196387633 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947803baa0 con 0x7f9480165e10 2024-03-30T13:15:41.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.718+0000 7f947fe00640 1 -- 172.21.15.44:0/196387633 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94800adef0 con 0x7f9480165e10 2024-03-30T13:15:41.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.718+0000 7f947fe00640 1 -- 172.21.15.44:0/196387633 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94800c9fb0 con 0x7f9480165e10 2024-03-30T13:15:41.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.719+0000 7f947fe00640 1 -- 172.21.15.44:0/196387633 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9480075890 con 0x7f9480165e10 2024-03-30T13:15:41.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.720+0000 7f9476a00640 1 -- 172.21.15.44:0/196387633 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9478038020 con 0x7f9480165e10 2024-03-30T13:15:41.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.721+0000 7f9476a00640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f945c06c560 0x7f945c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:41.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.721+0000 7f9476a00640 1 -- 172.21.15.44:0/196387633 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f94780ad4c0 con 0x7f9480165e10 2024-03-30T13:15:41.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.722+0000 7f947ea00640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f945c06c560 0x7f945c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:41.727 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.723+0000 7f947ea00640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f945c06c560 0x7f945c06ea20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9470007fd0 tx=0x7f9470009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:41.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.730+0000 7f9476a00640 1 -- 172.21.15.44:0/196387633 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9478031800 con 0x7f9480165e10 2024-03-30T13:15:41.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.954+0000 7f947fe00640 1 -- 172.21.15.44:0/196387633 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f94800b05c0 con 0x7f9480165e10 2024-03-30T13:15:41.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.955+0000 7f9476a00640 1 -- 172.21.15.44:0/196387633 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) ==== 80+0+0 (secure 0 0 0) 0x7f947807b910 con 0x7f9480165e10 2024-03-30T13:15:41.961 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-03-30T13:15:41.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.959+0000 7f947fe00640 1 -- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f945c06c560 msgr2=0x7f945c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.959+0000 7f947fe00640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f945c06c560 0x7f945c06ea20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9470007fd0 tx=0x7f9470009040 comp rx=0 tx=0).stop 2024-03-30T13:15:41.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.959+0000 7f947fe00640 1 -- 172.21.15.44:0/196387633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9480165e10 msgr2=0x7f94800c8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:41.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.959+0000 7f947fe00640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9480165e10 0x7f94800c8330 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9478009860 tx=0x7f94780046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.959+0000 7f947fe00640 1 -- 172.21.15.44:0/196387633 shutdown_connections 2024-03-30T13:15:41.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.959+0000 7f947fe00640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9480165e10 0x7f94800c8330 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.959+0000 7f947fe00640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f945c06c560 0x7f945c06ea20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.959+0000 7f947fe00640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f948006c070 0x7f94800b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.959+0000 7f947fe00640 1 --2- 172.21.15.44:0/196387633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948006b580 0x7f948015e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:41.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.959+0000 7f947fe00640 1 -- 172.21.15.44:0/196387633 >> 172.21.15.44:0/196387633 conn(0x7f94800cd080 msgr2=0x7f9480153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:41.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.959+0000 7f947fe00640 1 -- 172.21.15.44:0/196387633 shutdown_connections 2024-03-30T13:15:41.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:41.959+0000 7f947fe00640 1 -- 172.21.15.44:0/196387633 wait complete. 2024-03-30T13:15:41.984 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-30T13:15:41.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:41.985 DEBUG:teuthology.orchestra.run.smithi044:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-30T13:15:42.230 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:15:42.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:42.230 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-30T13:15:42.268 INFO:tasks.cephfs.mount:Terminating background process 2024-03-30T13:15:42.269 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:15:42.269 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:15:42.312 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:15:42.313 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:15:42.405 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:15:42.622 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.617+0000 7fc180800640 1 Processor -- start 2024-03-30T13:15:42.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.617+0000 7fc180800640 1 -- start start 2024-03-30T13:15:42.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.619+0000 7fc180800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc178141530 0x7fc178071920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:42.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.619+0000 7fc180800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc178141910 con 0x7fc178162030 2024-03-30T13:15:42.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.619+0000 7fc180800640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc178071e60 con 0x7fc1780b5950 2024-03-30T13:15:42.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.619+0000 7fc180800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc178162af0 con 0x7fc178141530 2024-03-30T13:15:42.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.619+0000 7fc17d400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc178162030 0x7fc1780b5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38442/0 (socket says 172.21.15.44:38442) 2024-03-30T13:15:42.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.619+0000 7fc17d400640 1 -- 172.21.15.44:0/1067371966 learned_addr learned my addr 172.21.15.44:0/1067371966 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:42.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.620+0000 7fc17de00640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc178141530 0x7fc178071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:42.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.620+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2350182932 0 0) 0x7fc178141910 con 0x7fc178162030 2024-03-30T13:15:42.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.620+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc160003520 con 0x7fc178162030 2024-03-30T13:15:42.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.620+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 641878824 0 0) 0x7fc160003520 con 0x7fc178162030 2024-03-30T13:15:42.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.620+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc178141530 msgr2=0x7fc178071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:42.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.620+0000 7fc17ca00640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc178141530 0x7fc178071920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:42.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.620+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 >> v1:172.21.15.151:6789/0 conn(0x7fc1780b5950 legacy=0x7fc178141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:42.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.620+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc178162dd0 con 0x7fc178162030 2024-03-30T13:15:42.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.620+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fc168001690 con 0x7fc178162030 2024-03-30T13:15:42.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 >> v1:172.21.15.44:6789/0 conn(0x7fc178162030 legacy=0x7fc1780b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:42.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17ca00640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1600039e0 0x7fc160003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:42.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17ca00640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc178141530 0x7fc160004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17ca00640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc160004d40 0x7fc1600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc178162af0 con 0x7fc1600039e0 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc16000baf0 con 0x7fc160004d40 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc16000bcf0 con 0x7fc178141530 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17de00640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1600039e0 0x7fc160003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17de00640 1 -- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc178141530 msgr2=0x7fc160004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17d400640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc178141530 0x7fc160004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17e800640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc160004d40 0x7fc1600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17de00640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc178141530 0x7fc160004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17de00640 1 -- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc160004d40 msgr2=0x7fc1600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17de00640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc160004d40 0x7fc1600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.621+0000 7fc17de00640 1 -- 172.21.15.44:0/1067371966 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc160003520 con 0x7fc1600039e0 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.622+0000 7fc17d400640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc178141530 0x7fc160004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:42.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.622+0000 7fc17e800640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc160004d40 0x7fc1600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:42.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.623+0000 7fc17de00640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1600039e0 0x7fc160003e00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009ac0 tx=0x7fc160005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519c98f9398cfd49 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:42.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.623+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c039070 con 0x7fc1600039e0 2024-03-30T13:15:42.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.623+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16c02c600 con 0x7fc1600039e0 2024-03-30T13:15:42.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.623+0000 7fc17ca00640 1 -- 172.21.15.44:0/1067371966 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c009690 con 0x7fc1600039e0 2024-03-30T13:15:42.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.624+0000 7fc180800640 1 -- 172.21.15.44:0/1067371966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1600039e0 msgr2=0x7fc160003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:42.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.624+0000 7fc180800640 1 --2- 172.21.15.44:0/1067371966 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1600039e0 0x7fc160003e00 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009ac0 tx=0x7fc160005830 comp rx=0 tx=0).stop 2024-03-30T13:15:42.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.624+0000 7fc17e800640 1 -- 172.21.15.44:0/1067371966 reap_dead start 2024-03-30T13:15:42.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.624+0000 7fc180800640 1 -- 172.21.15.44:0/1067371966 shutdown_connections 2024-03-30T13:15:42.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.624+0000 7fc180800640 1 -- 172.21.15.44:0/1067371966 >> 172.21.15.44:0/1067371966 conn(0x7fc17806f8b0 msgr2=0x7fc17806fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:42.635 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.624+0000 7fc180800640 1 -- 172.21.15.44:0/1067371966 shutdown_connections 2024-03-30T13:15:42.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.624+0000 7fc180800640 1 -- 172.21.15.44:0/1067371966 wait complete. 2024-03-30T13:15:42.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.626+0000 7fc180800640 1 Processor -- start 2024-03-30T13:15:42.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.626+0000 7fc180800640 1 -- start start 2024-03-30T13:15:42.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc180800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1600039e0 0x7fc1780b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:42.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc180800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc178158520 0x7fc1781f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:42.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc180800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc17813ae10 0x7fc17813b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:42.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc180800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc1780b1950 con 0x7fc1600039e0 2024-03-30T13:15:42.636 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc180800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc178071400 con 0x7fc178158520 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc180800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc178071920 con 0x7fc17813ae10 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc17de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1600039e0 0x7fc1780b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc17de00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1600039e0 0x7fc1780b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59458/0 (socket says 172.21.15.44:59458) 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc17de00640 1 -- 172.21.15.44:0/3683627733 learned_addr learned my addr 172.21.15.44:0/3683627733 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc17de00640 1 -- 172.21.15.44:0/3683627733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc17813ae10 msgr2=0x7fc17813b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc17de00640 1 --2- 172.21.15.44:0/3683627733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc17813ae10 0x7fc17813b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc17de00640 1 -- 172.21.15.44:0/3683627733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc178158520 msgr2=0x7fc1781f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.627+0000 7fc17de00640 1 --2- 172.21.15.44:0/3683627733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc178158520 0x7fc1781f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.628+0000 7fc17de00640 1 -- 172.21.15.44:0/3683627733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1781f44c0 con 0x7fc1600039e0 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.628+0000 7fc17de00640 1 --2- 172.21.15.44:0/3683627733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1600039e0 0x7fc1780b3740 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc16c037040 tx=0x7fc16c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.628+0000 7fc172000640 1 -- 172.21.15.44:0/3683627733 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c039050 con 0x7fc1600039e0 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.628+0000 7fc172000640 1 -- 172.21.15.44:0/3683627733 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16c03a040 con 0x7fc1600039e0 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.628+0000 7fc172000640 1 -- 172.21.15.44:0/3683627733 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0044c0 con 0x7fc1600039e0 2024-03-30T13:15:42.637 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.628+0000 7fc180800640 1 -- 172.21.15.44:0/3683627733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1780b3d20 con 0x7fc1600039e0 2024-03-30T13:15:42.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.628+0000 7fc180800640 1 -- 172.21.15.44:0/3683627733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1780b42e0 con 0x7fc1600039e0 2024-03-30T13:15:42.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.630+0000 7fc180800640 1 -- 172.21.15.44:0/3683627733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1780b6750 con 0x7fc1600039e0 2024-03-30T13:15:42.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.631+0000 7fc172000640 1 -- 172.21.15.44:0/3683627733 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc16c047020 con 0x7fc1600039e0 2024-03-30T13:15:42.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.632+0000 7fc172000640 1 --2- 172.21.15.44:0/3683627733 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc15c06c530 0x7fc15c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:42.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.632+0000 7fc172000640 1 -- 172.21.15.44:0/3683627733 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fc16c0acfb0 con 0x7fc1600039e0 2024-03-30T13:15:42.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.632+0000 7fc17d400640 1 --2- 172.21.15.44:0/3683627733 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc15c06c530 0x7fc15c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:42.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.633+0000 7fc17d400640 1 --2- 172.21.15.44:0/3683627733 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc15c06c530 0x7fc15c06e9f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc168000fd0 tx=0x7fc168009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:42.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.636+0000 7fc172000640 1 -- 172.21.15.44:0/3683627733 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc1780b6750 con 0x7fc1600039e0 2024-03-30T13:15:42.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.845+0000 7fc180800640 1 -- 172.21.15.44:0/3683627733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc178075a10 con 0x7fc1600039e0 2024-03-30T13:15:42.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.847+0000 7fc172000640 1 -- 172.21.15.44:0/3683627733 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16978 (secure 0 0 0) 0x7fc16c04e020 con 0x7fc1600039e0 2024-03-30T13:15:42.852 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:42.853 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":46,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:15:30.641950+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:13:22.414656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-30T13:13:23.348753+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":45,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:15:42.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.850+0000 7fc180800640 1 -- 172.21.15.44:0/3683627733 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc15c06c530 msgr2=0x7fc15c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:42.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.850+0000 7fc180800640 1 --2- 172.21.15.44:0/3683627733 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc15c06c530 0x7fc15c06e9f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc168000fd0 tx=0x7fc168009040 comp rx=0 tx=0).stop 2024-03-30T13:15:42.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.850+0000 7fc180800640 1 -- 172.21.15.44:0/3683627733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1600039e0 msgr2=0x7fc1780b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:42.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.850+0000 7fc180800640 1 --2- 172.21.15.44:0/3683627733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1600039e0 0x7fc1780b3740 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc16c037040 tx=0x7fc16c004730 comp rx=0 tx=0).stop 2024-03-30T13:15:42.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.850+0000 7fc180800640 1 -- 172.21.15.44:0/3683627733 shutdown_connections 2024-03-30T13:15:42.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.850+0000 7fc180800640 1 --2- 172.21.15.44:0/3683627733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc17813ae10 0x7fc17813b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:42.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.850+0000 7fc180800640 1 --2- 172.21.15.44:0/3683627733 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc15c06c530 0x7fc15c06e9f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:42.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.850+0000 7fc180800640 1 --2- 172.21.15.44:0/3683627733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc178158520 0x7fc1781f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:42.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.850+0000 7fc180800640 1 --2- 172.21.15.44:0/3683627733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc1600039e0 0x7fc1780b3740 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:42.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.850+0000 7fc180800640 1 -- 172.21.15.44:0/3683627733 >> 172.21.15.44:0/3683627733 conn(0x7fc17806f8b0 msgr2=0x7fc17806e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:42.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.850+0000 7fc180800640 1 -- 172.21.15.44:0/3683627733 shutdown_connections 2024-03-30T13:15:42.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:42.850+0000 7fc180800640 1 -- 172.21.15.44:0/3683627733 wait complete. 2024-03-30T13:15:42.874 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:13:22.414656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:13:23.348753+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 45, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:15:42.875 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:15:43.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.088+0000 7f44be000640 1 Processor -- start 2024-03-30T13:15:43.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.088+0000 7f44be000640 1 -- start start 2024-03-30T13:15:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.090+0000 7f44be000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f44b8070530 0x7f44b80aea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.090+0000 7f44be000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44b806b580 0x7f44b806ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.090+0000 7f44be000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44b8070b10 con 0x7f44b8158d10 2024-03-30T13:15:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.090+0000 7f44be000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f44b80adf80 con 0x7f44b8070530 2024-03-30T13:15:43.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.090+0000 7f44be000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f44b80ae260 con 0x7f44b806b580 2024-03-30T13:15:43.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.091+0000 7f44afe00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f44b8070530 0x7f44b80aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:43.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.091+0000 7f44bd600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44b806b580 0x7f44b806ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:43.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.091+0000 7f44bd600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44b806b580 0x7f44b806ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:53814/0 (socket says 172.21.15.44:53814) 2024-03-30T13:15:43.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.091+0000 7f44bd600640 1 -- 172.21.15.44:0/2902738708 learned_addr learned my addr 172.21.15.44:0/2902738708 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:43.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.092+0000 7f44afe00640 1 -- 172.21.15.44:0/2902738708 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44b806b580 msgr2=0x7f44b806ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:43.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.092+0000 7f44afe00640 1 --2- 172.21.15.44:0/2902738708 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44b806b580 0x7f44b806ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.092+0000 7f44afe00640 1 -- 172.21.15.44:0/2902738708 >> v1:172.21.15.151:6789/0 conn(0x7f44b8158d10 legacy=0x7f44b815f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:43.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.092+0000 7f44afe00640 1 -- 172.21.15.44:0/2902738708 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b80ae540 con 0x7f44b8070530 2024-03-30T13:15:43.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.092+0000 7f44bd600640 1 --2- 172.21.15.44:0/2902738708 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44b806b580 0x7f44b806ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-30T13:15:43.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.093+0000 7f44afe00640 1 --2- 172.21.15.44:0/2902738708 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44b8070530 0x7f44b80aea60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f44a00097a0 tx=0x7f44a002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f01f33df641112 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:43.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.093+0000 7f44b7e00640 1 -- 172.21.15.44:0/2902738708 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a00315a0 con 0x7f44b8070530 2024-03-30T13:15:43.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.093+0000 7f44b7e00640 1 -- 172.21.15.44:0/2902738708 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44a0037070 con 0x7f44b8070530 2024-03-30T13:15:43.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.094+0000 7f44b7e00640 1 -- 172.21.15.44:0/2902738708 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a0031960 con 0x7f44b8070530 2024-03-30T13:15:43.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.094+0000 7f44be000640 1 -- 172.21.15.44:0/2902738708 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44b8070530 msgr2=0x7f44b80aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:43.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.094+0000 7f44be000640 1 --2- 172.21.15.44:0/2902738708 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44b8070530 0x7f44b80aea60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f44a00097a0 tx=0x7f44a002b840 comp rx=0 tx=0).stop 2024-03-30T13:15:43.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.094+0000 7f44be000640 1 -- 172.21.15.44:0/2902738708 shutdown_connections 2024-03-30T13:15:43.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.094+0000 7f44be000640 1 --2- 172.21.15.44:0/2902738708 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44b806b580 0x7f44b806ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.094+0000 7f44be000640 1 --2- 172.21.15.44:0/2902738708 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44b8070530 0x7f44b80aea60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.094+0000 7f44be000640 1 -- 172.21.15.44:0/2902738708 >> 172.21.15.44:0/2902738708 conn(0x7f44b80d0ed0 msgr2=0x7f44b80d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:43.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.094+0000 7f44be000640 1 -- 172.21.15.44:0/2902738708 shutdown_connections 2024-03-30T13:15:43.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.094+0000 7f44be000640 1 -- 172.21.15.44:0/2902738708 wait complete. 2024-03-30T13:15:43.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.097+0000 7f44be000640 1 Processor -- start 2024-03-30T13:15:43.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.097+0000 7f44be000640 1 -- start start 2024-03-30T13:15:43.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.099+0000 7f44be000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44b806b580 0x7f44b8152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:43.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.099+0000 7f44be000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44b8070530 0x7f44b8155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:43.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.099+0000 7f44be000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b8158d10 0x7f44b8151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:43.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.099+0000 7f44be000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f44b80b3f80 con 0x7f44b8158d10 2024-03-30T13:15:43.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.099+0000 7f44be000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f44b80b3e00 con 0x7f44b8070530 2024-03-30T13:15:43.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.099+0000 7f44be000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f44b80b4100 con 0x7f44b806b580 2024-03-30T13:15:43.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.099+0000 7f44bd600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b8158d10 0x7f44b8151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:43.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.099+0000 7f44bd600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b8158d10 0x7f44b8151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59468/0 (socket says 172.21.15.44:59468) 2024-03-30T13:15:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.099+0000 7f44bd600640 1 -- 172.21.15.44:0/1468692382 learned_addr learned my addr 172.21.15.44:0/1468692382 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.100+0000 7f44afe00640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44b8070530 0x7f44b8155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.100+0000 7f44bcc00640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44b806b580 0x7f44b8152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.100+0000 7f44bd600640 1 -- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44b806b580 msgr2=0x7f44b8152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.100+0000 7f44bd600640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44b806b580 0x7f44b8152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.100+0000 7f44bd600640 1 -- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44b8070530 msgr2=0x7f44b8155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.100+0000 7f44bd600640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44b8070530 0x7f44b8155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.100+0000 7f44bd600640 1 -- 172.21.15.44:0/1468692382 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b81532c0 con 0x7f44b8158d10 2024-03-30T13:15:43.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.100+0000 7f44bd600640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b8158d10 0x7f44b8151d80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f44b000efc0 tx=0x7f44b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:43.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.101+0000 7f44b5600640 1 -- 172.21.15.44:0/1468692382 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b000cbe0 con 0x7f44b8158d10 2024-03-30T13:15:43.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.101+0000 7f44b5600640 1 -- 172.21.15.44:0/1468692382 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b000cd80 con 0x7f44b8158d10 2024-03-30T13:15:43.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.101+0000 7f44b5600640 1 -- 172.21.15.44:0/1468692382 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b0003bb0 con 0x7f44b8158d10 2024-03-30T13:15:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.101+0000 7f44be000640 1 -- 172.21.15.44:0/1468692382 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b8152d00 con 0x7f44b8158d10 2024-03-30T13:15:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.101+0000 7f44be000640 1 -- 172.21.15.44:0/1468692382 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b81f5280 con 0x7f44b8158d10 2024-03-30T13:15:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.102+0000 7f44be000640 1 -- 172.21.15.44:0/1468692382 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b806e600 con 0x7f44b8158d10 2024-03-30T13:15:43.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.103+0000 7f44b5600640 1 -- 172.21.15.44:0/1468692382 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f44b001b030 con 0x7f44b8158d10 2024-03-30T13:15:43.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.105+0000 7f44b5600640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f449406c530 0x7f449406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:43.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.105+0000 7f44b5600640 1 -- 172.21.15.44:0/1468692382 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f44b008bd20 con 0x7f44b8158d10 2024-03-30T13:15:43.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.106+0000 7f44bcc00640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f449406c530 0x7f449406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:43.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.107+0000 7f44bcc00640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f449406c530 0x7f449406e9f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f44a8000f60 tx=0x7f44a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:43.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.109+0000 7f44b5600640 1 -- 172.21.15.44:0/1468692382 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f44b0022020 con 0x7f44b8158d10 2024-03-30T13:15:43.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.311+0000 7f44be000640 1 -- 172.21.15.44:0/1468692382 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f44b8155880 con 0x7f44b8158d10 2024-03-30T13:15:43.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.311+0000 7f44b5600640 1 -- 172.21.15.44:0/1468692382 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7f44b0010040 con 0x7f44b8158d10 2024-03-30T13:15:43.317 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:15:43.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.314+0000 7f44be000640 1 -- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f449406c530 msgr2=0x7f449406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.314+0000 7f44be000640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f449406c530 0x7f449406e9f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f44a8000f60 tx=0x7f44a8009040 comp rx=0 tx=0).stop 2024-03-30T13:15:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.314+0000 7f44be000640 1 -- 172.21.15.44:0/1468692382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b8158d10 msgr2=0x7f44b8151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.314+0000 7f44be000640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b8158d10 0x7f44b8151d80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f44b000efc0 tx=0x7f44b000c490 comp rx=0 tx=0).stop 2024-03-30T13:15:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.314+0000 7f44be000640 1 -- 172.21.15.44:0/1468692382 shutdown_connections 2024-03-30T13:15:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.314+0000 7f44be000640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f44b8158d10 0x7f44b8151d80 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.314+0000 7f44be000640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f449406c530 0x7f449406e9f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.314+0000 7f44be000640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44b8070530 0x7f44b8155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.314+0000 7f44be000640 1 --2- 172.21.15.44:0/1468692382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44b806b580 0x7f44b8152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.314+0000 7f44be000640 1 -- 172.21.15.44:0/1468692382 >> 172.21.15.44:0/1468692382 conn(0x7f44b80d0ed0 msgr2=0x7f44b806ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.314+0000 7f44be000640 1 -- 172.21.15.44:0/1468692382 shutdown_connections 2024-03-30T13:15:43.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.314+0000 7f44be000640 1 -- 172.21.15.44:0/1468692382 wait complete. 2024-03-30T13:15:43.338 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:15:43.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.553+0000 7f78b9000640 1 Processor -- start 2024-03-30T13:15:43.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.553+0000 7f78b9000640 1 -- start start 2024-03-30T13:15:43.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.555+0000 7f78b9000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f78b413f0c0 0x7f78b406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:43.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.555+0000 7f78b9000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f78b41605a0 0x7f78b40cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:43.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.555+0000 7f78b9000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b40ce9c0 con 0x7f78b406d720 2024-03-30T13:15:43.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.555+0000 7f78b9000640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f78b4160e30 con 0x7f78b41605a0 2024-03-30T13:15:43.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.555+0000 7f78b9000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f78b4160b50 con 0x7f78b413f0c0 2024-03-30T13:15:43.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.555+0000 7f78abe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f78b406d720 0x7f78b415fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38454/0 (socket says 172.21.15.44:38454) 2024-03-30T13:15:43.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.555+0000 7f78abe00640 1 -- 172.21.15.44:0/2025738950 learned_addr learned my addr 172.21.15.44:0/2025738950 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:43.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.555+0000 7f78b2800640 1 --2- 172.21.15.44:0/2025738950 >> v2:172.21.15.44:3300/0 conn(0x7f78b41605a0 0x7f78b40cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:43.561 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.555+0000 7f78b1e00640 1 --2- 172.21.15.44:0/2025738950 >> v2:172.21.15.151:3300/0 conn(0x7f78b413f0c0 0x7f78b406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:43.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.556+0000 7f78b1400640 1 -- 172.21.15.44:0/2025738950 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4281527243 0 0) 0x7f789c001110 con 0x7f78b406d720 2024-03-30T13:15:43.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.556+0000 7f78b1400640 1 -- 172.21.15.44:0/2025738950 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7894003520 con 0x7f78b406d720 2024-03-30T13:15:43.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.556+0000 7f78b2800640 1 -- 172.21.15.44:0/2025738950 >> v2:172.21.15.151:3300/0 conn(0x7f78b413f0c0 msgr2=0x7f78b406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:43.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.556+0000 7f78b2800640 1 --2- 172.21.15.44:0/2025738950 >> v2:172.21.15.151:3300/0 conn(0x7f78b413f0c0 0x7f78b406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.556+0000 7f78b2800640 1 -- 172.21.15.44:0/2025738950 >> v1:172.21.15.44:6789/0 conn(0x7f78b406d720 legacy=0x7f78b415fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:43.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.556+0000 7f78b2800640 1 -- 172.21.15.44:0/2025738950 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b413fa40 con 0x7f78b41605a0 2024-03-30T13:15:43.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.557+0000 7f78b2800640 1 --2- 172.21.15.44:0/2025738950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b41605a0 0x7f78b40cfbb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f78b406e2b0 tx=0x7f78ac02bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457aca66eb1284a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:43.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.557+0000 7f78b1400640 1 -- 172.21.15.44:0/2025738950 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac039070 con 0x7f78b41605a0 2024-03-30T13:15:43.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.558+0000 7f78b1400640 1 -- 172.21.15.44:0/2025738950 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78ac02cb50 con 0x7f78b41605a0 2024-03-30T13:15:43.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.558+0000 7f78b1400640 1 -- 172.21.15.44:0/2025738950 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78ac034440 con 0x7f78b41605a0 2024-03-30T13:15:43.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.558+0000 7f78b9000640 1 -- 172.21.15.44:0/2025738950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b41605a0 msgr2=0x7f78b40cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:43.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.558+0000 7f78b9000640 1 --2- 172.21.15.44:0/2025738950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b41605a0 0x7f78b40cfbb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f78b406e2b0 tx=0x7f78ac02bda0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.558+0000 7f78b9000640 1 -- 172.21.15.44:0/2025738950 shutdown_connections 2024-03-30T13:15:43.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.558+0000 7f78b9000640 1 --2- 172.21.15.44:0/2025738950 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b41605a0 0x7f78b40cfbb0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.558+0000 7f78b9000640 1 --2- 172.21.15.44:0/2025738950 >> v2:172.21.15.151:3300/0 conn(0x7f78b413f0c0 0x7f78b406d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.558+0000 7f78b9000640 1 -- 172.21.15.44:0/2025738950 >> 172.21.15.44:0/2025738950 conn(0x7f78b40b5b00 msgr2=0x7f78b406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:43.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.559+0000 7f78b9000640 1 -- 172.21.15.44:0/2025738950 shutdown_connections 2024-03-30T13:15:43.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.559+0000 7f78b9000640 1 -- 172.21.15.44:0/2025738950 wait complete. 2024-03-30T13:15:43.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.560+0000 7f78b9000640 1 Processor -- start 2024-03-30T13:15:43.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.561+0000 7f78b9000640 1 -- start start 2024-03-30T13:15:43.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.561+0000 7f78b9000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78b406d720 0x7f78b40aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:43.567 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78b9000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b413f0c0 0x7f78b413dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78b9000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b41605a0 0x7f78b4156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78b9000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f78b413f4a0 con 0x7f78b413f0c0 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78b9000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f78b4140000 con 0x7f78b406d720 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78b9000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f78b413f620 con 0x7f78b41605a0 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78abe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b413f0c0 0x7f78b413dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78abe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b413f0c0 0x7f78b413dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59484/0 (socket says 172.21.15.44:59484) 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78abe00640 1 -- 172.21.15.44:0/3096081045 learned_addr learned my addr 172.21.15.44:0/3096081045 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78b1e00640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78b406d720 0x7f78b40aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78b2800640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b41605a0 0x7f78b4156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78abe00640 1 -- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b41605a0 msgr2=0x7f78b4156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78abe00640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b41605a0 0x7f78b4156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78abe00640 1 -- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78b406d720 msgr2=0x7f78b40aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:43.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78abe00640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78b406d720 0x7f78b40aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78abe00640 1 -- 172.21.15.44:0/3096081045 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b40ad8a0 con 0x7f78b413f0c0 2024-03-30T13:15:43.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.562+0000 7f78b1e00640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78b406d720 0x7f78b40aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:43.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.563+0000 7f78abe00640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b413f0c0 0x7f78b413dd20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f789c00c3a0 tx=0x7f789c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:43.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.563+0000 7f78aa000640 1 -- 172.21.15.44:0/3096081045 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c017070 con 0x7f78b413f0c0 2024-03-30T13:15:43.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.563+0000 7f78aa000640 1 -- 172.21.15.44:0/3096081045 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c005ce0 con 0x7f78b413f0c0 2024-03-30T13:15:43.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.563+0000 7f78aa000640 1 -- 172.21.15.44:0/3096081045 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c007310 con 0x7f78b413f0c0 2024-03-30T13:15:43.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.563+0000 7f78b9000640 1 -- 172.21.15.44:0/3096081045 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b40adb80 con 0x7f78b413f0c0 2024-03-30T13:15:43.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.563+0000 7f78b9000640 1 -- 172.21.15.44:0/3096081045 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b40ae140 con 0x7f78b413f0c0 2024-03-30T13:15:43.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.564+0000 7f78b9000640 1 -- 172.21.15.44:0/3096081045 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b4075890 con 0x7f78b413f0c0 2024-03-30T13:15:43.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.566+0000 7f78aa000640 1 -- 172.21.15.44:0/3096081045 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f789c01a070 con 0x7f78b413f0c0 2024-03-30T13:15:43.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.567+0000 7f78aa000640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f789006c530 0x7f789006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:43.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.567+0000 7f78aa000640 1 -- 172.21.15.44:0/3096081045 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f789c08ac90 con 0x7f78b413f0c0 2024-03-30T13:15:43.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.568+0000 7f78b1e00640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f789006c530 0x7f789006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:43.574 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.569+0000 7f78b1e00640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f789006c530 0x7f789006e9f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009ac0 tx=0x7f78a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:43.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.572+0000 7f78aa000640 1 -- 172.21.15.44:0/3096081045 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f78b40ce9c0 con 0x7f78b413f0c0 2024-03-30T13:15:43.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.776+0000 7f78b9000640 1 -- 172.21.15.44:0/3096081045 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f78b406c2c0 con 0x7f78b413f0c0 2024-03-30T13:15:43.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.777+0000 7f78aa000640 1 -- 172.21.15.44:0/3096081045 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) ==== 104+0+11 (secure 0 0 0) 0x7f789c0590e0 con 0x7f78b413f0c0 2024-03-30T13:15:43.782 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:15:43.785 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.779+0000 7f78b9000640 1 -- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f789006c530 msgr2=0x7f789006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.779+0000 7f78b9000640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f789006c530 0x7f789006e9f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009ac0 tx=0x7f78a4008040 comp rx=0 tx=0).stop 2024-03-30T13:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.779+0000 7f78b9000640 1 -- 172.21.15.44:0/3096081045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b413f0c0 msgr2=0x7f78b413dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.779+0000 7f78b9000640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b413f0c0 0x7f78b413dd20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f789c00c3a0 tx=0x7f789c00c860 comp rx=0 tx=0).stop 2024-03-30T13:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.780+0000 7f78b9000640 1 -- 172.21.15.44:0/3096081045 shutdown_connections 2024-03-30T13:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.780+0000 7f78b9000640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b41605a0 0x7f78b4156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.780+0000 7f78b9000640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f78b413f0c0 0x7f78b413dd20 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.780+0000 7f78b9000640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f789006c530 0x7f789006e9f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.780+0000 7f78b9000640 1 --2- 172.21.15.44:0/3096081045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78b406d720 0x7f78b40aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.780+0000 7f78b9000640 1 -- 172.21.15.44:0/3096081045 >> 172.21.15.44:0/3096081045 conn(0x7f78b40b5b00 msgr2=0x7f78b40cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.780+0000 7f78b9000640 1 -- 172.21.15.44:0/3096081045 shutdown_connections 2024-03-30T13:15:43.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:43.780+0000 7f78b9000640 1 -- 172.21.15.44:0/3096081045 wait complete. 2024-03-30T13:15:43.806 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:15:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.016+0000 7fe618e00640 1 Processor -- start 2024-03-30T13:15:44.022 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.017+0000 7fe618e00640 1 -- start start 2024-03-30T13:15:44.023 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.018+0000 7fe618e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6140d0b90 0x7fe6140d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.018+0000 7fe618e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6140b54b0 con 0x7fe6140b4920 2024-03-30T13:15:44.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.018+0000 7fe618e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6140cfca0 con 0x7fe6140b4d00 2024-03-30T13:15:44.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.018+0000 7fe618e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe6140d0260 con 0x7fe6140d0b90 2024-03-30T13:15:44.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.019+0000 7fe613400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe6140b4920 0x7fe6140b3ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38462/0 (socket says 172.21.15.44:38462) 2024-03-30T13:15:44.024 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.019+0000 7fe613400640 1 -- 172.21.15.44:0/1600809371 learned_addr learned my addr 172.21.15.44:0/1600809371 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:44.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.019+0000 7fe613e00640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6140d0b90 0x7fe6140d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:44.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.019+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512569784 0 0) 0x7fe604001110 con 0x7fe6140b4920 2024-03-30T13:15:44.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.019+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5f8003520 con 0x7fe6140b4920 2024-03-30T13:15:44.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4084895292 0 0) 0x7fe5f8003520 con 0x7fe6140b4920 2024-03-30T13:15:44.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6140d0b90 msgr2=0x7fe6140d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:44.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6140d0b90 0x7fe6140d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 >> v1:172.21.15.151:6789/0 conn(0x7fe6140b4d00 legacy=0x7fe6140d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6140cff80 con 0x7fe6140b4920 2024-03-30T13:15:44.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fe604001840 con 0x7fe6140b4920 2024-03-30T13:15:44.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 >> v1:172.21.15.44:6789/0 conn(0x7fe6140b4920 legacy=0x7fe6140b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5f80039e0 0x7fe5f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6140d0b90 0x7fe5f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5f8004d40 0x7fe5f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6140d0260 con 0x7fe5f80039e0 2024-03-30T13:15:44.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f800baa0 con 0x7fe5f8004d40 2024-03-30T13:15:44.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f800bca0 con 0x7fe6140d0b90 2024-03-30T13:15:44.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.020+0000 7fe613400640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5f80039e0 0x7fe5f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:44.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.021+0000 7fe613e00640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5f8004d40 0x7fe5f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:44.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.021+0000 7fe60be00640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6140d0b90 0x7fe5f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:44.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.021+0000 7fe613400640 1 -- 172.21.15.44:0/1600809371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6140d0b90 msgr2=0x7fe5f8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:44.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.021+0000 7fe613400640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6140d0b90 0x7fe5f8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.021+0000 7fe613400640 1 -- 172.21.15.44:0/1600809371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5f8004d40 msgr2=0x7fe5f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:44.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.021+0000 7fe613400640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5f8004d40 0x7fe5f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.021+0000 7fe613400640 1 -- 172.21.15.44:0/1600809371 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f8003520 con 0x7fe5f80039e0 2024-03-30T13:15:44.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.021+0000 7fe60be00640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6140d0b90 0x7fe5f8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:44.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.022+0000 7fe613400640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5f80039e0 0x7fe5f8003de0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe60400c4c0 tx=0x7fe5f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc77f121db39e2f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:44.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.022+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60400c0e0 con 0x7fe5f80039e0 2024-03-30T13:15:44.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.023+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe604030070 con 0x7fe5f80039e0 2024-03-30T13:15:44.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.023+0000 7fe612a00640 1 -- 172.21.15.44:0/1600809371 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6040058d0 con 0x7fe5f80039e0 2024-03-30T13:15:44.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.023+0000 7fe618e00640 1 -- 172.21.15.44:0/1600809371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5f80039e0 msgr2=0x7fe5f8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.023+0000 7fe618e00640 1 --2- 172.21.15.44:0/1600809371 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5f80039e0 0x7fe5f8003de0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe60400c4c0 tx=0x7fe5f8005830 comp rx=0 tx=0).stop 2024-03-30T13:15:44.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.023+0000 7fe613e00640 1 -- 172.21.15.44:0/1600809371 reap_dead start 2024-03-30T13:15:44.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.023+0000 7fe618e00640 1 -- 172.21.15.44:0/1600809371 shutdown_connections 2024-03-30T13:15:44.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.023+0000 7fe618e00640 1 -- 172.21.15.44:0/1600809371 >> 172.21.15.44:0/1600809371 conn(0x7fe61409d4e0 msgr2=0x7fe6140d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:44.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.023+0000 7fe618e00640 1 -- 172.21.15.44:0/1600809371 shutdown_connections 2024-03-30T13:15:44.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.023+0000 7fe618e00640 1 -- 172.21.15.44:0/1600809371 wait complete. 2024-03-30T13:15:44.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.025+0000 7fe618e00640 1 Processor -- start 2024-03-30T13:15:44.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.025+0000 7fe618e00640 1 -- start start 2024-03-30T13:15:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.026+0000 7fe618e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5f80039e0 0x7fe6140ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.026+0000 7fe618e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe61415c8e0 0x7fe6140b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.026+0000 7fe618e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe61415fe80 0x7fe614160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.026+0000 7fe618e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6140cf8c0 con 0x7fe5f80039e0 2024-03-30T13:15:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.026+0000 7fe618e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe6140d2180 con 0x7fe61415c8e0 2024-03-30T13:15:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.026+0000 7fe618e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe6140cfa40 con 0x7fe61415fe80 2024-03-30T13:15:44.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.026+0000 7fe613400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5f80039e0 0x7fe6140ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:44.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.026+0000 7fe613400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5f80039e0 0x7fe6140ce070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59502/0 (socket says 172.21.15.44:59502) 2024-03-30T13:15:44.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.026+0000 7fe613400640 1 -- 172.21.15.44:0/2653484358 learned_addr learned my addr 172.21.15.44:0/2653484358 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:44.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.027+0000 7fe60be00640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe61415c8e0 0x7fe6140b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:44.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.027+0000 7fe613400640 1 -- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe61415fe80 msgr2=0x7fe614160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.027+0000 7fe613400640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe61415fe80 0x7fe614160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.027+0000 7fe613400640 1 -- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe61415c8e0 msgr2=0x7fe6140b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.027+0000 7fe613400640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe61415c8e0 0x7fe6140b8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.027+0000 7fe613400640 1 -- 172.21.15.44:0/2653484358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6140b8ec0 con 0x7fe5f80039e0 2024-03-30T13:15:44.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.027+0000 7fe60be00640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe61415c8e0 0x7fe6140b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:44.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.027+0000 7fe613400640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5f80039e0 0x7fe6140ce070 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe60400c4c0 tx=0x7fe6140b5a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:44.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.027+0000 7fe60b400640 1 -- 172.21.15.44:0/2653484358 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe604004bf0 con 0x7fe5f80039e0 2024-03-30T13:15:44.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.027+0000 7fe60b400640 1 -- 172.21.15.44:0/2653484358 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe604004d90 con 0x7fe5f80039e0 2024-03-30T13:15:44.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.028+0000 7fe618e00640 1 -- 172.21.15.44:0/2653484358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6140b91a0 con 0x7fe5f80039e0 2024-03-30T13:15:44.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.028+0000 7fe60b400640 1 -- 172.21.15.44:0/2653484358 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe604007270 con 0x7fe5f80039e0 2024-03-30T13:15:44.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.028+0000 7fe618e00640 1 -- 172.21.15.44:0/2653484358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6140b9760 con 0x7fe5f80039e0 2024-03-30T13:15:44.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.029+0000 7fe618e00640 1 -- 172.21.15.44:0/2653484358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe614075890 con 0x7fe5f80039e0 2024-03-30T13:15:44.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.030+0000 7fe60b400640 1 -- 172.21.15.44:0/2653484358 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe604047020 con 0x7fe5f80039e0 2024-03-30T13:15:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.032+0000 7fe60b400640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe5f006c530 0x7fe5f006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.032+0000 7fe60b400640 1 -- 172.21.15.44:0/2653484358 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fe6040aca80 con 0x7fe5f80039e0 2024-03-30T13:15:44.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.032+0000 7fe60be00640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe5f006c530 0x7fe5f006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:44.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.034+0000 7fe60be00640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe5f006c530 0x7fe5f006e9f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe6140caec0 tx=0x7fe5fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:44.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.035+0000 7fe60b400640 1 -- 172.21.15.44:0/2653484358 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe6040aee20 con 0x7fe5f80039e0 2024-03-30T13:15:44.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.240+0000 7fe618e00640 1 -- 172.21.15.44:0/2653484358 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe614160840 con 0x7fe5f80039e0 2024-03-30T13:15:44.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.240+0000 7fe60b400640 1 -- 172.21.15.44:0/2653484358 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) ==== 100+0+11 (secure 0 0 0) 0x7fe6140b54b0 con 0x7fe5f80039e0 2024-03-30T13:15:44.246 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:15:44.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.243+0000 7fe618e00640 1 -- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe5f006c530 msgr2=0x7fe5f006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.243+0000 7fe618e00640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe5f006c530 0x7fe5f006e9f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe6140caec0 tx=0x7fe5fc009040 comp rx=0 tx=0).stop 2024-03-30T13:15:44.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.243+0000 7fe618e00640 1 -- 172.21.15.44:0/2653484358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5f80039e0 msgr2=0x7fe6140ce070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.243+0000 7fe618e00640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5f80039e0 0x7fe6140ce070 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe60400c4c0 tx=0x7fe6140b5a70 comp rx=0 tx=0).stop 2024-03-30T13:15:44.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.244+0000 7fe618e00640 1 -- 172.21.15.44:0/2653484358 shutdown_connections 2024-03-30T13:15:44.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.244+0000 7fe618e00640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe61415fe80 0x7fe614160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.244+0000 7fe618e00640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe5f006c530 0x7fe5f006e9f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.244+0000 7fe618e00640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe61415c8e0 0x7fe6140b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.244+0000 7fe618e00640 1 --2- 172.21.15.44:0/2653484358 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5f80039e0 0x7fe6140ce070 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.244+0000 7fe618e00640 1 -- 172.21.15.44:0/2653484358 >> 172.21.15.44:0/2653484358 conn(0x7fe61409d4e0 msgr2=0x7fe6140d4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:44.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.244+0000 7fe618e00640 1 -- 172.21.15.44:0/2653484358 shutdown_connections 2024-03-30T13:15:44.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.244+0000 7fe618e00640 1 -- 172.21.15.44:0/2653484358 wait complete. 2024-03-30T13:15:44.268 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-30T13:15:44.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.474+0000 7ff3e0000640 1 Processor -- start 2024-03-30T13:15:44.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.474+0000 7ff3e0000640 1 -- start start 2024-03-30T13:15:44.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.475+0000 7ff3e0000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff3d80d1390 0x7ff3d80d1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.475+0000 7ff3e0000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3d80ba3d0 con 0x7ff3d80b39d0 2024-03-30T13:15:44.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.476+0000 7ff3e0000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3d80d1cb0 con 0x7ff3d80b3570 2024-03-30T13:15:44.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.476+0000 7ff3e0000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7ff3d80cf6e0 con 0x7ff3d80d1390 2024-03-30T13:15:44.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.476+0000 7ff3de000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff3d80b39d0 0x7ff3d80b7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38464/0 (socket says 172.21.15.44:38464) 2024-03-30T13:15:44.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.476+0000 7ff3de000640 1 -- 172.21.15.44:0/2785801076 learned_addr learned my addr 172.21.15.44:0/2785801076 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:44.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.476+0000 7ff3dd600640 1 --2- 172.21.15.44:0/2785801076 >> v2:172.21.15.151:3300/0 conn(0x7ff3d80d1390 0x7ff3d80d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:44.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.477+0000 7ff3d7e00640 1 -- 172.21.15.44:0/2785801076 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056934632 0 0) 0x7ff3d80ba3d0 con 0x7ff3d80b39d0 2024-03-30T13:15:44.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.477+0000 7ff3d7e00640 1 -- 172.21.15.44:0/2785801076 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3c0003520 con 0x7ff3d80b39d0 2024-03-30T13:15:44.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.477+0000 7ff3dd600640 1 -- 172.21.15.44:0/2785801076 >> v1:172.21.15.151:6789/0 conn(0x7ff3d80b3570 legacy=0x7ff3d80b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.477+0000 7ff3dd600640 1 -- 172.21.15.44:0/2785801076 >> v1:172.21.15.44:6789/0 conn(0x7ff3d80b39d0 legacy=0x7ff3d80b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.477+0000 7ff3dd600640 1 -- 172.21.15.44:0/2785801076 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d80b9050 con 0x7ff3d80d1390 2024-03-30T13:15:44.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.478+0000 7ff3dd600640 1 --2- 172.21.15.44:0/2785801076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3d80d1390 0x7ff3d80d1770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009d90 tx=0x7ff3cc02bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e57f1e8e63653c96 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:44.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.479+0000 7ff3d7e00640 1 -- 172.21.15.44:0/2785801076 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc039070 con 0x7ff3d80d1390 2024-03-30T13:15:44.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.479+0000 7ff3d7e00640 1 -- 172.21.15.44:0/2785801076 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3cc02cd80 con 0x7ff3d80d1390 2024-03-30T13:15:44.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.479+0000 7ff3d7e00640 1 -- 172.21.15.44:0/2785801076 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc034640 con 0x7ff3d80d1390 2024-03-30T13:15:44.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.480+0000 7ff3e0000640 1 -- 172.21.15.44:0/2785801076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3d80d1390 msgr2=0x7ff3d80d1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.480+0000 7ff3e0000640 1 --2- 172.21.15.44:0/2785801076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3d80d1390 0x7ff3d80d1770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009d90 tx=0x7ff3cc02bfd0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.480+0000 7ff3e0000640 1 -- 172.21.15.44:0/2785801076 shutdown_connections 2024-03-30T13:15:44.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.480+0000 7ff3e0000640 1 --2- 172.21.15.44:0/2785801076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3d80d1390 0x7ff3d80d1770 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.480+0000 7ff3e0000640 1 -- 172.21.15.44:0/2785801076 >> 172.21.15.44:0/2785801076 conn(0x7ff3d80676e0 msgr2=0x7ff3d8067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:44.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.480+0000 7ff3e0000640 1 -- 172.21.15.44:0/2785801076 shutdown_connections 2024-03-30T13:15:44.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.480+0000 7ff3e0000640 1 -- 172.21.15.44:0/2785801076 wait complete. 2024-03-30T13:15:44.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.482+0000 7ff3e0000640 1 Processor -- start 2024-03-30T13:15:44.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.483+0000 7ff3e0000640 1 -- start start 2024-03-30T13:15:44.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.484+0000 7ff3e0000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b3570 0x7ff3d814de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.484+0000 7ff3e0000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3d80b39d0 0x7ff3d80c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.484+0000 7ff3e0000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3d80d1390 0x7ff3d80c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.484+0000 7ff3e0000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d80b98f0 con 0x7ff3d80b3570 2024-03-30T13:15:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.484+0000 7ff3e0000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d80b9610 con 0x7ff3d80d1390 2024-03-30T13:15:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.484+0000 7ff3e0000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff3d80b9bd0 con 0x7ff3d80b39d0 2024-03-30T13:15:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.484+0000 7ff3dd600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b3570 0x7ff3d814de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.484+0000 7ff3dd600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b3570 0x7ff3d814de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59516/0 (socket says 172.21.15.44:59516) 2024-03-30T13:15:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.484+0000 7ff3dd600640 1 -- 172.21.15.44:0/2867823288 learned_addr learned my addr 172.21.15.44:0/2867823288 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.485+0000 7ff3dd600640 1 -- 172.21.15.44:0/2867823288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3d80b39d0 msgr2=0x7ff3d80c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.485+0000 7ff3dd600640 1 --2- 172.21.15.44:0/2867823288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3d80b39d0 0x7ff3d80c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.485+0000 7ff3dd600640 1 -- 172.21.15.44:0/2867823288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3d80d1390 msgr2=0x7ff3d80c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.485+0000 7ff3dd600640 1 --2- 172.21.15.44:0/2867823288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3d80d1390 0x7ff3d80c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.485+0000 7ff3dd600640 1 -- 172.21.15.44:0/2867823288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d814e390 con 0x7ff3d80b3570 2024-03-30T13:15:44.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.485+0000 7ff3dd600640 1 --2- 172.21.15.44:0/2867823288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b3570 0x7ff3d814de50 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc000f80 tx=0x7ff3cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:44.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.485+0000 7ff3d5600640 1 -- 172.21.15.44:0/2867823288 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc039050 con 0x7ff3d80b3570 2024-03-30T13:15:44.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.485+0000 7ff3d5600640 1 -- 172.21.15.44:0/2867823288 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3cc03a040 con 0x7ff3d80b3570 2024-03-30T13:15:44.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.485+0000 7ff3d5600640 1 -- 172.21.15.44:0/2867823288 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc009450 con 0x7ff3d80b3570 2024-03-30T13:15:44.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.485+0000 7ff3e0000640 1 -- 172.21.15.44:0/2867823288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d80cb4d0 con 0x7ff3d80b3570 2024-03-30T13:15:44.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.486+0000 7ff3e0000640 1 -- 172.21.15.44:0/2867823288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d80cba70 con 0x7ff3d80b3570 2024-03-30T13:15:44.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.487+0000 7ff3e0000640 1 -- 172.21.15.44:0/2867823288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d8075a10 con 0x7ff3d80b3570 2024-03-30T13:15:44.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.489+0000 7ff3d5600640 1 -- 172.21.15.44:0/2867823288 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff3cc047020 con 0x7ff3d80b3570 2024-03-30T13:15:44.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.490+0000 7ff3d5600640 1 --2- 172.21.15.44:0/2867823288 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3b806c530 0x7ff3b806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:44.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.490+0000 7ff3d5600640 1 -- 172.21.15.44:0/2867823288 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7ff3cc0ade00 con 0x7ff3d80b3570 2024-03-30T13:15:44.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.491+0000 7ff3dcc00640 1 --2- 172.21.15.44:0/2867823288 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3b806c530 0x7ff3b806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:44.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.492+0000 7ff3dcc00640 1 --2- 172.21.15.44:0/2867823288 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3b806c530 0x7ff3b806e9f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4000f60 tx=0x7ff3c40079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:44.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.495+0000 7ff3d5600640 1 -- 172.21.15.44:0/2867823288 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff3d814e390 con 0x7ff3d80b3570 2024-03-30T13:15:44.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.759+0000 7ff3e0000640 1 -- 172.21.15.44:0/2867823288 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff3d80b6a30 con 0x7ff3d80b3570 2024-03-30T13:15:44.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.760+0000 7ff3d5600640 1 -- 172.21.15.44:0/2867823288 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) ==== 80+0+0 (secure 0 0 0) 0x7ff3cc03d360 con 0x7ff3d80b3570 2024-03-30T13:15:44.765 INFO:teuthology.orchestra.run.smithi044.stderr:listed 0 entries 2024-03-30T13:15:44.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.763+0000 7ff3e0000640 1 -- 172.21.15.44:0/2867823288 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3b806c530 msgr2=0x7ff3b806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.763+0000 7ff3e0000640 1 --2- 172.21.15.44:0/2867823288 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3b806c530 0x7ff3b806e9f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4000f60 tx=0x7ff3c40079d0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.763+0000 7ff3e0000640 1 -- 172.21.15.44:0/2867823288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b3570 msgr2=0x7ff3d814de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:44.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.763+0000 7ff3e0000640 1 --2- 172.21.15.44:0/2867823288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b3570 0x7ff3d814de50 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc000f80 tx=0x7ff3cc004a40 comp rx=0 tx=0).stop 2024-03-30T13:15:44.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.763+0000 7ff3e0000640 1 -- 172.21.15.44:0/2867823288 shutdown_connections 2024-03-30T13:15:44.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.763+0000 7ff3e0000640 1 --2- 172.21.15.44:0/2867823288 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff3b806c530 0x7ff3b806e9f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.763+0000 7ff3e0000640 1 --2- 172.21.15.44:0/2867823288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3d80d1390 0x7ff3d80c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.763+0000 7ff3e0000640 1 --2- 172.21.15.44:0/2867823288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3d80b39d0 0x7ff3d80c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.763+0000 7ff3e0000640 1 --2- 172.21.15.44:0/2867823288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff3d80b3570 0x7ff3d814de50 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:44.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.763+0000 7ff3e0000640 1 -- 172.21.15.44:0/2867823288 >> 172.21.15.44:0/2867823288 conn(0x7ff3d80676e0 msgr2=0x7ff3d80d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:44.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.763+0000 7ff3e0000640 1 -- 172.21.15.44:0/2867823288 shutdown_connections 2024-03-30T13:15:44.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:44.764+0000 7ff3e0000640 1 -- 172.21.15.44:0/2867823288 wait complete. 2024-03-30T13:15:44.795 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-30T13:15:44.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:44.796 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-03-30T13:15:44.903 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:15:44.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:44.903 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-30T13:15:44.955 INFO:tasks.cephfs.mount:Terminating background process 2024-03-30T13:15:44.955 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:15:44.955 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:15:45.012 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054203,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-30T13:15:45.013 INFO:tasks.cephfs.mount:Terminating background process 2024-03-30T13:15:45.013 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:15:45.013 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:15:45.068 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053430,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T13:15:45.069 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:15:45.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.282+0000 7f2728c00640 1 Processor -- start 2024-03-30T13:15:45.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.282+0000 7f2728c00640 1 -- start start 2024-03-30T13:15:45.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.284+0000 7f2728c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f272415e950 0x7f27240d4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:45.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.284+0000 7f2728c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27240d30d0 0x7f27240b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:45.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.284+0000 7f2728c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27240d36f0 con 0x7f27240d48c0 2024-03-30T13:15:45.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.284+0000 7f2728c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f27240d3cb0 con 0x7f272415e950 2024-03-30T13:15:45.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.284+0000 7f2728c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f27240d4d00 con 0x7f27240d30d0 2024-03-30T13:15:45.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.284+0000 7f2721e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f272415e950 0x7f27240d4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:45.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.284+0000 7f2721e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f272415e950 0x7f27240d4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59518/0 (socket says 172.21.15.44:59518) 2024-03-30T13:15:45.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.284+0000 7f2721e00640 1 -- 172.21.15.44:0/3083242115 learned_addr learned my addr 172.21.15.44:0/3083242115 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:45.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.284+0000 7f2721e00640 1 -- 172.21.15.44:0/3083242115 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27240d30d0 msgr2=0x7f27240b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:45.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.284+0000 7f2721e00640 1 --2- 172.21.15.44:0/3083242115 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27240d30d0 0x7f27240b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:45.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.284+0000 7f2721e00640 1 -- 172.21.15.44:0/3083242115 >> v1:172.21.15.151:6789/0 conn(0x7f27240d48c0 legacy=0x7f27240d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:45.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.284+0000 7f2721e00640 1 -- 172.21.15.44:0/3083242115 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27240d39d0 con 0x7f272415e950 2024-03-30T13:15:45.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.285+0000 7f2721e00640 1 --2- 172.21.15.44:0/3083242115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f272415e950 0x7f27240d4380 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2714009870 tx=0x7f271402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48087658a702cf91 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:45.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.286+0000 7f2720a00640 1 -- 172.21.15.44:0/3083242115 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2714034070 con 0x7f272415e950 2024-03-30T13:15:45.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.286+0000 7f2720a00640 1 -- 172.21.15.44:0/3083242115 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2714030840 con 0x7f272415e950 2024-03-30T13:15:45.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.286+0000 7f2720a00640 1 -- 172.21.15.44:0/3083242115 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2714030c10 con 0x7f272415e950 2024-03-30T13:15:45.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.287+0000 7f2728c00640 1 -- 172.21.15.44:0/3083242115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f272415e950 msgr2=0x7f27240d4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:45.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.287+0000 7f2728c00640 1 --2- 172.21.15.44:0/3083242115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f272415e950 0x7f27240d4380 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2714009870 tx=0x7f271402b980 comp rx=0 tx=0).stop 2024-03-30T13:15:45.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.287+0000 7f2728c00640 1 -- 172.21.15.44:0/3083242115 shutdown_connections 2024-03-30T13:15:45.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.287+0000 7f2728c00640 1 --2- 172.21.15.44:0/3083242115 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27240d30d0 0x7f27240b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:45.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.287+0000 7f2728c00640 1 --2- 172.21.15.44:0/3083242115 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f272415e950 0x7f27240d4380 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:45.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.287+0000 7f2728c00640 1 -- 172.21.15.44:0/3083242115 >> 172.21.15.44:0/3083242115 conn(0x7f27240676e0 msgr2=0x7f2724067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:45.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.287+0000 7f2728c00640 1 -- 172.21.15.44:0/3083242115 shutdown_connections 2024-03-30T13:15:45.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.287+0000 7f2728c00640 1 -- 172.21.15.44:0/3083242115 wait complete. 2024-03-30T13:15:45.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.289+0000 7f2728c00640 1 Processor -- start 2024-03-30T13:15:45.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.289+0000 7f2728c00640 1 -- start start 2024-03-30T13:15:45.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.290+0000 7f2728c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27240d30d0 0x7f272415f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:45.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.290+0000 7f2728c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27240d48c0 0x7f27240c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:45.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.290+0000 7f2728c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f272415e950 0x7f27241496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.290+0000 7f2728c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f272415ed30 con 0x7f272415e950 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.290+0000 7f2728c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f27240b7da0 con 0x7f27240d30d0 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.290+0000 7f2728c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f272415eeb0 con 0x7f27240d48c0 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.290+0000 7f2722800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f272415e950 0x7f27241496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.290+0000 7f2722800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f272415e950 0x7f27241496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59520/0 (socket says 172.21.15.44:59520) 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.290+0000 7f2722800640 1 -- 172.21.15.44:0/807004726 learned_addr learned my addr 172.21.15.44:0/807004726 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.290+0000 7f2721e00640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27240d30d0 0x7f272415f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.290+0000 7f2721400640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27240d48c0 0x7f27240c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.291+0000 7f2722800640 1 -- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27240d48c0 msgr2=0x7f27240c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.291+0000 7f2722800640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27240d48c0 0x7f27240c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.291+0000 7f2722800640 1 -- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27240d30d0 msgr2=0x7f272415f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.291+0000 7f2722800640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27240d30d0 0x7f272415f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:45.297 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.291+0000 7f2722800640 1 -- 172.21.15.44:0/807004726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f272415f780 con 0x7f272415e950 2024-03-30T13:15:45.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.291+0000 7f2721e00640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27240d30d0 0x7f272415f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:45.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.291+0000 7f2722800640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f272415e950 0x7f27241496d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f271c00b9a0 tx=0x7f271c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:45.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.291+0000 7f271a000640 1 -- 172.21.15.44:0/807004726 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c019070 con 0x7f272415e950 2024-03-30T13:15:45.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.291+0000 7f271a000640 1 -- 172.21.15.44:0/807004726 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c00cbc0 con 0x7f272415e950 2024-03-30T13:15:45.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.291+0000 7f271a000640 1 -- 172.21.15.44:0/807004726 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271c014440 con 0x7f272415e950 2024-03-30T13:15:45.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.291+0000 7f2728c00640 1 -- 172.21.15.44:0/807004726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f272415fa60 con 0x7f272415e950 2024-03-30T13:15:45.298 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.292+0000 7f2728c00640 1 -- 172.21.15.44:0/807004726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2724160020 con 0x7f272415e950 2024-03-30T13:15:45.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.293+0000 7f2728c00640 1 -- 172.21.15.44:0/807004726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2724075a10 con 0x7f272415e950 2024-03-30T13:15:45.299 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.294+0000 7f271a000640 1 -- 172.21.15.44:0/807004726 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f271c01c070 con 0x7f272415e950 2024-03-30T13:15:45.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.295+0000 7f271a000640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f270406c530 0x7f270406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:45.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.295+0000 7f271a000640 1 -- 172.21.15.44:0/807004726 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f271c08b610 con 0x7f272415e950 2024-03-30T13:15:45.300 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.295+0000 7f2721e00640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f270406c530 0x7f270406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:45.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.297+0000 7f2721e00640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f270406c530 0x7f270406e9f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2714036000 tx=0x7f271403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:45.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.299+0000 7f271a000640 1 -- 172.21.15.44:0/807004726 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f271c059a60 con 0x7f272415e950 2024-03-30T13:15:45.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.548+0000 7f2728c00640 1 -- 172.21.15.44:0/807004726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f272415ae80 con 0x7f272415e950 2024-03-30T13:15:45.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.549+0000 7f271a000640 1 -- 172.21.15.44:0/807004726 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5184 (secure 0 0 0) 0x7f271c059360 con 0x7f272415e950 2024-03-30T13:15:45.555 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:45.555 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/3435907345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3435907345},{"type":"v1","addr":"172.21.15.151:6836","nonce":3435907345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3966337326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":3966337326},{"type":"v1","addr":"172.21.15.151:6837","nonce":3966337326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/4136308231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":4136308231},{"type":"v1","addr":"172.21.15.44:6833","nonce":4136308231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:13:24.374039+0000","modified":"2024-03-30T13:15:32.728090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/585602782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":585602782},{"type":"v1","addr":"172.21.15.44:6835","nonce":585602782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5298,"qdb_cluster":[5298]},"id":2}]} 2024-03-30T13:15:45.555 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 21 2024-03-30T13:15:45.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.552+0000 7f2728c00640 1 -- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f270406c530 msgr2=0x7f270406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:45.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.552+0000 7f2728c00640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f270406c530 0x7f270406e9f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2714036000 tx=0x7f271403b040 comp rx=0 tx=0).stop 2024-03-30T13:15:45.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.552+0000 7f2728c00640 1 -- 172.21.15.44:0/807004726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f272415e950 msgr2=0x7f27241496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:45.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.552+0000 7f2728c00640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f272415e950 0x7f27241496d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f271c00b9a0 tx=0x7f271c00be60 comp rx=0 tx=0).stop 2024-03-30T13:15:45.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.552+0000 7f2728c00640 1 -- 172.21.15.44:0/807004726 shutdown_connections 2024-03-30T13:15:45.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.552+0000 7f2728c00640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f272415e950 0x7f27241496d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:45.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.552+0000 7f2728c00640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27240d48c0 0x7f27240c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:45.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.552+0000 7f2728c00640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f270406c530 0x7f270406e9f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:45.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.552+0000 7f2728c00640 1 --2- 172.21.15.44:0/807004726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27240d30d0 0x7f272415f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:45.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.552+0000 7f2728c00640 1 -- 172.21.15.44:0/807004726 >> 172.21.15.44:0/807004726 conn(0x7f27240676e0 msgr2=0x7f2724074b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:45.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.553+0000 7f2728c00640 1 -- 172.21.15.44:0/807004726 shutdown_connections 2024-03-30T13:15:45.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.553+0000 7f2728c00640 1 -- 172.21.15.44:0/807004726 wait complete. 2024-03-30T13:15:45.577 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:15:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.907+0000 7f0621000640 1 Processor -- start 2024-03-30T13:15:45.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.907+0000 7f0621000640 1 -- start start 2024-03-30T13:15:45.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.910+0000 7f0621000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c161e70 0x7f061c0b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:45.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.910+0000 7f0621000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f061c0b5b60 con 0x7f061c0d4950 2024-03-30T13:15:45.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.910+0000 7f0621000640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f061c0d4fc0 con 0x7f061c0d0d30 2024-03-30T13:15:45.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.910+0000 7f0621000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f061c0c7b90 con 0x7f061c161e70 2024-03-30T13:15:45.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.910+0000 7f061aa00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f061c0d4950 0x7f061c161760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38472/0 (socket says 172.21.15.44:38472) 2024-03-30T13:15:45.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.910+0000 7f061aa00640 1 -- 172.21.15.44:0/3274820398 learned_addr learned my addr 172.21.15.44:0/3274820398 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:45.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.910+0000 7f061be00640 1 --2- 172.21.15.44:0/3274820398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c161e70 0x7f061c0b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:45.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.911+0000 7f061be00640 1 -- 172.21.15.44:0/3274820398 >> v1:172.21.15.151:6789/0 conn(0x7f061c0d0d30 legacy=0x7f061c0cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:45.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.911+0000 7f061be00640 1 -- 172.21.15.44:0/3274820398 >> v1:172.21.15.44:6789/0 conn(0x7f061c0d4950 legacy=0x7f061c161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:45.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.911+0000 7f061a000640 1 -- 172.21.15.44:0/3274820398 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600588259 0 0) 0x7f061c0b5b60 con 0x7f061c0d4950 2024-03-30T13:15:45.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.911+0000 7f061be00640 1 -- 172.21.15.44:0/3274820398 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f061c0b57f0 con 0x7f061c161e70 2024-03-30T13:15:45.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.913+0000 7f061be00640 1 --2- 172.21.15.44:0/3274820398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c161e70 0x7f061c0b3a50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0614009dc0 tx=0x7f061402be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c16c74b26a4032 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:45.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.913+0000 7f061a000640 1 -- 172.21.15.44:0/3274820398 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0614039070 con 0x7f061c161e70 2024-03-30T13:15:45.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.913+0000 7f061a000640 1 -- 172.21.15.44:0/3274820398 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f061402cc30 con 0x7f061c161e70 2024-03-30T13:15:45.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.913+0000 7f061a000640 1 -- 172.21.15.44:0/3274820398 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0614034440 con 0x7f061c161e70 2024-03-30T13:15:45.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.914+0000 7f0621000640 1 -- 172.21.15.44:0/3274820398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c161e70 msgr2=0x7f061c0b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:45.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.914+0000 7f0621000640 1 --2- 172.21.15.44:0/3274820398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c161e70 0x7f061c0b3a50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0614009dc0 tx=0x7f061402be80 comp rx=0 tx=0).stop 2024-03-30T13:15:45.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.914+0000 7f0621000640 1 -- 172.21.15.44:0/3274820398 shutdown_connections 2024-03-30T13:15:45.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.914+0000 7f0621000640 1 --2- 172.21.15.44:0/3274820398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c161e70 0x7f061c0b3a50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:45.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.914+0000 7f0621000640 1 -- 172.21.15.44:0/3274820398 >> 172.21.15.44:0/3274820398 conn(0x7f061c09d570 msgr2=0x7f061c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:45.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.914+0000 7f0621000640 1 -- 172.21.15.44:0/3274820398 shutdown_connections 2024-03-30T13:15:45.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.914+0000 7f0621000640 1 -- 172.21.15.44:0/3274820398 wait complete. 2024-03-30T13:15:45.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.916+0000 7f0621000640 1 Processor -- start 2024-03-30T13:15:45.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.916+0000 7f0621000640 1 -- start start 2024-03-30T13:15:45.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.917+0000 7f0621000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0d0d30 0x7f061c1f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:45.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.917+0000 7f0621000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f061c0d4950 0x7f061c153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:45.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.917+0000 7f0621000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f061c161e70 0x7f061c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:45.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.917+0000 7f0621000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f061c0d1290 con 0x7f061c161e70 2024-03-30T13:15:45.923 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.917+0000 7f0621000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f061c0d1110 con 0x7f061c0d4950 2024-03-30T13:15:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.917+0000 7f0621000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f061c0d1410 con 0x7f061c0d0d30 2024-03-30T13:15:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.917+0000 7f061be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f061c161e70 0x7f061c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.917+0000 7f061be00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f061c161e70 0x7f061c0cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59530/0 (socket says 172.21.15.44:59530) 2024-03-30T13:15:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.917+0000 7f061be00640 1 -- 172.21.15.44:0/291645724 learned_addr learned my addr 172.21.15.44:0/291645724 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.917+0000 7f061aa00640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f061c0d4950 0x7f061c153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.917+0000 7f061b400640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0d0d30 0x7f061c1f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.918+0000 7f061be00640 1 -- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0d0d30 msgr2=0x7f061c1f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.918+0000 7f061be00640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0d0d30 0x7f061c1f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.918+0000 7f061be00640 1 -- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f061c0d4950 msgr2=0x7f061c153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.918+0000 7f061be00640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f061c0d4950 0x7f061c153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.918+0000 7f061be00640 1 -- 172.21.15.44:0/291645724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f061c0ce140 con 0x7f061c161e70 2024-03-30T13:15:45.924 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.918+0000 7f061be00640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f061c161e70 0x7f061c0cdc00 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0614037040 tx=0x7f0614004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.918+0000 7f0613400640 1 -- 172.21.15.44:0/291645724 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0614044020 con 0x7f061c161e70 2024-03-30T13:15:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.918+0000 7f0613400640 1 -- 172.21.15.44:0/291645724 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f061403f470 con 0x7f061c161e70 2024-03-30T13:15:45.925 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.918+0000 7f0613400640 1 -- 172.21.15.44:0/291645724 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0614039040 con 0x7f061c161e70 2024-03-30T13:15:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.918+0000 7f0621000640 1 -- 172.21.15.44:0/291645724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f061c1f4c40 con 0x7f061c161e70 2024-03-30T13:15:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.919+0000 7f0621000640 1 -- 172.21.15.44:0/291645724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f061c1f5200 con 0x7f061c161e70 2024-03-30T13:15:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.920+0000 7f0621000640 1 -- 172.21.15.44:0/291645724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f061c0c7dd0 con 0x7f061c161e70 2024-03-30T13:15:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.922+0000 7f0613400640 1 -- 172.21.15.44:0/291645724 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0614047020 con 0x7f061c161e70 2024-03-30T13:15:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.923+0000 7f0613400640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f05fc06c530 0x7f05fc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.923+0000 7f0613400640 1 -- 172.21.15.44:0/291645724 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f06140ae4d0 con 0x7f061c161e70 2024-03-30T13:15:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.923+0000 7f061b400640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f05fc06c530 0x7f05fc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.924+0000 7f061b400640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f05fc06c530 0x7f05fc06e9f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f060c004ea0 tx=0x7f060c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:45.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:45.933+0000 7f0613400640 1 -- 172.21.15.44:0/291645724 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f061c0c7dd0 con 0x7f061c161e70 2024-03-30T13:15:46.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.146+0000 7f0621000640 1 -- 172.21.15.44:0/291645724 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f061c075890 con 0x7f061c161e70 2024-03-30T13:15:46.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.149+0000 7f0613400640 1 -- 172.21.15.44:0/291645724 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16978 (secure 0 0 0) 0x7f061404e030 con 0x7f061c161e70 2024-03-30T13:15:46.155 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:46.155 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":46,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:15:30.641950+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:13:22.414656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-30T13:13:23.348753+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":45,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:15:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.153+0000 7f0621000640 1 -- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f05fc06c530 msgr2=0x7f05fc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.153+0000 7f0621000640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f05fc06c530 0x7f05fc06e9f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f060c004ea0 tx=0x7f060c009040 comp rx=0 tx=0).stop 2024-03-30T13:15:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.153+0000 7f0621000640 1 -- 172.21.15.44:0/291645724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f061c161e70 msgr2=0x7f061c0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.153+0000 7f0621000640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f061c161e70 0x7f061c0cdc00 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0614037040 tx=0x7f0614004a40 comp rx=0 tx=0).stop 2024-03-30T13:15:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.153+0000 7f0621000640 1 -- 172.21.15.44:0/291645724 shutdown_connections 2024-03-30T13:15:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.153+0000 7f0621000640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f061c161e70 0x7f061c0cdc00 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.153+0000 7f0621000640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f05fc06c530 0x7f05fc06e9f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.153+0000 7f0621000640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f061c0d4950 0x7f061c153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.153+0000 7f0621000640 1 --2- 172.21.15.44:0/291645724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f061c0d0d30 0x7f061c1f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.153+0000 7f0621000640 1 -- 172.21.15.44:0/291645724 >> 172.21.15.44:0/291645724 conn(0x7f061c09d570 msgr2=0x7f061c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:46.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.153+0000 7f0621000640 1 -- 172.21.15.44:0/291645724 shutdown_connections 2024-03-30T13:15:46.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.153+0000 7f0621000640 1 -- 172.21.15.44:0/291645724 wait complete. 2024-03-30T13:15:46.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-30T13:11:33.983851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-30T13:13:22.414656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-03-30T13:13:23.348753+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 45, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-30T13:15:46.180 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-30T13:15:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.396+0000 7fca68400640 1 Processor -- start 2024-03-30T13:15:46.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.397+0000 7fca68400640 1 -- start start 2024-03-30T13:15:46.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.398+0000 7fca68400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca60072d50 0x7fca600b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.398+0000 7fca68400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca6015fcb0 con 0x7fca60144cb0 2024-03-30T13:15:46.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.398+0000 7fca68400640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca600b35e0 con 0x7fca6015f800 2024-03-30T13:15:46.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.398+0000 7fca68400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fca600b3e80 con 0x7fca60072d50 2024-03-30T13:15:46.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.399+0000 7fca65a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fca60144cb0 0x7fca60072640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38478/0 (socket says 172.21.15.44:38478) 2024-03-30T13:15:46.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.399+0000 7fca65a00640 1 -- 172.21.15.44:0/1745294846 learned_addr learned my addr 172.21.15.44:0/1745294846 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:46.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.399+0000 7fca65000640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca60072d50 0x7fca600b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.399+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 631082204 0 0) 0x7fca54001110 con 0x7fca60144cb0 2024-03-30T13:15:46.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.399+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca48003520 con 0x7fca60144cb0 2024-03-30T13:15:46.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1992976649 0 0) 0x7fca48003520 con 0x7fca60144cb0 2024-03-30T13:15:46.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca60072d50 msgr2=0x7fca600b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:46.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca60072d50 0x7fca600b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 >> v1:172.21.15.151:6789/0 conn(0x7fca6015f800 legacy=0x7fca600ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca600b38c0 con 0x7fca60144cb0 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fca54001840 con 0x7fca60144cb0 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 >> v1:172.21.15.44:6789/0 conn(0x7fca60144cb0 legacy=0x7fca60072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca480039e0 0x7fca48003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca48004800 0x7fca48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca60072d50 0x7fca480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fca600b3e80 con 0x7fca48004800 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fca4800ba70 con 0x7fca480039e0 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fca4800bc70 con 0x7fca60072d50 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.400+0000 7fca65000640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca48004800 0x7fca48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.401+0000 7fca65a00640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca480039e0 0x7fca48003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.401+0000 7fca65000640 1 -- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca60072d50 msgr2=0x7fca480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.401+0000 7fca66400640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca60072d50 0x7fca480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.401+0000 7fca65000640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca60072d50 0x7fca480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.401+0000 7fca65000640 1 -- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca480039e0 msgr2=0x7fca48003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:46.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.401+0000 7fca65000640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca480039e0 0x7fca48003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.401+0000 7fca65000640 1 -- 172.21.15.44:0/1745294846 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca48003520 con 0x7fca48004800 2024-03-30T13:15:46.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.401+0000 7fca66400640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca60072d50 0x7fca480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:46.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.401+0000 7fca65a00640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca480039e0 0x7fca48003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:46.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.402+0000 7fca65000640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca48004800 0x7fca48004c80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009a90 tx=0x7fca48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba4d38e95e91b69 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:46.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.402+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c039070 con 0x7fca48004800 2024-03-30T13:15:46.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.402+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4c02c660 con 0x7fca48004800 2024-03-30T13:15:46.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.402+0000 7fca5fe00640 1 -- 172.21.15.44:0/1745294846 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c009690 con 0x7fca48004800 2024-03-30T13:15:46.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.403+0000 7fca68400640 1 -- 172.21.15.44:0/1745294846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca48004800 msgr2=0x7fca48004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.403+0000 7fca68400640 1 --2- 172.21.15.44:0/1745294846 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca48004800 0x7fca48004c80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009a90 tx=0x7fca48005830 comp rx=0 tx=0).stop 2024-03-30T13:15:46.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.403+0000 7fca66400640 1 -- 172.21.15.44:0/1745294846 reap_dead start 2024-03-30T13:15:46.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.403+0000 7fca68400640 1 -- 172.21.15.44:0/1745294846 shutdown_connections 2024-03-30T13:15:46.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.403+0000 7fca68400640 1 -- 172.21.15.44:0/1745294846 >> 172.21.15.44:0/1745294846 conn(0x7fca600b5b00 msgr2=0x7fca6006b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:46.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.403+0000 7fca68400640 1 -- 172.21.15.44:0/1745294846 shutdown_connections 2024-03-30T13:15:46.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.403+0000 7fca68400640 1 -- 172.21.15.44:0/1745294846 wait complete. 2024-03-30T13:15:46.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.405+0000 7fca68400640 1 Processor -- start 2024-03-30T13:15:46.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.405+0000 7fca68400640 1 -- start start 2024-03-30T13:15:46.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.406+0000 7fca68400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca48004800 0x7fca601423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.406+0000 7fca68400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca601439b0 0x7fca60142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.406+0000 7fca68400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6015a9a0 0x7fca601e6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.413 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.406+0000 7fca68400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fca600b2f20 con 0x7fca48004800 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.406+0000 7fca68400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fca600cdb30 con 0x7fca6015a9a0 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.406+0000 7fca68400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fca600b30a0 con 0x7fca601439b0 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.406+0000 7fca65a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca48004800 0x7fca601423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.406+0000 7fca65a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca48004800 0x7fca601423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59534/0 (socket says 172.21.15.44:59534) 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.406+0000 7fca65a00640 1 -- 172.21.15.44:0/4087797327 learned_addr learned my addr 172.21.15.44:0/4087797327 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.407+0000 7fca66400640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6015a9a0 0x7fca601e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.407+0000 7fca65a00640 1 -- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca601439b0 msgr2=0x7fca60142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.407+0000 7fca65000640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca601439b0 0x7fca60142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.407+0000 7fca65a00640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca601439b0 0x7fca60142e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.407+0000 7fca65a00640 1 -- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6015a9a0 msgr2=0x7fca601e6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.407+0000 7fca65a00640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6015a9a0 0x7fca601e6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.407+0000 7fca65a00640 1 -- 172.21.15.44:0/4087797327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca601435b0 con 0x7fca48004800 2024-03-30T13:15:46.414 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.407+0000 7fca66400640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6015a9a0 0x7fca601e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:46.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.407+0000 7fca65a00640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca48004800 0x7fca601423e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fca54007390 tx=0x7fca54007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:46.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.408+0000 7fca5d600640 1 -- 172.21.15.44:0/4087797327 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5400e8c0 con 0x7fca48004800 2024-03-30T13:15:46.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.408+0000 7fca5d600640 1 -- 172.21.15.44:0/4087797327 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca54018070 con 0x7fca48004800 2024-03-30T13:15:46.415 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.408+0000 7fca5d600640 1 -- 172.21.15.44:0/4087797327 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5400ec80 con 0x7fca48004800 2024-03-30T13:15:46.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.408+0000 7fca68400640 1 -- 172.21.15.44:0/4087797327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca60141620 con 0x7fca48004800 2024-03-30T13:15:46.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.408+0000 7fca68400640 1 -- 172.21.15.44:0/4087797327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca60141be0 con 0x7fca48004800 2024-03-30T13:15:46.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.409+0000 7fca68400640 1 -- 172.21.15.44:0/4087797327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca60075890 con 0x7fca48004800 2024-03-30T13:15:46.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.411+0000 7fca5d600640 1 -- 172.21.15.44:0/4087797327 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fca5401d460 con 0x7fca48004800 2024-03-30T13:15:46.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.412+0000 7fca5d600640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fca4006c530 0x7fca4006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.412+0000 7fca5d600640 1 -- 172.21.15.44:0/4087797327 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fca5408b9e0 con 0x7fca48004800 2024-03-30T13:15:46.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.413+0000 7fca65000640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fca4006c530 0x7fca4006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.414+0000 7fca65000640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fca4006c530 0x7fca4006e9f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fca4c036000 tx=0x7fca4c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:46.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.417+0000 7fca5d600640 1 -- 172.21.15.44:0/4087797327 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fca6015fcb0 con 0x7fca48004800 2024-03-30T13:15:46.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.621+0000 7fca68400640 1 -- 172.21.15.44:0/4087797327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fca600b4030 con 0x7fca48004800 2024-03-30T13:15:46.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.622+0000 7fca5d600640 1 -- 172.21.15.44:0/4087797327 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) ==== 93+0+10 (secure 0 0 0) 0x7fca54059e60 con 0x7fca48004800 2024-03-30T13:15:46.627 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-03-30T13:15:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.625+0000 7fca68400640 1 -- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fca4006c530 msgr2=0x7fca4006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.625+0000 7fca68400640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fca4006c530 0x7fca4006e9f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fca4c036000 tx=0x7fca4c030000 comp rx=0 tx=0).stop 2024-03-30T13:15:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.625+0000 7fca68400640 1 -- 172.21.15.44:0/4087797327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca48004800 msgr2=0x7fca601423e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.625+0000 7fca68400640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca48004800 0x7fca601423e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fca54007390 tx=0x7fca54007850 comp rx=0 tx=0).stop 2024-03-30T13:15:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.625+0000 7fca68400640 1 -- 172.21.15.44:0/4087797327 shutdown_connections 2024-03-30T13:15:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.625+0000 7fca68400640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fca4006c530 0x7fca4006e9f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.625+0000 7fca68400640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6015a9a0 0x7fca601e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.625+0000 7fca68400640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca601439b0 0x7fca60142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.625+0000 7fca68400640 1 --2- 172.21.15.44:0/4087797327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fca48004800 0x7fca601423e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.625+0000 7fca68400640 1 -- 172.21.15.44:0/4087797327 >> 172.21.15.44:0/4087797327 conn(0x7fca600b5b00 msgr2=0x7fca600d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.625+0000 7fca68400640 1 -- 172.21.15.44:0/4087797327 shutdown_connections 2024-03-30T13:15:46.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.625+0000 7fca68400640 1 -- 172.21.15.44:0/4087797327 wait complete. 2024-03-30T13:15:46.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-30T13:15:46.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.867+0000 7fdf01a00640 1 Processor -- start 2024-03-30T13:15:46.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.867+0000 7fdf01a00640 1 -- start start 2024-03-30T13:15:46.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.869+0000 7fdf01a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdefc0d18f0 0x7fdefc0d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.869+0000 7fdf01a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdefc0d46b0 0x7fdefc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.869+0000 7fdf01a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdefc0d32b0 con 0x7fdefc15c040 2024-03-30T13:15:46.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.869+0000 7fdf01a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fdefc0d4b20 con 0x7fdefc0d18f0 2024-03-30T13:15:46.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.869+0000 7fdf01a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fdefc15fa70 con 0x7fdefc0d46b0 2024-03-30T13:15:46.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.869+0000 7fdef3e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fdefc0d18f0 0x7fdefc0d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.869+0000 7fdefbe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fdefc15c040 0x7fdefc15f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:38492/0 (socket says 172.21.15.44:38492) 2024-03-30T13:15:46.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.869+0000 7fdefbe00640 1 -- 172.21.15.44:0/1717076532 learned_addr learned my addr 172.21.15.44:0/1717076532 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:46.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.869+0000 7fdf01000640 1 --2- 172.21.15.44:0/1717076532 >> v2:172.21.15.151:3300/0 conn(0x7fdefc0d46b0 0x7fdefc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.870+0000 7fdef3e00640 1 -- 172.21.15.44:0/1717076532 >> v2:172.21.15.151:3300/0 conn(0x7fdefc0d46b0 msgr2=0x7fdefc0b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:46.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.870+0000 7fdef3e00640 1 --2- 172.21.15.44:0/1717076532 >> v2:172.21.15.151:3300/0 conn(0x7fdefc0d46b0 0x7fdefc0b4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.870+0000 7fdef3e00640 1 -- 172.21.15.44:0/1717076532 >> v1:172.21.15.44:6789/0 conn(0x7fdefc15c040 legacy=0x7fdefc15f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.870+0000 7fdef3e00640 1 -- 172.21.15.44:0/1717076532 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdefc0d2210 con 0x7fdefc0d18f0 2024-03-30T13:15:46.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.871+0000 7fdef3e00640 1 --2- 172.21.15.44:0/1717076532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdefc0d18f0 0x7fdefc0d4170 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fdee40097a0 tx=0x7fdee402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f757284d1cb691 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:46.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.871+0000 7fdefb400640 1 -- 172.21.15.44:0/1717076532 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee40315a0 con 0x7fdefc0d18f0 2024-03-30T13:15:46.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.871+0000 7fdefb400640 1 -- 172.21.15.44:0/1717076532 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee4037070 con 0x7fdefc0d18f0 2024-03-30T13:15:46.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.871+0000 7fdefb400640 1 -- 172.21.15.44:0/1717076532 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee4031960 con 0x7fdefc0d18f0 2024-03-30T13:15:46.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.872+0000 7fdf01a00640 1 -- 172.21.15.44:0/1717076532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdefc0d18f0 msgr2=0x7fdefc0d4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.872+0000 7fdf01a00640 1 --2- 172.21.15.44:0/1717076532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdefc0d18f0 0x7fdefc0d4170 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fdee40097a0 tx=0x7fdee402b840 comp rx=0 tx=0).stop 2024-03-30T13:15:46.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.872+0000 7fdf01a00640 1 -- 172.21.15.44:0/1717076532 shutdown_connections 2024-03-30T13:15:46.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.872+0000 7fdf01a00640 1 --2- 172.21.15.44:0/1717076532 >> v2:172.21.15.151:3300/0 conn(0x7fdefc0d46b0 0x7fdefc0b4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.872+0000 7fdf01a00640 1 --2- 172.21.15.44:0/1717076532 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdefc0d18f0 0x7fdefc0d4170 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.872+0000 7fdf01a00640 1 -- 172.21.15.44:0/1717076532 >> 172.21.15.44:0/1717076532 conn(0x7fdefc08dbf0 msgr2=0x7fdefc09d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:46.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.872+0000 7fdf01a00640 1 -- 172.21.15.44:0/1717076532 shutdown_connections 2024-03-30T13:15:46.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.872+0000 7fdf01a00640 1 -- 172.21.15.44:0/1717076532 wait complete. 2024-03-30T13:15:46.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.874+0000 7fdf01a00640 1 Processor -- start 2024-03-30T13:15:46.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.875+0000 7fdf01a00640 1 -- start start 2024-03-30T13:15:46.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.876+0000 7fdf01a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdefc0d18f0 0x7fdefc14f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.876+0000 7fdf01a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdefc0d46b0 0x7fdefc0c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.876+0000 7fdf01a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdefc15c040 0x7fdefc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.876+0000 7fdf01a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc0d2ab0 con 0x7fdefc0d18f0 2024-03-30T13:15:46.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.876+0000 7fdf01a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc0d27d0 con 0x7fdefc0d46b0 2024-03-30T13:15:46.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.876+0000 7fdf01a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fdefc0d2d90 con 0x7fdefc15c040 2024-03-30T13:15:46.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.876+0000 7fdefbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdefc0d18f0 0x7fdefc14f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.877+0000 7fdefbe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdefc0d18f0 0x7fdefc14f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59540/0 (socket says 172.21.15.44:59540) 2024-03-30T13:15:46.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.877+0000 7fdefbe00640 1 -- 172.21.15.44:0/1394871199 learned_addr learned my addr 172.21.15.44:0/1394871199 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:46.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.877+0000 7fdef3e00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdefc0d46b0 0x7fdefc0c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.877+0000 7fdf01000640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdefc15c040 0x7fdefc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.877+0000 7fdefbe00640 1 -- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdefc15c040 msgr2=0x7fdefc0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.877+0000 7fdefbe00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdefc15c040 0x7fdefc0cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.877+0000 7fdefbe00640 1 -- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdefc0d46b0 msgr2=0x7fdefc0c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:46.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.877+0000 7fdefbe00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdefc0d46b0 0x7fdefc0c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:46.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.877+0000 7fdefbe00640 1 -- 172.21.15.44:0/1394871199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdefc1f4c40 con 0x7fdefc0d18f0 2024-03-30T13:15:46.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.877+0000 7fdef3e00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdefc0d46b0 0x7fdefc0c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:46.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.877+0000 7fdefbe00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdefc0d18f0 0x7fdefc14f500 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00c400 tx=0x7fdeec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:46.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.878+0000 7fdef8c00640 1 -- 172.21.15.44:0/1394871199 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec017070 con 0x7fdefc0d18f0 2024-03-30T13:15:46.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.878+0000 7fdef8c00640 1 -- 172.21.15.44:0/1394871199 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeec005ce0 con 0x7fdefc0d18f0 2024-03-30T13:15:46.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.878+0000 7fdef8c00640 1 -- 172.21.15.44:0/1394871199 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0072f0 con 0x7fdefc0d18f0 2024-03-30T13:15:46.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.878+0000 7fdf01a00640 1 -- 172.21.15.44:0/1394871199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdefc1f4f20 con 0x7fdefc0d18f0 2024-03-30T13:15:46.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.878+0000 7fdf01a00640 1 -- 172.21.15.44:0/1394871199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdefc1f54e0 con 0x7fdefc0d18f0 2024-03-30T13:15:46.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.879+0000 7fdf01a00640 1 -- 172.21.15.44:0/1394871199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdefc075890 con 0x7fdefc0d18f0 2024-03-30T13:15:46.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.880+0000 7fdef8c00640 1 -- 172.21.15.44:0/1394871199 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdeec01a070 con 0x7fdefc0d18f0 2024-03-30T13:15:46.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.881+0000 7fdef8c00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fded806c530 0x7fded806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:46.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.881+0000 7fdef8c00640 1 -- 172.21.15.44:0/1394871199 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fdeec08ad50 con 0x7fdefc0d18f0 2024-03-30T13:15:46.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.882+0000 7fdef3e00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fded806c530 0x7fded806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:46.888 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.883+0000 7fdef3e00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fded806c530 0x7fded806e9f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdee4036000 tx=0x7fdee4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:46.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:46.886+0000 7fdef8c00640 1 -- 172.21.15.44:0/1394871199 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fdeec059110 con 0x7fdefc0d18f0 2024-03-30T13:15:47.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.086+0000 7fdf01a00640 1 -- 172.21.15.44:0/1394871199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdefc09d760 con 0x7fdefc0d18f0 2024-03-30T13:15:47.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.087+0000 7fdef8c00640 1 -- 172.21.15.44:0/1394871199 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) ==== 104+0+11 (secure 0 0 0) 0x7fdeec058a10 con 0x7fdefc0d18f0 2024-03-30T13:15:47.092 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 32 2024-03-30T13:15:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.090+0000 7fdf01a00640 1 -- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fded806c530 msgr2=0x7fded806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.090+0000 7fdf01a00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fded806c530 0x7fded806e9f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdee4036000 tx=0x7fdee4008030 comp rx=0 tx=0).stop 2024-03-30T13:15:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.090+0000 7fdf01a00640 1 -- 172.21.15.44:0/1394871199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdefc0d18f0 msgr2=0x7fdefc14f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.090+0000 7fdf01a00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdefc0d18f0 0x7fdefc14f500 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00c400 tx=0x7fdeec00c8c0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.090+0000 7fdf01a00640 1 -- 172.21.15.44:0/1394871199 shutdown_connections 2024-03-30T13:15:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.090+0000 7fdf01a00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdefc15c040 0x7fdefc0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.090+0000 7fdf01a00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fded806c530 0x7fded806e9f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.090+0000 7fdf01a00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdefc0d46b0 0x7fdefc0c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.090+0000 7fdf01a00640 1 --2- 172.21.15.44:0/1394871199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fdefc0d18f0 0x7fdefc14f500 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.090+0000 7fdf01a00640 1 -- 172.21.15.44:0/1394871199 >> 172.21.15.44:0/1394871199 conn(0x7fdefc08dbf0 msgr2=0x7fdefc06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:47.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.090+0000 7fdf01a00640 1 -- 172.21.15.44:0/1394871199 shutdown_connections 2024-03-30T13:15:47.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.091+0000 7fdf01a00640 1 -- 172.21.15.44:0/1394871199 wait complete. 2024-03-30T13:15:47.116 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-30T13:15:47.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.327+0000 7fee9d600640 1 Processor -- start 2024-03-30T13:15:47.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.328+0000 7fee9d600640 1 -- start start 2024-03-30T13:15:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.329+0000 7fee9d600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee98072d50 0x7fee980b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.329+0000 7fee9d600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fee9815f800 0x7fee980ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.329+0000 7fee9d600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee9815fcb0 con 0x7fee98144cb0 2024-03-30T13:15:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.329+0000 7fee9d600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fee980b3e80 con 0x7fee9815f800 2024-03-30T13:15:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.329+0000 7fee9d600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fee980b35e0 con 0x7fee98072d50 2024-03-30T13:15:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.330+0000 7fee97400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fee9815f800 0x7fee980ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.330+0000 7fee8e000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee98072d50 0x7fee980b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.330+0000 7fee8e000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee98072d50 0x7fee980b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:41388/0 (socket says 172.21.15.44:41388) 2024-03-30T13:15:47.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.330+0000 7fee8e000640 1 -- 172.21.15.44:0/263068733 learned_addr learned my addr 172.21.15.44:0/263068733 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.330+0000 7fee97400640 1 --2- 172.21.15.44:0/263068733 >> v2:172.21.15.151:3300/0 conn(0x7fee9815f800 0x7fee980ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:53528/0 (socket says 172.21.15.44:53528) 2024-03-30T13:15:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.331+0000 7fee8e000640 1 -- 172.21.15.44:0/263068733 >> v2:172.21.15.151:3300/0 conn(0x7fee9815f800 msgr2=0x7fee980ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.331+0000 7fee8e000640 1 --2- 172.21.15.44:0/263068733 >> v2:172.21.15.151:3300/0 conn(0x7fee9815f800 0x7fee980ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.331+0000 7fee8e000640 1 -- 172.21.15.44:0/263068733 >> v1:172.21.15.151:6789/0 conn(0x7fee98144cb0 legacy=0x7fee98072640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:47.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.331+0000 7fee8e000640 1 -- 172.21.15.44:0/263068733 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee980b38c0 con 0x7fee98072d50 2024-03-30T13:15:47.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.332+0000 7fee8e000640 1 --2- 172.21.15.44:0/263068733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee98072d50 0x7fee980b2f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee8000bb10 tx=0x7fee8002e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=985e12532e946e79 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:47.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.332+0000 7fee96000640 1 -- 172.21.15.44:0/263068733 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8003b070 con 0x7fee98072d50 2024-03-30T13:15:47.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.333+0000 7fee96000640 1 -- 172.21.15.44:0/263068733 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee80036440 con 0x7fee98072d50 2024-03-30T13:15:47.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.333+0000 7fee96000640 1 -- 172.21.15.44:0/263068733 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80036810 con 0x7fee98072d50 2024-03-30T13:15:47.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.333+0000 7fee9d600640 1 -- 172.21.15.44:0/263068733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee98072d50 msgr2=0x7fee980b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:47.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.333+0000 7fee9d600640 1 --2- 172.21.15.44:0/263068733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee98072d50 0x7fee980b2f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee8000bb10 tx=0x7fee8002e150 comp rx=0 tx=0).stop 2024-03-30T13:15:47.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.333+0000 7fee9d600640 1 -- 172.21.15.44:0/263068733 shutdown_connections 2024-03-30T13:15:47.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.333+0000 7fee9d600640 1 --2- 172.21.15.44:0/263068733 >> v2:172.21.15.151:3300/0 conn(0x7fee9815f800 0x7fee980ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.333+0000 7fee9d600640 1 --2- 172.21.15.44:0/263068733 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee98072d50 0x7fee980b2f20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.333+0000 7fee9d600640 1 -- 172.21.15.44:0/263068733 >> 172.21.15.44:0/263068733 conn(0x7fee980b5b00 msgr2=0x7fee9806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:47.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.333+0000 7fee9d600640 1 -- 172.21.15.44:0/263068733 shutdown_connections 2024-03-30T13:15:47.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.333+0000 7fee9d600640 1 -- 172.21.15.44:0/263068733 wait complete. 2024-03-30T13:15:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.335+0000 7fee9d600640 1 Processor -- start 2024-03-30T13:15:47.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.335+0000 7fee9d600640 1 -- start start 2024-03-30T13:15:47.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.336+0000 7fee9d600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee98072d50 0x7fee981419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.336+0000 7fee9d600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee98144cb0 0x7fee98143830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.336+0000 7fee9d600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee9815f800 0x7fee980aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.336+0000 7fee9d600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fee980ce590 con 0x7fee98144cb0 2024-03-30T13:15:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.336+0000 7fee9d600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fee980cdb30 con 0x7fee98072d50 2024-03-30T13:15:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.336+0000 7fee9d600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fee980ce710 con 0x7fee9815f800 2024-03-30T13:15:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.337+0000 7fee8e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee98144cb0 0x7fee98143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.337+0000 7fee8e000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee98144cb0 0x7fee98143830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37984/0 (socket says 172.21.15.44:37984) 2024-03-30T13:15:47.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.337+0000 7fee8e000640 1 -- 172.21.15.44:0/385322268 learned_addr learned my addr 172.21.15.44:0/385322268 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.337+0000 7fee96a00640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee98072d50 0x7fee981419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.337+0000 7fee97400640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee9815f800 0x7fee980aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.337+0000 7fee8e000640 1 -- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee9815f800 msgr2=0x7fee980aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.337+0000 7fee8e000640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee9815f800 0x7fee980aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.337+0000 7fee8e000640 1 -- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee98072d50 msgr2=0x7fee981419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.337+0000 7fee8e000640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee98072d50 0x7fee981419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.337+0000 7fee8e000640 1 -- 172.21.15.44:0/385322268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee98142320 con 0x7fee98144cb0 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.337+0000 7fee96a00640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee98072d50 0x7fee981419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.337+0000 7fee97400640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee9815f800 0x7fee980aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.338+0000 7fee8e000640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee98144cb0 0x7fee98143830 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fee8000b2c0 tx=0x7fee800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.338+0000 7fee8f400640 1 -- 172.21.15.44:0/385322268 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80046070 con 0x7fee98144cb0 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.338+0000 7fee8f400640 1 -- 172.21.15.44:0/385322268 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee800346a0 con 0x7fee98144cb0 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.338+0000 7fee9d600640 1 -- 172.21.15.44:0/385322268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee98142600 con 0x7fee98144cb0 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.338+0000 7fee8f400640 1 -- 172.21.15.44:0/385322268 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8003b040 con 0x7fee98144cb0 2024-03-30T13:15:47.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.338+0000 7fee9d600640 1 -- 172.21.15.44:0/385322268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee98142bc0 con 0x7fee98144cb0 2024-03-30T13:15:47.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.339+0000 7fee9d600640 1 -- 172.21.15.44:0/385322268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee9806bab0 con 0x7fee98144cb0 2024-03-30T13:15:47.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.340+0000 7fee8f400640 1 -- 172.21.15.44:0/385322268 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fee80049070 con 0x7fee98144cb0 2024-03-30T13:15:47.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.342+0000 7fee8f400640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fee7406c580 0x7fee7406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.342+0000 7fee8f400640 1 -- 172.21.15.44:0/385322268 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fee800ad630 con 0x7fee98144cb0 2024-03-30T13:15:47.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.343+0000 7fee96a00640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fee7406c580 0x7fee7406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.344+0000 7fee96a00640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fee7406c580 0x7fee7406ea40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fee88001d70 tx=0x7fee88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:47.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.346+0000 7fee8f400640 1 -- 172.21.15.44:0/385322268 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fee9806bab0 con 0x7fee98144cb0 2024-03-30T13:15:47.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.549+0000 7fee9d600640 1 -- 172.21.15.44:0/385322268 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fee98142dc0 con 0x7fee98144cb0 2024-03-30T13:15:47.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.549+0000 7fee8f400640 1 -- 172.21.15.44:0/385322268 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) ==== 100+0+11 (secure 0 0 0) 0x7fee98142dc0 con 0x7fee98144cb0 2024-03-30T13:15:47.555 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 64 2024-03-30T13:15:47.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.552+0000 7fee9d600640 1 -- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fee7406c580 msgr2=0x7fee7406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:47.557 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.552+0000 7fee9d600640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fee7406c580 0x7fee7406ea40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fee88001d70 tx=0x7fee88009040 comp rx=0 tx=0).stop 2024-03-30T13:15:47.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.552+0000 7fee9d600640 1 -- 172.21.15.44:0/385322268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee98144cb0 msgr2=0x7fee98143830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:47.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.552+0000 7fee9d600640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee98144cb0 0x7fee98143830 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fee8000b2c0 tx=0x7fee800046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.552+0000 7fee9d600640 1 -- 172.21.15.44:0/385322268 shutdown_connections 2024-03-30T13:15:47.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.552+0000 7fee9d600640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee9815f800 0x7fee980aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.552+0000 7fee9d600640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fee98144cb0 0x7fee98143830 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.552+0000 7fee9d600640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fee7406c580 0x7fee7406ea40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.552+0000 7fee9d600640 1 --2- 172.21.15.44:0/385322268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee98072d50 0x7fee981419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.552+0000 7fee9d600640 1 -- 172.21.15.44:0/385322268 >> 172.21.15.44:0/385322268 conn(0x7fee980b5b00 msgr2=0x7fee980b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:47.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.552+0000 7fee9d600640 1 -- 172.21.15.44:0/385322268 shutdown_connections 2024-03-30T13:15:47.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.552+0000 7fee9d600640 1 -- 172.21.15.44:0/385322268 wait complete. 2024-03-30T13:15:47.577 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:15:47.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.787+0000 7fd9a4200640 1 Processor -- start 2024-03-30T13:15:47.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.788+0000 7fd9a4200640 1 -- start start 2024-03-30T13:15:47.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.790+0000 7fd9a4200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd99c0cd3b0 0x7fd99c15a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.790+0000 7fd9a4200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd99c0cca10 0x7fd99c071a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.790+0000 7fd9a4200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd99c0724e0 con 0x7fd99c0cce50 2024-03-30T13:15:47.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.790+0000 7fd9a4200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fd99c0730f0 con 0x7fd99c0cca10 2024-03-30T13:15:47.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.790+0000 7fd9a4200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd99c0727c0 con 0x7fd99c0cd3b0 2024-03-30T13:15:47.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.790+0000 7fd9a2200640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fd99c0cce50 0x7fd99c0cae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57850/0 (socket says 172.21.15.44:57850) 2024-03-30T13:15:47.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.790+0000 7fd9a2200640 1 -- 172.21.15.44:0/2771802681 learned_addr learned my addr 172.21.15.44:0/2771802681 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd9a0e00640 1 --2- 172.21.15.44:0/2771802681 >> v2:172.21.15.151:3300/0 conn(0x7fd99c0cca10 0x7fd99c071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd9a1800640 1 --2- 172.21.15.44:0/2771802681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd99c0cd3b0 0x7fd99c15a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3772512701 0 0) 0x7fd99c0724e0 con 0x7fd99c0cce50 2024-03-30T13:15:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd984003520 con 0x7fd99c0cce50 2024-03-30T13:15:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3311359451 0 0) 0x7fd984003520 con 0x7fd99c0cce50 2024-03-30T13:15:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd99c0cd3b0 msgr2=0x7fd99c15a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 --2- 172.21.15.44:0/2771802681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd99c0cd3b0 0x7fd99c15a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 >> v2:172.21.15.151:3300/0 conn(0x7fd99c0cca10 msgr2=0x7fd99c071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 --2- 172.21.15.44:0/2771802681 >> v2:172.21.15.151:3300/0 conn(0x7fd99c0cca10 0x7fd99c071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99c072aa0 con 0x7fd99c0cce50 2024-03-30T13:15:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fd9940019f0 con 0x7fd99c0cce50 2024-03-30T13:15:47.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 >> v1:172.21.15.44:6789/0 conn(0x7fd99c0cce50 legacy=0x7fd99c0cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 --2- 172.21.15.44:0/2771802681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9840039b0 0x7fd984003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 --2- 172.21.15.44:0/2771802681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984004800 0x7fd984004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.791+0000 7fd99be00640 1 --2- 172.21.15.44:0/2771802681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd99c0cd3b0 0x7fd9840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.792+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c0730f0 con 0x7fd9840039b0 2024-03-30T13:15:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.792+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c0727c0 con 0x7fd984004800 2024-03-30T13:15:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.792+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd98400b9c0 con 0x7fd99c0cd3b0 2024-03-30T13:15:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.792+0000 7fd9a1800640 1 --2- 172.21.15.44:0/2771802681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9840039b0 0x7fd984003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.792+0000 7fd9a0e00640 1 --2- 172.21.15.44:0/2771802681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984004800 0x7fd984004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.792+0000 7fd9a2200640 1 --2- 172.21.15.44:0/2771802681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd99c0cd3b0 0x7fd9840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.792+0000 7fd9a1800640 1 -- 172.21.15.44:0/2771802681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd99c0cd3b0 msgr2=0x7fd9840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.792+0000 7fd9a1800640 1 --2- 172.21.15.44:0/2771802681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd99c0cd3b0 0x7fd9840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.792+0000 7fd9a1800640 1 -- 172.21.15.44:0/2771802681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984004800 msgr2=0x7fd984004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.792+0000 7fd9a1800640 1 --2- 172.21.15.44:0/2771802681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984004800 0x7fd984004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.792+0000 7fd9a1800640 1 -- 172.21.15.44:0/2771802681 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd984003520 con 0x7fd9840039b0 2024-03-30T13:15:47.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.794+0000 7fd9a1800640 1 --2- 172.21.15.44:0/2771802681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9840039b0 0x7fd984003dd0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd990009ac0 tx=0x7fd984005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8205a8f57b1ac861 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:47.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.794+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990039070 con 0x7fd9840039b0 2024-03-30T13:15:47.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.794+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd99002c6b0 con 0x7fd9840039b0 2024-03-30T13:15:47.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.794+0000 7fd99be00640 1 -- 172.21.15.44:0/2771802681 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990009690 con 0x7fd9840039b0 2024-03-30T13:15:47.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.795+0000 7fd9a4200640 1 -- 172.21.15.44:0/2771802681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9840039b0 msgr2=0x7fd984003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:47.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.795+0000 7fd9a4200640 1 --2- 172.21.15.44:0/2771802681 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9840039b0 0x7fd984003dd0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fd990009ac0 tx=0x7fd984005830 comp rx=0 tx=0).stop 2024-03-30T13:15:47.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.795+0000 7fd9a2200640 1 -- 172.21.15.44:0/2771802681 reap_dead start 2024-03-30T13:15:47.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.795+0000 7fd9a4200640 1 -- 172.21.15.44:0/2771802681 shutdown_connections 2024-03-30T13:15:47.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.795+0000 7fd9a4200640 1 -- 172.21.15.44:0/2771802681 >> 172.21.15.44:0/2771802681 conn(0x7fd99c0b1c90 msgr2=0x7fd99c0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:47.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.795+0000 7fd9a4200640 1 -- 172.21.15.44:0/2771802681 shutdown_connections 2024-03-30T13:15:47.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.795+0000 7fd9a4200640 1 -- 172.21.15.44:0/2771802681 wait complete. 2024-03-30T13:15:47.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.797+0000 7fd9a4200640 1 Processor -- start 2024-03-30T13:15:47.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.797+0000 7fd9a4200640 1 -- start start 2024-03-30T13:15:47.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a4200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9840039b0 0x7fd99c1f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a4200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd99c0b4690 0x7fd99c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a4200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd99c0b4af0 0x7fd99c158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a4200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c0cb700 con 0x7fd9840039b0 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a4200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c0cb580 con 0x7fd99c0b4af0 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a4200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd99c071fb0 con 0x7fd99c0b4690 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9840039b0 0x7fd99c1f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a1800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9840039b0 0x7fd99c1f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37994/0 (socket says 172.21.15.44:37994) 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a1800640 1 -- 172.21.15.44:0/2753092696 learned_addr learned my addr 172.21.15.44:0/2753092696 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a1800640 1 -- 172.21.15.44:0/2753092696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd99c0b4690 msgr2=0x7fd99c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a1800640 1 --2- 172.21.15.44:0/2753092696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd99c0b4690 0x7fd99c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a1800640 1 -- 172.21.15.44:0/2753092696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd99c0b4af0 msgr2=0x7fd99c158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a1800640 1 --2- 172.21.15.44:0/2753092696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd99c0b4af0 0x7fd99c158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.798+0000 7fd9a1800640 1 -- 172.21.15.44:0/2753092696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99c1f5250 con 0x7fd9840039b0 2024-03-30T13:15:47.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.799+0000 7fd9a1800640 1 --2- 172.21.15.44:0/2753092696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9840039b0 0x7fd99c1f4d10 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd990009ac0 tx=0x7fd990004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:47.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.799+0000 7fd999600640 1 -- 172.21.15.44:0/2753092696 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990039050 con 0x7fd9840039b0 2024-03-30T13:15:47.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.799+0000 7fd999600640 1 -- 172.21.15.44:0/2753092696 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd990045070 con 0x7fd9840039b0 2024-03-30T13:15:47.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.799+0000 7fd999600640 1 -- 172.21.15.44:0/2753092696 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd990003a50 con 0x7fd9840039b0 2024-03-30T13:15:47.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.799+0000 7fd9a4200640 1 -- 172.21.15.44:0/2753092696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd99c1541e0 con 0x7fd9840039b0 2024-03-30T13:15:47.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.799+0000 7fd9a4200640 1 -- 172.21.15.44:0/2753092696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd99c1547a0 con 0x7fd9840039b0 2024-03-30T13:15:47.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.800+0000 7fd9a4200640 1 -- 172.21.15.44:0/2753092696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd99c0ca240 con 0x7fd9840039b0 2024-03-30T13:15:47.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.801+0000 7fd999600640 1 -- 172.21.15.44:0/2753092696 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd990003bf0 con 0x7fd9840039b0 2024-03-30T13:15:47.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.802+0000 7fd999600640 1 --2- 172.21.15.44:0/2753092696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd97c06c530 0x7fd97c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:47.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.802+0000 7fd999600640 1 -- 172.21.15.44:0/2753092696 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fd9900ad510 con 0x7fd9840039b0 2024-03-30T13:15:47.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.803+0000 7fd9a0e00640 1 --2- 172.21.15.44:0/2753092696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd97c06c530 0x7fd97c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:47.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.804+0000 7fd9a0e00640 1 --2- 172.21.15.44:0/2753092696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd97c06c530 0x7fd97c06e9f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd988006e80 tx=0x7fd988006df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:47.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:47.807+0000 7fd999600640 1 -- 172.21.15.44:0/2753092696 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd99c0ca240 con 0x7fd9840039b0 2024-03-30T13:15:48.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.099+0000 7fd9a4200640 1 -- 172.21.15.44:0/2753092696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd99c06e2e0 con 0x7fd9840039b0 2024-03-30T13:15:48.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.100+0000 7fd999600640 1 -- 172.21.15.44:0/2753092696 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5184 (secure 0 0 0) 0x7fd99004e020 con 0x7fd9840039b0 2024-03-30T13:15:48.105 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:48.105 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/3435907345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3435907345},{"type":"v1","addr":"172.21.15.151:6836","nonce":3435907345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3966337326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":3966337326},{"type":"v1","addr":"172.21.15.151:6837","nonce":3966337326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/4136308231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":4136308231},{"type":"v1","addr":"172.21.15.44:6833","nonce":4136308231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:13:24.374039+0000","modified":"2024-03-30T13:15:32.728090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/585602782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":585602782},{"type":"v1","addr":"172.21.15.44:6835","nonce":585602782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5298,"qdb_cluster":[5298]},"id":2}]} 2024-03-30T13:15:48.106 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 21 2024-03-30T13:15:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.103+0000 7fd9a4200640 1 -- 172.21.15.44:0/2753092696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd97c06c530 msgr2=0x7fd97c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.103+0000 7fd9a4200640 1 --2- 172.21.15.44:0/2753092696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd97c06c530 0x7fd97c06e9f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd988006e80 tx=0x7fd988006df0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.103+0000 7fd9a4200640 1 -- 172.21.15.44:0/2753092696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9840039b0 msgr2=0x7fd99c1f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.103+0000 7fd9a4200640 1 --2- 172.21.15.44:0/2753092696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9840039b0 0x7fd99c1f4d10 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd990009ac0 tx=0x7fd990004730 comp rx=0 tx=0).stop 2024-03-30T13:15:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.104+0000 7fd9a4200640 1 -- 172.21.15.44:0/2753092696 shutdown_connections 2024-03-30T13:15:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.104+0000 7fd9a4200640 1 --2- 172.21.15.44:0/2753092696 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd97c06c530 0x7fd97c06e9f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.104+0000 7fd9a4200640 1 --2- 172.21.15.44:0/2753092696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd99c0b4af0 0x7fd99c158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.104+0000 7fd9a4200640 1 --2- 172.21.15.44:0/2753092696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd99c0b4690 0x7fd99c1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.104+0000 7fd9a4200640 1 --2- 172.21.15.44:0/2753092696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9840039b0 0x7fd99c1f4d10 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.104+0000 7fd9a4200640 1 -- 172.21.15.44:0/2753092696 >> 172.21.15.44:0/2753092696 conn(0x7fd99c0b1c90 msgr2=0x7fd99c159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:48.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.104+0000 7fd9a4200640 1 -- 172.21.15.44:0/2753092696 shutdown_connections 2024-03-30T13:15:48.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.104+0000 7fd9a4200640 1 -- 172.21.15.44:0/2753092696 wait complete. 2024-03-30T13:15:48.128 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:15:48.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.328+0000 7f1e94c00640 1 Processor -- start 2024-03-30T13:15:48.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.329+0000 7f1e94c00640 1 -- start start 2024-03-30T13:15:48.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.332+0000 7f1e94c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1e901562f0 0x7f1e901566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.332+0000 7f1e94c00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e90160c20 con 0x7f1e900d09a0 2024-03-30T13:15:48.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.332+0000 7f1e94c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e901600a0 con 0x7f1e90142300 2024-03-30T13:15:48.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.332+0000 7f1e94c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f1e90156c10 con 0x7f1e901562f0 2024-03-30T13:15:48.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.332+0000 7f1e8fe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f1e900d09a0 0x7f1e9015ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57858/0 (socket says 172.21.15.44:57858) 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.332+0000 7f1e8fe00640 1 -- 172.21.15.44:0/3838477014 learned_addr learned my addr 172.21.15.44:0/3838477014 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.333+0000 7f1e8f400640 1 --2- 172.21.15.44:0/3838477014 >> v2:172.21.15.151:3300/0 conn(0x7f1e901562f0 0x7f1e901566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.333+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940677560 0 0) 0x7f1e90160c20 con 0x7f1e900d09a0 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.333+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e74003520 con 0x7f1e900d09a0 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.333+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4195302798 0 0) 0x7f1e74003520 con 0x7f1e900d09a0 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.333+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 >> v2:172.21.15.151:3300/0 conn(0x7f1e901562f0 msgr2=0x7f1e901566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.333+0000 7f1e8e000640 1 --2- 172.21.15.44:0/3838477014 >> v2:172.21.15.151:3300/0 conn(0x7f1e901562f0 0x7f1e901566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.333+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 >> v1:172.21.15.151:6789/0 conn(0x7f1e90142300 legacy=0x7f1e900d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.333+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e90160380 con 0x7f1e900d09a0 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.333+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f1e880019f0 con 0x7f1e900d09a0 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.333+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 >> v1:172.21.15.44:6789/0 conn(0x7f1e900d09a0 legacy=0x7f1e9015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.333+0000 7f1e8e000640 1 --2- 172.21.15.44:0/3838477014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e74003a00 0x7f1e74003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8e000640 1 --2- 172.21.15.44:0/3838477014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e74004800 0x7f1e74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8e000640 1 --2- 172.21.15.44:0/3838477014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e74005210 0x7f1e7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e90156c10 con 0x7f1e74003a00 2024-03-30T13:15:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7400c160 con 0x7f1e74005210 2024-03-30T13:15:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1e7400c360 con 0x7f1e74004800 2024-03-30T13:15:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8f400640 1 --2- 172.21.15.44:0/3838477014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e74003a00 0x7f1e74003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8fe00640 1 --2- 172.21.15.44:0/3838477014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e74005210 0x7f1e7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8ea00640 1 --2- 172.21.15.44:0/3838477014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e74004800 0x7f1e74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8f400640 1 -- 172.21.15.44:0/3838477014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e74004800 msgr2=0x7f1e74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8f400640 1 --2- 172.21.15.44:0/3838477014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e74004800 0x7f1e74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8f400640 1 -- 172.21.15.44:0/3838477014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e74005210 msgr2=0x7f1e7400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8f400640 1 --2- 172.21.15.44:0/3838477014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e74005210 0x7f1e7400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8fe00640 1 -- 172.21.15.44:0/3838477014 reap_dead start 2024-03-30T13:15:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8f400640 1 -- 172.21.15.44:0/3838477014 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e74003520 con 0x7f1e74003a00 2024-03-30T13:15:48.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.334+0000 7f1e8ea00640 1 --2- 172.21.15.44:0/3838477014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e74004800 0x7f1e74004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.336+0000 7f1e8f400640 1 --2- 172.21.15.44:0/3838477014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e74003a00 0x7f1e74003e20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009a90 tx=0x7f1e74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889dc7823ab58941 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.336+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e80039070 con 0x7f1e74003a00 2024-03-30T13:15:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.336+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8002c680 con 0x7f1e74003a00 2024-03-30T13:15:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.336+0000 7f1e8e000640 1 -- 172.21.15.44:0/3838477014 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e80009690 con 0x7f1e74003a00 2024-03-30T13:15:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.337+0000 7f1e94c00640 1 -- 172.21.15.44:0/3838477014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e74003a00 msgr2=0x7f1e74003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.337+0000 7f1e94c00640 1 --2- 172.21.15.44:0/3838477014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e74003a00 0x7f1e74003e20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1e80009a90 tx=0x7f1e74005830 comp rx=0 tx=0).stop 2024-03-30T13:15:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.337+0000 7f1e94c00640 1 -- 172.21.15.44:0/3838477014 shutdown_connections 2024-03-30T13:15:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.337+0000 7f1e94c00640 1 --2- 172.21.15.44:0/3838477014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e74003a00 0x7f1e74003e20 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.337+0000 7f1e94c00640 1 -- 172.21.15.44:0/3838477014 >> 172.21.15.44:0/3838477014 conn(0x7f1e9006b9a0 msgr2=0x7f1e9006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.337+0000 7f1e94c00640 1 -- 172.21.15.44:0/3838477014 shutdown_connections 2024-03-30T13:15:48.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.337+0000 7f1e94c00640 1 -- 172.21.15.44:0/3838477014 wait complete. 2024-03-30T13:15:48.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.339+0000 7f1e94c00640 1 Processor -- start 2024-03-30T13:15:48.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.339+0000 7f1e94c00640 1 -- start start 2024-03-30T13:15:48.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.340+0000 7f1e94c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e74003a00 0x7f1e9015c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.340+0000 7f1e94c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e901389b0 0x7f1e90139540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.340+0000 7f1e94c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e90139a80 0x7f1e9015e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.340+0000 7f1e94c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e90142780 con 0x7f1e90139a80 2024-03-30T13:15:48.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.340+0000 7f1e94c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1e90160940 con 0x7f1e74003a00 2024-03-30T13:15:48.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.340+0000 7f1e94c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1e900cca20 con 0x7f1e901389b0 2024-03-30T13:15:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.341+0000 7f1e8fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e90139a80 0x7f1e9015e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.341+0000 7f1e8fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e90139a80 0x7f1e9015e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38010/0 (socket says 172.21.15.44:38010) 2024-03-30T13:15:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.341+0000 7f1e8fe00640 1 -- 172.21.15.44:0/3462735388 learned_addr learned my addr 172.21.15.44:0/3462735388 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.341+0000 7f1e8ea00640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e901389b0 0x7f1e90139540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.341+0000 7f1e8f400640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e74003a00 0x7f1e9015c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.341+0000 7f1e8fe00640 1 -- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e901389b0 msgr2=0x7f1e90139540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.341+0000 7f1e8fe00640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e901389b0 0x7f1e90139540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.341+0000 7f1e8fe00640 1 -- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e74003a00 msgr2=0x7f1e9015c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.341+0000 7f1e8fe00640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e74003a00 0x7f1e9015c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.341+0000 7f1e8fe00640 1 -- 172.21.15.44:0/3462735388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9015d100 con 0x7f1e90139a80 2024-03-30T13:15:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.341+0000 7f1e8f400640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e74003a00 0x7f1e9015c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.341+0000 7f1e8fe00640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e90139a80 0x7f1e9015e1a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f1e900cd7f0 tx=0x7f1e88007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.342+0000 7f1e87400640 1 -- 172.21.15.44:0/3462735388 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800eaa0 con 0x7f1e90139a80 2024-03-30T13:15:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.342+0000 7f1e87400640 1 -- 172.21.15.44:0/3462735388 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e88018070 con 0x7f1e90139a80 2024-03-30T13:15:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.342+0000 7f1e94c00640 1 -- 172.21.15.44:0/3462735388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9015d3e0 con 0x7f1e90139a80 2024-03-30T13:15:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.342+0000 7f1e87400640 1 -- 172.21.15.44:0/3462735388 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800ee80 con 0x7f1e90139a80 2024-03-30T13:15:48.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.342+0000 7f1e94c00640 1 -- 172.21.15.44:0/3462735388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e9015d9a0 con 0x7f1e90139a80 2024-03-30T13:15:48.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.343+0000 7f1e94c00640 1 -- 172.21.15.44:0/3462735388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e90075890 con 0x7f1e90139a80 2024-03-30T13:15:48.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.344+0000 7f1e87400640 1 -- 172.21.15.44:0/3462735388 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1e8801d460 con 0x7f1e90139a80 2024-03-30T13:15:48.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.345+0000 7f1e87400640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1e7006c530 0x7f1e7006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.346+0000 7f1e87400640 1 -- 172.21.15.44:0/3462735388 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7f1e8808bc20 con 0x7f1e90139a80 2024-03-30T13:15:48.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.346+0000 7f1e8f400640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1e7006c530 0x7f1e7006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.347+0000 7f1e8f400640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1e7006c530 0x7f1e7006e9f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1e80036000 tx=0x7f1e80030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:48.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.350+0000 7f1e87400640 1 -- 172.21.15.44:0/3462735388 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1e88059fe0 con 0x7f1e90139a80 2024-03-30T13:15:48.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.602+0000 7f1e94c00640 1 -- 172.21.15.44:0/3462735388 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e9006ef60 con 0x7f1e90139a80 2024-03-30T13:15:48.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.604+0000 7f1e87400640 1 -- 172.21.15.44:0/3462735388 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16978 (secure 0 0 0) 0x7f1e8805ee20 con 0x7f1e90139a80 2024-03-30T13:15:48.610 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:48.610 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":46,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:15:30.641950+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:13:22.414656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-30T13:13:23.348753+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":45,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:15:48.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.607+0000 7f1e94c00640 1 -- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1e7006c530 msgr2=0x7f1e7006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.607+0000 7f1e94c00640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1e7006c530 0x7f1e7006e9f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1e80036000 tx=0x7f1e80030000 comp rx=0 tx=0).stop 2024-03-30T13:15:48.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.607+0000 7f1e94c00640 1 -- 172.21.15.44:0/3462735388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e90139a80 msgr2=0x7f1e9015e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.607+0000 7f1e94c00640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e90139a80 0x7f1e9015e1a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f1e900cd7f0 tx=0x7f1e88007b50 comp rx=0 tx=0).stop 2024-03-30T13:15:48.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.607+0000 7f1e94c00640 1 -- 172.21.15.44:0/3462735388 shutdown_connections 2024-03-30T13:15:48.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.607+0000 7f1e94c00640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e90139a80 0x7f1e9015e1a0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.607+0000 7f1e94c00640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1e901389b0 0x7f1e90139540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.607+0000 7f1e94c00640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1e7006c530 0x7f1e7006e9f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.607+0000 7f1e94c00640 1 --2- 172.21.15.44:0/3462735388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e74003a00 0x7f1e9015c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.607+0000 7f1e94c00640 1 -- 172.21.15.44:0/3462735388 >> 172.21.15.44:0/3462735388 conn(0x7f1e9006b9a0 msgr2=0x7f1e90141580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:48.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.607+0000 7f1e94c00640 1 -- 172.21.15.44:0/3462735388 shutdown_connections 2024-03-30T13:15:48.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.607+0000 7f1e94c00640 1 -- 172.21.15.44:0/3462735388 wait complete. 2024-03-30T13:15:48.631 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T13:15:48.631 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:15:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.830+0000 7fb791200640 1 Processor -- start 2024-03-30T13:15:48.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.830+0000 7fb791200640 1 -- start start 2024-03-30T13:15:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.831+0000 7fb791200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fb78c0d0d30 0x7fb78c0cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.832+0000 7fb791200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78c0d4950 0x7fb78c161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.832+0000 7fb791200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78c0b5b60 con 0x7fb78c0d1110 2024-03-30T13:15:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.832+0000 7fb791200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fb78c0c7b90 con 0x7fb78c0d0d30 2024-03-30T13:15:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.832+0000 7fb791200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb78c0d4fc0 con 0x7fb78c0d4950 2024-03-30T13:15:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.832+0000 7fb78be00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fb78c0d1110 0x7fb78c0b3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57870/0 (socket says 172.21.15.44:57870) 2024-03-30T13:15:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.832+0000 7fb78be00640 1 -- 172.21.15.44:0/581895121 learned_addr learned my addr 172.21.15.44:0/581895121 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:48.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.832+0000 7fb78b400640 1 --2- 172.21.15.44:0/581895121 >> v2:172.21.15.44:3300/0 conn(0x7fb78c0d0d30 0x7fb78c0cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.832+0000 7fb78aa00640 1 --2- 172.21.15.44:0/581895121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78c0d4950 0x7fb78c161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.832+0000 7fb78a000640 1 -- 172.21.15.44:0/581895121 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 563420544 0 0) 0x7fb78c0b5b60 con 0x7fb78c0d1110 2024-03-30T13:15:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.833+0000 7fb78a000640 1 -- 172.21.15.44:0/581895121 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb770003520 con 0x7fb78c0d1110 2024-03-30T13:15:48.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.833+0000 7fb78b400640 1 -- 172.21.15.44:0/581895121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78c0d4950 msgr2=0x7fb78c161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:48.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.833+0000 7fb78b400640 1 --2- 172.21.15.44:0/581895121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78c0d4950 0x7fb78c161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.833+0000 7fb78b400640 1 -- 172.21.15.44:0/581895121 >> v1:172.21.15.44:6789/0 conn(0x7fb78c0d1110 legacy=0x7fb78c0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.833+0000 7fb78b400640 1 -- 172.21.15.44:0/581895121 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78c0b57f0 con 0x7fb78c0d0d30 2024-03-30T13:15:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.834+0000 7fb78b400640 1 --2- 172.21.15.44:0/581895121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78c0d0d30 0x7fb78c0cfde0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0097a0 tx=0x7fb77c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6365a9f9c15f7cd2 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.834+0000 7fb78a000640 1 -- 172.21.15.44:0/581895121 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c034070 con 0x7fb78c0d0d30 2024-03-30T13:15:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.834+0000 7fb78a000640 1 -- 172.21.15.44:0/581895121 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb77c030800 con 0x7fb78c0d0d30 2024-03-30T13:15:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.834+0000 7fb78a000640 1 -- 172.21.15.44:0/581895121 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c030bb0 con 0x7fb78c0d0d30 2024-03-30T13:15:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.835+0000 7fb791200640 1 -- 172.21.15.44:0/581895121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78c0d0d30 msgr2=0x7fb78c0cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.835+0000 7fb791200640 1 --2- 172.21.15.44:0/581895121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78c0d0d30 0x7fb78c0cfde0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0097a0 tx=0x7fb77c02b940 comp rx=0 tx=0).stop 2024-03-30T13:15:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.835+0000 7fb791200640 1 -- 172.21.15.44:0/581895121 shutdown_connections 2024-03-30T13:15:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.835+0000 7fb791200640 1 --2- 172.21.15.44:0/581895121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78c0d4950 0x7fb78c161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.835+0000 7fb791200640 1 --2- 172.21.15.44:0/581895121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78c0d0d30 0x7fb78c0cfde0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.835+0000 7fb791200640 1 -- 172.21.15.44:0/581895121 >> 172.21.15.44:0/581895121 conn(0x7fb78c09d570 msgr2=0x7fb78c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:48.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.835+0000 7fb791200640 1 -- 172.21.15.44:0/581895121 shutdown_connections 2024-03-30T13:15:48.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.835+0000 7fb791200640 1 -- 172.21.15.44:0/581895121 wait complete. 2024-03-30T13:15:48.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.837+0000 7fb791200640 1 Processor -- start 2024-03-30T13:15:48.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.837+0000 7fb791200640 1 -- start start 2024-03-30T13:15:48.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.838+0000 7fb791200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78c0d0d30 0x7fb78c0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.838+0000 7fb791200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb78c0d1110 0x7fb78c1f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.838+0000 7fb791200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78c0d4950 0x7fb78c0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.838+0000 7fb791200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c0b3300 con 0x7fb78c0d0d30 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.838+0000 7fb791200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c0b3180 con 0x7fb78c0d1110 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.838+0000 7fb791200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fb78c0d3150 con 0x7fb78c0d4950 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.838+0000 7fb78b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78c0d0d30 0x7fb78c0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.838+0000 7fb78b400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78c0d0d30 0x7fb78c0c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38024/0 (socket says 172.21.15.44:38024) 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.838+0000 7fb78b400640 1 -- 172.21.15.44:0/1307594711 learned_addr learned my addr 172.21.15.44:0/1307594711 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.839+0000 7fb78be00640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78c0d4950 0x7fb78c0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.839+0000 7fb78aa00640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb78c0d1110 0x7fb78c1f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.839+0000 7fb78b400640 1 -- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78c0d4950 msgr2=0x7fb78c0cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.839+0000 7fb78b400640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78c0d4950 0x7fb78c0cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.839+0000 7fb78b400640 1 -- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb78c0d1110 msgr2=0x7fb78c1f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.839+0000 7fb78b400640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb78c0d1110 0x7fb78c1f3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.839+0000 7fb78b400640 1 -- 172.21.15.44:0/1307594711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78c1f79b0 con 0x7fb78c0d0d30 2024-03-30T13:15:48.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.839+0000 7fb78b400640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78c0d0d30 0x7fb78c0c9a80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0098c0 tx=0x7fb77c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:48.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.839+0000 7fb783400640 1 -- 172.21.15.44:0/1307594711 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c034040 con 0x7fb78c0d0d30 2024-03-30T13:15:48.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.839+0000 7fb783400640 1 -- 172.21.15.44:0/1307594711 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb77c030e30 con 0x7fb78c0d0d30 2024-03-30T13:15:48.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.839+0000 7fb791200640 1 -- 172.21.15.44:0/1307594711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78c1f7c90 con 0x7fb78c0d0d30 2024-03-30T13:15:48.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.839+0000 7fb783400640 1 -- 172.21.15.44:0/1307594711 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c039d10 con 0x7fb78c0d0d30 2024-03-30T13:15:48.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.840+0000 7fb791200640 1 -- 172.21.15.44:0/1307594711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78c1f8250 con 0x7fb78c0d0d30 2024-03-30T13:15:48.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.841+0000 7fb791200640 1 -- 172.21.15.44:0/1307594711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78c160020 con 0x7fb78c0d0d30 2024-03-30T13:15:48.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.842+0000 7fb783400640 1 -- 172.21.15.44:0/1307594711 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb77c037070 con 0x7fb78c0d0d30 2024-03-30T13:15:48.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.842+0000 7fb783400640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb76c06c530 0x7fb76c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:48.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.843+0000 7fb783400640 1 -- 172.21.15.44:0/1307594711 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7fb77c0ada40 con 0x7fb78c0d0d30 2024-03-30T13:15:48.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.843+0000 7fb78aa00640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb76c06c530 0x7fb76c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:48.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.844+0000 7fb78aa00640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb76c06c530 0x7fb76c06e9f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb78c15cc80 tx=0x7fb778008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:48.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:48.847+0000 7fb783400640 1 -- 172.21.15.44:0/1307594711 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb78c160020 con 0x7fb78c0d0d30 2024-03-30T13:15:49.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.130+0000 7fb791200640 1 -- 172.21.15.44:0/1307594711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb78c075890 con 0x7fb78c0d0d30 2024-03-30T13:15:49.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.131+0000 7fb783400640 1 -- 172.21.15.44:0/1307594711 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5184 (secure 0 0 0) 0x7fb77c07bd80 con 0x7fb78c0d0d30 2024-03-30T13:15:49.136 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:49.136 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/3435907345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3435907345},{"type":"v1","addr":"172.21.15.151:6836","nonce":3435907345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3966337326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":3966337326},{"type":"v1","addr":"172.21.15.151:6837","nonce":3966337326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/4136308231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":4136308231},{"type":"v1","addr":"172.21.15.44:6833","nonce":4136308231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:13:24.374039+0000","modified":"2024-03-30T13:15:32.728090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/585602782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":585602782},{"type":"v1","addr":"172.21.15.44:6835","nonce":585602782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5298,"qdb_cluster":[5298]},"id":2}]} 2024-03-30T13:15:49.136 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 21 2024-03-30T13:15:49.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.133+0000 7fb791200640 1 -- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb76c06c530 msgr2=0x7fb76c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:49.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.133+0000 7fb791200640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb76c06c530 0x7fb76c06e9f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb78c15cc80 tx=0x7fb778008040 comp rx=0 tx=0).stop 2024-03-30T13:15:49.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.133+0000 7fb791200640 1 -- 172.21.15.44:0/1307594711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78c0d0d30 msgr2=0x7fb78c0c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.133+0000 7fb791200640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78c0d0d30 0x7fb78c0c9a80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0098c0 tx=0x7fb77c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.133+0000 7fb791200640 1 -- 172.21.15.44:0/1307594711 shutdown_connections 2024-03-30T13:15:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.133+0000 7fb791200640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb78c0d4950 0x7fb78c0cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.133+0000 7fb791200640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fb76c06c530 0x7fb76c06e9f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.133+0000 7fb791200640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb78c0d1110 0x7fb78c1f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.133+0000 7fb791200640 1 --2- 172.21.15.44:0/1307594711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb78c0d0d30 0x7fb78c0c9a80 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.133+0000 7fb791200640 1 -- 172.21.15.44:0/1307594711 >> 172.21.15.44:0/1307594711 conn(0x7fb78c09d570 msgr2=0x7fb78c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.134+0000 7fb791200640 1 -- 172.21.15.44:0/1307594711 shutdown_connections 2024-03-30T13:15:49.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.134+0000 7fb791200640 1 -- 172.21.15.44:0/1307594711 wait complete. 2024-03-30T13:15:49.166 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:15:49.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.384+0000 7efe90200640 1 Processor -- start 2024-03-30T13:15:49.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.385+0000 7efe90200640 1 -- start start 2024-03-30T13:15:49.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.386+0000 7efe90200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe8815b270 0x7efe8815f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.386+0000 7efe90200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efe88072280 0x7efe880cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.386+0000 7efe90200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe8815b650 con 0x7efe880ccf10 2024-03-30T13:15:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.386+0000 7efe90200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7efe88072ab0 con 0x7efe88072280 2024-03-30T13:15:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.386+0000 7efe90200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7efe88072d90 con 0x7efe8815b270 2024-03-30T13:15:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.387+0000 7efe8ce00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efe88072280 0x7efe880cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.387+0000 7efe8d800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe8815b270 0x7efe8815f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.387+0000 7efe8d800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe8815b270 0x7efe8815f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:41464/0 (socket says 172.21.15.44:41464) 2024-03-30T13:15:49.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.387+0000 7efe8d800640 1 -- 172.21.15.44:0/1705460364 learned_addr learned my addr 172.21.15.44:0/1705460364 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:49.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.388+0000 7efe8d800640 1 -- 172.21.15.44:0/1705460364 >> v2:172.21.15.151:3300/0 conn(0x7efe88072280 msgr2=0x7efe880cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:49.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.388+0000 7efe8d800640 1 --2- 172.21.15.44:0/1705460364 >> v2:172.21.15.151:3300/0 conn(0x7efe88072280 0x7efe880cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.388+0000 7efe8d800640 1 -- 172.21.15.44:0/1705460364 >> v1:172.21.15.151:6789/0 conn(0x7efe880ccf10 legacy=0x7efe880cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:49.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.388+0000 7efe8d800640 1 -- 172.21.15.44:0/1705460364 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe88073070 con 0x7efe8815b270 2024-03-30T13:15:49.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.388+0000 7efe87e00640 1 -- 172.21.15.44:0/1705460364 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1682150740 0 0) 0x7efe8815b650 con 0x7efe880ccf10 2024-03-30T13:15:49.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.389+0000 7efe8d800640 1 --2- 172.21.15.44:0/1705460364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe8815b270 0x7efe8815f7e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009870 tx=0x7efe7c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d777ffda30a0322b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:49.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.390+0000 7efe87e00640 1 -- 172.21.15.44:0/1705460364 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c034070 con 0x7efe8815b270 2024-03-30T13:15:49.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.390+0000 7efe87e00640 1 -- 172.21.15.44:0/1705460364 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7c030840 con 0x7efe8815b270 2024-03-30T13:15:49.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.390+0000 7efe87e00640 1 -- 172.21.15.44:0/1705460364 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe7c030c10 con 0x7efe8815b270 2024-03-30T13:15:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.391+0000 7efe90200640 1 -- 172.21.15.44:0/1705460364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe8815b270 msgr2=0x7efe8815f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.391+0000 7efe90200640 1 --2- 172.21.15.44:0/1705460364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe8815b270 0x7efe8815f7e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009870 tx=0x7efe7c02b980 comp rx=0 tx=0).stop 2024-03-30T13:15:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.391+0000 7efe90200640 1 -- 172.21.15.44:0/1705460364 shutdown_connections 2024-03-30T13:15:49.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.391+0000 7efe90200640 1 --2- 172.21.15.44:0/1705460364 >> v2:172.21.15.151:3300/0 conn(0x7efe88072280 0x7efe880cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.391+0000 7efe90200640 1 --2- 172.21.15.44:0/1705460364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe8815b270 0x7efe8815f7e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.391+0000 7efe90200640 1 -- 172.21.15.44:0/1705460364 >> 172.21.15.44:0/1705460364 conn(0x7efe880b1c90 msgr2=0x7efe880b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:49.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.391+0000 7efe90200640 1 -- 172.21.15.44:0/1705460364 shutdown_connections 2024-03-30T13:15:49.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.391+0000 7efe90200640 1 -- 172.21.15.44:0/1705460364 wait complete. 2024-03-30T13:15:49.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.394+0000 7efe90200640 1 Processor -- start 2024-03-30T13:15:49.399 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.394+0000 7efe90200640 1 -- start start 2024-03-30T13:15:49.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.396+0000 7efe90200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe88072280 0x7efe8814b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.396+0000 7efe90200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe880ccf10 0x7efe881670e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.396+0000 7efe90200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8815b270 0x7efe88167620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.396+0000 7efe90200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7efe880726e0 con 0x7efe8815b270 2024-03-30T13:15:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.396+0000 7efe90200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efe88073630 con 0x7efe88072280 2024-03-30T13:15:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.396+0000 7efe90200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7efe88072860 con 0x7efe880ccf10 2024-03-30T13:15:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.396+0000 7efe8e200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8815b270 0x7efe88167620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.396+0000 7efe8e200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8815b270 0x7efe88167620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38036/0 (socket says 172.21.15.44:38036) 2024-03-30T13:15:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.396+0000 7efe8e200640 1 -- 172.21.15.44:0/1964650918 learned_addr learned my addr 172.21.15.44:0/1964650918 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.396+0000 7efe8d800640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe88072280 0x7efe8814b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.396+0000 7efe8ce00640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe880ccf10 0x7efe881670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.397+0000 7efe8e200640 1 -- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe880ccf10 msgr2=0x7efe881670e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.397+0000 7efe8e200640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe880ccf10 0x7efe881670e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.397+0000 7efe8e200640 1 -- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe88072280 msgr2=0x7efe8814b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.397+0000 7efe8e200640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe88072280 0x7efe8814b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.397+0000 7efe8e200640 1 -- 172.21.15.44:0/1964650918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe880b4a90 con 0x7efe8815b270 2024-03-30T13:15:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.397+0000 7efe8e200640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8815b270 0x7efe88167620 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7efe8000c760 tx=0x7efe8000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.397+0000 7efe85600640 1 -- 172.21.15.44:0/1964650918 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80003da0 con 0x7efe8815b270 2024-03-30T13:15:49.403 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.398+0000 7efe85600640 1 -- 172.21.15.44:0/1964650918 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe80005070 con 0x7efe8815b270 2024-03-30T13:15:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.398+0000 7efe85600640 1 -- 172.21.15.44:0/1964650918 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe80005460 con 0x7efe8815b270 2024-03-30T13:15:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.398+0000 7efe90200640 1 -- 172.21.15.44:0/1964650918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe8814b9e0 con 0x7efe8815b270 2024-03-30T13:15:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.398+0000 7efe90200640 1 -- 172.21.15.44:0/1964650918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe880b4ff0 con 0x7efe8815b270 2024-03-30T13:15:49.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.399+0000 7efe90200640 1 -- 172.21.15.44:0/1964650918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe88075a10 con 0x7efe8815b270 2024-03-30T13:15:49.405 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.400+0000 7efe85600640 1 -- 172.21.15.44:0/1964650918 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7efe80005600 con 0x7efe8815b270 2024-03-30T13:15:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.401+0000 7efe85600640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efe6806c530 0x7efe6806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.401+0000 7efe85600640 1 -- 172.21.15.44:0/1964650918 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7efe8008b6b0 con 0x7efe8815b270 2024-03-30T13:15:49.406 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.402+0000 7efe8d800640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efe6806c530 0x7efe6806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.403+0000 7efe8d800640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efe6806c530 0x7efe6806e9f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe7c036000 tx=0x7efe7c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:49.410 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.405+0000 7efe85600640 1 -- 172.21.15.44:0/1964650918 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7efe880b4a90 con 0x7efe8815b270 2024-03-30T13:15:49.654 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.649+0000 7efe90200640 1 -- 172.21.15.44:0/1964650918 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe8815a880 con 0x7efe8815b270 2024-03-30T13:15:49.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.650+0000 7efe85600640 1 -- 172.21.15.44:0/1964650918 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5184 (secure 0 0 0) 0x7efe800594c0 con 0x7efe8815b270 2024-03-30T13:15:49.655 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:49.655 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/3435907345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3435907345},{"type":"v1","addr":"172.21.15.151:6836","nonce":3435907345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3966337326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":3966337326},{"type":"v1","addr":"172.21.15.151:6837","nonce":3966337326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/4136308231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":4136308231},{"type":"v1","addr":"172.21.15.44:6833","nonce":4136308231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-30T13:13:24.374039+0000","modified":"2024-03-30T13:15:32.728090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5298},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5298":{"gid":5298,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.44:6835/585602782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":585602782},{"type":"v1","addr":"172.21.15.44:6835","nonce":585602782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5298,"qdb_cluster":[5298]},"id":2}]} 2024-03-30T13:15:49.656 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 21 2024-03-30T13:15:49.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.653+0000 7efe90200640 1 -- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efe6806c530 msgr2=0x7efe6806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:49.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.653+0000 7efe90200640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efe6806c530 0x7efe6806e9f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe7c036000 tx=0x7efe7c03c040 comp rx=0 tx=0).stop 2024-03-30T13:15:49.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.653+0000 7efe90200640 1 -- 172.21.15.44:0/1964650918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8815b270 msgr2=0x7efe88167620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:49.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.653+0000 7efe90200640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8815b270 0x7efe88167620 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7efe8000c760 tx=0x7efe8000cc20 comp rx=0 tx=0).stop 2024-03-30T13:15:49.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.653+0000 7efe90200640 1 -- 172.21.15.44:0/1964650918 shutdown_connections 2024-03-30T13:15:49.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.653+0000 7efe90200640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7efe8815b270 0x7efe88167620 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.653+0000 7efe90200640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe880ccf10 0x7efe881670e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.653+0000 7efe90200640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7efe6806c530 0x7efe6806e9f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.653+0000 7efe90200640 1 --2- 172.21.15.44:0/1964650918 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe88072280 0x7efe8814b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.653+0000 7efe90200640 1 -- 172.21.15.44:0/1964650918 >> 172.21.15.44:0/1964650918 conn(0x7efe880b1c90 msgr2=0x7efe8815ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.653+0000 7efe90200640 1 -- 172.21.15.44:0/1964650918 shutdown_connections 2024-03-30T13:15:49.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.653+0000 7efe90200640 1 -- 172.21.15.44:0/1964650918 wait complete. 2024-03-30T13:15:49.680 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:15:49.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.883+0000 7ff1dec00640 1 Processor -- start 2024-03-30T13:15:49.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.883+0000 7ff1dec00640 1 -- start start 2024-03-30T13:15:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.884+0000 7ff1dec00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff1d80d0d30 0x7ff1d80cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.884+0000 7ff1dec00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d8161e70 0x7ff1d80b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.884+0000 7ff1dec00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1d80b5b60 con 0x7ff1d80d4950 2024-03-30T13:15:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.884+0000 7ff1dec00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7ff1d80c7b90 con 0x7ff1d80d0d30 2024-03-30T13:15:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.884+0000 7ff1dec00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d80d4fc0 con 0x7ff1d8161e70 2024-03-30T13:15:49.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.884+0000 7ff1dce00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff1d80d4950 0x7ff1d8161760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57882/0 (socket says 172.21.15.44:57882) 2024-03-30T13:15:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.884+0000 7ff1dce00640 1 -- 172.21.15.44:0/3163928212 learned_addr learned my addr 172.21.15.44:0/3163928212 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1de200640 1 --2- 172.21.15.44:0/3163928212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d8161e70 0x7ff1d80b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1dd800640 1 --2- 172.21.15.44:0/3163928212 >> v2:172.21.15.151:3300/0 conn(0x7ff1d80d0d30 0x7ff1d80cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2751693037 0 0) 0x7ff1d80b5b60 con 0x7ff1d80d4950 2024-03-30T13:15:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c0003520 con 0x7ff1d80d4950 2024-03-30T13:15:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1912766357 0 0) 0x7ff1c0003520 con 0x7ff1d80d4950 2024-03-30T13:15:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d8161e70 msgr2=0x7ff1d80b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 --2- 172.21.15.44:0/3163928212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d8161e70 0x7ff1d80b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 >> v2:172.21.15.151:3300/0 conn(0x7ff1d80d0d30 msgr2=0x7ff1d80cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:49.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 --2- 172.21.15.44:0/3163928212 >> v2:172.21.15.151:3300/0 conn(0x7ff1d80d0d30 0x7ff1d80cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d80b57f0 con 0x7ff1d80d4950 2024-03-30T13:15:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7ff1c4001670 con 0x7ff1d80d4950 2024-03-30T13:15:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 >> v1:172.21.15.44:6789/0 conn(0x7ff1d80d4950 legacy=0x7ff1d8161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 --2- 172.21.15.44:0/3163928212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d8161e70 0x7ff1c00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 --2- 172.21.15.44:0/3163928212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1c0003f80 0x7ff1c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 --2- 172.21.15.44:0/3163928212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1c0004d40 0x7ff1c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d80c7b90 con 0x7ff1c0004d40 2024-03-30T13:15:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d80d4fc0 con 0x7ff1c0003f80 2024-03-30T13:15:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.885+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c000ba40 con 0x7ff1d8161e70 2024-03-30T13:15:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.886+0000 7ff1de200640 1 --2- 172.21.15.44:0/3163928212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1c0004d40 0x7ff1c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.886+0000 7ff1dce00640 1 --2- 172.21.15.44:0/3163928212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1c0003f80 0x7ff1c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.886+0000 7ff1de200640 1 -- 172.21.15.44:0/3163928212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d8161e70 msgr2=0x7ff1c00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:49.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.886+0000 7ff1de200640 1 --2- 172.21.15.44:0/3163928212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d8161e70 0x7ff1c00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.886+0000 7ff1de200640 1 -- 172.21.15.44:0/3163928212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1c0003f80 msgr2=0x7ff1c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:49.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.886+0000 7ff1de200640 1 --2- 172.21.15.44:0/3163928212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1c0003f80 0x7ff1c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.886+0000 7ff1de200640 1 -- 172.21.15.44:0/3163928212 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c0003520 con 0x7ff1c0004d40 2024-03-30T13:15:49.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.887+0000 7ff1de200640 1 --2- 172.21.15.44:0/3163928212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1c0004d40 0x7ff1c00051c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009fc0 tx=0x7ff1c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a5d034837ad1b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:49.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.887+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0039070 con 0x7ff1c0004d40 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.888+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d002cc30 con 0x7ff1c0004d40 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.888+0000 7ff1d7e00640 1 -- 172.21.15.44:0/3163928212 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0009c10 con 0x7ff1c0004d40 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.888+0000 7ff1dec00640 1 -- 172.21.15.44:0/3163928212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1c0004d40 msgr2=0x7ff1c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.888+0000 7ff1dec00640 1 --2- 172.21.15.44:0/3163928212 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1c0004d40 0x7ff1c00051c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0009fc0 tx=0x7ff1c0005830 comp rx=0 tx=0).stop 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.888+0000 7ff1de200640 1 -- 172.21.15.44:0/3163928212 reap_dead start 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.888+0000 7ff1dec00640 1 -- 172.21.15.44:0/3163928212 shutdown_connections 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.888+0000 7ff1dec00640 1 -- 172.21.15.44:0/3163928212 >> 172.21.15.44:0/3163928212 conn(0x7ff1d809d570 msgr2=0x7ff1d80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.888+0000 7ff1dec00640 1 -- 172.21.15.44:0/3163928212 shutdown_connections 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.888+0000 7ff1dec00640 1 -- 172.21.15.44:0/3163928212 wait complete. 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.890+0000 7ff1dec00640 1 Processor -- start 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.890+0000 7ff1dec00640 1 -- start start 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.891+0000 7ff1dec00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1c0004d40 0x7ff1d80b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.891+0000 7ff1dec00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d80c8720 0x7ff1d815d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.891+0000 7ff1dec00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1d80ca2f0 0x7ff1d80ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.891+0000 7ff1dec00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d80b3300 con 0x7ff1d80ca2f0 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.891+0000 7ff1dec00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d80b3180 con 0x7ff1c0004d40 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.891+0000 7ff1dec00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d80d1110 con 0x7ff1d80c8720 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.891+0000 7ff1de200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1d80ca2f0 0x7ff1d80ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.892+0000 7ff1de200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1d80ca2f0 0x7ff1d80ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38056/0 (socket says 172.21.15.44:38056) 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.892+0000 7ff1de200640 1 -- 172.21.15.44:0/1543089089 learned_addr learned my addr 172.21.15.44:0/1543089089 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.892+0000 7ff1dd800640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1c0004d40 0x7ff1d80b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.892+0000 7ff1de200640 1 -- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d80c8720 msgr2=0x7ff1d815d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.892+0000 7ff1dce00640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d80c8720 0x7ff1d815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.892+0000 7ff1de200640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d80c8720 0x7ff1d815d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.892+0000 7ff1de200640 1 -- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1c0004d40 msgr2=0x7ff1d80b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.892+0000 7ff1de200640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1c0004d40 0x7ff1d80b1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.892+0000 7ff1de200640 1 -- 172.21.15.44:0/1543089089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d80c8ee0 con 0x7ff1d80ca2f0 2024-03-30T13:15:49.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.892+0000 7ff1de200640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1d80ca2f0 0x7ff1d80ca780 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0037040 tx=0x7ff1d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.893+0000 7ff1d5600640 1 -- 172.21.15.44:0/1543089089 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0044070 con 0x7ff1d80ca2f0 2024-03-30T13:15:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.893+0000 7ff1d5600640 1 -- 172.21.15.44:0/1543089089 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d003a040 con 0x7ff1d80ca2f0 2024-03-30T13:15:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.893+0000 7ff1d5600640 1 -- 172.21.15.44:0/1543089089 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0039070 con 0x7ff1d80ca2f0 2024-03-30T13:15:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.893+0000 7ff1dec00640 1 -- 172.21.15.44:0/1543089089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d80c91c0 con 0x7ff1d80ca2f0 2024-03-30T13:15:49.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.893+0000 7ff1dec00640 1 -- 172.21.15.44:0/1543089089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d80c8ba0 con 0x7ff1d80ca2f0 2024-03-30T13:15:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.894+0000 7ff1dec00640 1 -- 172.21.15.44:0/1543089089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d8075890 con 0x7ff1d80ca2f0 2024-03-30T13:15:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.895+0000 7ff1d5600640 1 -- 172.21.15.44:0/1543089089 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff1d0047070 con 0x7ff1d80ca2f0 2024-03-30T13:15:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.896+0000 7ff1d5600640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff1b806c560 0x7ff1b806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.896+0000 7ff1d5600640 1 -- 172.21.15.44:0/1543089089 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7ff1d00acfe0 con 0x7ff1d80ca2f0 2024-03-30T13:15:49.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.897+0000 7ff1dd800640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff1b806c560 0x7ff1b806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:49.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.898+0000 7ff1dd800640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff1b806c560 0x7ff1b806ea20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc004770 tx=0x7ff1cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:49.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:49.905+0000 7ff1d5600640 1 -- 172.21.15.44:0/1543089089 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff1d007ae00 con 0x7ff1d80ca2f0 2024-03-30T13:15:50.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.107+0000 7ff1dec00640 1 -- 172.21.15.44:0/1543089089 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1d80c96e0 con 0x7ff1d80ca2f0 2024-03-30T13:15:50.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.110+0000 7ff1d5600640 1 -- 172.21.15.44:0/1543089089 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16978 (secure 0 0 0) 0x7ff1d007f100 con 0x7ff1d80ca2f0 2024-03-30T13:15:50.115 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:50.115 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":46,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:15:30.641950+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-30T13:13:22.414656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-30T13:13:23.348753+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":45,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":20}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:15:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.112+0000 7ff1dec00640 1 -- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff1b806c560 msgr2=0x7ff1b806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.112+0000 7ff1dec00640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff1b806c560 0x7ff1b806ea20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc004770 tx=0x7ff1cc008040 comp rx=0 tx=0).stop 2024-03-30T13:15:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.112+0000 7ff1dec00640 1 -- 172.21.15.44:0/1543089089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1d80ca2f0 msgr2=0x7ff1d80ca780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.112+0000 7ff1dec00640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1d80ca2f0 0x7ff1d80ca780 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0037040 tx=0x7ff1d0009750 comp rx=0 tx=0).stop 2024-03-30T13:15:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.112+0000 7ff1dec00640 1 -- 172.21.15.44:0/1543089089 shutdown_connections 2024-03-30T13:15:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.112+0000 7ff1dec00640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1d80ca2f0 0x7ff1d80ca780 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.112+0000 7ff1dec00640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d80c8720 0x7ff1d815d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.112+0000 7ff1dec00640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff1b806c560 0x7ff1b806ea20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.112+0000 7ff1dec00640 1 --2- 172.21.15.44:0/1543089089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1c0004d40 0x7ff1d80b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.112+0000 7ff1dec00640 1 -- 172.21.15.44:0/1543089089 >> 172.21.15.44:0/1543089089 conn(0x7ff1d809d570 msgr2=0x7ff1d80b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.113+0000 7ff1dec00640 1 -- 172.21.15.44:0/1543089089 shutdown_connections 2024-03-30T13:15:50.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.113+0000 7ff1dec00640 1 -- 172.21.15.44:0/1543089089 wait complete. 2024-03-30T13:15:50.145 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-30T13:15:50.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.349+0000 7ff48b200640 1 Processor -- start 2024-03-30T13:15:50.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.349+0000 7ff48b200640 1 -- start start 2024-03-30T13:15:50.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.351+0000 7ff48b200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff48c15e470 0x7ff48c0d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.351+0000 7ff48b200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7ff48c0b64a0 0x7ff48c0b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.351+0000 7ff48b200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c0d2c50 con 0x7ff48c0d3cf0 2024-03-30T13:15:50.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.351+0000 7ff48b200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7ff48c0d4170 con 0x7ff48c0b64a0 2024-03-30T13:15:50.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.351+0000 7ff48b200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7ff48c0ba2c0 con 0x7ff48c15e470 2024-03-30T13:15:50.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.351+0000 7ff489400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7ff48c0d3cf0 0x7ff48c0b5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57894/0 (socket says 172.21.15.44:57894) 2024-03-30T13:15:50.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.351+0000 7ff489400640 1 -- 172.21.15.44:0/3989370435 learned_addr learned my addr 172.21.15.44:0/3989370435 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:50.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.351+0000 7ff48a800640 1 --2- 172.21.15.44:0/3989370435 >> v2:172.21.15.44:3300/0 conn(0x7ff48c0b64a0 0x7ff48c0b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.352+0000 7ff489e00640 1 --2- 172.21.15.44:0/3989370435 >> v2:172.21.15.151:3300/0 conn(0x7ff48c15e470 0x7ff48c0d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.352+0000 7ff48a800640 1 -- 172.21.15.44:0/3989370435 >> v2:172.21.15.151:3300/0 conn(0x7ff48c15e470 msgr2=0x7ff48c0d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.352+0000 7ff48a800640 1 --2- 172.21.15.44:0/3989370435 >> v2:172.21.15.151:3300/0 conn(0x7ff48c15e470 0x7ff48c0d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.352+0000 7ff48a800640 1 -- 172.21.15.44:0/3989370435 >> v1:172.21.15.44:6789/0 conn(0x7ff48c0d3cf0 legacy=0x7ff48c0b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.352+0000 7ff48a800640 1 -- 172.21.15.44:0/3989370435 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c0d2f30 con 0x7ff48c0b64a0 2024-03-30T13:15:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.352+0000 7ff488a00640 1 -- 172.21.15.44:0/3989370435 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496497910 0 0) 0x7ff48c0d2c50 con 0x7ff48c0d3cf0 2024-03-30T13:15:50.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.352+0000 7ff489e00640 1 --2- 172.21.15.44:0/3989370435 >> v2:172.21.15.151:3300/0 conn(0x7ff48c15e470 0x7ff48c0d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:50.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.353+0000 7ff48a800640 1 --2- 172.21.15.44:0/3989370435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c0b64a0 0x7ff48c0b9d80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0d53f0 tx=0x7ff48402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c5d81ebecbc0b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:50.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.354+0000 7ff488a00640 1 -- 172.21.15.44:0/3989370435 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484039070 con 0x7ff48c0b64a0 2024-03-30T13:15:50.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.354+0000 7ff488a00640 1 -- 172.21.15.44:0/3989370435 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48402cd10 con 0x7ff48c0b64a0 2024-03-30T13:15:50.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.354+0000 7ff488a00640 1 -- 172.21.15.44:0/3989370435 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484034660 con 0x7ff48c0b64a0 2024-03-30T13:15:50.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.354+0000 7ff48b200640 1 -- 172.21.15.44:0/3989370435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c0b64a0 msgr2=0x7ff48c0b9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:50.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.354+0000 7ff48b200640 1 --2- 172.21.15.44:0/3989370435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c0b64a0 0x7ff48c0b9d80 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0d53f0 tx=0x7ff48402bf60 comp rx=0 tx=0).stop 2024-03-30T13:15:50.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.354+0000 7ff48b200640 1 -- 172.21.15.44:0/3989370435 shutdown_connections 2024-03-30T13:15:50.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.354+0000 7ff48b200640 1 --2- 172.21.15.44:0/3989370435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c0b64a0 0x7ff48c0b9d80 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.354+0000 7ff48b200640 1 --2- 172.21.15.44:0/3989370435 >> v2:172.21.15.151:3300/0 conn(0x7ff48c15e470 0x7ff48c0d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.354+0000 7ff48b200640 1 -- 172.21.15.44:0/3989370435 >> 172.21.15.44:0/3989370435 conn(0x7ff48c0678f0 msgr2=0x7ff48c0d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:50.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.355+0000 7ff48b200640 1 -- 172.21.15.44:0/3989370435 shutdown_connections 2024-03-30T13:15:50.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.355+0000 7ff48b200640 1 -- 172.21.15.44:0/3989370435 wait complete. 2024-03-30T13:15:50.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.356+0000 7ff48b200640 1 Processor -- start 2024-03-30T13:15:50.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.356+0000 7ff48b200640 1 -- start start 2024-03-30T13:15:50.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.357+0000 7ff48b200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48c0b64a0 0x7ff48c1f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.357+0000 7ff48b200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff48c0d3cf0 0x7ff48c1f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.357+0000 7ff48b200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c15e470 0x7ff48c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.357+0000 7ff48b200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0d34f0 con 0x7ff48c15e470 2024-03-30T13:15:50.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.357+0000 7ff48b200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0d3860 con 0x7ff48c0d3cf0 2024-03-30T13:15:50.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.357+0000 7ff48b200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7ff48c15e850 con 0x7ff48c0b64a0 2024-03-30T13:15:50.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.358+0000 7ff48a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c15e470 0x7ff48c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.358+0000 7ff48a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c15e470 0x7ff48c15eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38068/0 (socket says 172.21.15.44:38068) 2024-03-30T13:15:50.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.358+0000 7ff48a800640 1 -- 172.21.15.44:0/3348861223 learned_addr learned my addr 172.21.15.44:0/3348861223 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:50.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.358+0000 7ff489e00640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48c0b64a0 0x7ff48c1f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.358+0000 7ff489400640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff48c0d3cf0 0x7ff48c1f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.358+0000 7ff48a800640 1 -- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48c0b64a0 msgr2=0x7ff48c1f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.358+0000 7ff48a800640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48c0b64a0 0x7ff48c1f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.358+0000 7ff48a800640 1 -- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff48c0d3cf0 msgr2=0x7ff48c1f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.358+0000 7ff48a800640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff48c0d3cf0 0x7ff48c1f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.358+0000 7ff48a800640 1 -- 172.21.15.44:0/3348861223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c158860 con 0x7ff48c15e470 2024-03-30T13:15:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.358+0000 7ff489e00640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48c0b64a0 0x7ff48c1f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.359+0000 7ff48a800640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c15e470 0x7ff48c15eac0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff484009e80 tx=0x7ff484004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.359+0000 7ff482000640 1 -- 172.21.15.44:0/3348861223 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484039050 con 0x7ff48c15e470 2024-03-30T13:15:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.359+0000 7ff482000640 1 -- 172.21.15.44:0/3348861223 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff484045070 con 0x7ff48c15e470 2024-03-30T13:15:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.359+0000 7ff482000640 1 -- 172.21.15.44:0/3348861223 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48403e830 con 0x7ff48c15e470 2024-03-30T13:15:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.359+0000 7ff48b200640 1 -- 172.21.15.44:0/3348861223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c158b40 con 0x7ff48c15e470 2024-03-30T13:15:50.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.359+0000 7ff48b200640 1 -- 172.21.15.44:0/3348861223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c159100 con 0x7ff48c15e470 2024-03-30T13:15:50.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.361+0000 7ff48b200640 1 -- 172.21.15.44:0/3348861223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48c075890 con 0x7ff48c15e470 2024-03-30T13:15:50.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.361+0000 7ff482000640 1 -- 172.21.15.44:0/3348861223 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff48403e9d0 con 0x7ff48c15e470 2024-03-30T13:15:50.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.363+0000 7ff482000640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff46806c530 0x7ff46806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.363+0000 7ff482000640 1 -- 172.21.15.44:0/3348861223 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6158+0+0 (secure 0 0 0) 0x7ff4840ae620 con 0x7ff48c15e470 2024-03-30T13:15:50.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.363+0000 7ff489e00640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff46806c530 0x7ff46806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.364+0000 7ff489e00640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff46806c530 0x7ff46806e9f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff47c006fd0 tx=0x7ff47c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:50.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.368+0000 7ff482000640 1 -- 172.21.15.44:0/3348861223 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff48407cb90 con 0x7ff48c15e470 2024-03-30T13:15:50.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.650+0000 7ff48b200640 1 -- 172.21.15.44:0/3348861223 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff48c15da10 con 0x7ff48c15e470 2024-03-30T13:15:50.655 INFO:tasks.ceph.mon.a.smithi044.stderr:2024-03-30T13:15:50.651+0000 7fc347800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-30T13:15:50.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.653+0000 7ff482000640 1 -- 172.21.15.44:0/3348861223 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7ff48407c490 con 0x7ff48c15e470 2024-03-30T13:15:50.659 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-30T13:15:50.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.656+0000 7ff48b200640 1 -- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff46806c530 msgr2=0x7ff46806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:50.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.656+0000 7ff48b200640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff46806c530 0x7ff46806e9f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff47c006fd0 tx=0x7ff47c008040 comp rx=0 tx=0).stop 2024-03-30T13:15:50.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.656+0000 7ff48b200640 1 -- 172.21.15.44:0/3348861223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c15e470 msgr2=0x7ff48c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.656+0000 7ff48b200640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c15e470 0x7ff48c15eac0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff484009e80 tx=0x7ff484004a40 comp rx=0 tx=0).stop 2024-03-30T13:15:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.656+0000 7ff48b200640 1 -- 172.21.15.44:0/3348861223 shutdown_connections 2024-03-30T13:15:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.656+0000 7ff48b200640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff48c15e470 0x7ff48c15eac0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.656+0000 7ff48b200640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7ff46806c530 0x7ff46806e9f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.656+0000 7ff48b200640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff48c0d3cf0 0x7ff48c1f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.656+0000 7ff48b200640 1 --2- 172.21.15.44:0/3348861223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48c0b64a0 0x7ff48c1f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.656+0000 7ff48b200640 1 -- 172.21.15.44:0/3348861223 >> 172.21.15.44:0/3348861223 conn(0x7ff48c0678f0 msgr2=0x7ff48c15bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.656+0000 7ff48b200640 1 -- 172.21.15.44:0/3348861223 shutdown_connections 2024-03-30T13:15:50.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.656+0000 7ff48b200640 1 -- 172.21.15.44:0/3348861223 wait complete. 2024-03-30T13:15:50.682 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-30T13:15:50.777 INFO:tasks.ceph.mds.a.smithi044.stdout:starting mds.a at 2024-03-30T13:15:50.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.875+0000 7fe6cfe00640 1 Processor -- start 2024-03-30T13:15:50.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.875+0000 7fe6cfe00640 1 -- start start 2024-03-30T13:15:50.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.877+0000 7fe6cfe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c806d8f0 0x7fe6c815fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.877+0000 7fe6cfe00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6c80ce9c0 con 0x7fe6c81603d0 2024-03-30T13:15:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.877+0000 7fe6cfe00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6c8160b50 con 0x7fe6c813f0c0 2024-03-30T13:15:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.877+0000 7fe6cfe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c8160e30 con 0x7fe6c806d8f0 2024-03-30T13:15:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.878+0000 7fe6cde00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe6c81603d0 0x7fe6c80cfbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57912/0 (socket says 172.21.15.44:57912) 2024-03-30T13:15:50.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.878+0000 7fe6cde00640 1 -- 172.21.15.44:0/899083540 learned_addr learned my addr 172.21.15.44:0/899083540 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.878+0000 7fe6cca00640 1 --2- 172.21.15.44:0/899083540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c806d8f0 0x7fe6c815fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.878+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703220389 0 0) 0x7fe6c0001490 con 0x7fe6c81603d0 2024-03-30T13:15:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.878+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6b0003520 con 0x7fe6c81603d0 2024-03-30T13:15:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.878+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4251651212 0 0) 0x7fe6b0003520 con 0x7fe6c81603d0 2024-03-30T13:15:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.878+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c806d8f0 msgr2=0x7fe6c815fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.878+0000 7fe6c7e00640 1 --2- 172.21.15.44:0/899083540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c806d8f0 0x7fe6c815fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.878+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 >> v1:172.21.15.151:6789/0 conn(0x7fe6c813f0c0 legacy=0x7fe6c806d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.878+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c813fa40 con 0x7fe6c81603d0 2024-03-30T13:15:50.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.878+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fe6c0001bc0 con 0x7fe6c81603d0 2024-03-30T13:15:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.878+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 >> v1:172.21.15.44:6789/0 conn(0x7fe6c81603d0 legacy=0x7fe6c80cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6c7e00640 1 --2- 172.21.15.44:0/899083540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b00039e0 0x7fe6b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6c7e00640 1 --2- 172.21.15.44:0/899083540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6b0004800 0x7fe6b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6c7e00640 1 --2- 172.21.15.44:0/899083540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c806d8f0 0x7fe6b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c8160e30 con 0x7fe6b0004800 2024-03-30T13:15:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0005550 con 0x7fe6b00039e0 2024-03-30T13:15:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b000bf00 con 0x7fe6c806d8f0 2024-03-30T13:15:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6cca00640 1 --2- 172.21.15.44:0/899083540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6b0004800 0x7fe6b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6cd400640 1 --2- 172.21.15.44:0/899083540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b00039e0 0x7fe6b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6cde00640 1 --2- 172.21.15.44:0/899083540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c806d8f0 0x7fe6b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6cca00640 1 -- 172.21.15.44:0/899083540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c806d8f0 msgr2=0x7fe6b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:50.885 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6cca00640 1 --2- 172.21.15.44:0/899083540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c806d8f0 0x7fe6b000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6cca00640 1 -- 172.21.15.44:0/899083540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b00039e0 msgr2=0x7fe6b0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6cca00640 1 --2- 172.21.15.44:0/899083540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b00039e0 0x7fe6b0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.886 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.879+0000 7fe6cca00640 1 -- 172.21.15.44:0/899083540 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b0003520 con 0x7fe6b0004800 2024-03-30T13:15:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.881+0000 7fe6cca00640 1 --2- 172.21.15.44:0/899083540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6b0004800 0x7fe6b0004c80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00ba30 tx=0x7fe6b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974c839f637b1158 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.881+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc036020 con 0x7fe6b0004800 2024-03-30T13:15:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.881+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6bc032640 con 0x7fe6b0004800 2024-03-30T13:15:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.881+0000 7fe6c7e00640 1 -- 172.21.15.44:0/899083540 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00b600 con 0x7fe6b0004800 2024-03-30T13:15:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.881+0000 7fe6cfe00640 1 -- 172.21.15.44:0/899083540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6b0004800 msgr2=0x7fe6b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.881+0000 7fe6cfe00640 1 --2- 172.21.15.44:0/899083540 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6b0004800 0x7fe6b0004c80 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00ba30 tx=0x7fe6b0005830 comp rx=0 tx=0).stop 2024-03-30T13:15:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.881+0000 7fe6cde00640 1 -- 172.21.15.44:0/899083540 reap_dead start 2024-03-30T13:15:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.881+0000 7fe6cfe00640 1 -- 172.21.15.44:0/899083540 shutdown_connections 2024-03-30T13:15:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.881+0000 7fe6cfe00640 1 -- 172.21.15.44:0/899083540 >> 172.21.15.44:0/899083540 conn(0x7fe6c80b5b00 msgr2=0x7fe6c806b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.881+0000 7fe6cfe00640 1 -- 172.21.15.44:0/899083540 shutdown_connections 2024-03-30T13:15:50.887 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.881+0000 7fe6cfe00640 1 -- 172.21.15.44:0/899083540 wait complete. 2024-03-30T13:15:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.883+0000 7fe6cfe00640 1 Processor -- start 2024-03-30T13:15:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.883+0000 7fe6cfe00640 1 -- start start 2024-03-30T13:15:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.884+0000 7fe6cfe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b0004800 0x7fe6c8155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.884+0000 7fe6cfe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c813e480 0x7fe6c815ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.884+0000 7fe6cfe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c8157700 0x7fe6c8157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.884+0000 7fe6cfe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c8160820 con 0x7fe6c813e480 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.884+0000 7fe6cfe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c8140000 con 0x7fe6b0004800 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.884+0000 7fe6cfe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe6c813f4a0 con 0x7fe6c8157700 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.885+0000 7fe6cca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c813e480 0x7fe6c815ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.885+0000 7fe6cca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c813e480 0x7fe6c815ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38096/0 (socket says 172.21.15.44:38096) 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.885+0000 7fe6cca00640 1 -- 172.21.15.44:0/882058298 learned_addr learned my addr 172.21.15.44:0/882058298 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.885+0000 7fe6cd400640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b0004800 0x7fe6c8155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.885+0000 7fe6cde00640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c8157700 0x7fe6c8157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.885+0000 7fe6cca00640 1 -- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c8157700 msgr2=0x7fe6c8157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.885+0000 7fe6cca00640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c8157700 0x7fe6c8157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.885+0000 7fe6cca00640 1 -- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b0004800 msgr2=0x7fe6c8155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.885+0000 7fe6cca00640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b0004800 0x7fe6c8155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:50.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.885+0000 7fe6cca00640 1 -- 172.21.15.44:0/882058298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c815deb0 con 0x7fe6c813e480 2024-03-30T13:15:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.885+0000 7fe6cd400640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b0004800 0x7fe6c8155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.886+0000 7fe6cca00640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c813e480 0x7fe6c815ef50 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc02bf90 tx=0x7fe6bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.886+0000 7fe6c5600640 1 -- 172.21.15.44:0/882058298 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc036040 con 0x7fe6c813e480 2024-03-30T13:15:50.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.886+0000 7fe6c5600640 1 -- 172.21.15.44:0/882058298 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6bc030a50 con 0x7fe6c813e480 2024-03-30T13:15:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.886+0000 7fe6c5600640 1 -- 172.21.15.44:0/882058298 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00b600 con 0x7fe6c813e480 2024-03-30T13:15:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.886+0000 7fe6cfe00640 1 -- 172.21.15.44:0/882058298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c815e190 con 0x7fe6c813e480 2024-03-30T13:15:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.886+0000 7fe6cfe00640 1 -- 172.21.15.44:0/882058298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c815e750 con 0x7fe6c813e480 2024-03-30T13:15:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.887+0000 7fe6cfe00640 1 -- 172.21.15.44:0/882058298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c815cd30 con 0x7fe6c813e480 2024-03-30T13:15:50.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.888+0000 7fe6c5600640 1 -- 172.21.15.44:0/882058298 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe6bc039020 con 0x7fe6c813e480 2024-03-30T13:15:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.889+0000 7fe6c5600640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe6ac06c530 0x7fe6ac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.889+0000 7fe6c5600640 1 -- 172.21.15.44:0/882058298 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6216+0+0 (secure 0 0 0) 0x7fe6bc0ae4e0 con 0x7fe6c813e480 2024-03-30T13:15:50.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.890+0000 7fe6cd400640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe6ac06c530 0x7fe6ac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:50.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.891+0000 7fe6cd400640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe6ac06c530 0x7fe6ac06e9f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8004f00 tx=0x7fe6b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:50.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:50.893+0000 7fe6c5600640 1 -- 172.21.15.44:0/882058298 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe6c815cd30 con 0x7fe6c813e480 2024-03-30T13:15:51.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.130+0000 7fe6cfe00640 1 -- 172.21.15.44:0/882058298 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe6c8075890 con 0x7fe6c813e480 2024-03-30T13:15:51.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.776+0000 7fe6c5600640 1 -- 172.21.15.44:0/882058298 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7fe6bc07c7d0 con 0x7fe6c813e480 2024-03-30T13:15:51.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.779+0000 7fe6cfe00640 1 -- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe6ac06c530 msgr2=0x7fe6ac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:51.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.779+0000 7fe6cfe00640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe6ac06c530 0x7fe6ac06e9f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8004f00 tx=0x7fe6b8009040 comp rx=0 tx=0).stop 2024-03-30T13:15:51.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.779+0000 7fe6cfe00640 1 -- 172.21.15.44:0/882058298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c813e480 msgr2=0x7fe6c815ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:51.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.779+0000 7fe6cfe00640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c813e480 0x7fe6c815ef50 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc02bf90 tx=0x7fe6bc004730 comp rx=0 tx=0).stop 2024-03-30T13:15:51.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.779+0000 7fe6cfe00640 1 -- 172.21.15.44:0/882058298 shutdown_connections 2024-03-30T13:15:51.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.779+0000 7fe6cfe00640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6c8157700 0x7fe6c8157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:51.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.779+0000 7fe6cfe00640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe6c813e480 0x7fe6c815ef50 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:51.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.779+0000 7fe6cfe00640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe6ac06c530 0x7fe6ac06e9f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:51.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.779+0000 7fe6cfe00640 1 --2- 172.21.15.44:0/882058298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b0004800 0x7fe6c8155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:51.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.779+0000 7fe6cfe00640 1 -- 172.21.15.44:0/882058298 >> 172.21.15.44:0/882058298 conn(0x7fe6c80b5b00 msgr2=0x7fe6c80b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:51.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.780+0000 7fe6cfe00640 1 -- 172.21.15.44:0/882058298 shutdown_connections 2024-03-30T13:15:51.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:51.780+0000 7fe6cfe00640 1 -- 172.21.15.44:0/882058298 wait complete. 2024-03-30T13:15:51.807 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-30T13:15:52.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.032+0000 7f634cc00640 1 Processor -- start 2024-03-30T13:15:52.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.033+0000 7f634cc00640 1 -- start start 2024-03-30T13:15:52.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.034+0000 7f634cc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480d1100 0x7f63480cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:52.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.034+0000 7f634cc00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6348162010 con 0x7f63480b5870 2024-03-30T13:15:52.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.034+0000 7f634cc00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63480b31c0 con 0x7f6348161c30 2024-03-30T13:15:52.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.034+0000 7f634cc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f63480d22f0 con 0x7f63480d1100 2024-03-30T13:15:52.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.034+0000 7f6346a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f63480b5870 0x7f63480d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57918/0 (socket says 172.21.15.44:57918) 2024-03-30T13:15:52.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.034+0000 7f6346a00640 1 -- 172.21.15.44:0/2722555873 learned_addr learned my addr 172.21.15.44:0/2722555873 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:52.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.035+0000 7f6347e00640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480d1100 0x7f63480cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:52.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.035+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3809952796 0 0) 0x7f6330001110 con 0x7f63480b5870 2024-03-30T13:15:52.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.035+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f632c003520 con 0x7f63480b5870 2024-03-30T13:15:52.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.035+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 49260964 0 0) 0x7f632c003520 con 0x7f63480b5870 2024-03-30T13:15:52.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.035+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480d1100 msgr2=0x7f63480cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:52.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.035+0000 7f6346000640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480d1100 0x7f63480cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:52.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.035+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 >> v1:172.21.15.151:6789/0 conn(0x7f6348161c30 legacy=0x7f63480d2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:52.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.035+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63480d25d0 con 0x7f63480b5870 2024-03-30T13:15:52.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.035+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f6330001840 con 0x7f63480b5870 2024-03-30T13:15:52.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.035+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 >> v1:172.21.15.44:6789/0 conn(0x7f63480b5870 legacy=0x7f63480d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:52.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.035+0000 7f6346000640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480d1100 0x7f632c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:52.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.035+0000 7f6346000640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f632c003f60 0x7f632c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:52.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6346000640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f632c004d40 0x7f632c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:52.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63480d22f0 con 0x7f632c004d40 2024-03-30T13:15:52.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f632c00baa0 con 0x7f632c003f60 2024-03-30T13:15:52.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f632c00bca0 con 0x7f63480d1100 2024-03-30T13:15:52.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6347e00640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f632c004d40 0x7f632c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:52.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6346a00640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f632c003f60 0x7f632c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:52.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6347e00640 1 -- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480d1100 msgr2=0x7f632c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:52.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6347400640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480d1100 0x7f632c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:52.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6347e00640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480d1100 0x7f632c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:52.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6347e00640 1 -- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f632c003f60 msgr2=0x7f632c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6347e00640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f632c003f60 0x7f632c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6347e00640 1 -- 172.21.15.44:0/2722555873 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c003520 con 0x7f632c004d40 2024-03-30T13:15:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6347400640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480d1100 0x7f632c0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:52.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.036+0000 7f6346a00640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f632c003f60 0x7f632c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:52.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.037+0000 7f6347e00640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f632c004d40 0x7f632c0051c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6340009fc0 tx=0x7f632c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736c4ca9c88ae5c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:52.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.038+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340039070 con 0x7f632c004d40 2024-03-30T13:15:52.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.038+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634002cbf0 con 0x7f632c004d40 2024-03-30T13:15:52.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.038+0000 7f6346000640 1 -- 172.21.15.44:0/2722555873 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340009c10 con 0x7f632c004d40 2024-03-30T13:15:52.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.038+0000 7f634cc00640 1 -- 172.21.15.44:0/2722555873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f632c004d40 msgr2=0x7f632c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.038+0000 7f634cc00640 1 --2- 172.21.15.44:0/2722555873 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f632c004d40 0x7f632c0051c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f6340009fc0 tx=0x7f632c005830 comp rx=0 tx=0).stop 2024-03-30T13:15:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.038+0000 7f6347e00640 1 -- 172.21.15.44:0/2722555873 reap_dead start 2024-03-30T13:15:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.038+0000 7f634cc00640 1 -- 172.21.15.44:0/2722555873 shutdown_connections 2024-03-30T13:15:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.038+0000 7f634cc00640 1 -- 172.21.15.44:0/2722555873 >> 172.21.15.44:0/2722555873 conn(0x7f634809d510 msgr2=0x7f63480d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.039+0000 7f634cc00640 1 -- 172.21.15.44:0/2722555873 shutdown_connections 2024-03-30T13:15:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.039+0000 7f634cc00640 1 -- 172.21.15.44:0/2722555873 wait complete. 2024-03-30T13:15:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.040+0000 7f634cc00640 1 Processor -- start 2024-03-30T13:15:52.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.040+0000 7f634cc00640 1 -- start start 2024-03-30T13:15:52.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.041+0000 7f634cc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f632c004d40 0x7f63481f82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:52.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.041+0000 7f634cc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480ca1e0 0x7f63480b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:52.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.041+0000 7f634cc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63481f79a0 0x7f63480b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:52.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.041+0000 7f634cc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63480b3780 con 0x7f63481f79a0 2024-03-30T13:15:52.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.041+0000 7f634cc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f63480b3600 con 0x7f632c004d40 2024-03-30T13:15:52.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.041+0000 7f634cc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f63480c7870 con 0x7f63480ca1e0 2024-03-30T13:15:52.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.042+0000 7f6347e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63481f79a0 0x7f63480b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.042+0000 7f6347e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63481f79a0 0x7f63480b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38120/0 (socket says 172.21.15.44:38120) 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.042+0000 7f6347e00640 1 -- 172.21.15.44:0/4049107333 learned_addr learned my addr 172.21.15.44:0/4049107333 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.042+0000 7f6346a00640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480ca1e0 0x7f63480b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.042+0000 7f6347e00640 1 -- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480ca1e0 msgr2=0x7f63480b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.042+0000 7f6347e00640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480ca1e0 0x7f63480b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.042+0000 7f6347400640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f632c004d40 0x7f63481f82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.042+0000 7f6347e00640 1 -- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f632c004d40 msgr2=0x7f63481f82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.042+0000 7f6347e00640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f632c004d40 0x7f63481f82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.042+0000 7f6347e00640 1 -- 172.21.15.44:0/4049107333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6348161120 con 0x7f63481f79a0 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.042+0000 7f6346a00640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480ca1e0 0x7f63480b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.042+0000 7f6347e00640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63481f79a0 0x7f63480b75b0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f634000e230 tx=0x7f6340009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.043+0000 7f633f400640 1 -- 172.21.15.44:0/4049107333 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340039030 con 0x7f63481f79a0 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.043+0000 7f633f400640 1 -- 172.21.15.44:0/4049107333 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634003a040 con 0x7f63481f79a0 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.043+0000 7f633f400640 1 -- 172.21.15.44:0/4049107333 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340009c10 con 0x7f63481f79a0 2024-03-30T13:15:52.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.043+0000 7f634cc00640 1 -- 172.21.15.44:0/4049107333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6348161400 con 0x7f63481f79a0 2024-03-30T13:15:52.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.043+0000 7f634cc00640 1 -- 172.21.15.44:0/4049107333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63480c99e0 con 0x7f63481f79a0 2024-03-30T13:15:52.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.044+0000 7f634cc00640 1 -- 172.21.15.44:0/4049107333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6348075890 con 0x7f63481f79a0 2024-03-30T13:15:52.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.045+0000 7f633f400640 1 -- 172.21.15.44:0/4049107333 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6340005d10 con 0x7f63481f79a0 2024-03-30T13:15:52.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.046+0000 7f633f400640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f632406c560 0x7f632406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:52.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.046+0000 7f633f400640 1 -- 172.21.15.44:0/4049107333 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6216+0+0 (secure 0 0 0) 0x7f63400ad570 con 0x7f63481f79a0 2024-03-30T13:15:52.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.047+0000 7f6347400640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f632406c560 0x7f632406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:52.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.048+0000 7f6347400640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f632406c560 0x7f632406ea20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6338001630 tx=0x7f6338009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:52.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.050+0000 7f633f400640 1 -- 172.21.15.44:0/4049107333 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f634007b8f0 con 0x7f63481f79a0 2024-03-30T13:15:52.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.255+0000 7f634cc00640 1 -- 172.21.15.44:0/4049107333 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f63480680b0 con 0x7f63481f79a0 2024-03-30T13:15:52.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.790+0000 7f633f400640 1 -- 172.21.15.44:0/4049107333 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) ==== 181+0+0 (secure 0 0 0) 0x7f634007b1f0 con 0x7f63481f79a0 2024-03-30T13:15:52.795 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-03-30T13:15:52.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.796+0000 7f634cc00640 1 -- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f632406c560 msgr2=0x7f632406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.796+0000 7f634cc00640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f632406c560 0x7f632406ea20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6338001630 tx=0x7f6338009040 comp rx=0 tx=0).stop 2024-03-30T13:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.796+0000 7f634cc00640 1 -- 172.21.15.44:0/4049107333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63481f79a0 msgr2=0x7f63480b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.796+0000 7f634cc00640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63481f79a0 0x7f63480b75b0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f634000e230 tx=0x7f6340009750 comp rx=0 tx=0).stop 2024-03-30T13:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.796+0000 7f634cc00640 1 -- 172.21.15.44:0/4049107333 shutdown_connections 2024-03-30T13:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.796+0000 7f634cc00640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63481f79a0 0x7f63480b75b0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.796+0000 7f634cc00640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480ca1e0 0x7f63480b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.796+0000 7f634cc00640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f632406c560 0x7f632406ea20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.796+0000 7f634cc00640 1 --2- 172.21.15.44:0/4049107333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f632c004d40 0x7f63481f82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.796+0000 7f634cc00640 1 -- 172.21.15.44:0/4049107333 >> 172.21.15.44:0/4049107333 conn(0x7f634809d510 msgr2=0x7f63480cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.797+0000 7f634cc00640 1 -- 172.21.15.44:0/4049107333 shutdown_connections 2024-03-30T13:15:52.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:52.797+0000 7f634cc00640 1 -- 172.21.15.44:0/4049107333 wait complete. 2024-03-30T13:15:52.823 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-30T13:15:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.038+0000 7f0f49600640 1 Processor -- start 2024-03-30T13:15:53.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.038+0000 7f0f49600640 1 -- start start 2024-03-30T13:15:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.039+0000 7f0f49600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0f4413f2d0 0x7f0f4406d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.040+0000 7f0f49600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f4415cfa0 0x7f0f440cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.040+0000 7f0f49600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f44160120 con 0x7f0f4406d760 2024-03-30T13:15:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.040+0000 7f0f49600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f0f4406dbc0 con 0x7f0f4415cfa0 2024-03-30T13:15:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.040+0000 7f0f49600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f0f4415d470 con 0x7f0f4413f2d0 2024-03-30T13:15:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.040+0000 7f0f42000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f0f4406d760 0x7f0f4415c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57924/0 (socket says 172.21.15.44:57924) 2024-03-30T13:15:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.040+0000 7f0f42000640 1 -- 172.21.15.44:0/2846116116 learned_addr learned my addr 172.21.15.44:0/2846116116 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:53.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.040+0000 7f0f43400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f0f4415cfa0 0x7f0f440cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:53.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.040+0000 7f0f42a00640 1 --2- 172.21.15.44:0/2846116116 >> v2:172.21.15.151:3300/0 conn(0x7f0f4413f2d0 0x7f0f4406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.041+0000 7f0f41600640 1 -- 172.21.15.44:0/2846116116 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522866436 0 0) 0x7f0f44160120 con 0x7f0f4406d760 2024-03-30T13:15:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.041+0000 7f0f41600640 1 -- 172.21.15.44:0/2846116116 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f28003520 con 0x7f0f4406d760 2024-03-30T13:15:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.041+0000 7f0f43400640 1 -- 172.21.15.44:0/2846116116 >> v2:172.21.15.151:3300/0 conn(0x7f0f4413f2d0 msgr2=0x7f0f4406d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.041+0000 7f0f43400640 1 --2- 172.21.15.44:0/2846116116 >> v2:172.21.15.151:3300/0 conn(0x7f0f4413f2d0 0x7f0f4406d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.041+0000 7f0f43400640 1 -- 172.21.15.44:0/2846116116 >> v1:172.21.15.44:6789/0 conn(0x7f0f4406d760 legacy=0x7f0f4415c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:53.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.041+0000 7f0f43400640 1 -- 172.21.15.44:0/2846116116 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4415d750 con 0x7f0f4415cfa0 2024-03-30T13:15:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.042+0000 7f0f43400640 1 --2- 172.21.15.44:0/2846116116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4415cfa0 0x7f0f440cf660 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f0f440738e0 tx=0x7f0f3c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af0e465ae82a52f server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.043+0000 7f0f41600640 1 -- 172.21.15.44:0/2846116116 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c039070 con 0x7f0f4415cfa0 2024-03-30T13:15:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.043+0000 7f0f41600640 1 -- 172.21.15.44:0/2846116116 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3c02cc80 con 0x7f0f4415cfa0 2024-03-30T13:15:53.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.043+0000 7f0f41600640 1 -- 172.21.15.44:0/2846116116 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c034660 con 0x7f0f4415cfa0 2024-03-30T13:15:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.043+0000 7f0f49600640 1 -- 172.21.15.44:0/2846116116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4415cfa0 msgr2=0x7f0f440cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.043+0000 7f0f49600640 1 --2- 172.21.15.44:0/2846116116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4415cfa0 0x7f0f440cf660 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f0f440738e0 tx=0x7f0f3c02bed0 comp rx=0 tx=0).stop 2024-03-30T13:15:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.044+0000 7f0f49600640 1 -- 172.21.15.44:0/2846116116 shutdown_connections 2024-03-30T13:15:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.044+0000 7f0f49600640 1 --2- 172.21.15.44:0/2846116116 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4415cfa0 0x7f0f440cf660 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.044+0000 7f0f49600640 1 --2- 172.21.15.44:0/2846116116 >> v2:172.21.15.151:3300/0 conn(0x7f0f4413f2d0 0x7f0f4406d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.044+0000 7f0f49600640 1 -- 172.21.15.44:0/2846116116 >> 172.21.15.44:0/2846116116 conn(0x7f0f4406f060 msgr2=0x7f0f4406b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.044+0000 7f0f49600640 1 -- 172.21.15.44:0/2846116116 shutdown_connections 2024-03-30T13:15:53.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.044+0000 7f0f49600640 1 -- 172.21.15.44:0/2846116116 wait complete. 2024-03-30T13:15:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.045+0000 7f0f49600640 1 Processor -- start 2024-03-30T13:15:53.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.046+0000 7f0f49600640 1 -- start start 2024-03-30T13:15:53.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.046+0000 7f0f49600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4406d760 0x7f0f44130100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.046+0000 7f0f49600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f4413f2d0 0x7f0f4412e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.046+0000 7f0f49600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4415cfa0 0x7f0f4415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f49600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4413f6b0 con 0x7f0f4415cfa0 2024-03-30T13:15:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f49600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0f440cf140 con 0x7f0f4413f2d0 2024-03-30T13:15:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f49600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f0f440cea80 con 0x7f0f4406d760 2024-03-30T13:15:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f43400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4415cfa0 0x7f0f4415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f43400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4415cfa0 0x7f0f4415eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38130/0 (socket says 172.21.15.44:38130) 2024-03-30T13:15:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f43400640 1 -- 172.21.15.44:0/2746566151 learned_addr learned my addr 172.21.15.44:0/2746566151 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f42a00640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4406d760 0x7f0f44130100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f42000640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f4413f2d0 0x7f0f4412e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f43400640 1 -- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4406d760 msgr2=0x7f0f44130100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:53.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f43400640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4406d760 0x7f0f44130100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:53.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f43400640 1 -- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f4413f2d0 msgr2=0x7f0f4412e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:53.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f43400640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f4413f2d0 0x7f0f4412e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:53.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f43400640 1 -- 172.21.15.44:0/2746566151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4412f060 con 0x7f0f4415cfa0 2024-03-30T13:15:53.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.047+0000 7f0f42000640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f4413f2d0 0x7f0f4412e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:53.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.048+0000 7f0f43400640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4415cfa0 0x7f0f4415eb10 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009e80 tx=0x7f0f3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:53.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.048+0000 7f0f3aa00640 1 -- 172.21.15.44:0/2746566151 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c039050 con 0x7f0f4415cfa0 2024-03-30T13:15:53.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.048+0000 7f0f3aa00640 1 -- 172.21.15.44:0/2746566151 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3c045070 con 0x7f0f4415cfa0 2024-03-30T13:15:53.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.048+0000 7f0f49600640 1 -- 172.21.15.44:0/2746566151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4412f340 con 0x7f0f4415cfa0 2024-03-30T13:15:53.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.048+0000 7f0f3aa00640 1 -- 172.21.15.44:0/2746566151 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c009450 con 0x7f0f4415cfa0 2024-03-30T13:15:53.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.048+0000 7f0f49600640 1 -- 172.21.15.44:0/2746566151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4412f900 con 0x7f0f4415cfa0 2024-03-30T13:15:53.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.049+0000 7f0f49600640 1 -- 172.21.15.44:0/2746566151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f44075900 con 0x7f0f4415cfa0 2024-03-30T13:15:53.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.050+0000 7f0f3aa00640 1 -- 172.21.15.44:0/2746566151 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0f3c03e850 con 0x7f0f4415cfa0 2024-03-30T13:15:53.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.052+0000 7f0f3aa00640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2406c530 0x7f0f2406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.052+0000 7f0f3aa00640 1 -- 172.21.15.44:0/2746566151 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5778+0+0 (secure 0 0 0) 0x7f0f3c0ae3a0 con 0x7f0f4415cfa0 2024-03-30T13:15:53.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.052+0000 7f0f42a00640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2406c530 0x7f0f2406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:53.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.053+0000 7f0f42a00640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2406c530 0x7f0f2406e9f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0f4415f980 tx=0x7f0f34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:53.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.056+0000 7f0f3aa00640 1 -- 172.21.15.44:0/2746566151 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0f3c032e20 con 0x7f0f4415cfa0 2024-03-30T13:15:53.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.259+0000 7f0f49600640 1 -- 172.21.15.44:0/2746566151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0f44155b80 con 0x7f0f4415cfa0 2024-03-30T13:15:53.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.794+0000 7f0f3aa00640 1 -- 172.21.15.44:0/2746566151 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) ==== 169+0+0 (secure 0 0 0) 0x7f0f3c07c8d0 con 0x7f0f4415cfa0 2024-03-30T13:15:53.798 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-03-30T13:15:53.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.800+0000 7f0f49600640 1 -- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2406c530 msgr2=0x7f0f2406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:53.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.800+0000 7f0f49600640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2406c530 0x7f0f2406e9f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0f4415f980 tx=0x7f0f34008040 comp rx=0 tx=0).stop 2024-03-30T13:15:53.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.800+0000 7f0f49600640 1 -- 172.21.15.44:0/2746566151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4415cfa0 msgr2=0x7f0f4415eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:53.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.800+0000 7f0f49600640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4415cfa0 0x7f0f4415eb10 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009e80 tx=0x7f0f3c004a40 comp rx=0 tx=0).stop 2024-03-30T13:15:53.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.802+0000 7f0f49600640 1 -- 172.21.15.44:0/2746566151 shutdown_connections 2024-03-30T13:15:53.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.802+0000 7f0f49600640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0f4415cfa0 0x7f0f4415eb10 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:53.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.802+0000 7f0f49600640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f0f2406c530 0x7f0f2406e9f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:53.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.802+0000 7f0f49600640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f4413f2d0 0x7f0f4412e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:53.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.802+0000 7f0f49600640 1 --2- 172.21.15.44:0/2746566151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f4406d760 0x7f0f44130100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:53.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.802+0000 7f0f49600640 1 -- 172.21.15.44:0/2746566151 >> 172.21.15.44:0/2746566151 conn(0x7f0f4406f060 msgr2=0x7f0f440b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.802+0000 7f0f49600640 1 -- 172.21.15.44:0/2746566151 shutdown_connections 2024-03-30T13:15:53.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:53.802+0000 7f0f49600640 1 -- 172.21.15.44:0/2746566151 wait complete. 2024-03-30T13:15:53.833 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-30T13:15:54.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.036+0000 7fd11fe00640 1 Processor -- start 2024-03-30T13:15:54.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.036+0000 7fd11fe00640 1 -- start start 2024-03-30T13:15:54.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.037+0000 7fd11fe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1200b4920 0x7fd1200b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.037+0000 7fd11fe00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd1200b4d00 0x7fd1200d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.038+0000 7fd11fe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd1200d0b90 0x7fd1200d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.038+0000 7fd11fe00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd1200d0260 con 0x7fd1200d0b90 2024-03-30T13:15:54.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.038+0000 7fd11fe00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fd1200b54b0 con 0x7fd1200b4d00 2024-03-30T13:15:54.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.038+0000 7fd11fe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd1200cfca0 con 0x7fd1200b4920 2024-03-30T13:15:54.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.038+0000 7fd11f400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd1200d0b90 0x7fd1200d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.038+0000 7fd11f400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd1200d0b90 0x7fd1200d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38146/0 (socket says 172.21.15.44:38146) 2024-03-30T13:15:54.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.038+0000 7fd11f400640 1 -- 172.21.15.44:0/1324365578 learned_addr learned my addr 172.21.15.44:0/1324365578 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:54.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.038+0000 7fd11e000640 1 --2- 172.21.15.44:0/1324365578 >> v2:172.21.15.151:3300/0 conn(0x7fd1200b4d00 0x7fd1200d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.038+0000 7fd11ea00640 1 --2- 172.21.15.44:0/1324365578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1200b4920 0x7fd1200b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.039+0000 7fd11f400640 1 -- 172.21.15.44:0/1324365578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1200b4920 msgr2=0x7fd1200b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:54.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.039+0000 7fd11f400640 1 --2- 172.21.15.44:0/1324365578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1200b4920 0x7fd1200b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.039+0000 7fd11f400640 1 -- 172.21.15.44:0/1324365578 >> v2:172.21.15.151:3300/0 conn(0x7fd1200b4d00 msgr2=0x7fd1200d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:54.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.039+0000 7fd11f400640 1 --2- 172.21.15.44:0/1324365578 >> v2:172.21.15.151:3300/0 conn(0x7fd1200b4d00 0x7fd1200d4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.039+0000 7fd11f400640 1 -- 172.21.15.44:0/1324365578 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1200cff80 con 0x7fd1200d0b90 2024-03-30T13:15:54.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.040+0000 7fd11f400640 1 --2- 172.21.15.44:0/1324365578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1200d0b90 0x7fd1200d1040 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd12008c970 tx=0x7fd11802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2460bb1e03e3b82 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:54.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.040+0000 7fd11d600640 1 -- 172.21.15.44:0/1324365578 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11802c9f0 con 0x7fd1200d0b90 2024-03-30T13:15:54.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.040+0000 7fd11d600640 1 -- 172.21.15.44:0/1324365578 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11802cb90 con 0x7fd1200d0b90 2024-03-30T13:15:54.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.040+0000 7fd11d600640 1 -- 172.21.15.44:0/1324365578 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1180343f0 con 0x7fd1200d0b90 2024-03-30T13:15:54.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.041+0000 7fd11fe00640 1 -- 172.21.15.44:0/1324365578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1200d0b90 msgr2=0x7fd1200d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:54.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.041+0000 7fd11fe00640 1 --2- 172.21.15.44:0/1324365578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1200d0b90 0x7fd1200d1040 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd12008c970 tx=0x7fd11802be50 comp rx=0 tx=0).stop 2024-03-30T13:15:54.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.041+0000 7fd11fe00640 1 -- 172.21.15.44:0/1324365578 shutdown_connections 2024-03-30T13:15:54.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.041+0000 7fd11fe00640 1 --2- 172.21.15.44:0/1324365578 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1200d0b90 0x7fd1200d1040 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.041+0000 7fd11fe00640 1 --2- 172.21.15.44:0/1324365578 >> v2:172.21.15.151:3300/0 conn(0x7fd1200b4d00 0x7fd1200d4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.041+0000 7fd11fe00640 1 --2- 172.21.15.44:0/1324365578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1200b4920 0x7fd1200b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.041+0000 7fd11fe00640 1 -- 172.21.15.44:0/1324365578 >> 172.21.15.44:0/1324365578 conn(0x7fd12009d4e0 msgr2=0x7fd1200d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:54.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.041+0000 7fd11fe00640 1 -- 172.21.15.44:0/1324365578 shutdown_connections 2024-03-30T13:15:54.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.041+0000 7fd11fe00640 1 -- 172.21.15.44:0/1324365578 wait complete. 2024-03-30T13:15:54.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.043+0000 7fd11fe00640 1 Processor -- start 2024-03-30T13:15:54.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.043+0000 7fd11fe00640 1 -- start start 2024-03-30T13:15:54.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.044+0000 7fd11fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1200b4920 0x7fd12014e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.044+0000 7fd11fe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1200b4d00 0x7fd1200c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.044+0000 7fd11fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1200d0b90 0x7fd1201f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.044+0000 7fd11fe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd1200b3ff0 con 0x7fd1200d0b90 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.044+0000 7fd11fe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd1200d2180 con 0x7fd1200b4920 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.044+0000 7fd11fe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd1200d5000 con 0x7fd1200b4d00 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.044+0000 7fd11f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1200d0b90 0x7fd1201f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.044+0000 7fd11f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1200d0b90 0x7fd1201f77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38150/0 (socket says 172.21.15.44:38150) 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.044+0000 7fd11f400640 1 -- 172.21.15.44:0/3985921617 learned_addr learned my addr 172.21.15.44:0/3985921617 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.045+0000 7fd11e000640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1200b4d00 0x7fd1200c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.045+0000 7fd11ea00640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1200b4920 0x7fd12014e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.045+0000 7fd11f400640 1 -- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1200b4d00 msgr2=0x7fd1200c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.045+0000 7fd11f400640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1200b4d00 0x7fd1200c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.045+0000 7fd11f400640 1 -- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1200b4920 msgr2=0x7fd12014e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:54.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.045+0000 7fd11f400640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1200b4920 0x7fd12014e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.045+0000 7fd11f400640 1 -- 172.21.15.44:0/3985921617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1200ca820 con 0x7fd1200d0b90 2024-03-30T13:15:54.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.045+0000 7fd11f400640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1200d0b90 0x7fd1201f77a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd118036040 tx=0x7fd118004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:54.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.045+0000 7fd116a00640 1 -- 172.21.15.44:0/3985921617 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd118044020 con 0x7fd1200d0b90 2024-03-30T13:15:54.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.045+0000 7fd116a00640 1 -- 172.21.15.44:0/3985921617 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd118040670 con 0x7fd1200d0b90 2024-03-30T13:15:54.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.045+0000 7fd116a00640 1 -- 172.21.15.44:0/3985921617 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd118009510 con 0x7fd1200d0b90 2024-03-30T13:15:54.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.046+0000 7fd11fe00640 1 -- 172.21.15.44:0/3985921617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1200cab00 con 0x7fd1200d0b90 2024-03-30T13:15:54.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.046+0000 7fd11fe00640 1 -- 172.21.15.44:0/3985921617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1200cc510 con 0x7fd1200d0b90 2024-03-30T13:15:54.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.047+0000 7fd11fe00640 1 -- 172.21.15.44:0/3985921617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd120075890 con 0x7fd1200d0b90 2024-03-30T13:15:54.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.048+0000 7fd116a00640 1 -- 172.21.15.44:0/3985921617 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd118047020 con 0x7fd1200d0b90 2024-03-30T13:15:54.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.049+0000 7fd116a00640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd10006c580 0x7fd10006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.049+0000 7fd116a00640 1 -- 172.21.15.44:0/3985921617 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fd1180ae060 con 0x7fd1200d0b90 2024-03-30T13:15:54.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.049+0000 7fd11ea00640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd10006c580 0x7fd10006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.051+0000 7fd11ea00640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd10006c580 0x7fd10006ea40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd110006fd0 tx=0x7fd110008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:54.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.053+0000 7fd116a00640 1 -- 172.21.15.44:0/3985921617 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd11804e030 con 0x7fd1200d0b90 2024-03-30T13:15:54.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.255+0000 7fd11fe00640 1 -- 172.21.15.44:0/3985921617 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fd1200cc6e0 con 0x7fd1200d0b90 2024-03-30T13:15:54.266 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.262+0000 7fd116a00640 1 -- 172.21.15.44:0/3985921617 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fd11807c7d0 con 0x7fd1200d0b90 2024-03-30T13:15:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.265+0000 7fd11fe00640 1 -- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd10006c580 msgr2=0x7fd10006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.265+0000 7fd11fe00640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd10006c580 0x7fd10006ea40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd110006fd0 tx=0x7fd110008040 comp rx=0 tx=0).stop 2024-03-30T13:15:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.265+0000 7fd11fe00640 1 -- 172.21.15.44:0/3985921617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1200d0b90 msgr2=0x7fd1201f77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.265+0000 7fd11fe00640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1200d0b90 0x7fd1201f77a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd118036040 tx=0x7fd118004a40 comp rx=0 tx=0).stop 2024-03-30T13:15:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.265+0000 7fd11fe00640 1 -- 172.21.15.44:0/3985921617 shutdown_connections 2024-03-30T13:15:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.265+0000 7fd11fe00640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd1200d0b90 0x7fd1201f77a0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.265+0000 7fd11fe00640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd1200b4d00 0x7fd1200c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.265+0000 7fd11fe00640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd10006c580 0x7fd10006ea40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.265+0000 7fd11fe00640 1 --2- 172.21.15.44:0/3985921617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1200b4920 0x7fd12014e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.265+0000 7fd11fe00640 1 -- 172.21.15.44:0/3985921617 >> 172.21.15.44:0/3985921617 conn(0x7fd12009d4e0 msgr2=0x7fd1200b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.265+0000 7fd11fe00640 1 -- 172.21.15.44:0/3985921617 shutdown_connections 2024-03-30T13:15:54.270 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.265+0000 7fd11fe00640 1 -- 172.21.15.44:0/3985921617 wait complete. 2024-03-30T13:15:54.289 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining' 2024-03-30T13:15:54.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.497+0000 7f553ca00640 1 Processor -- start 2024-03-30T13:15:54.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.498+0000 7f553ca00640 1 -- start start 2024-03-30T13:15:54.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.499+0000 7f553ca00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55380d09a0 0x7f55381566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.499+0000 7f553ca00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5538160c20 con 0x7f5538142300 2024-03-30T13:15:54.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.499+0000 7f553ca00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55381427b0 con 0x7f55381562f0 2024-03-30T13:15:54.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.499+0000 7f553ca00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f5538156c10 con 0x7f55380d09a0 2024-03-30T13:15:54.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.499+0000 7f5537e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f5538142300 0x7f553815ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57928/0 (socket says 172.21.15.44:57928) 2024-03-30T13:15:54.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.499+0000 7f5537e00640 1 -- 172.21.15.44:0/1888718071 learned_addr learned my addr 172.21.15.44:0/1888718071 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:54.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518318812 0 0) 0x7f5538160c20 con 0x7f5538142300 2024-03-30T13:15:54.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f551c003520 con 0x7f5538142300 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f552fe00640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55380d09a0 0x7f55381566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2254288009 0 0) 0x7f551c003520 con 0x7f5538142300 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55380d09a0 msgr2=0x7f55381566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f5536a00640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55380d09a0 0x7f55381566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 >> v1:172.21.15.151:6789/0 conn(0x7f55381562f0 legacy=0x7f55380d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55381600a0 con 0x7f5538142300 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f55300019f0 con 0x7f5538142300 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 >> v1:172.21.15.44:6789/0 conn(0x7f5538142300 legacy=0x7f553815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f5536a00640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f551c0039e0 0x7f551c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f5536a00640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55380d09a0 0x7f551c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.500+0000 7f5536a00640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f551c004d40 0x7f551c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5538156c10 con 0x7f551c004d40 2024-03-30T13:15:54.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f551c00bb50 con 0x7f551c0039e0 2024-03-30T13:15:54.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f551c00bd50 con 0x7f55380d09a0 2024-03-30T13:15:54.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f5537e00640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f551c004d40 0x7f551c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f5537400640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f551c0039e0 0x7f551c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f552fe00640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55380d09a0 0x7f551c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f5537e00640 1 -- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55380d09a0 msgr2=0x7f551c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:54.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f5537e00640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55380d09a0 0x7f551c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f5537e00640 1 -- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f551c0039e0 msgr2=0x7f551c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:54.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f5537e00640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f551c0039e0 0x7f551c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f5537e00640 1 -- 172.21.15.44:0/1888718071 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551c003520 con 0x7f551c004d40 2024-03-30T13:15:54.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f552fe00640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55380d09a0 0x7f551c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:54.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.501+0000 7f5537400640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f551c0039e0 0x7f551c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:54.508 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.502+0000 7f5537e00640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f551c004d40 0x7f551c0051c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f553000a860 tx=0x7f551c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ed7531c59ccc8c server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:54.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.503+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553000a480 con 0x7f551c004d40 2024-03-30T13:15:54.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.503+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5530034630 con 0x7f551c004d40 2024-03-30T13:15:54.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.503+0000 7f5536a00640 1 -- 172.21.15.44:0/1888718071 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530034a40 con 0x7f551c004d40 2024-03-30T13:15:54.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.503+0000 7f553ca00640 1 -- 172.21.15.44:0/1888718071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f551c004d40 msgr2=0x7f551c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:54.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.503+0000 7f553ca00640 1 --2- 172.21.15.44:0/1888718071 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f551c004d40 0x7f551c0051c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f553000a860 tx=0x7f551c005830 comp rx=0 tx=0).stop 2024-03-30T13:15:54.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.503+0000 7f5537e00640 1 -- 172.21.15.44:0/1888718071 reap_dead start 2024-03-30T13:15:54.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.503+0000 7f553ca00640 1 -- 172.21.15.44:0/1888718071 shutdown_connections 2024-03-30T13:15:54.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.503+0000 7f553ca00640 1 -- 172.21.15.44:0/1888718071 >> 172.21.15.44:0/1888718071 conn(0x7f553806b9a0 msgr2=0x7f553806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:54.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.503+0000 7f553ca00640 1 -- 172.21.15.44:0/1888718071 shutdown_connections 2024-03-30T13:15:54.509 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.504+0000 7f553ca00640 1 -- 172.21.15.44:0/1888718071 wait complete. 2024-03-30T13:15:54.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.505+0000 7f553ca00640 1 Processor -- start 2024-03-30T13:15:54.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.505+0000 7f553ca00640 1 -- start start 2024-03-30T13:15:54.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.506+0000 7f553ca00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f551c004d40 0x7f55381f7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.506+0000 7f553ca00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55380af910 0x7f55380afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.506+0000 7f553ca00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f553815e8c0 0x7f553815ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.506+0000 7f553ca00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5538160940 con 0x7f55380af910 2024-03-30T13:15:54.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.506+0000 7f553ca00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5538160660 con 0x7f553815e8c0 2024-03-30T13:15:54.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.506+0000 7f553ca00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f55380cca20 con 0x7f551c004d40 2024-03-30T13:15:54.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.507+0000 7f552fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55380af910 0x7f55380afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.507+0000 7f552fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55380af910 0x7f55380afd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38170/0 (socket says 172.21.15.44:38170) 2024-03-30T13:15:54.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.507+0000 7f552fe00640 1 -- 172.21.15.44:0/37545361 learned_addr learned my addr 172.21.15.44:0/37545361 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:54.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.507+0000 7f5537e00640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f553815e8c0 0x7f553815ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.507+0000 7f5537400640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f551c004d40 0x7f55381f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.507+0000 7f552fe00640 1 -- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f551c004d40 msgr2=0x7f55381f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.507+0000 7f552fe00640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f551c004d40 0x7f55381f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.507+0000 7f552fe00640 1 -- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f553815e8c0 msgr2=0x7f553815ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.507+0000 7f552fe00640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f553815e8c0 0x7f553815ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.507+0000 7f552fe00640 1 -- 172.21.15.44:0/37545361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55380b0480 con 0x7f55380af910 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.507+0000 7f5537e00640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f553815e8c0 0x7f553815ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.508+0000 7f552fe00640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55380af910 0x7f55380afd90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f552000e810 tx=0x7f552000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.508+0000 7f552f400640 1 -- 172.21.15.44:0/37545361 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520017070 con 0x7f55380af910 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.508+0000 7f552f400640 1 -- 172.21.15.44:0/37545361 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552000c6d0 con 0x7f55380af910 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.508+0000 7f552f400640 1 -- 172.21.15.44:0/37545361 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552000f040 con 0x7f55380af910 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.508+0000 7f553ca00640 1 -- 172.21.15.44:0/37545361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55380b0760 con 0x7f55380af910 2024-03-30T13:15:54.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.508+0000 7f553ca00640 1 -- 172.21.15.44:0/37545361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55380b0d20 con 0x7f55380af910 2024-03-30T13:15:54.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.509+0000 7f553ca00640 1 -- 172.21.15.44:0/37545361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5538075890 con 0x7f55380af910 2024-03-30T13:15:54.514 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.510+0000 7f552f400640 1 -- 172.21.15.44:0/37545361 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f552001a070 con 0x7f55380af910 2024-03-30T13:15:54.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.511+0000 7f552f400640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f551406c560 0x7f551406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:54.515 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.511+0000 7f552f400640 1 -- 172.21.15.44:0/37545361 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f552008b170 con 0x7f55380af910 2024-03-30T13:15:54.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.512+0000 7f5537400640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f551406c560 0x7f551406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:54.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.513+0000 7f5537400640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f551406c560 0x7f551406ea20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5528001750 tx=0x7f5528009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:54.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.516+0000 7f552f400640 1 -- 172.21.15.44:0/37545361 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5520059860 con 0x7f55380af910 2024-03-30T13:15:54.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.796+0000 7f553ca00640 1 -- 172.21.15.44:0/37545361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]} v 0) -- 0x7f55380cc130 con 0x7f55380af910 2024-03-30T13:15:54.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.823+0000 7f552f400640 1 -- 172.21.15.44:0/37545361 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]}]=0 v213) ==== 147+0+0 (secure 0 0 0) 0x7f5520059160 con 0x7f55380af910 2024-03-30T13:15:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.825+0000 7f553ca00640 1 -- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f551406c560 msgr2=0x7f551406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.825+0000 7f553ca00640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f551406c560 0x7f551406ea20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5528001750 tx=0x7f5528009040 comp rx=0 tx=0).stop 2024-03-30T13:15:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.825+0000 7f553ca00640 1 -- 172.21.15.44:0/37545361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55380af910 msgr2=0x7f55380afd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.825+0000 7f553ca00640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55380af910 0x7f55380afd90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f552000e810 tx=0x7f552000ecd0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.825+0000 7f553ca00640 1 -- 172.21.15.44:0/37545361 shutdown_connections 2024-03-30T13:15:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.825+0000 7f553ca00640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f551406c560 0x7f551406ea20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.825+0000 7f553ca00640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f553815e8c0 0x7f553815ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.825+0000 7f553ca00640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f55380af910 0x7f55380afd90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.825+0000 7f553ca00640 1 --2- 172.21.15.44:0/37545361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f551c004d40 0x7f55381f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:54.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.825+0000 7f553ca00640 1 -- 172.21.15.44:0/37545361 >> 172.21.15.44:0/37545361 conn(0x7f553806b9a0 msgr2=0x7f553813fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:54.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.826+0000 7f553ca00640 1 -- 172.21.15.44:0/37545361 shutdown_connections 2024-03-30T13:15:54.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:54.826+0000 7f553ca00640 1 -- 172.21.15.44:0/37545361 wait complete. 2024-03-30T13:15:54.856 INFO:tasks.cephfs_test_runner:test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) ... ERROR 2024-03-30T13:15:54.857 INFO:tasks.cephfs_test_runner: 2024-03-30T13:15:54.857 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-30T13:15:54.857 INFO:tasks.cephfs_test_runner:ERROR: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:15:54.857 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-30T13:15:54.857 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-30T13:15:54.857 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/test_uninlining.py", line 322, in test_data_uninlining 2024-03-30T13:15:54.857 INFO:tasks.cephfs_test_runner: self.run_test_worker(opt_clear_cache, 2024-03-30T13:15:54.857 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/test_uninlining.py", line 219, in run_test_worker 2024-03-30T13:15:54.857 INFO:tasks.cephfs_test_runner: self.fs.mds_tell(['cache', 'drop'], i) 2024-03-30T13:15:54.857 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1313, in mds_tell 2024-03-30T13:15:54.857 INFO:tasks.cephfs_test_runner: return self.rank_tell(*args, **kwargs) 2024-03-30T13:15:54.857 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1332, in rank_tell 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: return self.mds_tell(*args, mds_id=f"{self.id}:{rank}", **kwargs) 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1319, in mds_tell 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: out = self.get_ceph_cmd_stdout("tell", f"mds.{mds_id}", *args, **kwargs) 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 447, in run 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: r = RemoteProcess(client, args, check_status=check_status, hostname=name, 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 65, in __init__ 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: self.command = quote(args) 2024-03-30T13:15:54.858 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 257, in quote 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner: return ' '.join(_quote(args)) 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 255, in _quote 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner: yield pipes.quote(a) 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/shlex.py", line 325, in quote 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner: if _find_unsafe(s) is None: 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner:TypeError: expected string or bytes-like object 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner: 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner:Ran 1 test in 186.055s 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner: 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner: 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner:ERROR: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:15:54.859 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-30T13:15:54.860 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-30T13:15:54.860 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/test_uninlining.py", line 322, in test_data_uninlining 2024-03-30T13:15:54.860 INFO:tasks.cephfs_test_runner: self.run_test_worker(opt_clear_cache, 2024-03-30T13:15:54.860 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/test_uninlining.py", line 219, in run_test_worker 2024-03-30T13:15:54.860 INFO:tasks.cephfs_test_runner: self.fs.mds_tell(['cache', 'drop'], i) 2024-03-30T13:15:54.860 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1313, in mds_tell 2024-03-30T13:15:54.860 INFO:tasks.cephfs_test_runner: return self.rank_tell(*args, **kwargs) 2024-03-30T13:15:54.860 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1332, in rank_tell 2024-03-30T13:15:54.860 INFO:tasks.cephfs_test_runner: return self.mds_tell(*args, mds_id=f"{self.id}:{rank}", **kwargs) 2024-03-30T13:15:54.860 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs/filesystem.py", line 1319, in mds_tell 2024-03-30T13:15:54.860 INFO:tasks.cephfs_test_runner: out = self.get_ceph_cmd_stdout("tell", f"mds.{mds_id}", *args, **kwargs) 2024-03-30T13:15:54.860 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 447, in run 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: r = RemoteProcess(client, args, check_status=check_status, hostname=name, 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 65, in __init__ 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: self.command = quote(args) 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 257, in quote 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: return ' '.join(_quote(args)) 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 255, in _quote 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: yield pipes.quote(a) 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/shlex.py", line 325, in quote 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: if _find_unsafe(s) is None: 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner:TypeError: expected string or bytes-like object 2024-03-30T13:15:54.861 INFO:tasks.cephfs_test_runner: 2024-03-30T13:15:54.862 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:15:55.128 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=36431adacf1c43ef911b3b0550fdf5bb Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_ac1710396f9f7c389fa4b407711bc5157a8c0bf7/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-30T13:15:55.130 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-30T13:15:55.142 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-30T13:15:55.165 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-30T13:15:55.166 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:15:55.166 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:15:55.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054203,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-30T13:15:55.228 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-03-30T13:15:55.228 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:15:55.284 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054203,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-30T13:15:55.284 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:15:55.284 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:15:55.341 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053430,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T13:15:55.342 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-03-30T13:15:55.342 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-30T13:15:55.396 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053430,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249180k,nr_inodes=812295,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498364k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-30T13:15:55.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:55.396 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-03-30T13:15:55.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-30T13:15:55.457 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-30T13:15:55.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:55.458 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-30T13:15:55.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:55.556 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-30T13:15:55.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:55.652 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-03-30T13:15:55.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:55.786 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-03-30T13:15:55.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:55.831 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-03-30T13:15:55.965 INFO:teuthology.orchestra.run.smithi044.stderr:Cannot find device "ceph-brx" 2024-03-30T13:15:55.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:15:55.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:55.970 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2024-03-30T13:15:56.025 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-30T13:15:56.026 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-30T13:15:56.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:56.027 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-30T13:15:56.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:56.120 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-30T13:15:56.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:56.211 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2024-03-30T13:15:56.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:56.350 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2024-03-30T13:15:56.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-30T13:15:56.395 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2024-03-30T13:15:56.528 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2024-03-30T13:15:56.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:15:56.532 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-30T13:15:56.543 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-30T13:15:56.543 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:15:56.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.772+0000 7fc85d600640 1 Processor -- start 2024-03-30T13:15:56.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.772+0000 7fc85d600640 1 -- start start 2024-03-30T13:15:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.774+0000 7fc85d600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858155370 0x7fc858162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.774+0000 7fc85d600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc85815ef20 con 0x7fc8580d09a0 2024-03-30T13:15:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.774+0000 7fc85d600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc85815f200 con 0x7fc8580b2e40 2024-03-30T13:15:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.774+0000 7fc85d600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc858073060 con 0x7fc858155370 2024-03-30T13:15:56.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.774+0000 7fc85cc00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc8580d09a0 0x7fc858071aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:57930/0 (socket says 172.21.15.44:57930) 2024-03-30T13:15:56.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.774+0000 7fc85cc00640 1 -- 172.21.15.44:0/189049320 learned_addr learned my addr 172.21.15.44:0/189049320 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:56.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857e00640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858155370 0x7fc858162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600326980 0 0) 0x7fc85815ef20 con 0x7fc8580d09a0 2024-03-30T13:15:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc83c003520 con 0x7fc8580d09a0 2024-03-30T13:15:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 700338106 0 0) 0x7fc83c003520 con 0x7fc8580d09a0 2024-03-30T13:15:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858155370 msgr2=0x7fc858162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858155370 0x7fc858162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 >> v1:172.21.15.151:6789/0 conn(0x7fc8580b2e40 legacy=0x7fc8580d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:56.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85815f4e0 con 0x7fc8580d09a0 2024-03-30T13:15:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fc8500019f0 con 0x7fc8580d09a0 2024-03-30T13:15:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 >> v1:172.21.15.44:6789/0 conn(0x7fc8580d09a0 legacy=0x7fc858071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858155370 0x7fc83c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc83c003fb0 0x7fc83c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc83c004d40 0x7fc83c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c00bad0 con 0x7fc83c003fb0 2024-03-30T13:15:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c00bc80 con 0x7fc83c004d40 2024-03-30T13:15:56.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.775+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc83c00be80 con 0x7fc858155370 2024-03-30T13:15:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.776+0000 7fc84f400640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc83c003fb0 0x7fc83c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.776+0000 7fc857e00640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858155370 0x7fc83c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.776+0000 7fc85cc00640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc83c004d40 0x7fc83c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.776+0000 7fc84f400640 1 -- 172.21.15.44:0/189049320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858155370 msgr2=0x7fc83c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.776+0000 7fc84f400640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858155370 0x7fc83c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.776+0000 7fc84f400640 1 -- 172.21.15.44:0/189049320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc83c004d40 msgr2=0x7fc83c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.776+0000 7fc84f400640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc83c004d40 0x7fc83c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:56.783 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.776+0000 7fc84f400640 1 -- 172.21.15.44:0/189049320 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83c003520 con 0x7fc83c003fb0 2024-03-30T13:15:56.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.776+0000 7fc85cc00640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc83c004d40 0x7fc83c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.777+0000 7fc84f400640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc83c003fb0 0x7fc83c004800 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fc840001720 tx=0x7fc83c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a49f0060f332269 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:56.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.777+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840001370 con 0x7fc83c003fb0 2024-03-30T13:15:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.777+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8400052d0 con 0x7fc83c003fb0 2024-03-30T13:15:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.777+0000 7fc857400640 1 -- 172.21.15.44:0/189049320 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840003830 con 0x7fc83c003fb0 2024-03-30T13:15:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.778+0000 7fc85d600640 1 -- 172.21.15.44:0/189049320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc83c003fb0 msgr2=0x7fc83c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.778+0000 7fc85d600640 1 --2- 172.21.15.44:0/189049320 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc83c003fb0 0x7fc83c004800 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fc840001720 tx=0x7fc83c005830 comp rx=0 tx=0).stop 2024-03-30T13:15:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.778+0000 7fc85cc00640 1 -- 172.21.15.44:0/189049320 reap_dead start 2024-03-30T13:15:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.778+0000 7fc85d600640 1 -- 172.21.15.44:0/189049320 shutdown_connections 2024-03-30T13:15:56.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.778+0000 7fc85d600640 1 -- 172.21.15.44:0/189049320 >> 172.21.15.44:0/189049320 conn(0x7fc85806b9a0 msgr2=0x7fc85806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.778+0000 7fc85d600640 1 -- 172.21.15.44:0/189049320 shutdown_connections 2024-03-30T13:15:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.778+0000 7fc85d600640 1 -- 172.21.15.44:0/189049320 wait complete. 2024-03-30T13:15:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.780+0000 7fc85d600640 1 Processor -- start 2024-03-30T13:15:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.781+0000 7fc85d600640 1 -- start start 2024-03-30T13:15:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc85d600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc83c003fb0 0x7fc8581f35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc85d600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc85814fa90 0x7fc85814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc85d600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858151270 0x7fc8581516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc85d600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc858071530 con 0x7fc85814fa90 2024-03-30T13:15:56.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc85d600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580af910 con 0x7fc83c003fb0 2024-03-30T13:15:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc85d600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc858155750 con 0x7fc858151270 2024-03-30T13:15:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc84f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc85814fa90 0x7fc85814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc84f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc85814fa90 0x7fc85814fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38184/0 (socket says 172.21.15.44:38184) 2024-03-30T13:15:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc84f400640 1 -- 172.21.15.44:0/3851079677 learned_addr learned my addr 172.21.15.44:0/3851079677 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc857e00640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc83c003fb0 0x7fc8581f35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc85cc00640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858151270 0x7fc8581516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:56.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc84f400640 1 -- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858151270 msgr2=0x7fc8581516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc84f400640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858151270 0x7fc8581516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc84f400640 1 -- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc83c003fb0 msgr2=0x7fc8581f35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc84f400640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc83c003fb0 0x7fc8581f35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.782+0000 7fc84f400640 1 -- 172.21.15.44:0/3851079677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85814bb00 con 0x7fc85814fa90 2024-03-30T13:15:56.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.783+0000 7fc84f400640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc85814fa90 0x7fc85814fef0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc840008fd0 tx=0x7fc840001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.783+0000 7fc854c00640 1 -- 172.21.15.44:0/3851079677 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840041070 con 0x7fc85814fa90 2024-03-30T13:15:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.783+0000 7fc854c00640 1 -- 172.21.15.44:0/3851079677 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc840005480 con 0x7fc85814fa90 2024-03-30T13:15:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.783+0000 7fc854c00640 1 -- 172.21.15.44:0/3851079677 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840001370 con 0x7fc85814fa90 2024-03-30T13:15:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.783+0000 7fc85d600640 1 -- 172.21.15.44:0/3851079677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc858150530 con 0x7fc85814fa90 2024-03-30T13:15:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.783+0000 7fc85d600640 1 -- 172.21.15.44:0/3851079677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc858150af0 con 0x7fc85814fa90 2024-03-30T13:15:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.785+0000 7fc85d600640 1 -- 172.21.15.44:0/3851079677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc858075890 con 0x7fc85814fa90 2024-03-30T13:15:56.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.786+0000 7fc854c00640 1 -- 172.21.15.44:0/3851079677 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc840044070 con 0x7fc85814fa90 2024-03-30T13:15:56.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.787+0000 7fc854c00640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc83406c560 0x7fc83406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:56.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.787+0000 7fc854c00640 1 -- 172.21.15.44:0/3851079677 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fc8400ad240 con 0x7fc85814fa90 2024-03-30T13:15:56.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.788+0000 7fc857e00640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc83406c560 0x7fc83406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:56.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.789+0000 7fc857e00640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc83406c560 0x7fc83406ea20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc848009a10 tx=0x7fc848008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:56.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.792+0000 7fc854c00640 1 -- 172.21.15.44:0/3851079677 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc840006e20 con 0x7fc85814fa90 2024-03-30T13:15:57.002 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:56.998+0000 7fc85d600640 1 -- 172.21.15.44:0/3851079677 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc85806e7b0 con 0x7fc83406c560 2024-03-30T13:15:57.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.001+0000 7fc854c00640 1 -- 172.21.15.44:0/3851079677 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13564 (secure 0 0 0) 0x7fc85806e7b0 con 0x7fc83406c560 2024-03-30T13:15:57.005 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:57.006 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:15:57.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.003+0000 7fc85d600640 1 -- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc83406c560 msgr2=0x7fc83406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.008 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.003+0000 7fc85d600640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc83406c560 0x7fc83406ea20 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc848009a10 tx=0x7fc848008040 comp rx=0 tx=0).stop 2024-03-30T13:15:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.003+0000 7fc85d600640 1 -- 172.21.15.44:0/3851079677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc85814fa90 msgr2=0x7fc85814fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.003+0000 7fc85d600640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc85814fa90 0x7fc85814fef0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc840008fd0 tx=0x7fc840001120 comp rx=0 tx=0).stop 2024-03-30T13:15:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.003+0000 7fc85d600640 1 -- 172.21.15.44:0/3851079677 shutdown_connections 2024-03-30T13:15:57.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.003+0000 7fc85d600640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc858151270 0x7fc8581516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.003+0000 7fc85d600640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc85814fa90 0x7fc85814fef0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.003+0000 7fc85d600640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc83406c560 0x7fc83406ea20 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.003+0000 7fc85d600640 1 --2- 172.21.15.44:0/3851079677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc83c003fb0 0x7fc8581f35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.003+0000 7fc85d600640 1 -- 172.21.15.44:0/3851079677 >> 172.21.15.44:0/3851079677 conn(0x7fc85806b9a0 msgr2=0x7fc8580cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:57.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.004+0000 7fc85d600640 1 -- 172.21.15.44:0/3851079677 shutdown_connections 2024-03-30T13:15:57.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.004+0000 7fc85d600640 1 -- 172.21.15.44:0/3851079677 wait complete. 2024-03-30T13:15:57.029 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-03-30T13:15:56.049725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":594336,"kb_used_data":349052,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754380384,"statfs":{"total":773094113280,"available":772485513216,"internally_reserved":0,"allocated":357429248,"data_stored":354592150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-177582274,"num_objects":-139,"num_object_clones":0,"num_object_copies":-278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-139,"num_whiteouts":0,"num_read":-200,"num_read_kb":-168594,"num_write":-928,"num_write_kb":-176242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002221"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":222,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-30T13:15:52.801417+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:15:52.801417+0000","last_peered":"2024-03-30T13:15:52.801417+0000","last_clean":"2024-03-30T13:15:52.801417+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:15:52.801417+0000","last_undegraded":"2024-03-30T13:15:52.801417+0000","last_fullsized":"2024-03-30T13:15:52.801417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94100,"kb_used_data":62920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94277740,"statfs":{"total":96636764160,"available":96540405760,"internally_reserved":0,"allocated":64430080,"data_stored":64063681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69344,"kb_used_data":42324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94302496,"statfs":{"total":96636764160,"available":96565755904,"internally_reserved":0,"allocated":43339776,"data_stored":43004191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509495,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101888,"kb_used_data":70708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94269952,"statfs":{"total":96636764160,"available":96532430848,"internally_reserved":0,"allocated":72404992,"data_stored":72036579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48452,"kb_used_data":17268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323388,"statfs":{"total":96636764160,"available":96587149312,"internally_reserved":0,"allocated":17682432,"data_stored":17341075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89460,"kb_used_data":58280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282380,"statfs":{"total":96636764160,"available":96545157120,"internally_reserved":0,"allocated":59678720,"data_stored":59303430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44420,"kb_used_data":13240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327420,"statfs":{"total":96636764160,"available":96591278080,"internally_reserved":0,"allocated":13557760,"data_stored":13210173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65368,"kb_used_data":34188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94306472,"statfs":{"total":96636764160,"available":96569827328,"internally_reserved":0,"allocated":35008512,"data_stored":34654533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542199,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81304,"kb_used_data":50124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94290536,"statfs":{"total":96636764160,"available":96553508864,"internally_reserved":0,"allocated":51326976,"data_stored":50978488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:15:57.031 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:15:57.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.244+0000 7f703f200640 1 Processor -- start 2024-03-30T13:15:57.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.244+0000 7f703f200640 1 -- start start 2024-03-30T13:15:57.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.246+0000 7f703f200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f70400d0d30 0x7f70400cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.246+0000 7f703f200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70400d4950 0x7f7040161760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.246+0000 7f703f200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f70400d1110 0x7f7040161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.246+0000 7f703f200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f70400c7b90 con 0x7f70400d0d30 2024-03-30T13:15:57.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.246+0000 7f703f200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f70400b5b60 con 0x7f70400d1110 2024-03-30T13:15:57.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.246+0000 7f703f200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f70400d4fc0 con 0x7f70400d4950 2024-03-30T13:15:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.246+0000 7f703de00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f70400d0d30 0x7f70400cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.246+0000 7f703de00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f70400d0d30 0x7f70400cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51630/0 (socket says 172.21.15.44:51630) 2024-03-30T13:15:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.246+0000 7f703de00640 1 -- 172.21.15.44:0/3279300292 learned_addr learned my addr 172.21.15.44:0/3279300292 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.247+0000 7f703e800640 1 --2- 172.21.15.44:0/3279300292 >> v2:172.21.15.151:3300/0 conn(0x7f70400d1110 0x7f7040161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.247+0000 7f7035400640 1 --2- 172.21.15.44:0/3279300292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70400d4950 0x7f7040161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.247+0000 7f703de00640 1 -- 172.21.15.44:0/3279300292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70400d4950 msgr2=0x7f7040161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:57.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.247+0000 7f703de00640 1 --2- 172.21.15.44:0/3279300292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70400d4950 0x7f7040161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.247+0000 7f703de00640 1 -- 172.21.15.44:0/3279300292 >> v2:172.21.15.151:3300/0 conn(0x7f70400d1110 msgr2=0x7f7040161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:57.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.247+0000 7f703de00640 1 --2- 172.21.15.44:0/3279300292 >> v2:172.21.15.151:3300/0 conn(0x7f70400d1110 0x7f7040161ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.247+0000 7f703de00640 1 -- 172.21.15.44:0/3279300292 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70400b57f0 con 0x7f70400d0d30 2024-03-30T13:15:57.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.247+0000 7f7035400640 1 --2- 172.21.15.44:0/3279300292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70400d4950 0x7f7040161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:57.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.247+0000 7f703e800640 1 --2- 172.21.15.44:0/3279300292 >> v2:172.21.15.151:3300/0 conn(0x7f70400d1110 0x7f7040161ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.248+0000 7f703de00640 1 --2- 172.21.15.44:0/3279300292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70400d0d30 0x7f70400cfde0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f70400b3110 tx=0x7f703002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77aedfab95032d15 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.248+0000 7f703d400640 1 -- 172.21.15.44:0/3279300292 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703002cb00 con 0x7f70400d0d30 2024-03-30T13:15:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.248+0000 7f703d400640 1 -- 172.21.15.44:0/3279300292 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f703002cca0 con 0x7f70400d0d30 2024-03-30T13:15:57.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.248+0000 7f703d400640 1 -- 172.21.15.44:0/3279300292 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030034610 con 0x7f70400d0d30 2024-03-30T13:15:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.249+0000 7f703f200640 1 -- 172.21.15.44:0/3279300292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70400d0d30 msgr2=0x7f70400cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.249+0000 7f703f200640 1 --2- 172.21.15.44:0/3279300292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70400d0d30 0x7f70400cfde0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f70400b3110 tx=0x7f703002bf60 comp rx=0 tx=0).stop 2024-03-30T13:15:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.249+0000 7f703f200640 1 -- 172.21.15.44:0/3279300292 shutdown_connections 2024-03-30T13:15:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.249+0000 7f703f200640 1 --2- 172.21.15.44:0/3279300292 >> v2:172.21.15.151:3300/0 conn(0x7f70400d1110 0x7f7040161ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.249+0000 7f703f200640 1 --2- 172.21.15.44:0/3279300292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70400d4950 0x7f7040161760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.249+0000 7f703f200640 1 --2- 172.21.15.44:0/3279300292 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70400d0d30 0x7f70400cfde0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.249+0000 7f703f200640 1 -- 172.21.15.44:0/3279300292 >> 172.21.15.44:0/3279300292 conn(0x7f704009d570 msgr2=0x7f70400d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:57.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.249+0000 7f703f200640 1 -- 172.21.15.44:0/3279300292 shutdown_connections 2024-03-30T13:15:57.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.249+0000 7f703f200640 1 -- 172.21.15.44:0/3279300292 wait complete. 2024-03-30T13:15:57.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.251+0000 7f703f200640 1 Processor -- start 2024-03-30T13:15:57.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.251+0000 7f703f200640 1 -- start start 2024-03-30T13:15:57.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.252+0000 7f703f200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70400d0d30 0x7f70401f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.252+0000 7f703f200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70400d1110 0x7f70401f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.252+0000 7f703f200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70400d4950 0x7f70400c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.252+0000 7f703f200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f70400b3300 con 0x7f70400d1110 2024-03-30T13:15:57.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.252+0000 7f703f200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f70400b3180 con 0x7f70400d0d30 2024-03-30T13:15:57.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.252+0000 7f703f200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f70400b3a50 con 0x7f70400d4950 2024-03-30T13:15:57.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.252+0000 7f7035400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70400d1110 0x7f70401f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.253+0000 7f7035400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70400d1110 0x7f70401f7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51646/0 (socket says 172.21.15.44:51646) 2024-03-30T13:15:57.260 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.253+0000 7f7035400640 1 -- 172.21.15.44:0/953720213 learned_addr learned my addr 172.21.15.44:0/953720213 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:57.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.253+0000 7f703e800640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70400d4950 0x7f70400c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.253+0000 7f7035400640 1 -- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70400d4950 msgr2=0x7f70400c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.253+0000 7f7035400640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70400d4950 0x7f70400c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.253+0000 7f7035400640 1 -- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70400d0d30 msgr2=0x7f70401f73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.253+0000 7f703de00640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70400d0d30 0x7f70401f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.253+0000 7f7035400640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70400d0d30 0x7f70401f73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.253+0000 7f7035400640 1 -- 172.21.15.44:0/953720213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70400c9ab0 con 0x7f70400d1110 2024-03-30T13:15:57.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.253+0000 7f703de00640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70400d0d30 0x7f70401f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:57.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.253+0000 7f7035400640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70400d1110 0x7f70401f7920 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f702800c7c0 tx=0x7f702800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:57.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.254+0000 7f7036a00640 1 -- 172.21.15.44:0/953720213 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028015070 con 0x7f70400d1110 2024-03-30T13:15:57.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.254+0000 7f7036a00640 1 -- 172.21.15.44:0/953720213 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7028007820 con 0x7f70400d1110 2024-03-30T13:15:57.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.254+0000 7f703f200640 1 -- 172.21.15.44:0/953720213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70400c9d90 con 0x7f70400d1110 2024-03-30T13:15:57.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.254+0000 7f7036a00640 1 -- 172.21.15.44:0/953720213 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028007bf0 con 0x7f70400d1110 2024-03-30T13:15:57.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.254+0000 7f703f200640 1 -- 172.21.15.44:0/953720213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70400b78d0 con 0x7f70400d1110 2024-03-30T13:15:57.262 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.255+0000 7f703f200640 1 -- 172.21.15.44:0/953720213 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7040075890 con 0x7f70400d1110 2024-03-30T13:15:57.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.256+0000 7f7036a00640 1 -- 172.21.15.44:0/953720213 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7028018070 con 0x7f70400d1110 2024-03-30T13:15:57.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.257+0000 7f7036a00640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f701c06c530 0x7f701c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.257+0000 7f7036a00640 1 -- 172.21.15.44:0/953720213 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f702808b4b0 con 0x7f70400d1110 2024-03-30T13:15:57.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.258+0000 7f703de00640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f701c06c530 0x7f701c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.259+0000 7f703de00640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f701c06c530 0x7f701c06e9f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7030035000 tx=0x7f7030030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:57.265 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.261+0000 7f7036a00640 1 -- 172.21.15.44:0/953720213 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7028059c30 con 0x7f70400d1110 2024-03-30T13:15:57.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.462+0000 7f703f200640 1 -- 172.21.15.44:0/953720213 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f704006c600 con 0x7f701c06c530 2024-03-30T13:15:57.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.464+0000 7f7036a00640 1 -- 172.21.15.44:0/953720213 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13564 (secure 0 0 0) 0x7f704006c600 con 0x7f701c06c530 2024-03-30T13:15:57.468 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:57.468 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:15:57.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.467+0000 7f703f200640 1 -- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f701c06c530 msgr2=0x7f701c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.467+0000 7f703f200640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f701c06c530 0x7f701c06e9f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7030035000 tx=0x7f7030030000 comp rx=0 tx=0).stop 2024-03-30T13:15:57.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.467+0000 7f703f200640 1 -- 172.21.15.44:0/953720213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70400d1110 msgr2=0x7f70401f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.467+0000 7f703f200640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70400d1110 0x7f70401f7920 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f702800c7c0 tx=0x7f702800cc80 comp rx=0 tx=0).stop 2024-03-30T13:15:57.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.467+0000 7f703f200640 1 -- 172.21.15.44:0/953720213 shutdown_connections 2024-03-30T13:15:57.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.467+0000 7f703f200640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70400d4950 0x7f70400c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.467+0000 7f703f200640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70400d1110 0x7f70401f7920 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.467+0000 7f703f200640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f701c06c530 0x7f701c06e9f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.467+0000 7f703f200640 1 --2- 172.21.15.44:0/953720213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70400d0d30 0x7f70401f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.467+0000 7f703f200640 1 -- 172.21.15.44:0/953720213 >> 172.21.15.44:0/953720213 conn(0x7f704009d570 msgr2=0x7f70400b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:57.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.467+0000 7f703f200640 1 -- 172.21.15.44:0/953720213 shutdown_connections 2024-03-30T13:15:57.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.467+0000 7f703f200640 1 -- 172.21.15.44:0/953720213 wait complete. 2024-03-30T13:15:57.489 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-03-30T13:15:56.049725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":594336,"kb_used_data":349052,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754380384,"statfs":{"total":773094113280,"available":772485513216,"internally_reserved":0,"allocated":357429248,"data_stored":354592150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-177582274,"num_objects":-139,"num_object_clones":0,"num_object_copies":-278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-139,"num_whiteouts":0,"num_read":-200,"num_read_kb":-168594,"num_write":-928,"num_write_kb":-176242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002221"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":222,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-30T13:15:52.801417+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:15:52.801417+0000","last_peered":"2024-03-30T13:15:52.801417+0000","last_clean":"2024-03-30T13:15:52.801417+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:15:52.801417+0000","last_undegraded":"2024-03-30T13:15:52.801417+0000","last_fullsized":"2024-03-30T13:15:52.801417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94100,"kb_used_data":62920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94277740,"statfs":{"total":96636764160,"available":96540405760,"internally_reserved":0,"allocated":64430080,"data_stored":64063681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69344,"kb_used_data":42324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94302496,"statfs":{"total":96636764160,"available":96565755904,"internally_reserved":0,"allocated":43339776,"data_stored":43004191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509495,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101888,"kb_used_data":70708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94269952,"statfs":{"total":96636764160,"available":96532430848,"internally_reserved":0,"allocated":72404992,"data_stored":72036579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48452,"kb_used_data":17268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323388,"statfs":{"total":96636764160,"available":96587149312,"internally_reserved":0,"allocated":17682432,"data_stored":17341075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89460,"kb_used_data":58280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282380,"statfs":{"total":96636764160,"available":96545157120,"internally_reserved":0,"allocated":59678720,"data_stored":59303430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44420,"kb_used_data":13240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327420,"statfs":{"total":96636764160,"available":96591278080,"internally_reserved":0,"allocated":13557760,"data_stored":13210173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65368,"kb_used_data":34188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94306472,"statfs":{"total":96636764160,"available":96569827328,"internally_reserved":0,"allocated":35008512,"data_stored":34654533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542199,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81304,"kb_used_data":50124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94290536,"statfs":{"total":96636764160,"available":96553508864,"internally_reserved":0,"allocated":51326976,"data_stored":50978488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:15:57.490 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-30T13:15:57.490 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:15:57.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.675+0000 7fcb47a00640 1 Processor -- start 2024-03-30T13:15:57.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.676+0000 7fcb47a00640 1 -- start start 2024-03-30T13:15:57.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.677+0000 7fcb47a00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb4006b580 0x7fcb4006ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.677+0000 7fcb47a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb400b4f90 con 0x7fcb401470d0 2024-03-30T13:15:57.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.677+0000 7fcb47a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb40162110 con 0x7fcb4006fb10 2024-03-30T13:15:57.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.677+0000 7fcb47a00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fcb401623f0 con 0x7fcb4006b580 2024-03-30T13:15:57.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.677+0000 7fcb45000640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fcb401470d0 0x7fcb400b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46878/0 (socket says 172.21.15.44:46878) 2024-03-30T13:15:57.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.677+0000 7fcb45000640 1 -- 172.21.15.44:0/2899381726 learned_addr learned my addr 172.21.15.44:0/2899381726 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:57.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3fe00640 1 --2- 172.21.15.44:0/2899381726 >> v2:172.21.15.151:3300/0 conn(0x7fcb4006b580 0x7fcb4006ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 850311791 0 0) 0x7fcb400b4f90 con 0x7fcb401470d0 2024-03-30T13:15:57.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb28003520 con 0x7fcb401470d0 2024-03-30T13:15:57.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 910667415 0 0) 0x7fcb28003520 con 0x7fcb401470d0 2024-03-30T13:15:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 >> v2:172.21.15.151:3300/0 conn(0x7fcb4006b580 msgr2=0x7fcb4006ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3f400640 1 --2- 172.21.15.44:0/2899381726 >> v2:172.21.15.151:3300/0 conn(0x7fcb4006b580 0x7fcb4006ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 >> v1:172.21.15.151:6789/0 conn(0x7fcb4006fb10 legacy=0x7fcb4006ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb401626d0 con 0x7fcb401470d0 2024-03-30T13:15:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fcb34001670 con 0x7fcb401470d0 2024-03-30T13:15:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 >> v1:172.21.15.44:6789/0 conn(0x7fcb401470d0 legacy=0x7fcb400b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3f400640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb280039b0 0x7fcb28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3f400640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb28004800 0x7fcb28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.678+0000 7fcb3f400640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb280051c0 0x7fcb2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcb401623f0 con 0x7fcb280039b0 2024-03-30T13:15:57.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2800c060 con 0x7fcb28004800 2024-03-30T13:15:57.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2800c260 con 0x7fcb280051c0 2024-03-30T13:15:57.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb45000640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb280039b0 0x7fcb28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb3fe00640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb28004800 0x7fcb28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.686 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb45a00640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb280051c0 0x7fcb2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb45000640 1 -- 172.21.15.44:0/2899381726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb280051c0 msgr2=0x7fcb2800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb45000640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb280051c0 0x7fcb2800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb45000640 1 -- 172.21.15.44:0/2899381726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb28004800 msgr2=0x7fcb28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb45000640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb28004800 0x7fcb28004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb45000640 1 -- 172.21.15.44:0/2899381726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb28003520 con 0x7fcb280039b0 2024-03-30T13:15:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb45a00640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb280051c0 0x7fcb2800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.679+0000 7fcb3fe00640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb28004800 0x7fcb28004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:15:57.687 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.680+0000 7fcb45a00640 1 -- 172.21.15.44:0/2899381726 reap_dead start 2024-03-30T13:15:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.681+0000 7fcb45000640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb280039b0 0x7fcb28003dd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400c240 tx=0x7fcb28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02272b28aaa478d server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.681+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34007cf0 con 0x7fcb280039b0 2024-03-30T13:15:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.682+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb34030070 con 0x7fcb280039b0 2024-03-30T13:15:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.682+0000 7fcb3f400640 1 -- 172.21.15.44:0/2899381726 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34005d70 con 0x7fcb280039b0 2024-03-30T13:15:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.682+0000 7fcb47a00640 1 -- 172.21.15.44:0/2899381726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb280039b0 msgr2=0x7fcb28003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.682+0000 7fcb47a00640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb280039b0 0x7fcb28003dd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400c240 tx=0x7fcb28005830 comp rx=0 tx=0).stop 2024-03-30T13:15:57.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.682+0000 7fcb47a00640 1 -- 172.21.15.44:0/2899381726 shutdown_connections 2024-03-30T13:15:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.682+0000 7fcb47a00640 1 --2- 172.21.15.44:0/2899381726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb280039b0 0x7fcb28003dd0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.682+0000 7fcb47a00640 1 -- 172.21.15.44:0/2899381726 >> 172.21.15.44:0/2899381726 conn(0x7fcb400b2e10 msgr2=0x7fcb400b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.682+0000 7fcb47a00640 1 -- 172.21.15.44:0/2899381726 shutdown_connections 2024-03-30T13:15:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.682+0000 7fcb47a00640 1 -- 172.21.15.44:0/2899381726 wait complete. 2024-03-30T13:15:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.684+0000 7fcb47a00640 1 Processor -- start 2024-03-30T13:15:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.684+0000 7fcb47a00640 1 -- start start 2024-03-30T13:15:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.685+0000 7fcb47a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb280039b0 0x7fcb4015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.685+0000 7fcb47a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb4015f8e0 0x7fcb4015fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.685+0000 7fcb47a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb4013d8e0 0x7fcb4013dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.685+0000 7fcb47a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcb401474b0 con 0x7fcb4013d8e0 2024-03-30T13:15:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.685+0000 7fcb47a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcb40073700 con 0x7fcb280039b0 2024-03-30T13:15:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.685+0000 7fcb47a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4013e710 con 0x7fcb4015f8e0 2024-03-30T13:15:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.686+0000 7fcb45a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb4013d8e0 0x7fcb4013dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.686+0000 7fcb45a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb4013d8e0 0x7fcb4013dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51670/0 (socket says 172.21.15.44:51670) 2024-03-30T13:15:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.686+0000 7fcb45a00640 1 -- 172.21.15.44:0/2616065147 learned_addr learned my addr 172.21.15.44:0/2616065147 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.686+0000 7fcb45000640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb280039b0 0x7fcb4015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.686+0000 7fcb3fe00640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb4015f8e0 0x7fcb4015fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.686+0000 7fcb45a00640 1 -- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb4015f8e0 msgr2=0x7fcb4015fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.686+0000 7fcb45a00640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb4015f8e0 0x7fcb4015fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.686+0000 7fcb45a00640 1 -- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb280039b0 msgr2=0x7fcb4015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.686+0000 7fcb45a00640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb280039b0 0x7fcb4015ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.686+0000 7fcb45a00640 1 -- 172.21.15.44:0/2616065147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4013e9f0 con 0x7fcb4013d8e0 2024-03-30T13:15:57.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.687+0000 7fcb45a00640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb4013d8e0 0x7fcb4013dd60 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fcb400b5e40 tx=0x7fcb3800d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:57.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.687+0000 7fcb3cc00640 1 -- 172.21.15.44:0/2616065147 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38018070 con 0x7fcb4013d8e0 2024-03-30T13:15:57.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.687+0000 7fcb3cc00640 1 -- 172.21.15.44:0/2616065147 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb38003da0 con 0x7fcb4013d8e0 2024-03-30T13:15:57.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.687+0000 7fcb3cc00640 1 -- 172.21.15.44:0/2616065147 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38005310 con 0x7fcb4013d8e0 2024-03-30T13:15:57.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.687+0000 7fcb47a00640 1 -- 172.21.15.44:0/2616065147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4013ecd0 con 0x7fcb4013d8e0 2024-03-30T13:15:57.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.687+0000 7fcb47a00640 1 -- 172.21.15.44:0/2616065147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4015e410 con 0x7fcb4013d8e0 2024-03-30T13:15:57.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.688+0000 7fcb47a00640 1 -- 172.21.15.44:0/2616065147 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb40075a10 con 0x7fcb4013d8e0 2024-03-30T13:15:57.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.689+0000 7fcb3cc00640 1 -- 172.21.15.44:0/2616065147 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcb3801b070 con 0x7fcb4013d8e0 2024-03-30T13:15:57.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.690+0000 7fcb3cc00640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcb2006c530 0x7fcb2006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:57.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.691+0000 7fcb3cc00640 1 -- 172.21.15.44:0/2616065147 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fcb3808ac50 con 0x7fcb4013d8e0 2024-03-30T13:15:57.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.691+0000 7fcb45000640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcb2006c530 0x7fcb2006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:57.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.692+0000 7fcb45000640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcb2006c530 0x7fcb2006e9f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcb34034000 tx=0x7fcb34007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:57.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.696+0000 7fcb3cc00640 1 -- 172.21.15.44:0/2616065147 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fcb38090020 con 0x7fcb4013d8e0 2024-03-30T13:15:57.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.896+0000 7fcb47a00640 1 -- 172.21.15.44:0/2616065147 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb40072d40 con 0x7fcb2006c530 2024-03-30T13:15:57.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.898+0000 7fcb3cc00640 1 -- 172.21.15.44:0/2616065147 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13564 (secure 0 0 0) 0x7fcb40072d40 con 0x7fcb2006c530 2024-03-30T13:15:57.903 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:57.903 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:15:57.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.901+0000 7fcb47a00640 1 -- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcb2006c530 msgr2=0x7fcb2006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.901+0000 7fcb47a00640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcb2006c530 0x7fcb2006e9f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcb34034000 tx=0x7fcb34007000 comp rx=0 tx=0).stop 2024-03-30T13:15:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.901+0000 7fcb47a00640 1 -- 172.21.15.44:0/2616065147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb4013d8e0 msgr2=0x7fcb4013dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.901+0000 7fcb47a00640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb4013d8e0 0x7fcb4013dd60 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fcb400b5e40 tx=0x7fcb3800d920 comp rx=0 tx=0).stop 2024-03-30T13:15:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.901+0000 7fcb47a00640 1 -- 172.21.15.44:0/2616065147 shutdown_connections 2024-03-30T13:15:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.901+0000 7fcb47a00640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcb4013d8e0 0x7fcb4013dd60 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.901+0000 7fcb47a00640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb4015f8e0 0x7fcb4015fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.901+0000 7fcb47a00640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcb2006c530 0x7fcb2006e9f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.901+0000 7fcb47a00640 1 --2- 172.21.15.44:0/2616065147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb280039b0 0x7fcb4015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:57.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.901+0000 7fcb47a00640 1 -- 172.21.15.44:0/2616065147 >> 172.21.15.44:0/2616065147 conn(0x7fcb400b2e10 msgr2=0x7fcb40160a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:57.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.901+0000 7fcb47a00640 1 -- 172.21.15.44:0/2616065147 shutdown_connections 2024-03-30T13:15:57.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:57.901+0000 7fcb47a00640 1 -- 172.21.15.44:0/2616065147 wait complete. 2024-03-30T13:15:57.922 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-03-30T13:15:56.049725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":594336,"kb_used_data":349052,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754380384,"statfs":{"total":773094113280,"available":772485513216,"internally_reserved":0,"allocated":357429248,"data_stored":354592150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-177582274,"num_objects":-139,"num_object_clones":0,"num_object_copies":-278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-139,"num_whiteouts":0,"num_read":-200,"num_read_kb":-168594,"num_write":-928,"num_write_kb":-176242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002221"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":222,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-30T13:15:52.801417+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:15:52.801417+0000","last_peered":"2024-03-30T13:15:52.801417+0000","last_clean":"2024-03-30T13:15:52.801417+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:15:52.801417+0000","last_undegraded":"2024-03-30T13:15:52.801417+0000","last_fullsized":"2024-03-30T13:15:52.801417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94100,"kb_used_data":62920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94277740,"statfs":{"total":96636764160,"available":96540405760,"internally_reserved":0,"allocated":64430080,"data_stored":64063681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69344,"kb_used_data":42324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94302496,"statfs":{"total":96636764160,"available":96565755904,"internally_reserved":0,"allocated":43339776,"data_stored":43004191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509495,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":101888,"kb_used_data":70708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94269952,"statfs":{"total":96636764160,"available":96532430848,"internally_reserved":0,"allocated":72404992,"data_stored":72036579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509495,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48452,"kb_used_data":17268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323388,"statfs":{"total":96636764160,"available":96587149312,"internally_reserved":0,"allocated":17682432,"data_stored":17341075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89460,"kb_used_data":58280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94282380,"statfs":{"total":96636764160,"available":96545157120,"internally_reserved":0,"allocated":59678720,"data_stored":59303430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44420,"kb_used_data":13240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327420,"statfs":{"total":96636764160,"available":96591278080,"internally_reserved":0,"allocated":13557760,"data_stored":13210173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509494,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65368,"kb_used_data":34188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94306472,"statfs":{"total":96636764160,"available":96569827328,"internally_reserved":0,"allocated":35008512,"data_stored":34654533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542199,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81304,"kb_used_data":50124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94290536,"statfs":{"total":96636764160,"available":96553508864,"internally_reserved":0,"allocated":51326976,"data_stored":50978488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:15:57.923 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-30T13:15:58.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.115+0000 7f2707200640 1 Processor -- start 2024-03-30T13:15:58.119 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.115+0000 7f2707200640 1 -- start start 2024-03-30T13:15:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.116+0000 7f2707200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2700145c60 0x7f2700071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.117+0000 7f2707200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2700160830 0x7f27000ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.117+0000 7f2707200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2700146040 con 0x7f2700071a60 2024-03-30T13:15:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.117+0000 7f2707200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f2700071ed0 con 0x7f2700145c60 2024-03-30T13:15:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.117+0000 7f2707200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f2700160e50 con 0x7f2700160830 2024-03-30T13:15:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.117+0000 7f26ff400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f2700071a60 0x7f2700160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46892/0 (socket says 172.21.15.44:46892) 2024-03-30T13:15:58.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.117+0000 7f26ffe00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f2700145c60 0x7f2700071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:58.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.117+0000 7f26ff400640 1 -- 172.21.15.44:0/2718597238 learned_addr learned my addr 172.21.15.44:0/2718597238 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:58.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.117+0000 7f2705200640 1 --2- 172.21.15.44:0/2718597238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2700160830 0x7f27000ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:58.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.118+0000 7f26ffe00640 1 -- 172.21.15.44:0/2718597238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2700160830 msgr2=0x7f27000ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:58.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.118+0000 7f26ffe00640 1 --2- 172.21.15.44:0/2718597238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2700160830 0x7f27000ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:58.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.118+0000 7f26ffe00640 1 -- 172.21.15.44:0/2718597238 >> v1:172.21.15.44:6789/0 conn(0x7f2700071a60 legacy=0x7f2700160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:58.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.118+0000 7f26ffe00640 1 -- 172.21.15.44:0/2718597238 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270015d8b0 con 0x7f2700145c60 2024-03-30T13:15:58.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.118+0000 7f26fea00640 1 -- 172.21.15.44:0/2718597238 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778411274 0 0) 0x7f2700146040 con 0x7f2700071a60 2024-03-30T13:15:58.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.119+0000 7f26ffe00640 1 --2- 172.21.15.44:0/2718597238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2700145c60 0x7f2700071520 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f26e80097a0 tx=0x7f26e802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe1b6014f642ed8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:58.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.119+0000 7f26fea00640 1 -- 172.21.15.44:0/2718597238 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e80315a0 con 0x7f2700145c60 2024-03-30T13:15:58.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.119+0000 7f26fea00640 1 -- 172.21.15.44:0/2718597238 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e8037070 con 0x7f2700145c60 2024-03-30T13:15:58.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.119+0000 7f26fea00640 1 -- 172.21.15.44:0/2718597238 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8031960 con 0x7f2700145c60 2024-03-30T13:15:58.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.120+0000 7f2707200640 1 -- 172.21.15.44:0/2718597238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2700145c60 msgr2=0x7f2700071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:58.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.120+0000 7f2707200640 1 --2- 172.21.15.44:0/2718597238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2700145c60 0x7f2700071520 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f26e80097a0 tx=0x7f26e802b840 comp rx=0 tx=0).stop 2024-03-30T13:15:58.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.120+0000 7f2707200640 1 -- 172.21.15.44:0/2718597238 shutdown_connections 2024-03-30T13:15:58.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.120+0000 7f2707200640 1 --2- 172.21.15.44:0/2718597238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2700160830 0x7f27000ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:58.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.120+0000 7f2707200640 1 --2- 172.21.15.44:0/2718597238 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2700145c60 0x7f2700071520 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:58.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.120+0000 7f2707200640 1 -- 172.21.15.44:0/2718597238 >> 172.21.15.44:0/2718597238 conn(0x7f27000b1c90 msgr2=0x7f27000b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:58.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.120+0000 7f2707200640 1 -- 172.21.15.44:0/2718597238 shutdown_connections 2024-03-30T13:15:58.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.120+0000 7f2707200640 1 -- 172.21.15.44:0/2718597238 wait complete. 2024-03-30T13:15:58.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.121+0000 7f2707200640 1 Processor -- start 2024-03-30T13:15:58.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.122+0000 7f2707200640 1 -- start start 2024-03-30T13:15:58.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2707200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700071a60 0x7f270015bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:58.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2707200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2700145c60 0x7f27001f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:58.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2707200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2700160830 0x7f27000b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:58.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2707200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f270015d0b0 con 0x7f2700160830 2024-03-30T13:15:58.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2707200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f270015cdd0 con 0x7f2700071a60 2024-03-30T13:15:58.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2707200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f27000cad70 con 0x7f2700145c60 2024-03-30T13:15:58.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2705200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2700160830 0x7f27000b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:58.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2705200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2700160830 0x7f27000b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51692/0 (socket says 172.21.15.44:51692) 2024-03-30T13:15:58.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2705200640 1 -- 172.21.15.44:0/1344021734 learned_addr learned my addr 172.21.15.44:0/1344021734 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:58.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2705200640 1 -- 172.21.15.44:0/1344021734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2700145c60 msgr2=0x7f27001f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:58.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2705200640 1 --2- 172.21.15.44:0/1344021734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2700145c60 0x7f27001f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:58.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2705200640 1 -- 172.21.15.44:0/1344021734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700071a60 msgr2=0x7f270015bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:58.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2705200640 1 --2- 172.21.15.44:0/1344021734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700071a60 0x7f270015bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:58.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.123+0000 7f2705200640 1 -- 172.21.15.44:0/1344021734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27000b4640 con 0x7f2700160830 2024-03-30T13:15:58.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.124+0000 7f2705200640 1 --2- 172.21.15.44:0/1344021734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2700160830 0x7f27000b4100 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f26f800d5d0 tx=0x7f26f800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:58.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.124+0000 7f26f7e00640 1 -- 172.21.15.44:0/1344021734 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f80125f0 con 0x7f2700160830 2024-03-30T13:15:58.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.124+0000 7f26f7e00640 1 -- 172.21.15.44:0/1344021734 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f8019070 con 0x7f2700160830 2024-03-30T13:15:58.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.124+0000 7f26f7e00640 1 -- 172.21.15.44:0/1344021734 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f80129f0 con 0x7f2700160830 2024-03-30T13:15:58.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.124+0000 7f2707200640 1 -- 172.21.15.44:0/1344021734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27001f4a70 con 0x7f2700160830 2024-03-30T13:15:58.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.124+0000 7f2707200640 1 -- 172.21.15.44:0/1344021734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27001f5030 con 0x7f2700160830 2024-03-30T13:15:58.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.125+0000 7f2707200640 1 -- 172.21.15.44:0/1344021734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2700075a10 con 0x7f2700160830 2024-03-30T13:15:58.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.126+0000 7f26f7e00640 1 -- 172.21.15.44:0/1344021734 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f26f8012b90 con 0x7f2700160830 2024-03-30T13:15:58.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.127+0000 7f26f7e00640 1 --2- 172.21.15.44:0/1344021734 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f26dc06c530 0x7f26dc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:58.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.127+0000 7f26f7e00640 1 -- 172.21.15.44:0/1344021734 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f26f808b9f0 con 0x7f2700160830 2024-03-30T13:15:58.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.128+0000 7f26ffe00640 1 --2- 172.21.15.44:0/1344021734 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f26dc06c530 0x7f26dc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:58.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.129+0000 7f26ffe00640 1 --2- 172.21.15.44:0/1344021734 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f26dc06c530 0x7f26dc06e9f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f26e8036000 tx=0x7f26e8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:58.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.131+0000 7f26f7e00640 1 -- 172.21.15.44:0/1344021734 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f27000b4640 con 0x7f2700160830 2024-03-30T13:15:58.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.330+0000 7f2707200640 1 -- 172.21.15.44:0/1344021734 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27000ca610 con 0x7f2700160830 2024-03-30T13:15:58.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.331+0000 7f26f7e00640 1 -- 172.21.15.44:0/1344021734 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+13267 (secure 0 0 0) 0x7f26f805a0f0 con 0x7f2700160830 2024-03-30T13:15:58.335 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:15:58.336 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":49,"fsid":"cf82a1f9-ad5a-4657-adf6-b77304ed0e9d","created":"2024-03-30T13:11:20.633198+0000","modified":"2024-03-30T13:15:53.790700+0000","last_up_change":"2024-03-30T13:11:32.802509+0000","last_in_change":"2024-03-30T13:11:24.142223+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-30T13:11:33.983851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e9f254c5-2916-435c-a929-73eb57610678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6809","nonce":117092933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6811","nonce":117092933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6815","nonce":117092933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":117092933},{"type":"v1","addr":"172.21.15.44:6813","nonce":117092933}]},"public_addr":"172.21.15.44:6809/117092933","cluster_addr":"172.21.15.44:6811/117092933","heartbeat_back_addr":"172.21.15.44:6815/117092933","heartbeat_front_addr":"172.21.15.44:6813/117092933","state":["exists","up"]},{"osd":1,"uuid":"a7ff4d09-d3c6-40ac-ad39-7ea908769472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6801","nonce":1186302707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6803","nonce":1186302707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6807","nonce":1186302707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":1186302707},{"type":"v1","addr":"172.21.15.44:6805","nonce":1186302707}]},"public_addr":"172.21.15.44:6801/1186302707","cluster_addr":"172.21.15.44:6803/1186302707","heartbeat_back_addr":"172.21.15.44:6807/1186302707","heartbeat_front_addr":"172.21.15.44:6805/1186302707","state":["exists","up"]},{"osd":2,"uuid":"43dcea44-7a40-413e-a4c1-c868380d33db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6817","nonce":3473014849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6819","nonce":3473014849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6823","nonce":3473014849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":3473014849},{"type":"v1","addr":"172.21.15.44:6821","nonce":3473014849}]},"public_addr":"172.21.15.44:6817/3473014849","cluster_addr":"172.21.15.44:6819/3473014849","heartbeat_back_addr":"172.21.15.44:6823/3473014849","heartbeat_front_addr":"172.21.15.44:6821/3473014849","state":["exists","up"]},{"osd":3,"uuid":"f7f4027e-1888-4c9b-a4a9-4ddd9b59c6bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6825","nonce":667769912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6827","nonce":667769912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6831","nonce":667769912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":667769912},{"type":"v1","addr":"172.21.15.44:6829","nonce":667769912}]},"public_addr":"172.21.15.44:6825/667769912","cluster_addr":"172.21.15.44:6827/667769912","heartbeat_back_addr":"172.21.15.44:6831/667769912","heartbeat_front_addr":"172.21.15.44:6829/667769912","state":["exists","up"]},{"osd":4,"uuid":"2fc37687-1849-4792-91b2-c58ea87d3506","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6817","nonce":1952435005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6819","nonce":1952435005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6823","nonce":1952435005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1952435005},{"type":"v1","addr":"172.21.15.151:6821","nonce":1952435005}]},"public_addr":"172.21.15.151:6817/1952435005","cluster_addr":"172.21.15.151:6819/1952435005","heartbeat_back_addr":"172.21.15.151:6823/1952435005","heartbeat_front_addr":"172.21.15.151:6821/1952435005","state":["exists","up"]},{"osd":5,"uuid":"ee034798-2fd8-4dbc-a713-55f1a16bb98e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6801","nonce":3241621332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6803","nonce":3241621332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6807","nonce":3241621332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3241621332},{"type":"v1","addr":"172.21.15.151:6805","nonce":3241621332}]},"public_addr":"172.21.15.151:6801/3241621332","cluster_addr":"172.21.15.151:6803/3241621332","heartbeat_back_addr":"172.21.15.151:6807/3241621332","heartbeat_front_addr":"172.21.15.151:6805/3241621332","state":["exists","up"]},{"osd":6,"uuid":"22a50a18-c452-4c7e-95ad-431ec30864f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6825","nonce":3023883464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6827","nonce":3023883464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6831","nonce":3023883464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3023883464},{"type":"v1","addr":"172.21.15.151:6829","nonce":3023883464}]},"public_addr":"172.21.15.151:6825/3023883464","cluster_addr":"172.21.15.151:6827/3023883464","heartbeat_back_addr":"172.21.15.151:6831/3023883464","heartbeat_front_addr":"172.21.15.151:6829/3023883464","state":["exists","up"]},{"osd":7,"uuid":"1b3f2117-76b0-4720-ad67-b765e5e10603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6809","nonce":684556134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6811","nonce":684556134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6815","nonce":684556134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":684556134},{"type":"v1","addr":"172.21.15.151:6813","nonce":684556134}]},"public_addr":"172.21.15.151:6809/684556134","cluster_addr":"172.21.15.151:6811/684556134","heartbeat_back_addr":"172.21.15.151:6815/684556134","heartbeat_front_addr":"172.21.15.151:6813/684556134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.749084+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.664160+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.510559+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.744887+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.729125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.372900+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.453243+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-30T13:11:29.439354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6835/585602782":"2024-03-31T13:15:50.652246+0000","172.21.15.44:6834/585602782":"2024-03-31T13:15:50.652246+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-30T13:15:58.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.334+0000 7f2707200640 1 -- 172.21.15.44:0/1344021734 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f26dc06c530 msgr2=0x7f26dc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:58.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.334+0000 7f2707200640 1 --2- 172.21.15.44:0/1344021734 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f26dc06c530 0x7f26dc06e9f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f26e8036000 tx=0x7f26e8030000 comp rx=0 tx=0).stop 2024-03-30T13:15:58.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.334+0000 7f2707200640 1 -- 172.21.15.44:0/1344021734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2700160830 msgr2=0x7f27000b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:58.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.334+0000 7f2707200640 1 --2- 172.21.15.44:0/1344021734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2700160830 0x7f27000b4100 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f26f800d5d0 tx=0x7f26f800da90 comp rx=0 tx=0).stop 2024-03-30T13:15:58.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.334+0000 7f2707200640 1 -- 172.21.15.44:0/1344021734 shutdown_connections 2024-03-30T13:15:58.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.334+0000 7f2707200640 1 --2- 172.21.15.44:0/1344021734 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2700160830 0x7f27000b4100 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:58.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.334+0000 7f2707200640 1 --2- 172.21.15.44:0/1344021734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2700145c60 0x7f27001f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:58.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.334+0000 7f2707200640 1 --2- 172.21.15.44:0/1344021734 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f26dc06c530 0x7f26dc06e9f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:58.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.334+0000 7f2707200640 1 --2- 172.21.15.44:0/1344021734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2700071a60 0x7f270015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:58.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.334+0000 7f2707200640 1 -- 172.21.15.44:0/1344021734 >> 172.21.15.44:0/1344021734 conn(0x7f27000b1c90 msgr2=0x7f27000afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:58.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.334+0000 7f2707200640 1 -- 172.21.15.44:0/1344021734 shutdown_connections 2024-03-30T13:15:58.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:58.334+0000 7f2707200640 1 -- 172.21.15.44:0/1344021734 wait complete. 2024-03-30T13:15:59.355 INFO:tasks.ceph:Scrubbing osd.0 2024-03-30T13:15:59.356 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:15:59.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.590+0000 7fe877e00640 1 Processor -- start 2024-03-30T13:15:59.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.590+0000 7fe877e00640 1 -- start start 2024-03-30T13:15:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.591+0000 7fe877e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8781448f0 0x7fe87806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.591+0000 7fe877e00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8780b43a0 con 0x7fe8780b34e0 2024-03-30T13:15:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.591+0000 7fe877e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe878144cd0 con 0x7fe87806eb30 2024-03-30T13:15:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.592+0000 7fe877e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe87806ef90 con 0x7fe8781448f0 2024-03-30T13:15:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.592+0000 7fe877400640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fe8780b34e0 0x7fe8780cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46904/0 (socket says 172.21.15.44:46904) 2024-03-30T13:15:59.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.592+0000 7fe877400640 1 -- 172.21.15.44:0/1506134211 learned_addr learned my addr 172.21.15.44:0/1506134211 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:59.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.592+0000 7fe876a00640 1 --2- 172.21.15.44:0/1506134211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8781448f0 0x7fe87806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3929838897 0 0) 0x7fe8780b43a0 con 0x7fe8780b34e0 2024-03-30T13:15:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe85c003520 con 0x7fe8780b34e0 2024-03-30T13:15:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 250984987 0 0) 0x7fe85c003520 con 0x7fe8780b34e0 2024-03-30T13:15:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8781448f0 msgr2=0x7fe87806e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 --2- 172.21.15.44:0/1506134211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8781448f0 0x7fe87806e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 >> v1:172.21.15.151:6789/0 conn(0x7fe87806eb30 legacy=0x7fe8780b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8780b3b00 con 0x7fe8780b34e0 2024-03-30T13:15:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7fe8700019f0 con 0x7fe8780b34e0 2024-03-30T13:15:59.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 >> v1:172.21.15.44:6789/0 conn(0x7fe8780b34e0 legacy=0x7fe8780cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:59.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 --2- 172.21.15.44:0/1506134211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe85c0039e0 0x7fe85c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 --2- 172.21.15.44:0/1506134211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe85c004800 0x7fe85c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 --2- 172.21.15.44:0/1506134211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8781448f0 0x7fe85c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c00dc80 con 0x7fe85c004800 2024-03-30T13:15:59.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c00de00 con 0x7fe85c0039e0 2024-03-30T13:15:59.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.593+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe85c00e000 con 0x7fe8781448f0 2024-03-30T13:15:59.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.594+0000 7fe86e000640 1 --2- 172.21.15.44:0/1506134211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe85c004800 0x7fe85c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.594+0000 7fe876a00640 1 --2- 172.21.15.44:0/1506134211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe85c0039e0 0x7fe85c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.594+0000 7fe877400640 1 --2- 172.21.15.44:0/1506134211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8781448f0 0x7fe85c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.594+0000 7fe86e000640 1 -- 172.21.15.44:0/1506134211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8781448f0 msgr2=0x7fe85c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:59.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.594+0000 7fe86e000640 1 --2- 172.21.15.44:0/1506134211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8781448f0 0x7fe85c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.594+0000 7fe86e000640 1 -- 172.21.15.44:0/1506134211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe85c0039e0 msgr2=0x7fe85c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:59.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.594+0000 7fe86e000640 1 --2- 172.21.15.44:0/1506134211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe85c0039e0 0x7fe85c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.594+0000 7fe86e000640 1 -- 172.21.15.44:0/1506134211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c003520 con 0x7fe85c004800 2024-03-30T13:15:59.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.595+0000 7fe86e000640 1 --2- 172.21.15.44:0/1506134211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe85c004800 0x7fe85c004c80 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fe860001720 tx=0x7fe85c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5271badc87803467 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:59.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.595+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860001370 con 0x7fe85c004800 2024-03-30T13:15:59.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.595+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8600052d0 con 0x7fe85c004800 2024-03-30T13:15:59.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.595+0000 7fe876000640 1 -- 172.21.15.44:0/1506134211 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe860003830 con 0x7fe85c004800 2024-03-30T13:15:59.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.596+0000 7fe877e00640 1 -- 172.21.15.44:0/1506134211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe85c004800 msgr2=0x7fe85c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:59.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.596+0000 7fe877e00640 1 --2- 172.21.15.44:0/1506134211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe85c004800 0x7fe85c004c80 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fe860001720 tx=0x7fe85c005830 comp rx=0 tx=0).stop 2024-03-30T13:15:59.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.596+0000 7fe877400640 1 -- 172.21.15.44:0/1506134211 reap_dead start 2024-03-30T13:15:59.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.596+0000 7fe877e00640 1 -- 172.21.15.44:0/1506134211 shutdown_connections 2024-03-30T13:15:59.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.596+0000 7fe877e00640 1 -- 172.21.15.44:0/1506134211 >> 172.21.15.44:0/1506134211 conn(0x7fe87806b9a0 msgr2=0x7fe87806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:59.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.596+0000 7fe877e00640 1 -- 172.21.15.44:0/1506134211 shutdown_connections 2024-03-30T13:15:59.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.596+0000 7fe877e00640 1 -- 172.21.15.44:0/1506134211 wait complete. 2024-03-30T13:15:59.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.598+0000 7fe877e00640 1 Processor -- start 2024-03-30T13:15:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.598+0000 7fe877e00640 1 -- start start 2024-03-30T13:15:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.599+0000 7fe877e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe85c004800 0x7fe87815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.599+0000 7fe877e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8781e51a0 0x7fe8781e3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.599+0000 7fe877e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8781e3ad0 0x7fe87806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.599+0000 7fe877e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe8780ce310 con 0x7fe85c004800 2024-03-30T13:15:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.599+0000 7fe877e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe8780b40c0 con 0x7fe8781e3ad0 2024-03-30T13:15:59.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.599+0000 7fe877e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe8780ce490 con 0x7fe8781e51a0 2024-03-30T13:15:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.599+0000 7fe876a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe85c004800 0x7fe87815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.599+0000 7fe876a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe85c004800 0x7fe87815a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51712/0 (socket says 172.21.15.44:51712) 2024-03-30T13:15:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.599+0000 7fe876a00640 1 -- 172.21.15.44:0/559218739 learned_addr learned my addr 172.21.15.44:0/559218739 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.600+0000 7fe86e000640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8781e51a0 0x7fe8781e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.600+0000 7fe877400640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8781e3ad0 0x7fe87806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.600+0000 7fe876a00640 1 -- 172.21.15.44:0/559218739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8781e51a0 msgr2=0x7fe8781e3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.600+0000 7fe876a00640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8781e51a0 0x7fe8781e3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.600+0000 7fe876a00640 1 -- 172.21.15.44:0/559218739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8781e3ad0 msgr2=0x7fe87806d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:59.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.600+0000 7fe876a00640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8781e3ad0 0x7fe87806d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.600+0000 7fe876a00640 1 -- 172.21.15.44:0/559218739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87815d6e0 con 0x7fe85c004800 2024-03-30T13:15:59.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.600+0000 7fe876a00640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe85c004800 0x7fe87815a720 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fe868011630 tx=0x7fe868011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:59.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.600+0000 7fe86f400640 1 -- 172.21.15.44:0/559218739 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86800f920 con 0x7fe85c004800 2024-03-30T13:15:59.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.601+0000 7fe86f400640 1 -- 172.21.15.44:0/559218739 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe86800fac0 con 0x7fe85c004800 2024-03-30T13:15:59.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.601+0000 7fe86f400640 1 -- 172.21.15.44:0/559218739 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86800fe70 con 0x7fe85c004800 2024-03-30T13:15:59.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.601+0000 7fe877e00640 1 -- 172.21.15.44:0/559218739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8781e4100 con 0x7fe85c004800 2024-03-30T13:15:59.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.601+0000 7fe877e00640 1 -- 172.21.15.44:0/559218739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8781e46c0 con 0x7fe85c004800 2024-03-30T13:15:59.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.602+0000 7fe877e00640 1 -- 172.21.15.44:0/559218739 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8781e4d70 con 0x7fe85c004800 2024-03-30T13:15:59.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.603+0000 7fe86f400640 1 -- 172.21.15.44:0/559218739 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe868015460 con 0x7fe85c004800 2024-03-30T13:15:59.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.605+0000 7fe86f400640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe85406c560 0x7fe85406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.605+0000 7fe86f400640 1 -- 172.21.15.44:0/559218739 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fe86808bc00 con 0x7fe85c004800 2024-03-30T13:15:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.605+0000 7fe86f400640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] conn(0x7fe854072a00 0x7fe854074e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.605+0000 7fe86f400640 1 -- 172.21.15.44:0/559218739 --> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe854075510 con 0x7fe854072a00 2024-03-30T13:15:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.605+0000 7fe86f400640 1 -- 172.21.15.44:0/559218739 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fe868092050 con 0x7fe85c004800 2024-03-30T13:15:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.605+0000 7fe86e000640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe85406c560 0x7fe85406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.605+0000 7fe877400640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] conn(0x7fe854072a00 0x7fe854074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.606+0000 7fe877400640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] conn(0x7fe854072a00 0x7fe854074e40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.606+0000 7fe86e000640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe85406c560 0x7fe85406ea20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe860033000 tx=0x7fe860009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:59.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.607+0000 7fe86f400640 1 -- 172.21.15.44:0/559218739 <== osd.0 v2:172.21.15.44:6808/117092933 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe854075510 con 0x7fe854072a00 2024-03-30T13:15:59.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.621+0000 7fe877e00640 1 -- 172.21.15.44:0/559218739 --> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe878075890 con 0x7fe854072a00 2024-03-30T13:15:59.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.621+0000 7fe86f400640 1 -- 172.21.15.44:0/559218739 <== osd.0 v2:172.21.15.44:6808/117092933 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe878075890 con 0x7fe854072a00 2024-03-30T13:15:59.626 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:15:59.626 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:15:59.626 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:15:59.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.622+0000 7fe877e00640 1 -- 172.21.15.44:0/559218739 >> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] conn(0x7fe854072a00 msgr2=0x7fe854074e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:59.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.622+0000 7fe877e00640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.44:6808/117092933,v1:172.21.15.44:6809/117092933] conn(0x7fe854072a00 0x7fe854074e40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.622+0000 7fe877e00640 1 -- 172.21.15.44:0/559218739 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe85406c560 msgr2=0x7fe85406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:59.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.622+0000 7fe877e00640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe85406c560 0x7fe85406ea20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe860033000 tx=0x7fe860009030 comp rx=0 tx=0).stop 2024-03-30T13:15:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.622+0000 7fe877e00640 1 -- 172.21.15.44:0/559218739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe85c004800 msgr2=0x7fe87815a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.622+0000 7fe877e00640 1 --2- 172.21.15.44:0/559218739 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe85c004800 0x7fe87815a720 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fe868011630 tx=0x7fe868011af0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.622+0000 7fe877400640 1 -- 172.21.15.44:0/559218739 reap_dead start 2024-03-30T13:15:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.622+0000 7fe877e00640 1 -- 172.21.15.44:0/559218739 shutdown_connections 2024-03-30T13:15:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.622+0000 7fe877e00640 1 -- 172.21.15.44:0/559218739 >> 172.21.15.44:0/559218739 conn(0x7fe87806b9a0 msgr2=0x7fe87806e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.622+0000 7fe877e00640 1 -- 172.21.15.44:0/559218739 shutdown_connections 2024-03-30T13:15:59.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.622+0000 7fe877e00640 1 -- 172.21.15.44:0/559218739 wait complete. 2024-03-30T13:15:59.645 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-30T13:15:59.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.857+0000 7f670a000640 1 Processor -- start 2024-03-30T13:15:59.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.857+0000 7f670a000640 1 -- start start 2024-03-30T13:15:59.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.858+0000 7f670a000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670415fba0 0x7f6704071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.858+0000 7f670a000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f67040cca60 0x7f67040ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.859+0000 7f670a000640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6704071fe0 con 0x7f6704160a80 2024-03-30T13:15:59.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.859+0000 7f670a000640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f6704071a20 con 0x7f67040cca60 2024-03-30T13:15:59.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.859+0000 7f670a000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6704071d00 con 0x7f670415fba0 2024-03-30T13:15:59.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.859+0000 7f6702a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f6704160a80 0x7f67040cb3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46906/0 (socket says 172.21.15.44:46906) 2024-03-30T13:15:59.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.859+0000 7f6702a00640 1 -- 172.21.15.44:0/2581769466 learned_addr learned my addr 172.21.15.44:0/2581769466 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:15:59.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.859+0000 7f6703e00640 1 --2- 172.21.15.44:0/2581769466 >> v2:172.21.15.151:3300/0 conn(0x7f67040cca60 0x7f67040ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.859+0000 7f6703400640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670415fba0 0x7f6704071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.859+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2650884043 0 0) 0x7f6704071fe0 con 0x7f6704160a80 2024-03-30T13:15:59.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66e8003520 con 0x7f6704160a80 2024-03-30T13:15:59.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 997690410 0 0) 0x7f66e8003520 con 0x7f6704160a80 2024-03-30T13:15:59.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670415fba0 msgr2=0x7f6704071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:59.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670415fba0 0x7f6704071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 >> v2:172.21.15.151:3300/0 conn(0x7f67040cca60 msgr2=0x7f67040ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:59.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 --2- 172.21.15.44:0/2581769466 >> v2:172.21.15.151:3300/0 conn(0x7f67040cca60 0x7f67040ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67040cabf0 con 0x7f6704160a80 2024-03-30T13:15:59.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f66f0001670 con 0x7f6704160a80 2024-03-30T13:15:59.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6703400640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670415fba0 0x7f6704071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:59.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 >> v1:172.21.15.44:6789/0 conn(0x7f6704160a80 legacy=0x7f67040cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:59.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66e80039b0 0x7f66e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670415fba0 0x7f66e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66e8004d40 0x7f66e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6704071a20 con 0x7f66e8004d40 2024-03-30T13:15:59.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6704071d00 con 0x7f66e80039b0 2024-03-30T13:15:59.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f66e800ba70 con 0x7f670415fba0 2024-03-30T13:15:59.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.860+0000 7f6703e00640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66e8004d40 0x7f66e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.861+0000 7f6703400640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66e80039b0 0x7f66e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.861+0000 7f6702a00640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670415fba0 0x7f66e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.861+0000 7f6703e00640 1 -- 172.21.15.44:0/2581769466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670415fba0 msgr2=0x7f66e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:59.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.861+0000 7f6703e00640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670415fba0 0x7f66e8004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.861+0000 7f6703e00640 1 -- 172.21.15.44:0/2581769466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66e80039b0 msgr2=0x7f66e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:15:59.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.861+0000 7f6703e00640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66e80039b0 0x7f66e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.861+0000 7f6703e00640 1 -- 172.21.15.44:0/2581769466 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e8003520 con 0x7f66e8004d40 2024-03-30T13:15:59.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.862+0000 7f6703e00640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66e8004d40 0x7f66e80051c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009f90 tx=0x7f66e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef4c33d52a99bbe server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:59.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.862+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc039070 con 0x7f66e8004d40 2024-03-30T13:15:59.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.862+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc02cc20 con 0x7f66e8004d40 2024-03-30T13:15:59.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.862+0000 7f6702000640 1 -- 172.21.15.44:0/2581769466 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc009c10 con 0x7f66e8004d40 2024-03-30T13:15:59.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.863+0000 7f670a000640 1 -- 172.21.15.44:0/2581769466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66e8004d40 msgr2=0x7f66e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:59.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.863+0000 7f670a000640 1 --2- 172.21.15.44:0/2581769466 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66e8004d40 0x7f66e80051c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009f90 tx=0x7f66e8005830 comp rx=0 tx=0).stop 2024-03-30T13:15:59.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.863+0000 7f6703e00640 1 -- 172.21.15.44:0/2581769466 reap_dead start 2024-03-30T13:15:59.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.863+0000 7f670a000640 1 -- 172.21.15.44:0/2581769466 shutdown_connections 2024-03-30T13:15:59.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.863+0000 7f670a000640 1 -- 172.21.15.44:0/2581769466 >> 172.21.15.44:0/2581769466 conn(0x7f670406d610 msgr2=0x7f670406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:15:59.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.863+0000 7f670a000640 1 -- 172.21.15.44:0/2581769466 shutdown_connections 2024-03-30T13:15:59.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.863+0000 7f670a000640 1 -- 172.21.15.44:0/2581769466 wait complete. 2024-03-30T13:15:59.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.865+0000 7f670a000640 1 Processor -- start 2024-03-30T13:15:59.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.865+0000 7f670a000640 1 -- start start 2024-03-30T13:15:59.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.866+0000 7f670a000640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66e8004d40 0x7f6704158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.866+0000 7f670a000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f670415cda0 0x7f6704145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.866+0000 7f670a000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6704155d80 0x7f6704156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.866+0000 7f670a000640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6704161060 con 0x7f670415cda0 2024-03-30T13:15:59.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.866+0000 7f670a000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6704160ee0 con 0x7f6704155d80 2024-03-30T13:15:59.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.866+0000 7f670a000640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f6704071440 con 0x7f66e8004d40 2024-03-30T13:15:59.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.867+0000 7f6702a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f670415cda0 0x7f6704145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.867+0000 7f6702a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f670415cda0 0x7f6704145210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51730/0 (socket says 172.21.15.44:51730) 2024-03-30T13:15:59.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.867+0000 7f6702a00640 1 -- 172.21.15.44:0/1361881871 learned_addr learned my addr 172.21.15.44:0/1361881871 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:15:59.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.867+0000 7f6703400640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66e8004d40 0x7f6704158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.867+0000 7f6703e00640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6704155d80 0x7f6704156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.867+0000 7f6702a00640 1 -- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66e8004d40 msgr2=0x7f6704158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:59.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.867+0000 7f6702a00640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66e8004d40 0x7f6704158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.867+0000 7f6702a00640 1 -- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6704155d80 msgr2=0x7f6704156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:15:59.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.867+0000 7f6702a00640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6704155d80 0x7f6704156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:15:59.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.867+0000 7f6702a00640 1 -- 172.21.15.44:0/1361881871 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670415d460 con 0x7f670415cda0 2024-03-30T13:15:59.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.867+0000 7f6703400640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66e8004d40 0x7f6704158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:15:59.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.867+0000 7f6702a00640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f670415cda0 0x7f6704145210 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f66f000d750 tx=0x7f66f000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:59.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.868+0000 7f66fb400640 1 -- 172.21.15.44:0/1361881871 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0019070 con 0x7f670415cda0 2024-03-30T13:15:59.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.868+0000 7f66fb400640 1 -- 172.21.15.44:0/1361881871 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f00074e0 con 0x7f670415cda0 2024-03-30T13:15:59.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.868+0000 7f670a000640 1 -- 172.21.15.44:0/1361881871 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670415d740 con 0x7f670415cda0 2024-03-30T13:15:59.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.868+0000 7f66fb400640 1 -- 172.21.15.44:0/1361881871 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f000de60 con 0x7f670415cda0 2024-03-30T13:15:59.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.868+0000 7f670a000640 1 -- 172.21.15.44:0/1361881871 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670415dd00 con 0x7f670415cda0 2024-03-30T13:15:59.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.869+0000 7f670a000640 1 -- 172.21.15.44:0/1361881871 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67040687f0 con 0x7f670415cda0 2024-03-30T13:15:59.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.870+0000 7f66fb400640 1 -- 172.21.15.44:0/1361881871 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f66f001c070 con 0x7f670415cda0 2024-03-30T13:15:59.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.871+0000 7f66fb400640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f66e406c560 0x7f66e406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:15:59.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.871+0000 7f66fb400640 1 -- 172.21.15.44:0/1361881871 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f66f008af80 con 0x7f670415cda0 2024-03-30T13:15:59.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.871+0000 7f6703400640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f66e406c560 0x7f66e406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:15:59.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.872+0000 7f6703400640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f66e406c560 0x7f66e406ea20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f66f4006fd0 tx=0x7f66f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:15:59.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:15:59.875+0000 7f66fb400640 1 -- 172.21.15.44:0/1361881871 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f67040687f0 con 0x7f670415cda0 2024-03-30T13:16:00.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.078+0000 7f670a000640 1 -- 172.21.15.44:0/1361881871 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f6704075900 con 0x7f66e406c560 2024-03-30T13:16:00.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.079+0000 7f66fb400640 1 -- 172.21.15.44:0/1361881871 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6704075900 con 0x7f66e406c560 2024-03-30T13:16:00.083 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 0 to deep-scrub 2024-03-30T13:16:00.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.082+0000 7f670a000640 1 -- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f66e406c560 msgr2=0x7f66e406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.082+0000 7f670a000640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f66e406c560 0x7f66e406ea20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f66f4006fd0 tx=0x7f66f4008040 comp rx=0 tx=0).stop 2024-03-30T13:16:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.082+0000 7f670a000640 1 -- 172.21.15.44:0/1361881871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f670415cda0 msgr2=0x7f6704145210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.082+0000 7f670a000640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f670415cda0 0x7f6704145210 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f66f000d750 tx=0x7f66f000dc10 comp rx=0 tx=0).stop 2024-03-30T13:16:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.082+0000 7f670a000640 1 -- 172.21.15.44:0/1361881871 shutdown_connections 2024-03-30T13:16:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.082+0000 7f670a000640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f66e406c560 0x7f66e406ea20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.082+0000 7f670a000640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6704155d80 0x7f6704156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.082+0000 7f670a000640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f670415cda0 0x7f6704145210 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.082+0000 7f670a000640 1 --2- 172.21.15.44:0/1361881871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66e8004d40 0x7f6704158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.082+0000 7f670a000640 1 -- 172.21.15.44:0/1361881871 >> 172.21.15.44:0/1361881871 conn(0x7f670406d610 msgr2=0x7f67040cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:00.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.082+0000 7f670a000640 1 -- 172.21.15.44:0/1361881871 shutdown_connections 2024-03-30T13:16:00.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.082+0000 7f670a000640 1 -- 172.21.15.44:0/1361881871 wait complete. 2024-03-30T13:16:00.106 INFO:tasks.ceph:Scrubbing osd.1 2024-03-30T13:16:00.106 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:16:00.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.329+0000 7fe815a00640 1 Processor -- start 2024-03-30T13:16:00.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.329+0000 7fe815a00640 1 -- start start 2024-03-30T13:16:00.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.331+0000 7fe815a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8100d01c0 0x7fe8100d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:00.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.331+0000 7fe815a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe8100ce690 0x7fe8100ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:00.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.331+0000 7fe815a00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81015c780 con 0x7fe81013f000 2024-03-30T13:16:00.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.331+0000 7fe815a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fe8100d0b40 con 0x7fe8100ce690 2024-03-30T13:16:00.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.331+0000 7fe815a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe81015ca60 con 0x7fe8100d01c0 2024-03-30T13:16:00.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.331+0000 7fe815000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe8100ce690 0x7fe8100ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:00.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.331+0000 7fe815000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fe8100ce690 0x7fe8100ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51734/0 (socket says 172.21.15.44:51734) 2024-03-30T13:16:00.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.331+0000 7fe815000640 1 -- 172.21.15.44:0/3789771077 learned_addr learned my addr 172.21.15.44:0/3789771077 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:00.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.332+0000 7fe80f400640 1 --2- 172.21.15.44:0/3789771077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8100d01c0 0x7fe8100d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:00.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.332+0000 7fe815000640 1 -- 172.21.15.44:0/3789771077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8100d01c0 msgr2=0x7fe8100d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:00.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.332+0000 7fe815000640 1 --2- 172.21.15.44:0/3789771077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8100d01c0 0x7fe8100d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.332+0000 7fe815000640 1 -- 172.21.15.44:0/3789771077 >> v1:172.21.15.151:6789/0 conn(0x7fe81013f000 legacy=0x7fe810141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:00.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.332+0000 7fe815000640 1 -- 172.21.15.44:0/3789771077 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81015cd40 con 0x7fe8100ce690 2024-03-30T13:16:00.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.333+0000 7fe815000640 1 --2- 172.21.15.44:0/3789771077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8100ce690 0x7fe8100ceac0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe808009870 tx=0x7fe80802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97752f5a3f1d6690 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:00.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.333+0000 7fe80ea00640 1 -- 172.21.15.44:0/3789771077 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808035020 con 0x7fe8100ce690 2024-03-30T13:16:00.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.334+0000 7fe80ea00640 1 -- 172.21.15.44:0/3789771077 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe808031640 con 0x7fe8100ce690 2024-03-30T13:16:00.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.334+0000 7fe80ea00640 1 -- 172.21.15.44:0/3789771077 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80802d040 con 0x7fe8100ce690 2024-03-30T13:16:00.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.334+0000 7fe815a00640 1 -- 172.21.15.44:0/3789771077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8100ce690 msgr2=0x7fe8100ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.334+0000 7fe815a00640 1 --2- 172.21.15.44:0/3789771077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8100ce690 0x7fe8100ceac0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe808009870 tx=0x7fe80802b8f0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.334+0000 7fe815a00640 1 -- 172.21.15.44:0/3789771077 shutdown_connections 2024-03-30T13:16:00.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.334+0000 7fe815a00640 1 --2- 172.21.15.44:0/3789771077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8100ce690 0x7fe8100ceac0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.335+0000 7fe815a00640 1 --2- 172.21.15.44:0/3789771077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8100d01c0 0x7fe8100d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.335+0000 7fe815a00640 1 -- 172.21.15.44:0/3789771077 >> 172.21.15.44:0/3789771077 conn(0x7fe81006b9a0 msgr2=0x7fe81006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:00.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.335+0000 7fe815a00640 1 -- 172.21.15.44:0/3789771077 shutdown_connections 2024-03-30T13:16:00.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.335+0000 7fe815a00640 1 -- 172.21.15.44:0/3789771077 wait complete. 2024-03-30T13:16:00.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.337+0000 7fe815a00640 1 Processor -- start 2024-03-30T13:16:00.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.337+0000 7fe815a00640 1 -- start start 2024-03-30T13:16:00.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.338+0000 7fe815a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8100ce690 0x7fe81013a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:00.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.338+0000 7fe815a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8100d01c0 0x7fe81015e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:00.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.338+0000 7fe815a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81013f000 0x7fe8100cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:00.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.338+0000 7fe815a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe81013f3e0 con 0x7fe8100d01c0 2024-03-30T13:16:00.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.338+0000 7fe815a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe8101426d0 con 0x7fe81013f000 2024-03-30T13:16:00.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.338+0000 7fe815a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fe81013f560 con 0x7fe8100ce690 2024-03-30T13:16:00.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.338+0000 7fe80f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8100d01c0 0x7fe81015e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:00.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.338+0000 7fe80f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8100d01c0 0x7fe81015e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51738/0 (socket says 172.21.15.44:51738) 2024-03-30T13:16:00.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.338+0000 7fe80f400640 1 -- 172.21.15.44:0/3419476711 learned_addr learned my addr 172.21.15.44:0/3419476711 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:00.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.338+0000 7fe815000640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81013f000 0x7fe8100cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:00.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.338+0000 7fe80fe00640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8100ce690 0x7fe81013a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:00.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.339+0000 7fe80f400640 1 -- 172.21.15.44:0/3419476711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8100ce690 msgr2=0x7fe81013a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.339+0000 7fe80f400640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8100ce690 0x7fe81013a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.339+0000 7fe80f400640 1 -- 172.21.15.44:0/3419476711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81013f000 msgr2=0x7fe8100cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.339+0000 7fe80f400640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe81013f000 0x7fe8100cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.339+0000 7fe80f400640 1 -- 172.21.15.44:0/3419476711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe810071870 con 0x7fe8100d01c0 2024-03-30T13:16:00.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.339+0000 7fe80f400640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8100d01c0 0x7fe81015e020 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc007f20 tx=0x7fe7fc00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:00.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.339+0000 7fe807e00640 1 -- 172.21.15.44:0/3419476711 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc014620 con 0x7fe8100d01c0 2024-03-30T13:16:00.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.339+0000 7fe807e00640 1 -- 172.21.15.44:0/3419476711 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7fc019070 con 0x7fe8100d01c0 2024-03-30T13:16:00.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.339+0000 7fe807e00640 1 -- 172.21.15.44:0/3419476711 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc014a00 con 0x7fe8100d01c0 2024-03-30T13:16:00.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.339+0000 7fe815a00640 1 -- 172.21.15.44:0/3419476711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe810071b50 con 0x7fe8100d01c0 2024-03-30T13:16:00.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.340+0000 7fe815a00640 1 -- 172.21.15.44:0/3419476711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe810072110 con 0x7fe8100d01c0 2024-03-30T13:16:00.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.340+0000 7fe815a00640 1 -- 172.21.15.44:0/3419476711 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8100724e0 con 0x7fe8100d01c0 2024-03-30T13:16:00.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.342+0000 7fe807e00640 1 -- 172.21.15.44:0/3419476711 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe7fc014ba0 con 0x7fe8100d01c0 2024-03-30T13:16:00.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.343+0000 7fe807e00640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe7f006c530 0x7fe7f006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:00.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.343+0000 7fe807e00640 1 -- 172.21.15.44:0/3419476711 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fe7fc08bf60 con 0x7fe8100d01c0 2024-03-30T13:16:00.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.343+0000 7fe807e00640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] conn(0x7fe7f00729d0 0x7fe7f0074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:00.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.343+0000 7fe807e00640 1 -- 172.21.15.44:0/3419476711 --> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7fc022ec0 con 0x7fe7f00729d0 2024-03-30T13:16:00.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.343+0000 7fe807e00640 1 -- 172.21.15.44:0/3419476711 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fe7fc08e580 con 0x7fe8100d01c0 2024-03-30T13:16:00.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.343+0000 7fe815000640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] conn(0x7fe7f00729d0 0x7fe7f0074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:00.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.343+0000 7fe80fe00640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe7f006c530 0x7fe7f006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:00.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.344+0000 7fe815000640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] conn(0x7fe7f00729d0 0x7fe7f0074e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:00.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.345+0000 7fe80fe00640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe7f006c530 0x7fe7f006e9f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe800006fd0 tx=0x7fe800008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:00.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.345+0000 7fe807e00640 1 -- 172.21.15.44:0/3419476711 <== osd.1 v2:172.21.15.44:6800/1186302707 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe7fc022ec0 con 0x7fe7f00729d0 2024-03-30T13:16:00.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.360+0000 7fe815a00640 1 -- 172.21.15.44:0/3419476711 --> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe810075890 con 0x7fe7f00729d0 2024-03-30T13:16:00.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.360+0000 7fe807e00640 1 -- 172.21.15.44:0/3419476711 <== osd.1 v2:172.21.15.44:6800/1186302707 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe810075890 con 0x7fe7f00729d0 2024-03-30T13:16:00.365 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:16:00.365 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:16:00.365 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:16:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.361+0000 7fe815a00640 1 -- 172.21.15.44:0/3419476711 >> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] conn(0x7fe7f00729d0 msgr2=0x7fe7f0074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.361+0000 7fe815a00640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.44:6800/1186302707,v1:172.21.15.44:6801/1186302707] conn(0x7fe7f00729d0 0x7fe7f0074e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.361+0000 7fe815a00640 1 -- 172.21.15.44:0/3419476711 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe7f006c530 msgr2=0x7fe7f006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.361+0000 7fe815a00640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fe7f006c530 0x7fe7f006e9f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe800006fd0 tx=0x7fe800008040 comp rx=0 tx=0).stop 2024-03-30T13:16:00.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.361+0000 7fe815a00640 1 -- 172.21.15.44:0/3419476711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8100d01c0 msgr2=0x7fe81015e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.361+0000 7fe815a00640 1 --2- 172.21.15.44:0/3419476711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe8100d01c0 0x7fe81015e020 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc007f20 tx=0x7fe7fc00e570 comp rx=0 tx=0).stop 2024-03-30T13:16:00.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.361+0000 7fe815000640 1 -- 172.21.15.44:0/3419476711 reap_dead start 2024-03-30T13:16:00.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.362+0000 7fe815a00640 1 -- 172.21.15.44:0/3419476711 shutdown_connections 2024-03-30T13:16:00.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.362+0000 7fe815a00640 1 -- 172.21.15.44:0/3419476711 >> 172.21.15.44:0/3419476711 conn(0x7fe81006b9a0 msgr2=0x7fe81006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:00.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.362+0000 7fe815a00640 1 -- 172.21.15.44:0/3419476711 shutdown_connections 2024-03-30T13:16:00.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.362+0000 7fe815a00640 1 -- 172.21.15.44:0/3419476711 wait complete. 2024-03-30T13:16:00.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-30T13:16:00.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.591+0000 7fc329600640 1 Processor -- start 2024-03-30T13:16:00.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.591+0000 7fc329600640 1 -- start start 2024-03-30T13:16:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.593+0000 7fc329600640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fc324152260 0x7fc32415bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.593+0000 7fc329600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc32415c340 con 0x7fc324151e80 2024-03-30T13:16:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.593+0000 7fc329600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3240cc6b0 con 0x7fc32406e960 2024-03-30T13:16:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.593+0000 7fc329600640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fc3240cc470 con 0x7fc324152260 2024-03-30T13:16:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.593+0000 7fc323e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fc324151e80 0x7fc32406e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46918/0 (socket says 172.21.15.44:46918) 2024-03-30T13:16:00.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.593+0000 7fc323e00640 1 -- 172.21.15.44:0/3007713577 learned_addr learned my addr 172.21.15.44:0/3007713577 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:16:00.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.593+0000 7fc328c00640 1 --2- 172.21.15.44:0/3007713577 >> v2:172.21.15.44:3300/0 conn(0x7fc324152260 0x7fc32415bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:00.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.593+0000 7fc322a00640 1 -- 172.21.15.44:0/3007713577 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4276223107 0 0) 0x7fc32415c340 con 0x7fc324151e80 2024-03-30T13:16:00.598 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.593+0000 7fc322a00640 1 -- 172.21.15.44:0/3007713577 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc308003520 con 0x7fc324151e80 2024-03-30T13:16:00.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.594+0000 7fc328c00640 1 -- 172.21.15.44:0/3007713577 >> v1:172.21.15.151:6789/0 conn(0x7fc32406e960 legacy=0x7fc32415b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.594+0000 7fc328c00640 1 -- 172.21.15.44:0/3007713577 >> v1:172.21.15.44:6789/0 conn(0x7fc324151e80 legacy=0x7fc32406e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.594+0000 7fc328c00640 1 -- 172.21.15.44:0/3007713577 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3240cc990 con 0x7fc324152260 2024-03-30T13:16:00.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.595+0000 7fc328c00640 1 --2- 172.21.15.44:0/3007713577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc324152260 0x7fc32415bd20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009d90 tx=0x7fc31c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59daf61a853c15ed server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:00.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.595+0000 7fc322a00640 1 -- 172.21.15.44:0/3007713577 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c039070 con 0x7fc324152260 2024-03-30T13:16:00.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.595+0000 7fc322a00640 1 -- 172.21.15.44:0/3007713577 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc31c02cd00 con 0x7fc324152260 2024-03-30T13:16:00.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.595+0000 7fc322a00640 1 -- 172.21.15.44:0/3007713577 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc31c034660 con 0x7fc324152260 2024-03-30T13:16:00.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.596+0000 7fc329600640 1 -- 172.21.15.44:0/3007713577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc324152260 msgr2=0x7fc32415bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.596+0000 7fc329600640 1 --2- 172.21.15.44:0/3007713577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc324152260 0x7fc32415bd20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009d90 tx=0x7fc31c02bf50 comp rx=0 tx=0).stop 2024-03-30T13:16:00.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.596+0000 7fc329600640 1 -- 172.21.15.44:0/3007713577 shutdown_connections 2024-03-30T13:16:00.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.596+0000 7fc329600640 1 --2- 172.21.15.44:0/3007713577 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc324152260 0x7fc32415bd20 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.596+0000 7fc329600640 1 -- 172.21.15.44:0/3007713577 >> 172.21.15.44:0/3007713577 conn(0x7fc3240b1800 msgr2=0x7fc3240b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:00.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.596+0000 7fc329600640 1 -- 172.21.15.44:0/3007713577 shutdown_connections 2024-03-30T13:16:00.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.596+0000 7fc329600640 1 -- 172.21.15.44:0/3007713577 wait complete. 2024-03-30T13:16:00.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.598+0000 7fc329600640 1 Processor -- start 2024-03-30T13:16:00.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.598+0000 7fc329600640 1 -- start start 2024-03-30T13:16:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.599+0000 7fc329600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc32406e960 0x7fc3240c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.599+0000 7fc329600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc324151e80 0x7fc3241e9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.599+0000 7fc329600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc324152260 0x7fc3241550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.599+0000 7fc329600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc3240cd560 con 0x7fc324151e80 2024-03-30T13:16:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.599+0000 7fc329600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc3240cd3e0 con 0x7fc324152260 2024-03-30T13:16:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.599+0000 7fc329600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fc3240ca9a0 con 0x7fc32406e960 2024-03-30T13:16:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.599+0000 7fc323400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc324151e80 0x7fc3241e9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:00.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.599+0000 7fc323400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc324151e80 0x7fc3241e9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51760/0 (socket says 172.21.15.44:51760) 2024-03-30T13:16:00.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.599+0000 7fc323400640 1 -- 172.21.15.44:0/2951970327 learned_addr learned my addr 172.21.15.44:0/2951970327 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:00.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc323400640 1 -- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc32406e960 msgr2=0x7fc3240c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc328c00640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc324152260 0x7fc3241550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:00.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc323e00640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc32406e960 0x7fc3240c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:00.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc323400640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc32406e960 0x7fc3240c7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc323400640 1 -- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc324152260 msgr2=0x7fc3241550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc323400640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc324152260 0x7fc3241550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc323400640 1 -- 172.21.15.44:0/2951970327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc32413de20 con 0x7fc324151e80 2024-03-30T13:16:00.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc328c00640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc324152260 0x7fc3241550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:16:00.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc323400640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc324151e80 0x7fc3241e9fc0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c400 tx=0x7fc30c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:00.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc31be00640 1 -- 172.21.15.44:0/2951970327 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0052d0 con 0x7fc324151e80 2024-03-30T13:16:00.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc31be00640 1 -- 172.21.15.44:0/2951970327 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc30c005490 con 0x7fc324151e80 2024-03-30T13:16:00.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc31be00640 1 -- 172.21.15.44:0/2951970327 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c007260 con 0x7fc324151e80 2024-03-30T13:16:00.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.600+0000 7fc329600640 1 -- 172.21.15.44:0/2951970327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc32413e100 con 0x7fc324151e80 2024-03-30T13:16:00.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.601+0000 7fc329600640 1 -- 172.21.15.44:0/2951970327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc32413e6c0 con 0x7fc324151e80 2024-03-30T13:16:00.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.602+0000 7fc329600640 1 -- 172.21.15.44:0/2951970327 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc324075890 con 0x7fc324151e80 2024-03-30T13:16:00.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.603+0000 7fc31be00640 1 -- 172.21.15.44:0/2951970327 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc30c007400 con 0x7fc324151e80 2024-03-30T13:16:00.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.603+0000 7fc31be00640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc30006c530 0x7fc30006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:00.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.604+0000 7fc31be00640 1 -- 172.21.15.44:0/2951970327 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fc30c08aa40 con 0x7fc324151e80 2024-03-30T13:16:00.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.604+0000 7fc323e00640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc30006c530 0x7fc30006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:00.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.605+0000 7fc323e00640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc30006c530 0x7fc30006e9f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc3140011e0 tx=0x7fc314009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:00.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.609+0000 7fc31be00640 1 -- 172.21.15.44:0/2951970327 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc30c059260 con 0x7fc324151e80 2024-03-30T13:16:00.819 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:16:00.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.816+0000 7fc329600640 1 -- 172.21.15.44:0/2951970327 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fc32413e890 con 0x7fc30006c530 2024-03-30T13:16:00.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.817+0000 7fc31be00640 1 -- 172.21.15.44:0/2951970327 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc32413e890 con 0x7fc30006c530 2024-03-30T13:16:00.826 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:16:00.827 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 1 to deep-scrub 2024-03-30T13:16:00.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.820+0000 7fc329600640 1 -- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc30006c530 msgr2=0x7fc30006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.820+0000 7fc329600640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc30006c530 0x7fc30006e9f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc3140011e0 tx=0x7fc314009040 comp rx=0 tx=0).stop 2024-03-30T13:16:00.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.820+0000 7fc329600640 1 -- 172.21.15.44:0/2951970327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc324151e80 msgr2=0x7fc3241e9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:00.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.820+0000 7fc329600640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc324151e80 0x7fc3241e9fc0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c400 tx=0x7fc30c00c8c0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.820+0000 7fc329600640 1 -- 172.21.15.44:0/2951970327 shutdown_connections 2024-03-30T13:16:00.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.820+0000 7fc329600640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fc30006c530 0x7fc30006e9f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.820+0000 7fc329600640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc324152260 0x7fc3241550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.820+0000 7fc329600640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc324151e80 0x7fc3241e9fc0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.820+0000 7fc329600640 1 --2- 172.21.15.44:0/2951970327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc32406e960 0x7fc3240c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:00.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.820+0000 7fc329600640 1 -- 172.21.15.44:0/2951970327 >> 172.21.15.44:0/2951970327 conn(0x7fc3240b1800 msgr2=0x7fc3240cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:00.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.820+0000 7fc329600640 1 -- 172.21.15.44:0/2951970327 shutdown_connections 2024-03-30T13:16:00.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:00.820+0000 7fc329600640 1 -- 172.21.15.44:0/2951970327 wait complete. 2024-03-30T13:16:00.843 INFO:tasks.ceph:Scrubbing osd.2 2024-03-30T13:16:00.843 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:16:01.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.097+0000 7f1595200640 1 Processor -- start 2024-03-30T13:16:01.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.097+0000 7f1595200640 1 -- start start 2024-03-30T13:16:01.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.098+0000 7f1595200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1590161c30 0x7f15900d2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.098+0000 7f1595200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15900b5870 0x7f15900d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.098+0000 7f1595200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1590162010 con 0x7f15900c7870 2024-03-30T13:16:01.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.098+0000 7f1595200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f15900b31c0 con 0x7f1590161c30 2024-03-30T13:16:01.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.098+0000 7f1595200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f15900d22f0 con 0x7f15900b5870 2024-03-30T13:16:01.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.098+0000 7f158f400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1590161c30 0x7f15900d2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.098+0000 7f158f400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f1590161c30 0x7f15900d2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51774/0 (socket says 172.21.15.44:51774) 2024-03-30T13:16:01.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.098+0000 7f158f400640 1 -- 172.21.15.44:0/698282997 learned_addr learned my addr 172.21.15.44:0/698282997 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:01.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.099+0000 7f158ea00640 1 --2- 172.21.15.44:0/698282997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15900b5870 0x7f15900d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.099+0000 7f158f400640 1 -- 172.21.15.44:0/698282997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15900b5870 msgr2=0x7f15900d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:01.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.099+0000 7f158f400640 1 --2- 172.21.15.44:0/698282997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15900b5870 0x7f15900d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.099+0000 7f158f400640 1 -- 172.21.15.44:0/698282997 >> v1:172.21.15.151:6789/0 conn(0x7f15900c7870 legacy=0x7f15900cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:01.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.099+0000 7f158f400640 1 -- 172.21.15.44:0/698282997 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15900d25d0 con 0x7f1590161c30 2024-03-30T13:16:01.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.100+0000 7f158f400640 1 --2- 172.21.15.44:0/698282997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1590161c30 0x7f15900d2dd0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f1578009870 tx=0x7f157802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90afe19fd377c1a server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.101+0000 7f158e000640 1 -- 172.21.15.44:0/698282997 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578035020 con 0x7f1590161c30 2024-03-30T13:16:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.101+0000 7f158e000640 1 -- 172.21.15.44:0/698282997 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1578031640 con 0x7f1590161c30 2024-03-30T13:16:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.101+0000 7f158e000640 1 -- 172.21.15.44:0/698282997 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157802d040 con 0x7f1590161c30 2024-03-30T13:16:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.101+0000 7f1595200640 1 -- 172.21.15.44:0/698282997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1590161c30 msgr2=0x7f15900d2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.101+0000 7f1595200640 1 --2- 172.21.15.44:0/698282997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1590161c30 0x7f15900d2dd0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f1578009870 tx=0x7f157802b8f0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.101+0000 7f1595200640 1 -- 172.21.15.44:0/698282997 shutdown_connections 2024-03-30T13:16:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.101+0000 7f1595200640 1 --2- 172.21.15.44:0/698282997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15900b5870 0x7f15900d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.101+0000 7f1595200640 1 --2- 172.21.15.44:0/698282997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1590161c30 0x7f15900d2dd0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.101+0000 7f1595200640 1 -- 172.21.15.44:0/698282997 >> 172.21.15.44:0/698282997 conn(0x7f159009d510 msgr2=0x7f15900d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.101+0000 7f1595200640 1 -- 172.21.15.44:0/698282997 shutdown_connections 2024-03-30T13:16:01.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.101+0000 7f1595200640 1 -- 172.21.15.44:0/698282997 wait complete. 2024-03-30T13:16:01.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.103+0000 7f1595200640 1 Processor -- start 2024-03-30T13:16:01.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.103+0000 7f1595200640 1 -- start start 2024-03-30T13:16:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.104+0000 7f1595200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15900b5870 0x7f15900ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.104+0000 7f1595200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15900c7870 0x7f159006ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.104+0000 7f1595200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1590161c30 0x7f159006cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.104+0000 7f1595200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f15900b3600 con 0x7f1590161c30 2024-03-30T13:16:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.104+0000 7f1595200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f15900d3310 con 0x7f15900c7870 2024-03-30T13:16:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.104+0000 7f1595200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f15900b3780 con 0x7f15900b5870 2024-03-30T13:16:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.105+0000 7f158fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1590161c30 0x7f159006cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.105+0000 7f158fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1590161c30 0x7f159006cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51776/0 (socket says 172.21.15.44:51776) 2024-03-30T13:16:01.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.105+0000 7f158fe00640 1 -- 172.21.15.44:0/281428863 learned_addr learned my addr 172.21.15.44:0/281428863 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.105+0000 7f158ea00640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15900c7870 0x7f159006ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.105+0000 7f158f400640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15900b5870 0x7f15900ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.105+0000 7f158fe00640 1 -- 172.21.15.44:0/281428863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15900b5870 msgr2=0x7f15900ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.105+0000 7f158fe00640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15900b5870 0x7f15900ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.105+0000 7f158fe00640 1 -- 172.21.15.44:0/281428863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15900c7870 msgr2=0x7f159006ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.105+0000 7f158fe00640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15900c7870 0x7f159006ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.105+0000 7f158fe00640 1 -- 172.21.15.44:0/281428863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15900cab30 con 0x7f1590161c30 2024-03-30T13:16:01.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.106+0000 7f158fe00640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1590161c30 0x7f159006cf60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f158800c7b0 tx=0x7f158800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:01.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.106+0000 7f1587400640 1 -- 172.21.15.44:0/281428863 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588004b60 con 0x7f1590161c30 2024-03-30T13:16:01.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.106+0000 7f1587400640 1 -- 172.21.15.44:0/281428863 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1588004d00 con 0x7f1590161c30 2024-03-30T13:16:01.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.106+0000 7f1587400640 1 -- 172.21.15.44:0/281428863 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158800aa90 con 0x7f1590161c30 2024-03-30T13:16:01.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.106+0000 7f1595200640 1 -- 172.21.15.44:0/281428863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15900c8770 con 0x7f1590161c30 2024-03-30T13:16:01.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.106+0000 7f1595200640 1 -- 172.21.15.44:0/281428863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15900c8d30 con 0x7f1590161c30 2024-03-30T13:16:01.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.107+0000 7f1595200640 1 -- 172.21.15.44:0/281428863 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1590075890 con 0x7f1590161c30 2024-03-30T13:16:01.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.108+0000 7f1587400640 1 -- 172.21.15.44:0/281428863 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f158800ac30 con 0x7f1590161c30 2024-03-30T13:16:01.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.109+0000 7f1587400640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f156c06c560 0x7f156c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.109+0000 7f1587400640 1 -- 172.21.15.44:0/281428863 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f158808b840 con 0x7f1590161c30 2024-03-30T13:16:01.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.110+0000 7f1587400640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] conn(0x7f156c072a00 0x7f156c074e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.110+0000 7f1587400640 1 -- 172.21.15.44:0/281428863 --> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1588009eb0 con 0x7f156c072a00 2024-03-30T13:16:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.110+0000 7f1587400640 1 -- 172.21.15.44:0/281428863 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f1588092050 con 0x7f1590161c30 2024-03-30T13:16:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.110+0000 7f158ea00640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] conn(0x7f156c072a00 0x7f156c074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.110+0000 7f158f400640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f156c06c560 0x7f156c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.110+0000 7f158ea00640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] conn(0x7f156c072a00 0x7f156c074e40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.111+0000 7f1587400640 1 -- 172.21.15.44:0/281428863 <== osd.2 v2:172.21.15.44:6816/3473014849 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1588009eb0 con 0x7f156c072a00 2024-03-30T13:16:01.116 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.112+0000 7f158f400640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f156c06c560 0x7f156c06ea20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1578036000 tx=0x7f157803c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:01.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.127+0000 7f1595200640 1 -- 172.21.15.44:0/281428863 --> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f15900ca3d0 con 0x7f156c072a00 2024-03-30T13:16:01.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.127+0000 7f1587400640 1 -- 172.21.15.44:0/281428863 <== osd.2 v2:172.21.15.44:6816/3473014849 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f15900ca3d0 con 0x7f156c072a00 2024-03-30T13:16:01.131 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:16:01.132 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:16:01.132 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:16:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.128+0000 7f1595200640 1 -- 172.21.15.44:0/281428863 >> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] conn(0x7f156c072a00 msgr2=0x7f156c074e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.128+0000 7f1595200640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.44:6816/3473014849,v1:172.21.15.44:6817/3473014849] conn(0x7f156c072a00 0x7f156c074e40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.128+0000 7f1595200640 1 -- 172.21.15.44:0/281428863 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f156c06c560 msgr2=0x7f156c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.128+0000 7f1595200640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f156c06c560 0x7f156c06ea20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1578036000 tx=0x7f157803c040 comp rx=0 tx=0).stop 2024-03-30T13:16:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.128+0000 7f1595200640 1 -- 172.21.15.44:0/281428863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1590161c30 msgr2=0x7f159006cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.128+0000 7f1595200640 1 --2- 172.21.15.44:0/281428863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1590161c30 0x7f159006cf60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f158800c7b0 tx=0x7f158800cc70 comp rx=0 tx=0).stop 2024-03-30T13:16:01.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.128+0000 7f158fe00640 1 -- 172.21.15.44:0/281428863 reap_dead start 2024-03-30T13:16:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.128+0000 7f1595200640 1 -- 172.21.15.44:0/281428863 shutdown_connections 2024-03-30T13:16:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.128+0000 7f1595200640 1 -- 172.21.15.44:0/281428863 >> 172.21.15.44:0/281428863 conn(0x7f159009d510 msgr2=0x7f15900cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.128+0000 7f1595200640 1 -- 172.21.15.44:0/281428863 shutdown_connections 2024-03-30T13:16:01.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.128+0000 7f1595200640 1 -- 172.21.15.44:0/281428863 wait complete. 2024-03-30T13:16:01.154 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-30T13:16:01.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.372+0000 7f40a5600640 1 Processor -- start 2024-03-30T13:16:01.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.372+0000 7f40a5600640 1 -- start start 2024-03-30T13:16:01.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.374+0000 7f40a5600640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40a015c2e0 0x7f40a006db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.374+0000 7f40a5600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a00711b0 con 0x7f40a00cc700 2024-03-30T13:16:01.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.374+0000 7f40a5600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a0071470 con 0x7f40a00b2b40 2024-03-30T13:16:01.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.374+0000 7f40a5600640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f40a006ee40 con 0x7f40a015c2e0 2024-03-30T13:16:01.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.374+0000 7f409fe00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f40a00cc700 0x7f40a00ccae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46932/0 (socket says 172.21.15.44:46932) 2024-03-30T13:16:01.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.374+0000 7f409fe00640 1 -- 172.21.15.44:0/1496675130 learned_addr learned my addr 172.21.15.44:0/1496675130 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:16:01.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.375+0000 7f4097400640 1 --2- 172.21.15.44:0/1496675130 >> v2:172.21.15.151:3300/0 conn(0x7f40a015c2e0 0x7f40a006db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.375+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2717766776 0 0) 0x7f40a00711b0 con 0x7f40a00cc700 2024-03-30T13:16:01.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.375+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4084003520 con 0x7f40a00cc700 2024-03-30T13:16:01.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.375+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2109427382 0 0) 0x7f4084003520 con 0x7f40a00cc700 2024-03-30T13:16:01.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.375+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 >> v2:172.21.15.151:3300/0 conn(0x7f40a015c2e0 msgr2=0x7f40a006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:01.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.375+0000 7f409f400640 1 --2- 172.21.15.44:0/1496675130 >> v2:172.21.15.151:3300/0 conn(0x7f40a015c2e0 0x7f40a006db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.375+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 >> v1:172.21.15.151:6789/0 conn(0x7f40a00b2b40 legacy=0x7f40a015fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.375+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a0072eb0 con 0x7f40a00cc700 2024-03-30T13:16:01.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.375+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f40900019f0 con 0x7f40a00cc700 2024-03-30T13:16:01.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 >> v1:172.21.15.44:6789/0 conn(0x7f40a00cc700 legacy=0x7f40a00ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f409f400640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40840039b0 0x7f4084003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f409f400640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4084004800 0x7f4084004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f409f400640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40840051c0 0x7f408400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40a006ee40 con 0x7f4084004800 2024-03-30T13:16:01.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f408400c060 con 0x7f40840051c0 2024-03-30T13:16:01.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f408400c260 con 0x7f40840039b0 2024-03-30T13:16:01.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f4097400640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4084004800 0x7f4084004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f409fe00640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40840039b0 0x7f4084003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f4097400640 1 -- 172.21.15.44:0/1496675130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40840039b0 msgr2=0x7f4084003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:01.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f40a4c00640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40840051c0 0x7f408400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f4097400640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40840039b0 0x7f4084003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f4097400640 1 -- 172.21.15.44:0/1496675130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40840051c0 msgr2=0x7f408400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:01.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f4097400640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40840051c0 0x7f408400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f4097400640 1 -- 172.21.15.44:0/1496675130 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4084003520 con 0x7f4084004800 2024-03-30T13:16:01.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f409fe00640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40840039b0 0x7f4084003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:16:01.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f40a4c00640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40840051c0 0x7f408400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:16:01.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.376+0000 7f40a4c00640 1 -- 172.21.15.44:0/1496675130 reap_dead start 2024-03-30T13:16:01.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.377+0000 7f4097400640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4084004800 0x7f4084004c80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4088009a90 tx=0x7f4084005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546bb1a9830c74b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:01.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.378+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088039070 con 0x7f4084004800 2024-03-30T13:16:01.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.378+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f408802c680 con 0x7f4084004800 2024-03-30T13:16:01.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.378+0000 7f409f400640 1 -- 172.21.15.44:0/1496675130 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088009690 con 0x7f4084004800 2024-03-30T13:16:01.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.378+0000 7f40a5600640 1 -- 172.21.15.44:0/1496675130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4084004800 msgr2=0x7f4084004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.378+0000 7f40a5600640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4084004800 0x7f4084004c80 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4088009a90 tx=0x7f4084005830 comp rx=0 tx=0).stop 2024-03-30T13:16:01.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.378+0000 7f40a5600640 1 -- 172.21.15.44:0/1496675130 shutdown_connections 2024-03-30T13:16:01.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.378+0000 7f40a5600640 1 --2- 172.21.15.44:0/1496675130 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4084004800 0x7f4084004c80 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.378+0000 7f40a5600640 1 -- 172.21.15.44:0/1496675130 >> 172.21.15.44:0/1496675130 conn(0x7f40a00b1800 msgr2=0x7f40a00b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:01.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.379+0000 7f40a5600640 1 -- 172.21.15.44:0/1496675130 shutdown_connections 2024-03-30T13:16:01.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.379+0000 7f40a5600640 1 -- 172.21.15.44:0/1496675130 wait complete. 2024-03-30T13:16:01.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.380+0000 7f40a5600640 1 Processor -- start 2024-03-30T13:16:01.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.380+0000 7f40a5600640 1 -- start start 2024-03-30T13:16:01.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.381+0000 7f40a5600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4084004800 0x7f40a01e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.381+0000 7f40a5600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a00ad9e0 0x7f40a00ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.381+0000 7f40a5600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40a0157c50 0x7f40a01580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.381+0000 7f40a5600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40a00718d0 con 0x7f40a0157c50 2024-03-30T13:16:01.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.381+0000 7f40a5600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f40a0071750 con 0x7f40a00ad9e0 2024-03-30T13:16:01.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.381+0000 7f40a5600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f40a00cbf90 con 0x7f4084004800 2024-03-30T13:16:01.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.382+0000 7f40a4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40a0157c50 0x7f40a01580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.382+0000 7f40a4c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40a0157c50 0x7f40a01580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51784/0 (socket says 172.21.15.44:51784) 2024-03-30T13:16:01.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.382+0000 7f40a4c00640 1 -- 172.21.15.44:0/3249754155 learned_addr learned my addr 172.21.15.44:0/3249754155 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:01.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.382+0000 7f409fe00640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4084004800 0x7f40a01e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.382+0000 7f4097400640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a00ad9e0 0x7f40a00ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.382+0000 7f40a4c00640 1 -- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4084004800 msgr2=0x7f40a01e22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.382+0000 7f40a4c00640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4084004800 0x7f40a01e22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.382+0000 7f40a4c00640 1 -- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a00ad9e0 msgr2=0x7f40a00ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.382+0000 7f40a4c00640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a00ad9e0 0x7f40a00ade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.382+0000 7f40a4c00640 1 -- 172.21.15.44:0/3249754155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a00ae480 con 0x7f40a0157c50 2024-03-30T13:16:01.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.383+0000 7f40a4c00640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40a0157c50 0x7f40a01580b0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f40a00cd690 tx=0x7f409800d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:01.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.383+0000 7f409cc00640 1 -- 172.21.15.44:0/3249754155 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098018070 con 0x7f40a0157c50 2024-03-30T13:16:01.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.383+0000 7f409cc00640 1 -- 172.21.15.44:0/3249754155 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f409800de60 con 0x7f40a0157c50 2024-03-30T13:16:01.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.383+0000 7f409cc00640 1 -- 172.21.15.44:0/3249754155 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098003830 con 0x7f40a0157c50 2024-03-30T13:16:01.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.383+0000 7f40a5600640 1 -- 172.21.15.44:0/3249754155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a00ae760 con 0x7f40a0157c50 2024-03-30T13:16:01.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.383+0000 7f40a5600640 1 -- 172.21.15.44:0/3249754155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a00aed20 con 0x7f40a0157c50 2024-03-30T13:16:01.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.384+0000 7f40a5600640 1 -- 172.21.15.44:0/3249754155 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a0075890 con 0x7f40a0157c50 2024-03-30T13:16:01.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.385+0000 7f409cc00640 1 -- 172.21.15.44:0/3249754155 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f409801b070 con 0x7f40a0157c50 2024-03-30T13:16:01.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.386+0000 7f409cc00640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f407c06c560 0x7f407c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.386+0000 7f409cc00640 1 -- 172.21.15.44:0/3249754155 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f409808aaf0 con 0x7f40a0157c50 2024-03-30T13:16:01.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.387+0000 7f409fe00640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f407c06c560 0x7f407c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.388+0000 7f409fe00640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f407c06c560 0x7f407c06ea20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4090001b60 tx=0x7f4090009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:01.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.391+0000 7f409cc00640 1 -- 172.21.15.44:0/3249754155 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f40980591e0 con 0x7f40a0157c50 2024-03-30T13:16:01.599 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.595+0000 7f40a5600640 1 -- 172.21.15.44:0/3249754155 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f40a00711b0 con 0x7f407c06c560 2024-03-30T13:16:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.596+0000 7f409cc00640 1 -- 172.21.15.44:0/3249754155 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f40a00711b0 con 0x7f407c06c560 2024-03-30T13:16:01.600 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 2 to deep-scrub 2024-03-30T13:16:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.598+0000 7f40a5600640 1 -- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f407c06c560 msgr2=0x7f407c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.599+0000 7f40a5600640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f407c06c560 0x7f407c06ea20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4090001b60 tx=0x7f4090009040 comp rx=0 tx=0).stop 2024-03-30T13:16:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.599+0000 7f40a5600640 1 -- 172.21.15.44:0/3249754155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40a0157c50 msgr2=0x7f40a01580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.599+0000 7f40a5600640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40a0157c50 0x7f40a01580b0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f40a00cd690 tx=0x7f409800d660 comp rx=0 tx=0).stop 2024-03-30T13:16:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.599+0000 7f40a5600640 1 -- 172.21.15.44:0/3249754155 shutdown_connections 2024-03-30T13:16:01.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.599+0000 7f40a5600640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40a0157c50 0x7f40a01580b0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.599+0000 7f40a5600640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f407c06c560 0x7f407c06ea20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.599+0000 7f40a5600640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40a00ad9e0 0x7f40a00ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.599+0000 7f40a5600640 1 --2- 172.21.15.44:0/3249754155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4084004800 0x7f40a01e22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.599+0000 7f40a5600640 1 -- 172.21.15.44:0/3249754155 >> 172.21.15.44:0/3249754155 conn(0x7f40a00b1800 msgr2=0x7f40a00b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:01.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.599+0000 7f40a5600640 1 -- 172.21.15.44:0/3249754155 shutdown_connections 2024-03-30T13:16:01.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.599+0000 7f40a5600640 1 -- 172.21.15.44:0/3249754155 wait complete. 2024-03-30T13:16:01.621 INFO:tasks.ceph:Scrubbing osd.3 2024-03-30T13:16:01.622 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:16:01.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.845+0000 7fcd86c00640 1 Processor -- start 2024-03-30T13:16:01.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.845+0000 7fcd86c00640 1 -- start start 2024-03-30T13:16:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.847+0000 7fcd86c00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcd801448f0 0x7fcd8006e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.847+0000 7fcd86c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcd800b34e0 0x7fcd800cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.847+0000 7fcd86c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd800b43a0 con 0x7fcd8006eb30 2024-03-30T13:16:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.847+0000 7fcd86c00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fcd8006ef90 con 0x7fcd801448f0 2024-03-30T13:16:01.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.847+0000 7fcd86c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fcd80144cd0 con 0x7fcd800b34e0 2024-03-30T13:16:01.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.847+0000 7fcd85800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcd801448f0 0x7fcd8006e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.847+0000 7fcd85800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fcd801448f0 0x7fcd8006e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51794/0 (socket says 172.21.15.44:51794) 2024-03-30T13:16:01.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.847+0000 7fcd85800640 1 -- 172.21.15.44:0/1727375561 learned_addr learned my addr 172.21.15.44:0/1727375561 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.848+0000 7fcd86200640 1 --2- 172.21.15.44:0/1727375561 >> v2:172.21.15.151:3300/0 conn(0x7fcd800b34e0 0x7fcd800cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.848+0000 7fcd85800640 1 -- 172.21.15.44:0/1727375561 >> v2:172.21.15.151:3300/0 conn(0x7fcd800b34e0 msgr2=0x7fcd800cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.848+0000 7fcd85800640 1 --2- 172.21.15.44:0/1727375561 >> v2:172.21.15.151:3300/0 conn(0x7fcd800b34e0 0x7fcd800cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.848+0000 7fcd85800640 1 -- 172.21.15.44:0/1727375561 >> v1:172.21.15.151:6789/0 conn(0x7fcd8006eb30 legacy=0x7fcd800b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.848+0000 7fcd85800640 1 -- 172.21.15.44:0/1727375561 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd800b3b00 con 0x7fcd801448f0 2024-03-30T13:16:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.848+0000 7fcd86200640 1 --2- 172.21.15.44:0/1727375561 >> v2:172.21.15.151:3300/0 conn(0x7fcd800b34e0 0x7fcd800cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:16:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.849+0000 7fcd85800640 1 --2- 172.21.15.44:0/1727375561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd801448f0 0x7fcd8006e5f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fcd8015b5d0 tx=0x7fcd7402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fa9c9776932591 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.849+0000 7fcd7fe00640 1 -- 172.21.15.44:0/1727375561 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7402ca80 con 0x7fcd801448f0 2024-03-30T13:16:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.849+0000 7fcd7fe00640 1 -- 172.21.15.44:0/1727375561 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7402cc20 con 0x7fcd801448f0 2024-03-30T13:16:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.850+0000 7fcd7fe00640 1 -- 172.21.15.44:0/1727375561 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd740343f0 con 0x7fcd801448f0 2024-03-30T13:16:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.850+0000 7fcd86c00640 1 -- 172.21.15.44:0/1727375561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd801448f0 msgr2=0x7fcd8006e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.850+0000 7fcd86c00640 1 --2- 172.21.15.44:0/1727375561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd801448f0 0x7fcd8006e5f0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fcd8015b5d0 tx=0x7fcd7402bee0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.850+0000 7fcd86c00640 1 -- 172.21.15.44:0/1727375561 shutdown_connections 2024-03-30T13:16:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.850+0000 7fcd86c00640 1 --2- 172.21.15.44:0/1727375561 >> v2:172.21.15.151:3300/0 conn(0x7fcd800b34e0 0x7fcd800cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.850+0000 7fcd86c00640 1 --2- 172.21.15.44:0/1727375561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd801448f0 0x7fcd8006e5f0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.850+0000 7fcd86c00640 1 -- 172.21.15.44:0/1727375561 >> 172.21.15.44:0/1727375561 conn(0x7fcd8006b9a0 msgr2=0x7fcd8006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:01.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.850+0000 7fcd86c00640 1 -- 172.21.15.44:0/1727375561 shutdown_connections 2024-03-30T13:16:01.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.850+0000 7fcd86c00640 1 -- 172.21.15.44:0/1727375561 wait complete. 2024-03-30T13:16:01.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.853+0000 7fcd86c00640 1 Processor -- start 2024-03-30T13:16:01.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.853+0000 7fcd86c00640 1 -- start start 2024-03-30T13:16:01.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.854+0000 7fcd86c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd8006eb30 0x7fcd800ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.854+0000 7fcd86c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd800b34e0 0x7fcd8015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.854+0000 7fcd86c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd801448f0 0x7fcd80142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.854+0000 7fcd86c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcd800ce140 con 0x7fcd8006eb30 2024-03-30T13:16:01.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.854+0000 7fcd86c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcd800b40c0 con 0x7fcd800b34e0 2024-03-30T13:16:01.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.854+0000 7fcd86c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fcd800ce2c0 con 0x7fcd801448f0 2024-03-30T13:16:01.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.854+0000 7fcd85800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd8006eb30 0x7fcd800ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.854+0000 7fcd85800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd8006eb30 0x7fcd800ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51806/0 (socket says 172.21.15.44:51806) 2024-03-30T13:16:01.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.854+0000 7fcd85800640 1 -- 172.21.15.44:0/3265857426 learned_addr learned my addr 172.21.15.44:0/3265857426 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:01.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.855+0000 7fcd84e00640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd800b34e0 0x7fcd8015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.855+0000 7fcd86200640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd801448f0 0x7fcd80142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.855+0000 7fcd85800640 1 -- 172.21.15.44:0/3265857426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd801448f0 msgr2=0x7fcd80142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.855+0000 7fcd85800640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd801448f0 0x7fcd80142300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.855+0000 7fcd85800640 1 -- 172.21.15.44:0/3265857426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd800b34e0 msgr2=0x7fcd8015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.855+0000 7fcd85800640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd800b34e0 0x7fcd8015ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.855+0000 7fcd85800640 1 -- 172.21.15.44:0/3265857426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd800adef0 con 0x7fcd8006eb30 2024-03-30T13:16:01.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.855+0000 7fcd85800640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd8006eb30 0x7fcd800ad8a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fcd7402c4f0 tx=0x7fcd74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:01.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.856+0000 7fcd7d600640 1 -- 172.21.15.44:0/3265857426 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd74043020 con 0x7fcd8006eb30 2024-03-30T13:16:01.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.856+0000 7fcd7d600640 1 -- 172.21.15.44:0/3265857426 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7403e450 con 0x7fcd8006eb30 2024-03-30T13:16:01.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.856+0000 7fcd7d600640 1 -- 172.21.15.44:0/3265857426 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7403e820 con 0x7fcd8006eb30 2024-03-30T13:16:01.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.856+0000 7fcd86c00640 1 -- 172.21.15.44:0/3265857426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd800ae1d0 con 0x7fcd8006eb30 2024-03-30T13:16:01.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.856+0000 7fcd86c00640 1 -- 172.21.15.44:0/3265857426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd800ae790 con 0x7fcd8006eb30 2024-03-30T13:16:01.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.857+0000 7fcd86c00640 1 -- 172.21.15.44:0/3265857426 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd80075890 con 0x7fcd8006eb30 2024-03-30T13:16:01.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.858+0000 7fcd7d600640 1 -- 172.21.15.44:0/3265857426 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcd74046020 con 0x7fcd8006eb30 2024-03-30T13:16:01.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.859+0000 7fcd7d600640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcd6006c530 0x7fcd6006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.859+0000 7fcd7d600640 1 -- 172.21.15.44:0/3265857426 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fcd740add60 con 0x7fcd8006eb30 2024-03-30T13:16:01.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.859+0000 7fcd7d600640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] conn(0x7fcd600729d0 0x7fcd60074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:01.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.859+0000 7fcd7d600640 1 -- 172.21.15.44:0/3265857426 --> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd7403ae50 con 0x7fcd600729d0 2024-03-30T13:16:01.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.859+0000 7fcd7d600640 1 -- 172.21.15.44:0/3265857426 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fcd740b0380 con 0x7fcd8006eb30 2024-03-30T13:16:01.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.860+0000 7fcd86200640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] conn(0x7fcd600729d0 0x7fcd60074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.860+0000 7fcd84e00640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcd6006c530 0x7fcd6006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:01.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.860+0000 7fcd86200640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] conn(0x7fcd600729d0 0x7fcd60074e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:01.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.861+0000 7fcd84e00640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcd6006c530 0x7fcd6006e9f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c007fd0 tx=0x7fcd6c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:01.866 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.861+0000 7fcd7d600640 1 -- 172.21.15.44:0/3265857426 <== osd.3 v2:172.21.15.44:6824/667769912 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcd7403ae50 con 0x7fcd600729d0 2024-03-30T13:16:01.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.876+0000 7fcd86c00640 1 -- 172.21.15.44:0/3265857426 --> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcd800b5230 con 0x7fcd600729d0 2024-03-30T13:16:01.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.876+0000 7fcd7d600640 1 -- 172.21.15.44:0/3265857426 <== osd.3 v2:172.21.15.44:6824/667769912 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcd800b5230 con 0x7fcd600729d0 2024-03-30T13:16:01.881 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:16:01.881 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:16:01.881 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:16:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.877+0000 7fcd86c00640 1 -- 172.21.15.44:0/3265857426 >> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] conn(0x7fcd600729d0 msgr2=0x7fcd60074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.877+0000 7fcd86c00640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.44:6824/667769912,v1:172.21.15.44:6825/667769912] conn(0x7fcd600729d0 0x7fcd60074e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.877+0000 7fcd86c00640 1 -- 172.21.15.44:0/3265857426 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcd6006c530 msgr2=0x7fcd6006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.877+0000 7fcd86c00640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fcd6006c530 0x7fcd6006e9f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c007fd0 tx=0x7fcd6c009040 comp rx=0 tx=0).stop 2024-03-30T13:16:01.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.877+0000 7fcd86c00640 1 -- 172.21.15.44:0/3265857426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd8006eb30 msgr2=0x7fcd800ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:01.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.877+0000 7fcd86c00640 1 --2- 172.21.15.44:0/3265857426 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcd8006eb30 0x7fcd800ad8a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fcd7402c4f0 tx=0x7fcd74004a40 comp rx=0 tx=0).stop 2024-03-30T13:16:01.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.877+0000 7fcd86200640 1 -- 172.21.15.44:0/3265857426 reap_dead start 2024-03-30T13:16:01.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.877+0000 7fcd86c00640 1 -- 172.21.15.44:0/3265857426 shutdown_connections 2024-03-30T13:16:01.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.877+0000 7fcd86c00640 1 -- 172.21.15.44:0/3265857426 >> 172.21.15.44:0/3265857426 conn(0x7fcd8006b9a0 msgr2=0x7fcd8006bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:01.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.878+0000 7fcd86c00640 1 -- 172.21.15.44:0/3265857426 shutdown_connections 2024-03-30T13:16:01.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:01.878+0000 7fcd86c00640 1 -- 172.21.15.44:0/3265857426 wait complete. 2024-03-30T13:16:01.901 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-30T13:16:02.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.118+0000 7fa36da00640 1 Processor -- start 2024-03-30T13:16:02.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.118+0000 7fa36da00640 1 -- start start 2024-03-30T13:16:02.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.120+0000 7fa36da00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa36815e3b0 0x7fa36806db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.120+0000 7fa36da00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa3680ad910 0x7fa3680aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.120+0000 7fa36da00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36815e790 con 0x7fa36806c590 2024-03-30T13:16:02.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.120+0000 7fa36da00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fa3680b4630 con 0x7fa3680ad910 2024-03-30T13:16:02.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.120+0000 7fa36da00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa3680b3a20 con 0x7fa36815e3b0 2024-03-30T13:16:02.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.121+0000 7fa367400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa3680ad910 0x7fa3680aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.121+0000 7fa367400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa3680ad910 0x7fa3680aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:38226/0 (socket says 172.21.15.44:38226) 2024-03-30T13:16:02.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.121+0000 7fa367400640 1 -- 172.21.15.44:0/3942374374 learned_addr learned my addr 172.21.15.44:0/3942374374 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:02.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.121+0000 7fa367e00640 1 --2- 172.21.15.44:0/3942374374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa36815e3b0 0x7fa36806db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.122+0000 7fa367e00640 1 -- 172.21.15.44:0/3942374374 >> v2:172.21.15.151:3300/0 conn(0x7fa3680ad910 msgr2=0x7fa3680aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:02.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.122+0000 7fa367e00640 1 --2- 172.21.15.44:0/3942374374 >> v2:172.21.15.151:3300/0 conn(0x7fa3680ad910 0x7fa3680aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.122+0000 7fa367e00640 1 -- 172.21.15.44:0/3942374374 >> v1:172.21.15.151:6789/0 conn(0x7fa36806c590 legacy=0x7fa368161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.122+0000 7fa367e00640 1 -- 172.21.15.44:0/3942374374 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3680b3d00 con 0x7fa36815e3b0 2024-03-30T13:16:02.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.123+0000 7fa367e00640 1 --2- 172.21.15.44:0/3942374374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa36815e3b0 0x7fa36806db00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa358009d90 tx=0x7fa35802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=585fd99d9811e146 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.124+0000 7fa366a00640 1 -- 172.21.15.44:0/3942374374 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa358039070 con 0x7fa36815e3b0 2024-03-30T13:16:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.124+0000 7fa366a00640 1 -- 172.21.15.44:0/3942374374 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35802cc50 con 0x7fa36815e3b0 2024-03-30T13:16:02.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.124+0000 7fa366a00640 1 -- 172.21.15.44:0/3942374374 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa358034440 con 0x7fa36815e3b0 2024-03-30T13:16:02.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.125+0000 7fa36da00640 1 -- 172.21.15.44:0/3942374374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa36815e3b0 msgr2=0x7fa36806db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.125+0000 7fa36da00640 1 --2- 172.21.15.44:0/3942374374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa36815e3b0 0x7fa36806db00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa358009d90 tx=0x7fa35802bea0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.125+0000 7fa36da00640 1 -- 172.21.15.44:0/3942374374 shutdown_connections 2024-03-30T13:16:02.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.125+0000 7fa36da00640 1 --2- 172.21.15.44:0/3942374374 >> v2:172.21.15.151:3300/0 conn(0x7fa3680ad910 0x7fa3680aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.125+0000 7fa36da00640 1 --2- 172.21.15.44:0/3942374374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa36815e3b0 0x7fa36806db00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.125+0000 7fa36da00640 1 -- 172.21.15.44:0/3942374374 >> 172.21.15.44:0/3942374374 conn(0x7fa368071b10 msgr2=0x7fa368071f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:02.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.125+0000 7fa36da00640 1 -- 172.21.15.44:0/3942374374 shutdown_connections 2024-03-30T13:16:02.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.125+0000 7fa36da00640 1 -- 172.21.15.44:0/3942374374 wait complete. 2024-03-30T13:16:02.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.127+0000 7fa36da00640 1 Processor -- start 2024-03-30T13:16:02.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.127+0000 7fa36da00640 1 -- start start 2024-03-30T13:16:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.128+0000 7fa36da00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa36806c590 0x7fa36813ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.128+0000 7fa36da00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3680ad910 0x7fa36815fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.128+0000 7fa36da00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa36815e3b0 0x7fa368162100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.128+0000 7fa36da00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa3680b3640 con 0x7fa36815e3b0 2024-03-30T13:16:02.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.128+0000 7fa36da00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa3680b42c0 con 0x7fa3680ad910 2024-03-30T13:16:02.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.128+0000 7fa36da00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fa3680b37c0 con 0x7fa36806c590 2024-03-30T13:16:02.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.128+0000 7fa36d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa36815e3b0 0x7fa368162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.129+0000 7fa36d000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa36815e3b0 0x7fa368162100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51820/0 (socket says 172.21.15.44:51820) 2024-03-30T13:16:02.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.129+0000 7fa36d000640 1 -- 172.21.15.44:0/1601233800 learned_addr learned my addr 172.21.15.44:0/1601233800 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:02.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.129+0000 7fa367e00640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa36806c590 0x7fa36813ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.129+0000 7fa367400640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3680ad910 0x7fa36815fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.129+0000 7fa36d000640 1 -- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa36806c590 msgr2=0x7fa36813ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.129+0000 7fa36d000640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa36806c590 0x7fa36813ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.129+0000 7fa36d000640 1 -- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3680ad910 msgr2=0x7fa36815fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.129+0000 7fa36d000640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3680ad910 0x7fa36815fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.129+0000 7fa36d000640 1 -- 172.21.15.44:0/1601233800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36815ee30 con 0x7fa36815e3b0 2024-03-30T13:16:02.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.129+0000 7fa367400640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3680ad910 0x7fa36815fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:16:02.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.129+0000 7fa36d000640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa36815e3b0 0x7fa368162100 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa36000c3c0 tx=0x7fa36000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:02.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.130+0000 7fa35fe00640 1 -- 172.21.15.44:0/1601233800 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360017070 con 0x7fa36815e3b0 2024-03-30T13:16:02.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.130+0000 7fa35fe00640 1 -- 172.21.15.44:0/1601233800 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3600052d0 con 0x7fa36815e3b0 2024-03-30T13:16:02.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.130+0000 7fa35fe00640 1 -- 172.21.15.44:0/1601233800 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360003830 con 0x7fa36815e3b0 2024-03-30T13:16:02.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.130+0000 7fa36da00640 1 -- 172.21.15.44:0/1601233800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa36815f110 con 0x7fa36815e3b0 2024-03-30T13:16:02.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.130+0000 7fa36da00640 1 -- 172.21.15.44:0/1601233800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa36815f6d0 con 0x7fa36815e3b0 2024-03-30T13:16:02.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.131+0000 7fa36da00640 1 -- 172.21.15.44:0/1601233800 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3680685e0 con 0x7fa36815e3b0 2024-03-30T13:16:02.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.132+0000 7fa35fe00640 1 -- 172.21.15.44:0/1601233800 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa36001a070 con 0x7fa36815e3b0 2024-03-30T13:16:02.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.133+0000 7fa35fe00640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa34806c530 0x7fa34806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.133+0000 7fa35fe00640 1 -- 172.21.15.44:0/1601233800 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fa36008a810 con 0x7fa36815e3b0 2024-03-30T13:16:02.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.134+0000 7fa367e00640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa34806c530 0x7fa34806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.136+0000 7fa367e00640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa34806c530 0x7fa34806e9f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa358036000 tx=0x7fa358030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:02.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.138+0000 7fa35fe00640 1 -- 172.21.15.44:0/1601233800 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa3680685e0 con 0x7fa36815e3b0 2024-03-30T13:16:02.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.340+0000 7fa36da00640 1 -- 172.21.15.44:0/1601233800 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa3680af160 con 0x7fa34806c530 2024-03-30T13:16:02.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.341+0000 7fa35fe00640 1 -- 172.21.15.44:0/1601233800 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa3680af160 con 0x7fa34806c530 2024-03-30T13:16:02.345 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 3 to deep-scrub 2024-03-30T13:16:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.343+0000 7fa36da00640 1 -- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa34806c530 msgr2=0x7fa34806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.343+0000 7fa36da00640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa34806c530 0x7fa34806e9f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa358036000 tx=0x7fa358030000 comp rx=0 tx=0).stop 2024-03-30T13:16:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.344+0000 7fa36da00640 1 -- 172.21.15.44:0/1601233800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa36815e3b0 msgr2=0x7fa368162100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.344+0000 7fa36da00640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa36815e3b0 0x7fa368162100 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fa36000c3c0 tx=0x7fa36000c880 comp rx=0 tx=0).stop 2024-03-30T13:16:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.344+0000 7fa36da00640 1 -- 172.21.15.44:0/1601233800 shutdown_connections 2024-03-30T13:16:02.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.344+0000 7fa36da00640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa36815e3b0 0x7fa368162100 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.344+0000 7fa36da00640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fa34806c530 0x7fa34806e9f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.344+0000 7fa36da00640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3680ad910 0x7fa36815fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.344+0000 7fa36da00640 1 --2- 172.21.15.44:0/1601233800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa36806c590 0x7fa36813ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.344+0000 7fa36da00640 1 -- 172.21.15.44:0/1601233800 >> 172.21.15.44:0/1601233800 conn(0x7fa368071b10 msgr2=0x7fa36806dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:02.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.344+0000 7fa36da00640 1 -- 172.21.15.44:0/1601233800 shutdown_connections 2024-03-30T13:16:02.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.344+0000 7fa36da00640 1 -- 172.21.15.44:0/1601233800 wait complete. 2024-03-30T13:16:02.365 INFO:tasks.ceph:Scrubbing osd.4 2024-03-30T13:16:02.365 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:16:02.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.592+0000 7fec11400640 1 Processor -- start 2024-03-30T13:16:02.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.593+0000 7fec11400640 1 -- start start 2024-03-30T13:16:02.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.594+0000 7fec11400640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fec0c144a80 0x7fec0c071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.594+0000 7fec11400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fec0c0720b0 0x7fec0c0cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.594+0000 7fec11400640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec0c0b2fc0 con 0x7fec0c0cd950 2024-03-30T13:16:02.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.594+0000 7fec11400640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fec0c0b32a0 con 0x7fec0c0720b0 2024-03-30T13:16:02.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.594+0000 7fec11400640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fec0c0b3580 con 0x7fec0c144a80 2024-03-30T13:16:02.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.594+0000 7fec0b200640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fec0c0cd950 0x7fec0c0b4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46944/0 (socket says 172.21.15.44:46944) 2024-03-30T13:16:02.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.595+0000 7fec0b200640 1 -- 172.21.15.44:0/3293995136 learned_addr learned my addr 172.21.15.44:0/3293995136 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:16:02.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.595+0000 7fec09e00640 1 --2- 172.21.15.44:0/3293995136 >> v2:172.21.15.44:3300/0 conn(0x7fec0c0720b0 0x7fec0c0cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.595+0000 7fec0a800640 1 --2- 172.21.15.44:0/3293995136 >> v2:172.21.15.151:3300/0 conn(0x7fec0c144a80 0x7fec0c071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.595+0000 7fec09400640 1 -- 172.21.15.44:0/3293995136 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440282392 0 0) 0x7fec0c0b2fc0 con 0x7fec0c0cd950 2024-03-30T13:16:02.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.595+0000 7fec09400640 1 -- 172.21.15.44:0/3293995136 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febf0003520 con 0x7fec0c0cd950 2024-03-30T13:16:02.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.595+0000 7fec09e00640 1 -- 172.21.15.44:0/3293995136 >> v2:172.21.15.151:3300/0 conn(0x7fec0c144a80 msgr2=0x7fec0c071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:02.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.595+0000 7fec09e00640 1 --2- 172.21.15.44:0/3293995136 >> v2:172.21.15.151:3300/0 conn(0x7fec0c144a80 0x7fec0c071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.604 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.595+0000 7fec09e00640 1 -- 172.21.15.44:0/3293995136 >> v1:172.21.15.44:6789/0 conn(0x7fec0c0cd950 legacy=0x7fec0c0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.595+0000 7fec09e00640 1 -- 172.21.15.44:0/3293995136 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0c0b3860 con 0x7fec0c0720b0 2024-03-30T13:16:02.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.596+0000 7fec09e00640 1 --2- 172.21.15.44:0/3293995136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec0c0720b0 0x7fec0c0cfea0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0b5610 tx=0x7febf802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f83a922db9d2547 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:02.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.597+0000 7fec09400640 1 -- 172.21.15.44:0/3293995136 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8035020 con 0x7fec0c0720b0 2024-03-30T13:16:02.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.597+0000 7fec09400640 1 -- 172.21.15.44:0/3293995136 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf8031830 con 0x7fec0c0720b0 2024-03-30T13:16:02.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.597+0000 7fec09400640 1 -- 172.21.15.44:0/3293995136 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8031be0 con 0x7fec0c0720b0 2024-03-30T13:16:02.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.597+0000 7fec11400640 1 -- 172.21.15.44:0/3293995136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec0c0720b0 msgr2=0x7fec0c0cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.597+0000 7fec11400640 1 --2- 172.21.15.44:0/3293995136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec0c0720b0 0x7fec0c0cfea0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0b5610 tx=0x7febf802b8d0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.597+0000 7fec11400640 1 -- 172.21.15.44:0/3293995136 shutdown_connections 2024-03-30T13:16:02.605 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.598+0000 7fec11400640 1 --2- 172.21.15.44:0/3293995136 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec0c0720b0 0x7fec0c0cfea0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.598+0000 7fec11400640 1 --2- 172.21.15.44:0/3293995136 >> v2:172.21.15.151:3300/0 conn(0x7fec0c144a80 0x7fec0c071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.598+0000 7fec11400640 1 -- 172.21.15.44:0/3293995136 >> 172.21.15.44:0/3293995136 conn(0x7fec0c06f060 msgr2=0x7fec0c06b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:02.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.598+0000 7fec11400640 1 -- 172.21.15.44:0/3293995136 shutdown_connections 2024-03-30T13:16:02.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.598+0000 7fec11400640 1 -- 172.21.15.44:0/3293995136 wait complete. 2024-03-30T13:16:02.606 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.599+0000 7fec11400640 1 Processor -- start 2024-03-30T13:16:02.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.599+0000 7fec11400640 1 -- start start 2024-03-30T13:16:02.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.600+0000 7fec11400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec0c0720b0 0x7fec0c152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.600+0000 7fec11400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec0c0cd950 0x7fec0c151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.600+0000 7fec11400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec0c144a80 0x7fec0c13dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.600+0000 7fec11400640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c071620 con 0x7fec0c0720b0 2024-03-30T13:16:02.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.600+0000 7fec11400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c144e60 con 0x7fec0c0cd950 2024-03-30T13:16:02.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.600+0000 7fec11400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fec0c0717a0 con 0x7fec0c144a80 2024-03-30T13:16:02.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.601+0000 7fec0a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec0c0720b0 0x7fec0c152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.601+0000 7fec0a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec0c0720b0 0x7fec0c152750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51844/0 (socket says 172.21.15.44:51844) 2024-03-30T13:16:02.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.601+0000 7fec0a800640 1 -- 172.21.15.44:0/3657672178 learned_addr learned my addr 172.21.15.44:0/3657672178 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:02.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.601+0000 7fec09e00640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec0c0cd950 0x7fec0c151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.601+0000 7fec0b200640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec0c144a80 0x7fec0c13dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.601+0000 7fec0a800640 1 -- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec0c144a80 msgr2=0x7fec0c13dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.601+0000 7fec0a800640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec0c144a80 0x7fec0c13dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.601+0000 7fec0a800640 1 -- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec0c0cd950 msgr2=0x7fec0c151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.601+0000 7fec0a800640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec0c0cd950 0x7fec0c151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.601+0000 7fec0a800640 1 -- 172.21.15.44:0/3657672178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0c143120 con 0x7fec0c0720b0 2024-03-30T13:16:02.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.601+0000 7fec09e00640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec0c0cd950 0x7fec0c151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:16:02.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.601+0000 7fec0a800640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec0c0720b0 0x7fec0c152750 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7febfc00efc0 tx=0x7febfc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:02.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.602+0000 7fec02a00640 1 -- 172.21.15.44:0/3657672178 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc018020 con 0x7fec0c0720b0 2024-03-30T13:16:02.610 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.602+0000 7fec02a00640 1 -- 172.21.15.44:0/3657672178 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febfc014480 con 0x7fec0c0720b0 2024-03-30T13:16:02.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.602+0000 7fec11400640 1 -- 172.21.15.44:0/3657672178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0c1436a0 con 0x7fec0c0720b0 2024-03-30T13:16:02.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.602+0000 7fec02a00640 1 -- 172.21.15.44:0/3657672178 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc014850 con 0x7fec0c0720b0 2024-03-30T13:16:02.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.602+0000 7fec11400640 1 -- 172.21.15.44:0/3657672178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0c141900 con 0x7fec0c0720b0 2024-03-30T13:16:02.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.603+0000 7fec11400640 1 -- 172.21.15.44:0/3657672178 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec0c167270 con 0x7fec0c0720b0 2024-03-30T13:16:02.611 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.604+0000 7fec02a00640 1 -- 172.21.15.44:0/3657672178 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7febfc005d10 con 0x7fec0c0720b0 2024-03-30T13:16:02.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.605+0000 7fec02a00640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7febec06c530 0x7febec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.612 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.605+0000 7fec02a00640 1 -- 172.21.15.44:0/3657672178 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7febfc08bfe0 con 0x7fec0c0720b0 2024-03-30T13:16:02.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.605+0000 7fec02a00640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] conn(0x7febec0729d0 0x7febec074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.605+0000 7fec02a00640 1 -- 172.21.15.44:0/3657672178 --> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7febfc00be50 con 0x7febec0729d0 2024-03-30T13:16:02.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.605+0000 7fec02a00640 1 -- 172.21.15.44:0/3657672178 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7febfc08e600 con 0x7fec0c0720b0 2024-03-30T13:16:02.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.605+0000 7fec09e00640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7febec06c530 0x7febec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.606+0000 7fec0b200640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] conn(0x7febec0729d0 0x7febec074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.606+0000 7fec09e00640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7febec06c530 0x7febec06e9f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7febf8036000 tx=0x7febf8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:02.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.606+0000 7fec0b200640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] conn(0x7febec0729d0 0x7febec074e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:02.613 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.608+0000 7fec02a00640 1 -- 172.21.15.44:0/3657672178 <== osd.4 v2:172.21.15.151:6816/1952435005 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7febfc00be50 con 0x7febec0729d0 2024-03-30T13:16:02.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.623+0000 7fec11400640 1 -- 172.21.15.44:0/3657672178 --> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fec0c071b70 con 0x7febec0729d0 2024-03-30T13:16:02.628 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.624+0000 7fec02a00640 1 -- 172.21.15.44:0/3657672178 <== osd.4 v2:172.21.15.151:6816/1952435005 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fec0c071b70 con 0x7febec0729d0 2024-03-30T13:16:02.628 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:16:02.628 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:16:02.628 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:16:02.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.624+0000 7fec11400640 1 -- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] conn(0x7febec0729d0 msgr2=0x7febec074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.624+0000 7fec11400640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:6816/1952435005,v1:172.21.15.151:6817/1952435005] conn(0x7febec0729d0 0x7febec074e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.629 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.624+0000 7fec11400640 1 -- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7febec06c530 msgr2=0x7febec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.624+0000 7fec11400640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7febec06c530 0x7febec06e9f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7febf8036000 tx=0x7febf8008030 comp rx=0 tx=0).stop 2024-03-30T13:16:02.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.624+0000 7fec11400640 1 -- 172.21.15.44:0/3657672178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec0c0720b0 msgr2=0x7fec0c152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.624+0000 7fec11400640 1 --2- 172.21.15.44:0/3657672178 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec0c0720b0 0x7fec0c152750 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7febfc00efc0 tx=0x7febfc00c490 comp rx=0 tx=0).stop 2024-03-30T13:16:02.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.625+0000 7fec0b200640 1 -- 172.21.15.44:0/3657672178 reap_dead start 2024-03-30T13:16:02.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.625+0000 7fec11400640 1 -- 172.21.15.44:0/3657672178 shutdown_connections 2024-03-30T13:16:02.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.625+0000 7fec11400640 1 -- 172.21.15.44:0/3657672178 >> 172.21.15.44:0/3657672178 conn(0x7fec0c06f060 msgr2=0x7fec0c0cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:02.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.625+0000 7fec11400640 1 -- 172.21.15.44:0/3657672178 shutdown_connections 2024-03-30T13:16:02.630 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.625+0000 7fec11400640 1 -- 172.21.15.44:0/3657672178 wait complete. 2024-03-30T13:16:02.644 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-30T13:16:02.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.855+0000 7f8e56a00640 1 Processor -- start 2024-03-30T13:16:02.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.855+0000 7f8e56a00640 1 -- start start 2024-03-30T13:16:02.860 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.856+0000 7f8e56a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e5015fba0 0x7f8e50071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.856+0000 7f8e56a00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8e50160a80 0x7f8e500cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.856+0000 7f8e56a00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e50071fe0 con 0x7f8e500cca60 2024-03-30T13:16:02.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.856+0000 7f8e56a00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f8e50071a20 con 0x7f8e50160a80 2024-03-30T13:16:02.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.856+0000 7f8e56a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f8e50071d00 con 0x7f8e5015fba0 2024-03-30T13:16:02.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.857+0000 7f8e4f400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f8e50160a80 0x7f8e500cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.857+0000 7f8e54a00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f8e500cca60 0x7f8e500b2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46948/0 (socket says 172.21.15.44:46948) 2024-03-30T13:16:02.861 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.857+0000 7f8e54a00640 1 -- 172.21.15.44:0/312907985 learned_addr learned my addr 172.21.15.44:0/312907985 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:16:02.862 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.857+0000 7f8e4f400640 1 -- 172.21.15.44:0/312907985 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e5015fba0 msgr2=0x7f8e50071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:02.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.857+0000 7f8e4f400640 1 --2- 172.21.15.44:0/312907985 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e5015fba0 0x7f8e50071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.857+0000 7f8e4f400640 1 -- 172.21.15.44:0/312907985 >> v1:172.21.15.44:6789/0 conn(0x7f8e500cca60 legacy=0x7f8e500b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.857+0000 7f8e4ea00640 1 -- 172.21.15.44:0/312907985 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908812498 0 0) 0x7f8e50071fe0 con 0x7f8e500cca60 2024-03-30T13:16:02.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.857+0000 7f8e4f400640 1 -- 172.21.15.44:0/312907985 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e500cabf0 con 0x7f8e50160a80 2024-03-30T13:16:02.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.858+0000 7f8e4f400640 1 --2- 172.21.15.44:0/312907985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e50160a80 0x7f8e500cb3f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0097a0 tx=0x7f8e3c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f8a9a71ab4d7c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:02.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.859+0000 7f8e4ea00640 1 -- 172.21.15.44:0/312907985 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c035020 con 0x7f8e50160a80 2024-03-30T13:16:02.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.859+0000 7f8e4ea00640 1 -- 172.21.15.44:0/312907985 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3c031830 con 0x7f8e50160a80 2024-03-30T13:16:02.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.859+0000 7f8e4ea00640 1 -- 172.21.15.44:0/312907985 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c031c00 con 0x7f8e50160a80 2024-03-30T13:16:02.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.859+0000 7f8e56a00640 1 -- 172.21.15.44:0/312907985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e50160a80 msgr2=0x7f8e500cb3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.864 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.859+0000 7f8e56a00640 1 --2- 172.21.15.44:0/312907985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e50160a80 0x7f8e500cb3f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0097a0 tx=0x7f8e3c02b8d0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.859+0000 7f8e56a00640 1 -- 172.21.15.44:0/312907985 shutdown_connections 2024-03-30T13:16:02.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.859+0000 7f8e56a00640 1 --2- 172.21.15.44:0/312907985 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e50160a80 0x7f8e500cb3f0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.859+0000 7f8e56a00640 1 --2- 172.21.15.44:0/312907985 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e5015fba0 0x7f8e50071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.859+0000 7f8e56a00640 1 -- 172.21.15.44:0/312907985 >> 172.21.15.44:0/312907985 conn(0x7f8e5006d610 msgr2=0x7f8e5006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:02.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.859+0000 7f8e56a00640 1 -- 172.21.15.44:0/312907985 shutdown_connections 2024-03-30T13:16:02.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.860+0000 7f8e56a00640 1 -- 172.21.15.44:0/312907985 wait complete. 2024-03-30T13:16:02.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.861+0000 7f8e56a00640 1 Processor -- start 2024-03-30T13:16:02.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.861+0000 7f8e56a00640 1 -- start start 2024-03-30T13:16:02.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.862+0000 7f8e56a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e500cca60 0x7f8e50144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.862+0000 7f8e56a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5015fba0 0x7f8e500b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.862+0000 7f8e56a00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e50160a80 0x7f8e50158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.862+0000 7f8e56a00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8e50160ee0 con 0x7f8e5015fba0 2024-03-30T13:16:02.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.862+0000 7f8e56a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8e500cb930 con 0x7f8e500cca60 2024-03-30T13:16:02.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.862+0000 7f8e56a00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f8e50161060 con 0x7f8e50160a80 2024-03-30T13:16:02.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.862+0000 7f8e4f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5015fba0 0x7f8e500b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.863+0000 7f8e4f400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5015fba0 0x7f8e500b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51860/0 (socket says 172.21.15.44:51860) 2024-03-30T13:16:02.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.863+0000 7f8e4f400640 1 -- 172.21.15.44:0/3017184713 learned_addr learned my addr 172.21.15.44:0/3017184713 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:02.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.863+0000 7f8e4fe00640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e500cca60 0x7f8e50144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.863+0000 7f8e4f400640 1 -- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e50160a80 msgr2=0x7f8e50158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.863+0000 7f8e4f400640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e50160a80 0x7f8e50158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.863+0000 7f8e4f400640 1 -- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e500cca60 msgr2=0x7f8e50144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:02.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.863+0000 7f8e4f400640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e500cca60 0x7f8e50144a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:02.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.863+0000 7f8e4f400640 1 -- 172.21.15.44:0/3017184713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e500b5c50 con 0x7f8e5015fba0 2024-03-30T13:16:02.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.863+0000 7f8e4f400640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5015fba0 0x7f8e500b5710 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0098c0 tx=0x7f8e3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:02.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.864+0000 7f8e47e00640 1 -- 172.21.15.44:0/3017184713 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c03b9c0 con 0x7f8e5015fba0 2024-03-30T13:16:02.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.864+0000 7f8e47e00640 1 -- 172.21.15.44:0/3017184713 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3c03bb60 con 0x7f8e5015fba0 2024-03-30T13:16:02.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.864+0000 7f8e47e00640 1 -- 172.21.15.44:0/3017184713 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c0453f0 con 0x7f8e5015fba0 2024-03-30T13:16:02.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.864+0000 7f8e56a00640 1 -- 172.21.15.44:0/3017184713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e501575d0 con 0x7f8e5015fba0 2024-03-30T13:16:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.864+0000 7f8e56a00640 1 -- 172.21.15.44:0/3017184713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e50157b90 con 0x7f8e5015fba0 2024-03-30T13:16:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.865+0000 7f8e56a00640 1 -- 172.21.15.44:0/3017184713 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e50075900 con 0x7f8e5015fba0 2024-03-30T13:16:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.866+0000 7f8e47e00640 1 -- 172.21.15.44:0/3017184713 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8e3c038020 con 0x7f8e5015fba0 2024-03-30T13:16:02.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.867+0000 7f8e47e00640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8e3006c530 0x7f8e3006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:02.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.867+0000 7f8e47e00640 1 -- 172.21.15.44:0/3017184713 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f8e3c0ad3a0 con 0x7f8e5015fba0 2024-03-30T13:16:02.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.867+0000 7f8e4fe00640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8e3006c530 0x7f8e3006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:02.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.868+0000 7f8e4fe00640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8e3006c530 0x7f8e3006e9f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8e500c6bc0 tx=0x7f8e40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:02.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:02.871+0000 7f8e47e00640 1 -- 172.21.15.44:0/3017184713 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8e3c040070 con 0x7f8e5015fba0 2024-03-30T13:16:03.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.075+0000 7f8e56a00640 1 -- 172.21.15.44:0/3017184713 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f8e500c63a0 con 0x7f8e3006c530 2024-03-30T13:16:03.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.076+0000 7f8e47e00640 1 -- 172.21.15.44:0/3017184713 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8e40009480 con 0x7f8e3006c530 2024-03-30T13:16:03.080 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 4 to deep-scrub 2024-03-30T13:16:03.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.079+0000 7f8e56a00640 1 -- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8e3006c530 msgr2=0x7f8e3006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.079+0000 7f8e56a00640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8e3006c530 0x7f8e3006e9f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8e500c6bc0 tx=0x7f8e40008040 comp rx=0 tx=0).stop 2024-03-30T13:16:03.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.079+0000 7f8e56a00640 1 -- 172.21.15.44:0/3017184713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5015fba0 msgr2=0x7f8e500b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.079+0000 7f8e56a00640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5015fba0 0x7f8e500b5710 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c0098c0 tx=0x7f8e3c0046c0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.079+0000 7f8e56a00640 1 -- 172.21.15.44:0/3017184713 shutdown_connections 2024-03-30T13:16:03.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.079+0000 7f8e56a00640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e50160a80 0x7f8e50158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.079+0000 7f8e56a00640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8e5015fba0 0x7f8e500b5710 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.079+0000 7f8e56a00640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f8e3006c530 0x7f8e3006e9f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.079+0000 7f8e56a00640 1 --2- 172.21.15.44:0/3017184713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e500cca60 0x7f8e50144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.079+0000 7f8e56a00640 1 -- 172.21.15.44:0/3017184713 >> 172.21.15.44:0/3017184713 conn(0x7f8e5006d610 msgr2=0x7f8e500cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:03.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.079+0000 7f8e56a00640 1 -- 172.21.15.44:0/3017184713 shutdown_connections 2024-03-30T13:16:03.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.079+0000 7f8e56a00640 1 -- 172.21.15.44:0/3017184713 wait complete. 2024-03-30T13:16:03.101 INFO:tasks.ceph:Scrubbing osd.5 2024-03-30T13:16:03.102 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:16:03.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.311+0000 7f5409c00640 1 Processor -- start 2024-03-30T13:16:03.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.311+0000 7f5409c00640 1 -- start start 2024-03-30T13:16:03.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.313+0000 7f5409c00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f54040b5870 0x7f54040d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.313+0000 7f5409c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54040c7870 0x7f54040d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.313+0000 7f5409c00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5404162010 con 0x7f5404161c30 2024-03-30T13:16:03.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.313+0000 7f5409c00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f54040b31c0 con 0x7f54040b5870 2024-03-30T13:16:03.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.313+0000 7f5409c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f54040d22f0 con 0x7f54040c7870 2024-03-30T13:16:03.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.313+0000 7f5403e00640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f5404161c30 0x7f54040d2dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:38280/0 (socket says 172.21.15.44:38280) 2024-03-30T13:16:03.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.313+0000 7f5403e00640 1 -- 172.21.15.44:0/1579770131 learned_addr learned my addr 172.21.15.44:0/1579770131 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:16:03.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.313+0000 7f5409200640 1 --2- 172.21.15.44:0/1579770131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54040c7870 0x7f54040d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.313+0000 7f5403400640 1 --2- 172.21.15.44:0/1579770131 >> v2:172.21.15.151:3300/0 conn(0x7f54040b5870 0x7f54040d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.314+0000 7f5402a00640 1 -- 172.21.15.44:0/1579770131 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4137267004 0 0) 0x7f53f4001110 con 0x7f5404161c30 2024-03-30T13:16:03.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.314+0000 7f5402a00640 1 -- 172.21.15.44:0/1579770131 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53e8003520 con 0x7f5404161c30 2024-03-30T13:16:03.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.314+0000 7f5409200640 1 -- 172.21.15.44:0/1579770131 >> v2:172.21.15.151:3300/0 conn(0x7f54040b5870 msgr2=0x7f54040d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:03.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.314+0000 7f5409200640 1 --2- 172.21.15.44:0/1579770131 >> v2:172.21.15.151:3300/0 conn(0x7f54040b5870 0x7f54040d09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.314+0000 7f5409200640 1 -- 172.21.15.44:0/1579770131 >> v1:172.21.15.151:6789/0 conn(0x7f5404161c30 legacy=0x7f54040d2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.314+0000 7f5409200640 1 -- 172.21.15.44:0/1579770131 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54040d25d0 con 0x7f54040c7870 2024-03-30T13:16:03.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.315+0000 7f5409200640 1 --2- 172.21.15.44:0/1579770131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54040c7870 0x7f54040d0f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009d90 tx=0x7f53fc02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11020529733a0d98 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:03.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.316+0000 7f5402a00640 1 -- 172.21.15.44:0/1579770131 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc039070 con 0x7f54040c7870 2024-03-30T13:16:03.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.316+0000 7f5402a00640 1 -- 172.21.15.44:0/1579770131 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc02cc50 con 0x7f54040c7870 2024-03-30T13:16:03.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.316+0000 7f5402a00640 1 -- 172.21.15.44:0/1579770131 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc034440 con 0x7f54040c7870 2024-03-30T13:16:03.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.317+0000 7f5409c00640 1 -- 172.21.15.44:0/1579770131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54040c7870 msgr2=0x7f54040d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.317+0000 7f5409c00640 1 --2- 172.21.15.44:0/1579770131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54040c7870 0x7f54040d0f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009d90 tx=0x7f53fc02bea0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.317+0000 7f5409c00640 1 -- 172.21.15.44:0/1579770131 shutdown_connections 2024-03-30T13:16:03.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.317+0000 7f5409c00640 1 --2- 172.21.15.44:0/1579770131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54040c7870 0x7f54040d0f30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.317+0000 7f5409c00640 1 --2- 172.21.15.44:0/1579770131 >> v2:172.21.15.151:3300/0 conn(0x7f54040b5870 0x7f54040d09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.317+0000 7f5409c00640 1 -- 172.21.15.44:0/1579770131 >> 172.21.15.44:0/1579770131 conn(0x7f540409d510 msgr2=0x7f54040d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:03.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.317+0000 7f5409c00640 1 -- 172.21.15.44:0/1579770131 shutdown_connections 2024-03-30T13:16:03.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.317+0000 7f5409c00640 1 -- 172.21.15.44:0/1579770131 wait complete. 2024-03-30T13:16:03.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.319+0000 7f5409c00640 1 Processor -- start 2024-03-30T13:16:03.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.319+0000 7f5409c00640 1 -- start start 2024-03-30T13:16:03.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.320+0000 7f5409c00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54040b5870 0x7f54040c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.320+0000 7f5409c00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54040c7870 0x7f54040ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.320+0000 7f5409c00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5404161c30 0x7f54040b9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.320+0000 7f5409c00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54040b3780 con 0x7f5404161c30 2024-03-30T13:16:03.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.320+0000 7f5409c00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f54040b3600 con 0x7f54040c7870 2024-03-30T13:16:03.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.320+0000 7f5409c00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f54040cefd0 con 0x7f54040b5870 2024-03-30T13:16:03.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.320+0000 7f5409200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5404161c30 0x7f54040b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.320+0000 7f5409200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5404161c30 0x7f54040b9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51872/0 (socket says 172.21.15.44:51872) 2024-03-30T13:16:03.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.320+0000 7f5409200640 1 -- 172.21.15.44:0/1157724743 learned_addr learned my addr 172.21.15.44:0/1157724743 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:03.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.320+0000 7f5403400640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54040c7870 0x7f54040ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.320+0000 7f5403e00640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54040b5870 0x7f54040c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.321+0000 7f5409200640 1 -- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54040b5870 msgr2=0x7f54040c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.321+0000 7f5409200640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54040b5870 0x7f54040c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.321+0000 7f5409200640 1 -- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54040c7870 msgr2=0x7f54040ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.321+0000 7f5409200640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54040c7870 0x7f54040ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.326 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.321+0000 7f5409200640 1 -- 172.21.15.44:0/1157724743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54040b9be0 con 0x7f5404161c30 2024-03-30T13:16:03.327 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.321+0000 7f5409200640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5404161c30 0x7f54040b9190 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009eb0 tx=0x7f53fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:03.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.321+0000 7f53fbe00640 1 -- 172.21.15.44:0/1157724743 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc044020 con 0x7f5404161c30 2024-03-30T13:16:03.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.321+0000 7f53fbe00640 1 -- 172.21.15.44:0/1157724743 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53fc035e50 con 0x7f5404161c30 2024-03-30T13:16:03.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.321+0000 7f5409c00640 1 -- 172.21.15.44:0/1157724743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54040cb5f0 con 0x7f5404161c30 2024-03-30T13:16:03.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.321+0000 7f53fbe00640 1 -- 172.21.15.44:0/1157724743 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc039040 con 0x7f5404161c30 2024-03-30T13:16:03.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.322+0000 7f5409c00640 1 -- 172.21.15.44:0/1157724743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54040cbbb0 con 0x7f5404161c30 2024-03-30T13:16:03.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.322+0000 7f5409c00640 1 -- 172.21.15.44:0/1157724743 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5404075890 con 0x7f5404161c30 2024-03-30T13:16:03.328 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.324+0000 7f53fbe00640 1 -- 172.21.15.44:0/1157724743 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f53fc047020 con 0x7f5404161c30 2024-03-30T13:16:03.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.325+0000 7f53fbe00640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f53e406c530 0x7f53e406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.325+0000 7f53fbe00640 1 -- 172.21.15.44:0/1157724743 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f53fc0ae200 con 0x7f5404161c30 2024-03-30T13:16:03.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.325+0000 7f53fbe00640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] conn(0x7f53e40729d0 0x7f53e4074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.325+0000 7f53fbe00640 1 -- 172.21.15.44:0/1157724743 --> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53fc0020b0 con 0x7f53e40729d0 2024-03-30T13:16:03.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.325+0000 7f53fbe00640 1 -- 172.21.15.44:0/1157724743 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f53fc0ae5b0 con 0x7f5404161c30 2024-03-30T13:16:03.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.325+0000 7f5403e00640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f53e406c530 0x7f53e406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.326+0000 7f5403400640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] conn(0x7f53e40729d0 0x7f53e4074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.326+0000 7f5403e00640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f53e406c530 0x7f53e406e9f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f53f40013d0 tx=0x7f53f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:03.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.327+0000 7f5403400640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] conn(0x7f53e40729d0 0x7f53e4074e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:03.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.329+0000 7f53fbe00640 1 -- 172.21.15.44:0/1157724743 <== osd.5 v2:172.21.15.151:6800/3241621332 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53fc0020b0 con 0x7f53e40729d0 2024-03-30T13:16:03.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.344+0000 7f5409c00640 1 -- 172.21.15.44:0/1157724743 --> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f54040680b0 con 0x7f53e40729d0 2024-03-30T13:16:03.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.345+0000 7f53fbe00640 1 -- 172.21.15.44:0/1157724743 <== osd.5 v2:172.21.15.151:6800/3241621332 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f54040680b0 con 0x7f53e40729d0 2024-03-30T13:16:03.349 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:16:03.349 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:16:03.349 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:16:03.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.345+0000 7f5409c00640 1 -- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] conn(0x7f53e40729d0 msgr2=0x7f53e4074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.345+0000 7f5409c00640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:6800/3241621332,v1:172.21.15.151:6801/3241621332] conn(0x7f53e40729d0 0x7f53e4074e10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.346+0000 7f5409c00640 1 -- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f53e406c530 msgr2=0x7f53e406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.346+0000 7f5409c00640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f53e406c530 0x7f53e406e9f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f53f40013d0 tx=0x7f53f4009040 comp rx=0 tx=0).stop 2024-03-30T13:16:03.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.346+0000 7f5409c00640 1 -- 172.21.15.44:0/1157724743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5404161c30 msgr2=0x7f54040b9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.346+0000 7f5409c00640 1 --2- 172.21.15.44:0/1157724743 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5404161c30 0x7f54040b9190 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009eb0 tx=0x7f53fc004a40 comp rx=0 tx=0).stop 2024-03-30T13:16:03.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.346+0000 7f5409200640 1 -- 172.21.15.44:0/1157724743 reap_dead start 2024-03-30T13:16:03.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.346+0000 7f5409c00640 1 -- 172.21.15.44:0/1157724743 shutdown_connections 2024-03-30T13:16:03.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.346+0000 7f5409c00640 1 -- 172.21.15.44:0/1157724743 >> 172.21.15.44:0/1157724743 conn(0x7f540409d510 msgr2=0x7f54040b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:03.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.346+0000 7f5409c00640 1 -- 172.21.15.44:0/1157724743 shutdown_connections 2024-03-30T13:16:03.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.346+0000 7f5409c00640 1 -- 172.21.15.44:0/1157724743 wait complete. 2024-03-30T13:16:03.369 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-30T13:16:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.576+0000 7fd67bc00640 1 Processor -- start 2024-03-30T13:16:03.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.576+0000 7fd67bc00640 1 -- start start 2024-03-30T13:16:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.577+0000 7fd67bc00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd67415fba0 0x7fd674071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.577+0000 7fd67bc00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd674160a80 0x7fd6740cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.577+0000 7fd67bc00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd674071fe0 con 0x7fd6740cca60 2024-03-30T13:16:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.577+0000 7fd67bc00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd674071a20 con 0x7fd67415fba0 2024-03-30T13:16:03.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.577+0000 7fd67bc00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fd674071d00 con 0x7fd674160a80 2024-03-30T13:16:03.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.577+0000 7fd679200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd67415fba0 0x7fd674071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.577+0000 7fd679200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd67415fba0 0x7fd674071440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51874/0 (socket says 172.21.15.44:51874) 2024-03-30T13:16:03.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.578+0000 7fd679200640 1 -- 172.21.15.44:0/2010780863 learned_addr learned my addr 172.21.15.44:0/2010780863 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:03.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.578+0000 7fd673e00640 1 --2- 172.21.15.44:0/2010780863 >> v2:172.21.15.151:3300/0 conn(0x7fd674160a80 0x7fd6740cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.578+0000 7fd679200640 1 -- 172.21.15.44:0/2010780863 >> v2:172.21.15.151:3300/0 conn(0x7fd674160a80 msgr2=0x7fd6740cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:03.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.578+0000 7fd679200640 1 --2- 172.21.15.44:0/2010780863 >> v2:172.21.15.151:3300/0 conn(0x7fd674160a80 0x7fd6740cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.578+0000 7fd679200640 1 -- 172.21.15.44:0/2010780863 >> v1:172.21.15.151:6789/0 conn(0x7fd6740cca60 legacy=0x7fd6740cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:03.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.578+0000 7fd679200640 1 -- 172.21.15.44:0/2010780863 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6740cabf0 con 0x7fd67415fba0 2024-03-30T13:16:03.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.579+0000 7fd679200640 1 --2- 172.21.15.44:0/2010780863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd67415fba0 0x7fd674071440 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fd67406d330 tx=0x7fd66402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d383cb8196fb67 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:03.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.580+0000 7fd673400640 1 -- 172.21.15.44:0/2010780863 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66402ca80 con 0x7fd67415fba0 2024-03-30T13:16:03.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.580+0000 7fd673400640 1 -- 172.21.15.44:0/2010780863 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66402cc20 con 0x7fd67415fba0 2024-03-30T13:16:03.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.580+0000 7fd673400640 1 -- 172.21.15.44:0/2010780863 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6640343f0 con 0x7fd67415fba0 2024-03-30T13:16:03.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.580+0000 7fd67bc00640 1 -- 172.21.15.44:0/2010780863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd67415fba0 msgr2=0x7fd674071440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.580+0000 7fd67bc00640 1 --2- 172.21.15.44:0/2010780863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd67415fba0 0x7fd674071440 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fd67406d330 tx=0x7fd66402bee0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.580+0000 7fd67bc00640 1 -- 172.21.15.44:0/2010780863 shutdown_connections 2024-03-30T13:16:03.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.580+0000 7fd67bc00640 1 --2- 172.21.15.44:0/2010780863 >> v2:172.21.15.151:3300/0 conn(0x7fd674160a80 0x7fd6740cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.580+0000 7fd67bc00640 1 --2- 172.21.15.44:0/2010780863 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd67415fba0 0x7fd674071440 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.580+0000 7fd67bc00640 1 -- 172.21.15.44:0/2010780863 >> 172.21.15.44:0/2010780863 conn(0x7fd67406d610 msgr2=0x7fd67406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:03.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.580+0000 7fd67bc00640 1 -- 172.21.15.44:0/2010780863 shutdown_connections 2024-03-30T13:16:03.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.580+0000 7fd67bc00640 1 -- 172.21.15.44:0/2010780863 wait complete. 2024-03-30T13:16:03.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.582+0000 7fd67bc00640 1 Processor -- start 2024-03-30T13:16:03.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.582+0000 7fd67bc00640 1 -- start start 2024-03-30T13:16:03.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.583+0000 7fd67bc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6740cca60 0x7fd6740c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.583+0000 7fd67bc00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd67415fba0 0x7fd6741e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.583+0000 7fd67bc00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd674160a80 0x7fd6740cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.583+0000 7fd67bc00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd674160f10 con 0x7fd6740cca60 2024-03-30T13:16:03.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.583+0000 7fd67bc00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd6740cb930 con 0x7fd67415fba0 2024-03-30T13:16:03.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.583+0000 7fd67bc00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd674161090 con 0x7fd674160a80 2024-03-30T13:16:03.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.583+0000 7fd679200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6740cca60 0x7fd6740c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.583+0000 7fd679200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6740cca60 0x7fd6740c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51886/0 (socket says 172.21.15.44:51886) 2024-03-30T13:16:03.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.583+0000 7fd679200640 1 -- 172.21.15.44:0/3915862993 learned_addr learned my addr 172.21.15.44:0/3915862993 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:03.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.584+0000 7fd673e00640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd67415fba0 0x7fd6741e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.584+0000 7fd679c00640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd674160a80 0x7fd6740cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.584+0000 7fd679200640 1 -- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd674160a80 msgr2=0x7fd6740cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.584+0000 7fd679200640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd674160a80 0x7fd6740cfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.584+0000 7fd679200640 1 -- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd67415fba0 msgr2=0x7fd6741e72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.584+0000 7fd679200640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd67415fba0 0x7fd6741e72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.584+0000 7fd679200640 1 -- 172.21.15.44:0/3915862993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6741e5f20 con 0x7fd6740cca60 2024-03-30T13:16:03.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.584+0000 7fd673e00640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd67415fba0 0x7fd6741e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:16:03.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.584+0000 7fd679200640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6740cca60 0x7fd6740c6830 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fd664000f80 tx=0x7fd664004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:03.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.585+0000 7fd670c00640 1 -- 172.21.15.44:0/3915862993 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664043020 con 0x7fd6740cca60 2024-03-30T13:16:03.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.585+0000 7fd670c00640 1 -- 172.21.15.44:0/3915862993 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66403e450 con 0x7fd6740cca60 2024-03-30T13:16:03.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.585+0000 7fd670c00640 1 -- 172.21.15.44:0/3915862993 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664009510 con 0x7fd6740cca60 2024-03-30T13:16:03.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.585+0000 7fd67bc00640 1 -- 172.21.15.44:0/3915862993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6741e6200 con 0x7fd6740cca60 2024-03-30T13:16:03.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.585+0000 7fd67bc00640 1 -- 172.21.15.44:0/3915862993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6741e67c0 con 0x7fd6740cca60 2024-03-30T13:16:03.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.586+0000 7fd67bc00640 1 -- 172.21.15.44:0/3915862993 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd674075900 con 0x7fd6740cca60 2024-03-30T13:16:03.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.587+0000 7fd670c00640 1 -- 172.21.15.44:0/3915862993 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd664046020 con 0x7fd6740cca60 2024-03-30T13:16:03.592 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.588+0000 7fd670c00640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd65406c560 0x7fd65406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:03.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.588+0000 7fd670c00640 1 -- 172.21.15.44:0/3915862993 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fd6640adb20 con 0x7fd6740cca60 2024-03-30T13:16:03.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.589+0000 7fd673e00640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd65406c560 0x7fd65406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:03.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.589+0000 7fd673e00640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd65406c560 0x7fd65406ea20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd6740b0c90 tx=0x7fd660008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:03.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.593+0000 7fd670c00640 1 -- 172.21.15.44:0/3915862993 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd66404d070 con 0x7fd6740cca60 2024-03-30T13:16:03.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.795+0000 7fd67bc00640 1 -- 172.21.15.44:0/3915862993 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fd6740b0700 con 0x7fd65406c560 2024-03-30T13:16:03.800 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.796+0000 7fd670c00640 1 -- 172.21.15.44:0/3915862993 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd6740b0700 con 0x7fd65406c560 2024-03-30T13:16:03.800 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 5 to deep-scrub 2024-03-30T13:16:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.798+0000 7fd67bc00640 1 -- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd65406c560 msgr2=0x7fd65406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.798+0000 7fd67bc00640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd65406c560 0x7fd65406ea20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd6740b0c90 tx=0x7fd660008040 comp rx=0 tx=0).stop 2024-03-30T13:16:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.798+0000 7fd67bc00640 1 -- 172.21.15.44:0/3915862993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6740cca60 msgr2=0x7fd6740c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.798+0000 7fd67bc00640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6740cca60 0x7fd6740c6830 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fd664000f80 tx=0x7fd664004a40 comp rx=0 tx=0).stop 2024-03-30T13:16:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.798+0000 7fd67bc00640 1 -- 172.21.15.44:0/3915862993 shutdown_connections 2024-03-30T13:16:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.798+0000 7fd67bc00640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd674160a80 0x7fd6740cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.798+0000 7fd67bc00640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd65406c560 0x7fd65406ea20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.798+0000 7fd67bc00640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd67415fba0 0x7fd6741e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.798+0000 7fd67bc00640 1 --2- 172.21.15.44:0/3915862993 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6740cca60 0x7fd6740c6830 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.798+0000 7fd67bc00640 1 -- 172.21.15.44:0/3915862993 >> 172.21.15.44:0/3915862993 conn(0x7fd67406d610 msgr2=0x7fd6740c7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.799+0000 7fd67bc00640 1 -- 172.21.15.44:0/3915862993 shutdown_connections 2024-03-30T13:16:03.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:03.799+0000 7fd67bc00640 1 -- 172.21.15.44:0/3915862993 wait complete. 2024-03-30T13:16:03.822 INFO:tasks.ceph:Scrubbing osd.6 2024-03-30T13:16:03.822 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:16:04.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.048+0000 7f84c8e00640 1 Processor -- start 2024-03-30T13:16:04.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.048+0000 7f84c8e00640 1 -- start start 2024-03-30T13:16:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.050+0000 7f84c8e00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f84c413f000 0x7f84c4141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.050+0000 7f84c8e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f84c4142500 0x7f84c40d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.050+0000 7f84c8e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c40d0b20 con 0x7f84c40d0700 2024-03-30T13:16:04.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.050+0000 7f84c8e00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f84c415c780 con 0x7f84c413f000 2024-03-30T13:16:04.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.050+0000 7f84c8e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f84c415ca60 con 0x7f84c4142500 2024-03-30T13:16:04.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.050+0000 7f84c3400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f84c413f000 0x7f84c4141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.050+0000 7f84c3400640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f84c413f000 0x7f84c4141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51890/0 (socket says 172.21.15.44:51890) 2024-03-30T13:16:04.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.050+0000 7f84c3400640 1 -- 172.21.15.44:0/1889107737 learned_addr learned my addr 172.21.15.44:0/1889107737 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:04.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.050+0000 7f84c2a00640 1 --2- 172.21.15.44:0/1889107737 >> v2:172.21.15.151:3300/0 conn(0x7f84c4142500 0x7f84c40d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.050+0000 7f84c3400640 1 -- 172.21.15.44:0/1889107737 >> v2:172.21.15.151:3300/0 conn(0x7f84c4142500 msgr2=0x7f84c40d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:04.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.050+0000 7f84c3400640 1 --2- 172.21.15.44:0/1889107737 >> v2:172.21.15.151:3300/0 conn(0x7f84c4142500 0x7f84c40d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.051+0000 7f84c3400640 1 -- 172.21.15.44:0/1889107737 >> v1:172.21.15.151:6789/0 conn(0x7f84c40d0700 legacy=0x7f84c406d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:04.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.051+0000 7f84c3400640 1 -- 172.21.15.44:0/1889107737 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c415cd40 con 0x7f84c413f000 2024-03-30T13:16:04.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.052+0000 7f84c3400640 1 --2- 172.21.15.44:0/1889107737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c413f000 0x7f84c4141fc0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f84c40d0d90 tx=0x7f84b402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431b796e7515f0e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:04.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.052+0000 7f84c2000640 1 -- 172.21.15.44:0/1889107737 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b402ca80 con 0x7f84c413f000 2024-03-30T13:16:04.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.052+0000 7f84c2000640 1 -- 172.21.15.44:0/1889107737 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b402cc20 con 0x7f84c413f000 2024-03-30T13:16:04.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.052+0000 7f84c2000640 1 -- 172.21.15.44:0/1889107737 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b40343f0 con 0x7f84c413f000 2024-03-30T13:16:04.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.053+0000 7f84c8e00640 1 -- 172.21.15.44:0/1889107737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c413f000 msgr2=0x7f84c4141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.053+0000 7f84c8e00640 1 --2- 172.21.15.44:0/1889107737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c413f000 0x7f84c4141fc0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f84c40d0d90 tx=0x7f84b402bee0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.053+0000 7f84c8e00640 1 -- 172.21.15.44:0/1889107737 shutdown_connections 2024-03-30T13:16:04.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.053+0000 7f84c8e00640 1 --2- 172.21.15.44:0/1889107737 >> v2:172.21.15.151:3300/0 conn(0x7f84c4142500 0x7f84c40d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.053+0000 7f84c8e00640 1 --2- 172.21.15.44:0/1889107737 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c413f000 0x7f84c4141fc0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.053+0000 7f84c8e00640 1 -- 172.21.15.44:0/1889107737 >> 172.21.15.44:0/1889107737 conn(0x7f84c406b9a0 msgr2=0x7f84c406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:04.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.053+0000 7f84c8e00640 1 -- 172.21.15.44:0/1889107737 shutdown_connections 2024-03-30T13:16:04.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.053+0000 7f84c8e00640 1 -- 172.21.15.44:0/1889107737 wait complete. 2024-03-30T13:16:04.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.055+0000 7f84c8e00640 1 Processor -- start 2024-03-30T13:16:04.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.056+0000 7f84c8e00640 1 -- start start 2024-03-30T13:16:04.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.057+0000 7f84c8e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c40d0700 0x7f84c41412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.057+0000 7f84c8e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c413f000 0x7f84c4154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.057+0000 7f84c8e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84c4142500 0x7f84c413a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.057+0000 7f84c8e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f84c413f560 con 0x7f84c413f000 2024-03-30T13:16:04.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.057+0000 7f84c8e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f84c413f3e0 con 0x7f84c40d0700 2024-03-30T13:16:04.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.057+0000 7f84c8e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f84c41419c0 con 0x7f84c4142500 2024-03-30T13:16:04.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.057+0000 7f84c2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c413f000 0x7f84c4154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.057+0000 7f84c2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c413f000 0x7f84c4154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51898/0 (socket says 172.21.15.44:51898) 2024-03-30T13:16:04.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.057+0000 7f84c2a00640 1 -- 172.21.15.44:0/3647588134 learned_addr learned my addr 172.21.15.44:0/3647588134 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:04.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.057+0000 7f84c3400640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c40d0700 0x7f84c41412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84c2a00640 1 -- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84c4142500 msgr2=0x7f84c413a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84c3e00640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84c4142500 0x7f84c413a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84c2a00640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84c4142500 0x7f84c413a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84c2a00640 1 -- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c40d0700 msgr2=0x7f84c41412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84c2a00640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c40d0700 0x7f84c41412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84c2a00640 1 -- 172.21.15.44:0/3647588134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c41548b0 con 0x7f84c413f000 2024-03-30T13:16:04.064 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84c3400640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c40d0700 0x7f84c41412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:16:04.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84c2a00640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c413f000 0x7f84c4154140 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00d5c0 tx=0x7f84ac00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:04.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84bb400640 1 -- 172.21.15.44:0/3647588134 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0125f0 con 0x7f84c413f000 2024-03-30T13:16:04.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84bb400640 1 -- 172.21.15.44:0/3647588134 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ac019070 con 0x7f84c413f000 2024-03-30T13:16:04.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84bb400640 1 -- 172.21.15.44:0/3647588134 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0129d0 con 0x7f84c413f000 2024-03-30T13:16:04.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84c8e00640 1 -- 172.21.15.44:0/3647588134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c413f930 con 0x7f84c413f000 2024-03-30T13:16:04.065 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.058+0000 7f84c8e00640 1 -- 172.21.15.44:0/3647588134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c413a840 con 0x7f84c413f000 2024-03-30T13:16:04.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.060+0000 7f84c8e00640 1 -- 172.21.15.44:0/3647588134 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84c4075890 con 0x7f84c413f000 2024-03-30T13:16:04.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.061+0000 7f84bb400640 1 -- 172.21.15.44:0/3647588134 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f84ac012b70 con 0x7f84c413f000 2024-03-30T13:16:04.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.062+0000 7f84bb400640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f84a006c530 0x7f84a006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.062+0000 7f84bb400640 1 -- 172.21.15.44:0/3647588134 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f84ac08b9c0 con 0x7f84c413f000 2024-03-30T13:16:04.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.062+0000 7f84bb400640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] conn(0x7f84a00729d0 0x7f84a0074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.062+0000 7f84bb400640 1 -- 172.21.15.44:0/3647588134 --> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84a00754e0 con 0x7f84a00729d0 2024-03-30T13:16:04.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.062+0000 7f84bb400640 1 -- 172.21.15.44:0/3647588134 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f84ac0902a0 con 0x7f84c413f000 2024-03-30T13:16:04.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.063+0000 7f84c3400640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f84a006c530 0x7f84a006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.063+0000 7f84c3e00640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] conn(0x7f84a00729d0 0x7f84a0074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.064+0000 7f84c3e00640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] conn(0x7f84a00729d0 0x7f84a0074e10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:04.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.064+0000 7f84c3400640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f84a006c530 0x7f84a006e9f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f84b4035000 tx=0x7f84b4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:04.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.066+0000 7f84bb400640 1 -- 172.21.15.44:0/3647588134 <== osd.6 v2:172.21.15.151:6824/3023883464 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f84a00754e0 con 0x7f84a00729d0 2024-03-30T13:16:04.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.081+0000 7f84c8e00640 1 -- 172.21.15.44:0/3647588134 --> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f84c415f8a0 con 0x7f84a00729d0 2024-03-30T13:16:04.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.082+0000 7f84bb400640 1 -- 172.21.15.44:0/3647588134 <== osd.6 v2:172.21.15.151:6824/3023883464 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f84c415f8a0 con 0x7f84a00729d0 2024-03-30T13:16:04.087 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:16:04.087 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:16:04.087 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:16:04.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.083+0000 7f84c8e00640 1 -- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] conn(0x7f84a00729d0 msgr2=0x7f84a0074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.083+0000 7f84c8e00640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:6824/3023883464,v1:172.21.15.151:6825/3023883464] conn(0x7f84a00729d0 0x7f84a0074e10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.083+0000 7f84c8e00640 1 -- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f84a006c530 msgr2=0x7f84a006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.083+0000 7f84c8e00640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f84a006c530 0x7f84a006e9f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f84b4035000 tx=0x7f84b4030000 comp rx=0 tx=0).stop 2024-03-30T13:16:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.083+0000 7f84c8e00640 1 -- 172.21.15.44:0/3647588134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c413f000 msgr2=0x7f84c4154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.083+0000 7f84c8e00640 1 --2- 172.21.15.44:0/3647588134 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84c413f000 0x7f84c4154140 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00d5c0 tx=0x7f84ac00da80 comp rx=0 tx=0).stop 2024-03-30T13:16:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.083+0000 7f84c3e00640 1 -- 172.21.15.44:0/3647588134 reap_dead start 2024-03-30T13:16:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.083+0000 7f84c8e00640 1 -- 172.21.15.44:0/3647588134 shutdown_connections 2024-03-30T13:16:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.083+0000 7f84c8e00640 1 -- 172.21.15.44:0/3647588134 >> 172.21.15.44:0/3647588134 conn(0x7f84c406b9a0 msgr2=0x7f84c40afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.084+0000 7f84c8e00640 1 -- 172.21.15.44:0/3647588134 shutdown_connections 2024-03-30T13:16:04.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.084+0000 7f84c8e00640 1 -- 172.21.15.44:0/3647588134 wait complete. 2024-03-30T13:16:04.109 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-30T13:16:04.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.338+0000 7f1a2fe00640 1 Processor -- start 2024-03-30T13:16:04.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.338+0000 7f1a2fe00640 1 -- start start 2024-03-30T13:16:04.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.340+0000 7f1a2fe00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1a3015c2e0 0x7f1a3006db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.340+0000 7f1a2fe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a300b2b40 0x7f1a3015fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.340+0000 7f1a2fe00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a300711b0 con 0x7f1a300cc700 2024-03-30T13:16:04.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.340+0000 7f1a2fe00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f1a3006ee40 con 0x7f1a3015c2e0 2024-03-30T13:16:04.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.340+0000 7f1a2fe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1a30071470 con 0x7f1a300b2b40 2024-03-30T13:16:04.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.340+0000 7f1a26000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1a3015c2e0 0x7f1a3006db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.340+0000 7f1a2f400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a300b2b40 0x7f1a3015fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.340+0000 7f1a26000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1a3015c2e0 0x7f1a3006db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.44:38326/0 (socket says 172.21.15.44:38326) 2024-03-30T13:16:04.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.340+0000 7f1a2ea00640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f1a300cc700 0x7f1a300ccae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:38312/0 (socket says 172.21.15.44:38312) 2024-03-30T13:16:04.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.340+0000 7f1a26000640 1 -- 172.21.15.44:0/3110055725 learned_addr learned my addr 172.21.15.44:0/3110055725 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:04.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.341+0000 7f1a2f400640 1 -- 172.21.15.44:0/3110055725 >> v2:172.21.15.151:3300/0 conn(0x7f1a3015c2e0 msgr2=0x7f1a3006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:04.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.341+0000 7f1a2f400640 1 --2- 172.21.15.44:0/3110055725 >> v2:172.21.15.151:3300/0 conn(0x7f1a3015c2e0 0x7f1a3006db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.341+0000 7f1a2f400640 1 -- 172.21.15.44:0/3110055725 >> v1:172.21.15.151:6789/0 conn(0x7f1a300cc700 legacy=0x7f1a300ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.341+0000 7f1a2f400640 1 -- 172.21.15.44:0/3110055725 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a30072eb0 con 0x7f1a300b2b40 2024-03-30T13:16:04.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.343+0000 7f1a2f400640 1 --2- 172.21.15.44:0/3110055725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a300b2b40 0x7f1a3015fd00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a280097a0 tx=0x7f1a2802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2b285aa02046c39 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:04.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.343+0000 7f1a2e000640 1 -- 172.21.15.44:0/3110055725 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28035020 con 0x7f1a300b2b40 2024-03-30T13:16:04.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.344+0000 7f1a2e000640 1 -- 172.21.15.44:0/3110055725 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a28031810 con 0x7f1a300b2b40 2024-03-30T13:16:04.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.344+0000 7f1a2e000640 1 -- 172.21.15.44:0/3110055725 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28031be0 con 0x7f1a300b2b40 2024-03-30T13:16:04.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.344+0000 7f1a2fe00640 1 -- 172.21.15.44:0/3110055725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a300b2b40 msgr2=0x7f1a3015fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.344+0000 7f1a2fe00640 1 --2- 172.21.15.44:0/3110055725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a300b2b40 0x7f1a3015fd00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a280097a0 tx=0x7f1a2802b8b0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.344+0000 7f1a2fe00640 1 -- 172.21.15.44:0/3110055725 shutdown_connections 2024-03-30T13:16:04.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.344+0000 7f1a2fe00640 1 --2- 172.21.15.44:0/3110055725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a300b2b40 0x7f1a3015fd00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.344+0000 7f1a2fe00640 1 --2- 172.21.15.44:0/3110055725 >> v2:172.21.15.151:3300/0 conn(0x7f1a3015c2e0 0x7f1a3006db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.344+0000 7f1a2fe00640 1 -- 172.21.15.44:0/3110055725 >> 172.21.15.44:0/3110055725 conn(0x7f1a300b1800 msgr2=0x7f1a300b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:04.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.344+0000 7f1a2fe00640 1 -- 172.21.15.44:0/3110055725 shutdown_connections 2024-03-30T13:16:04.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.344+0000 7f1a2fe00640 1 -- 172.21.15.44:0/3110055725 wait complete. 2024-03-30T13:16:04.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.347+0000 7f1a2fe00640 1 Processor -- start 2024-03-30T13:16:04.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.347+0000 7f1a2fe00640 1 -- start start 2024-03-30T13:16:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.348+0000 7f1a2fe00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a300b2b40 0x7f1a3014dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.348+0000 7f1a2fe00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a300cc700 0x7f1a3015c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.348+0000 7f1a2fe00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a3015c2e0 0x7f1a301505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.348+0000 7f1a2fe00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1a300718d0 con 0x7f1a300cc700 2024-03-30T13:16:04.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.348+0000 7f1a2fe00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30071750 con 0x7f1a3015c2e0 2024-03-30T13:16:04.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.348+0000 7f1a2fe00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1a300cbf90 con 0x7f1a300b2b40 2024-03-30T13:16:04.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.349+0000 7f1a26000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a300cc700 0x7f1a3015c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.349+0000 7f1a26000640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a300cc700 0x7f1a3015c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51912/0 (socket says 172.21.15.44:51912) 2024-03-30T13:16:04.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.349+0000 7f1a26000640 1 -- 172.21.15.44:0/707951878 learned_addr learned my addr 172.21.15.44:0/707951878 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:04.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.349+0000 7f1a2ea00640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a300b2b40 0x7f1a3014dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.349+0000 7f1a2f400640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a3015c2e0 0x7f1a301505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.349+0000 7f1a26000640 1 -- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a300b2b40 msgr2=0x7f1a3014dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.349+0000 7f1a26000640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a300b2b40 0x7f1a3014dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.349+0000 7f1a26000640 1 -- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a3015c2e0 msgr2=0x7f1a301505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.350+0000 7f1a26000640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a3015c2e0 0x7f1a301505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.350+0000 7f1a26000640 1 -- 172.21.15.44:0/707951878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3014e260 con 0x7f1a300cc700 2024-03-30T13:16:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.350+0000 7f1a26000640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a300cc700 0x7f1a3015c6f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800e8a0 tx=0x7f1a1800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.350+0000 7f1a27400640 1 -- 172.21.15.44:0/707951878 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18017070 con 0x7f1a300cc700 2024-03-30T13:16:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.350+0000 7f1a27400640 1 -- 172.21.15.44:0/707951878 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1800c940 con 0x7f1a300cc700 2024-03-30T13:16:04.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.350+0000 7f1a2fe00640 1 -- 172.21.15.44:0/707951878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a300c8b90 con 0x7f1a300cc700 2024-03-30T13:16:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.351+0000 7f1a27400640 1 -- 172.21.15.44:0/707951878 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1800cd30 con 0x7f1a300cc700 2024-03-30T13:16:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.351+0000 7f1a2fe00640 1 -- 172.21.15.44:0/707951878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a300c9150 con 0x7f1a300cc700 2024-03-30T13:16:04.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.352+0000 7f1a2fe00640 1 -- 172.21.15.44:0/707951878 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a30075890 con 0x7f1a300cc700 2024-03-30T13:16:04.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.354+0000 7f1a27400640 1 -- 172.21.15.44:0/707951878 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1a1801a070 con 0x7f1a300cc700 2024-03-30T13:16:04.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.356+0000 7f1a27400640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1a0c06c530 0x7f1a0c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.356+0000 7f1a27400640 1 -- 172.21.15.44:0/707951878 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f1a1808b3c0 con 0x7f1a300cc700 2024-03-30T13:16:04.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.356+0000 7f1a2ea00640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1a0c06c530 0x7f1a0c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.357+0000 7f1a2ea00640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1a0c06c530 0x7f1a0c06e9f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1a200012e0 tx=0x7f1a20005b70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:04.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.360+0000 7f1a27400640 1 -- 172.21.15.44:0/707951878 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1a18059bc0 con 0x7f1a300cc700 2024-03-30T13:16:04.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.577+0000 7f1a2fe00640 1 -- 172.21.15.44:0/707951878 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f1a3006e8d0 con 0x7f1a0c06c530 2024-03-30T13:16:04.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.579+0000 7f1a27400640 1 -- 172.21.15.44:0/707951878 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1a3006e8d0 con 0x7f1a0c06c530 2024-03-30T13:16:04.583 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 6 to deep-scrub 2024-03-30T13:16:04.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.581+0000 7f1a2fe00640 1 -- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1a0c06c530 msgr2=0x7f1a0c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.581+0000 7f1a2fe00640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1a0c06c530 0x7f1a0c06e9f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1a200012e0 tx=0x7f1a20005b70 comp rx=0 tx=0).stop 2024-03-30T13:16:04.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.581+0000 7f1a2fe00640 1 -- 172.21.15.44:0/707951878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a300cc700 msgr2=0x7f1a3015c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.581+0000 7f1a2fe00640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a300cc700 0x7f1a3015c6f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800e8a0 tx=0x7f1a1800ed60 comp rx=0 tx=0).stop 2024-03-30T13:16:04.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.582+0000 7f1a2fe00640 1 -- 172.21.15.44:0/707951878 shutdown_connections 2024-03-30T13:16:04.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.582+0000 7f1a2fe00640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f1a0c06c530 0x7f1a0c06e9f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.582+0000 7f1a2fe00640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a3015c2e0 0x7f1a301505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.582+0000 7f1a2fe00640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a300cc700 0x7f1a3015c6f0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.582+0000 7f1a2fe00640 1 --2- 172.21.15.44:0/707951878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a300b2b40 0x7f1a3014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.582+0000 7f1a2fe00640 1 -- 172.21.15.44:0/707951878 >> 172.21.15.44:0/707951878 conn(0x7f1a300b1800 msgr2=0x7f1a300b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:04.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.582+0000 7f1a2fe00640 1 -- 172.21.15.44:0/707951878 shutdown_connections 2024-03-30T13:16:04.588 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.582+0000 7f1a2fe00640 1 -- 172.21.15.44:0/707951878 wait complete. 2024-03-30T13:16:04.608 INFO:tasks.ceph:Scrubbing osd.7 2024-03-30T13:16:04.608 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-30T13:16:04.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.815+0000 7fd2c7200640 1 Processor -- start 2024-03-30T13:16:04.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.815+0000 7fd2c7200640 1 -- start start 2024-03-30T13:16:04.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.817+0000 7fd2c7200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd2c80b37e0 0x7fd2c80d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.817+0000 7fd2c7200640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd2c80d0700 0x7fd2c8162de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.817+0000 7fd2c7200640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2c80b3c70 con 0x7fd2c814c180 2024-03-30T13:16:04.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.817+0000 7fd2c7200640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7fd2c814c560 con 0x7fd2c80d0700 2024-03-30T13:16:04.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.817+0000 7fd2c7200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fd2c80b3f50 con 0x7fd2c80b37e0 2024-03-30T13:16:04.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.818+0000 7fd2c6800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd2c80d0700 0x7fd2c8162de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.818+0000 7fd2c6800640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7fd2c80d0700 0x7fd2c8162de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51926/0 (socket says 172.21.15.44:51926) 2024-03-30T13:16:04.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.818+0000 7fd2c6800640 1 -- 172.21.15.44:0/211145311 learned_addr learned my addr 172.21.15.44:0/211145311 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:04.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.818+0000 7fd2bd400640 1 --2- 172.21.15.44:0/211145311 >> v2:172.21.15.151:3300/0 conn(0x7fd2c80b37e0 0x7fd2c80d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.818+0000 7fd2c6800640 1 -- 172.21.15.44:0/211145311 >> v2:172.21.15.151:3300/0 conn(0x7fd2c80b37e0 msgr2=0x7fd2c80d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:04.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.818+0000 7fd2c6800640 1 --2- 172.21.15.44:0/211145311 >> v2:172.21.15.151:3300/0 conn(0x7fd2c80b37e0 0x7fd2c80d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.818+0000 7fd2c6800640 1 -- 172.21.15.44:0/211145311 >> v1:172.21.15.151:6789/0 conn(0x7fd2c814c180 legacy=0x7fd2c80718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.818+0000 7fd2c6800640 1 -- 172.21.15.44:0/211145311 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c80b4230 con 0x7fd2c80d0700 2024-03-30T13:16:04.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.819+0000 7fd2c6800640 1 --2- 172.21.15.44:0/211145311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c80d0700 0x7fd2c8162de0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80d0e80 tx=0x7fd2c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9557abe2884efbb4 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:04.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.820+0000 7fd2c5400640 1 -- 172.21.15.44:0/211145311 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0035020 con 0x7fd2c80d0700 2024-03-30T13:16:04.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.820+0000 7fd2c5400640 1 -- 172.21.15.44:0/211145311 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c0031870 con 0x7fd2c80d0700 2024-03-30T13:16:04.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.820+0000 7fd2c5400640 1 -- 172.21.15.44:0/211145311 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0031c40 con 0x7fd2c80d0700 2024-03-30T13:16:04.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.820+0000 7fd2c7200640 1 -- 172.21.15.44:0/211145311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c80d0700 msgr2=0x7fd2c8162de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.820+0000 7fd2c7200640 1 --2- 172.21.15.44:0/211145311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c80d0700 0x7fd2c8162de0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80d0e80 tx=0x7fd2c002b910 comp rx=0 tx=0).stop 2024-03-30T13:16:04.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.821+0000 7fd2c7200640 1 -- 172.21.15.44:0/211145311 shutdown_connections 2024-03-30T13:16:04.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.821+0000 7fd2c7200640 1 --2- 172.21.15.44:0/211145311 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c80d0700 0x7fd2c8162de0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.821+0000 7fd2c7200640 1 --2- 172.21.15.44:0/211145311 >> v2:172.21.15.151:3300/0 conn(0x7fd2c80b37e0 0x7fd2c80d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.821+0000 7fd2c7200640 1 -- 172.21.15.44:0/211145311 >> 172.21.15.44:0/211145311 conn(0x7fd2c806b9a0 msgr2=0x7fd2c806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:04.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.821+0000 7fd2c7200640 1 -- 172.21.15.44:0/211145311 shutdown_connections 2024-03-30T13:16:04.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.821+0000 7fd2c7200640 1 -- 172.21.15.44:0/211145311 wait complete. 2024-03-30T13:16:04.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.822+0000 7fd2c7200640 1 Processor -- start 2024-03-30T13:16:04.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.823+0000 7fd2c7200640 1 -- start start 2024-03-30T13:16:04.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.823+0000 7fd2c7200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c80d0700 0x7fd2c80ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.823+0000 7fd2c7200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2c814c180 0x7fd2c8162220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c7200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2c806d4e0 0x7fd2c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c7200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c8163320 con 0x7fd2c80d0700 2024-03-30T13:16:04.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c7200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c8072000 con 0x7fd2c806d4e0 2024-03-30T13:16:04.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c7200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c81634a0 con 0x7fd2c814c180 2024-03-30T13:16:04.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c80d0700 0x7fd2c80ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c5e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c80d0700 0x7fd2c80ad170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51936/0 (socket says 172.21.15.44:51936) 2024-03-30T13:16:04.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c5e00640 1 -- 172.21.15.44:0/4230755144 learned_addr learned my addr 172.21.15.44:0/4230755144 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:04.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2bd400640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2c814c180 0x7fd2c8162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c6800640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2c806d4e0 0x7fd2c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c5e00640 1 -- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2c814c180 msgr2=0x7fd2c8162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c5e00640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2c814c180 0x7fd2c8162220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c5e00640 1 -- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2c806d4e0 msgr2=0x7fd2c806d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c5e00640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2c806d4e0 0x7fd2c806d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c5e00640 1 -- 172.21.15.44:0/4230755144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c8162760 con 0x7fd2c80d0700 2024-03-30T13:16:04.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.824+0000 7fd2c6800640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2c806d4e0 0x7fd2c806d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:16:04.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.825+0000 7fd2c5e00640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c80d0700 0x7fd2c80ad170 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800c730 tx=0x7fd2b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:04.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.825+0000 7fd2bea00640 1 -- 172.21.15.44:0/4230755144 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8016020 con 0x7fd2c80d0700 2024-03-30T13:16:04.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.825+0000 7fd2bea00640 1 -- 172.21.15.44:0/4230755144 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b8006d50 con 0x7fd2c80d0700 2024-03-30T13:16:04.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.825+0000 7fd2bea00640 1 -- 172.21.15.44:0/4230755144 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8003bb0 con 0x7fd2c80d0700 2024-03-30T13:16:04.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.825+0000 7fd2c7200640 1 -- 172.21.15.44:0/4230755144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c81f8e30 con 0x7fd2c80d0700 2024-03-30T13:16:04.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.825+0000 7fd2c7200640 1 -- 172.21.15.44:0/4230755144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c80ac970 con 0x7fd2c80d0700 2024-03-30T13:16:04.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.826+0000 7fd2c7200640 1 -- 172.21.15.44:0/4230755144 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd2c8075890 con 0x7fd2c80d0700 2024-03-30T13:16:04.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.827+0000 7fd2bea00640 1 -- 172.21.15.44:0/4230755144 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd2b800a850 con 0x7fd2c80d0700 2024-03-30T13:16:04.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.828+0000 7fd2bea00640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd2a406c530 0x7fd2a406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.828+0000 7fd2bea00640 1 -- 172.21.15.44:0/4230755144 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fd2b808b200 con 0x7fd2c80d0700 2024-03-30T13:16:04.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.829+0000 7fd2bea00640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] conn(0x7fd2a40729d0 0x7fd2a4074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:04.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.829+0000 7fd2bea00640 1 -- 172.21.15.44:0/4230755144 --> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2b8010e50 con 0x7fd2a40729d0 2024-03-30T13:16:04.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.829+0000 7fd2bea00640 1 -- 172.21.15.44:0/4230755144 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd2b8092050 con 0x7fd2c80d0700 2024-03-30T13:16:04.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.829+0000 7fd2bd400640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd2a406c530 0x7fd2a406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.829+0000 7fd2c6800640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] conn(0x7fd2a40729d0 0x7fd2a4074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:04.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.830+0000 7fd2c6800640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] conn(0x7fd2a40729d0 0x7fd2a4074e10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:04.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.830+0000 7fd2bd400640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd2a406c530 0x7fd2a406e9f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80ceeb0 tx=0x7fd2b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:04.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.832+0000 7fd2bea00640 1 -- 172.21.15.44:0/4230755144 <== osd.7 v2:172.21.15.151:6808/684556134 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2b8010e50 con 0x7fd2a40729d0 2024-03-30T13:16:04.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.847+0000 7fd2c7200640 1 -- 172.21.15.44:0/4230755144 --> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd2c80cf080 con 0x7fd2a40729d0 2024-03-30T13:16:04.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.848+0000 7fd2bea00640 1 -- 172.21.15.44:0/4230755144 <== osd.7 v2:172.21.15.151:6808/684556134 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd2c80cf080 con 0x7fd2a40729d0 2024-03-30T13:16:04.853 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-03-30T13:16:04.853 INFO:teuthology.orchestra.run.smithi044.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-30T13:16:04.853 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-03-30T13:16:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.849+0000 7fd2c7200640 1 -- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] conn(0x7fd2a40729d0 msgr2=0x7fd2a4074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.849+0000 7fd2c7200640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:6808/684556134,v1:172.21.15.151:6809/684556134] conn(0x7fd2a40729d0 0x7fd2a4074e10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.849+0000 7fd2c7200640 1 -- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd2a406c530 msgr2=0x7fd2a406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.849+0000 7fd2c7200640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fd2a406c530 0x7fd2a406e9f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80ceeb0 tx=0x7fd2b0008040 comp rx=0 tx=0).stop 2024-03-30T13:16:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.849+0000 7fd2c7200640 1 -- 172.21.15.44:0/4230755144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c80d0700 msgr2=0x7fd2c80ad170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:04.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.849+0000 7fd2c7200640 1 --2- 172.21.15.44:0/4230755144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2c80d0700 0x7fd2c80ad170 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800c730 tx=0x7fd2b800cbf0 comp rx=0 tx=0).stop 2024-03-30T13:16:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.849+0000 7fd2c6800640 1 -- 172.21.15.44:0/4230755144 reap_dead start 2024-03-30T13:16:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.849+0000 7fd2c7200640 1 -- 172.21.15.44:0/4230755144 shutdown_connections 2024-03-30T13:16:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.849+0000 7fd2c7200640 1 -- 172.21.15.44:0/4230755144 >> 172.21.15.44:0/4230755144 conn(0x7fd2c806b9a0 msgr2=0x7fd2c8163880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.850+0000 7fd2c7200640 1 -- 172.21.15.44:0/4230755144 shutdown_connections 2024-03-30T13:16:04.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:04.850+0000 7fd2c7200640 1 -- 172.21.15.44:0/4230755144 wait complete. 2024-03-30T13:16:04.871 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-30T13:16:05.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.080+0000 7f88a3e00640 1 Processor -- start 2024-03-30T13:16:05.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.081+0000 7f88a3e00640 1 -- start start 2024-03-30T13:16:05.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.082+0000 7f88a3e00640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f88a40b4800 0x7f88a40cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.082+0000 7f88a3e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40d0390 0x7f88a40cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.082+0000 7f88a3e00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a40d1400 con 0x7f88a409aa30 2024-03-30T13:16:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.082+0000 7f88a3e00640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f88a406c690 con 0x7f88a40b4800 2024-03-30T13:16:05.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.082+0000 7f88a3e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f88a40d16e0 con 0x7f88a40d0390 2024-03-30T13:16:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.083+0000 7f88a2000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f88a40b4800 0x7f88a40cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.083+0000 7f88a3400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40d0390 0x7f88a40cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.083+0000 7f88a2a00640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f88a409aa30 0x7f88a409ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.44:38334/0 (socket says 172.21.15.44:38334) 2024-03-30T13:16:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.083+0000 7f88a2a00640 1 -- 172.21.15.44:0/3917873240 learned_addr learned my addr 172.21.15.44:0/3917873240 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:16:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.083+0000 7f88a3400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40d0390 0x7f88a40cd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.44:39326/0 (socket says 172.21.15.44:39326) 2024-03-30T13:16:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.084+0000 7f88a3400640 1 -- 172.21.15.44:0/3917873240 >> v2:172.21.15.151:3300/0 conn(0x7f88a40b4800 msgr2=0x7f88a40cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.084+0000 7f88a3400640 1 --2- 172.21.15.44:0/3917873240 >> v2:172.21.15.151:3300/0 conn(0x7f88a40b4800 0x7f88a40cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.084+0000 7f88a3400640 1 -- 172.21.15.44:0/3917873240 >> v1:172.21.15.151:6789/0 conn(0x7f88a409aa30 legacy=0x7f88a409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.084+0000 7f88a1600640 1 -- 172.21.15.44:0/3917873240 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328616330 0 0) 0x7f88a40d1400 con 0x7f88a409aa30 2024-03-30T13:16:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.084+0000 7f88a3400640 1 -- 172.21.15.44:0/3917873240 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a40cc7d0 con 0x7f88a40d0390 2024-03-30T13:16:05.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.085+0000 7f88a3400640 1 --2- 172.21.15.44:0/3917873240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40d0390 0x7f88a40cd7f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f889c0097d0 tx=0x7f889c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=545d687f2f7ad07e server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:05.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.086+0000 7f88a1600640 1 -- 172.21.15.44:0/3917873240 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c035020 con 0x7f88a40d0390 2024-03-30T13:16:05.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.086+0000 7f88a1600640 1 -- 172.21.15.44:0/3917873240 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889c031890 con 0x7f88a40d0390 2024-03-30T13:16:05.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.086+0000 7f88a1600640 1 -- 172.21.15.44:0/3917873240 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c031c60 con 0x7f88a40d0390 2024-03-30T13:16:05.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.087+0000 7f88a3e00640 1 -- 172.21.15.44:0/3917873240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40d0390 msgr2=0x7f88a40cd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.087+0000 7f88a3e00640 1 --2- 172.21.15.44:0/3917873240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40d0390 0x7f88a40cd7f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f889c0097d0 tx=0x7f889c02b930 comp rx=0 tx=0).stop 2024-03-30T13:16:05.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.087+0000 7f88a3e00640 1 -- 172.21.15.44:0/3917873240 shutdown_connections 2024-03-30T13:16:05.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.087+0000 7f88a3e00640 1 --2- 172.21.15.44:0/3917873240 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40d0390 0x7f88a40cd7f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.087+0000 7f88a3e00640 1 --2- 172.21.15.44:0/3917873240 >> v2:172.21.15.151:3300/0 conn(0x7f88a40b4800 0x7f88a40cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.087+0000 7f88a3e00640 1 -- 172.21.15.44:0/3917873240 >> 172.21.15.44:0/3917873240 conn(0x7f88a40b3ad0 msgr2=0x7f88a40b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:05.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.087+0000 7f88a3e00640 1 -- 172.21.15.44:0/3917873240 shutdown_connections 2024-03-30T13:16:05.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.087+0000 7f88a3e00640 1 -- 172.21.15.44:0/3917873240 wait complete. 2024-03-30T13:16:05.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.089+0000 7f88a3e00640 1 Processor -- start 2024-03-30T13:16:05.093 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.089+0000 7f88a3e00640 1 -- start start 2024-03-30T13:16:05.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.090+0000 7f88a3e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a409aa30 0x7f88a4155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.090+0000 7f88a3e00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40b4800 0x7f88a40c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.090+0000 7f88a3e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a40d0390 0x7f88a40b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.090+0000 7f88a3e00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f88a415ea90 con 0x7f88a409aa30 2024-03-30T13:16:05.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.090+0000 7f88a3e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f88a40ccd90 con 0x7f88a40d0390 2024-03-30T13:16:05.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.090+0000 7f88a3e00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f88a409b5d0 con 0x7f88a40b4800 2024-03-30T13:16:05.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.091+0000 7f88a2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a409aa30 0x7f88a4155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:05.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.091+0000 7f88a2a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a409aa30 0x7f88a4155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51948/0 (socket says 172.21.15.44:51948) 2024-03-30T13:16:05.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.091+0000 7f88a2a00640 1 -- 172.21.15.44:0/1636886945 learned_addr learned my addr 172.21.15.44:0/1636886945 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:05.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.091+0000 7f88a3400640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a40d0390 0x7f88a40b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:05.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.091+0000 7f88a2000640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40b4800 0x7f88a40c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:05.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.091+0000 7f88a2a00640 1 -- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40b4800 msgr2=0x7f88a40c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.091+0000 7f88a2a00640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40b4800 0x7f88a40c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.091+0000 7f88a2a00640 1 -- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a40d0390 msgr2=0x7f88a40b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.091+0000 7f88a2a00640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a40d0390 0x7f88a40b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.091+0000 7f88a2a00640 1 -- 172.21.15.44:0/1636886945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a4155c60 con 0x7f88a409aa30 2024-03-30T13:16:05.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.092+0000 7f88a2a00640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a409aa30 0x7f88a4155720 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f888c00c420 tx=0x7f888c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:05.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.092+0000 7f889aa00640 1 -- 172.21.15.44:0/1636886945 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c0074e0 con 0x7f88a409aa30 2024-03-30T13:16:05.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.092+0000 7f889aa00640 1 -- 172.21.15.44:0/1636886945 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888c0047e0 con 0x7f88a409aa30 2024-03-30T13:16:05.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.092+0000 7f889aa00640 1 -- 172.21.15.44:0/1636886945 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c004c10 con 0x7f88a409aa30 2024-03-30T13:16:05.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.092+0000 7f88a3e00640 1 -- 172.21.15.44:0/1636886945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a40c8720 con 0x7f88a409aa30 2024-03-30T13:16:05.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.092+0000 7f88a3e00640 1 -- 172.21.15.44:0/1636886945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a40c5f90 con 0x7f88a409aa30 2024-03-30T13:16:05.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.093+0000 7f88a3e00640 1 -- 172.21.15.44:0/1636886945 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a4075890 con 0x7f88a409aa30 2024-03-30T13:16:05.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.095+0000 7f889aa00640 1 -- 172.21.15.44:0/1636886945 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f888c011070 con 0x7f88a409aa30 2024-03-30T13:16:05.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.096+0000 7f889aa00640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f888006c530 0x7f888006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.096+0000 7f889aa00640 1 -- 172.21.15.44:0/1636886945 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f888c08b1f0 con 0x7f88a409aa30 2024-03-30T13:16:05.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.096+0000 7f88a2000640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f888006c530 0x7f888006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:05.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.097+0000 7f88a2000640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f888006c530 0x7f888006e9f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f88a40b0940 tx=0x7f889400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:05.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.100+0000 7f889aa00640 1 -- 172.21.15.44:0/1636886945 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f888c0598e0 con 0x7f88a409aa30 2024-03-30T13:16:05.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.303+0000 7f88a3e00640 1 -- 172.21.15.44:0/1636886945 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f88a409b960 con 0x7f888006c530 2024-03-30T13:16:05.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.304+0000 7f889aa00640 1 -- 172.21.15.44:0/1636886945 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f88a409b960 con 0x7f888006c530 2024-03-30T13:16:05.309 INFO:teuthology.orchestra.run.smithi044.stderr:instructed osd(s) 7 to deep-scrub 2024-03-30T13:16:05.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.307+0000 7f88a3e00640 1 -- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f888006c530 msgr2=0x7f888006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.307+0000 7f88a3e00640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f888006c530 0x7f888006e9f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f88a40b0940 tx=0x7f889400b040 comp rx=0 tx=0).stop 2024-03-30T13:16:05.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.307+0000 7f88a3e00640 1 -- 172.21.15.44:0/1636886945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a409aa30 msgr2=0x7f88a4155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.307+0000 7f88a3e00640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a409aa30 0x7f88a4155720 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f888c00c420 tx=0x7f888c00c8e0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.308+0000 7f88a3e00640 1 -- 172.21.15.44:0/1636886945 shutdown_connections 2024-03-30T13:16:05.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.308+0000 7f88a3e00640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f888006c530 0x7f888006e9f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.308+0000 7f88a3e00640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a40d0390 0x7f88a40b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.308+0000 7f88a3e00640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40b4800 0x7f88a40c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.308+0000 7f88a3e00640 1 --2- 172.21.15.44:0/1636886945 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88a409aa30 0x7f88a4155720 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.308+0000 7f88a3e00640 1 -- 172.21.15.44:0/1636886945 >> 172.21.15.44:0/1636886945 conn(0x7f88a40b3ad0 msgr2=0x7f88a415c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:05.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.308+0000 7f88a3e00640 1 -- 172.21.15.44:0/1636886945 shutdown_connections 2024-03-30T13:16:05.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.308+0000 7f88a3e00640 1 -- 172.21.15.44:0/1636886945 wait complete. 2024-03-30T13:16:05.332 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:16:05.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.554+0000 7f70bd600640 1 Processor -- start 2024-03-30T13:16:05.558 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.554+0000 7f70bd600640 1 -- start start 2024-03-30T13:16:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.555+0000 7f70bd600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b806bc90 0x7f70b806f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.555+0000 7f70bd600640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70b8162ca0 con 0x7f70b815e160 2024-03-30T13:16:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.555+0000 7f70bd600640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70b806e960 con 0x7f70b815e540 2024-03-30T13:16:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.555+0000 7f70bd600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f70b806e710 con 0x7f70b806bc90 2024-03-30T13:16:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.556+0000 7f70b7e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f70b815e160 0x7f70b806b580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:46962/0 (socket says 172.21.15.44:46962) 2024-03-30T13:16:05.560 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.556+0000 7f70b7e00640 1 -- 172.21.15.44:0/3758930647 learned_addr learned my addr 172.21.15.44:0/3758930647 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:16:05.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.556+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 894995987 0 0) 0x7f70b8162ca0 con 0x7f70b815e160 2024-03-30T13:16:05.562 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.556+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f709c003520 con 0x7f70b815e160 2024-03-30T13:16:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.556+0000 7f70b7400640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b806bc90 0x7f70b806f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2037118111 0 0) 0x7f709c003520 con 0x7f70b815e160 2024-03-30T13:16:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b806bc90 msgr2=0x7f70b806f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b806bc90 0x7f70b806f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 >> v1:172.21.15.151:6789/0 conn(0x7f70b815e540 legacy=0x7f70b80b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b806ec40 con 0x7f70b815e160 2024-03-30T13:16:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f70a80019f0 con 0x7f70b815e160 2024-03-30T13:16:05.563 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 >> v1:172.21.15.44:6789/0 conn(0x7f70b815e160 legacy=0x7f70b806b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f709c0039e0 0x7f709c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b806bc90 0x7f709c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709c004d40 0x7f709c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f70b806e710 con 0x7f709c0039e0 2024-03-30T13:16:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f709c00bc70 con 0x7f709c004d40 2024-03-30T13:16:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f709c00be70 con 0x7f70b806bc90 2024-03-30T13:16:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b7e00640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f709c0039e0 0x7f709c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70bcc00640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709c004d40 0x7f709c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:05.564 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b7e00640 1 -- 172.21.15.44:0/3758930647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b806bc90 msgr2=0x7f709c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b7400640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b806bc90 0x7f709c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.557+0000 7f70b7e00640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b806bc90 0x7f709c004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.558+0000 7f70b7e00640 1 -- 172.21.15.44:0/3758930647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709c004d40 msgr2=0x7f709c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.558+0000 7f70b7e00640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709c004d40 0x7f709c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.558+0000 7f70b7e00640 1 -- 172.21.15.44:0/3758930647 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c003520 con 0x7f709c0039e0 2024-03-30T13:16:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.558+0000 7f70bcc00640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709c004d40 0x7f709c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:16:05.565 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.559+0000 7f70b7e00640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f709c0039e0 0x7f709c003e00 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f70a800a770 tx=0x7f709c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7bc9b4aa02064b server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:05.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.559+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a800a390 con 0x7f709c0039e0 2024-03-30T13:16:05.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.559+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a8034650 con 0x7f709c0039e0 2024-03-30T13:16:05.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.559+0000 7f70b6a00640 1 -- 172.21.15.44:0/3758930647 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8034a40 con 0x7f709c0039e0 2024-03-30T13:16:05.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.560+0000 7f70bd600640 1 -- 172.21.15.44:0/3758930647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f709c0039e0 msgr2=0x7f709c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.560+0000 7f70bd600640 1 --2- 172.21.15.44:0/3758930647 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f709c0039e0 0x7f709c003e00 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f70a800a770 tx=0x7f709c005830 comp rx=0 tx=0).stop 2024-03-30T13:16:05.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.560+0000 7f70bcc00640 1 -- 172.21.15.44:0/3758930647 reap_dead start 2024-03-30T13:16:05.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.560+0000 7f70bd600640 1 -- 172.21.15.44:0/3758930647 shutdown_connections 2024-03-30T13:16:05.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.560+0000 7f70bd600640 1 -- 172.21.15.44:0/3758930647 >> 172.21.15.44:0/3758930647 conn(0x7f70b806d130 msgr2=0x7f70b80b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:05.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.560+0000 7f70bd600640 1 -- 172.21.15.44:0/3758930647 shutdown_connections 2024-03-30T13:16:05.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.560+0000 7f70bd600640 1 -- 172.21.15.44:0/3758930647 wait complete. 2024-03-30T13:16:05.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.561+0000 7f70bd600640 1 Processor -- start 2024-03-30T13:16:05.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.562+0000 7f70bd600640 1 -- start start 2024-03-30T13:16:05.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.562+0000 7f70bd600640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b81f7460 0x7f70b80cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.562+0000 7f70bd600640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70b80d0060 0x7f70b81e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.563+0000 7f70bd600640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70b81e8260 0x7f70b80b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.563+0000 7f70bd600640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f70b80b0130 con 0x7f70b81e8260 2024-03-30T13:16:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.563+0000 7f70bd600640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f70b80affb0 con 0x7f70b80d0060 2024-03-30T13:16:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.563+0000 7f70bd600640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f70b81628a0 con 0x7f70b81f7460 2024-03-30T13:16:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.563+0000 7f70bcc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70b81e8260 0x7f70b80b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.563+0000 7f70bcc00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70b81e8260 0x7f70b80b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51960/0 (socket says 172.21.15.44:51960) 2024-03-30T13:16:05.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.563+0000 7f70bcc00640 1 -- 172.21.15.44:0/2938624670 learned_addr learned my addr 172.21.15.44:0/2938624670 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.563+0000 7f70bcc00640 1 -- 172.21.15.44:0/2938624670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b81f7460 msgr2=0x7f70b80cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.563+0000 7f70bcc00640 1 --2- 172.21.15.44:0/2938624670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b81f7460 0x7f70b80cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.563+0000 7f70bcc00640 1 -- 172.21.15.44:0/2938624670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70b80d0060 msgr2=0x7f70b81e7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.563+0000 7f70bcc00640 1 --2- 172.21.15.44:0/2938624670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70b80d0060 0x7f70b81e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.563+0000 7f70bcc00640 1 -- 172.21.15.44:0/2938624670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b81e86e0 con 0x7f70b81e8260 2024-03-30T13:16:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.564+0000 7f70bcc00640 1 --2- 172.21.15.44:0/2938624670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70b81e8260 0x7f70b80b02b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f70b80b6600 tx=0x7f70b000d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.564+0000 7f70afe00640 1 -- 172.21.15.44:0/2938624670 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b0005480 con 0x7f70b81e8260 2024-03-30T13:16:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.564+0000 7f70afe00640 1 -- 172.21.15.44:0/2938624670 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b0007030 con 0x7f70b81e8260 2024-03-30T13:16:05.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.564+0000 7f70afe00640 1 -- 172.21.15.44:0/2938624670 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b0007440 con 0x7f70b81e8260 2024-03-30T13:16:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.564+0000 7f70bd600640 1 -- 172.21.15.44:0/2938624670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b81e89a0 con 0x7f70b81e8260 2024-03-30T13:16:05.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.564+0000 7f70bd600640 1 -- 172.21.15.44:0/2938624670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b81e8f60 con 0x7f70b81e8260 2024-03-30T13:16:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.565+0000 7f70bd600640 1 -- 172.21.15.44:0/2938624670 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b80d1e20 con 0x7f70b81e8260 2024-03-30T13:16:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.566+0000 7f70afe00640 1 -- 172.21.15.44:0/2938624670 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f70b001b020 con 0x7f70b81e8260 2024-03-30T13:16:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.567+0000 7f70afe00640 1 --2- 172.21.15.44:0/2938624670 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f709806c530 0x7f709806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.567+0000 7f70afe00640 1 -- 172.21.15.44:0/2938624670 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f70b008af30 con 0x7f70b81e8260 2024-03-30T13:16:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.568+0000 7f70b7e00640 1 --2- 172.21.15.44:0/2938624670 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f709806c530 0x7f709806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:05.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.569+0000 7f70b7e00640 1 --2- 172.21.15.44:0/2938624670 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f709806c530 0x7f709806e9f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f70a8034000 tx=0x7f70a8007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:05.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.572+0000 7f70afe00640 1 -- 172.21.15.44:0/2938624670 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f70b80d1e20 con 0x7f70b81e8260 2024-03-30T13:16:05.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.772+0000 7f70bd600640 1 -- 172.21.15.44:0/2938624670 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70b80d04a0 con 0x7f709806c530 2024-03-30T13:16:05.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.774+0000 7f70afe00640 1 -- 172.21.15.44:0/2938624670 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13353 (secure 0 0 0) 0x7f70b80d04a0 con 0x7f709806c530 2024-03-30T13:16:05.779 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:16:05.779 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:16:05.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.776+0000 7f70bd600640 1 -- 172.21.15.44:0/2938624670 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f709806c530 msgr2=0x7f709806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.776+0000 7f70bd600640 1 --2- 172.21.15.44:0/2938624670 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f709806c530 0x7f709806e9f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f70a8034000 tx=0x7f70a8007000 comp rx=0 tx=0).stop 2024-03-30T13:16:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.776+0000 7f70bd600640 1 -- 172.21.15.44:0/2938624670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70b81e8260 msgr2=0x7f70b80b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.776+0000 7f70bd600640 1 --2- 172.21.15.44:0/2938624670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70b81e8260 0x7f70b80b02b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f70b80b6600 tx=0x7f70b000d890 comp rx=0 tx=0).stop 2024-03-30T13:16:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.777+0000 7f70bd600640 1 -- 172.21.15.44:0/2938624670 shutdown_connections 2024-03-30T13:16:05.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.777+0000 7f70bd600640 1 --2- 172.21.15.44:0/2938624670 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70b81e8260 0x7f70b80b02b0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.777+0000 7f70bd600640 1 --2- 172.21.15.44:0/2938624670 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f709806c530 0x7f709806e9f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.777+0000 7f70bd600640 1 --2- 172.21.15.44:0/2938624670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70b80d0060 0x7f70b81e7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.777+0000 7f70bd600640 1 --2- 172.21.15.44:0/2938624670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70b81f7460 0x7f70b80cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:05.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.777+0000 7f70bd600640 1 -- 172.21.15.44:0/2938624670 >> 172.21.15.44:0/2938624670 conn(0x7f70b806d130 msgr2=0x7f70b80ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:05.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.777+0000 7f70bd600640 1 -- 172.21.15.44:0/2938624670 shutdown_connections 2024-03-30T13:16:05.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:05.777+0000 7f70bd600640 1 -- 172.21.15.44:0/2938624670 wait complete. 2024-03-30T13:16:05.801 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-03-30T13:16:04.051762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":250936,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754723784,"statfs":{"total":773094113280,"available":772837154816,"internally_reserved":0,"allocated":5775360,"data_stored":3199344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.253402"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":224,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-30T13:15:53.809587+0000","last_change":"2024-03-30T13:11:35.909306+0000","last_active":"2024-03-30T13:15:53.809587+0000","last_peered":"2024-03-30T13:15:53.809587+0000","last_clean":"2024-03-30T13:15:53.809587+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:15:53.809587+0000","last_undegraded":"2024-03-30T13:15:53.809587+0000","last_fullsized":"2024-03-30T13:15:53.809587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-30T13:11:34.885967+0000","last_clean_scrub_stamp":"2024-03-30T13:11:34.885967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T23:30:22.128177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1167360,"data_stored":842694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":252326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":252326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":252326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":252326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":252326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509496,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":842694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542201,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":252326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:16:05.804 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-30T13:11:34.885967+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=30, tm_hour=13, tm_min=11, tm_sec=34, tm_wday=5, tm_yday=90, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=30, tm_hour=13, tm_min=15, tm_sec=58, tm_wday=5, tm_yday=90, tm_isdst=0) 2024-03-30T13:16:05.804 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-30T13:16:25.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-30T13:16:26.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.035+0000 7f165ba00640 1 Processor -- start 2024-03-30T13:16:26.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.035+0000 7f165ba00640 1 -- start start 2024-03-30T13:16:26.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.037+0000 7f165ba00640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f165414b700 0x7f16540cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.037+0000 7f165ba00640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1654166a40 con 0x7f16541665d0 2024-03-30T13:16:26.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.037+0000 7f165ba00640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1654166cb0 con 0x7f16540cad20 2024-03-30T13:16:26.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.037+0000 7f165ba00640 1 -- --> v2:172.21.15.44:3300/0 -- mon_getmap magic: 0 -- 0x7f1654167550 con 0x7f165414b700 2024-03-30T13:16:26.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.037+0000 7f1653e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f16541665d0 0x7f16540ca610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33250/0 (socket says 172.21.15.44:33250) 2024-03-30T13:16:26.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.037+0000 7f1653e00640 1 -- 172.21.15.44:0/1410795262 learned_addr learned my addr 172.21.15.44:0/1410795262 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:16:26.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.037+0000 7f1659000640 1 --2- >> v2:172.21.15.44:3300/0 conn(0x7f165414b700 0x7f16540cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.038+0000 7f1659000640 1 -- 172.21.15.44:0/1410795262 >> v1:172.21.15.151:6789/0 conn(0x7f16540cad20 legacy=0x7f16540ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:26.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.038+0000 7f1659000640 1 -- 172.21.15.44:0/1410795262 >> v1:172.21.15.44:6789/0 conn(0x7f16541665d0 legacy=0x7f16540ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.038+0000 7f1659000640 1 -- 172.21.15.44:0/1410795262 --> v2:172.21.15.44:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1654166f90 con 0x7f165414b700 2024-03-30T13:16:26.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.039+0000 7f1659000640 1 --2- 172.21.15.44:0/1410795262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f165414b700 0x7f16540cd3b0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f16480097a0 tx=0x7f164802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fe4660e7870fd8 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:26.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.040+0000 7f1653400640 1 -- 172.21.15.44:0/1410795262 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16480315a0 con 0x7f165414b700 2024-03-30T13:16:26.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.040+0000 7f1653400640 1 -- 172.21.15.44:0/1410795262 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1648037070 con 0x7f165414b700 2024-03-30T13:16:26.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.040+0000 7f1653400640 1 -- 172.21.15.44:0/1410795262 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648031960 con 0x7f165414b700 2024-03-30T13:16:26.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.040+0000 7f165ba00640 1 -- 172.21.15.44:0/1410795262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f165414b700 msgr2=0x7f16540cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.040+0000 7f165ba00640 1 --2- 172.21.15.44:0/1410795262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f165414b700 0x7f16540cd3b0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f16480097a0 tx=0x7f164802b840 comp rx=0 tx=0).stop 2024-03-30T13:16:26.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.041+0000 7f165ba00640 1 -- 172.21.15.44:0/1410795262 shutdown_connections 2024-03-30T13:16:26.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.041+0000 7f165ba00640 1 --2- 172.21.15.44:0/1410795262 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f165414b700 0x7f16540cd3b0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.041+0000 7f165ba00640 1 -- 172.21.15.44:0/1410795262 >> 172.21.15.44:0/1410795262 conn(0x7f16540b1c90 msgr2=0x7f16540b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:26.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.041+0000 7f165ba00640 1 -- 172.21.15.44:0/1410795262 shutdown_connections 2024-03-30T13:16:26.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.041+0000 7f165ba00640 1 -- 172.21.15.44:0/1410795262 wait complete. 2024-03-30T13:16:26.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.042+0000 7f165ba00640 1 Processor -- start 2024-03-30T13:16:26.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.043+0000 7f165ba00640 1 -- start start 2024-03-30T13:16:26.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.043+0000 7f165ba00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16540cad20 0x7f1654165fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.043+0000 7f165ba00640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165414b700 0x7f1654151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.043+0000 7f165ba00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16541665d0 0x7f165414a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.043+0000 7f165ba00640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f165414bae0 con 0x7f16541665d0 2024-03-30T13:16:26.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.043+0000 7f165ba00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f16540cded0 con 0x7f16540cad20 2024-03-30T13:16:26.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.043+0000 7f165ba00640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f1654157c40 con 0x7f165414b700 2024-03-30T13:16:26.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.044+0000 7f1659a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16541665d0 0x7f165414a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.044+0000 7f1659a00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16541665d0 0x7f165414a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37322/0 (socket says 172.21.15.44:37322) 2024-03-30T13:16:26.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.044+0000 7f1659a00640 1 -- 172.21.15.44:0/2636938886 learned_addr learned my addr 172.21.15.44:0/2636938886 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:26.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.044+0000 7f1653e00640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165414b700 0x7f1654151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.044+0000 7f1659000640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16540cad20 0x7f1654165fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.044+0000 7f1659a00640 1 -- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165414b700 msgr2=0x7f1654151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.044+0000 7f1659a00640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165414b700 0x7f1654151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.044+0000 7f1659a00640 1 -- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16540cad20 msgr2=0x7f1654165fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.044+0000 7f1659a00640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16540cad20 0x7f1654165fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.044+0000 7f1659a00640 1 -- 172.21.15.44:0/2636938886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165414af20 con 0x7f16541665d0 2024-03-30T13:16:26.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.044+0000 7f1653e00640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165414b700 0x7f1654151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:16:26.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.044+0000 7f1659000640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16540cad20 0x7f1654165fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-30T13:16:26.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.045+0000 7f1659a00640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16541665d0 0x7f165414a3b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f164c00c730 tx=0x7f164c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:26.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.045+0000 7f1650c00640 1 -- 172.21.15.44:0/2636938886 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c016020 con 0x7f16541665d0 2024-03-30T13:16:26.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.045+0000 7f1650c00640 1 -- 172.21.15.44:0/2636938886 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f164c00aa50 con 0x7f16541665d0 2024-03-30T13:16:26.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.045+0000 7f1650c00640 1 -- 172.21.15.44:0/2636938886 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c00ce40 con 0x7f16541665d0 2024-03-30T13:16:26.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.045+0000 7f165ba00640 1 -- 172.21.15.44:0/2636938886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16540b40d0 con 0x7f16541665d0 2024-03-30T13:16:26.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.045+0000 7f165ba00640 1 -- 172.21.15.44:0/2636938886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16540b4690 con 0x7f16541665d0 2024-03-30T13:16:26.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.046+0000 7f165ba00640 1 -- 172.21.15.44:0/2636938886 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1654075a10 con 0x7f16541665d0 2024-03-30T13:16:26.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.047+0000 7f1650c00640 1 -- 172.21.15.44:0/2636938886 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f164c019020 con 0x7f16541665d0 2024-03-30T13:16:26.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.048+0000 7f1650c00640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f163406c530 0x7f163406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.048+0000 7f1650c00640 1 -- 172.21.15.44:0/2636938886 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f164c08b580 con 0x7f16541665d0 2024-03-30T13:16:26.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.049+0000 7f1659000640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f163406c530 0x7f163406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.050+0000 7f1659000640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f163406c530 0x7f163406e9f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1648036000 tx=0x7f1648008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:26.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.053+0000 7f1650c00640 1 -- 172.21.15.44:0/2636938886 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f164c020030 con 0x7f16541665d0 2024-03-30T13:16:26.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.253+0000 7f165ba00640 1 -- 172.21.15.44:0/2636938886 --> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1654152330 con 0x7f163406c530 2024-03-30T13:16:26.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.256+0000 7f1650c00640 1 -- 172.21.15.44:0/2636938886 <== mgr.4100 v2:172.21.15.151:6832/4285775013 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13360 (secure 0 0 0) 0x7f1654152330 con 0x7f163406c530 2024-03-30T13:16:26.260 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:16:26.260 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-03-30T13:16:26.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.259+0000 7f165ba00640 1 -- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f163406c530 msgr2=0x7f163406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.259+0000 7f165ba00640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f163406c530 0x7f163406e9f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1648036000 tx=0x7f1648008030 comp rx=0 tx=0).stop 2024-03-30T13:16:26.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.259+0000 7f165ba00640 1 -- 172.21.15.44:0/2636938886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16541665d0 msgr2=0x7f165414a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.259+0000 7f165ba00640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16541665d0 0x7f165414a3b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f164c00c730 tx=0x7f164c00cbf0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.259+0000 7f165ba00640 1 -- 172.21.15.44:0/2636938886 shutdown_connections 2024-03-30T13:16:26.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.259+0000 7f165ba00640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f16541665d0 0x7f165414a3b0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.259+0000 7f165ba00640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165414b700 0x7f1654151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.259+0000 7f165ba00640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f163406c530 0x7f163406e9f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.259+0000 7f165ba00640 1 --2- 172.21.15.44:0/2636938886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16540cad20 0x7f1654165fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.259+0000 7f165ba00640 1 -- 172.21.15.44:0/2636938886 >> 172.21.15.44:0/2636938886 conn(0x7f16540b1c90 msgr2=0x7f1654071420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:26.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.259+0000 7f165ba00640 1 -- 172.21.15.44:0/2636938886 shutdown_connections 2024-03-30T13:16:26.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.259+0000 7f165ba00640 1 -- 172.21.15.44:0/2636938886 wait complete. 2024-03-30T13:16:26.282 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-03-30T13:16:26.058026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":250924,"kb_used_data":5640,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754723796,"statfs":{"total":773094113280,"available":772837167104,"internally_reserved":0,"allocated":5775360,"data_stored":3199344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003404"},"pg_stats":[{"pgid":"1.0","version":"49'119","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-30T13:16:06.237739+0000","last_change":"2024-03-30T13:16:06.237864+0000","last_active":"2024-03-30T13:16:06.237739+0000","last_peered":"2024-03-30T13:16:06.237739+0000","last_clean":"2024-03-30T13:16:06.237739+0000","last_became_active":"2024-03-30T13:11:35.908263+0000","last_became_peered":"2024-03-30T13:11:35.908263+0000","last_unstale":"2024-03-30T13:16:06.237739+0000","last_undegraded":"2024-03-30T13:16:06.237739+0000","last_fullsized":"2024-03-30T13:16:06.237739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'119","last_scrub_stamp":"2024-03-30T13:16:06.237497+0000","last_deep_scrub":"49'119","last_deep_scrub_stamp":"2024-03-30T13:16:06.237497+0000","last_clean_scrub_stamp":"2024-03-30T13:16:06.237497+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-31T14:28:15.891162+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1167360,"data_stored":842694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27580,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344260,"statfs":{"total":96636764160,"available":96608522240,"internally_reserved":0,"allocated":573440,"data_stored":252326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":252326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":252326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31740,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":573440,"data_stored":252326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":252326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1167360,"data_stored":842694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":252326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-30T13:16:26.283 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-30T13:16:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.486+0000 7fec2b200640 1 Processor -- start 2024-03-30T13:16:26.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.486+0000 7fec2b200640 1 -- start start 2024-03-30T13:16:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.488+0000 7fec2b200640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fec2c06e980 0x7fec2c072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.488+0000 7fec2b200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec2c0acd60 0x7fec2c15d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.488+0000 7fec2b200640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec2c15d5b0 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.488+0000 7fec2b200640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7fec2c0ad5c0 con 0x7fec2c06e980 2024-03-30T13:16:26.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.488+0000 7fec2b200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fec2c071450 con 0x7fec2c0acd60 2024-03-30T13:16:26.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.488+0000 7fec2a800640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7fec2c0ae9d0 0x7fec2c0aee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:33256/0 (socket says 172.21.15.44:33256) 2024-03-30T13:16:26.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.488+0000 7fec2a800640 1 -- 172.21.15.44:0/2128075627 learned_addr learned my addr 172.21.15.44:0/2128075627 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:16:26.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.489+0000 7fec29400640 1 --2- 172.21.15.44:0/2128075627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec2c0acd60 0x7fec2c15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.489+0000 7fec29e00640 1 --2- 172.21.15.44:0/2128075627 >> v2:172.21.15.151:3300/0 conn(0x7fec2c06e980 0x7fec2c072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.489+0000 7fec28a00640 1 -- 172.21.15.44:0/2128075627 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543192650 0 0) 0x7fec24001490 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.489+0000 7fec28a00640 1 -- 172.21.15.44:0/2128075627 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec10003520 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.489+0000 7fec29400640 1 -- 172.21.15.44:0/2128075627 >> v2:172.21.15.151:3300/0 conn(0x7fec2c06e980 msgr2=0x7fec2c072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:26.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.489+0000 7fec29400640 1 --2- 172.21.15.44:0/2128075627 >> v2:172.21.15.151:3300/0 conn(0x7fec2c06e980 0x7fec2c072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.489+0000 7fec29400640 1 -- 172.21.15.44:0/2128075627 >> v1:172.21.15.44:6789/0 conn(0x7fec2c0ae9d0 legacy=0x7fec2c0aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.489+0000 7fec29400640 1 -- 172.21.15.44:0/2128075627 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c0ad2e0 con 0x7fec2c0acd60 2024-03-30T13:16:26.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.491+0000 7fec29400640 1 --2- 172.21.15.44:0/2128075627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec2c0acd60 0x7fec2c15d070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec180097a0 tx=0x7fec1802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e016c96befabf391 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:26.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.492+0000 7fec28a00640 1 -- 172.21.15.44:0/2128075627 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18031780 con 0x7fec2c0acd60 2024-03-30T13:16:26.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.492+0000 7fec28a00640 1 -- 172.21.15.44:0/2128075627 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec18037070 con 0x7fec2c0acd60 2024-03-30T13:16:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.492+0000 7fec28a00640 1 -- 172.21.15.44:0/2128075627 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18031b40 con 0x7fec2c0acd60 2024-03-30T13:16:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.492+0000 7fec2b200640 1 -- 172.21.15.44:0/2128075627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec2c0acd60 msgr2=0x7fec2c15d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.492+0000 7fec2b200640 1 --2- 172.21.15.44:0/2128075627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec2c0acd60 0x7fec2c15d070 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fec180097a0 tx=0x7fec1802b820 comp rx=0 tx=0).stop 2024-03-30T13:16:26.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.493+0000 7fec2b200640 1 -- 172.21.15.44:0/2128075627 shutdown_connections 2024-03-30T13:16:26.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.493+0000 7fec2b200640 1 --2- 172.21.15.44:0/2128075627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec2c0acd60 0x7fec2c15d070 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.493+0000 7fec2b200640 1 --2- 172.21.15.44:0/2128075627 >> v2:172.21.15.151:3300/0 conn(0x7fec2c06e980 0x7fec2c072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.493+0000 7fec2b200640 1 -- 172.21.15.44:0/2128075627 >> 172.21.15.44:0/2128075627 conn(0x7fec2c0cfd90 msgr2=0x7fec2c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:26.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.493+0000 7fec2b200640 1 -- 172.21.15.44:0/2128075627 shutdown_connections 2024-03-30T13:16:26.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.493+0000 7fec2b200640 1 -- 172.21.15.44:0/2128075627 wait complete. 2024-03-30T13:16:26.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.495+0000 7fec2b200640 1 Processor -- start 2024-03-30T13:16:26.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.496+0000 7fec2b200640 1 -- start start 2024-03-30T13:16:26.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.497+0000 7fec2b200640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec2c06e980 0x7fec2c14c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.497+0000 7fec2b200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c0acd60 0x7fec2c154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.497+0000 7fec2b200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec2c0ae9d0 0x7fec2c1551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.497+0000 7fec2b200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c071c60 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.497+0000 7fec2b200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c071980 con 0x7fec2c0acd60 2024-03-30T13:16:26.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.497+0000 7fec2b200640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7fec2c156020 con 0x7fec2c06e980 2024-03-30T13:16:26.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.497+0000 7fec2a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec2c0ae9d0 0x7fec2c1551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.498+0000 7fec2a800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec2c0ae9d0 0x7fec2c1551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37332/0 (socket says 172.21.15.44:37332) 2024-03-30T13:16:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.498+0000 7fec2a800640 1 -- 172.21.15.44:0/608858239 learned_addr learned my addr 172.21.15.44:0/608858239 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.498+0000 7fec29400640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c0acd60 0x7fec2c154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.498+0000 7fec29e00640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec2c06e980 0x7fec2c14c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.498+0000 7fec2a800640 1 -- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec2c06e980 msgr2=0x7fec2c14c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.498+0000 7fec2a800640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec2c06e980 0x7fec2c14c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.498+0000 7fec2a800640 1 -- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c0acd60 msgr2=0x7fec2c154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.498+0000 7fec2a800640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c0acd60 0x7fec2c154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.498+0000 7fec2a800640 1 -- 172.21.15.44:0/608858239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c1f5330 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.498+0000 7fec29e00640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec2c06e980 0x7fec2c14c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-30T13:16:26.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.498+0000 7fec2a800640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec2c0ae9d0 0x7fec2c1551b0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fec2400cb40 tx=0x7fec2400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:26.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.499+0000 7fec22000640 1 -- 172.21.15.44:0/608858239 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24017070 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.499+0000 7fec22000640 1 -- 172.21.15.44:0/608858239 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2400ac40 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.499+0000 7fec22000640 1 -- 172.21.15.44:0/608858239 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec24012400 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.499+0000 7fec2b200640 1 -- 172.21.15.44:0/608858239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2c1f55d0 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.499+0000 7fec2b200640 1 -- 172.21.15.44:0/608858239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2c1f5b90 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.500+0000 7fec2b200640 1 -- 172.21.15.44:0/608858239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec2c075890 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.501+0000 7fec22000640 1 -- 172.21.15.44:0/608858239 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fec2401a070 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.502+0000 7fec22000640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fec0c06c530 0x7fec0c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.502+0000 7fec22000640 1 -- 172.21.15.44:0/608858239 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7fec2408b410 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.503+0000 7fec29e00640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fec0c06c530 0x7fec0c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.504+0000 7fec29e00640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fec0c06c530 0x7fec0c06e9f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009b90 tx=0x7fec1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:26.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.506+0000 7fec22000640 1 -- 172.21.15.44:0/608858239 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fec2c15d5b0 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.712+0000 7fec2b200640 1 -- 172.21.15.44:0/608858239 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fec2c0cc560 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.717+0000 7fec22000640 1 -- 172.21.15.44:0/608858239 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7fec24059b00 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.718+0000 7fec22000640 1 -- 172.21.15.44:0/608858239 <== mon.0 v2:172.21.15.44:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fec24059400 con 0x7fec2c0ae9d0 2024-03-30T13:16:26.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.720+0000 7fec2b200640 1 -- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fec0c06c530 msgr2=0x7fec0c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.720+0000 7fec2b200640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fec0c06c530 0x7fec0c06e9f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fec1c009b90 tx=0x7fec1c008040 comp rx=0 tx=0).stop 2024-03-30T13:16:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.720+0000 7fec2b200640 1 -- 172.21.15.44:0/608858239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec2c0ae9d0 msgr2=0x7fec2c1551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.720+0000 7fec2b200640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec2c0ae9d0 0x7fec2c1551b0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fec2400cb40 tx=0x7fec2400a060 comp rx=0 tx=0).stop 2024-03-30T13:16:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.721+0000 7fec2b200640 1 -- 172.21.15.44:0/608858239 shutdown_connections 2024-03-30T13:16:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.721+0000 7fec2b200640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec2c0ae9d0 0x7fec2c1551b0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.721+0000 7fec2b200640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7fec0c06c530 0x7fec0c06e9f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.721+0000 7fec2b200640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c0acd60 0x7fec2c154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.721+0000 7fec2b200640 1 --2- 172.21.15.44:0/608858239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec2c06e980 0x7fec2c14c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.721+0000 7fec2b200640 1 -- 172.21.15.44:0/608858239 >> 172.21.15.44:0/608858239 conn(0x7fec2c0cfd90 msgr2=0x7fec2c0b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.721+0000 7fec2b200640 1 -- 172.21.15.44:0/608858239 shutdown_connections 2024-03-30T13:16:26.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.721+0000 7fec2b200640 1 -- 172.21.15.44:0/608858239 wait complete. 2024-03-30T13:16:26.744 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-30T13:16:26.744 DEBUG:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-30T13:16:26.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.950+0000 7f4bd9800640 1 Processor -- start 2024-03-30T13:16:26.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.950+0000 7f4bd9800640 1 -- start start 2024-03-30T13:16:26.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.951+0000 7f4bd9800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd415e340 0x7f4bd40b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.951+0000 7f4bd9800640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4bd40d2170 0x7f4bd40d2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.951+0000 7f4bd9800640 1 -- --> v1:172.21.15.44:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd40d25f0 con 0x7f4bd40d2d50 2024-03-30T13:16:26.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.951+0000 7f4bd9800640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd40b42b0 con 0x7f4bd40d2170 2024-03-30T13:16:26.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.951+0000 7f4bd9800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd40b4590 con 0x7f4bd415e340 2024-03-30T13:16:26.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.952+0000 7f4bd8e00640 1 --1- >> v1:172.21.15.44:6789/0 conn(0x7f4bd40d2d50 0x7f4bd40d0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.44:6789/0 says I am v1:172.21.15.44:42614/0 (socket says 172.21.15.44:42614) 2024-03-30T13:16:26.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.952+0000 7f4bd8e00640 1 -- 172.21.15.44:0/26433357 learned_addr learned my addr 172.21.15.44:0/26433357 (peer_addr_for_me v1:172.21.15.44:0/0) 2024-03-30T13:16:26.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.952+0000 7f4bd3e00640 1 --2- 172.21.15.44:0/26433357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd415e340 0x7f4bd40b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.952+0000 7f4bd3400640 1 --2- 172.21.15.44:0/26433357 >> v2:172.21.15.151:3300/0 conn(0x7f4bd40d2170 0x7f4bd40d2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.952+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 <== mon.0 v1:172.21.15.44:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 436293864 0 0) 0x7f4bd40d25f0 con 0x7f4bd40d2d50 2024-03-30T13:16:26.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.952+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 --> v1:172.21.15.44:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bb4003520 con 0x7f4bd40d2d50 2024-03-30T13:16:26.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 <== mon.0 v1:172.21.15.44:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1557310616 0 0) 0x7f4bb4003520 con 0x7f4bd40d2d50 2024-03-30T13:16:26.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd415e340 msgr2=0x7f4bd40b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:26.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 --2- 172.21.15.44:0/26433357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd415e340 0x7f4bd40b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 >> v2:172.21.15.151:3300/0 conn(0x7f4bd40d2170 msgr2=0x7f4bd40d2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:26.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 --2- 172.21.15.44:0/26433357 >> v2:172.21.15.151:3300/0 conn(0x7f4bd40d2170 0x7f4bd40d2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 --> v1:172.21.15.44:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd40b4870 con 0x7f4bd40d2d50 2024-03-30T13:16:26.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 <== mon.0 v1:172.21.15.44:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3251978807 0 0) 0x7f4bcc0019f0 con 0x7f4bd40d2d50 2024-03-30T13:16:26.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 >> v1:172.21.15.44:6789/0 conn(0x7f4bd40d2d50 legacy=0x7f4bd40d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 --2- 172.21.15.44:0/26433357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bb40039b0 0x7f4bb4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 --2- 172.21.15.44:0/26433357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bb4004800 0x7f4bb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 --2- 172.21.15.44:0/26433357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd415e340 0x7f4bb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd40b42b0 con 0x7f4bb4004800 2024-03-30T13:16:26.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd40b4590 con 0x7f4bb40039b0 2024-03-30T13:16:26.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb400b9c0 con 0x7f4bd415e340 2024-03-30T13:16:26.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.953+0000 7f4bd3400640 1 --2- 172.21.15.44:0/26433357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bb4004800 0x7f4bb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.954+0000 7f4bd3e00640 1 --2- 172.21.15.44:0/26433357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bb40039b0 0x7f4bb4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.954+0000 7f4bd8e00640 1 --2- 172.21.15.44:0/26433357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd415e340 0x7f4bb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.954+0000 7f4bd3400640 1 -- 172.21.15.44:0/26433357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd415e340 msgr2=0x7f4bb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:26.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.954+0000 7f4bd3400640 1 --2- 172.21.15.44:0/26433357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bd415e340 0x7f4bb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.954+0000 7f4bd3400640 1 -- 172.21.15.44:0/26433357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bb40039b0 msgr2=0x7f4bb4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-30T13:16:26.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.954+0000 7f4bd3400640 1 --2- 172.21.15.44:0/26433357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bb40039b0 0x7f4bb4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.954+0000 7f4bd3400640 1 -- 172.21.15.44:0/26433357 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb4003520 con 0x7f4bb4004800 2024-03-30T13:16:26.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.955+0000 7f4bd3400640 1 --2- 172.21.15.44:0/26433357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bb4004800 0x7f4bb4004c80 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009ac0 tx=0x7f4bb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e7fb6f16bc36ff server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.955+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc039070 con 0x7f4bb4004800 2024-03-30T13:16:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.955+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4bbc02c6d0 con 0x7f4bb4004800 2024-03-30T13:16:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.955+0000 7f4bd2a00640 1 -- 172.21.15.44:0/26433357 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc009690 con 0x7f4bb4004800 2024-03-30T13:16:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.956+0000 7f4bd9800640 1 -- 172.21.15.44:0/26433357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bb4004800 msgr2=0x7f4bb4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.956+0000 7f4bd9800640 1 --2- 172.21.15.44:0/26433357 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bb4004800 0x7f4bb4004c80 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009ac0 tx=0x7f4bb4005830 comp rx=0 tx=0).stop 2024-03-30T13:16:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.956+0000 7f4bd8e00640 1 -- 172.21.15.44:0/26433357 reap_dead start 2024-03-30T13:16:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.956+0000 7f4bd9800640 1 -- 172.21.15.44:0/26433357 shutdown_connections 2024-03-30T13:16:26.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.956+0000 7f4bd9800640 1 -- 172.21.15.44:0/26433357 >> 172.21.15.44:0/26433357 conn(0x7f4bd408dc60 msgr2=0x7f4bd409d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:26.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.956+0000 7f4bd9800640 1 -- 172.21.15.44:0/26433357 shutdown_connections 2024-03-30T13:16:26.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.956+0000 7f4bd9800640 1 -- 172.21.15.44:0/26433357 wait complete. 2024-03-30T13:16:26.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.958+0000 7f4bd9800640 1 Processor -- start 2024-03-30T13:16:26.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.958+0000 7f4bd9800640 1 -- start start 2024-03-30T13:16:26.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.959+0000 7f4bd9800640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bb4004800 0x7f4bd4155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.959+0000 7f4bd9800640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd4155fa0 0x7f4bd41f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.959+0000 7f4bd9800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bd41f4ad0 0x7f4bd41f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.959+0000 7f4bd9800640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd415e720 con 0x7f4bd4155fa0 2024-03-30T13:16:26.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.959+0000 7f4bd9800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd40b4e30 con 0x7f4bd41f4ad0 2024-03-30T13:16:26.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.959+0000 7f4bd9800640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd415e8a0 con 0x7f4bb4004800 2024-03-30T13:16:26.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.959+0000 7f4bd3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd4155fa0 0x7f4bd41f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.959+0000 7f4bd3400640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd4155fa0 0x7f4bd41f4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53716/0 (socket says 172.21.15.44:53716) 2024-03-30T13:16:26.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.959+0000 7f4bd3400640 1 -- 172.21.15.44:0/3171996594 learned_addr learned my addr 172.21.15.44:0/3171996594 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-03-30T13:16:26.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.960+0000 7f4bd3e00640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bb4004800 0x7f4bd4155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.960+0000 7f4bd8e00640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bd41f4ad0 0x7f4bd41f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.960+0000 7f4bd3400640 1 -- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bb4004800 msgr2=0x7f4bd4155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.960+0000 7f4bd3400640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bb4004800 0x7f4bd4155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.960+0000 7f4bd3400640 1 -- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bd41f4ad0 msgr2=0x7f4bd41f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.960+0000 7f4bd3400640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bd41f4ad0 0x7f4bd41f4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.960+0000 7f4bd3400640 1 -- 172.21.15.44:0/3171996594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd40c96b0 con 0x7f4bd4155fa0 2024-03-30T13:16:26.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.960+0000 7f4bd3400640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd4155fa0 0x7f4bd41f4590 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc000c00 tx=0x7f4bbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.960+0000 7f4bcbe00640 1 -- 172.21.15.44:0/3171996594 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc039050 con 0x7f4bd4155fa0 2024-03-30T13:16:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.960+0000 7f4bcbe00640 1 -- 172.21.15.44:0/3171996594 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4bbc045070 con 0x7f4bd4155fa0 2024-03-30T13:16:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.960+0000 7f4bcbe00640 1 -- 172.21.15.44:0/3171996594 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0044e0 con 0x7f4bd4155fa0 2024-03-30T13:16:26.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.960+0000 7f4bd9800640 1 -- 172.21.15.44:0/3171996594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd4154850 con 0x7f4bd4155fa0 2024-03-30T13:16:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.961+0000 7f4bd9800640 1 -- 172.21.15.44:0/3171996594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd4156720 con 0x7f4bd4155fa0 2024-03-30T13:16:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.962+0000 7f4bd9800640 1 -- 172.21.15.44:0/3171996594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd406e120 con 0x7f4bd4155fa0 2024-03-30T13:16:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.963+0000 7f4bcbe00640 1 -- 172.21.15.44:0/3171996594 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4bbc003a70 con 0x7f4bd4155fa0 2024-03-30T13:16:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.964+0000 7f4bcbe00640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4bb006c530 0x7f4bb006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-30T13:16:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.964+0000 7f4bcbe00640 1 -- 172.21.15.44:0/3171996594 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5335+0+0 (secure 0 0 0) 0x7f4bbc0ad230 con 0x7f4bd4155fa0 2024-03-30T13:16:26.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.964+0000 7f4bd3e00640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4bb006c530 0x7f4bb006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-30T13:16:26.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.966+0000 7f4bd3e00640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4bb006c530 0x7f4bb006e9f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40c9c10 tx=0x7f4bc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-30T13:16:26.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:26.970+0000 7f4bcbe00640 1 -- 172.21.15.44:0/3171996594 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4bd406e120 con 0x7f4bd4155fa0 2024-03-30T13:16:27.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.215+0000 7f4bd9800640 1 -- 172.21.15.44:0/3171996594 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4bd415d080 con 0x7f4bd4155fa0 2024-03-30T13:16:27.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.216+0000 7f4bcbe00640 1 -- 172.21.15.44:0/3171996594 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+3875 (secure 0 0 0) 0x7f4bbc04e020 con 0x7f4bd4155fa0 2024-03-30T13:16:27.220 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-03-30T13:16:27.221 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5053,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6836/3435907345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":3435907345},{"type":"v1","addr":"172.21.15.151:6836","nonce":3435907345}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5056,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/3966337326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6835","nonce":3966337326},{"type":"v1","addr":"172.21.15.151:6837","nonce":3966337326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5289,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6833/4136308231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":4136308231},{"type":"v1","addr":"172.21.15.44:6833","nonce":4136308231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":6654,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2695054166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2695054166},{"type":"v1","addr":"172.21.15.44:6835","nonce":2695054166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[]} 2024-03-30T13:16:27.221 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 23 2024-03-30T13:16:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.219+0000 7f4bd9800640 1 -- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4bb006c530 msgr2=0x7f4bb006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.219+0000 7f4bd9800640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4bb006c530 0x7f4bb006e9f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40c9c10 tx=0x7f4bc4008040 comp rx=0 tx=0).stop 2024-03-30T13:16:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.219+0000 7f4bd9800640 1 -- 172.21.15.44:0/3171996594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd4155fa0 msgr2=0x7f4bd41f4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-30T13:16:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.219+0000 7f4bd9800640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd4155fa0 0x7f4bd41f4590 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc000c00 tx=0x7f4bbc004730 comp rx=0 tx=0).stop 2024-03-30T13:16:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.219+0000 7f4bd9800640 1 -- 172.21.15.44:0/3171996594 shutdown_connections 2024-03-30T13:16:27.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.219+0000 7f4bd9800640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:6832/4285775013,v1:172.21.15.151:6833/4285775013] conn(0x7f4bb006c530 0x7f4bb006e9f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.219+0000 7f4bd9800640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4bd41f4ad0 0x7f4bd41f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.219+0000 7f4bd9800640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4bd4155fa0 0x7f4bd41f4590 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.219+0000 7f4bd9800640 1 --2- 172.21.15.44:0/3171996594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4bb4004800 0x7f4bd4155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-30T13:16:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.219+0000 7f4bd9800640 1 -- 172.21.15.44:0/3171996594 >> 172.21.15.44:0/3171996594 conn(0x7f4bd408dc60 msgr2=0x7f4bd40b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-30T13:16:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.219+0000 7f4bd9800640 1 -- 172.21.15.44:0/3171996594 shutdown_connections 2024-03-30T13:16:27.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-03-30T13:16:27.219+0000 7f4bd9800640 1 -- 172.21.15.44:0/3171996594 wait complete. 2024-03-30T13:16:27.241 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-30T13:16:27.241 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-30T13:16:27.242 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-30T13:16:27.242 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.260 INFO:tasks.ceph.mds.a:Stopped 2024-03-30T13:16:27.260 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-30T13:16:27.260 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.323 INFO:tasks.ceph.mds.c:Stopped 2024-03-30T13:16:27.324 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-30T13:16:27.324 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.346 INFO:tasks.ceph.mds.b:Stopped 2024-03-30T13:16:27.346 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-30T13:16:27.346 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.411 INFO:tasks.ceph.mds.d:Stopped 2024-03-30T13:16:27.411 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-30T13:16:27.412 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-30T13:16:27.412 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.471 INFO:tasks.ceph.osd.0:Stopped 2024-03-30T13:16:27.471 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-30T13:16:27.471 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.537 INFO:tasks.ceph.osd.1:Stopped 2024-03-30T13:16:27.537 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-30T13:16:27.538 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.588 INFO:tasks.ceph.osd.2:Stopped 2024-03-30T13:16:27.588 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-30T13:16:27.588 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.648 INFO:tasks.ceph.osd.3:Stopped 2024-03-30T13:16:27.648 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-30T13:16:27.648 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.711 INFO:tasks.ceph.osd.4:Stopped 2024-03-30T13:16:27.712 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-30T13:16:27.712 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.775 INFO:tasks.ceph.osd.5:Stopped 2024-03-30T13:16:27.776 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-30T13:16:27.776 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.837 INFO:tasks.ceph.osd.6:Stopped 2024-03-30T13:16:27.838 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-30T13:16:27.838 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.894 INFO:tasks.ceph.osd.7:Stopped 2024-03-30T13:16:27.895 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-30T13:16:27.895 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-30T13:16:27.895 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:27.982 INFO:tasks.ceph.mgr.y:Stopped 2024-03-30T13:16:27.982 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-30T13:16:27.982 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:28.066 INFO:tasks.ceph.mgr.x:Stopped 2024-03-30T13:16:28.066 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-30T13:16:28.067 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-30T13:16:28.067 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:28.120 INFO:tasks.ceph.mon.a:Stopped 2024-03-30T13:16:28.120 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-30T13:16:28.120 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:28.163 INFO:tasks.ceph.mon.b:Stopped 2024-03-30T13:16:28.164 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-30T13:16:28.164 INFO:teuthology.orchestra.run:waiting for 300 2024-03-30T13:16:28.203 INFO:tasks.ceph.mon.c:Stopped 2024-03-30T13:16:28.203 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-30T13:16:28.204 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-03-30T13:16:28.317 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:16:28.318 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-30T13:16:28.548 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:16:28.548 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-30T13:16:28.856 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:16:28.857 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-30T13:16:29.060 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:16:29.061 DEBUG:teuthology.orchestra.run.smithi044:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-30T13:16:29.203 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:16:29.203 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-30T13:16:29.449 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:16:29.449 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-30T13:16:29.597 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:16:29.597 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-30T13:16:29.756 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:16:29.756 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-30T13:16:29.927 INFO:tasks.ceph:Archiving mon data... 2024-03-30T13:16:29.929 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154/data/mon.a.tgz 2024-03-30T13:16:29.929 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-03-30T13:16:29.990 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.oGQIQV5rJu 2024-03-30T13:16:29.990 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.oGQIQV5rJu 2024-03-30T13:16:30.171 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.oGQIQV5rJu 2024-03-30T13:16:30.333 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.oGQIQV5rJu is 352KB 2024-03-30T13:16:30.445 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.oGQIQV5rJu 2024-03-30T13:16:30.504 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154/data/mon.b.tgz 2024-03-30T13:16:30.504 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-03-30T13:16:30.553 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.8ErvGaUfKM 2024-03-30T13:16:30.554 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8ErvGaUfKM 2024-03-30T13:16:30.822 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.8ErvGaUfKM 2024-03-30T13:16:30.949 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.8ErvGaUfKM is 463KB 2024-03-30T13:16:30.963 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:16:30.970 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:16:31.094 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.8ErvGaUfKM 2024-03-30T13:16:31.148 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154/data/mon.c.tgz 2024-03-30T13:16:31.149 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-03-30T13:16:31.198 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.Vx7NviEavn 2024-03-30T13:16:31.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Vx7NviEavn 2024-03-30T13:16:31.388 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.Vx7NviEavn 2024-03-30T13:16:31.535 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.Vx7NviEavn is 463KB 2024-03-30T13:16:31.643 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.Vx7NviEavn 2024-03-30T13:16:31.698 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-30T13:16:31.698 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-30T13:16:31.706 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-30T13:16:31.862 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-30T13:16:31.919 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-30T13:16:31.919 INFO:tasks.ceph:Archiving crash dumps... 2024-03-30T13:16:31.921 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154/remote/smithi044/crash 2024-03-30T13:16:31.922 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-30T13:16:32.019 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154/remote/smithi151/crash 2024-03-30T13:16:32.021 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-30T13:16:32.117 INFO:tasks.ceph:Shutting down logrotate 2024-03-30T13:16:32.118 DEBUG:teuthology.orchestra.run.smithi044:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:16:32.125 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-30T13:16:32.255 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-30T13:16:32.356 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-30T13:16:32.457 INFO:tasks.ceph:Compressing logs... 2024-03-30T13:16:32.458 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-30T13:16:32.465 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-30T13:16:32.554 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-30T13:16:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43185.log 2024-03-30T13:16:32.556 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37362.log 2024-03-30T13:16:32.557 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.3.43185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43185.log.gz 2024-03-30T13:16:32.557 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43189.log 2024-03-30T13:16:32.558 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51127.log 2024-03-30T13:16:32.558 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.37362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37242.log 2024-03-30T13:16:32.559 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57146.log 2024-03-30T13:16:32.560 INFO:teuthology.orchestra.run.smithi151.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37362.log.gz 2024-03-30T13:16:32.560 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.3.43189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43189.log.gz 2024-03-30T13:16:32.560 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37282.log 2024-03-30T13:16:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.37242.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-30T13:16:32.561 INFO:teuthology.orchestra.run.smithi151.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37242.log.gz 2024-03-30T13:16:32.562 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55669.log 2024-03-30T13:16:32.562 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51127.log.gz 2024-03-30T13:16:32.562 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57618.log 2024-03-30T13:16:32.562 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57146.log.gz 2024-03-30T13:16:32.564 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53144.log 2024-03-30T13:16:32.564 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55669.log.gz 2024-03-30T13:16:32.564 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48602.log 2024-03-30T13:16:32.564 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57618.log.gz 2024-03-30T13:16:32.565 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.37282.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-30T13:16:32.565 INFO:teuthology.orchestra.run.smithi151.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37282.log.gz 2024-03-30T13:16:32.565 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-30T13:16:32.565 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37122.log 2024-03-30T13:16:32.566 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.4.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-30T13:16:32.566 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37202.log 2024-03-30T13:16:32.567 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-30T13:16:32.568 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53144.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-30T13:16:32.568 INFO:teuthology.orchestra.run.smithi044.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.53144.log.gz 2024-03-30T13:16:32.568 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48602.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48602.log.gzgzip 2024-03-30T13:16:32.568 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53606.log 2024-03-30T13:16:32.568 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58141.log 2024-03-30T13:16:32.570 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49541.log 2024-03-30T13:16:32.570 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53606.log.gz 2024-03-30T13:16:32.570 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44274.log 2024-03-30T13:16:32.571 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58141.log.gz 2024-03-30T13:16:32.571 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.37122.log: /var/log/ceph/ceph-client.admin.37202.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37122.log.gz 2024-03-30T13:16:32.571 INFO:teuthology.orchestra.run.smithi151.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37202.log.gz 2024-03-30T13:16:32.571 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-30T13:16:32.571 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43806.log 2024-03-30T13:16:32.572 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37082.log 2024-03-30T13:16:32.573 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.1.43806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37322.log 2024-03-30T13:16:32.573 INFO:teuthology.orchestra.run.smithi151.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43806.log.gz 2024-03-30T13:16:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49541.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49541.log.gz 2024-03-30T13:16:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47972.log 2024-03-30T13:16:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45618.log 2024-03-30T13:16:32.574 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44274.log.gz 2024-03-30T13:16:32.574 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46496.log 2024-03-30T13:16:32.576 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.37082.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-30T13:16:32.576 INFO:teuthology.orchestra.run.smithi151.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37082.log.gz 2024-03-30T13:16:32.576 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.37322.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37322.log.gz 2024-03-30T13:16:32.576 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42790.log 2024-03-30T13:16:32.577 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47972.log.gz 2024-03-30T13:16:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55273.log 2024-03-30T13:16:32.577 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45618.log.gz 2024-03-30T13:16:32.577 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44484.log 2024-03-30T13:16:32.577 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46496.log.gz 2024-03-30T13:16:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49313.log 2024-03-30T13:16:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44484.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55273.log.gz 2024-03-30T13:16:32.579 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43884.log 2024-03-30T13:16:32.580 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44484.log.gz 2024-03-30T13:16:32.580 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43802.log 2024-03-30T13:16:32.581 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.1.42790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42790.log.gz 2024-03-30T13:16:32.581 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-30T13:16:32.581 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.1.43802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43802.log.gz 2024-03-30T13:16:32.581 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-30T13:16:32.582 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47636.log 2024-03-30T13:16:32.583 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49313.log.gz 2024-03-30T13:16:32.583 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48755.log 2024-03-30T13:16:32.583 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43884.log.gz 2024-03-30T13:16:32.583 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49745.log 2024-03-30T13:16:32.583 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47636.log.gz 2024-03-30T13:16:32.585 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42898.log 2024-03-30T13:16:32.586 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48755.log.gz 2024-03-30T13:16:32.586 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55999.log 2024-03-30T13:16:32.586 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49745.log.gz 2024-03-30T13:16:32.586 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50957.log 2024-03-30T13:16:32.586 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-30T13:16:32.586 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37162.log 2024-03-30T13:16:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.37162.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-30T13:16:32.589 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55999.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.42898.log.gz 2024-03-30T13:16:32.589 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46080.log 2024-03-30T13:16:32.589 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55999.log.gz 2024-03-30T13:16:32.589 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51352.log 2024-03-30T13:16:32.589 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50957.log.gz 2024-03-30T13:16:32.589 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58595.log 2024-03-30T13:16:32.592 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46080.log.gz 2024-03-30T13:16:32.592 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51578.log 2024-03-30T13:16:32.592 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51352.log.gz 2024-03-30T13:16:32.592 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45081.log 2024-03-30T13:16:32.592 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58595.log.gz 2024-03-30T13:16:32.593 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mds.d.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37162.log.gz 2024-03-30T13:16:32.593 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42771.log 2024-03-30T13:16:32.593 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-30T13:16:32.595 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46164.log 2024-03-30T13:16:32.595 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51578.log.gz 2024-03-30T13:16:32.595 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50249.log 2024-03-30T13:16:32.595 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45081.log.gz 2024-03-30T13:16:32.595 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58949.log 2024-03-30T13:16:32.595 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46164.log.gz 2024-03-30T13:16:32.597 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.1.42771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42771.log.gz 2024-03-30T13:16:32.598 INFO:teuthology.orchestra.run.smithi151.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-30T13:16:32.598 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58419.log 2024-03-30T13:16:32.598 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50249.log.gz 2024-03-30T13:16:32.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42383.log 2024-03-30T13:16:32.599 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58949.log.gz 2024-03-30T13:16:32.599 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46834.log 2024-03-30T13:16:32.599 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58419.log.gz 2024-03-30T13:16:32.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45074.log 2024-03-30T13:16:32.600 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42383.log.gz 2024-03-30T13:16:32.600 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.46834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55867.log 2024-03-30T13:16:32.601 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46834.log.gz 2024-03-30T13:16:32.602 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57576.log 2024-03-30T13:16:32.602 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45074.log.gz 2024-03-30T13:16:32.603 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52090.log 2024-03-30T13:16:32.603 INFO:teuthology.orchestra.run.smithi044.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.55867.log.gz 2024-03-30T13:16:32.604 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51264.log 2024-03-30T13:16:32.604 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57576.log.gz 2024-03-30T13:16:32.605 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.52090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52090.log.gz 2024-03-30T13:16:32.605 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42432.log 2024-03-30T13:16:32.606 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45421.log 2024-03-30T13:16:32.606 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51264.log.gz 2024-03-30T13:16:32.607 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56263.log 2024-03-30T13:16:32.608 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42432.log.gz 2024-03-30T13:16:32.608 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45421.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.45421.log.gz -5 2024-03-30T13:16:32.609 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57962.log 2024-03-30T13:16:32.610 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45870.log 2024-03-30T13:16:32.610 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.56263.log.gz 2024-03-30T13:16:32.611 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50459.log 2024-03-30T13:16:32.611 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57962.log.gz 2024-03-30T13:16:32.612 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49181.log 2024-03-30T13:16:32.612 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45870.log.gz 2024-03-30T13:16:32.613 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42233.log 2024-03-30T13:16:32.613 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50459.log.gz 2024-03-30T13:16:32.614 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50207.log 2024-03-30T13:16:32.615 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mon.c.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-30T13:16:32.615 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49181.log.gz 2024-03-30T13:16:32.616 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48098.log 2024-03-30T13:16:32.616 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42233.log.gz 2024-03-30T13:16:32.617 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53936.log 2024-03-30T13:16:32.617 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50207.log.gz 2024-03-30T13:16:32.618 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57828.log 2024-03-30T13:16:32.618 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48098.log.gz 2024-03-30T13:16:32.619 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45413.log 2024-03-30T13:16:32.620 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57828.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53936.log.gz 2024-03-30T13:16:32.620 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42560.log 2024-03-30T13:16:32.620 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57828.log.gz 2024-03-30T13:16:32.621 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50417.log 2024-03-30T13:16:32.621 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45413.log.gz 2024-03-30T13:16:32.622 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45954.log 2024-03-30T13:16:32.623 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42560.log.gz 2024-03-30T13:16:32.623 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47510.log 2024-03-30T13:16:32.624 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50417.log.gz 2024-03-30T13:16:32.625 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53540.log 2024-03-30T13:16:32.625 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45954.log.gz 2024-03-30T13:16:32.625 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56131.log 2024-03-30T13:16:32.626 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47510.log.gz 2024-03-30T13:16:32.627 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43650.log 2024-03-30T13:16:32.627 INFO:teuthology.orchestra.run.smithi044.stderr: 90.7%/var/log/ceph/ceph-client.admin.56131.log: -- replaced with /var/log/ceph/ceph-client.admin.53540.log.gz 2024-03-30T13:16:32.628 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47846.log 2024-03-30T13:16:32.629 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56131.log.gz 2024-03-30T13:16:32.629 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50501.log 2024-03-30T13:16:32.629 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43650.log.gz 2024-03-30T13:16:32.630 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56527.log 2024-03-30T13:16:32.630 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47846.log.gz 2024-03-30T13:16:32.632 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50501.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50501.log.gz 2024-03-30T13:16:32.632 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41958.log 2024-03-30T13:16:32.633 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48224.log 2024-03-30T13:16:32.634 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.41958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51664.log 2024-03-30T13:16:32.634 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56527.log.gz 2024-03-30T13:16:32.635 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41958.log.gz 2024-03-30T13:16:32.635 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53870.log 2024-03-30T13:16:32.636 INFO:teuthology.orchestra.run.smithi044.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48224.log.gz 2024-03-30T13:16:32.636 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49055.log 2024-03-30T13:16:32.636 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51664.log.gz 2024-03-30T13:16:32.637 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43968.log 2024-03-30T13:16:32.638 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49055.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53870.log.gz 2024-03-30T13:16:32.639 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49829.log 2024-03-30T13:16:32.639 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49055.log.gz 2024-03-30T13:16:32.640 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54546.log 2024-03-30T13:16:32.640 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43968.log.gz 2024-03-30T13:16:32.641 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37038.log 2024-03-30T13:16:32.641 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49829.log.gz 2024-03-30T13:16:32.642 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53342.log 2024-03-30T13:16:32.643 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54546.log.gz 2024-03-30T13:16:32.643 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58739.log 2024-03-30T13:16:32.644 INFO:teuthology.orchestra.run.smithi044.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.37038.log.gz 2024-03-30T13:16:32.645 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57534.log 2024-03-30T13:16:32.645 INFO:teuthology.orchestra.run.smithi044.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53342.log.gz 2024-03-30T13:16:32.646 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49955.log 2024-03-30T13:16:32.646 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58739.log.gz 2024-03-30T13:16:32.647 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42814.log 2024-03-30T13:16:32.647 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57534.log.gz 2024-03-30T13:16:32.648 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45912.log 2024-03-30T13:16:32.648 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49955.log.gz 2024-03-30T13:16:32.649 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2024-03-30T13:16:32.650 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42814.log.gz 2024-03-30T13:16:32.650 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58468.log 2024-03-30T13:16:32.651 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45912.log.gz 2024-03-30T13:16:32.652 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44232.log 2024-03-30T13:16:32.652 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2024-03-30T13:16:32.653 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58468.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58468.log.gz -5 2024-03-30T13:16:32.653 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44736.log 2024-03-30T13:16:32.654 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49457.log 2024-03-30T13:16:32.654 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44232.log.gz 2024-03-30T13:16:32.655 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47888.log 2024-03-30T13:16:32.655 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44736.log.gz 2024-03-30T13:16:32.656 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49013.log 2024-03-30T13:16:32.657 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49457.log.gz 2024-03-30T13:16:32.657 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43699.log 2024-03-30T13:16:32.658 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47888.log.gz 2024-03-30T13:16:32.658 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-30T13:16:32.659 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57188.log 2024-03-30T13:16:32.659 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49013.log.gz 2024-03-30T13:16:32.660 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51520.log 2024-03-30T13:16:32.660 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43699.log.gz 2024-03-30T13:16:32.661 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57188.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57188.log.gz 2024-03-30T13:16:32.662 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47468.log 2024-03-30T13:16:32.662 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50831.log 2024-03-30T13:16:32.663 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51520.log.gz 2024-03-30T13:16:32.663 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44749.log 2024-03-30T13:16:32.664 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47468.log.gz 2024-03-30T13:16:32.665 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49139.log 2024-03-30T13:16:32.665 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50831.log.gz 2024-03-30T13:16:32.666 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49871.log 2024-03-30T13:16:32.666 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44749.log.gz 2024-03-30T13:16:32.667 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.47289.log 2024-03-30T13:16:32.667 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49139.log.gz 2024-03-30T13:16:32.668 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49223.log 2024-03-30T13:16:32.668 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49871.log.gz 2024-03-30T13:16:32.669 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.2.47289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.47289.log.gz 2024-03-30T13:16:32.669 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53276.log 2024-03-30T13:16:32.670 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43605.log 2024-03-30T13:16:32.671 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49223.log.gz 2024-03-30T13:16:32.671 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48182.log 2024-03-30T13:16:32.672 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43605.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53276.log.gz 2024-03-30T13:16:32.673 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52578.log 2024-03-30T13:16:32.673 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43605.log.gz 2024-03-30T13:16:32.674 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46248.log 2024-03-30T13:16:32.674 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48182.log.gz 2024-03-30T13:16:32.675 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44442.log 2024-03-30T13:16:32.676 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46248.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.52578.log.gz 2024-03-30T13:16:32.676 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54755.log 2024-03-30T13:16:32.677 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46248.log.gz 2024-03-30T13:16:32.678 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58907.log 2024-03-30T13:16:32.678 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44442.log.gz 2024-03-30T13:16:32.678 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59285.log 2024-03-30T13:16:32.680 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58907.log: gzip 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54755.log.gz -5 2024-03-30T13:16:32.680 INFO:teuthology.orchestra.run.smithi044.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48140.log 2024-03-30T13:16:32.680 INFO:teuthology.orchestra.run.smithi044.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58907.log.gz 2024-03-30T13:16:32.681 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.59285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57308.log 2024-03-30T13:16:32.681 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59285.log.gz 2024-03-30T13:16:32.682 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50039.log 2024-03-30T13:16:32.682 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48140.log.gz 2024-03-30T13:16:32.683 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57308.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-30T13:16:32.683 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57308.log.gz 2024-03-30T13:16:32.684 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50039.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50039.log.gz 2024-03-30T13:16:32.685 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48713.log 2024-03-30T13:16:32.685 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44568.log 2024-03-30T13:16:32.686 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45660.log 2024-03-30T13:16:32.687 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48713.log.gz 2024-03-30T13:16:32.688 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-30T13:16:32.688 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44568.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44568.log.gz 2024-03-30T13:16:32.688 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54266.log 2024-03-30T13:16:32.689 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51898.log 2024-03-30T13:16:32.689 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45660.log.gz 2024-03-30T13:16:32.690 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46038.log 2024-03-30T13:16:32.691 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51898.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54266.log.gz 2024-03-30T13:16:32.692 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44748.log 2024-03-30T13:16:32.692 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51898.log.gz 2024-03-30T13:16:32.692 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42295.log 2024-03-30T13:16:32.693 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46038.log.gz 2024-03-30T13:16:32.694 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46967.log 2024-03-30T13:16:32.694 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44748.log.gz 2024-03-30T13:16:32.695 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51478.log 2024-03-30T13:16:32.695 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42295.log.gz 2024-03-30T13:16:32.696 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53474.log 2024-03-30T13:16:32.697 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46967.log.gz 2024-03-30T13:16:32.697 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56611.log 2024-03-30T13:16:32.698 INFO:teuthology.orchestra.run.smithi044.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51478.log.gz 2024-03-30T13:16:32.698 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46122.log 2024-03-30T13:16:32.699 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53474.log.gz 2024-03-30T13:16:32.700 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56329.log 2024-03-30T13:16:32.700 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56611.log.gz 2024-03-30T13:16:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57266.log 2024-03-30T13:16:32.701 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46122.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46122.log.gz 2024-03-30T13:16:32.702 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42054.log 2024-03-30T13:16:32.702 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56329.log.gz 2024-03-30T13:16:32.703 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59076.log 2024-03-30T13:16:32.703 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57266.log.gz 2024-03-30T13:16:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50375.log 2024-03-30T13:16:32.706 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42054.log.gz 2024-03-30T13:16:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.59076.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59076.log.gz 2024-03-30T13:16:32.706 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51436.log 2024-03-30T13:16:32.707 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52494.log 2024-03-30T13:16:32.707 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50375.log.gz 2024-03-30T13:16:32.708 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42135.log 2024-03-30T13:16:32.708 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51436.log.gz 2024-03-30T13:16:32.709 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51310.log 2024-03-30T13:16:32.709 INFO:teuthology.orchestra.run.smithi044.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52494.log.gz 2024-03-30T13:16:32.710 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42856.log 2024-03-30T13:16:32.710 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42135.log.gz 2024-03-30T13:16:32.711 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45407.log 2024-03-30T13:16:32.711 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51310.log.gz 2024-03-30T13:16:32.712 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42856.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42856.log.gz 2024-03-30T13:16:32.712 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43842.log 2024-03-30T13:16:32.713 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45407.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45407.log.gz 2024-03-30T13:16:32.713 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44190.log 2024-03-30T13:16:32.715 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44010.log 2024-03-30T13:16:32.715 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43842.log.gz 2024-03-30T13:16:32.715 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58553.log 2024-03-30T13:16:32.716 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44190.log.gz 2024-03-30T13:16:32.716 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44010.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44010.log.gz 2024-03-30T13:16:32.717 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42604.log 2024-03-30T13:16:32.718 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43784.log 2024-03-30T13:16:32.718 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58553.log.gz 2024-03-30T13:16:32.719 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42604.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42604.log.gz 2024-03-30T13:16:32.719 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43562.log 2024-03-30T13:16:32.720 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52086.log 2024-03-30T13:16:32.720 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43784.log.gz 2024-03-30T13:16:32.721 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43562.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43562.log.gz 2024-03-30T13:16:32.721 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51222.log 2024-03-30T13:16:32.722 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.52086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52086.log.gz 2024-03-30T13:16:32.722 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42338.log 2024-03-30T13:16:32.723 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45828.log 2024-03-30T13:16:32.723 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51222.log.gz 2024-03-30T13:16:32.724 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42338.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42338.log.gz 2024-03-30T13:16:32.724 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58637.log 2024-03-30T13:16:32.725 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47552.log 2024-03-30T13:16:32.725 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45828.log.gz 2024-03-30T13:16:32.726 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58637.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58637.log.gz 2024-03-30T13:16:32.727 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45412.log 2024-03-30T13:16:32.727 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47552.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47552.log.gz 2024-03-30T13:16:32.728 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-30T13:16:32.729 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45422.log 2024-03-30T13:16:32.729 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45412.log.gz 2024-03-30T13:16:32.730 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31009.log 2024-03-30T13:16:32.731 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50333.log 2024-03-30T13:16:32.731 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45422.log.gz 2024-03-30T13:16:32.732 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.tmp-client.admin.31009.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31009.log.gz 2024-03-30T13:16:32.732 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45080.log 2024-03-30T13:16:32.733 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58099.log 2024-03-30T13:16:32.733 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50333.log.gz 2024-03-30T13:16:32.735 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51748.log 2024-03-30T13:16:32.735 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45080.log.gz 2024-03-30T13:16:32.736 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59033.log 2024-03-30T13:16:32.736 INFO:teuthology.orchestra.run.smithi044.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58099.log.gz 2024-03-30T13:16:32.737 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44738.log 2024-03-30T13:16:32.737 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51748.log.gz 2024-03-30T13:16:32.738 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.59033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58697.log 2024-03-30T13:16:32.738 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59033.log.gz 2024-03-30T13:16:32.739 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51706.log 2024-03-30T13:16:32.740 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44738.log.gz 2024-03-30T13:16:32.741 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47426.log 2024-03-30T13:16:32.741 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58697.log.gz 2024-03-30T13:16:32.741 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53738.log 2024-03-30T13:16:32.742 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51706.log.gz 2024-03-30T13:16:32.742 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47426.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47426.log.gz 2024-03-30T13:16:32.743 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48934.log 2024-03-30T13:16:32.744 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47804.log 2024-03-30T13:16:32.745 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48934.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53738.log.gz 2024-03-30T13:16:32.745 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57702.log 2024-03-30T13:16:32.746 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48934.log.gz 2024-03-30T13:16:32.747 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47804.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47804.log.gz 2024-03-30T13:16:32.747 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53804.log 2024-03-30T13:16:32.747 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48014.log 2024-03-30T13:16:32.748 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-30T13:16:32.748 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57702.log.gz 2024-03-30T13:16:32.749 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45702.log 2024-03-30T13:16:32.750 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53804.log.gz 2024-03-30T13:16:32.750 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44148.log 2024-03-30T13:16:32.751 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48014.log.gz 2024-03-30T13:16:32.752 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42180.log 2024-03-30T13:16:32.752 INFO:teuthology.orchestra.run.smithi044.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45702.log.gz 2024-03-30T13:16:32.752 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44148.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44148.log.gz 2024-03-30T13:16:32.753 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45362.log 2024-03-30T13:16:32.754 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51394.log 2024-03-30T13:16:32.754 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42180.log.gz 2024-03-30T13:16:32.755 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45362.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45362.log.gz 2024-03-30T13:16:32.755 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42772.log 2024-03-30T13:16:32.756 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49097.log 2024-03-30T13:16:32.757 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51394.log.gz 2024-03-30T13:16:32.757 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45786.log 2024-03-30T13:16:32.758 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42772.log.gz 2024-03-30T13:16:32.759 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49097.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49097.log.gz 2024-03-30T13:16:32.759 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54068.log 2024-03-30T13:16:32.760 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50704.log 2024-03-30T13:16:32.760 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45786.log.gz 2024-03-30T13:16:32.761 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58865.log 2024-03-30T13:16:32.761 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54068.log.gz 2024-03-30T13:16:32.762 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59161.log 2024-03-30T13:16:32.762 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50704.log.gz 2024-03-30T13:16:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58865.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58865.log.gz 2024-03-30T13:16:32.763 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58057.log 2024-03-30T13:16:32.764 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.59161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49913.log 2024-03-30T13:16:32.764 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59161.log.gz 2024-03-30T13:16:32.765 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58057.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58057.log.gz 2024-03-30T13:16:32.766 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54332.log 2024-03-30T13:16:32.766 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53012.log 2024-03-30T13:16:32.767 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49913.log.gz 2024-03-30T13:16:32.768 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54134.log 2024-03-30T13:16:32.768 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54332.log.gz 2024-03-30T13:16:32.769 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55471.log 2024-03-30T13:16:32.770 INFO:teuthology.orchestra.run.smithi044.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53012.log.gz 2024-03-30T13:16:32.770 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58511.log 2024-03-30T13:16:32.771 INFO:teuthology.orchestra.run.smithi044.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.54134.log.gz 2024-03-30T13:16:32.772 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57392.log 2024-03-30T13:16:32.772 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55471.log.gz 2024-03-30T13:16:32.773 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54689.log 2024-03-30T13:16:32.774 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58511.log.gz 2024-03-30T13:16:32.774 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57392.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57392.log.gz 2024-03-30T13:16:32.775 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54464.log 2024-03-30T13:16:32.775 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59327.log 2024-03-30T13:16:32.776 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54464.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.54689.log.gz 2024-03-30T13:16:32.777 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55735.log 2024-03-30T13:16:32.777 INFO:teuthology.orchestra.run.smithi044.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.54464.log.gz 2024-03-30T13:16:32.778 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.59327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58823.log 2024-03-30T13:16:32.778 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59327.log.gz 2024-03-30T13:16:32.779 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49373.log 2024-03-30T13:16:32.780 INFO:teuthology.orchestra.run.smithi044.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.55735.log.gz 2024-03-30T13:16:32.781 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44052.log 2024-03-30T13:16:32.781 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58823.log.gz 2024-03-30T13:16:32.782 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49373.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49373.log.gz 2024-03-30T13:16:32.782 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42688.log 2024-03-30T13:16:32.783 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50581.log 2024-03-30T13:16:32.783 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44052.log.gz 2024-03-30T13:16:32.784 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42688.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42688.log.gz 2024-03-30T13:16:32.784 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42518.log 2024-03-30T13:16:32.785 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50123.log 2024-03-30T13:16:32.785 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50581.log.gz 2024-03-30T13:16:32.787 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49661.log 2024-03-30T13:16:32.787 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42518.log.gz 2024-03-30T13:16:32.788 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50123.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-30T13:16:32.788 INFO:teuthology.orchestra.run.smithi044.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50123.log.gz 2024-03-30T13:16:32.789 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-30T13:16:32.789 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58331.log 2024-03-30T13:16:32.789 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49661.log.gz 2024-03-30T13:16:32.790 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55933.log 2024-03-30T13:16:32.792 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45069.log 2024-03-30T13:16:32.792 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58331.log.gz 2024-03-30T13:16:32.793 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49703.log 2024-03-30T13:16:32.794 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55933.log.gz 2024-03-30T13:16:32.794 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43389.log 2024-03-30T13:16:32.795 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45069.log.gz 2024-03-30T13:16:32.796 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57434.log 2024-03-30T13:16:32.796 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49703.log.gz 2024-03-30T13:16:32.798 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49619.log 2024-03-30T13:16:32.799 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48266.log 2024-03-30T13:16:32.799 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57434.log.gz 2024-03-30T13:16:32.800 INFO:teuthology.orchestra.run.smithi044.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.43389.log.gz 2024-03-30T13:16:32.800 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57912.log 2024-03-30T13:16:32.801 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49619.log.gz 2024-03-30T13:16:32.802 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50747.log 2024-03-30T13:16:32.802 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48266.log.gz 2024-03-30T13:16:32.803 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54200.log 2024-03-30T13:16:32.804 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57912.log: /var/log/ceph/ceph-client.admin.50747.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57912.log.gz 2024-03-30T13:16:32.804 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53210.log 2024-03-30T13:16:32.805 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50747.log.gz 2024-03-30T13:16:32.805 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50873.log 2024-03-30T13:16:32.806 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54200.log.gz 2024-03-30T13:16:32.807 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58374.log 2024-03-30T13:16:32.808 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50873.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.53210.log.gz 2024-03-30T13:16:32.808 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55339.log 2024-03-30T13:16:32.809 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50873.log.gz 2024-03-30T13:16:32.810 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58374.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58374.log.gz 2024-03-30T13:16:32.810 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53078.log 2024-03-30T13:16:32.811 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57786.log 2024-03-30T13:16:32.812 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53078.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55339.log.gz 2024-03-30T13:16:32.812 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48892.log 2024-03-30T13:16:32.813 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53078.log.gz 2024-03-30T13:16:32.814 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49787.log 2024-03-30T13:16:32.814 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57786.log.gz 2024-03-30T13:16:32.815 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59245.log 2024-03-30T13:16:32.815 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48892.log.gz 2024-03-30T13:16:32.816 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49787.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49787.log.gz 2024-03-30T13:16:32.816 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51041.log 2024-03-30T13:16:32.818 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.59245.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59245.log.gz 2024-03-30T13:16:32.818 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57492.log 2024-03-30T13:16:32.819 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51832.log 2024-03-30T13:16:32.819 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51041.log.gz 2024-03-30T13:16:32.820 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57492.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57492.log.gz 2024-03-30T13:16:32.820 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48476.log 2024-03-30T13:16:32.821 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45084.log 2024-03-30T13:16:32.821 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51832.log.gz 2024-03-30T13:16:32.822 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46206.log 2024-03-30T13:16:32.823 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48476.log.gz 2024-03-30T13:16:32.824 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44750.log 2024-03-30T13:16:32.824 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45084.log.gz 2024-03-30T13:16:32.825 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47930.log 2024-03-30T13:16:32.825 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46206.log.gz 2024-03-30T13:16:32.827 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44316.log 2024-03-30T13:16:32.827 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44750.log.gz 2024-03-30T13:16:32.828 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50662.log 2024-03-30T13:16:32.828 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2%/var/log/ceph/ceph-client.admin.44316.log: -- replaced with /var/log/ceph/ceph-client.admin.47930.log.gz 2024-03-30T13:16:32.829 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44316.log.gzgzip 2024-03-30T13:16:32.829 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56197.log 2024-03-30T13:16:32.830 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50662.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50662.log.gz 2024-03-30T13:16:32.831 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48308.log 2024-03-30T13:16:32.831 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57744.log 2024-03-30T13:16:32.832 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48308.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56197.log.gz 2024-03-30T13:16:32.833 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57104.log 2024-03-30T13:16:32.833 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48308.log.gz 2024-03-30T13:16:32.834 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57744.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57744.log.gz 2024-03-30T13:16:32.834 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-30T13:16:32.836 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42646.log 2024-03-30T13:16:32.836 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57104.log.gz 2024-03-30T13:16:32.837 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43741.log 2024-03-30T13:16:32.838 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48392.log 2024-03-30T13:16:32.838 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42646.log.gz 2024-03-30T13:16:32.839 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47678.log 2024-03-30T13:16:32.839 INFO:teuthology.orchestra.run.smithi044.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43741.log.gz 2024-03-30T13:16:32.841 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51622.log 2024-03-30T13:16:32.841 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48392.log.gz 2024-03-30T13:16:32.842 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59203.log 2024-03-30T13:16:32.842 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47678.log.gz 2024-03-30T13:16:32.843 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51622.log: 93.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-30T13:16:32.843 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44747.log 2024-03-30T13:16:32.843 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51622.log.gz 2024-03-30T13:16:32.844 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58015.log 2024-03-30T13:16:32.845 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.59203.log: /var/log/ceph/ceph-client.admin.44747.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59203.log.gz 2024-03-30T13:16:32.845 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52428.log 2024-03-30T13:16:32.846 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44747.log.gz 2024-03-30T13:16:32.846 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47762.log 2024-03-30T13:16:32.847 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58015.log.gz 2024-03-30T13:16:32.848 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48843.log 2024-03-30T13:16:32.848 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52428.log.gz 2024-03-30T13:16:32.849 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45414.log 2024-03-30T13:16:32.849 INFO:teuthology.orchestra.run.smithi044.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47762.log.gz 2024-03-30T13:16:32.851 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45071.log 2024-03-30T13:16:32.851 INFO:teuthology.orchestra.run.smithi044.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48843.log.gz 2024-03-30T13:16:32.851 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44744.log 2024-03-30T13:16:32.852 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45414.log.gz 2024-03-30T13:16:32.853 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55537.log 2024-03-30T13:16:32.853 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45071.log.gz 2024-03-30T13:16:32.854 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44744.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44744.log.gz 2024-03-30T13:16:32.854 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48350.log 2024-03-30T13:16:32.855 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49415.log 2024-03-30T13:16:32.856 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48350.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.55537.log.gz 2024-03-30T13:16:32.857 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50999.log 2024-03-30T13:16:32.857 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48350.log.gz 2024-03-30T13:16:32.858 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49415.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49415.log.gz 2024-03-30T13:16:32.858 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44400.log 2024-03-30T13:16:32.859 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46332.log 2024-03-30T13:16:32.860 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50999.log.gz 2024-03-30T13:16:32.861 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53672.log 2024-03-30T13:16:32.861 INFO:teuthology.orchestra.run.smithi044.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44400.log.gz 2024-03-30T13:16:32.862 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.47293.log 2024-03-30T13:16:32.862 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46332.log.gz 2024-03-30T13:16:32.863 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53672.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-30T13:16:32.864 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.2.47293.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53672.log.gz 2024-03-30T13:16:32.864 INFO:teuthology.orchestra.run.smithi044.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.47293.log.gz 2024-03-30T13:16:32.864 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45996.log 2024-03-30T13:16:32.865 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48798.log 2024-03-30T13:16:32.867 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44358.log 2024-03-30T13:16:32.867 INFO:teuthology.orchestra.run.smithi044.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45996.log.gz 2024-03-30T13:16:32.868 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56395.log 2024-03-30T13:16:32.869 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48798.log.gz 2024-03-30T13:16:32.870 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56461.log 2024-03-30T13:16:32.870 INFO:teuthology.orchestra.run.smithi044.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44358.log.gz 2024-03-30T13:16:32.871 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50291.log 2024-03-30T13:16:32.872 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56395.log.gz 2024-03-30T13:16:32.872 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58991.log 2024-03-30T13:16:32.873 INFO:teuthology.orchestra.run.smithi044.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.56461.log.gz 2024-03-30T13:16:32.874 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51171.log 2024-03-30T13:16:32.874 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50291.log.gz 2024-03-30T13:16:32.875 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55603.log 2024-03-30T13:16:32.875 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58991.log.gz 2024-03-30T13:16:32.876 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44526.log 2024-03-30T13:16:32.876 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51171.log.gz 2024-03-30T13:16:32.878 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54398.log 2024-03-30T13:16:32.878 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44526.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.55603.log.gz 2024-03-30T13:16:32.879 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51790.log 2024-03-30T13:16:32.879 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44526.log.gz 2024-03-30T13:16:32.880 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42476.log 2024-03-30T13:16:32.881 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54398.log.gz 2024-03-30T13:16:32.882 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56677.log 2024-03-30T13:16:32.882 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51790.log.gz 2024-03-30T13:16:32.883 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42476.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-30T13:16:32.883 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42476.log.gz 2024-03-30T13:16:32.884 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53408.log 2024-03-30T13:16:32.885 INFO:teuthology.orchestra.run.smithi044.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56677.log.gz 2024-03-30T13:16:32.886 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49997.log 2024-03-30T13:16:32.887 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.53408.log: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-30T13:16:32.887 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45744.log 2024-03-30T13:16:32.888 INFO:teuthology.orchestra.run.smithi044.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53408.log.gz 2024-03-30T13:16:32.889 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43926.log 2024-03-30T13:16:32.889 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49997.log.gz 2024-03-30T13:16:32.890 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46815.log 2024-03-30T13:16:32.890 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45744.log.gz 2024-03-30T13:16:32.891 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.43926.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-30T13:16:32.891 INFO:teuthology.orchestra.run.smithi044.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43926.log.gz 2024-03-30T13:16:32.892 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.46815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46815.log.gz 2024-03-30T13:16:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59119.log 2024-03-30T13:16:32.893 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57062.log 2024-03-30T13:16:32.895 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.59119.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-30T13:16:32.895 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59119.log.gz 2024-03-30T13:16:32.896 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57062.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57062.log.gz 2024-03-30T13:16:32.897 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56065.log 2024-03-30T13:16:32.898 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57350.log 2024-03-30T13:16:32.901 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56065.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-30T13:16:32.901 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47594.log 2024-03-30T13:16:32.902 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.56065.log.gz 2024-03-30T13:16:32.902 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57350.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57350.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48056.log 2024-03-30T13:16:32.902 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-03-30T13:16:32.903 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37317.log 2024-03-30T13:16:32.903 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47594.log.gz 2024-03-30T13:16:32.904 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46290.log 2024-03-30T13:16:32.904 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48056.log.gz 2024-03-30T13:16:32.905 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37317.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37317.log.gz 2024-03-30T13:16:32.906 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37395.log 2024-03-30T13:16:32.910 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.46290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48434.log 2024-03-30T13:16:32.910 INFO:teuthology.orchestra.run.smithi044.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46290.log.gz 2024-03-30T13:16:32.910 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.37395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42730.log 2024-03-30T13:16:32.910 INFO:teuthology.orchestra.run.smithi044.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37395.log.gz 2024-03-30T13:16:32.911 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51083.log 2024-03-30T13:16:32.911 INFO:teuthology.orchestra.run.smithi044.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48434.log.gz 2024-03-30T13:16:32.911 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.42730.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42730.log.gz 2024-03-30T13:16:32.912 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.51083.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51083.log.gz 2024-03-30T13:16:32.913 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48560.log 2024-03-30T13:16:32.914 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54839.log 2024-03-30T13:16:32.916 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50789.log 2024-03-30T13:16:32.916 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48560.log.gz 2024-03-30T13:16:32.918 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54839.log: /var/log/ceph/ceph-client.admin.50789.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54839.log.gz 2024-03-30T13:16:32.919 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50789.log.gz 2024-03-30T13:16:32.919 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45083.log 2024-03-30T13:16:32.920 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57020.log 2024-03-30T13:16:32.923 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50081.log 2024-03-30T13:16:32.923 INFO:teuthology.orchestra.run.smithi044.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45083.log.gz 2024-03-30T13:16:32.924 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52168.log 2024-03-30T13:16:32.924 INFO:teuthology.orchestra.run.smithi044.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57020.log.gz 2024-03-30T13:16:32.925 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50081.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50081.log.gz 2024-03-30T13:16:32.926 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45411.log 2024-03-30T13:16:32.927 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52168.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52168.log.gz 2024-03-30T13:16:32.927 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54002.log 2024-03-30T13:16:32.928 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55405.log 2024-03-30T13:16:32.929 INFO:teuthology.orchestra.run.smithi044.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45411.log.gz 2024-03-30T13:16:32.930 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.54002.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54002.log.gz 2024-03-30T13:16:32.930 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47720.log 2024-03-30T13:16:32.932 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55405.log: 90.9%gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-30T13:16:32.932 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55405.log.gz 2024-03-30T13:16:32.933 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.47720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55801.log 2024-03-30T13:16:32.933 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47720.log.gz 2024-03-30T13:16:32.934 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49499.log 2024-03-30T13:16:32.936 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.55801.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.55801.log.gz 2024-03-30T13:16:32.938 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.49499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56825.log 2024-03-30T13:16:32.938 INFO:teuthology.orchestra.run.smithi044.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49499.log.gz 2024-03-30T13:16:32.938 INFO:teuthology.orchestra.run.smithi044.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-30T13:16:32.939 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50915.log 2024-03-30T13:16:32.940 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45086.log 2024-03-30T13:16:32.940 INFO:teuthology.orchestra.run.smithi044.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56825.log.gz 2024-03-30T13:16:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50915.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50915.log.gz 2024-03-30T13:16:32.941 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56743.log 2024-03-30T13:16:32.943 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.45086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57660.log 2024-03-30T13:16:32.943 INFO:teuthology.orchestra.run.smithi044.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45086.log.gz 2024-03-30T13:16:32.944 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.56743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44742.log 2024-03-30T13:16:32.945 INFO:teuthology.orchestra.run.smithi044.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.56743.log.gz 2024-03-30T13:16:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57660.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57660.log.gz 2024-03-30T13:16:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58781.log 2024-03-30T13:16:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.44742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52268.log 2024-03-30T13:16:32.947 INFO:teuthology.orchestra.run.smithi044.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44742.log.gz 2024-03-30T13:16:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.58781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57870.log 2024-03-30T13:16:32.948 INFO:teuthology.orchestra.run.smithi044.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58781.log.gz 2024-03-30T13:16:32.950 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48518.log 2024-03-30T13:16:32.950 INFO:teuthology.orchestra.run.smithi044.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52268.log.gz 2024-03-30T13:16:32.951 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.57870.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57870.log.gz 2024-03-30T13:16:32.951 INFO:teuthology.orchestra.run.smithi044.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52210.log 2024-03-30T13:16:32.952 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.48518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50165.log 2024-03-30T13:16:32.953 INFO:teuthology.orchestra.run.smithi044.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48518.log.gz 2024-03-30T13:16:32.954 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.52210.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52210.log.gz 2024-03-30T13:16:32.955 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.50165.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50165.log.gz 2024-03-30T13:16:33.426 INFO:teuthology.orchestra.run.smithi151.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-30T13:16:33.444 INFO:teuthology.orchestra.run.smithi151.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-30T13:16:33.556 INFO:teuthology.orchestra.run.smithi151.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-30T13:16:33.568 INFO:teuthology.orchestra.run.smithi151.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-30T13:16:33.571 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-03-30T13:16:33.571 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m1.054s 2024-03-30T13:16:33.571 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m3.922s 2024-03-30T13:16:33.572 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m0.456s 2024-03-30T13:16:33.612 INFO:teuthology.orchestra.run.smithi044.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-30T13:16:33.886 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-30T13:16:33.907 INFO:teuthology.orchestra.run.smithi044.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-30T13:16:34.010 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-30T13:16:34.025 INFO:teuthology.orchestra.run.smithi044.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-30T13:16:34.030 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-03-30T13:16:34.030 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m1.515s 2024-03-30T13:16:34.030 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m5.391s 2024-03-30T13:16:34.030 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m1.279s 2024-03-30T13:16:34.031 INFO:tasks.ceph:Archiving logs... 2024-03-30T13:16:34.031 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154/remote/smithi044/log 2024-03-30T13:16:34.032 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T13:16:35.055 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154/remote/smithi151/log 2024-03-30T13:16:35.056 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-30T13:16:35.675 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-30T13:16:35.684 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-30T13:16:35.684 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-30T13:16:35.692 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-30T13:16:35.851 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-30T13:16:35.861 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-30T13:16:35.861 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:16:35.869 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-30T13:16:35.918 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-03-30T13:16:35.923 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-03-30T13:16:35.928 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T13:16:35.928 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-03-30T13:16:35.928 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 35 +74us[ +74us] +/- 95ms 2024-03-30T13:16:35.928 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv02.front.sepia.ceph.com 3 6 377 37 -219us[ -217us] +/- 53ms 2024-03-30T13:16:35.929 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +223us[ +223us] +/- 67ms 2024-03-30T13:16:35.929 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:16:35.931 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-30T13:16:35.931 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-03-30T13:16:35.931 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +114us[ +121us] +/- 95ms 2024-03-30T13:16:35.932 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 -193us[ -186us] +/- 53ms 2024-03-30T13:16:35.932 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 +212us[ +219us] +/- 67ms 2024-03-30T13:16:35.932 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-30T13:16:35.933 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-30T13:16:35.942 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-30T13:16:35.943 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-30T13:16:35.952 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-30T13:16:36.193 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-30T13:16:36.409 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-30T13:16:36.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:16:36.518 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-30T13:16:36.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:16:36.622 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-30T13:16:36.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-30T13:16:36.640 INFO:teuthology.task.internal:Duration was 878.752358 seconds 2024-03-30T13:16:36.641 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-30T13:16:36.650 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-30T13:16:36.651 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T13:16:36.658 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-30T13:16:36.823 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T13:16:36.905 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-30T13:16:37.143 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-30T13:16:37.143 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-03-30T13:16:37.143 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T13:16:37.218 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-03-30T13:16:37.218 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-30T13:16:37.298 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-30T13:16:37.298 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T13:16:37.306 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-30T13:16:37.406 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-30T13:16:37.406 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T13:16:37.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-30T13:16:37.603 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-30T13:16:37.614 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-30T13:16:37.614 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T13:16:37.717 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-30T13:16:37.815 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-30T13:16:37.826 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T13:16:37.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-30T13:16:37.942 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-03-30T13:16:37.947 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-03-30T13:16:38.003 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T13:16:38.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:16:38.054 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-30T13:16:38.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-30T13:16:38.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-30T13:16:38.121 INFO:teuthology.task.internal:Transferring archived files... 2024-03-30T13:16:38.121 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154/remote/smithi044 2024-03-30T13:16:38.122 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T13:16:38.240 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154/remote/smithi151 2024-03-30T13:16:38.241 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-30T13:16:38.348 INFO:teuthology.task.internal:Removing archive directory... 2024-03-30T13:16:38.349 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T13:16:38.357 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-30T13:16:38.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-30T13:16:38.425 INFO:teuthology.task.internal:Not uploading archives. 2024-03-30T13:16:38.425 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-30T13:16:38.457 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-30T13:16:38.457 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T13:16:38.463 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-30T13:16:38.516 INFO:teuthology.orchestra.run.smithi044.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 13:16 /home/ubuntu/cephtest 2024-03-30T13:16:38.521 INFO:teuthology.orchestra.run.smithi151.stdout: 394286 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 30 13:16 /home/ubuntu/cephtest 2024-03-30T13:16:38.525 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-30T13:16:38.541 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-30T13:16:38.562 INFO:teuthology.nuke:Checking targets against current locks 2024-03-30T13:16:38.590 DEBUG:teuthology.nuke:shortname: smithi044 2024-03-30T13:16:38.591 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T13:16:38.617 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 12:52:53.676762', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHTcTYBQ2jxpk8rcJzsWSoaYXcH6H35u4YT/BbNU//5s5R094eBAT2CKdDIquvZQ/lcFnPnLjS2wUYN56GCIixg='} 2024-03-30T13:16:38.621 DEBUG:teuthology.nuke:shortname: smithi151 2024-03-30T13:16:38.621 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-30T13:16:38.643 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_13:38:54-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629154', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-30 12:52:53.678725', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG9UJ+Hq2NYgak2LvH0ObOKoIyQPk5Hw1kpe6/jE2GSyXUIunDKTKky+sQlaAgoiVYmgmrk/e7vohRdkcZ9+gqY='} 2024-03-30T13:16:38.674 INFO:teuthology.orchestra.console.smithi044:Power off 2024-03-30T13:16:38.674 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T13:16:38.703 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2024-03-30T13:16:38.704 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:16:38.722 INFO:teuthology.orchestra.console.smithi151:Power off 2024-03-30T13:16:38.723 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-30T13:16:38.733 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-03-30T13:16:38.745 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2024-03-30T13:16:38.745 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:16:38.768 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-03-30T13:16:42.734 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:16:42.770 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:16:42.845 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-03-30T13:16:42.881 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-03-30T13:16:46.850 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:16:46.882 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:16:46.961 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-03-30T13:16:46.993 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-03-30T13:16:47.063 INFO:teuthology.orchestra.console.smithi044:Power off completed 2024-03-30T13:16:50.998 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-30T13:16:51.109 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2024-03-30T13:16:51.210 INFO:teuthology.orchestra.console.smithi151:Power off completed 2024-03-30T13:16:51.315 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 client.1-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/uninlining} duration: 878.7523581981659 failure_reason: 'Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=36431adacf1c43ef911b3b0550fdf5bb status: fail success: false 2024-03-30T13:16:51.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-30T13:16:51.410 INFO:teuthology.run:FAIL